CN111580923B - Control method and device and electronic equipment - Google Patents

Control method and device and electronic equipment Download PDF

Info

Publication number
CN111580923B
CN111580923B CN202010418716.9A CN202010418716A CN111580923B CN 111580923 B CN111580923 B CN 111580923B CN 202010418716 A CN202010418716 A CN 202010418716A CN 111580923 B CN111580923 B CN 111580923B
Authority
CN
China
Prior art keywords
display unit
application interface
target
input
target object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010418716.9A
Other languages
Chinese (zh)
Other versions
CN111580923A (en
Inventor
毛毳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN202010418716.9A priority Critical patent/CN111580923B/en
Publication of CN111580923A publication Critical patent/CN111580923A/en
Application granted granted Critical
Publication of CN111580923B publication Critical patent/CN111580923B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The method comprises the steps of outputting a first application interface comprising at least one object identifier on a target display unit based on an obtained first input, further displaying and outputting a second application interface corresponding to the target object identifier based on an obtained second input acting on the target object identifier determined from the at least one object identifier, namely enabling the target object by obtaining the first input and the second input, and obviously having the advantages of simple and convenient operation, short time consumption, high efficiency and the like compared with a mode of enabling the object by performing a series of complex operations such as path searching, selecting, opening and the like in the prior art; in addition, under the condition that the second application interface or the target application process corresponding to the target object is closed, the second application interface of the target object can be displayed again at least based on the obtained third input, the efficiency and the convenience of starting the target object are further improved, and time consumption is reduced.

Description

Control method and device and electronic equipment
Technical Field
The application belongs to the field of human-computer interaction, and particularly relates to a control method and device and electronic equipment.
Background
Currently, when a terminal such as a mobile phone, a notebook, or a desktop is used, a user usually needs to enable a required device object through a series of complicated operations. For example, the device object is searched and selected by the mouse according to the path of the device object, and then the selected device object is opened by double-clicking the left button of the mouse (or pressing the enter key).
However, these methods for enabling device objects are based on complex operations of users, which are inefficient, time-consuming, and difficult to meet the requirements of users for enabling device objects quickly and conveniently.
Disclosure of Invention
Therefore, the application discloses the following technical scheme:
a control method, comprising:
obtaining a first input, and outputting a first application interface on a target display unit, wherein the first application interface comprises at least one object identifier;
obtaining a second input which is used for determining a target object identifier from the at least one object identifier, and displaying and outputting a second application interface corresponding to the target object identifier, wherein the second input is the same as or different from the first input;
and under the condition that the target application process corresponding to the second application interface or the target object identification is closed, redisplaying the second application interface at least based on obtained third input, wherein the third input is the same as or different from the second input.
A control method, comprising:
obtaining a first key signal generated by executing a first operation on a first key, and displaying and outputting a first application interface according to the first key signal, wherein the first application interface comprises at least one application object identifier;
obtaining a target object identifier determined by executing a second operation on the first key;
displaying and outputting a second application interface corresponding to the target object identifier; or the like, or, alternatively,
and acquiring a third operation executed on the first key so as to start the application program corresponding to the target object identification to enter a second application interface.
A control device, comprising:
the first output control unit is used for obtaining a first input and outputting a first application interface on the target display unit, wherein the first application interface comprises at least one object identifier;
the second output control unit is used for obtaining a second input which is used for determining a target object identifier from the at least one object identifier, and displaying and outputting a second application interface corresponding to the target object identifier, wherein the second input is the same as or different from the first input;
and the third output control unit is used for redisplaying the second application interface at least based on an obtained third input under the condition that the second application interface or a target application process corresponding to the target object identification is closed, wherein the third input is the same as or different from the second input.
A control device, comprising:
the device comprises an acquisition unit, a processing unit and a display unit, wherein the acquisition unit is used for acquiring a first key signal generated by executing a first operation on a first key so as to display and output a first application interface according to the first key signal, and the first application interface comprises at least one application object identifier; obtaining a target object identification determined by executing a second operation on the first key;
the control unit is used for displaying and outputting a second application interface corresponding to the target object identifier; or starting the application program corresponding to the target object identification to enter a second application interface based on the third operation executed on the first key.
An electronic device, comprising:
a memory for storing at least one set of instructions;
a processor for calling and executing the instruction set in the memory, the control method as described in any one of the above being performed by executing the instruction set.
A storage medium storing at least one set of instructions for implementing a control method as claimed in any one of the preceding claims when called and executed.
According to the scheme, the control method, the control device and the electronic equipment provided by the application have the advantages that based on the obtained first input, the first application interface comprising at least one object identifier is output on the target display unit, and further based on the obtained second input which is used for determining the target object identifier from the at least one object identifier, the second application interface corresponding to the target object identifier is displayed and output, namely, the target object can be enabled by obtaining the first input and the second input; in addition, under the condition that the second application interface or the target application process corresponding to the target object is closed, the second application interface of the target object can be displayed again at least based on the obtained third input, the efficiency and the convenience of starting the target object are further improved, and time consumption is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic flow chart of a control method provided in an embodiment of the present application;
fig. 2 is a diagram of an example of a target display unit in a book (tent) mode provided in an embodiment of the present application;
fig. 3 is a diagram illustrating an example of determining a target display unit when an extended display unit is externally connected according to an embodiment of the present disclosure;
fig. 4 (a) and 4 (b) are exemplary diagrams of determining a target display unit in a notebook mode and a book (tent) mode, respectively, according to an embodiment of the present application;
FIG. 5 is an exemplary diagram for displaying and outputting a second application interface in the case of an external extension display unit according to an embodiment of the present application;
FIG. 6 is a schematic flow chart of a control method according to an embodiment of the present disclosure;
FIG. 7 is a schematic flow chart of another control method provided by the embodiments of the present application;
fig. 8 is another schematic flow chart of another control method according to the embodiment of the present application;
FIG. 9 is an exemplary diagram of enabling a target object based on a single key super provided by an embodiment of the present application;
FIG. 10 is a schematic flow chart of another control method provided by the embodiment of the present application;
fig. 11 is a schematic structural diagram of a control device according to an embodiment of the present application;
FIG. 12 is a schematic structural diagram of another control device provided in the embodiments of the present application;
fig. 13 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In a scenario of using a terminal device, a user usually wants to enable a target object in the device conveniently and quickly by performing some simple operations, such as quickly enabling some applications, web pages, or documents, however, in the conventional technology, the user generally needs to use an input device (such as a mouse, a keyboard, a touch screen, etc.) to enable the target object by performing a series of complicated operations such as path finding, selecting, and opening (such as double-clicking an object icon or pressing an enter key in a state of selecting the object icon), which is inefficient and time-consuming, and is difficult to meet the requirement of the user for quickly and conveniently enabling the device object.
In view of the above, the present application discloses a control method, a control device and an electronic device, so as to at least solve the above technical problems.
In an optional embodiment, a control method is provided, where the control method may be applied to a mobile terminal such as a mobile phone and a tablet, or may also be applied to a computer device such as a notebook, a desktop, or an all-in-one machine, and is not limited herein; and is particularly applicable to a scenario in which a user operates an electronic device such as the mobile terminal or the computer device described above to enable one or more target objects in the device.
The processing of the method is described below in conjunction with fig. 1, and as shown in fig. 1, the method may include the following processing steps:
step 101, obtaining a first input, and outputting a first application interface on a target display unit, wherein the first application interface comprises at least one object identifier.
The first input may be user input information obtained by the electronic device based on an entity input or acquisition device such as a physical keyboard, a sound acquisition device (e.g., mic), an image acquisition device (e.g., a camera, an infrared device), etc., or user input information obtained by the electronic device based on a virtual input device such as a virtual keyboard, etc., in the electronic device, and accordingly, the device user may provide the first input to the electronic device through any one or combination of any multiple of modes such as keyboard information entry, voice, gesture, lip language, etc.
The first input is used for instructing the electronic equipment to output a first application interface comprising at least one object identifier on the target display unit so as to provide convenience support for a user to quickly enable the target object from the first application interface.
Optionally, the first application interface may be displayed in the form of a window, an OSD (on-screen display), a floating window, or the like, and may be displayed in all or a part of a specific area of the target display unit, for example, preferably, a preset edge area in one or more directions (up, down, left, and right) of the target display unit so as not to affect the display of the current content on the target display unit as much as possible. And optionally, the first application interface may have a certain transparency, so that even if there is content on the target display unit that is occluded by the first application interface, the occluded content is not affected to be viewed by the user.
The target display unit may be one or more display units determined from display units of the electronic device itself as an execution subject, for example, at least one display screen may be determined from a single-screen/multi-screen mobile phone, a tablet, a computer, or a display screen of the electronic device itself as a target display unit for displaying and outputting the first application interface.
But not limited to, the target display unit may also be at least one display unit for displaying and outputting the first application interface, which is determined from one or more extended display units and a screen projection display unit of the electronic device.
It is to be understood that the target display unit may also be at least one display unit for displaying the first application interface, which is determined from a display unit provided in the electronic device itself and the one or more extended display units.
The extended display unit of the electronic device may be, but is not limited to, a display/display screen externally connected to the electronic device, and/or a screen projection display unit, for example, a projection screen for forming display content based on light path projection, or, for example, when a mobile phone projects a screen to a computer or a computer projects a screen to a tablet pad, the computer may be used as the screen projection display unit of the mobile phone device, the tablet pad may be used as the screen projection display unit of the computer, the electronic device and the extended display/display screen may be connected by a cable, or may be connected wirelessly by bluetooth, wifi, or the like.
An object identifier in the first application interface includes information such as an object icon, an object name, and/or an object number that can be used to identify a particular object. The object corresponding to the object identifier may be any object that can be operated or used by a user in the electronic device, such as an application program, a file, a folder, a web page, and the like, but is not limited thereto, and any object that can be operated or used by a user in the electronic device all belong to the objects to which the control method is applicable, and are within the scope of protection of the present application.
And 102, obtaining a second input which is used for determining a target object identifier from the at least one object identifier, and displaying and outputting a second application interface corresponding to the target object identifier, wherein the second input is the same as or different from the first input.
The second input is used for determining a target object identifier from at least one object identifier included in the first application interface, and the target object identifiers determined based on the second input can be one or more.
Similar to the first input, the second input may also be an input provided by the user to the electronic device by any one of or any combination of keyboard information entry, voice, gesture, lip language, and the like.
Also, the second input may be the same or different from the first input.
Under the condition that the second input is the same as the first input, if the second input and the first input are both inputs triggered by a user pressing a certain key or a certain key combination, the electronic device can analyze the operation intention of the input in combination with the device state, and further realize correct response to the corresponding input based on the operation intention corresponding to the device state, for example, when the user presses a certain specific key or key combination, the state of the first application interface is not displayed and output by the electronic device, the user intention is analyzed to call the first application interface, and therefore in response to the input, the first application interface comprising at least one object identifier is output on the target display unit; for the above operation, based on the state of the electronic device that has displayed and output the first application interface, a second application interface that the user intends to call up a target object may be analyzed, and in response to the input, a target object identifier is determined from at least one object identifier of the first application interface, and the second application interface corresponding to the target object identifier is displayed and output.
The target object corresponding to the target object identifier is a device object such as an application, a file, a folder, a web page, and the like, and the second application interface for display output may be an application interface (such as a game interface, an instant messaging interface, and the like), a file content interface, a folder expansion interface, a web page, and the like, which is not limited herein.
Therefore, the target object in the electronic equipment is enabled by calling out the first application interface including at least one object identifier based on the first input (providing convenience support for a user to quickly enable the target object from the first application interface), and further displaying and outputting the second application interface corresponding to the target object identifier based on the second input, so that the operation is simple and efficient, and the consumed time is low.
Step 103, under the condition that the second application interface or the target application process corresponding to the target object identifier is closed, redisplaying the second application interface based on at least obtained third input, wherein the third input is the same as or different from the second input.
In addition, after the second application interface of the output target object is displayed based on the first input and the second input, if the user closes the second application interface or closes the target application process corresponding to the target object identifier according to the actual use situation, in this case, the second application interface of the target object can be displayed again directly by obtaining a third input for the target object which is activated nearby, and the target object does not need to be activated again by executing the first input and the second input, so that the purposes of further simplifying the user operation, saving time and improving efficiency are achieved.
The third input may also be an input provided by the user to the electronic device through any one of or any combination of keyboard information entry, voice, gesture, lip language, and the like, without limitation.
Here, closing the second application interface means that the interface display function of the target object is closed in the foreground display area of the device, but the process of the target object is still running in the background; in contrast, if the target application process corresponding to the target object identifier is closed, the process of the target object is closed at the device, and it is easy to understand that the target object no longer runs on the device under the condition, and the device foreground does not display any interface information of the target application process.
Whether the second application interface of the target object is closed or the process of the second application interface is closed, the second application interface of the target object can be conveniently displayed again at least based on the third input, and the target object can be enabled again more quickly and efficiently.
And, the third input and the second input (or the first input) may be the same or different, wherein, in the case that the third input is the same as the second input (or the first input), the electronic device may also analyze the operation intention of the input in conjunction with the device state, and further implement a correct response to the corresponding input based on the operation intention corresponding to the device state, for ease of understanding, specific reference may be made to the above description about the intention analysis and response in the case that the second input is the same as the first input, and details thereof are not described here.
In the embodiment, the execution main body equipment end can start the target object by obtaining the first input and the second input, and compared with a mode of starting the object by executing a series of complex operations such as path searching, selecting and opening in the traditional technology, the method obviously has the advantages of simple and convenient operation, short time consumption, high efficiency and the like; in addition, under the condition that the second application interface or the target application process corresponding to the target object is closed, the second application interface of the target object can be displayed again at least based on the obtained third input, the efficiency and the convenience of starting the target object are further improved, and time consumption is reduced.
In an optional embodiment, in the step 101, obtaining the first input, and outputting the first application interface on the target display unit may be implemented by:
under the condition of obtaining a first input acting on at least one key of the electronic equipment, determining a target display unit from a display unit of the electronic equipment and/or an external display unit, and outputting the first application interface on the target display unit.
The at least one key is a physical key or a virtual key. It is understood that, specifically, one physical key or one virtual key, or a key combination of a plurality of (e.g., two or more) physical keys or virtual keys may be used.
In this embodiment, the user may operate a particular key or a particular combination of keys in the physical or virtual keyboard of the device to enable the provision of the first input to the device.
The electronic equipment can obtain a first input triggered by a user based on operation of a specific key or a specific key combination through key signal detection, and further responds to the first input, a target display unit is determined from a display unit of the electronic equipment and/or an external display unit, so that the first application interface is output on the target display unit.
Preferably, in order to further improve the convenience of the user operation, in the implementation, the at least one key may be set as a certain key on the physical keyboard or the virtual keyboard of the device, which is referred to as a super key in this implementation. The super key can be any specific key on a physical keyboard or a virtual keyboard of the device, such as an F1 key, so that a user can directly operate (such as tap, double tap, or long-press) the physical or virtual super key (such as the F1 key) to provide a first input to the device, and further display and output a first application interface on the device itself or an external display unit (a display/display screen or a screen projection display unit) associated with the device, so that the user can conveniently and conveniently invoke a required target object.
In an optional embodiment, in the step 101, obtaining the first input, and outputting the first application interface on the target display unit may further be implemented by the following implementation manners:
under the condition that the electronic equipment obtains a first input for representing first instruction information, a target display unit is determined from a display unit of the electronic equipment and/or an externally connected display unit, and the first application interface is output on the target display unit.
In this embodiment, as an optional implementation, the first input may include a voice command input.
A user can provide a first input comprising a voice instruction to the electronic equipment in a voice mode, the electronic equipment acquires the user voice based on a sound acquisition device such as the electronic equipment or an external mic and the like, analyzes the voice instruction used for indicating and displaying the output first application interface, and then responds to the instruction, determines a target display unit from a display unit of the electronic equipment and/or an external display unit, so as to output the first application interface on the target display unit.
The voice input by the user to the device can be appointed voice as an instruction, such as a 'shortcut interface'; or it may be a voice including an agreed instruction, such as "please display a shortcut interface immediately"; or, the command can also be voice meeting the condition of similarity with the appointed command, such as 'quick interface', 'super interface'; or, the instruction meeting the similarity condition with the appointed instruction may be included in the voice, such as "please display the quick interface immediately", "please display the super interface as soon as possible", and the like. The electronic device can correctly acquire the intention of the user to call the first application interface based on semantic analysis of the input voice, and then the input voice can be used as an effective voice instruction of the first application interface.
The above examples, assume that the agreed voice command is a "shortcut interface".
As another alternative, the first input may comprise a string command input.
In this embodiment, the user may use the device itself or an external input device (e.g., a keyboard, a mic, etc.) to input a specific character string indicating the first application interface to the device, so as to provide the first input to the electronic device.
The specific character string may be, for example, "Super interface", or, for simplicity of input, a predetermined character combination or single character of a small number of characters, such as "SI" (for Super interface), or even "S", etc.
It should be noted that, in this embodiment, the input character string command may also be a strict appointment character string command, or may also be a character string command including an appointment character string (including other characters), or may also be a character string including a proximity/similarity to the appointment character string that exceeds a threshold (for example, when a user enters a Super interface, a certain character entry error is also able to be resolved effectively).
As yet another alternative, the first input may include a gesture command input and/or a lip language command input.
In this embodiment, the user may provide the first input to the electronic device based on a gesture and/or a lip language manner, the electronic device collects RGB image/video information of the user gesture or lip movement and/or infrared image/video information by using an image collection device and/or an infrared device of the electronic device, analyzes the user gesture information and the lip movement based on the collected gesture image/video information and/or the image/video of the lip movement, identifies a gesture instruction and/or a lip language instruction of the user according to the user gesture information and/or the lip movement, and determines a target display unit from a display unit of the electronic device and/or an external display unit in response to the instruction, so as to output the first application interface on the target display unit.
The gesture for instructing the electronic device to display and output the first application interface may be a touch gesture performed on a display interface of the electronic device or an air gesture in non-contact with the electronic device. Illustratively, the gesture can be executed on a display interface of the electronic device or a gesture of changing five fingers which are not in contact with the electronic device from a gathering state to an unfolding state.
In this embodiment, a user may provide, to the electronic device, a first input for instructing to display and output the first application interface in any manner such as a key instruction, a voice instruction, a string instruction, a gesture instruction, a lip language instruction, and the like, and the user is simple to operate and has various forms, and based on the first input, the first application interface including at least one object identifier may be called, so that a convenient support is provided for the user to quickly launch a target object from the first application interface.
In an optional embodiment, the determining the target display unit from the display unit of the electronic device itself and/or the external display unit may specifically be implemented as:
the method comprises the steps of obtaining operation information of the electronic equipment and/or display parameters of each display unit, and determining at least one of the display unit of the electronic equipment and/or an external display unit as the target display unit according to the operation information and/or the display parameters.
The operation information of the electronic device may include, but is not limited to, any one or more of operation mode information, operation application information, operation state information, and the like of the execution main body electronic device and/or an external electronic device (e.g., an electronic device corresponding to an external display screen).
The operation mode information may be information for executing a corresponding mode of the main electronic device and/or the external electronic device in a single-screen mode or a multi-screen mode, or information for executing a corresponding mode of the notebook mode, the book mode (which may also be understood as a tent mode), the tablet mode, the cover closing mode, or the like, or information for executing a corresponding mode of the non-external display screen, the screen projecting mode, or the like, which is not limited herein; the operating state information may be information related to a current operating state of the main electronic device and/or the external electronic device, such as state information of normal operation, suspension, standby, and the like; the running application information may be information such as the number and types of objects (such as started application programs, opened web pages, documents, and the like) which are respectively run and displayed by the main electronic device and/or the external electronic device.
The display parameters of each display unit of the electronic device may include, but are not limited to, any one or more of size, refresh rate, resolution, chromaticity, brightness, display position (such as display position of an existing window), and other parameter information of a display unit (external display/display screen or screen projection display unit) of the main electronic device and/or the external electronic device.
In this embodiment, based on the operation information of the electronic device and/or the display parameters of each display unit, at least one display unit with a better value of each parameter may be preferentially selected from the display unit of the electronic device itself and/or the external display unit as a target display unit for displaying and outputting the first application interface, specifically, for example, different weights may be respectively set for different values of the operation mode information, the operation application information, the operation state information, the display parameter information, or values in different value intervals, and based on the weighted sum of multiple types of parameter values, at least one display unit may be preferentially selected from the display unit of the electronic device itself and/or the external display unit to be determined as the target display unit.
Or, as another embodiment, at least one display unit meeting the parameter condition (for example, corresponding conditions meeting requirements may be set for the operation mode information, the operation application information, the operation state information, and the display parameter, respectively) may be selected from the display unit of the electronic device itself and/or an external display unit as the target display unit.
The following examples are given.
Referring to fig. 2, it is assumed that the electronic device has no external display unit and operates in a book (tent) mode, and the electronic device has two display units: the first display unit displays an application interface outputting a plurality of objects, the second display unit displays no object or only displays a small number of application interfaces, and the second display unit is determined to be a target display unit based on a weight summation or a condition determination and the like, so that the first application interface is displayed and output on the second display unit, and the first application interface is displayed and output on the second display unit instead of the first display unit, thereby not interfering with the content presented by the first display unit, enabling a user to visually and vividly view the first application interface without interference of other objects (or objects as few as possible), and further realizing balance of display task quantities of different display units.
For another example, assuming that the electronic device is a tablet device externally connected with an extended display unit, as shown in fig. 3, if the user tablet has operated and displayed an interface with a plurality of objects on its display unit, and the user tablet is externally connected with an extended display unit that does not display output or displays a few object interfaces, or the number of the object interfaces displayed and output by the tablet itself display unit and the external display unit is not significantly different, but the display parameters of the external display unit are better than those of the tablet itself display unit, such as having higher resolution and softer chromaticity/brightness, or the external display unit does not display any object interface window (where the position on the tablet itself display unit is occupied) at a specific position (such as a bottom edge area of the display screen) occupied by the first application interface (which needs to be output), and so on, the external display unit may be preferably a target display unit for outputting the first application interface, as shown in fig. 3 in particular. Fig. 2 and fig. 3 above are merely exemplary applications, but are not limited thereto.
In an optional embodiment, determining the target display unit from the display unit of the electronic device itself and/or an external display unit may further be implemented as:
the method comprises the steps of obtaining input position information of a first input, and determining a target display unit from a display unit of the electronic equipment and/or an external display unit according to the input position information.
The input position information of the first input is associated with an input manner of the first input.
The input position information of the first input may specifically be a position where an input device associated with the first input is generated and/or an associated collecting device collecting information of the first input is located.
For example, if the first input is an input based on a key instruction, the input position information of the first input may be position information corresponding to a keyboard device (physical or virtual) generating the key instruction, and more specifically, corresponding to a key instruction generated by the device own keyboard, or a key instruction generated by the external keyboard, and position information representing the device own keyboard or position information representing the external keyboard may be used as the input position information of the first input.
If the first input is based on a voice command, a character string command, a gesture command, a lip language command, or the like, the input location information of the first input may be location information corresponding to a corresponding acquisition device that acquires the corresponding command, such as location information of a mic, a camera, an infrared device, or the like that acquires the command, more specifically, location information representing the acquisition device of the device itself or location information representing the external acquisition device of the device may be used as the input location information of the first input, corresponding to the acquisition device of the device itself acquiring the corresponding command, or the external acquisition device acquiring the corresponding command.
It should be noted that the input position information of the first input may be specific information representing an actual physical position, such as position information represented by a spatial position coordinate or by a direction, an included angle, and/or a distance, or may be information having a position directivity represented by an appointed character, such as "0" representing that the input position of the first input is an apparatus own position (corresponding to that the apparatus own input device/acquisition device is used to obtain the first input), and "1" representing that the input position of the first input is an apparatus external position (corresponding to that the apparatus external input device/acquisition device is used to obtain the first input).
In this embodiment, at least one display unit matching the input position information is determined as a target display unit from a display unit of the electronic device itself and/or an external display unit according to the input position information of the first input.
Specifically, the input position of the first input generally represents the user position, so that a display unit, which accords with the position condition (such as the nearest distance) with the input position of the first input, in the electronic device itself and/or an external display unit, can be selected as a target display unit for outputting the first application interface, so as to facilitate the user to view or operate the first application interface.
In addition, the input position of the first input may also represent the intention of the user, and if the user desires to use the display unit of the device itself for display (or desires to use the display unit externally connected), it is easier to directly use the input device/acquisition device corresponding to the display unit of the device itself (or the display unit externally connected) for providing the first input, so that the obtained input position of the first input may be used for user intention analysis, and the display unit matching the intention of the user may be selected as the target display unit, for example, if the input position of the first input is "0" representing the position of the device itself, the display unit of the device itself may be used as the target display unit, and if the input position of the first input is "1" representing the position outside the device, the external display unit may be correspondingly used as the target display unit, and so on.
It should be noted that, if the device's own acquisition device and the external acquisition device both acquire the first input, optionally, the determination of the input position information of the first input may be performed based on the acquisition device corresponding to the acquisition information that has the best acquired signal quality and the largest useful information amount or is actually adopted by the electronic device.
In an optional embodiment, the determining the target display unit from the display unit of the electronic device itself and/or the external display unit may further be implemented as:
and obtaining object identification information of the first application interface to be output, and determining at least one of a display unit of the electronic equipment and/or an external display unit as the target display unit according to the display parameters of each display unit of the electronic equipment and the object identification information.
As described above, the display parameters of each display unit of the electronic device may include, but are not limited to, any one or more of parameter information such as size, refresh rate, resolution, chromaticity, brightness, display position (e.g., display position of an existing window), and the like of the display unit of the main electronic device and/or the external electronic device.
The object identification information of the first application interface may include the number of the object identifications included in the first application interface, and specific composition information of the object identifications (e.g., whether the object identifications are specifically composed of images/icons, characters, or a combination of images/icons and characters, etc., and the complexity and easy recognition of the object identifications, etc.).
In this embodiment, the display parameters of the device itself or the external display units and the object identification information included in the first application interface to be displayed are comprehensively analyzed, and at least one of the device itself and/or the external display unit that is adapted to the object identification information of the first application interface is selected and determined as the target display unit for the display output of the first application interface.
For ease of understanding, the following is exemplified.
If the number of object identifiers included in the first application interface is large, or if the composition of at least some object identifiers included in the first application interface is complex or the similarity of icons is high and difficult to uniquely identify, it is required to display and output the first application interface in a larger size and/or higher resolution as possible, and accordingly, at least one display unit with better size and/or resolution parameters or meeting the conditions can be selected from the device itself and/or the external display unit as the target display unit.
For another example, assuming that icons of some object identifiers included in the first application interface are similar in composition or shape and are mainly differentiated by color, at least one display unit with better rendering performance (which may be characterized based on chromaticity and/or brightness) may be preferentially determined as the target display unit.
In an optional embodiment, the determining the target display unit from the display unit of the electronic device itself and/or the external display unit may further be implemented as:
under the condition that the electronic equipment is in the first mode, obtaining use scene information of the electronic equipment and/or first display parameters of the display unit of the electronic equipment, and determining at least one of the display units of the electronic equipment as the target display unit according to the use scene information and/or the first display parameters.
The first mode is a normal use mode of the electronic device, more specifically a mode in which the electronic device does not extend the display unit.
In the first mode, the usage scenario information of the electronic device may include, but is not limited to, scenario information of different modes, such as a notebook mode, a book (tent) mode, a tablet mode, and a cover closing mode. The electronic device can utilize at least part of sensing elements in a gravity sensor, a gyroscope, an angle sensor, a distance sensor and the like to sense the posture of the device, and further analyze the use scene of the device based on the posture information of the device.
The first display parameter of the display unit of the electronic device itself includes, but is not limited to, one or more of information such as a display size of the display unit itself, a display task amount corresponding to existing display content, a display position, an idle state, power consumption, and the like. The electronic device may obtain the first display parameter information based on task monitoring, display position monitoring, or power consumption monitoring of a display unit of the electronic device.
As for the above-described first mode of the electronic device, optionally, the present embodiment determines at least one of the display units of the electronic device itself as the target display unit based on usage scenario information of the electronic device, such as a notebook mode, a book (tent) mode, a tablet mode, and a cover closing mode.
For example, taking a mobile phone or a tablet having a folding function as an example, as shown in fig. 4 (a) -4 (b), a display unit at a position other than the bottom surface is determined as a target display unit in the notebook mode, and a left side display unit is determined as a target display unit in the book mode.
In another embodiment, at least one display unit used as a target display unit may be selected from the display units of the electronic device itself based on one or more first display parameters of information such as display task amount, display position, idle state, power consumption and the like corresponding to the existing display content of the display unit of the electronic device itself.
The display unit with less display task amount, idleness and lower power consumption corresponding to the existing display content in the display unit of the electronic equipment can be preferentially selected, and/or the display unit with an idle state at a specific position (such as an edge area in a certain direction of the display unit) occupied by the first application interface to be output can be preferentially selected as the target display unit.
In another embodiment, the determination of the target display unit may be further performed in combination with the usage scenario information of the electronic device and the first display parameter of the display unit of the electronic device itself.
By way of example:
still taking a mobile phone or a tablet with a folding function as an example, in the notebook mode, the display unit in the non-bottom position is preferentially selected as the target display unit, but when the display task amount and/or the number of displayed application windows and/or the power consumption of the display unit in the non-bottom position exceed a first threshold, or the display task amount and/or the number of displayed application windows and/or the power consumption of the display unit in the non-bottom position and the display task amount and/or the number of displayed application windows and/or the power consumption of the display unit in the bottom position exceed a second threshold, the display unit in the bottom position is selected as the target display unit.
In an optional embodiment, the determining the target display unit from the display unit of the electronic device itself and/or the external display unit may further be implemented as:
and under the condition that the electronic equipment is in the second mode, obtaining the use object information of the electronic equipment and/or second display parameters of the extended display unit, and determining at least one of the extended display units of the electronic equipment as the target display unit according to the use object information and/or the second display parameters.
The second mode is a mode of extending the display unit of the electronic device, and can also be understood as an extended mode of the electronic device.
The usage object information of the electronic device may include, but is not limited to, location information of a usage object of the electronic device, relative location information of the usage object to the electronic device, or rank/priority of the usage object, and the location information or the relative location information may be represented based on the spatial coordinate data, or may also be represented based on the direction, angle, and/or distance data.
The second display parameter of the extended display unit may include, but is not limited to, a display size, a resolution, brightness, and chromaticity of the extended display unit, a display task amount corresponding to the existing display content, a display position, an idle state, power consumption, and other information.
Alternatively, in a case where the electronic device is in the second mode, usage object information of the electronic device may be obtained, and at least one of the extended display units of the electronic device may be determined as the target display unit according to the usage object information.
In a specific implementation, the position information or the relative position information may be obtained by analyzing the image information of the object to be used and the environment collected by the camera/infrared device, or the position information or the relative position information of the object to be used may be obtained by analyzing the position of the sound source of the voice emitted by the object to be used, and at least one display unit in the extended display unit of the electronic device, which is matched with the position information or the relative position information of the object to be used, is determined as the target display unit.
The following exemplary application scenario provides a typical application scenario, in which a plurality of client-facing display screens are externally connected to a service staff host (which has a service staff-facing display screen itself), when performing a specific service, at least one display screen matched with a client position can be selected from the externally connected display screens by detecting client position information as a target display unit for displaying a first application interface (for the service handling scenario, the first application interface may include service identifiers of a plurality of different services), for example, a display screen closest to the client or at least one display screen directly in front of the client (an angle between a vertical line of the client is 90 ° or close to 90 °) is selected as the target display unit, and so on.
For another example, for the above scenario, if the external different display screens are respectively used for displaying differentiated service information for the customers with different levels/priorities, the display screen matched with the customer level/priority information in the external display screens may be automatically used as the target display unit, which is easy to understand.
Optionally, when the electronic device is in the second mode, second display parameters of the extended display units of the electronic device may also be obtained, and at least one of the extended display units of the electronic device may be determined as the target display unit according to the second display parameters.
Specifically, for example, a display unit with better display performance (which may be characterized based on resolution, size, brightness, chromaticity, and the like) in the extended display unit is preferentially used as the target display unit, or a display unit in an idle state in the extended display unit, or a display unit with less current display task amount/less power consumption, or a specific output position that needs to be occupied by the display output of the first application interface is preferentially used as the target display unit, or the display performance, the task amount, the power consumption, and the busy state may be comprehensively measured to perform preferential selection, which is not limited.
Optionally, in a case where the electronic device is in the second mode, it is also possible to obtain usage object information of the electronic device and second display parameters of the extended display units, and determine at least one of the extended display units of the electronic device as the target display unit by integrating information according to the two aspects.
For example, from a portion of the external display units that meet the location condition with the user location, a display unit with better display performance and/or less display task amount, less power consumption, or a specific output location that needs to be occupied by the display output of the first application interface is further determined as a target display unit.
In addition, in implementation, the target display unit may be determined in the display unit of the electronic device itself or in the display unit of itself and the extended display unit based on the information of the usage object, such as the position information of the usage object, the relative position information of the usage object and the electronic device, the level/priority information of the usage object, and the like, which are not illustrated.
In an optional embodiment, determining the target display unit from the display unit of the electronic device itself and/or an external display unit may further be implemented as:
and under the condition that the electronic equipment is in a third mode, obtaining third display parameters of the screen projection display units of the electronic equipment, and determining at least one of the screen projection display units of the electronic equipment as the target display unit according to the third display parameters.
The third mode is a screen projection mode.
In the third mode, the electronic device may be externally extended with one or more projection units, each of which may form display content based on optical path projection.
The third display parameter of the projection screen display unit may include, but is not limited to, any one or more of a size, a definition, a distance from the projection source, an idle state, a display task amount corresponding to existing display content, a display position, and the like of the projection screen display unit.
In this embodiment, the third display parameters of the screen projection display units of the electronic device are obtained, and at least one of the screen projection display units of the electronic device is determined as the target display unit according to the third display parameters.
When at least one of the projection screen display units of the electronic device is determined as the target display unit according to the third display parameter, specifically, the projection screen display unit with high definition is preferred, or the projection screen display unit with a distance meeting a distance condition with a projection source is preferred, or the projection screen display unit in an idle state or with a small current display task amount is preferred, or the projection screen display unit with a preset specific position (that is, the position does not display content) is preferred, or a plurality of factors such as size, definition, a distance with the projection source, a display task amount corresponding to the existing display content, a display position, an idle state and the like are comprehensively considered, and at least one projection screen display unit with comprehensive evaluation meeting the expectation is selected as the target display unit for outputting the first application interface based on a set selection strategy.
After the target display unit is determined from the display unit and/or the extended display unit of the electronic device itself based on any of the above embodiments, the first application interface including at least one object identifier is further output at the determined target display unit.
The first application interface is output on the target display unit, and optionally, the first application interface may be integrally displayed on a single target display unit, for example, the application interface is integrally displayed on a single target display unit of the device itself, an external single target display unit, or a single projection screen display unit.
Or, optionally, the first application interface may also be synchronously or asynchronously displayed on two or more target display units, and specifically, the first application interface may be synchronously or asynchronously displayed on any two or more target display units of the device display unit, the external display unit, and the screen projection display unit.
Or, optionally, the first application interface may also be displayed in a split manner on two or more target display units, and the object identifiers of the first application interface displayed on different target display units are different.
In implementation, each object identifier included in the first application interface can be divided into two or more groups by adopting a set division strategy, and different groups are respectively displayed on different target display units with corresponding quantity; the specific segmentation strategy can be determined according to a use object of the electronic device (such as position information of the use object), a use scene (book mode, notebook mode, tablet mode, etc.), and/or display parameters (display task amount, idle state, resolution) of the electronic device itself or an external display unit (display/display screen, projection screen), etc.
Furthermore, the output mode (for example, a single target display unit is adopted for overall output, two or more target display units are adopted for synchronous or asynchronous output, two or more target display units are adopted for split output, and the like), the output position and/or the interface display parameters of the first application interface can be determined according to information such as the use object of the electronic equipment, the use scene, the display parameters of the electronic equipment or an external display unit, the equipment form and whether the electronic equipment is provided with related equipment (an external display unit, a screen projection display unit, and the like).
The output position of the first application interface is a specific display position of the whole or part of the first application interface on the corresponding target display unit, and the interface display parameters may include, but are not limited to, information such as an icon display state and an icon layout mode of the object identifier.
In an optional embodiment, in the step 102, obtaining a second input for determining a target object identifier from the at least one object identifier, and entering a second application interface corresponding to the target object identifier, may be implemented by the following processing procedures:
and under the condition of obtaining at least one input operation on a specific key of the electronic equipment, determining a target object identifier from the at least one object identifier according to the determined traversal strategy, and displaying and outputting a second application interface corresponding to the target object identifier.
The specific key may be the above-mentioned super key, or may be some other key besides the super key.
After the first application interface is displayed on the target display unit based on the obtained first input, the object identifier included in the first application interface is presented to the user, and the target object required by the user can be conveniently enabled.
Optionally, in a case of obtaining at least one input operation on the specific key of the electronic device, if the specific key is pressed, a target object identifier may be further selected and determined in a traversal manner from at least one object identifier included in the first application interface according to an object identifier traversal process in a manner of no-interval focus jump or interval focus jump, and then the second application interface corresponding to the target object identifier is entered.
In implementation, based on an event of traversal stop, determining an object identifier corresponding to the focus state when the traversal is stopped as a target object identifier, and directly entering a second application interface corresponding to the target object identifier, for example, starting an application program corresponding to the target object identifier to enter an interface of the application program, and the like; alternatively, when the traversal stops to determine the target object identifier in the focus state, the second application interface corresponding to the target object identifier may be entered based on an additional input, for example, by clicking the specific key one by one to perform object identifier focus switching based on the traversal manner on the first application interface (where a certain object identifier is in the focus state, that is, equivalent to the object identifier being currently "selected"), and by long-pressing the specific key when the traversal stops (of course, other keys except the specific key may also be operated to provide the additional input, without limitation), providing an additional input for indicating entry into the second application interface corresponding to the target object identifier, and the device may enter the second application interface corresponding to the object identifier in the focus state when the traversal stops in the first application interface in response to the additional input.
It should be noted that one or more target object identifiers determined based on the traversal policy may be determined, and in implementation, the object identifier in the focus state corresponding to the end time may be determined as the target object identifier based on the traversal end event.
The label input may be, for example, during the process of traversing by operating the specific key, when the object identifier is in focus at the time of traversing to a desired object identifier, a confirmation message may be simultaneously input to the device by voice, gesture, lip language, and/or key, for example, the voice input "selects" or "labels", or a key predefined to provide a "label" function is pressed, and the like.
In an optional embodiment, in the step 102, obtaining a second input for determining a target object identifier from the at least one object identifier, and entering a second application interface corresponding to the target object identifier, may further be implemented by the following processing procedures:
and under the condition of obtaining the combined operation of a specific key and a preset key of the electronic equipment, determining a target object identifier from the at least one object identifier according to the combined operation, and displaying and outputting a second application interface corresponding to the target object identifier.
After the first application interface is displayed on the target display unit, optionally, the target object identifier may also be directly determined from at least one object identifier included in the first application interface based on an input provided by a user through a combined operation of a specific key and a preset key.
For example, the initial key of the object identifier may be operated (e.g., pressed) at the same time as the superkey is operated (e.g., pressed), and the electronic device determines that the object identifier corresponding to the initial key is the target object identifier based on a combined operation of the superkey and the object identifier initial key. And under the condition that the second letter is the same, inputting a third letter until the different object identifications can be distinguished.
In an optional embodiment, in the step 102, obtaining a second input for determining a target object identifier from the at least one object identifier, and entering a second application interface corresponding to the target object identifier, may further be implemented by the following processing procedures:
and under the condition that the electronic equipment obtains a second input representing the target object identification information, determining a target object identification from the at least one object identification, and displaying and outputting a second application interface corresponding to the target object identification.
Specifically, the second input representing the target object identification information may be obtained based on a key, a voice, a character string, a gesture, and/or a lip language, for example, mic collects a voice command of "WeChat" input by a user (representing the object identification information of the "WeChat" object), or the image collection unit collects a specific gesture (different gestures may be predetermined for different objects) corresponding to the "WeChat" object, and accordingly determines the object identification represented by the second input as the target object identification.
In an optional embodiment, in the step 102, obtaining a second input for determining a target object identifier from the at least one object identifier, and entering a second application interface corresponding to the target object identifier, may further be implemented by the following processing procedures:
and under the condition of obtaining the input operation of a specific key of the electronic equipment and second input representing the identification information of the target object, determining the identification of the target object from the at least one object identification, and displaying and outputting a second application interface corresponding to the identification of the target object.
In this embodiment, the user may provide a second input representing the identification information of the target object to the electronic device based on the key, voice, character string, gesture, and/or lip language, while operating a specific key, for example, while inputting voice "WeChat" to the device when pressing the above-mentioned sperkey key, or performing a specific gesture corresponding to the object "WeChat" (different gestures may be predetermined for different objects), etc.
The electronic equipment determines an object identifier represented by second input as a target object identifier from at least one object identifier included in the first application interface based on the obtained input operation of the specific key of the electronic equipment and the second input of the identifier information representing the target object, and then enters a second application interface corresponding to the target object identifier.
In an optional embodiment, displaying and outputting the second application interface corresponding to the target object identifier may specifically be implemented as:
and under the condition that the target object identification is unique and the target display unit is unique, displaying and outputting the second application interface on the target display unit.
Specifically, when the determined target object identifier is unique and the target display unit is unique, the output mode of the second application interface corresponding to the target object identifier on the target display unit can be determined based on the idle state of the unique target display unit and information such as the display position of the existing display content.
Alternatively, the second application interface corresponding to the target object identifier may be randomly displayed at any position of the target display unit, and in a case that content (e.g., a window displaying one or more application interfaces, documents, web pages, etc.) is already displayed at a display position of the second application interface on the target display unit, the second application interface corresponding to the target object identifier is placed at the topmost layer (i.e., the front end of the user viewing perspective) so as to be convenient for the user to view or use.
Or, optionally, the second application interface may also be displayed at an idle position of the target display unit, or, in a state where the target display unit is completely idle (an interface window that does not display any object), the second application interface corresponding to the target object identifier may also be displayed in a full-screen manner, or the second application interface may be displayed at a certain specific position in a non-full-screen manner, such as at a middle position or a certain edge position of the entire area of the display unit.
For example, when the tablet computer of the user operates in the first mode (non-expansion mode), and the determined target object identifier is unique and the target display unit is unique, the second application interface corresponding to the target object identifier may be displayed and output on the display screen of the tablet computer according to any one of the above output modes. In an optional embodiment, displaying and outputting the second application interface corresponding to the target object identifier may further be implemented as:
and under the condition that the target object identification is unique and the target display unit is not unique, displaying and outputting the second application interface on the first target display unit meeting the first display condition.
Wherein the first display condition is related to a display output parameter of the second application interface.
And the display output parameter of the second application interface corresponding to the target object identifier is a display output requirement parameter of the second application interface. The display output requirement parameter of the second application interface may be determined based on the type of the target object, for example, if the target object is a game application, since the game application has high requirements for display size (generally, a large display size is required to display a game scene with a huge amount of information), resolution, chromaticity, luminance, and the like, the display conditions corresponding to the display size, resolution, chromaticity, luminance, and the like may be set for the game application in advance, and if the target object is an image processing program, since the image processing program has high requirements for resolution, chromaticity, luminance, and the like, the display conditions corresponding to the resolution, chromaticity, luminance, and the like may be set for the image processing program.
On the basis, aiming at the condition that the target object identification is unique and the target display unit is not unique, the target display unit meeting the first display condition corresponding to the target object can be determined from the plurality of target display units, and the second application interface corresponding to the target object identification is displayed on the target display unit meeting the first display condition.
The output mode of the second application interface on the target display unit meeting the first display condition may be determined by combining the output parameters of the target object (for example, the interface of the game application program requires large-size display, and the communication software such as 263 and WeChat can be displayed in small size), and the display parameters of the target display unit (whether the target display unit is in idle state, etc.).
As shown in fig. 5, in a scenario where a user connects a plurality of external display units (an external display unit i, an external display unit ii) to a mobile phone, if the user starts a game application, the external display unit i with a larger size and better display performance in terms of resolution, brightness, etc. may be preferentially used to output an application interface of the game application.
In an optional embodiment, displaying and outputting the second application interface corresponding to the target object identifier may further be implemented as:
and under the condition that the target object identification is unique, displaying and outputting the second application interface to a display unit of the electronic equipment or an external display unit which accords with a second display condition.
The second display condition is related to the current display content of the display unit of the electronic device or the external display unit.
More specifically, in this embodiment, the interface content of the second application interface corresponding to the target object identifier is associated with the current display content of the display unit of the electronic device itself or the external display unit, for example, in a word document comparison scenario, the current display content of the display unit of the electronic device itself or the external display unit is a first word document, and the second application interface corresponding to the target object identifier is a second word document used for comparison with the first word document, then the two documents are obviously associated.
For the above case, the second display condition may be set to: has a specific positional relationship with a specific display unit.
And the specific display unit is a display unit where the current display content is located and the current display content is associated with the interface content of the second application interface.
The specific positional relationship may be, but is not limited to, that a distance between display units where the current display content associated with the interface content of the second application interface is located is smaller than a threshold, or that the display units where the current display content associated with the interface content of the second application interface is located on the same plane, or that an included angle is within a set angle range, or the like.
Therefore, in this embodiment, when the target object identifier is unique, the second application interface may be displayed and output on the display unit of the electronic device or an external display unit that meets the second display condition.
For example, in a word document comparison scene, a word interface (a second application interface) to be output for comparison may be output to the electronic device itself and/or an external display unit that matches the above positional relationship with the specific display unit currently displaying the word that needs to participate in the comparison. In an optional embodiment, displaying and outputting the second application interface corresponding to the target object identifier may further be implemented as:
and under the condition that the target object identifiers are not unique and the target display unit is unique, displaying and outputting second application interfaces corresponding to the target object identifiers in a first preset mode to the target display unit, or displaying and outputting second application interfaces corresponding to the first target object identifiers to the target unit and displaying and outputting second application interfaces corresponding to other target object identifiers to other display units of the electronic equipment.
The first preset manner may be, but is not limited to: and displaying the second application interfaces corresponding to the target object identifications in a stacked manner on the target display unit, or displaying the second application interfaces corresponding to the target object identifications on the target display unit in a distributed manner according to a set layout mode (such as vertical layout, horizontal layout, circular layout taking a certain point as a center, and the like).
In the stacked display mode, the order of the second application interfaces from the top layer (the layer closest to the user) to the bottom layer (the layer farthest from the user) may be randomly set, or the order of the second application interfaces may be set according to information such as priority and importance, where the second application interface of the target object with high priority/high importance is displayed close to the corresponding layer of the user as much as possible, and accordingly, the second application interface of the target object with highest priority/importance is displayed at the top layer.
In the case of arranging and displaying according to the set layout mode, the arrangement positions of the second application interfaces can be randomly set, and the second application interfaces of the target objects with high priority/importance can be displayed in the display area in the middle or near the middle of the target display unit as much as possible according to the priority/importance. The window sizes of different second application interfaces displayed in the arrangement display may be the same or different.
In another embodiment, when the target object identifier is not unique and the target display unit is unique, the second application interface corresponding to the first target object identifier may be displayed and output on the target unit, and the second application interface corresponding to the other target object identifier may be displayed and output on the other display unit of the electronic device.
The first target object identifier may be an identifier of a target object with the highest priority/importance among the target objects, or an identifier of a target object specified based on a user operation.
For example, in the multi-word document display, the document interfaces (second application interfaces corresponding to the target object identifiers) of the determined multiple words may be stacked or arranged and displayed on the determined unique target display unit, or a word document (with the highest priority/importance degree representing the word) which is used most recently or has the highest frequency of use or has the longest duration of use may be displayed and output on the determined unique target display unit, and other word documents may be displayed and output on other display units, etc. In an optional embodiment, displaying and outputting the second application interface corresponding to the target object identifier may further be implemented as:
and respectively displaying and outputting second application interfaces corresponding to the target object identifiers to the target display units in a second preset mode under the condition that the target object identifiers are not unique and the target display units are not unique.
Optionally, the second preset manner may be that a plurality of second application interfaces corresponding to a plurality of target object identifiers are randomly allocated to a plurality of different target display units for display and output.
Or, optionally, the second preset manner may also be to allocate the second application interface of the target object with the display parameter requirement to the target display unit matched therewith and capable of meeting the display parameter requirement of the target object, and allocate the target object without the display parameter requirement randomly or allocate the target object according to the current idle state of each target display unit and the display task amount/window number in a balanced manner.
For example, the game application program needs display parameters with large size, high resolution and the like so as to output the display parameters to the target display unit meeting the display parameter requirements for display, and other target objects without special requirements can be randomly distributed to different display units or uniformly distributed according to the idle state and the display task amount/window number of each display unit. In an optional embodiment, displaying and outputting the second application interface corresponding to the target object identifier may further be implemented as:
and under the condition that the target object identification is not unique, the second application interface is respectively displayed and output on a display unit of the electronic equipment or an external display unit which accords with a third display condition.
Wherein the third display condition is related to a current display content and/or a display parameter of the display unit.
Alternatively, the third display condition may be set to: the priority/importance degree of the currently displayed content of the display unit is lower than the set priority/importance degree value (representing that the currently displayed content can be covered or can occupy the display area of the display unit together with other content such as a second application interface).
Alternatively, it is also possible to set: the display parameters of the display unit such as resolution, brightness, chromaticity and the like meet the corresponding resolution conditions, brightness conditions and chromaticity conditions, and/or the current display task amount of the display unit is lower than the set task amount or the power consumption is lower than the set power consumption value and the like.
Specifically, for example, the interface of the determined game application may be output to the target display unit that meets the third display condition.
According to the implementation manner provided by the above embodiments, the first application interface can be output on the target display unit based on obtaining the first input and responding to the first input, and support is provided for a user to quickly launch a desired target application from the first input, on this basis, the second input acting on the target object identifier determined from the at least one object identifier can be further obtained, so that the second application interface corresponding to the target object identifier is displayed and output, that is, the target object can be launched by obtaining the first input and the second input, and the method and the device have the advantages of being simple and convenient to operate, short in time consumption, high in efficiency and the like.
In an alternative embodiment, referring to FIG. 6 (which only shows the case where steps 104-106 are included), the control method of the present application may further include any one or more of the following:
104, under the condition that the target object identifier is not unique and the display parameters of different second application interfaces are different, switching the second application interface corresponding to the target object identifier to a determined target display area according to the obtained fourth input;
step 105, hiding or closing the first application interface under the condition that the second application interface is displayed;
and 106, under the condition that the first application interface is in a hidden state or a closed state, redisplaying the first application interface at least based on the obtained first input.
In the step 104, the target display area is determined at least based on the position relationship between the target object and the electronic device and/or the input of the target object; the target object is a user of the electronic device or a part of the users, such as an operator of the electronic device or a user (client) who needs to transact related business information in a business transaction scene and views the content presented by the display unit of the electronic device.
Under the condition that the target object identifiers are not unique and the display parameters of different second application interfaces are different, different second application interfaces corresponding to different target object identifiers may be displayed in a stacked manner or arranged and displayed in a predetermined layout manner on the target display unit, and the like, and accordingly, there may be a drawback that at least part of the content of at least part of the second application interfaces is blocked (corresponding to the stacked manner) or at least part of the second application interfaces are displayed in a small window form (corresponding to the arranged manner), so that a user such as the above cannot better view the content of each second application interface.
For the problem, in this embodiment, the second application interface corresponding to the target object identifier is switched to the determined target display area according to the obtained fourth input, that is, different second application interfaces are respectively switched to the determined target display area according to the obtained fourth input, and different second application interfaces are sequentially expanded in the target display area in the stacking manner or the small window arrangement manner through continuous switching of the second application interfaces of the target display area, so as to support the user to view the contents of the expanded different second application interfaces in the target display area.
The target display area may be a corresponding part or all of the display areas in the target display unit that displays the second application interfaces in a stacked or arranged manner, or may be a corresponding part or all of the display areas in other display units (the device itself or external devices) that are different from the target display unit that displays the second application interfaces in a stacked or arranged manner. In implementation, the target display area may be specifically determined based on display parameters such as a display task amount, an idle status, a size resolution, and the like of the electronic device itself and/or the external display device, and/or display requirement parameters of each second application interface.
The fourth input may be an input provided by the user to the electronic device by operating a specific key, but is not limited thereto, and may also be an input provided by any means such as voice, gesture, lip language, character string, and the like.
Optionally, in a case that the fourth input is an input provided by the user to the electronic device by operating a specific key, the specific key may be the above-mentioned superkey, and in a case that the target object identifier is not unique and the display parameters of the different second application interfaces are different, the user may continuously switch the second application interfaces displayed in a stacked or small-window arrangement in the target display area by operating the superkey (for example, pressing the superkey) to perform content display, and more specifically, for example, each time the superkey is pressed, the target display area performs switching of the second application interfaces once.
As for the step 105, in the case of displaying the second application interface of the target object, the first application interface is hidden or closed, so as to save the display resource and power consumption of the display unit.
In an implementation, whether and when to hide or close the first application interface may be determined based on a display duration of the second application interface that is enabled for display and/or user manipulation of the first application interface.
More specifically, the first application interface may be hidden or closed when the display duration of the second application interface reaches the first set duration, and/or the duration in which the user does not operate the first application interface reaches the second duration.
The first set time length and the second set time length may be the same or different.
Of course, the first application interface may also be directly closed or hidden when the second application interface outputting the target object identifier is displayed, which is not limited.
In the case of displaying the second application interface of the target object, in addition to closing or hiding the first application interface, the first application interface may be moved to other non-focused display areas, such as other screens.
With respect to step 106, if the user needs to use the first application interface again, for example, another target object needs to be enabled based on the first application interface, the first application interface may be redisplayed based on at least obtaining the first input, in a case where the first application interface is in a hidden state or a closed state.
Specifically, for example, when a superkey is pressed, the electronic device calls and displays the first application interface in combination with a state where the electronic device does not currently display the first application interface after detecting a first input generated based on operating the superkey.
In the embodiment, different second application interfaces are respectively switched to the determined target display areas according to the obtained fourth input, so that different second application interfaces in a stacking mode or a small window arrangement mode are gradually expanded in the target display area, and a user can be supported to watch contents of the expanded different second application interfaces in the target display area; in addition, under the condition of displaying the second application interface, the first application interface is hidden or closed, so that the display resource and the power consumption of the display unit are effectively saved, and if a user needs to use the first application interface again, the first application interface can be conveniently called up based on the first input.
The embodiment of the present application further discloses another control method, which is also applicable to the above electronic devices such as a mobile terminal or a computer device, and referring to fig. 7, the control method includes the following processing steps:
step 701, obtaining a first key signal generated by executing a first operation on a first key, and displaying and outputting a first application interface according to the first key signal, wherein the first application interface includes at least one application object identifier.
The first key may be a specific key of the electronic device itself or an external physical keyboard or a virtual keyboard (e.g., a virtual keyboard provided by an external device), or may also be a combination of two or more keys of the electronic device itself or the external physical keyboard or the virtual keyboard.
Preferably, the first key is a specific key in the above-mentioned keyboard, for example, the first key may be a superkey as described above, and more specifically, the first key may be an F1 key on the keyboard, and of course, the first key may also be set as another specific key on the keyboard.
The first operation performed on the first key may be, but is not limited to, a single click, a double click, a long press of the first key. The electronic equipment calls a first application interface comprising at least one object identifier according to a first key signal generated by executing a first operation on the first key, such as a signal of clicking, double-clicking or long-pressing the first key, and displays and outputs the first application interface.
The first application interface can be displayed and output on the electronic equipment and/or an external display unit. Further, before the display unit displays and outputs the first application interface, the target display unit may be determined from the electronic device itself and/or the external display unit, and the first application interface may be specifically displayed and output on the target display unit.
Furthermore, at least one of an output position, an output mode and an interface display parameter of the first application interface may be determined according to a device configuration and/or a device mode of the electronic device, and the first application interface may be output on the electronic device itself or an external target display unit (an external display screen or a projection screen) according to the determined at least one of the output position, the output mode and the interface display parameter.
The implementation process of determining the target display unit and controlling the output display of the first application interface on the target display unit is similar to the corresponding implementation process in the control method provided above, and reference may be specifically made to the related description in the control method above, and details are not repeated here.
Step 702, obtaining the target object identification determined by executing the second operation on the first key.
After the first application interface is displayed and output based on the first key signal generated by obtaining the first operation on the first key, the target object identifier can be further determined from a plurality of object identifiers included in the first application interface by performing a second operation on the first key.
The second operation may also be, without limitation, a single click, a double click, a long press, or the like of the first key.
For example, by clicking the first key, the object identifier in the focus state in the first application interface may be switched to a focus, and specifically, in response to clicking the first key multiple times, the object identifier traversal processing based on non-interval focus jump or interval focus jump may be performed on each object identifier on the first application interface, until the second operation on the first case is stopped, the traversal is stopped, and the object identifier in the focus state at the time of stopping is the target object identifier.
In addition, multiple selection of the target object identifier may be performed on the first application interface based on the operation of the first key, and as an optional implementation manner, while performing a second operation (for example, pressing the first key) on the first key, a mark input may be provided in a manner of a key (different from the first key), voice, gesture, lip language, or the like, so as to mark the object identifier currently in a focus state in a traversal process (at a traversal non-end time) as the target object identifier.
As another optional implementation manner, in the process of performing multiple selection of the target object identifier on the first application interface, when the object identifier in the first application interface is to be traversed to a specific object identifier that is needed in the process of performing focus switching on the object identifier in the first application interface based on the second operation on the first key, the fifth operation is performed on the first key instead (for example, a first key is clicked instead of a double click), so that the selected mark of the specific object identifier that is currently to be traversed is determined to be the target object identifier, it is easy to understand that traversal at this time is not finished, and then, the determination of the target object identifier based on focus switching can be continued through the second operation on the first key.
The fifth operation is different from the second operation.
For this way, for example, in a gapless jump mode, currently, based on a continuous click on a super key, traversing to an adjacent object identifier "Xm-1" before the object identifier "Xm", assuming that a user needs to perform multiple selections on an object identifier in a first application interface and needs to determine "Xm" as one of target object identifiers, after "Xm-1" is facilitated, switching to a double click on the super key to implement mark selection of "Xm", that is, determining "Xm" as a target object identifier, and then further performing focus switching by clicking the super key (in this process, marking and selecting other object identifiers in the traversal process based on the same operation as that of selecting "Xm") until the traversal is finished, wherein when the traversal is finished (based on a second operation), a corresponding object identifier in a focus state is also selected, that is also determined as a target object identifier, and multiple selections of the target object identifier are implemented.
703, displaying and outputting a second application interface corresponding to the target object identifier; or acquiring a third operation executed on the first key to start the target object corresponding to the target object identifier to enter a second application interface.
When at least one target object identifier is determined based on the second operation of the first key (including the implementation process of selecting one or more target object identifiers), the second application interface corresponding to the at least one target object identifier can be directly triggered, displayed and output based on the event of traversing ending.
Optionally, after at least one target object identifier is determined, a third operation is performed on the first key to start the target object corresponding to the target object identifier so as to enter the second application interface.
The third operation may be, for example, a long press, a continuous multi-tap of the first key, or the like.
In addition, if the number of the determined target object identifiers is multiple, multiple second application interfaces corresponding to the multiple target object identifiers can be synchronously or asynchronously displayed in a single target display unit or multiple different target display units in the electronic device and/or an external display unit (an external display screen or a projection screen), and for a certain second application interface, the second application interface can be integrally displayed in one target display unit or be displayed in different target display units in a divided manner, and each second display interface can be switched and displayed in a target display area based on corresponding switching operation according to display modes such as stacking, arrangement and the like. The implementation details or processes of this part may specifically refer to the related description of the control method provided above, and are not described here again.
In addition, the two control methods provided by the embodiments of the present application may be the same, communicated or combined with each other in some processing steps or links, and the processing variants based on the two control methods are all within the protection scope of the present application.
In the embodiment, the user can start the target object through a single first key (such as a super key), the operation is simple, the efficiency is high, and the time consumption of equipment is effectively saved.
Referring to fig. 8, in an alternative embodiment, the control method may further include at least one of the following processing steps (fig. 8 only shows that steps 704-705 are included at the same time):
step 704, under the condition that the second application interface or the application program corresponding to the target object identifier is closed, redisplaying the second application interface according to the obtained fourth operation executed on the first key.
The fourth operation, again for example, may be a single click, a double click or a long press of the first button.
When the user closes the second application interface corresponding to the target object identifier or the application program corresponding to the target object identifier based on the actual operation, the second application interface of the target object identifier can be redisplayed by executing the fourth operation on the first key (without being based on various operations such as the first operation, the second operation and the like), so that the convenience of enabling the target object by the user is further improved.
Specifically, in an actual application scenario, a user may enable (simultaneously or in a time-sharing manner) a plurality of different target objects based on a first application interface, and based on executing a fourth operation on a first key, the second application interface may be to redisplay a target object that is recently closed, or may be to select, based on a predetermined policy, a target object that meets a restart condition from among target objects that are enabled by the user using the first application interface this time, and to reenter the second application interface of the selected target object that meets the restart condition.
The restart condition may be determined based on the use frequency and/or the use duration of each target object when each target object is enabled by using the first application interface this time. The target object with high use frequency and/or high use duration can be preferentially taken as the target object to be restarted.
The first to fifth operations are not limited to the second operation and may be the same or different, except that the second operation is different from the fifth operation; when the corresponding operations (such as the first operation and the third operation) on the first key are the same, the electronic device can correctly respond to the user operation according to the state (such as whether the first application interface is displayed, whether the target object identifier is determined, whether the second application interface is displayed, and the like).
Step 705, obtaining key setting information, and switching the function of the first key to a second key indicated by the key setting information.
In this embodiment, a setting change function of the first key is provided for a user, the user may change the configuration of the first key based on the use habit of the user, for example, change the original first key to F1 to F2 (or other keys), and the electronic device switches the function of the original first key to the second key indicated by the user setting information based on the user setting information, for example, switch the above function of F1 to F2, and the like.
An application example of the control method provided in the present embodiment is provided below with reference to fig. 9.
As shown in FIG. 9, based on the operation of the first key (e.g., the Superker key: F1), the process of enabling the target object is implemented as follows:
1) And (3) long pressing a super key, such as long pressing 2S: the device starts and displays an output first application interface (such as a software interface in fig. 8);
2) Click on the superker key: carrying out focus switching on an object identifier in a first application interface; determining the object identifier in the focus state as a target object identifier when clicking is finished;
3) And (3) long pressing a super key, such as long pressing 2S: starting a target object corresponding to the target object identification, and entering a second application interface of the target object; the first application interface is automatically hidden at the moment of entering a second application interface of the target object or delaying for a preset time length;
4) Click on the superker key: and in the state of no interface (first application interface), directly waking up a second application interface of a target object which is started last time (recently) based on the operation information of clicking a Superker key.
In this embodiment, under the condition that the second application interface or the application program corresponding to the target object identifier is closed, the second application interface of the target object identifier may be redisplayed by performing a fourth operation on the first key, so that convenience of starting the target object by a user is further improved, efficiency is high, time consumption is short, in addition, personalized setting on a first case (supervisor) may be supported, a function of the device is enriched, and flexibility of device operation is improved.
In an alternative embodiment, referring to fig. 10, the control method may further include the following steps:
step 706, updating the object identifier included in the first application interface;
updating the object identifier included in the first application interface includes: adding and/or removing object identifications to and/or from the first application interface.
Optionally, the object identifier may be added and/or removed from the first application interface based on a manual update operation of the user, for example, adding an icon of the application to the first application interface based on an operation of dragging the corresponding application icon to the first application interface by the user, or removing the application icon based on an operation of deleting from the first application interface, dragging (dragging an icon in the first application interface out of the first application interface) the application icon, or the like. The operation of adding or removing objects such as files, folders, web pages, etc. is similar to the above operation of the application program.
In implementation, the removing or adding operation of a single object identifier can be executed for the first application interface, or the removing or adding operation can also be executed for a plurality of object identifiers in batch.
In addition, optionally, usage information of different objects may also be detected by the electronic device, and corresponding object identifiers are automatically added to the first application interface and/or removed from the first application interface based on the usage information of the different objects.
The usage information of the object may include, but is not limited to, any one or more of the usage duration, usage frequency, uninstallation, migration, new installation, etc. of the object, and determines whether to add or remove the object identifier in the first application interface according to the usage information of the object and the set usage condition.
For example, the object identifier of the object whose usage duration in a certain period of time reaches the set duration and/or whose usage frequency in a certain period of time reaches the set frequency may be automatically added to the first application interface, the object identifier of the object in which the event such as migration or uninstallation occurs may be removed from the first application interface, and for a newly installed object (e.g., an application program), monitoring of usage information such as usage duration, frequency, uninstallation/migration or the like may be started.
In this embodiment, the object identifier in the first application interface is updated based on manual operation by the user and/or automatic updating by the device, so that the object identifier included in the first application interface can better meet the needs or habits of the user, for example, the object identifier included in the first application interface is usually an identifier of an object with a higher probability of being used by the user or with a more frequent use by the user, so that, in essence, the overall use efficiency of the user when using each object in the electronic device can be further improved (for an object with a high use probability, the object can be enabled quickly based on the first application interface), and the user experience is further improved.
In response to the former control method, an embodiment of the present application further provides a control apparatus, as shown in fig. 11, the apparatus including:
a first output control unit 1101, configured to obtain a first input, and output a first application interface on a target display unit, where the first application interface includes at least one object identifier;
a second output control unit 1102, configured to obtain a second input used for determining a target object identifier from the at least one object identifier, and display and output a second application interface corresponding to the target object identifier, where the second input is the same as or different from the first input;
a third output control unit 1103, configured to, when the second application interface or the target application process corresponding to the target object identifier is closed, redisplay the second application interface based on at least an obtained third input, where the third input is the same as or different from the second input.
Optionally, the first output control unit 1101 is specifically configured to:
under the condition of obtaining a first input acting on at least one key of the electronic equipment, determining a target display unit from a display unit of the electronic equipment and/or an external display unit so as to output the first application interface on the target display unit; or the like, or a combination thereof,
under the condition that the electronic equipment obtains a first input for representing first instruction information, determining a target display unit from a display unit of the electronic equipment and/or an externally connected display unit, and outputting the first application interface on the target display unit; or the like, or, alternatively,
under the condition that a first input acting on at least one key of the electronic equipment and a first input used for representing second instruction information are obtained, a target display unit is determined from a display unit of the electronic equipment and/or an external display unit, and the first application interface is output on the target display unit.
Optionally, the first output control unit 1101 determines a target display unit from a display unit of the electronic device itself and/or an external display unit, and includes:
obtaining operation information of the electronic equipment and/or display parameters of each display unit, and determining at least one of the display unit of the electronic equipment and/or an external display unit as the target display unit according to the operation information and/or the display parameters; or the like, or, alternatively,
obtaining input position information of a first input, and determining a target display unit from a display unit of the electronic equipment and/or an external display unit according to the input position information; or the like, or a combination thereof,
obtaining object identification information of a first application interface to be output, and determining at least one of a display unit of the electronic equipment and/or an external display unit as the target display unit according to display parameters of each display unit of the electronic equipment and the object identification information; or the like, or a combination thereof,
under the condition that the electronic equipment is in a first mode, obtaining use scene information of the electronic equipment and/or first display parameters of a display unit of the electronic equipment, and determining at least one of the display units of the electronic equipment as the target display unit according to the use scene information and/or the first display parameters; or the like, or a combination thereof,
under the condition that the electronic equipment is in a second mode, obtaining use object information of the electronic equipment and/or second display parameters of an extended display unit, and determining at least one of the extended display unit of the electronic equipment as the target display unit according to the use object information and/or the second display parameters; or the like, or, alternatively,
and under the condition that the electronic equipment is in a third mode, obtaining third display parameters of the screen projection display units of the electronic equipment, and determining at least one of the screen projection display units of the electronic equipment as the target display unit according to the third display parameters.
Optionally, the second output control unit 1102 is specifically configured to:
under the condition of obtaining at least one input operation on a specific key of the electronic equipment, determining a target object identifier from the at least one object identifier according to a determined traversal strategy, and displaying and outputting a second application interface corresponding to the target object identifier; or the like, or a combination thereof,
under the condition of obtaining the combined operation of a specific key and a preset key of the electronic equipment, determining a target object identifier from the at least one object identifier according to the combined operation, and displaying and outputting a second application interface corresponding to the target object identifier; or the like, or, alternatively,
under the condition that electronic equipment obtains second input representing target object identification information, determining a target object identification from the at least one object identification, and displaying and outputting a second application interface corresponding to the target object identification; or the like, or, alternatively,
and under the condition of obtaining the input operation of a specific key of the electronic equipment and second input representing the identification information of the target object, determining the identification of the target object from the at least one object identification, and displaying and outputting a second application interface corresponding to the identification of the target object.
Optionally, the second output control unit 1102 displays and outputs a second application interface corresponding to the target object identifier, where the second application interface includes:
under the condition that the target object identifier is unique and the target display unit is unique, displaying and outputting the second application interface on the target display unit; or the like, or, alternatively,
under the condition that the target object identification is unique and the target display unit is not unique, displaying and outputting the second application interface on a first target display unit meeting a first display condition, wherein the first display condition is related to a display output parameter of the second application interface; or the like, or, alternatively,
under the condition that the target object identification is unique, displaying and outputting the second application interface on a display unit of the electronic equipment or an external display unit which meets a second display condition, wherein the second display condition is related to the current display content of the display unit of the electronic equipment or the external display unit; or the like, or, alternatively,
under the condition that the target object identifiers are not unique and the target display unit is unique, displaying and outputting second application interfaces corresponding to the target object identifiers in a first preset mode to the target display unit, or displaying and outputting second application interfaces corresponding to first target object identifiers to the target unit and displaying and outputting second application interfaces corresponding to other target object identifiers to other display units of the electronic equipment; or the like, or a combination thereof,
under the condition that the target object identification is not unique and the target display unit is not unique, respectively displaying and outputting second application interfaces corresponding to the target object identifications on the target display units in a second preset mode; or the like, or a combination thereof,
and under the condition that the target object identification is not unique, respectively displaying and outputting the second application interface on a display unit of the electronic equipment or an external display unit which accords with a third display condition, wherein the third display condition is related to the current display content and/or display parameters of the display unit.
Optionally, the second output control unit 1102 is further configured to, when the target object identifier is not unique and display parameters of different second application interfaces are different, switch the second application interface corresponding to the target object identifier to a determined target display area according to an obtained fourth input, where the target display area is determined based on at least a position relationship between the target object and the electronic device and/or an input of the target object; and/or the presence of a gas in the atmosphere,
the first output control unit 1101 is further configured to hide or close the first application interface when the second application interface is displayed; and/or, in the case that the first application interface is in a hidden state or a closed state, redisplaying the first application interface based on at least the obtained first input.
The control device disclosed in the embodiments of the present application is relatively simple in description because it corresponds to the previous control method disclosed in the corresponding embodiments above, and for the relevant similarities, please refer to the description of the previous control method in the corresponding embodiments above, and details are not described here.
In correspondence to the latter control method, an embodiment of the present application further provides another control apparatus, as shown in fig. 12, the apparatus includes:
an obtaining unit 1201, configured to obtain a first key signal generated by performing a first operation on a first key, and display and output a first application interface according to the first key signal, where the first application interface includes at least one application object identifier; obtaining a target object identifier determined by executing a second operation on the first key;
the control unit 1202 is configured to display and output a second application interface corresponding to the target object identifier; or, based on the third operation executed on the first key, starting the application program corresponding to the target object identifier to enter a second application interface.
Optionally, the control unit 1202 is further configured to:
under the condition that the second application interface or the application program corresponding to the target object identification is closed, redisplaying the second application interface according to the obtained fourth operation executed on the first key; and/or the presence of a gas and/or,
and obtaining key setting information, and switching the function of the first key to a second key indicated by the key setting information.
Optionally, the control unit 1202 is further configured to: updating the object identification included in the first application interface;
wherein, the updating of the object identifier included in the first application interface comprises: adding and/or removing object identifications to and/or from the first application interface.
For the control device disclosed in the embodiment of the present application, since it corresponds to the latter control method disclosed in the corresponding embodiment above, the description is relatively simple, and for the relevant similarities, please refer to the description of the latter control method in the corresponding embodiment above, and the detailed description is omitted here.
An embodiment of the present application further discloses an electronic device, where the electronic device may be the above-mentioned mobile terminal or computer device, and referring to fig. 13, the electronic device includes:
a memory 1301 for storing at least one set of instructions;
a processor 1302, configured to call and execute the instruction set in the memory, and execute the processing procedure of the former control method disclosed in the above corresponding embodiment by executing the instruction set, or execute the processing procedure of the latter control method disclosed in the above corresponding embodiment.
The embodiment of the application also discloses a storage medium, which stores at least one group of instruction sets, and the instruction sets are used for realizing the control method in any one of the above manners when being called and executed.
It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other.
For convenience of description, the above system or apparatus is described as being divided into various modules or units by function, respectively. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.
From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments of the present application.
Finally, it is further noted that, herein, relational terms such as first, second, third, fourth, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.
The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.

Claims (10)

1. A control method, comprising:
obtaining a first input, and outputting a first application interface for starting at least one object on a target display unit, wherein the first application interface comprises at least one object identifier;
obtaining a second input which is used for determining a target object identifier from the at least one object identifier, starting an object corresponding to the target object identifier and displaying and outputting a second application interface corresponding to the target object identifier, wherein the second input is the same as or different from the first input;
under the condition that a target application process corresponding to the second application interface or the target object identifier is closed, redisplaying the second application interface based on at least obtained third input, wherein the third input is the same as or different from the second input;
the first input is realized by any one or any combination of keyboard information input, voice, gesture and lip language modes, so that the target object can be quickly enabled from the first application interface.
2. The method of claim 1, wherein obtaining the first input and outputting the first application interface at the target display unit comprises:
under the condition of obtaining a first input acting on at least one key of the electronic equipment, determining a target display unit from a display unit of the electronic equipment and/or an external display unit so as to output the first application interface on the target display unit; or the like, or, alternatively,
under the condition that the electronic equipment obtains a first input for representing first instruction information, determining a target display unit from a display unit of the electronic equipment and/or an externally connected display unit, and outputting the first application interface on the target display unit; or the like, or, alternatively,
under the condition that a first input acting on at least one key of the electronic equipment and a first input used for representing second instruction information are obtained, a target display unit is determined from a display unit of the electronic equipment and/or an external display unit, and the first application interface is output on the target display unit.
3. The method of claim 2, wherein determining the target display unit from the display unit of the electronic device itself and/or an external display unit comprises:
obtaining operation information of the electronic equipment and/or display parameters of each display unit, and determining at least one of the display unit of the electronic equipment and/or an external display unit as the target display unit according to the operation information and/or the display parameters; or the like, or, alternatively,
obtaining input position information of a first input, and determining a target display unit from a display unit of the electronic equipment and/or an external display unit according to the input position information; or the like, or, alternatively,
acquiring object identification information of a first application interface to be output, and determining at least one of a display unit of the electronic equipment and/or an external display unit as the target display unit according to display parameters of each display unit of the electronic equipment and the object identification information; or the like, or a combination thereof,
under the condition that the electronic equipment is in a first mode, obtaining use scene information of the electronic equipment and/or first display parameters of a display unit of the electronic equipment, and determining at least one of the display units of the electronic equipment as the target display unit according to the use scene information and/or the first display parameters; or the like, or a combination thereof,
under the condition that the electronic equipment is in a second mode, obtaining use object information of the electronic equipment and/or second display parameters of an extended display unit, and determining at least one of the extended display unit of the electronic equipment as the target display unit according to the use object information and/or the second display parameters; or the like, or, alternatively,
and under the condition that the electronic equipment is in a third mode, obtaining third display parameters of the screen projection display units of the electronic equipment, and determining at least one of the screen projection display units of the electronic equipment as the target display unit according to the third display parameters.
4. The method of claim 1, wherein obtaining a second input for determining a target object identifier from the at least one object identifier into a second application interface corresponding to the target object identifier comprises:
under the condition of obtaining at least one input operation of a specific key of the electronic equipment, determining a target object identifier from the at least one object identifier according to a determined traversal strategy, and displaying and outputting a second application interface corresponding to the target object identifier; or the like, or, alternatively,
under the condition of obtaining the combined operation of a specific key and a preset key of the electronic equipment, determining a target object identifier from the at least one object identifier according to the combined operation, and displaying and outputting a second application interface corresponding to the target object identifier; or the like, or a combination thereof,
under the condition that electronic equipment obtains second input representing target object identification information, determining a target object identification from the at least one object identification, and displaying and outputting a second application interface corresponding to the target object identification; or the like, or a combination thereof,
and under the condition of obtaining the input operation of a specific key of the electronic equipment and second input representing the identification information of the target object, determining the identification of the target object from the at least one object identification, and displaying and outputting a second application interface corresponding to the identification of the target object.
5. The method of claim 1 or 4, wherein displaying a second application interface corresponding to the target object identification comprises:
under the condition that the target object identifier is unique and the target display unit is unique, displaying and outputting the second application interface on the target display unit; or the like, or, alternatively,
under the condition that the target object identification is unique and the target display unit is not unique, displaying and outputting the second application interface on a first target display unit meeting a first display condition, wherein the first display condition is related to a display output parameter of the second application interface; or the like, or, alternatively,
under the condition that the target object identification is unique, displaying and outputting the second application interface to a display unit of the electronic equipment or an external display unit which accords with a second display condition, wherein the second display condition is related to the current display content of the display unit of the electronic equipment or the external display unit; or the like, or, alternatively,
under the condition that the target object identifiers are not unique and the target display unit is unique, displaying and outputting second application interfaces corresponding to a plurality of target object identifiers in a first preset mode to the target display unit, or displaying and outputting second application interfaces corresponding to a first target object identifier to the target display unit and displaying and outputting second application interfaces corresponding to other target object identifiers to other display units of the electronic equipment; or the like, or, alternatively,
under the condition that the target object identification is not unique and the target display unit is not unique, respectively displaying and outputting second application interfaces corresponding to the target object identifications to the target display units in a second preset mode; or the like, or, alternatively,
and under the condition that the target object identification is not unique, respectively displaying and outputting the second application interface on a display unit of the electronic equipment or an external display unit which accords with a third display condition, wherein the third display condition is related to the current display content and/or display parameters of the display unit.
6. The method of claim 1, further comprising:
under the condition that the target object identifier is not unique and the display parameters of different second application interfaces are different, switching the second application interface corresponding to the target object identifier to a determined target display area according to an obtained fourth input, wherein the target display area is determined at least based on the position relation between the target object and the electronic equipment and/or the input of the target object; and/or the presence of a gas in the atmosphere,
hiding or closing the first application interface under the condition that the second application interface is displayed; and/or the presence of a gas in the atmosphere,
redisplaying the first application interface based on at least the obtained first input when the first application interface is in a hidden state or a closed state.
7. A control method, comprising:
obtaining a first key signal generated by executing a first operation on a first key, and displaying and outputting a first application interface for starting at least one object according to the first key signal, wherein the first application interface comprises at least one application object identifier;
obtaining a target object identifier determined by executing a second operation on the first key;
starting an object corresponding to the target object identification and displaying and outputting a second application interface corresponding to the target object identification; or the like, or, alternatively,
obtaining a third operation executed on the first key so as to start an application program corresponding to the target object identifier to enter a second application interface;
the first key is realized by one or any combination of keyboard information input so as to support the quick starting of the target object from the first application interface.
8. The method of claim 7, further comprising:
under the condition that the second application interface or the application program corresponding to the target object identification is closed, redisplaying the second application interface according to the obtained fourth operation executed on the first key; and/or the presence of a gas and/or,
and obtaining key setting information, and switching the function of the first key to a second key indicated by the key setting information.
9. A control device, comprising:
the first output control unit is used for obtaining a first input and outputting a first application interface for starting at least one object on the target display unit, wherein the first application interface comprises at least one object identifier;
the second output control unit is used for obtaining a second input which is used for determining a target object identifier from the at least one object identifier, starting an object corresponding to the target object identifier and displaying and outputting a second application interface corresponding to the target object identifier, wherein the second input is the same as or different from the first input;
a third output control unit, configured to, in a case that the second application interface or a target application process corresponding to the target object identifier is closed, redisplay the second application interface based on at least an obtained third input, where the third input is the same as or different from the second input;
the first input is realized by any one or any combination of keyboard information input, voice, gesture and lip language modes, so that the target object can be quickly enabled from the first application interface.
10. An electronic device, comprising:
a memory for storing at least one set of instructions;
a processor for invoking and executing the set of instructions in the memory, performing the control method of any one of claims 1-6 by executing the set of instructions, or performing the control method of any one of claims 7-8.
CN202010418716.9A 2020-05-18 2020-05-18 Control method and device and electronic equipment Active CN111580923B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010418716.9A CN111580923B (en) 2020-05-18 2020-05-18 Control method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010418716.9A CN111580923B (en) 2020-05-18 2020-05-18 Control method and device and electronic equipment

Publications (2)

Publication Number Publication Date
CN111580923A CN111580923A (en) 2020-08-25
CN111580923B true CN111580923B (en) 2023-02-17

Family

ID=72126819

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010418716.9A Active CN111580923B (en) 2020-05-18 2020-05-18 Control method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN111580923B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114237529A (en) * 2020-09-07 2022-03-25 华为技术有限公司 Navigation bar display method, navigation bar display method and first electronic equipment
CN114567619B (en) * 2020-11-27 2023-01-17 荣耀终端有限公司 Equipment recommendation method and electronic equipment
CN112669789A (en) * 2020-12-31 2021-04-16 联想(北京)有限公司 Control method and device
CN112925572B (en) * 2021-03-01 2023-05-23 联想(北京)有限公司 Control method and device and electronic equipment
CN113220954A (en) * 2021-05-11 2021-08-06 深圳市火乐科技发展有限公司 Information display method and device and projection equipment
CN113676384A (en) * 2021-07-26 2021-11-19 青岛海尔科技有限公司 Method and device for controlling screen projection of equipment, server and storage medium
CN115016703B (en) * 2021-09-10 2023-05-23 荣耀终端有限公司 Control method and system for selecting application program display screen in extended screen mode

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105426232A (en) * 2014-09-23 2016-03-23 宇龙计算机通信科技(深圳)有限公司 Interface processing method and apparatus
CN106909422A (en) * 2017-02-28 2017-06-30 北京小米移动软件有限公司 Open the method and apparatus of application
CN108762604A (en) * 2018-03-30 2018-11-06 联想(北京)有限公司 A kind of display methods, device and electronic equipment

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9600131B2 (en) * 2011-05-31 2017-03-21 Red Hat, Inc. Integrated application that contains software modules coupled to a message bus
CN105573832A (en) * 2015-05-26 2016-05-11 宇龙计算机通信科技(深圳)有限公司 Operation method and apparatus for audio play applications
CN105975170B (en) * 2016-06-20 2018-10-19 财付通支付科技有限公司 A kind of method and device of page load
CN106331355A (en) * 2016-08-29 2017-01-11 珠海市魅族科技有限公司 Information processing method and device
CN109976823A (en) * 2017-12-27 2019-07-05 Tcl集团股份有限公司 A kind of application program launching method, device and terminal device
CN108804151B (en) * 2018-04-28 2021-11-02 维沃移动通信有限公司 Method and terminal for restarting application program
CN109947003B (en) * 2019-03-29 2023-09-19 联想(北京)有限公司 Control method and control equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105426232A (en) * 2014-09-23 2016-03-23 宇龙计算机通信科技(深圳)有限公司 Interface processing method and apparatus
CN106909422A (en) * 2017-02-28 2017-06-30 北京小米移动软件有限公司 Open the method and apparatus of application
CN108762604A (en) * 2018-03-30 2018-11-06 联想(北京)有限公司 A kind of display methods, device and electronic equipment

Also Published As

Publication number Publication date
CN111580923A (en) 2020-08-25

Similar Documents

Publication Publication Date Title
CN111580923B (en) Control method and device and electronic equipment
CN109164964B (en) Content sharing method and device, terminal and storage medium
US11650716B2 (en) Operation methods of a smart interactive tablet, storage medium and related equipment
CN114467068B (en) Locating user interface components based on application layout and user workflow
CN108205430B (en) Double-screen mobile terminal, corresponding control method and storage medium
WO2021184375A1 (en) Method for execution of hand gesture commands, apparatus, system, and storage medium
US20190095051A1 (en) Method and system for performing copy-paste operations on a device via user gestures
WO2020238744A1 (en) Processing method, device and apparatus for split-screen display, and storage medium
CN109062479B (en) Split screen application switching method and device, storage medium and electronic equipment
CN107426403B (en) Mobile terminal
KR102133410B1 (en) Operating Method of Multi-Tasking and Electronic Device supporting the same
US8381127B2 (en) Methods, systems, and computer program products for displaying windows on a graphical user interface based on relative priorities associated with the windows
CN105988860B (en) Method for executing application program and mobile device
CN109933256A (en) Application programe switch-over method, application program switching device, medium and calculating equipment
US20190317658A1 (en) Interaction method and device for a flexible display screen
US20140362002A1 (en) Display control device, display control method, and computer program product
CN106325842B (en) Method and device for accessing similar applications of intelligent terminal and intelligent terminal
WO2018019050A1 (en) Gesture control and interaction method and device based on touch-sensitive surface and display
CN107797750A (en) A kind of screen content identifying processing method, apparatus, terminal and medium
WO2020248547A1 (en) Window minimization method and apparatus, storage medium, and interactive intelligent panel
CN108845752A (en) touch operation method, device, storage medium and electronic equipment
KR20160098752A (en) Display device and method for display thereof and computer-readable recording medium
WO2023016463A1 (en) Display control method and apparatus, and electronic device and medium
US11301124B2 (en) User interface modification using preview panel
CN113268182A (en) Application icon management method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant