CN117915141A - Local key control method and display device - Google Patents

Abstract

The embodiment of the application discloses a control method of a local key and display equipment, wherein the method comprises the following steps: when the first local key is detected to be pressed, a key configuration page mapped by the first local key is displayed, wherein the key configuration page comprises a function list of the first local key and an added application control, and the function list comprises at least one preset function control of the first local key; and adding a target application trigger control to the function list in response to a first combined operation executed by the user on the first local key and the add application control, wherein the target application trigger control is used for enabling the user to start the target application by triggering the first local key. The application ensures that the local key is not limited to the preset function, can rapidly start the application, and expands the function of the local key. Especially, when the user wants to start a certain application, but the remote controller cannot be used normally, the user can quickly access the application by triggering an application trigger control added in the function list of the local key, and the user experience is improved.

Description

Local key control method and display device

Technical Field

The application relates to the technical field of display equipment, in particular to a control method of a local key and the display equipment.

Background

The display devices such as smart televisions and the like can be provided with local keys, and the local keys can only trigger basic functions of the display devices, such as channel+, channel-, volume+, volume-, switching signal sources (sources), on-off and the like. The function of the local key is single and cannot be expanded, and especially when the remote controller is lost, damaged, and the battery has no electric quantity, a user cannot control the display device through the remote controller, and cannot trigger more functions of the display device through the local key, such as starting an application A, and the use experience of the user on the display device is affected.

Disclosure of Invention

The embodiment of the application provides a local key control method and display equipment, which are used for performing function expansion on local keys of the display equipment.

In a first aspect, an embodiment of the present application provides a display apparatus, including:

At least one local key;

A display for displaying a user interface;

A controller for performing:

When the first local key is detected to be pressed, controlling a display to display a key configuration page mapped by the first local key, wherein the key configuration page comprises a function list of the first local key and an added application control, and the function list comprises at least one preset function control of the first local key;

And in response to a first combined operation executed by the user on the first local key and the adding application control, adding a target application trigger control to the function list, wherein the target application trigger control is used for enabling the user to start the target application by triggering the first local key.

In some embodiments, the controller adds a target application trigger control to the list of functions in response to a first combined operation performed by a user on the first native key and an add application control, including: responding to a first preset operation executed by a user on the first local key, and controlling a selector to move in the key configuration page; when the selector selects the adding application control, if a second preset operation executed by a user on the first local key is received, controlling a display to display an application list, wherein the application list comprises application information of applications installed by the user; controlling the selector to jump into the application list, and controlling the selector to move in the application list in response to the first preset operation executed by the user on the first local key; when the selector selects the target application information, if the second preset operation executed by the user on the first local key is received, adding the target application trigger control corresponding to the target application information to the function list.

In some embodiments, after adding the target application trigger control to the list of functions, the controller is further to perform: responding to a first preset operation executed by a user on the first local key, and controlling a selector to move in the function list; and when the selector selects the target application trigger control, if the second preset operation executed by the user on the first local key is received, starting the target application, and controlling a display to close the key configuration page.

In some embodiments, the key configuration page further includes a key expansion control, the controller further to perform: responding to a first preset operation executed by a user on the first local key, and controlling a selector to move in the key configuration page; when the selector selects the key expansion control, if the second preset operation executed by the user on the first local key is received, controlling a display to display a key expansion function list, wherein the key expansion function list comprises at least one expansion function control of the first local key; controlling the selector to jump into the key expansion function list, and controlling the selector to move in the key expansion function list in response to a first preset operation executed by a user on the first local key; when the selector selects the first expansion function control, if a second preset operation executed by a user on the first local key is received, executing a target function corresponding to the first expansion function control.

In some embodiments, the controller includes a UI layer, a middleware layer, and a driver layer, and then the controller executes a function corresponding to the first extended functionality control, including: the UI layer transmits the virtual key instruction of the first expansion function control to the middleware layer; the middleware layer converts the virtual key instruction into a virtual key value and transmits the virtual key value to the UI layer; the UI layer acquires a key value list preset by the driving layer, wherein the key value list is used for recording the mapping relation between key values and key functions; and the UI layer acquires a target function corresponding to the virtual key value from the key value list and executes the target function.

In some embodiments, the key expansion function list includes a home page control, the controller further configured to perform: when the selector selects the homepage control, if a second preset operation of a user on the first local key is received, controlling a display to display a homepage interface, and displaying a first key expansion function sub-list on the upper layer of the homepage interface; the main page interface comprises at least one application icon, the first key expansion function sub-list comprises a direction key control and a confirmation control, the direction key control is used for moving the selector in the main page interface, and the confirmation control is used for confirming the position of the selector; responding to the operation of triggering the confirmation control by a user, and starting a first application corresponding to the application icon currently selected by the selector; and controlling a display to display an application page of the first application.

In some embodiments, the controller is further configured to perform: when an application page of the first application is displayed by a control display, a second key expansion function sub-list is displayed on the upper layer of the application page, and the second key expansion function sub-list comprises an exit control; and responding to the operation of triggering the exit control by the user, exiting the first application, and controlling a display to close an application page of the first application.

In some embodiments, the list of key expansion functions includes a voice control, the controller further configured to perform: when the selector selects the voice control, if a second preset operation executed by a user on the first local key is received, controlling a display to display a voice assistant configuration page, and displaying a third key expansion function sub-list on the upper layer of the voice assistant configuration page; the voice assistant configuration page comprises at least one voice assistant message, and the third key expansion function sub-list comprises the direction key control and the confirmation control; and responding to the operation of triggering the confirmation control by the user, and starting a first voice assistant corresponding to the voice assistant information currently selected by the selector.

In some embodiments, after controlling the display to display the key configuration page of the first native key map, the controller is further configured to perform: responding to a first preset operation executed by a user on the first local key, and controlling a selector to move in the function list; when the selector selects the first preset function control, if a second preset operation executed by a user on the first local key is received, executing a function corresponding to the first preset function control.

In a second aspect, an embodiment of the present application further provides a method for controlling a local key, where the method includes:

When a first local key is detected to be pressed, displaying a key configuration page mapped by the first local key, wherein the key configuration page comprises a function list of the first local key and an added application control, and the function list comprises at least one preset function control of the first local key;

And in response to a first combined operation executed by the user on the first local key and the adding application control, adding a target application trigger control to the function list, wherein the target application trigger control is used for enabling the user to start the target application by triggering the first local key.

In a third aspect, some embodiments of the present application also provide a computer storage medium having stored therein program instructions which, when run on a computer, cause the computer to perform the methods referred to in the above aspects and their respective implementations.

In the embodiment of the application, at least one local key can be configured on the body of the display device, and when any local key is pressed, the key configuration page mapped by the local key is displayed, and the key configuration pages of different local keys are different. In the embodiment of the application, the key configuration page comprises a function list and an added application control, the function list comprises at least one preset function control of a local key, and the preset functions are for example, on-off, source switching and the like. The adding application control is used for enabling a user to add an application program started by a local key, and the target application trigger control is added in the function list through the combined operation executed on the local key and the adding application control, so that the user can start the target application through the target application trigger control, the local key is not limited to a preset function any more, the application can be started quickly, and the function of the local key is expanded. Especially, when a user wants to start a certain application, but the remote controller cannot be used normally, the application which is needed to be started can be added into the function list of the local key through the flow, so that the user can conveniently start an application program through the application trigger control in the key configuration page, and the user experience is improved.

Drawings

In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is an operation scenario between a display device and a control apparatus 100 according to some embodiments of the present application;

Fig. 2 is a block diagram of a hardware configuration of a control device 100 according to some embodiments of the present application;

fig. 3 is a block diagram of a hardware configuration of a display device 200 according to some embodiments of the present application;

FIG. 4 is a software configuration diagram of a display device 200 according to some embodiments of the present application;

FIG. 5 is a flowchart of a method for controlling a local key according to some embodiments of the present application;

FIG. 6 is a schematic diagram I of a key configuration page according to some embodiments of the present application;

FIG. 7 is a second schematic diagram of a key configuration page according to some embodiments of the present application;

FIG. 8 is a third schematic diagram of a key configuration page according to some embodiments of the present application;

FIG. 9 is a first schematic diagram illustrating a change of a key configuration page according to some embodiments of the present application;

FIG. 10 is a diagram illustrating a key configuration page according to some embodiments of the present application;

FIG. 11 is a second schematic diagram illustrating a change of a key configuration page according to some embodiments of the present application;

FIG. 12 is a flowchart of another method for controlling a local key according to some embodiments of the present application;

FIG. 13 is a fifth diagram illustrating a key configuration page according to some embodiments of the present application;

FIG. 14 is a diagram sixth of a key configuration page according to some embodiments of the present application;

FIG. 15 is a schematic diagram of a system architecture according to some embodiments of the present application;

FIG. 16 is a schematic illustration of a home interface provided in accordance with some embodiments of the present application;

FIG. 17 is a schematic diagram of an application page according to some embodiments of the present application;

fig. 18 is a schematic diagram of a voice assistant configuration page according to some embodiments of the present application.

Detailed Description

For the purposes of making the objects and embodiments of the present application more apparent, an exemplary embodiment of the present application will be described in detail below with reference to the accompanying drawings in which exemplary embodiments of the present application are illustrated, it being apparent that the exemplary embodiments described are only some, but not all, of the embodiments of the present application.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided by the embodiment of the application can have various implementation forms, for example, a television, an intelligent television, a laser projection device, a display 260 (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table) and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus 100 according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the terminal device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc. Alternatively, the control device 100 may be a mouse, and the mouse and the display device may be connected by a wired or wireless manner. If the display device is a computer, the control apparatus 100 may be a mouse, a keyboard, or the like.

In some embodiments, the terminal device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the display device may receive instructions not using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

In some embodiments, server 400 may comprise a streaming server. The display device 200 may acquire streaming media data from the streaming media server after establishing a communication connection with the streaming media server, and play the received streaming media data.

Fig. 2 shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment in some embodiments. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

Fig. 3 is a block diagram of a hardware configuration of a display device 200 according to some embodiments of the present application. As shown in fig. 3, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the communicator 220 may be used to establish a communication connection between the display device 200 and a streaming server to enable interaction between the display device 200 and the streaming server. The controller 250 may transmit a download request to the streaming server through the communicator 220 to cause the streaming server to transmit streaming data to the display device 200 in response to the download request. After receiving the streaming media data through the communicator 220, the controller 250 may start the streaming media player and control the streaming media player to play the streaming media data, which includes audio and video data.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving image signals from the controller output, for displaying video content, image content, and a menu manipulation interface, and for manipulating a UI interface by a user. The display 260 may also be used to display video data of the streaming media.

In some embodiments, audio output interface 270 may be coupled to an audio playback device that plays audio data of the streaming media. Audio output interface 270 may be coupled to speakers internal to display device 200. The audio output interface may further include an external audio output terminal, where the external audio output terminal is used to connect to an external audio playing device (e.g., an audio device) in a wired manner. The audio playing device may also be an external power amplifier (e.g., bluetooth sound, bluetooth headset, etc.) that is wirelessly connected via the communicator 220.

The user interface may be configured to receive a control signal of the control device 100 (e.g., an infrared remote control, a mouse, etc.), where the control signal includes a streaming media on-demand operation input by a user through the control device 100.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (read-only memory, ROM), first to nth interfaces for input/output, a communication bus (bus), and the like.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Or the user may input the user command by inputting a specific sound or gesture, the user input interface recognizes the sound or gesture through the sensor, and receives the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of a user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a graphically displayed user interface that is related to computer operations. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: at least one of icons, operation menus, page contents displayed based on an input instruction of a user, and the like. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, as shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, respectively, from top to bottom.

In some embodiments, the application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on browser, such as: HTML5 APPs; a native application (NATIVE APPS);

in some embodiments, the application framework (Application Framework) is a complete program model that has all the basic functions required by standard application software, such as: file access, data exchange, and the interface for the use of these functions (toolbar, status column, menu, dialog box).

In some embodiments, the native application (NATIVE APPS) may support online or offline, message pushing, or local resource access.

In some embodiments, the middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

In some embodiments, the hardware layer mainly includes a HAL interface, hardware and a driver, where the HAL interface is a unified interface for all television chips to interface, and specific logic is implemented by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

For a device with the same or similar software and hardware configuration as the display device 200, at least one key (simply referred to as a native key) may be configured on the device body, where the native key, when pressed by a user, can generally only trigger a basic function (also referred to as a preset function) of the display device, for example, channel+, channel-, volume+, volume-, switching signal Source (Source), power on/off, and the like.

In some embodiments, the native key may map at least one preset function, and different native keys may map completely different or not completely the same preset function. For example, the types of the native keys may be classified into 1 key, 5 key, 7 key, etc. according to the number of the mapped preset functions; the types of the local key may be classified into a Power key (controlling the switching on and off of the display device), a channel key (controlling channel + and channel-), a volume key (controlling volume + and volume-), a Source key (switching a signal Source), etc., according to the mapped preset function types.

The local key is limited to a preset function, the key control function is single and cannot be expanded, and especially when the control device 100 (such as a remote controller) is lost, damaged, and the battery is not powered, and the like, the user cannot control the display device through the remote controller, and cannot trigger more functions of the display device through the local key, such as starting or exiting the application a, and the like, so that the use experience of the user on the display device is affected.

In order to solve the technical problems, the application provides a control method and display equipment for a local key, which aim to expand functions of the local key and enable a user to trigger more functions by operating the local key. Fig. 5 is a flowchart of a method for controlling a local key according to some embodiments of the present application, referring to fig. 5, the method may be executed by the controller 250, and includes the following program steps:

In step S51, when the first local key is detected to be pressed, the display is controlled to display a key configuration page mapped by the first local key.

In some embodiments, the controller may set a list of key functions and store the list of key functions in the overall machine profile. Wherein, the key function list is used for recording the mapping relation between the local key type and the preset function, and an exemplary key function list is shown in the following table 1:

Referring to table 1, for example, the native key types include 1 key, 5 key, and 7 key. Wherein, the 1 key only maps one preset function, namely the confirm key/OK key; 5 key map 5 preset functions including channel+, channel-, volume+, volume-, OK key/OK key; the 7 key maps 7 preset functions including channel+, channel-, volume+, volume-, OK/OK key, source key, and Power key. Note that, the division of the native key types and the configuration of the key function list are not limited to the example of table 1.

In some embodiments, the controller may monitor the state of the native key, including the pressed state and the idle state. The pressing state characterizes that a user presses the local key into the key groove, and the idle state refers to that the local key is in a natural form which is not pressed.

In some embodiments, when the controller monitors that any local key (first local key for short) is in a pressed state, the controller identifies a first key type (for example, 1 key, 5 key or 7 key) corresponding to the first local key, reads a key function list from the complete machine configuration file, and acquires a preset function matched with the first key type from the key function list, thereby generating a key configuration page.

Fig. 6 is a schematic diagram of a key configuration page according to some embodiments of the present application. Assuming that the pressed first local key is a 5 key, acquiring preset functions mapped by the 5 key from the key function list, wherein the preset functions comprise channel+, channel-, volume+, volume-, determination/OK, and thus generating and controlling the display to display a key configuration page, referring to FIG. 6, the key configuration page comprises a function list 61, at least one preset function control 61a of the first local key is included in the function list 61, and the preset function control 61a corresponds to one preset function. For example, for a 5-key, a channel + control, a channel-control, a volume + control, a volume-control, a OK/OK control are included.

In some embodiments, the user may perform a first preset operation on a first native key to move the selector 62 (also referred to as focus) in the function list 61. The first preset operation is not limited, and may be, for example, set to click/short-press the first native key. Referring to fig. 6, when the key configuration page is opened, the selector 62 defaults to select the channel + control that is first in the function list 61; when the user clicks/short presses the first native key one time, the selector 62 moves down one sequence bit, e.g., to the channel-control; similarly, when the OK control is selected by the selector 62, if the user clicks/short presses the first native key again, the selector 62 moves to the channel + control. Thus, the user can select the target control by performing a first preset operation on the first native key several times.

In some embodiments, when the selector 62 selects any preset function control 61a (hereinafter referred to as a first preset function control), the user may perform a second preset operation on the first native button to confirm the first preset function control selected by the selector 62 and trigger a function corresponding to the first preset function control. The second preset operation is not limited, and may be, for example, set to long-press the first local key. Referring to fig. 6, assuming that the selector 62 has currently selected the volume + control, when the user presses the first native key long, the controller triggers the volume + function, i.e., increases the volume output of the display device. Thus, the controller responds to the combined operation of the first preset operation and the second preset operation performed on the first local key by the user, and can trigger any preset function of the first local key. The embodiment of fig. 6 realizes that when the local key maps multiple preset functions, the user is supported to trigger any preset function according to the needs, but the local key is still limited to the scope of the preset functions in this way, and the function expansion of the local key is not performed.

Fig. 7 is a schematic diagram of a key configuration page according to some embodiments of the present application. Referring to FIG. 7, the key configuration page also includes an add application control 71. The position of the add application control 71 in the key configuration page is not limited and may be set at the lower part of the function list 61, for example.

Step S52, adding the target application trigger control to the function list in response to the first combined operation performed by the user on the first native key and the add application control.

In some embodiments, the controller controls the selector 62 to move within the key configuration page in response to a first preset operation (e.g., a single click/short press) performed by the user on the first native key, and if the preset functionality control 61a and the add application control 71 appear in a different row arrangement in the same column, see FIG. 7, the controller controls the selector 62 to move down one sequence bit each time the controller responds to the first preset operation until the selector 62 is moved to the position where the add application control 71 is selected.

Fig. 8 is a schematic diagram III of a key configuration page according to some embodiments of the present application. Referring to view (a) of fig. 8, when the selector 62 selects the add application control 71, the controller controls the display to display the application list 81 at the upper layer of the key configuration page in response to a second preset operation (e.g., long press) performed by the user on the first native key, referring to view (b) of fig. 8. The application list 81 includes application information 81A of the locally installed application, and the application information 81A includes, but is not limited to, an application name, an application icon (not shown in the figure), and the like, including, for example, an application A, an application B, an application C, and an application D ….

In some embodiments, the application list 81 may cover all M (m+.1) applications installed by the machine, or the controller may select N (1+.n+.m) applications from the M applications according to a preset selection rule, and add application information of the N applications to the application list 81 to filter out some unusual applications, so as to avoid redundancy of the application list 81. The preset selection rule is not limited, and for example, the preset selection rule may be configured as: the N applications with the latest use time closest to the current time are selected, or the N applications with the highest use frequency are selected.

In some embodiments, referring to view (b) of fig. 8, when the display displays the application list 81 at the top of the key configuration page, the controller may automatically jump the selector 62 into the application list 81 so that the controller may move the selector 62 within the application list 81 in response to a first preset operation (e.g., a single click/short press) performed by the user on the first native key.

In some embodiments, when the selector 62 selects any target application information in the application list 81, the controller may control the display to close the application list 81 and add a target application trigger control corresponding to the target application information to the function list 61 in response to a second preset operation (for example, long press) performed by the user on the first native key.

Fig. 9 is a schematic diagram illustrating a change of a key configuration page according to some embodiments of the present application. Referring to view (a) of fig. 9, the selector has currently selected application C, at which point the user presses the first native key long, referring to view (b) of fig. 9, the controller controls the display to close the application list 81, and adds the application trigger control 61b of application C to the function list 61.

In some embodiments, the location of the application trigger control 61b in the function list 61 is not limited, for example, if the priority of the application trigger control 61b is higher than the priority of the preset function control 61a, see the view (b) of fig. 9, the application trigger control 61b may be added to the first position of the function list 61, so that the next time the user opens the key configuration page mapped by the first native key, the selector 62 may quickly select the application trigger control 61b, thereby preferentially starting the extended application.

In some embodiments, if the priority of the preset functionality control 61a is higher than the priority of the application trigger control 61b, the newly added application trigger control 61b may be added to the last position of the functionality list 61, so that the selector 62 preferentially selects the preset functionality control 61a of the first native key.

In some embodiments, referring to fig. 9, the controller may set a corresponding delete control 61c for the application trigger control 61 b. The controller responds to the deletion control 61c corresponding to the application trigger control 61b of the target application triggered by the user, and deletes the application trigger control 61b of the target application from the function list 61, so that the user cannot access the target application through the local key, the user is supported to delete the application trigger control 61b of the function list 61 which is not accessed frequently or is unloaded in time, redundancy of the function list 61 is avoided, and key operation efficiency of the user is improved. The embodiment of the application supports the user to add and delete the application trigger control 61b in the function list 61 according to the need; the preset function control 61a of the local key is generally set for the factory of the equipment, and does not support the addition and deletion of users.

Fig. 10 is a schematic diagram of a key configuration page according to some embodiments of the present application. Referring to fig. 10, if the function list 61 includes a plurality of application trigger controls 61b, for example, including application trigger controls 61b corresponding to application C, application D, and application a, the controller may set the sorting positions of the plurality of application trigger controls 61b in the function list 61 according to a preset sorting rule. Wherein, the preset ordering rule may be configured as: sequencing according to the sequence of the application adding time, sequencing according to the sequence of the latest use time of the application, sequencing according to the use frequency of the application, and the like.

Step S53, the target application is started in response to a second combined operation executed by the user on the first local key and the target application trigger control.

Fig. 11 is a second schematic diagram illustrating a change of a key configuration page according to some embodiments of the present application. The controller controls the selector 62 to move within the function list 61 in response to the user performing a first preset operation (e.g., clicking/short pressing) on the first native key, see view (a) of fig. 11, and when the selector 62 selects an application trigger control 61b of any target application (e.g., application D), the user may perform a second preset operation (e.g., long pressing) on the first native key, see view (b) of fig. 11, and the controller may control the display to close the key configuration page, start the application D, and control the display to display an application page 111 of the application D.

In the embodiment of the application, the key configuration page comprises a function list and an adding application control, wherein the function list comprises at least one preset function control of a local key, and preset functions are channel +/-, volume +/-and the like. The adding application control is used for enabling a user to add an application program started by a local key, and the adding of the application trigger control in the function list is realized through the combined operation of the local key and the adding of the application control, wherein the application trigger control is equivalent to an operation entrance of the user for starting a target application by the local key, so that the shortcut function of starting the application program by the local key is expanded, and the local key is not limited to a preset function. Especially, when a user wants to start a certain application, but the remote controller cannot be used normally, the application which is needed to be started can be added into the function list of the local key through the flow, so that the user can conveniently start an application program through an application trigger control in the key configuration page, the use experience of the user is improved, and the function expansion of the local key is realized.

Fig. 12 is a flowchart of another method for controlling a local key according to some embodiments of the present application. Referring to fig. 12, the method may be performed by the controller 250, including the following program steps:

In step S121, when the first local key is detected to be pressed, the display is controlled to display a key configuration page mapped by the first local key.

Fig. 13 is a schematic diagram fifth of a key configuration page according to some embodiments of the present application. Referring to fig. 13, the key configuration page further includes a key expansion control 131. The position of the key expansion control 131 in the key configuration page is not limited, for example, if the key configuration page does not include the add-on application control 71, the key expansion control 131 may be disposed at the lower portion of the function list 61; if the key configuration page includes the add application control 71, the key expansion control 131 may be disposed at a lower portion of the add application control 71 or between the function list 61 and the add application control 71.

Step S122, in response to the third combination operation performed by the user on the first native key and the key expansion control, controlling the display to display a key expansion function list.

In some embodiments, the controller controls the selector 62 to move within the key configuration page in response to a first preset operation (e.g., a single click/short press) performed by the user on the first native key until the selector 62 is moved to a position where the key expansion control 131 is selected.

Fig. 14 is a schematic diagram sixth of a key configuration page according to some embodiments of the present application. Referring to view (a) of fig. 14, when the selector 62 selects the key expansion control 131, the user may perform a second preset operation (e.g., long press) on the first native key, and referring to view (b) of fig. 14, the controller may control the display to display the key expansion function list 141.

In some embodiments, referring to view (b) of fig. 14, the key expansion function list 141 includes at least one expansion function control of the first native key, including but not limited to: homepage control 141a (equivalent to a virtual Home key), direction control (including up, down, left, and right key controls, equivalent to a virtual direction key), exit control 141b (equivalent to a virtual exit key), return control (equivalent to a virtual return key), confirm control (equivalent to a virtual OK key), voice control 141c (equivalent to a virtual voice key), and the like. Thus, after the user triggers the button expansion control 131, it is equivalent to binding a "virtual remote controller" for the first local button, where the "virtual remote controller" is provided with virtual buttons/controls mapped for other functions of the first local button expansion, and the user can trigger the virtual buttons as required, so that the first local button is configured with more functions than the preset functions, and thus the function configuration of the local button is expanded from another angle.

Step S123, in response to the fourth combined operation performed by the user on the first native key and the key expansion function list, performing the target function.

In some embodiments, referring to view (b) of fig. 14, the controller may automatically jump the selector 62 into the key extended function list 141 when controlling the display to display the key extended function list 141, for example, to cause the selector 62 to preferentially select the first extended function control (e.g., the home page control 141 a) in the key extended function list 141, so that the selector 62 may be controlled to move within the key extended function list 141 in response to a first preset operation (e.g., a click/short press) performed by the user on the first native key. When any one of the extended functionality controls (hereinafter referred to as a first extended functionality control) is selected by the selector 62, the controller responds to a second preset operation (for example, long press) performed by the user on the first native key to execute the target function corresponding to the first extended functionality control. For example, the user triggers a return control in the key expansion function list 141, the controller may close the key configuration page and perform a return function, such as returning to a previous level menu, based on the state of the current display device.

Fig. 15 is a schematic diagram of a system architecture according to some embodiments of the present application. Referring to fig. 15, the system architecture may include, but is not limited to, a UI layer 151, a middleware layer 152, and a driver layer 153. The UI layer 151 and the middleware layer 152 may implement interaction through a biz interface; the driving layer 153 is configured to perform relevant configuration on the local key according to the model of the display device, and includes configuring a key function list of the local key, where the key function list is used to record a mapping relationship between a type of the local key and a preset function, and store the key function list in a configuration file of the complete machine, and a key value list is preset, where the key value list is used to record a mapping relationship between a key value and a key function, for example, a return key is mapped by a certain key value b.

In some embodiments, when the selector 62 selects the first extended functionality control, the UI layer 151 may generate a virtual key instruction corresponding to the first extended functionality control in response to a second preset operation (e.g., long press) performed by the user on the first native key, and pass the virtual key instruction to the middleware layer 152. The middleware layer 152 parses the virtual key instruction to convert the virtual key instruction into a virtual key value, and passes the virtual key value to the UI layer 151. The UI layer 151 may obtain a preset key value list from the driving layer 153, and obtain a target function of the virtual key value map returned by the middleware layer 152 from the key value list, for example, query the key value list to find that the key value c maps to an up key, and then the UI layer 151 may close the key configuration page, and perform the up function based on the current user interface and focus.

Thus, based on the key expansion function list 141 and the system architecture, the controller can effectively respond to the virtual key instruction of the local key expansion, so as to expand more functions except the preset function for the local key, and remove the limitation and restriction of the preset function to the local key.

FIG. 16 is a schematic illustration of a home interface provided in accordance with some embodiments of the present application. Referring to view (b) of fig. 14, when the selector 62 selects the home control 141a in the key expansion function list 141, the controller may control the display to display a home interface 161, referring to fig. 16, in response to a second preset operation (e.g., a long press) performed by the user on the first native key, the home interface 161 including at least one application icon 161a.

In some embodiments, referring to fig. 16, the controller may also control the display to display a first key expansion function sub-list 162 at an upper layer of the home interface 161. The first key expansion function sub-list 162 is a subset of the key expansion function list 141, and the controller may obtain expansion function controls adapted to homepage operations from the key expansion function list 141 to construct the first key expansion function sub-list 162, referring to fig. 16, the first key expansion function sub-list 162 includes, but is not limited to, a direction key control and a confirmation control. The direction key control is used for enabling a user to move the position of the selector/focus in the homepage interface, and comprises an up control, a down control, a left control, a right control and the like.

In some embodiments, referring to fig. 16, the controller may generate a first selector 62a and a second selector 62b, the first selector 62a being configured to move within the first key expansion function sub-list 162 such that a user may perform a first preset operation (e.g., a single click/short press) on a first native key to switch the expansion function control selected by the first selector 62 a. The second selector is used to move within the home interface 161 and the user can switch the application icon 161a selected by the second selector 62b by activating a directional key control in the first key expansion function sub-list 162. For example, the first selector 62a currently selects the down control, the second selector 62b currently selects the icon of the application a, and if the user presses the first native key for a long time (i.e., inputs the second preset operation), the UI layer performs a down function based on the system architecture of fig. 15, moving the second selector 62b to the icon of the application D located below the application a.

In some embodiments, the controller may also generate only one selector 62, the selector 62 moving within the first key expansion function sub-list 162 when the user performs a first preset operation on the first native key; when the user performs a second preset operation on the first native key, the controller needs to record the current position of the selector 62 within the first key expansion function sub-list 162. Assuming that the position number of the up control is 0, the position number of the down control is 1, the position number of the left control is 2, the position number of the right control is 3, the position number of the confirm control is 4, if the user performs a second preset operation on the first native key when the selector 62 selects the down control, the controller records that the position number of the selector 62 in the first key expansion function sub-list 162 is 1; then, the controller controls the selector 62 to jump to the home interface 161, acquires the icon number selected by the previously recorded selector 62 in the home interface 161, for example, 11 represents the icon number of the application a, and controls the selector 62 to move to the icon of the application D below the application a, assuming that the icon number of the application D is 21.

In some embodiments, when the selector 62 selects the icon of the application D, if the user performs a first preset operation on the first native key, the controller records that the icon number of the application D selected by the selector 62 in the home interface 161 is 21, then the controller controls the selector 62 to jump to the first key expansion function sub-list 162, obtains that the position number of the previously recorded selector 62 in the first key expansion function sub-list 162 is 1, and in response to the first preset operation, moves the selector 62 to the next control (i.e., the left control with the position number of 2) of the down control. And so on, the implementation jumps between the home interface 161 and the first key expansion function sub-list 162 with a single selector 62/focus.

In some embodiments, assuming that the user triggers the confirmation control in the first key expansion function sub-list 162 after the icon of any application (hereinafter referred to as the first application) is selected by the second selector 62 b/selector 62, the controller starts the first application and controls the display to display an application page of the first application.

Fig. 17 is a schematic diagram of an application page according to some embodiments of the present application. Referring to fig. 17, the application page 171 may include resources provided by the first application, and the controller may further control the display to display a second key expansion function sub-list 172 at an upper layer of the application page 171. The second sub-list of key extended functions 172 is a subset of the list of key extended functions 141, and the controller may obtain extended functionality controls adapted to the operation of the first application from the list of key extended functions 141 to construct the second sub-list of key extended functions 172, see fig. 17, the second sub-list of key extended functions 172 including, but not limited to, a directional key control, a confirmation control, a return control, an exit control, and a home page control. The direction key control is used for enabling a user to move the position of the selector/focus in the application page 171, the confirmation control is used for enabling the user to confirm the resource selected by the selector, the return control is used for returning to the previous page, the exit control is used for exiting the first application, and the homepage control is used for returning to the homepage interface 161 by one key.

In some embodiments, the user may open any target resource provided by the first application, such as viewing a movie of a hospital line, by a combined operation of the first native key, the direction key control, and the confirmation control.

In some embodiments, the user may trigger the exit control 141b in the second key expansion function sub-list 172 by a combined operation of the first native key and the exit control. In this way, the controller, in response to the user triggering the operation of the exit control 141b, exits the first application, controlling the display to close the application page 171.

In some embodiments, an application trigger control 61b may be included in the function list of the key configuration page, and the controller may initiate the first application in response to the user triggering the application trigger control 61b of the first application, and control the display to display an application page 171 of the first application. After the first application is started through the application entry added in the function list 61, the controller responds to the operation of the user triggering key expansion control 131 to obtain a second key expansion function sub-list adapting to the operation of the first application, calls out a second key expansion function sub-list 172 at the upper layer of the application page 171, responds to the operation of the user triggering the exit control in the second key expansion function sub-list 172, exits the first application, and controls the display to close the application page 171.

The user can trigger the control 61b through the application added in the function list 61 of the key configuration page to start any application, and call out the key expansion function sub-list through the key expansion control 131, so that the user can conveniently achieve the required operation intention (for example, opening application resources, exiting applications and the like) when the first application runs. Especially in the unable normal scene of using of controlling means such as remote controller, just can realize more function expansion through native button, promote the user to native button's rate of utilization, reduce native button's idle rate.

In some embodiments, referring to fig. 14, upon selection of the voice control 141c by the selector 62, the voice control 141c is triggered if a second preset operation performed by the user on the first native key is received.

Fig. 18 is a schematic diagram of a voice assistant configuration page according to some embodiments of the present application. Referring to view (b) of fig. 14, the controller, in response to a user triggering operation of the voice control 141c, referring to fig. 18, may control the display to display the voice assistant configuration page 181.

In some embodiments, referring to FIG. 18, a voice assistant configuration page 181 is used to prompt the user to select a voice assistant that is desired to be activated, the voice assistant configuration page 181 including at least one voice assistant information 181a and a later reselection control 181b. Where the voice assistant information 181a includes a standard name or nickname of the voice assistant, the example of fig. 18 includes voice assistant a and voice assistant b.

In some embodiments, referring to fig. 18, the controller may further control the display to display a third sub-list 182 of key extended functions at an upper layer of the voice assistant configuration page 181, the third sub-list 182 of key extended functions being a subset of the list 141 of key extended functions, and the controller may obtain extended function controls adapting to the voice assistant configuration operation from the list 141 of key extended functions to construct the third sub-list 182 of key extended functions, referring to fig. 18, the third sub-list 182 of key extended functions including, but not limited to, a direction key control and a confirmation control. The directional key control is used to enable the user to move the position of the selector/focus in the voice assistant configuration page 181, and the confirmation control is used to enable the user to confirm the voice assistant information 181a or to reselect the control 181b later selected by the selector. In the example of fig. 18, the voice assistant a, the voice assistant b, and the later reselection control 181b are arranged vertically, so the direction key control may include only an up key control and a down key control.

In some embodiments, referring to FIG. 18, the user causes the selector to select the voice assistant information corresponding to the first voice assistant (e.g., voice assistant b) by triggering the directional key control, and then triggers the confirmation control, so that the controller can control the display to close the voice assistant configuration page 181 and the third key expansion function sub-list 182 and activate the first voice assistant. After the first voice assistant is started, the user can realize voice control over the display device by interacting with the first voice assistant.

In some embodiments, referring to fig. 18, the user may also cause the selector to select the later reselection control 181b by triggering the direction key control, and then trigger the confirmation control, so that the controller may control the display to close the voice assistant configuration page 181 and the third key expansion function sub-list 182, not activate any voice assistant, and after a preset time (e.g., 1 hour) has elapsed, control the display to display the voice assistant configuration page 181 again.

In some embodiments, the first key expansion function sub-list 162, the second key expansion function sub-list 172 and the third key expansion function sub-list 182 may further include preset function controls corresponding to the first native key, which may be specifically set according to the usage scenario. For example, assuming that the first native key is of the 5-key type, the preset function control corresponding to the 5-key includes a confirm/OK control, referring to fig. 16 to 18, a confirm control (virtual confirm key) may be added to any of the extended function sub-lists of keys, so that the user may confirm the selected target object by triggering the confirm key.

In the embodiment of the application, the application control and the key expansion control are additionally arranged in the key configuration page, so that on one hand, a user can add a shortcut entry for starting the application by adding the application control to a function list of the key configuration page; on the other hand, the user can expand the functions of more virtual keys of the local key through the key expansion control, and realize the functions of starting a voice assistant, entering a homepage, starting or exiting an application and the like through the operation of the local key, so that the function expansion is performed on the local key, and particularly in the situation that a control device (such as a remote controller) cannot be normally used, the user can complete more functions and operations only by means of the local key, and the user experience is improved.

It should be noted that, the above embodiment solves the scenario that the control device 100 (e.g., remote controller) cannot be used normally, and how to perform function expansion through the local key. If the display device can normally communicate with the remote controller, the user can also combine the local key with the remote controller for use, for example, the user can call out a key configuration list by pressing the local key, and use the remote controller to operate related controls in a user interface such as a key configuration page, for example, add an application control to add an application trigger control in a function list by triggering the remote controller, so that an application program can be started by the local key later.

In addition, the system architecture, process flow, and UI interface presentation of the display device are not limited to examples of embodiments of the application. A person skilled in the art can add other controls for function expansion, such as a set menu control, to the key configuration page according to the function expansion requirement for the local key. The embodiment of the application can be applied to display equipment such as intelligent televisions, computers and the like, and for example, when a computer mouse or a keyboard cannot be used normally, a user can execute an expansion function through a local key on the computer.

Some embodiments of the present application also provide a computer storage medium, which may store a program. When the computer storage medium is configured in the display apparatus 200, the program may include program steps involved in the native key control method configured in the display apparatus 200 in the above embodiment when the program is executed. The computer storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a random access memory (Random Access Memory, RAM), or the like.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. The illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the disclosure and to enable others skilled in the art to best utilize the embodiments.

Claims (10)

1. A display device, characterized by comprising:

At least one local key;

A display for displaying a user interface;

A controller for performing:

When the first local key is detected to be pressed, controlling a display to display a key configuration page mapped by the first local key, wherein the key configuration page comprises a function list of the first local key and an added application control, and the function list comprises at least one preset function control of the first local key;

And in response to a first combined operation executed by the user on the first local key and the adding application control, adding a target application trigger control to the function list, wherein the target application trigger control is used for enabling the user to start the target application by triggering the first local key.

2. The display device of claim 1, wherein the controller, in response to a first combined operation performed by a user on the first native key and an add application control, adds a target application trigger control to the list of functions, comprises:

Responding to a first preset operation executed by a user on the first local key, and controlling a selector to move in the key configuration page;

when the selector selects the adding application control, if a second preset operation executed by a user on the first local key is received, controlling a display to display an application list, wherein the application list comprises application information of applications installed by the user;

Controlling the selector to jump into the application list, and controlling the selector to move in the application list in response to the first preset operation executed by the user on the first local key;

When the selector selects the target application information, if the second preset operation executed by the user on the first local key is received, adding the target application trigger control corresponding to the target application information to the function list.

3. The display device of claim 1 or 2, wherein after adding a target application trigger control to the list of functions, the controller is further to perform:

Responding to a first preset operation executed by a user on the first local key, and controlling a selector to move in the function list;

And when the selector selects the target application trigger control, if the second preset operation executed by the user on the first local key is received, starting the target application, and controlling a display to close the key configuration page.

4. The display device of claim 1, wherein the key configuration page further comprises a key expansion control, the controller further to perform:

Responding to a first preset operation executed by a user on the first local key, and controlling a selector to move in the key configuration page;

When the selector selects the key expansion control, if the second preset operation executed by the user on the first local key is received, controlling a display to display a key expansion function list, wherein the key expansion function list comprises at least one expansion function control of the first local key;

controlling the selector to jump into the key expansion function list, and controlling the selector to move in the key expansion function list in response to a first preset operation executed by a user on the first local key;

When the selector selects the first expansion function control, if a second preset operation executed by a user on the first local key is received, executing a target function corresponding to the first expansion function control.

5. The display device of claim 4, wherein the controller includes a UI layer, a middleware layer, and a driver layer, and wherein the controller performs functions corresponding to the first extended functionality control, including:

the UI layer transmits the virtual key instruction of the first expansion function control to the middleware layer;

The middleware layer converts the virtual key instruction into a virtual key value and transmits the virtual key value to the UI layer;

The UI layer acquires a key value list preset by the driving layer, wherein the key value list is used for recording the mapping relation between key values and key functions;

And the UI layer acquires a target function corresponding to the virtual key value from the key value list and executes the target function.

6. The display device of claim 4 or 5, wherein the list of key expansion functions includes a home page control, the controller further configured to perform:

When the selector selects the homepage control, if a second preset operation of a user on the first local key is received, controlling a display to display a homepage interface, and displaying a first key expansion function sub-list on the upper layer of the homepage interface; the main page interface comprises at least one application icon, the first key expansion function sub-list comprises a direction key control and a confirmation control, the direction key control is used for moving the selector in the main page interface, and the confirmation control is used for confirming the position of the selector;

responding to the operation of triggering the confirmation control by a user, and starting a first application corresponding to the application icon currently selected by the selector;

And controlling a display to display an application page of the first application.

7. The display device of claim 6, wherein the controller is further configured to perform:

When an application page of the first application is displayed by a control display, a second key expansion function sub-list is displayed on the upper layer of the application page, and the second key expansion function sub-list comprises an exit control;

and responding to the operation of triggering the exit control by the user, exiting the first application, and controlling a display to close an application page of the first application.

8. The display device of claim 6, wherein the list of key expansion functions includes a voice control, the controller further configured to perform:

When the selector selects the voice control, if a second preset operation executed by a user on the first local key is received, controlling a display to display a voice assistant configuration page, and displaying a third key expansion function sub-list on the upper layer of the voice assistant configuration page; the voice assistant configuration page comprises at least one voice assistant message, and the third key expansion function sub-list comprises the direction key control and the confirmation control;

and responding to the operation of triggering the confirmation control by the user, and starting a first voice assistant corresponding to the voice assistant information currently selected by the selector.

9. The display device of claim 1, wherein after controlling the display to display the key configuration page of the first native key map, the controller is further configured to perform:

Responding to a first preset operation executed by a user on the first local key, and controlling the selector to move in a function list;

when the selector selects the first preset function control, if a second preset operation executed by a user on the first local key is received, executing a function corresponding to the first preset function control.

10. The control method of the local key is characterized by comprising the following steps:

When a first local key is detected to be pressed, displaying a key configuration page mapped by the first local key, wherein the key configuration page comprises a function list of the first local key and an added application control, and the function list comprises at least one preset function control of the first local key;

And in response to a first combined operation executed by the user on the first local key and the adding application control, adding a target application trigger control to the function list, wherein the target application trigger control is used for enabling the user to start the target application by triggering the first local key.