CN111641856A

CN111641856A - Prompt message display method for guiding user operation in display equipment and display equipment

Info

Publication number: CN111641856A
Application number: CN202010442162.6A
Authority: CN
Inventors: 王学磊; 邱若强
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2020-05-22
Filing date: 2020-05-22
Publication date: 2020-09-08
Also published as: WO2021232914A1

Abstract

The embodiment of the invention relates to the technical field of display, in particular to a prompt message display method for guiding user operation in display equipment and the display equipment, wherein the prompt message display method comprises the following steps: a graphical user interface for guiding user manipulations is displayed on the display. The graphical user interface displays a control device interface object for controlling display equipment and a prompt language interface object for guiding a user to control; the prompt language interface object comprises texts and key pictures of corresponding keys on the control device, and the keys corresponding to the key pictures in the control device interface object are highlighted. The user can quickly and accurately select the key corresponding to the expected control according to the text corresponding to the prompt language interface, the key picture of the corresponding key on the control device and the key picture highlighted and displayed in the control device interface correspondence, the expected control is completed, the control steps are simplified, and the user experience is improved.

Description

Prompt message display method for guiding user operation in display equipment and display equipment

Technical Field

The present invention relates to the field of display technologies, and in particular, to a method for displaying prompt information for guiding a user to operate in a display device and a display device.

Background

With the continuous upgrade of smart television products, the traditional basic functions cannot meet the requirements of users. At present, a large number of new functions such as live video, video games, video on demand, broadcasting and the like are added to the smart television.

Due to the great increase of functions, in order to facilitate the use of the user, a prompt for prompting the user to operate is generally displayed on the page. However, the current prompts are presented to the user in a pure text form, and the number of keys on the control device is large, so that even if the user operates according to the prompts, the user often cannot accurately select the key corresponding to the expected operation, which results in operation errors. And finally, the expected operation can be completed by repeatedly trying, the operation steps are more complicated, and the user experience is poor.

Disclosure of Invention

The embodiment of the invention provides a prompt message display method for guiding user operation in display equipment and the display equipment, which are used for meeting the requirement that a user operates according to a prompt and a control device interface object, accurately selecting a key corresponding to an expected operation, completing the expected operation, simplifying the operation steps and improving the user experience.

In a first aspect, a method for displaying prompt information for guiding a user to operate in a display device is provided, including:

displaying a graphical user interface for guiding user manipulations on a display;

the graphical user interface displays a control device interface object for controlling display equipment and a prompt language interface object for guiding a user to control; the prompt language interface object comprises a text and a key picture of a corresponding key on the control device, and the key corresponding to the key picture in the control device interface object is highlighted;

and responding to the key value input of the key, and executing the function operation corresponding to the text.

In a second aspect, there is provided a display device comprising:

a display for displaying a graphical user interface;

the user interface is used for receiving instructions input by a user through the control device;

a controller for performing:

In the above-described embodiment, a graphical user interface for guiding user manipulations is displayed on the display. The graphical user interface displays a control device interface object for controlling display equipment and a prompt language interface object for guiding a user to control; the prompt language interface object comprises texts and key pictures of corresponding keys on the control device, and the keys corresponding to the key pictures in the control device interface object are highlighted. The user can quickly and accurately select the key corresponding to the expected control according to the text corresponding to the prompt language interface, the key picture of the corresponding key on the control device and the key picture highlighted and displayed in the control device interface correspondence, the expected control is completed, the control steps are simplified, and the user experience is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

Fig. 1A schematically illustrates a control scenario between a display device and a control apparatus;

fig. 1B is a block diagram schematically illustrating a configuration of the control apparatus 100 in fig. 1A;

fig. 1C is a block diagram schematically illustrating a configuration of the display device 200 in fig. 1A;

FIG. 1D is a block diagram illustrating an architectural configuration of a steering system in the memory of the display device 200;

fig. 1E schematically shows a control device 100 implemented as a remote control;

fig. 2 is a schematic diagram illustrating a main page provided by the display device 200;

fig. 3A-3D are schematic diagrams illustrating a GUI400 provided by the display apparatus 200 by manipulating the control device 100;

FIG. 4 illustrates a logical implementation of a hint display method in a display device;

fig. 5 exemplarily shows a communication flow diagram of the control apparatus pairing with the display device;

fig. 6 is a flowchart illustrating a prompt information display method for guiding a user operation in a display device.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Fig. 1A schematically illustrates a control scenario between a display device and a control apparatus. As shown in fig. 1A, the control apparatus 100 and the display device 200 may communicate with each other in a wired or wireless manner.

Among them, the control apparatus 100 is configured to control the display device 200, which may receive a manipulation instruction input by a user, and convert the manipulation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user controls the channel up/down keys on the control device 100, and the display device 200 responds to the channel up/down control.

The control device 100 may be a remote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control the display apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application program running on the smart device. The application program may provide various controls to the user through an intuitive user page (UI) on a screen associated with the smart device through configuration.

For example, the mobile terminal 100B may install a software application with the display device 200, implement connection communication through a network communication protocol, and implement the purpose of one-to-one control manipulation and data communication. Such as: the mobile terminal 100B may be caused to establish a control instruction protocol with the display device 200, and implement functions such as physical keys arranged by the remote controller 100A by manipulating various function keys or virtual buttons of a user page provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.

The display apparatus 200 may provide a network television function of a broadcast receiving function and a computer support function. The display device may be implemented as a digital television, a web television, an Internet Protocol Television (IPTV), or the like.

The display device 200 may be a liquid crystal display, an organic light emitting display, a projection device. The specific display device type, size, resolution, etc. are not limited.

The display apparatus 200 also performs data communication with the server 300 through various communication means. Here, the display apparatus 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display apparatus 200. By way of example, the display device 200 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The servers 300 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.

Fig. 1B is a block diagram illustrating the configuration of the control device 100. As shown in fig. 1B, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.

The controller 110 includes a Random Access Memory (RAM)111, a Read Only Memory (ROM)112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation and manipulation of the control device 100, as well as the communication cooperation between internal components, external and internal data processing functions.

Illustratively, when an interaction of a user pressing a key disposed on the remote controller 100A or an interaction of touching a touch panel disposed on the remote controller 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction and transmit the signal to the display device 200.

And a memory 120 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 120 may store various control signal commands input by a user.

The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the control apparatus 100 transmits a control signal (e.g., a touch signal or a button signal) to the display device 200 via the communicator 130, and the control apparatus 100 may receive the signal transmitted by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

The user input interface 140 may include at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like, so that a user can input a user instruction regarding controlling the display apparatus 200 to the control apparatus 100 through voice, touch, gesture, press, and the like.

The output interface 150 outputs a user instruction received by the user input interface 140 to the display apparatus 200, or outputs an image or voice signal received by the display apparatus 200. Here, the output interface 150 may include an LED interface 151, a vibration interface 152 generating vibration, a sound output interface 153 outputting sound, a display 154 outputting an image, and the like. For example, the remote controller 100A may receive an output signal such as audio, video, or data from the output interface 150, and display the output signal in the form of an image on the display 154, in the form of audio on the sound output interface 153, or in the form of vibration on the vibration interface 152.

And a power supply 160 for providing operation power support for each element of the control device 100 under the control of the controller 110. In the form of a battery and associated control circuitry.

A hardware configuration block diagram of the display device 200 is exemplarily illustrated in fig. 1C. As shown in fig. 1C, the display apparatus 200 may include a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, an audio processor 280, an audio output interface 285, and a power supply 290.

The tuner demodulator 210 receives the broadcast television signal in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., EPG data).

The tuner demodulator 210 is responsive to the user selected frequency of the television channel and the television signal carried by the frequency, as selected by the user and controlled by the controller 250.

The tuner demodulator 210 can receive a television signal in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to the different kinds of the received television signals.

In other exemplary embodiments, the tuning demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into the display apparatus 200 through the external device interface 240.

The communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the display apparatus 200 may transmit content data to an external apparatus connected via the communicator 220, or browse and download content data from an external apparatus connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, and a wired ethernet communication protocol module 223, so that the communicator 220 may receive a control signal of the control device 100 according to the control of the controller 250 and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.

The detector 230 is a component of the display apparatus 200 for collecting signals of an external environment or interaction with the outside. The detector 230 may include a sound collector 231, such as a microphone, which may be used to receive a user's sound, such as a voice signal of a control instruction of the user to control the display device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling the display device 200 to adapt to ambient noise.

In some other exemplary embodiments, the detector 230, which may further include an image collector 232, such as a camera, a video camera, etc., may be configured to collect external environment scenes to adaptively change the display parameters of the display device 200; and the function of acquiring the attribute of the user or interacting gestures with the user so as to realize the interaction between the display equipment and the user.

In some other exemplary embodiments, the detector 230 may further include a light receiver for collecting the intensity of the ambient light to adapt to the display parameter variation of the display device 200.

In some other exemplary embodiments, the detector 230 may further include a temperature sensor, such as by sensing an ambient temperature, and the display device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, the display apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, the display device 200 may be adjusted to display a warmer color temperature of the image.

The external device interface 240 is a component for providing the controller 250 to control data transmission between the display apparatus 200 and an external apparatus. The external device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

The external device interface 240 may include: a High Definition Multimedia Interface (HDMI) terminal 241, a Composite Video Blanking Sync (CVBS) terminal 242, an analog or digital Component terminal 243, a Universal Serial Bus (USB) terminal 244, a Component terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.

The controller 250 controls the operation of the display device 200 and responds to the manipulation of the user by operating various software control programs (e.g., a manipulation system and various application programs) stored on the memory 260.

As shown in fig. 1C, the controller 250 includes a Random Access Memory (RAM)251, a Read Only Memory (ROM)252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. The RAM251, the ROM252, the graphic processor 253, and the CPU processor 254 are connected to each other through a communication bus 256 through a communication interface 255.

The ROM252 stores various system boot instructions. If the display apparatus 200 starts to be powered on when receiving the power-on signal, the CPU processor 254 executes the system start-up command stored in the ROM252 and copies the operating system stored in the memory 260 to the RAM251 to start operating the start-up operating system. After the control system is started, the CPU processor 254 copies the various application programs in the memory 260 to the RAM251, and then starts running and starting the various application programs.

And a graphic processor 253 for generating various graphic objects such as icons, a manipulation menu, and a user input instruction display graphic. The graphic processor 253 may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to display attributes; and a renderer for generating various objects based on the operator and displaying the rendered result on the display 275.

A CPU processor 254 executes the operating system and application program instructions stored in memory 260. And according to the received user input instruction, processing of various application programs, data and contents is executed so as to finally display and play various audio-video contents.

In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some initialization manipulations of the display apparatus 200 in the display apparatus preload mode and/or manipulations of display graphics in the normal mode. And a plurality of or one sub-processor for performing a manipulation in a standby mode or the like of the display apparatus.

The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.

The controller 250 may control the overall manipulation of the display device 200. For example: in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform a manipulation related to the object selected by the user input command.

Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The manipulation related to the selected object is, for example, a manipulation of displaying a link to a hyperlink page, document, image, or the like, or a manipulation of executing a program corresponding to the object. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

A memory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM251 and the ROM252 of the controller 250, or a memory card in the display device 200.

In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.

In some embodiments, memory 260 is specifically configured to store drivers for tuner demodulator 210, communicator 220, detector 230, external device interface 240, video processor 270, display 275, audio processor 280, etc., and related data, such as external data (e.g., audio-visual data) received from the external device interface or user data (e.g., key information, voice information, touch information, etc.) received by the user interface.

In some embodiments, memory 260 specifically stores software and/or programs representing an Operating System (OS), which may include, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. Illustratively, the kernel may control or manage system resources, as well as functions implemented by other programs (e.g., the middleware, APIs, or applications); at the same time, the kernel may provide an interface to allow middleware, APIs, or applications to access the controller to enable control or management of system resources.

A block diagram of the architectural configuration of the steering system in the memory of the display device 200 is illustrated in fig. 1D. The control system architecture comprises an application layer, a middleware layer and a kernel layer from top to bottom.

The application layer, the application programs built in the system and the non-system-level application programs belong to the application layer. Is responsible for direct interaction with the user. The application layer may include a plurality of applications such as a setup application, a post application, a media center application, and the like. These applications may be implemented as Web applications that execute based on a WebKit engine, and in particular may be developed and executed based on HTML5, Cascading Style Sheets (CSS), and JavaScript.

Here, HTML, which is called HyperText Markup Language (HyperText Markup Language), is a standard Markup Language for creating web pages, and describes the web pages by Markup tags, where the HTML tags are used to describe characters, graphics, animation, sound, tables, links, etc., and a browser reads an HTML document, interprets the content of the tags in the document, and displays the content in the form of web pages.

CSS, known as Cascading Style Sheets (Cascading Style Sheets), is a computer language used to represent the Style of HTML documents, and may be used to define Style structures, such as fonts, colors, locations, etc. The CSS style can be directly stored in the HTML webpage or a separate style file, so that the style in the webpage can be controlled.

JavaScript, a language applied to Web page programming, can be inserted into an HTML page and interpreted and executed by a browser. The interaction logic of the Web application is realized by JavaScript. The JavaScript can package a JavaScript extension interface through a browser, realize the communication with the kernel layer,

and the middleware layer can provide a plurality of standardized interfaces to support the operation of various environments and systems. For example, the middleware layer may be implemented as multimedia and hypermedia information coding experts group (MHEG) middleware related to data broadcasting, DLNA middleware which is middleware related to communication with an external device, middleware which provides a browser environment in which each application program in the display device operates, and the like.

The kernel layer provides core system services, such as: file management, memory management, process management, network management, system security authority management and the like. The kernel layer may be implemented as a kernel based on various manipulation systems, for example, a kernel based on a Linux manipulation system.

The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: provide display driver for the display, provide camera driver for the camera, provide button driver for the remote controller, provide wiFi driver for the WIFI module, provide audio driver for audio output interface, provide power management drive for Power Management (PM) module etc..

A user interface 265 receives various user interactions. Specifically, it is used to transmit an input signal of a user to the controller 250 or transmit an output signal from the controller 250 to the user. For example, the remote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user interface 265, and then the input signal is transferred to the controller 250 through the user interface 265; alternatively, the remote controller 100A may receive an output signal such as audio, video, or data output from the user interface 265 via the controller 250, and display the received output signal or output the received output signal in audio or vibration form.

In some embodiments, a user may enter user commands on a graphical user page (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items.

Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 receives the user input command by recognizing the sound or gesture through the sensor.

The video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 275.

Illustratively, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is configured to demultiplex an input audio/video data stream, where, for example, an input MPEG-2 stream (based on a compression standard of a digital storage media moving image and voice), the demultiplexing module demultiplexes the input audio/video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert a frame rate of an input video, for example, convert a frame rate of an input 60Hz video into a frame rate of 120Hz or 240Hz, where a common format is implemented by using, for example, an interpolation frame method.

And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.

A display 275 for receiving the image signal from the input of the video processor 270 and displaying the video content, the image and the menu manipulation page. The display video content may be from the video content in the broadcast signal received by the tuner-demodulator 210, or from the video content input by the communicator 220 or the external device interface 240. A display 275 while displaying a user manipulation page UI generated in the display apparatus 200 and used to control the display apparatus 200.

And, the display 275 may include a display screen assembly for presenting graphics and a driving assembly for driving the display of images. Alternatively, a projection device and projection screen may be included, provided display 275 is a projection display.

The audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by the speaker 286.

Illustratively, audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.

The audio output interface 285 is used for receiving an audio signal output by the audio processor 280 under the control of the controller 250, and the audio output interface 285 may include a speaker 286 or an external sound output terminal 287, such as an earphone output terminal, for outputting to a generating device of an external device.

In other exemplary embodiments, video processor 270 may comprise one or more chips. Audio processor 280 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated with the controller 250 in one or more chips.

And a power supply 290 for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display apparatus 200 or may be a power supply installed outside the display apparatus 200.

It should be noted that, in order to select and execute the function paired with the control device provided by the display apparatus 200, the display apparatus 200 provides a plurality of prompts for instructing to implement the pairing function, and at the same time, the control device 100 configured to control the display apparatus 200 may include a plurality of keys with pictures for selecting the function, so as to prompt the user that the display apparatus 200 can execute the prompt function adapted to the keys with pictures by manipulating the keys with pictures on the control device 100.

Here, the function information corresponding to the above-described cue language has a mapping relationship with the key having a picture on the control device 100. Specifically, when the display device 200 receives a key event value corresponding to each key having a picture on the control apparatus 100, which is input by the user, the display device 200 may perform function manipulation corresponding to the key event value based on the mapping relationship, so that the user can visually match the key having the picture on the control apparatus 100 with the function provided by each hint.

For example, as shown in fig. 3C, a main page 41 is displayed on the display. The prompt of fig. 3C contains "long press of the menu key until you hear the beep. The remote controller is ensured to be close to the text information of a television (within the range of 3m in radius), and pictures corresponding to menu keys on the control device are also included, and the menu key pictures are displayed among the prompting language text contents. The control device 100 shown in fig. 1E is provided with a menu key, and the pattern of the menu key on the control device is the same as the picture in the prompt, so that the user can operate the menu on the control device 100 to make the display device 200 execute the pairing function.

A schematic diagram of a main page provided by a display device 200 is exemplarily shown in fig. 2.

As shown in fig. 2, the display device may provide a main page 41 to the display, which may be the first displayed graphic after power-up. In the home page, the user inputs an instruction indicating that the control apparatus is paired with the display device by manipulating the control apparatus. For example, after the user turns on the display device, the user wants to pair the control apparatus and the display device through bluetooth. The pairing can be triggered by pressing any key on the control device. The pairing is triggered through any key, and a pairing signal is sent to the display device in an infrared mode.

In response to an instruction input by the user through manipulation of the control means to pair the control means with the display device, the display device displays a prompt graphic 41-1 of the control means on the display as shown in fig. 3A. The prompt graph is a graph of the control device, and can be a graph of the control device matched with the display equipment, and the graph shows all keys on the control device.

Wherein cases related to pairing the control device and the display device are highlighted in the reminder graphic. The image 41-1a of the control device shown in fig. 3A is used to guide the user to highlight the corresponding case area where the key on the control device is manipulated, while other areas are grayed out, thereby guiding the user to press the corresponding key on the control device.

In some embodiments, in order to more clearly display the highlighted case area and to more easily guide the corresponding case on the pressing control device, as shown in fig. 3B, an enlarged graphic 41-1B of the highlighted area may be additionally displayed on one side of the highlighted area. The magnified graphics may be presented in still images or in dynamic motion.

In some embodiments, if the control device and the display device are not self-contained, it is possible that the graphics of the control device displayed on the display device may not correspond to the control device currently in use. Prompts for the user to manipulate the keys on the control device may also be displayed on the display. As shown in fig. 3C, the prompt is displayed on the display: press and hold the menu button unfit you board a beep. make sure you hear beep to this TV (around 3 meters).)

The prompt words may include text information for the user to instruct the user to operate the control device and pictures corresponding to the keys on the control device. For example, the prompt of FIG. 3C includes "long press of the menu key until you hear the beep. The remote controller is ensured to be close to the text information of a television (within the range of 3m in radius), and pictures corresponding to menu keys on the control device are also included, and the menu key pictures are displayed among the prompting language text contents. Therefore, when the user operates the case, the correct case can be selected more easily, the operation steps are further simplified, and the pairing success rate of the operation device and the display equipment is improved.

Here, in the process of pairing the control apparatus with the display device, it may be necessary to go through a plurality of steps, requiring a plurality of keys to be pressed. Thus, the prompt may also change with this. For example, after the user presses the menu key in the prompt and the prompt graphic in fig. 3C, the display device jumps from the page in fig. 3C to the page in fig. 3D in response to an instruction to proceed to the next step, which is input by the user by pressing a key on the control means. The highlighted area in the page control device graphic of fig. 3D is replaced with a confirmation key from the menu key, while the enlarged area is also replaced with a confirmation key. In addition, the prompt is also changed into the prompt related to the confirmation key: press and hold the confirm button to complete the pairing, and the confirm button picture is displayed between the text contents.

Here, the specific implementation manner of inserting characters and pictures in the prompt language at the same time is as follows:

such as the prompts in fig. 3C: press [ menu key ] long until you hear the beep. Here, the cue is divided into three parts: long press, menu key picture, until you hear beep. Two entries are then submitted: and long pressing is performed until you hear the beep sound, and the pages are arranged from left to right according to the sequence of long pressing, menu key pictures and until you hear the beep sound and are sequentially displayed as characters, pictures and characters.

Or, as shown in the implementation logic implementation diagram shown in fig. 4, after the computer is started up, the display device responds to an input instruction of pressing any key of the control device by a user, triggers the control device to be paired with the display device, and simultaneously displays a prompt graph of the control device on the display and a prompt on a page. At this time, the I18n plug-in obtains the text content to be displayed according to the current language environment. For example, first get long press until you hear the beep. Transmitting the path and size of the menu key picture through a Filter, then obtaining the menu key picture by a Filter component according to the path and size of the menu key picture and carrying out div display, and finally inserting the div displayed menu key picture between the character management application and the character pressing to obtain a final prompt language: press [ menu key ] long until you hear the beep.

In addition, based on the above implementation logic, the text content (another multi-language entry) may also be transmitted to the component through the Filter, where the font size and color may be set, and the Filter component acquires the text content and inserts the transmitted text content into the original text entry based on the transmitted parameters. Therefore, the embodiment of the application can also switch and display the prompt language.

In some embodiments, a communication flow diagram for controlling the pairing of an apparatus with a display device as shown in fig. 5. The user sends pairing packages to all display devices in the emission range indiscriminately by a command of indicating the pairing of the control device and the display devices, which is input by long pressing of a menu key, and a plurality of display devices which can be paired possibly exist in the emission range are paired possibly and return response data packages to the control device, so that the pairing with the control device is realized. However, in order to avoid one control apparatus controlling a plurality of televisions using a voice function, the pairing function of the embodiment of the present application shows that one bluetooth control apparatus supports pairing only one display device. Finally, the control device can be executed to complete the pairing function with the earliest returned response packet (i.e., the display device closest to the control device).

With reference to the method of fig. 6, the method for displaying the prompt information for guiding the user operation in the display device of the present application includes the following steps:

s51: displaying a graphical user interface for guiding user manipulations on a display;

for example, after the user turns on the display device, the user wants to pair the control apparatus and the display device through bluetooth. As shown in fig. 3C, the prompt is displayed on the display: press and hold the MENU button unfit you heart muscle is close to this TV (around 3meters) (long Press MENU key until you hear beep. ensure that the remote control is close to the TV (within radius 3 m)). The prompt words may include text information for the user to instruct the user to operate the control device and pictures corresponding to the keys on the control device. The prompt of fig. 3C contains "long press of the menu key until you hear the beep. The remote controller is ensured to be close to the text information of a television (within the range of 3m in radius), and pictures corresponding to menu keys on the control device are also included, and the menu key pictures are displayed among the prompting language text contents.

A prompt graphic 41-1 of the control device is also displayed on the display. The prompt graph is a graph of the control device, and can be a graph of the control device matched with the display equipment, and the graph shows all keys on the control device. Wherein cases related to pairing the control device and the display device are highlighted in the reminder graphic. The image 41-1a of the control device shown in fig. 3C is used to guide the user to highlight the corresponding case area where the key on the control device is manipulated, while other areas are grayed out, thereby guiding the user to press the corresponding key on the control device.

S52: and responding to the key value input of the key, and executing the function operation corresponding to the text.

For example, in fig. 3C, the user presses a menu key on the control apparatus, and the display device performs a function of pairing the control apparatus with the display device in response to a key value input of the menu key.

While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. A prompt message display method for guiding user operation in a display device is characterized by comprising the following steps:

2. The method according to claim 1, wherein highlighting the key in the control device interface object corresponding to the key picture specifically comprises:

highlighting keys corresponding to the key pictures in the control device interface object, and meanwhile, graying out other areas in the control device interface object;

or, the key corresponding to the key picture in the control device interface object is highlighted, and other keys in the control device interface object are not displayed at the same time.

3. The method according to claim 1, wherein highlighting the key in the control device interface object corresponding to the key picture specifically comprises:

highlighting keys corresponding to the key pictures in the control device interface object, additionally displaying an amplified graph of the highlighted area on one side of the highlighted area, and simultaneously displaying other areas in the control device interface object in a gray mode;

or, the key corresponding to the key picture in the control device interface object is highlighted, an enlarged graph of the highlighted area is additionally displayed on one side of the highlighted area, and other keys in the control device interface object are not displayed.

4. The method of claim 1, further comprising: in the prompt language interface object, the key pictures are arranged among the texts.

5. The method of claim 1, wherein the text is used to prompt a user to pair the control device with the display device;

executing the functional operation corresponding to the text, specifically comprising: and executing the function of pairing the control device and the display equipment.

6. The method according to claim 5, wherein performing the function of pairing the control device and the display device specifically comprises:

and executing the function of pairing the control device and the display equipment closest to the control device.

7. A display device, comprising:

a display for displaying a graphical user interface;

a controller for performing:

8. The display apparatus according to claim 7, wherein the controller is configured to execute the controlling of highlighting a key corresponding to the key picture in the device interface object, specifically including:

9. The display apparatus according to claim 7, wherein the controller is configured to execute the controlling of highlighting a key corresponding to the key picture in the device interface object, specifically including: highlighting keys corresponding to the key pictures in the control device interface object, additionally displaying an amplified graph of the highlighted area on one side of the highlighted area, and simultaneously displaying other areas in the control device interface object in a gray mode;

10. The display device according to claim 7, wherein the controller is further configured to perform: in the prompt language interface object, the key pictures are arranged among the texts.