CN114866636A

CN114866636A - Message display method, terminal device, intelligent device and server

Info

Publication number: CN114866636A
Application number: CN202110157160.7A
Authority: CN
Inventors: 管春辉
Original assignee: Juhaokan Technology Co Ltd
Current assignee: Juhaokan Technology Co Ltd
Priority date: 2021-02-04
Filing date: 2021-02-04
Publication date: 2022-08-05
Anticipated expiration: 2041-02-04
Also published as: CN114866636B

Abstract

The invention discloses a message display method, terminal equipment, intelligent equipment and a server, wherein for the intelligent equipment: receiving a message request sent by a server; when the message request does not identify the screen domination mark, displaying prompt information for prompting a user to check a new message; when the message request identifies the screen heater identification and the screen heater message leaving function of the local terminal is not started, displaying prompt information for prompting a user to check a new message; and when the message request identifies the screen heater identifier and the screen heater message leaving function of the local terminal is started, controlling a display to automatically display a message body in the message request in a floating layer mode on the upper layer of the current interface. The method and the device improve the ornamental value and the significance of the message information, and realize message display of the intelligent device in the cross-end remote control home scene.

Description

Message display method, terminal device, intelligent device and server

Technical Field

The invention relates to the field of intelligent interaction, in particular to a message display method, terminal equipment, intelligent equipment and a server.

Background

At present, intelligent devices such as televisions, refrigerators and the like are frequently added with message board functions, and users can input expected message information through the message board functions and also can check history or newly received message information through the message board. If the family members comprise a son, a father and a mother, and the son goes out temporarily, the message information can be input into a message board of the refrigerator to be ' dama ' that I has something to go out and dinner does not eat at home, eggs and tomatoes are arranged in the refrigerator, and the person can eat nutritional tomato fried eggs at dinner ', then the message information can be added into the message board by the refrigerator and displayed on a screen of the refrigerator, and then the father or the mother can know the condition of the son and feel the attention of the son to the son after checking the prompt of the message information. The message board function provides an individualized and humanized message mode for the intelligent equipment, the practical application and the interactive function of the intelligent equipment are expanded, and the user experience is improved. What needs to be considered in the art at present is how to further enhance the message board function.

Disclosure of Invention

The invention provides a message display method, terminal equipment, intelligent equipment and a server, which can realize cross-terminal message leaving operation and improve the prompt display effect of message leaving information.

An embodiment of the first aspect provides a terminal device, including:

the display is used for displaying a related interface of message leaving operation;

the communicator is used for being in communication connection with the server;

a controller configured to perform:

receiving an operation of starting a message board application, and controlling a display to display a first message board interface, wherein the first message board interface comprises a user-defined screen-saver message control;

receiving the clicking operation of the user-defined screen message control, and controlling a display to display a screen theme list interface;

receiving a selection operation of a first target image in the screen dominating theme list interface, and controlling a display to display a second message board interface, wherein the second message board interface comprises an information input box superposed with the first target image;

the method comprises the steps of receiving first message information input by a user in an information input box, generating and sending a first message request to a server according to the first message information, wherein the first message request comprises a user-defined identifier, the first message request is used for enabling the server to assemble the first message information and a first target image into a first message body according to the user-defined identifier, and sending a second message request to the intelligent equipment, the second message request comprises the first message body and a screen heater identifier, and the second message request is used for enabling the intelligent equipment to automatically display the first message body on the upper layer of a current interface in a floating layer mode after the screen heater identifier is identified.

An embodiment of the second aspect provides another terminal device, including:

the display is used for displaying a relevant interface of message leaving operation;

the communicator is used for being in communication connection with the server;

a controller configured to perform:

receiving the operation of starting the message board application and controlling the display to display a message board interface;

after receiving a selection of a local first target image from a user, generating a first message request containing a user-defined identifier according to input message information, wherein the first message request is used for enabling a server to assemble the message information and the first target image into a first message body according to the user-defined identifier, and sending a second message request to intelligent equipment, the second message request comprises the first message body and a screen heater identifier, and the second message request is used for enabling the intelligent equipment to automatically display the first message body on the upper layer of a current interface in a floating layer mode after identifying the screen heater identifier;

when the selection of the user on the first target image is not received, a third message request is generated according to the input message information, the third message request does not contain a custom identifier, the third message request is used for enabling a server to automatically match a second target image according to the message information, the message information and the second target image are assembled into a second message body, a fourth message request is sent to the intelligent device, the fourth message request comprises the second message body and a screen heater identifier, and the fourth message request is used for enabling the intelligent device to automatically display the second message body on the upper layer of a current interface in a floating layer mode after the screen heater identifier is identified.

In the terminal device provided by the first aspect, the user selects the first target image through the screen-highlighting theme list preset by the server, and the terminal device provided by the second aspect is the user selects the first target image from the local image, that is, two implementation modes of self-defining the screen-highlighting theme are provided.

A third aspect provides a server comprising:

the communicator is used for being in communication connection with the terminal equipment and the intelligent equipment;

a controller configured to perform:

receiving a message request sent by terminal equipment; the terminal equipment is further used for filling a user-defined identifier in the message request if the message request is generated after a user selects a first target image from a screen-dominating subject list interface, otherwise, the user-defined identifier is not added;

when the user-defined identifier is identified, assembling a first target image and message information into a first message body, and sending a second message request comprising the first message body and a screen saver identifier to the intelligent equipment, wherein the second message request is used for enabling the intelligent equipment to automatically display the first message body on the upper layer of a current interface in a floating layer mode after the screen saver identifier is identified;

and when the user-defined identifier is not identified, automatically matching a second target image according to the message information, assembling the second target image and the message information into a second message body, and sending a fourth message request comprising the second message body and a screen saver identifier to the intelligent equipment, wherein the fourth message request is used for enabling the intelligent equipment to automatically display the second message body on the upper layer of the current interface in a floating layer mode after the screen saver identifier is identified.

A fourth aspect provides a smart device comprising:

the display is used for interactively displaying the message information input by the terminal equipment;

the communicator is used for being in communication connection with the server;

a controller configured to perform:

receiving a message request sent by a server;

when the screen dominating identification is not identified in the message request, displaying prompt information for prompting a user to check a new message;

when the message request identifies the screen dominating identification and the screen dominating message function of the local terminal is not started, displaying prompt information for prompting the user to check a new message;

and when the message request identifies the screen heater identifier and the screen heater message leaving function of the local terminal is started, controlling a display to automatically display a message body in the message request in a floating layer mode on the upper layer of the current interface.

A message display method in a terminal device according to a fifth aspect includes:

receiving an operation of starting a message board application, and displaying a first message board interface, wherein the first message board interface comprises a user-defined screen message control;

receiving the clicking operation of the user-defined screen message control, and displaying a screen theme list interface;

receiving selection operation of a first target image in the screen dominating theme list interface, and displaying a second message board interface, wherein the second message board interface comprises an information input box superposed with the first target image;

A message display method in a server according to a sixth aspect includes:

A message display method in the intelligent device provided in the seventh aspect includes:

receiving a message request sent by a server;

when the message request does not identify the screen domination mark, displaying prompt information for prompting a user to check a new message;

when the message request identifies the screen heater identification and the screen heater message leaving function of the local terminal is not started, displaying prompt information for prompting a user to check a new message;

According to the technical scheme, the cross-device interaction message from the terminal device to the intelligent device is achieved, the interaction three ends comprise the terminal device, the server and the intelligent device, the terminal device is a mobile terminal such as a mobile phone and a tablet, and the intelligent device is an intelligent household appliance such as a television and a refrigerator. On the basis of the application of the conventional message board, the intelligent device is additionally provided with a screen-saver message function, and if the screen-saver message function is not started, the processing logic of a common message is executed; if the screen-dominating message-leaving function is started, the server assembles the image with the screen-dominating background and the message information input by the user in the terminal equipment into a message body, so that the intelligent equipment end displays the message body on the upper layer of the current interface of the intelligent equipment in a floating layer manner, and the prompt effect of screen-dominating messages is presented.

The user can self-define and select the screen-dominating theme at the terminal equipment, and the specific operation flow is as follows: after a user starts a message board application, the user enters a first message board interface, the user clicks a self-defined message control of a message board in the first message board interface, the terminal device displays a message board theme list interface which comprises background images of various themes preset by a plurality of operation terminals, for example, the content of the message to be left by the user is 'happy birthday', a first target image matched with the theme such as a birthday cake or a gift can be selected from the message board theme list interface in a self-defined way, then the interface jumps to a second message board interface, an information input box of the interface is superposed with the background effect of the first target image, the effect of the message board theme can be conveniently previewed by a message person at the local terminal, then the user inputs first message information in the information input box, after clicking and sending, the terminal generates a first message request according to the first message information and sends the first message request to a server, and the server recognizes that the first message request has a self-defined identifier, the method can know that the user selects the first target image in the terminal by self definition, the server does not need to automatically match the screen-saving theme according to the message information, the first target image selected by the user by self definition is directly obtained and assembled with the first message information to form a first message body, and then a second message request comprising the first message body and the screen-saving identifier is generated and sent to the intelligent device, or the message person can independently select a proper first target image from the local image. And when the server does not recognize the self-defined identifier, the message keeper does not select the first target image in a self-defined manner, and the server can automatically match the second target image according to the message information, assemble the second target image with the message information into a second message body, and send a fourth message request comprising the second message body and the screen dominator identifier to the intelligent equipment.

After receiving a message request sent by a server, the intelligent device needs to further detect the on-off state (namely, whether to start) of the message function of the screen warmer set by the intelligent device when recognizing that the message request has the screen warmer identifier; if the message function of the screen saver is not started, even if the message request has the screen saver identification, the message body cannot be displayed in the screen saver message mode, the common message mode is started, prompt information is displayed, the user is prompted to receive a new message, and the user can conveniently check the message in the message board application of the intelligent equipment; if the screen-dominating message-leaving function is started, a screen-dominating message can be left, namely a floating layer is established, the target image and the message information in the message body are fused into the corresponding display control in the floating layer, and the floating layer is displayed on the upper layer of the current interface, so that the screen-dominating message-leaving effect is realized; when the intelligent device does not recognize the screen heater identifier (or recognizes the non-screen heater identifier), the common message leaving mode is executed no matter whether the screen heater message leaving function of the intelligent device is started or not.

The message body assembled by the method can be combined in pictures and texts, the display effect of the message is improved, the finally realized effect is that the message body is displayed on the screen of the intelligent device in a screen message mode, the message information is improved in the aspects of ornamental performance and significance, the user operates the message at the terminal device end, the message display of the intelligent device in a cross-terminal remote control home scene is realized through communication interaction between devices, the message information is not limited to be input and displayed at the local terminal of the intelligent device, the application function of the message board is improved and promoted, the message mode is expanded, more diversified message modes are provided for the user, and the practical application experience of the user is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings to be accessed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

fig. 2 illustrates a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in the display device 200 according to some embodiments;

FIG. 5 illustrates an icon control interface display of an application in display device 200, in accordance with some embodiments;

fig. 6 is a schematic diagram illustrating an interface of a message board in the display device;

fig. 7 is a diagram illustrating a device list interface in the terminal device;

fig. 8 is a diagram illustrating a first message board interface in the terminal device;

fig. 9 is a schematic diagram illustrating a first message board interface in the terminal device after clicking the extended function control;

fig. 10 is a diagram illustrating a list interface of the theme of the home screen in the terminal device;

fig. 11 is a diagram illustrating a second message board interface in the terminal device;

FIG. 12 is a diagram illustrating a display device screen displaying a message body;

fig. 13 is a schematic view exemplarily showing an interface after a message board in the display device is updated after a message exits from the screen and leaves a message;

fig. 14 is a diagram exemplarily illustrating a first message board interface update transmission record in the terminal device;

fig. 15 is a flowchart illustrating a message display method performed on the terminal device side;

fig. 16 is a flowchart illustrating a message display method performed on the server side;

fig. 17 is a flowchart illustrating a message display method performed on the smart device side;

FIG. 18 is a schematic diagram illustrating a three-terminal interaction logic corresponding to the AI dominator mode;

a schematic diagram of three-terminal interaction logic corresponding to the custom screen saver mode is exemplarily shown in fig. 19.

Detailed Description

To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display apparatus 200 is also in data communication with a server 400, and a user can operate the display apparatus 200 through the smart device 300 or the control device 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any of a mobile terminal, a tablet, a computer, a laptop, an AR/VR device, and the like.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain a voice instruction, or may be received by a voice control apparatus provided outside the display device 200.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.

In some embodiments, software steps executed by one step execution agent may migrate to another step execution agent in data communication therewith for execution as needed. Illustratively, software steps performed by the server may be migrated to be performed on a display device in data communication therewith, and vice versa, as desired.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.

In some embodiments, the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key, or an alternative module.

Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.

In some embodiments, the display apparatus 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for displaying pictures, and a driving component for driving image display, a component for receiving image signals from the controller output, displaying video content, image content, and menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.

In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.

In some embodiments, a graphics processor for generating various graphics objects, such as: at least one of an icon, an operation menu, and a user input instruction display figure. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, and perform at least one of video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal displayed or played on the direct display device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image composition module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like. And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in the speaker.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

In some embodiments, user interface 280 is an interface that may be used to receive control inputs (e.g., physical buttons on the body of the display device, or the like).

In some embodiments, a system of a display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.

Referring to fig. 4, in some embodiments, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.

As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the various applications as well as general navigational fallback functions, such as controlling exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window, displaying a shake, displaying a distortion deformation, and the like), and the like.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

In some embodiments, the display device may directly enter the interface of the preset vod program after being activated, and the interface of the vod program may include at least a navigation bar 510 and a content display area located below the navigation bar 510, as shown in fig. 5, where the content displayed in the content display area may change according to the change of the selected control in the navigation bar. The programs in the application program layer can be integrated in the video-on-demand program and displayed through one control of the navigation bar, and can also be further displayed after the application control in the navigation bar is selected.

In some embodiments, the display device may directly enter a display interface of a signal source selected last time after being started, or a signal source selection interface, where the signal source may be a preset video-on-demand program, or may be at least one of an HDMI interface, a live tv interface, and the like, and after a user selects different signal sources, the display may display contents obtained from different signal sources.

In practical application scenarios, the intelligent device for displaying message information is not limited to the display device (e.g., a television), but may also be applied to devices such as an intelligent refrigerator and an intelligent desk lamp that support message board functions and have UI display capabilities. The user A can directly input expected message information at the home terminal of the intelligent device, so that other users except the user A in a scene can check the message information of the user A in the message board. In more application scenarios, the direct message leaving at the home may not be easily implemented, for example, if the user a is not at home, but still wants to make the refrigerator at home display his message leaving information, a remote message leaving at a cross-end via communication interaction between devices is needed. In contrast, the three interactive ends relate to terminal equipment, a server and intelligent equipment, the terminal equipment can be mobile terminals such as a smart phone, a tablet, a notebook computer and the like, and can also be terminals such as a desktop computer and the like, and a user inputs message information in the terminal equipment; the server is used for realizing the fusion of the message information and the screen-holding effect so as to assemble a message body, and is also used for pushing the message input by the user at the terminal equipment to the remote intelligent equipment; the intelligent device receives the message information (common message mode) or the message body (screen-overtaking message mode) sent by the server and displays the message according to the corresponding mode.

In some embodiments, the terminal device and the intelligent device may synchronously install the message board application, and a user may click an icon of the message board application to access the message board and check a message record in the message board, where the message record includes history message information and newly received message information that has not been read yet. For example, in the example of fig. 5, the icon of the message board application is shown on the home page of the display device, and in the actual application, the icon of the message board application can be accessed through other paths, such as an application center or a toolbar of the smart device.

In some embodiments, the message records in the message board may be sorted in chronological order, such as by showing the latest message information in the highest-order position of the message board. For example, if the message record in the message board is displayed along the transverse direction, the latest message information is displayed at the head of the message board; if the message record in the message board is displayed along the longitudinal direction, the latest message information is displayed at the last position of the message board, so that the user can quickly position and read the latest message without turning pages.

In some embodiments, fig. 6 is an example in which the intelligent device is a display device, and provides an interface example of a message board, in which various message messages are displayed in a horizontal direction, and a user may operate a remote controller or touch to switch focuses, so as to locate and switch message messages desired to be viewed. The left message information can be in the forms of text, video, audio, pictures and the like, and each piece of left message information can be annotated with the left message person, the state information and the sending time. For example, in fig. 6, the first ranked person is today 17: 30, the message leaving person is a son of the family member, and the remarked state information of the message leaving information is 'unread', which indicates that the message leaving information is not read by any user at the display device end after being received; the message information in the form of video sent by the message taker in the 9:10 th day in the second order in fig. 6 is the recorded video of the guo in the family member and is sent, and the remarked status information is "read", which indicates that the message information has been viewed before and belongs to the category of the history message record.

In some embodiments, the message information in different forms has different display effects in the message board, for example, the text form directly displays characters; the video form can select one frame of image as a background image, a video playing control is arranged on the background image, the video duration is marked, and a user can watch the video messages by clicking the video playing control; the voice playing control is displayed in the audio form, the audio duration is marked, and a user can hear a voice message played by the intelligent equipment by clicking the voice playing control; the picture form is only required to directly display the picture.

In some embodiments, when the smart device receives a message from the screen saver, a message body may be displayed in the message board. If the target image in the message body is a static background, the message record inserted in the message board can display a thumbnail of the static image, and the zoomed message information is superposed and displayed in the thumbnail; if the target image in the message body is a dynamic background, such as a GIF moving picture, a frame of image can be intercepted from the dynamic image to serve as a background picture, a message record can present a thumbnail of the background picture, and zoomed message information is superposed and displayed in the thumbnail, and after a user clicks the message record, the target image can be amplified and a dynamic special effect is automatically played, so that the user can check the message information with the screen-saving special effect; or if the target image in the message body is a dynamic background, the message body can be dynamically displayed in the message board, namely, the message with the screen shot is zoomed and displayed in the message board. The scale of each message record is suitable for the size of the message board in the interface, so as to achieve better visual effect.

In some embodiments, the device information of the local intelligent device may be displayed at a specified position on the message board, such as the lower left corner of the message board in fig. 6, and the device information may include the brand, model, name, IP address, MAC address, and the like of the intelligent device.

In some embodiments, referring to fig. 6, an edit control may be set on the message board, and when the user clicks "edit", one, more or all message information may be selected, so as to complete operations such as batch deletion, batch reading, and the like.

In some embodiments, a user can register an account of a message board application, the account can be logged in at a terminal device and at an intelligent device, when the account logged in by the terminal device and the account logged in by the intelligent device are the same, communication association is established between the terminal device and the intelligent device, and message information input by the terminal device can only be pushed to the associated intelligent device. The terminal device may dynamically maintain a device list, the device list records device information of the intelligent device currently associated with the terminal device, the device information may include a device name and a device type, so as to facilitate a user to identify the device, and the device information may further include an IP address, an MAC address, and the like. When a user starts a message board application on terminal equipment, if the equipment list at least comprises two intelligent equipment, an equipment list interface corresponding to the equipment list is displayed, so that the user can select one of the intelligent equipment for communication and push message information.

In some embodiments, when the intelligent device receives new message information, a prompt message for prompting the user to check a new message is generally displayed, where the prompt message may be a prompt identifier, for example, a prompt identifier is displayed in the upper right corner of an icon applied to a message board in fig. 5, the prompt identifier and the icon should have significant differentiation, so that the user can recognize and check the message conveniently, and when the user sees the prompt identifier appearing on the icon, the user can know that the intelligent device receives the new message. The reminding identifier can specifically display the number of message information in an unread state in the current message board. The prompting information mode is not limited to the prompting identification mode, and other implementation modes such as a prompting bullet box and the like can be adopted.

In some embodiments, the application adds a screen saver message function to the message board application of the intelligent device on the basis of the existing message prompt, for example, a switch control of the screen saver message function can be set on the message board in fig. 6, if the switch control of the screen saver message function is in an off state, the screen saver message function is not started, and the processing is performed according to the prompt display logic of the ordinary message; and if the user opens the switch control of the screen message leaving function and starts the screen message leaving function, message information input by the user at the terminal equipment is displayed on the screen of the intelligent equipment in a screen message leaving mode by default.

In some embodiments, the message leaving from the screen is a message leaving message input by the user and fused with a matched special effect of the theme of the screen, that is, the message leaving message and a target image matched with the message leaving message are assembled into a message body by the server, and the intelligent device end receives the message body pushed by the server and then displays the message leaving from the screen at the local end.

In some embodiments, the displaying of the message body is performed by controlling the display to establish a floating layer with a certain transparency (e.g., semi-transparency) when the message body is displayed, embedding the message body into the floating layer, and displaying the floating layer on the upper layer of the current UI interface in a full screen manner, so that the message information is displayed in a form of a screen. In some embodiments, the established floating layer may include different presentation controls, such as a control for presenting a target image in the message body and a control for presenting message information in the message body, so as to embed different content categories in the message body into the corresponding presentation controls, and finally implement uniform presentation of the message body by the floating layer.

In some embodiments, the message leaving from the screen can be accompanied by a special background effect of a picture loaded and displayed on the lower layer of the message leaving information, so that the appreciation and the significance of the message leaving information are improved. In some embodiments, the message on the overlord screen can be loaded with a sound special effect synchronously, for example, the message information is 'happy birthday congratulatory day' for mom, the target image in the message body can be a picture matched with themes such as birthday cake or gift, and the target image can be a static image or a dynamic image, so that the assembled message body can be in a luxuriant picture and text, the display effect of the message information is improved, the happy birthday song can be loaded and played synchronously when the message body is displayed, and the message quality and the display effect are improved from the three aspects of picture, text and sound.

The following is described first from the perspective of UI interaction. Firstly, a terminal device side is taken as an example of a smart phone, a user can enter a message board application through a certain path, for example, an icon of the message board application can be found through a tool page, and the message board application can be started by clicking the icon. If the message board application does not log in the account, an account login page is displayed, and the user can complete login by inputting the account and the password. If the account is logged in, automatically querying the associated intelligent devices, determining whether the number of the associated devices exceeds 1, if the number of the associated devices exceeds 1, displaying a device list interface as shown in fig. 7, wherein device information of the associated devices logging in the same account as the terminal is displayed in my device in fig. 7, and the device information includes the brand, category, name and the like of the devices; fig. 7 may further include a user name "shared to my device", that is, another user authorizes the smart device and shares the smart device to a home terminal user corresponding to the third-party account, and the user name "shared to my device" may be remarked to initiate sharing. The user selects one device from the device list as a target device, namely a message-left object, and after the user finishes selecting, the device list interface in the figure 7 is automatically retracted and jumps to a first message board interface corresponding to the target device selected by the user; if only 1 intelligent device is currently associated with the terminal, the user does not need to select the intelligent device, namely, the device list interface is not displayed, and the first message board interface corresponding to the currently and uniquely associated intelligent device is directly displayed.

In some embodiments, fig. 8 illustrates a first message board interface in the terminal device, where the top of the interface is remarked with device information of the intelligent device to which the current message board corresponds; the middle part of the first message board interface displays the historical sending records of message information of the local terminal under the current account, and if the quantity of the historical sending records is large, pages can be turned by sliding up and down; the bottom of the first message board interface is provided with a plurality of operation controls, such as a voice control, a text input box, an extended function control and the like. After clicking the voice control, the user can input and send the message information in the form of audio according to operation guidance, such as pressing to speak and releasing to send; and after clicking the text input box by the user, automatically popping up an electronic keyboard at the bottom of the interface, inputting the message information in a text form by clicking the electronic keyboard by the user, and then clicking a sending button to finish message information sending.

In some embodiments, after the user clicks the extended functionality control (i.e., in fig. 8 +), the hidden more message modes are automatically popped up at the bottom of the interface, which may further include a text message control, a video message control, a custom screen message control, and the like, as shown in fig. 9. When a user clicks the image-text message, a picture can be selected from the local photo album as message information; when a user clicks a video message, the user can enter a shooting preview interface, the user can switch the front camera or the rear camera in the shooting preview interface, the user can record the video message by pressing the shooting button, the video recording is finished after the shooting button is released, and the user can send the message information in the form of the video by clicking the sending button.

In some embodiments, the present application provides two modes of generating a message body, one mode being an AI screen mode and the other mode being a custom screen mode.

First, an AI screen mode is explained, which is to automatically acquire a target image matched with message information by a server. After a user inputs second message information on the first message board interface through any one of information input controls such as a voice control, a text input box, a graphic message control and a video message control, clicking a sending button, generating a third message request by the terminal device according to the second message information, and sending the third message request to the server; the server not only has strong information calculation processing capacity, but also stores a large number of image resources, when a third message request sent by the terminal equipment is received, and no self-defined identifier is identified in the third message request, for example, a target image showing a screen-warming effect can be automatically matched and obtained according to keywords or semantics of the second message information, and the target image automatically matched by the server side is named as a second target image to show the difference. If the second target image can be obtained (namely matching is successful), fusing the second message information and the second target image to assemble a second message body, and then sending a fourth message request to the intelligent equipment, wherein the fourth message request comprises the second message body and a screen display identifier, and the screen display identifier is used for indicating that the intelligent equipment needs to display the second message body in a screen display message mode; after receiving the fourth message request, the intelligent device recognizes that the message has the screen display identifier, and gives a corresponding message prompt mode according to the on-off state of the message function of the screen display of the intelligent device. When the screen message function is started, displaying a second message body in a screen message mode (namely the floating layer mode); and if the screen-overtaking message leaving function is not started, displaying prompt information for prompting the user to check a new message.

In some embodiments, the server may specifically include an operation module, a semantic module, and a message push module. The operation module is mainly oriented to the server-side personnel, the server-side personnel checks the received second message and can manually match the second target image according to the keyword, semantic and other contents of the second message, for example, the second message checked by the server-side personnel is' happy birthday of 50 years old to the old mother! If the keywords which can be screened out are 'happy birthday' and '50', the second target image matched manually is a birthday cake picture with a number 50 candle inserted; and inputting the received second message information into a semantic module for AI semantic recognition, thereby automatically matching and outputting a second target image. If any one of the operation module and the semantic module outputs the matched second target image, the second target image and the second message information can be assembled to obtain an effective second message body; if the operation module and the semantic module both match the second target image, the priority of manual matching is higher, that is, the image matched by the operation module is used as the second target image, because the manual thinking and voice analysis capability is higher than that of the semantic module, the matching degree of the manually matched second target image and the second message information is higher, for example, for the aforementioned second message information, "wish mam 50 years happy birthday! ", the keyword captured by the semantic module may only be" happy birthday ", then the matching second target image is a normal birthday cake without a candle identifying the birthday. The message pushing module is used for sending message requests to the intelligent device, wherein the message requests comprise a second message request, a fourth message request and a fifth message request.

In some embodiments, after the server receives the third message request, it may be that the second message does not have significant key information, such as "123", or the second message is ambiguous or the semantic expression of the second message is unclear, neither manual nor AI can screen a matched second target image from the image resource of the server, that is, outputs of the operation module and the semantic module are empty, and the second target image fails to be matched, so that an effective second message body cannot be obtained, and the second message cannot be displayed on a message screen, the server generates a fifth message request according to the second message, and the fifth message request is filled with a non-message screen identifier, where the non-message screen identifier is used to indicate that the intelligent device, regardless of whether it is enabled to have a message screen function, only has to execute a normal message mode, that is displayed to prompt the user to view new prompt information, without executing the screen message mode. And after receiving the fifth message request, the server side recognizes that the message has the non-screen-dominating identification, and can directly execute the common message mode without detecting the on-off state of the message-occupying function of the server side.

And then, a user-defined screen saver mode is explained, wherein the user-defined screen saver mode supports a terminal message keeper to select a target image in a user-defined mode without matching the target image with the message information by the server side. In some embodiments, after the user clicks the customized screen saver message control in the first message board interface of fig. 9, the first target image may be selected in two customized modes, the first mode is that the terminal device calls an operation module interface to obtain a screen saver topic list preset by an operator at the server, and then the terminal device displays the screen saver topic list interface shown in fig. 10. The screen dominating theme list interface comprises different theme images, and a user selects one of the screen dominating theme list interfaces as a target image, namely the target image is customized according to the screen dominating theme pushed by the server.

In a second embodiment of self-defining a target image, a user may further select one of images locally stored in the terminal as the target image, for example, the user clicks a local image control set in an interface, and enters an album image preview interface, which may display thumbnails of all images stored in a local album, and after the user clicks one of the thumbnails, the user self-defines and selects the local target image. In the application, the target image selected by the user in a self-defined manner through the two manners is named as a first target image, and after the first target image is clicked and confirmed, the user can jump to a second message board interface shown in fig. 11.

In some embodiments, fig. 11 provides an example of a second message board interface that includes an information input box with a background overlaid with a first target image selected by the user, and after the user clicks the information input box, that is, an electronic keyboard is popped up at the lower portion of the interface, so that the first message information in the form of text inputted by the user is gradually embedded into the first target image, the user can view the preview effect of the first message body in fig. 11, then clicking a sending button, generating a first message request by the terminal equipment according to the first message information, and sending a first message request to the server, the first message request including a custom identifier for indicating to the server that the target image need not be automatically matched, directly utilizing a first target image selected by a message-leaving person in a self-defined way and first message information to assemble and generate a first message body; after receiving the first message request, the server recognizes that the first message request has a user-defined identifier, and if the server also recognizes an identifier ID carrying a theme, which indicates that the first target image is selected from the screen-overtaking theme list, the server can directly call the first target image corresponding to the identifier ID of the theme and assemble the first target image and the first message information into a first message body; if the first target image is selected locally by the user from the terminal, the first message request sent by the terminal device to the server can carry information such as the local first target image or the URL of the first target image, so that the server can directly receive the data of the first target image after receiving the first message request, or can obtain the resource of the first target image according to the information, and the first target image and the first message information are assembled into a first message body.

Then the server sends a second message request to the intelligent equipment, wherein the second message request comprises a first message body and a screen heater identifier; and after receiving the second message request, the intelligent device recognizes that the message has the screen display identifier, and gives a corresponding message prompt mode according to the on-off state of the message function of the screen display of the intelligent device. When the screen message function is started, a first message body is displayed in a screen message mode (namely, the floating layer form); and if the screen-overtaking message leaving function is not started, displaying prompt information for prompting the user to check a new message.

In some embodiments, a theme change control is further set in the interface of fig. 11, if the user is not satisfied with the first message body preview effect and can click the theme change control, the terminal device returns to the screen-dominating theme list interface shown in fig. 10, and the user reselects the first target image until the satisfied effect is finally achieved, and then clicks the send button. The second message board interface is not limited to input the first message information in the text form, and for example, a voice input control, a video recording control, a picture insertion control and the like can be further arranged to input the first message information in other forms in the customized screen mode.

In some embodiments, the list of message objects of the screen overlay is sent to the terminal device by the server after receiving a message notification that the user selects the customized message object control of the screen overlay, and each object in the list of message objects of the screen overlay corresponds to a portrait/voice and a corresponding ID for presentation to the user. Wherein, the portrait can be displayed to the user through the display, and the sound can be played to the user through the loudspeaker.

In some embodiments, the list of the top screen topics may be cached in the terminal device in advance, the user may download in advance or the message board application program may be automatically preset in the memory of the terminal device, each topic in the list of the top screen topics corresponds to a portrait/sound for presentation to the user and a corresponding identification ID, and there is a mapping between the identification ID of the topic in the list and the identification ID of the topic stored in the server.

In some embodiments, the generated message request includes message information and also includes an identification ID of a subject selected by the user from the screen-dominating subject list, and the server may search and retrieve at least one of a target portrait, a sound, and a video of the corresponding subject according to the identification ID carried in the message request.

In some embodiments, the message body may be a message body that is composed of a message and a message, and the message body may be composed of a message body that is composed of a message and a message body that is composed of a message.

In some embodiments, the generated message request includes subject information in addition to message information, and the subject information may be an identification ID corresponding to a subject, or may be a subject file, or information such as a URL of the subject file.

In some embodiments, the image may be picture information, or may be a continuous frame file composed of multiple frames of pictures, such as a video, a GIF file, and the like.

In some embodiments, since the user has already preselected the first target image in the customized screen saver mode, the server does not need to perform manual and/or AI matching, and therefore before the terminal device sends the first message request, the first message request is filled with the customized identifier. After receiving the first message request, the server recognizes that the first message request has the user-defined identifier, and directly assembles the first message information and the first target image selected by the user in the screen object list interface into a first message body without manually and/or AI matching the target image according to the first message information, and adds the screen object identifier for the first message body; or setting the value of the flag bit in the screen-dominating identification field preset in the second message-leaving request to be 1, setting the value of 1 to represent the screen-dominating identification, setting the value of 0 to represent the non-screen-dominating identification, and then sending the first message body to the intelligent device, so that after the intelligent device receives the first message body, the intelligent device accesses the screen-dominating identification field, and recognizes that the value of the flag bit is 1, namely recognizes that the screen-dominating identification exists. The mode of setting the screen saver identifier for the fourth message request and the mode of setting the non-screen saver identifier for the fifth message request can refer to the second message request, and details are not repeated here.

In the foregoing embodiment, the second message request and the fourth message request sent by the server to the intelligent device include the screen saver identifier, and the fifth message request sent by the server to the intelligent device includes the non-screen saver identifier, so that the intelligent device selects the corresponding message mode according to the identifier indication carried in the message request sent by the server and the on-off state of the message leaving function of the intelligent device to identify the self screen saver. Because the first message body or the second message body is essentially a form of message information, the intelligent device terminal can identify whether the received message information is a common message or a message body by setting the screen-dominating identifier/non-screen-dominating identifier.

In some embodiments, the server side can synchronously acquire the on-off state of the screen message function of the intelligent device side, and the server side can synchronously update the on-off state recorded by the server side according to the operation of a user for turning on or off the screen message function of the intelligent device.

In some embodiments, before sending the second message request or the fourth message request to the intelligent device, the server queries the on-off state of the message leaving function of the screen saver at the intelligent device terminal, and if the query shows that the intelligent device currently enables the message leaving function of the screen saver, the server normally sets a screen saver identifier in the second message request or the fourth message request; if the server inquires that the intelligent device does not start the screen message function at present, even if the screen message identifier is set in the second message request or the fourth message request, the intelligent device terminal recognizes the screen message identifier and cannot execute the screen message, so that the server terminal can directly set the non-screen message identifier in the second message request or the fourth message request, after the intelligent device receives the second message request or the fourth message request, the intelligent device recognizes the non-screen message identifier, the on-off state of the screen message function of the intelligent device terminal is not needed to be further recognized, and the common message mode is directly executed, and although a message with the screen message effect displayed cannot be seen by a user of the intelligent device terminal, the effect of the inserted first/second message body can be seen in the message board of the intelligent device terminal.

In some embodiments, the server may query the on-off state of the message leaving function of the screen saver at the terminal of the intelligent device after receiving the first message request or the third message request sent by the terminal device, and if it is queried that the message leaving function of the screen saver is currently enabled in the intelligent device, normally assemble the first message body or the second message body, and normally set the screen saver identifier in the second message request or the fourth message request.

In some embodiments, after receiving a first message request sent by a terminal device, if the server queries that the smart device does not start the screen saver message function currently, the server does not recall a first target image selected by a user in a self-defined manner, cancels an assembly process of a first message body, directly generates a second message request according to first message information, and sets a non-screen identifier in the second message request, namely, the server end adaptively and automatically switches to a common message mode according to the state that the smart device end does not start the screen message function; after the intelligent equipment end receives the second message request, the identified non-screen-remote identifier is used for prompting the first message information in a common message mode without further identifying the on-off state of the self-screen-remote message function, and under the condition, the intelligent equipment end user looks up the first message information in the message board of the local end and does not look up the message in the form of the first message body.

In some embodiments, after receiving a third message request sent by the terminal device, if the server queries that the smart device does not currently start the screen saver message function, the server does not execute a process of manually and/or AI matching a second target image, and further cancels a process of assembling a second message body, generates a fifth message request directly according to the second message information, sets a non-screen saver identifier in the fifth message request, namely, the server side adaptively and automatically switches to a common message mode according to the state that the smart device side does not start the screen saver message function; after the intelligent equipment end receives the fifth message request, the identified non-screen-remote identifier is used for prompting the second message information in a common message mode without further identifying the on-off state of the self-screen-remote message function, and under the condition, the intelligent equipment end user looks up the second message information in the message board of the local end and does not look up the message in the form of the second message body.

In some embodiments, after receiving the second message request (user-defined screen bar) or the fourth message request, the smart device recognizes that the smart device has a screen bar identifier, and detects that the smart device has enabled the screen bar message function, displays a message body (the message body is the first message body or the second message body separately described in this application) in a screen bar message mode, and simultaneously inserts the message body into the highest-order position of the local message board, and notes the sending time, the message person, and the unread state of the message body. At this time, as shown in fig. 12, the message body is embedded into the uppermost floating layer for full-screen display, when a user in a home scene passes through the intelligent device, the message leaving the message on the message board.

In some embodiments, after receiving the fifth message request, the intelligent device recognizes that the fifth message request has the non-screen-dominating identifier, and then displays the prompt message for prompting the user to check the new message according to the normal message mode without detecting the on-off state of the message-dominating function of the intelligent device, and inserts the second message into the highest-order position of the local message board, and notes the sending time of the second message, the message-leaving person and the unread state. And when the user opens the local message board of the intelligent device based on the prompt message and clicks and views the newly received and unread second message, changing the state information of the second message into the read state information.

In some embodiments, the message body obtained by the server in the AI screen mode or the custom screen mode needs to be sent to both the intelligent device side and the terminal device, so that the message input end and the message receiving end keep the message synchronization, and the message sending record under the current account number of the terminal device is updated. After the server generates the message body in an assembling mode, the message body is sent to the terminal equipment; after the terminal device receives the message body sent by the server, as shown in fig. 14, the message body is inserted into the first message board interface for display according to the sending time sequence of the terminal (that is, the time of receiving the click operation on the sending control), and if the sending record is shown in the longitudinal direction in fig. 14, the newly received message body is inserted into the last position of the first message board interface, and the sending time is displayed above the message body.

In some embodiments, after receiving the third message request, the server sends matching failure information to the terminal device if the second target image is not matched; and the terminal equipment receives the matching failure information sent by the server, acquires that the second message information input by the local terminal cannot be displayed in a second message form, inserts the second message information input by the user into the first message board interface according to the sending time sequence for displaying, and displays the corresponding sending time above the message information.

In some embodiments, after receiving the first message request or the third message request, if it is found that the intelligent device does not start the screen-saver message function, the server does not execute the processing logic of the assembled message body, always according to a conventional common message mode, and sends message indication information without starting the screen-saver message to the terminal device; the terminal equipment receives message indication information without starting a screen saver, controls the display to display corresponding prompt information so as to prompt that the intelligent equipment at the opposite end of a message keeper does not start the screen saver function, inserts message information (the message information is the first message information or the second message information) input by a user into a first message board interface according to the sending time sequence to display, and displays the corresponding sending time above the message information.

In some embodiments, when the state information of each message record in the message board of the intelligent device end changes, the intelligent device synchronizes the state information to the server, the server can send the state information to the terminal device again, and the terminal device controls the display to display the received state information, so that a message keeper can know whether the message information received in the intelligent device of the opposite end is read or not.

The above UI is taken as an example of a display device, and other types of intelligent devices are basically similar to the display device in the UI embodied in the message board application and the message of the screen saver, and are not listed here. The UI interface provided in the present application is merely exemplary, and is subject to practical application and design.

In some embodiments, fig. 15 shows a message display method executed on the terminal device side, where an execution subject of the method is a controller in the terminal device, and the method includes the following program steps:

and S101, receiving the operation of starting the message board application and controlling the display to display a first message board interface. The first message board interface can refer to fig. 8 and 9, and the first message board interface comprises a user-defined screen message control.

And step S102, receiving the clicking operation of the user-defined screen saver message control in the first message board interface, and controlling the display to display a screen saver topic list interface. A schematic diagram of the screen shot theme list interface can be seen in fig. 10.

And step S103, receiving selection operation of a first target image in the screen dominating theme list interface, and controlling a display to display a second message board interface. The schematic diagram of the second message board interface may refer to fig. 11, which includes an information input box on which the first target image is superimposed.

And step S104, receiving first message information input by a user in an information input box of a second message board interface, generating and sending a first message request comprising a custom identifier to a server according to the first message information.

The first message request comprises a user-defined identifier, so that after receiving the first message request, the server recognizes the user-defined identifier, directly calls a first target image defined by a user, assembles first message information and the first target image into a first message body, and sends a second message request to the intelligent device, wherein the second message request comprises the first message body and a screen saver identifier, and the screen saver identifier is used for indicating the intelligent terminal to display the message body in a screen saver mode; after receiving the second message request, when recognizing that the message function of the message on the screen is started and the second message request has the message identifier of the screen, the intelligent device displays the first message body on the upper layer of the current interface in a floating layer mode, or recognizes that the message function of the screen is not started, and displays prompt information for prompting a user to check a new message. For the user-defined way of acquiring the first target image from the local storage of the terminal, the difference from the logic of fig. 15 only lies in the selection path of the first target image and the way of calling the first target image by the server, other contents are basically the same, and reference may be made to the logic of fig. 15 for adaptability, and therefore details are not repeated.

In some embodiments, fig. 16 shows a message display method executed on a server side, where an execution subject of the method is a controller in the server, and the method includes the following program steps:

step S201, receiving a message request sent by the terminal device.

The message request comprises message information received by the terminal equipment, and the terminal equipment is further used for filling a user-defined identifier in the message request if the message request is generated after a user selects a first target image from a screen-dominating theme list interface, otherwise, the user-defined identifier is not added. The type of the message request in step S201 may be the first message request or the third message request, which depends on whether the terminal side uses a customized screen to leave a message, but the server cannot actually perceive the processing logic executed by the terminal side, so the server mainly determines the type of the message request by whether the message request carries a customized identifier, and executes corresponding logic according to the type of the request to determine whether to automatically match the target image.

Step S202, judging whether the user-defined identification is identified. If the custom identifier is identified, step S203 is executed, otherwise, step S204 to step S207 are executed.

And S203, assembling the first target image and the message information into a first message body, and sending a second message request comprising the first message body and the screen dominating identifier to the intelligent device.

And the second message request is used for enabling the intelligent equipment to automatically display the first message body on the upper layer of the current interface in a floating layer mode if the home terminal starts the screen message function after recognizing the screen message identifier. Certainly, if the smart device does not start the screen message function, even if the smart device has the screen message identifier, the first message body cannot be displayed in the screen message mode, and the smart device is switched to the ordinary message mode.

And step S204, automatically matching a second target image according to the message information.

Step S205, judging whether a second target image is matched; if the second target image is matched, step S206 is performed, otherwise step S207 is performed.

Step S206, the second target image and the message information are assembled into a second message body, and a fourth message request comprising the second message body and the screen dominator identification is sent to the intelligent device.

And the fourth message request is used for enabling the intelligent equipment to automatically display a second message body on the upper layer of the current interface in a floating layer mode if the local terminal starts the screen message function after recognizing the screen message identifier. If the intelligent equipment end does not start the screen message function, even if the intelligent equipment end has the screen message mark, the second message body cannot be displayed in the screen message mode, and the intelligent equipment end is switched to the common message mode.

Step S207, sending a fifth message request comprising the message information and the non-dominating screen identifier to the intelligent device.

The fifth message request is used for enabling the intelligent device to identify the non-screen-dominating message identifier without inquiring whether the local terminal starts the screen-dominating message function, namely, no message is left in the screen-dominating message mode but the normal message mode is executed no matter whether the screen-dominating message function is in the on or off state, and prompt information for prompting a user to check a new message is displayed.

In some embodiments, fig. 17 shows a message display method executed by an intelligent device, where an execution subject of the method is a controller in the intelligent device, and the method includes the following program steps:

step S301, receiving a message request sent by a server.

The type of the message request in step S301 may be the second message request, the fourth message request, or the fifth message request, which is specifically determined by whether the terminal side uses the customized dashboard message or not, and whether the server side matches the second target image or not when the terminal side does not use the customized dashboard message. The intelligent device end cannot actually sense the processing logic executed by the terminal side and the server side, so the intelligent device mainly determines whether to execute a screen-holding message mode or a common message mode by judging whether the received message request carries a screen-holding identifier or not and combining the on-off state of the screen-holding message function of the intelligent device.

Step S302, judging whether the message request identifies the screen dominating identification. If the screen dominator is identified, executing step S303; otherwise, if the neither the home screen identifier nor the non-home screen identifier is recognized, step S305 is performed.

Step S303, detecting whether the message function of the screen shot is started; if the message function of the screen saver is enabled, the message mode of the screen saver is executed in step S304, and if the message function of the screen saver is not enabled, the message mode of the screen saver is executed in step S305.

And step S304, controlling the display to automatically display the message body in the message request in a floating layer mode on the upper layer of the current interface. The type of the message body in the step S304 is the first message body or the second message body, but the intelligent device side does not need to sense and recognize the type of the message body, and only needs to display the message body in the screen message mode when the screen message function is activated and the screen message identifier is recognized.

Step S305, displaying prompt information for prompting the user to check the new message.

When the intelligent device does not recognize the screen heater identifier (or recognizes the non-screen heater identifier) from the message request or recognizes the screen heater identifier but does not start the message function of the screen heater, the common message mode is executed, the prompt message is displayed, the user is prompted to receive a new message, and the user can conveniently check the message.

In some embodiments, referring to the foregoing description of UI interaction and fig. 18, a three-terminal interaction logic corresponding to an AI screen saver mode is provided, where three interactive terminals are a terminal device, a server, and an intelligent device, respectively, and the logic is that the intelligent device terminal has enabled a screen saver function:

step (a1), the terminal: responding to the operation of starting the message board application, inquiring the number of the associated devices, and judging whether the number of the associated devices exceeds 1; if only 1, performing step (A2); if there are more than 1, step (A3) is performed. The step (A2) and the step (A3) are that the display of the first message board interface is realized according to the number of the associated devices;

step (a2), the terminal: displaying a first message board interface corresponding to the uniquely associated intelligent equipment;

step (a3), the terminal: the device list interface is displayed, and a first message board interface corresponding to the target device is displayed in response to the received selection operation of the target device in the device list;

step (a4), the terminal: receiving second message information input by a user through the information input control in the first message board interface, generating a third message request according to the second message information, and sending the third message request to the server; when the second message information is in a non-text format, calling a server resource uploading interface to acquire the resource ID and URL information of the message to splice a message format so as to obtain a third message request, and calling the server interface to send the third message request to the server, wherein the spliced message format can ensure that the intelligent equipment of the opposite terminal can acquire the resource of the second message information, so that members of the opposite terminal can check the content of the second message information;

step (a5), the server: after receiving a third message request sent by the terminal device, automatically acquiring a second target image matched with the second message information according to the second message information (for example, by adopting a matching mode combining manual matching and keyword/semantic matching), and judging whether the matched second target image is acquired; if the second target image is matched, executing branch logic one; if the second target image is not matched, executing branch line logic two;

the branch logic one comprises the steps (A6) to (A10):

step (a6), the server side: assembling the second message body and the second target image into a second message body, sending a fourth message request to the intelligent device, wherein the fourth message request comprises the second message body and the screen heater identifier, and synchronously sending the second message body to the terminal device;

step (a7), the terminal: receiving a second message body sent by the server, and inserting the second message body into the first message board interface according to the sending time sequence for displaying;

step (A8), the smart device side: after receiving the fourth message request, identifying a screen heater identifier, and detecting whether a screen heater message function is started or not; if the intelligent device has started the screen message function, executing the step (A9); otherwise, if the intelligent device does not start the screen-screen message function, executing the step (A10);

step (a9), the smart device side: displaying a second message body on the upper layer of the current interface in a floating layer mode, simultaneously inserting the second message body into the highest ordinal position of the local message board, and remarking the sending time, the message person and the unread state of the second message body;

step (a10), the smart device side: and displaying prompt information for prompting the user to check the new message, inserting the second message body into the highest-order position of the local message board, and noting the sending time, the message taker and the unread state of the second message body.

And branch logic two, comprising the steps (A11) to (A13):

step (a11), the server: sending matching failure information to the terminal equipment, generating a fifth message request according to the second message information, and sending the fifth message request to the intelligent equipment, wherein the fifth message request comprises a non-overtaking screen identifier;

step (a12), the terminal: receiving matching failure information sent by the server, and inserting the second message information into the first message board interface according to the sending time sequence for displaying;

step (a13), the smart device side: and after receiving the fifth message request, recognizing the non-super screen identifier, displaying prompt information for prompting a user to check a new message, simultaneously inserting the second message into the highest-order bit of the local message board, and remarking the sending time, the message taker and the unread state of the second message body.

In some embodiments, referring to the foregoing description of UI interaction and fig. 19, a three-terminal interaction logic corresponding to a customized screen saver mode is provided, where three interactive terminals are a terminal device, a server, and an intelligent device, respectively, and the logic is that the intelligent device terminal has enabled a screen saver message function:

step (B1), the terminal apparatus side: responding to the operation of starting the message board application, inquiring the number of the associated devices, and judging whether the number of the associated devices exceeds 1; if only 1, executing step (B2); if there are more than 1, step (B3) is performed. The step (B2) and the step (B3) are to implement display of a first message board interface according to the number of the associated devices;

step (B2), the terminal: displaying a first message board interface corresponding to the uniquely associated intelligent equipment;

step (B3), the terminal: the device list interface is displayed, and a first message board interface corresponding to the target device is displayed in response to the received selection operation of the target device in the device list;

step (B4), the terminal: in response to receiving a click operation on a user-defined screen-saving message control in the first message board interface, calling an operation module interface, and acquiring a screen-saving theme list preset by an operator, so as to display a screen-saving theme list interface;

step (B5), the terminal: responding to the selection operation of a first target image in a screen dominating theme list interface, and displaying a second message board interface, wherein the second message board interface comprises an information input box superposed with the first target image;

step (B6), the terminal: receiving first message information input by a user in an information input box, generating a first message request according to the first message information, wherein the first message request comprises a user-defined identifier, and sending the first message request to a server; when the first message information is in a non-text format, calling a server resource uploading interface to acquire a message resource ID and URL information to splice a message format so as to obtain a first message request, and calling the server interface to send the first message request to a server, wherein the spliced message format can ensure that intelligent equipment of an opposite terminal can acquire the resource of the first message information, so that members of the opposite terminal can check the content of the first message information;

step (B7), the server: after receiving a first message request sent by terminal equipment, recognizing a user-defined identifier, calling a first target image, assembling first message information and the first target image into a first message body, sending a second message request to intelligent equipment, wherein the second message request comprises the first message body and a screen-warming identifier, and synchronously sending the first message body to the terminal equipment;

step (B8), the terminal: receiving a first message body sent by a server, and inserting the first message body into a first message board interface according to the sending time sequence for displaying;

step (B9), the smart device side: after receiving the second message request, identifying a screen heater identifier, and detecting whether a screen heater message function is started or not; if the intelligent device has started the screen message function, executing step (B10); otherwise, if the intelligent device does not start the screen-screen message function, executing the step (B11);

step (B10), the smart device side: displaying a first message body on the upper layer of a current interface in a floating layer mode, simultaneously inserting the first message body into the highest sequence position of a local message board, and remarking the sending time, the message person and the unread state of the first message body;

step (B11), the smart device side: and displaying prompt information for prompting the user to check the new message, inserting the first message body into the highest-order bit of the local message board, and noting the sending time, the message taker and the unread state of the first message body.

For the AI screen mode and the user-defined screen mode, when the intelligent device displays the message body in the screen message mode, responding to the return operation executed by the user, quitting the screen message leaving, and changing the state information of the corresponding message body in the local message board into the read state, thereby updating the read state of the message body in the message board in time.

According to the technical scheme, the cross-device interactive message leaving from the terminal device to the intelligent device is realized, the three interactive ends comprise the terminal device, the server and the intelligent device, the message leaving function of the screen saver is additionally arranged on the basis of the application of the conventional message leaving board, and if the message leaving function of the screen saver is not started by the intelligent device, the processing logic of the common message is executed; if the intelligent device has started the screen-holding message-leaving function, an AI screen-holding mode or a user-defined screen-holding mode can be selected and executed, a user inputs message information (first message information or second message information) in the terminal device, the server identifies whether the server side is required to match a target image according to whether a message request sent by the terminal device has a user-defined identifier, if so, the matching is not required, but the first target image selected by a person calling the message in a user-defined manner and the first message information are directly assembled into a first message body; and if the user-defined identification is not available, manually and/or AI matching is needed to be carried out on the second target image, and the matched second target image and the second message information are assembled into a second message body. And after the intelligent equipment receives the message request sent by the server, the intelligent equipment executes corresponding message mode processing logic according to the identifier carried in the message request and the on-off state of the message function of the message screen of the intelligent equipment.

The message body is assembled by message information and a target image (AI) in a matching or self-defining mode, the assembled message body can be in a luxuriant picture and text mode, the message quality and the message display effect are improved, the message on the screen is more striking, the message information is improved in the aspects of ornamental performance and significance, a user operates the message at a terminal equipment end, the message display of the intelligent equipment in a cross-end remote control home scene is realized through communication interaction between equipment, the message information is not limited to be input and output at the intelligent equipment end, the application function of the message board is improved and improved, the message mode is expanded, more diversified message modes are provided for the user, and the practical application experience of the user is improved.

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. In a specific implementation, the invention also provides a computer storage medium, which can store a program. When the computer storage medium is located in any one of the terminal device, the server and the intelligent device, the program execution may include program steps related to a message display method in which a controller of any one of the three terminals is configured to execute. The computer storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM) or a Random Access Memory (RAM).

In the present application, the single-ended devices and the message display methods executed by the single-ended devices and the configurations thereof are listed in the UI interaction and interaction logic, and the same and similar parts between the embodiments may be referred to each other, and the related contents are not described again.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A terminal device, comprising:

the communicator is used for being in communication connection with the server;

a controller configured to perform:

2. The terminal device of claim 1, wherein the first message board interface further comprises an information input control, and after displaying the first message board interface, the controller is further configured to perform:

receiving second message information input by the user through the information input control;

and generating and sending a third message request to a server according to the second message information, wherein the third message request is used for enabling the server to automatically match a second target image according to the second message information when the server recognizes that no self-defined identifier exists in the third message request, assembling the second message information and the second target image into a second message body, and sending a fourth message request to the intelligent device, wherein the fourth message request comprises the second message body and a screen heater identifier, and the fourth message request is used for enabling the intelligent device to automatically display the second message body on the upper layer of the current interface in a floating layer mode after recognizing the screen heater identifier.

3. The terminal device of claim 1, wherein the first message board interface further comprises an information input control, and after displaying the first message board interface, the controller is further configured to:

generating and sending a third message request to a server according to the second message information, wherein the third message request is used for enabling the server to automatically acquire a second target image matched with the second message information when the server recognizes that no self-defined identifier exists in the third message request, and after the second target image is acquired, assembling the second message information and the second target image into a second message body and sending a fourth message request to the intelligent device, wherein the fourth message request comprises the second message body and a message screen identifier, the fourth message request is used for enabling the intelligent device to automatically display the second message body on the upper layer of a current interface in a floating layer mode after recognizing the message screen identifier, or when the second target image is not acquired, generating and sending a fifth message request to the intelligent device according to the second message information, and the fifth message request comprises a non-message screen identifier, and the fifth message request is used for displaying prompt information for prompting the user to check a new message after the intelligent device recognizes the non-dominating screen identifier.

4. The terminal device according to any one of claims 1 to 3, wherein the controller is further configured to perform:

receiving an operation of starting a message board application;

when only one intelligent device is associated with the terminal device, directly controlling a display to display a first message board interface corresponding to the intelligent device which is uniquely associated; when the account numbers of the terminal equipment and the intelligent equipment for logging in the message board application are the same, the terminal equipment is associated with the intelligent equipment;

or when more than one intelligent device is associated with the terminal device, controlling a display to display a device list interface, wherein a device list displayed by the device list interface at least comprises two intelligent device controls associated with the terminal device; the intelligent device control is used for receiving selection operation of a target device control in the device list and controlling a display to display a first message board interface corresponding to the target device control.

5. A terminal device, comprising:

the communicator is used for being in communication connection with the server;

a controller configured to perform:

6. A server, comprising:

a controller configured to perform:

when the user-defined identifier is identified, assembling a first target image and message information into a first message body, and sending a second message request comprising the first message body and a screen saver identifier to the intelligent equipment, wherein the second message request is used for enabling the intelligent equipment to automatically display the first message body on the upper layer of a current interface in a floating layer mode after the screen saver identifier is identified; and when the user-defined identifier is not identified, automatically matching a second target image according to the message information, assembling the second target image and the message information into a second message body, and sending a fourth message request comprising the second message body and a screen saver identifier to the intelligent equipment, wherein the fourth message request is used for enabling the intelligent equipment to automatically display the second message body on the upper layer of the current interface in a floating layer mode after the screen saver identifier is identified.

7. The server according to claim 6, wherein the controller is further configured to perform:

and after the user-defined identifier is not recognized, when a second target image is not matched according to the message information, sending a fifth message request comprising the message information and a non-server screen identifier to the intelligent equipment, wherein the fifth message request is used for displaying prompt information for prompting a user to check a new message after the intelligent equipment recognizes the non-server screen identifier.

8. A smart device, comprising:

the communicator is used for being in communication connection with the server;

a controller configured to perform:

receiving a message request sent by a server;

9. A message display method in a terminal device is characterized by comprising the following steps:

the method comprises the steps of receiving first message information input by a user in an information input box, generating and sending a first message request to a server according to the first message information, wherein the first message request comprises a user-defined identifier, the first message request is used for enabling the server to assemble the first message information and a first target image into a first message body according to the user-defined identifier, and sending a second message request to the intelligent device, the second message request comprises the first message body and a screen heater identifier, and the second message request is used for enabling the intelligent device to automatically display the first message body on the upper layer of a current interface in a floating layer mode after the screen heater identifier is identified.

10. A message display method in an intelligent device is characterized by comprising the following steps:

receiving a message request sent by a server;

and when the screen-dominating identification is identified in the message request and the screen-dominating message leaving function of the local terminal is started, controlling a display to automatically display a message body in the message request in a floating layer mode on the upper layer of the current interface.