CN117981331A

CN117981331A - Display device and display method thereof

Info

Publication number: CN117981331A
Application number: CN202280063188.7A
Authority: CN
Inventors: 贾富佳
Original assignee: Juhaokan Technology Co Ltd
Current assignee: Juhaokan Technology Co Ltd
Priority date: 2021-11-08
Filing date: 2022-09-23
Publication date: 2024-05-03
Also published as: CN114040254B; CN114040254A; WO2023077991A1

Abstract

The application relates to a display device and a display method. The display device includes: a display configured to display images and user interfaces acquired through a network and/or a broadcast system; a communicator configured to establish a communication connection with a server; a controller configured to: receiving a control instruction input by a user and used for entering a live broadcasting room; responding to the control instruction, and acquiring the current user quantity and instant communication information in the live broadcasting room; creating a message cache list, wherein the message cache list is used for storing the instant messaging messages, and the upper limit of the cache quantity and/or the refresh delay time of the message cache list are set according to the quantity of the current users; and displaying the instant messaging messages in the message cache list according to the parameters of the instant messaging messages in the message cache list.

Description

Display device and display method thereof

Cross Reference to Related Applications

The present application claims priority from chinese patent application number 202111312731.6 filed at month 11 and 8 of 2021, the entire contents of which are incorporated herein by reference.

Technical Field

The application relates to the technical field of intelligent display equipment, in particular to display equipment and a high concurrency message display method.

Background

The display device refers to a terminal device capable of outputting a specific display screen, and may be a terminal device such as a smart television, a communication terminal, a smart advertisement screen, and a projector. Taking intelligent electricity as an example, the intelligent television is based on the Internet application technology, has an open operating system and a chip, has an open application platform, can realize a bidirectional man-machine interaction function, and is a television product integrating multiple functions of video, entertainment, data and the like, and the intelligent television is used for meeting the diversified and personalized requirements of users.

The display device can be accessed to the live broadcast platform through the live broadcast application, and live broadcast pictures can be presented for users in real time. For example, a "live classroom" application may be installed in the display device, where the display device accesses a specific live broadcasting room by running the live broadcasting classroom application, so as to receive, in real time, live broadcasting course pictures corresponding to the live broadcasting room, and display the live broadcasting course pictures. In order to increase interactivity of live broadcast, part of live broadcast applications support an instant messaging function, i.e. for a plurality of users in the same live broadcast room, communication can be performed by sending instant messaging messages. Therefore, the display device can synchronously display the instant communication message in the process of playing the live broadcast picture.

However, when the number of users in the same live broadcasting room is large, the display device receives a large number of instant messaging messages in a short time, and in order to display the instant messaging messages, the display device needs to continuously refresh the UI interface, so that the main thread task is blocked, and interface jamming is caused.

Disclosure of Invention

An embodiment of the present application provides a display apparatus including: a display configured to display images and user interfaces acquired through a network and/or a broadcast system; a communicator configured to establish a communication connection with a server; a controller configured to: receiving a control instruction input by a user and used for entering a live broadcasting room; responding to the control instruction, and acquiring the current user quantity and instant communication information in the live broadcasting room; creating a message cache list, wherein the message cache list is used for storing the instant messaging messages, and the upper limit of the cache quantity and/or the refresh delay time of the message cache list are set according to the quantity of the current users; and displaying the instant messaging messages in the message cache list according to the parameters of the instant messaging messages in the message cache list.

The embodiment of the application also provides a display method which is applied to the display equipment, wherein the display equipment comprises a display, a communicator and a controller, and the method comprises the following steps: receiving a control instruction input by a user and used for entering a live broadcasting room; responding to the control instruction, and acquiring the current user quantity and instant communication information in the live broadcasting room; creating a message cache list, wherein the message cache list is used for storing the instant communication message; the upper limit of the cache quantity and/or the refresh delay time of the message cache list are set according to the current user quantity; and displaying the instant communication messages in the message cache list according to the parameters of the instant communication messages in the message cache list.

Drawings

FIG. 1 is a usage scenario of a display device according to an embodiment of the present application;

FIG. 2 is a block diagram of a hardware configuration of a control device according to an embodiment of the present application;

FIG. 3 is a hardware configuration diagram of a display device according to an embodiment of the present application;

FIG. 4 is a software configuration diagram of a display device according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a live application interface in an embodiment of the present application;

fig. 6 is a diagram showing a display effect of a live broadcast picture according to an embodiment of the present application;

FIG. 7 is a schematic diagram showing an effect of displaying a real-time communication message according to an embodiment of the present application;

FIG. 8 is a diagram of context and information flow showing highly concurrent messages in an embodiment of the application;

FIG. 9 is a flow chart of comparing the number of users according to an embodiment of the present application;

FIG. 10 is a diagram showing context and information flow of historical messages in an embodiment of the application;

FIG. 11 is a flowchart illustrating a method for modifying a message cache list parameter according to an embodiment of the present application; and

Fig. 12 is a flowchart of a method for displaying high concurrency messages according to an embodiment of the present application.

Detailed Description

Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the examples below are not intended to represent all implementations consistent with the present application. Merely exemplary of systems and methods consistent with aspects of the application as set forth in the claims.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display device 200 is also in data communication with a server 400, and a user can operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any one of a mobile terminal, tablet, computer, notebook, AR/VR device, etc.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control apparatus configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 is a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

In some embodiments, the communication interface 130 is configured to communicate with the outside, including at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, keys, or an alternative module.

Fig. 3 is a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment.

In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving an image signal from the controller output, for displaying video content, image content, and components of a menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; either the detector 230 comprises an image collector, such as a camera, which may be used to collect external environmental scenes, user attributes or user interaction gestures, or the detector 230 comprises a sound collector, such as a microphone or the like, for receiving external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: at least one of icons, operation menus, and user input instruction display graphics. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, perform at least one of decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, and the like according to a standard codec protocol of an input signal, and obtain a signal that is displayed or played on the directly displayable device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like. And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received frame rate into a video output signal and changing the video output signal to be in accordance with a display format, such as outputting RGB data signals.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode according to a standard codec protocol of an input signal, and at least one of noise reduction, digital-to-analog conversion, and amplification, to obtain a sound signal that can be played in the speaker.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Or the user may input the user command by inputting a specific sound or gesture, the user input interface recognizes the sound or gesture through the sensor, and receives the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of a user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a graphically displayed user interface that is related to computer operations. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the user interface 280 is an interface (e.g., physical keys on a display device body, or the like) that may be used to receive control inputs.

In some embodiments, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.

Referring to FIG. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (referred to as an "application layer"), an application framework layer (Application Framework) layer (referred to as a "framework layer"), a An Zhuoyun row layer (Android runtime) and a system library layer (referred to as a "system runtime layer"), and a kernel layer, respectively.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for the application programs of the application layer. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.

As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an activity manager (ACTIVITY MANAGER) is used to interact with all activities running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a package manager (PACKAGE MANAGER) for retrieving various information about the application packages currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window to display, dithering display, distorting display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

Based on the display device 200 described above, the user may control the display device 200 to present different user interfaces through specific interactions. Wherein a portion of the application interface is available for presenting live pictures. For example, a live application such as "××classroom" may be installed in the display device 200 for presenting an online lesson live screen. When the user controls the display apparatus 200 to start the "x class" application, the display apparatus 200 may jump to a live interface such as an application interface corresponding to the x class through a current user interface, such as an application list interface.

In some embodiments, before the display device 200 presents a live interface, a live room (or channel) selection may also be made through a particular interface. For example, after launching an "x classroom" application, the "x classroom" application may first provide a course selection interface. As shown in fig. 5, in the course selection interface, different possible content live link options such as "literature public lessons, historic long river … …" may be included, and each live link option may be associated with one or more live rooms. When the user selects any direct-broadcasting link option, the display device 200 can be controlled to access the direct-broadcasting room, obtain the direct-broadcasting picture corresponding to the direct-broadcasting room, and display the direct-broadcasting picture through the display 260 in real time.

Since the live broadcast pictures corresponding to the same live broadcast room can be acquired by the plurality of display devices 200, and the plurality of display devices 200 entering the same live broadcast room can communicate with each other, the instant communication message is sent. Accordingly, the display apparatus 200 may display an instant communication message in the live interface while displaying a live screen through the display 260. For example, as shown in fig. 6, the user entering the same course corresponding living room may include a teacher, a student 1, a student 2, a student 3, a student 4, a student 5, and the like. These users can each input instant communication messages through their own display device 200. As shown in fig. 7, these instant messaging messages may also be displayed based on the upper layer of the live view and scroll with the continuous input of messages.

In order to display an instant communication message in a live interface, in some embodiments, the display device 200 may refresh the live interface according to the received instant communication message while displaying the live screen, and display the instant communication message in a local message list corresponding layer above the live screen. For example, when the student 5 sends out the instant communication message "teacher me does not do so", all the display devices 200 accessing the current live broadcasting room need to update the local message list according to the instant communication message sent by the student 5, so that the "teacher me does not do not go" sent by the student 5 is displayed at the bottom position of the message list. Similarly, for instant communication messages sent by different users at different times, the display device 200 can perform real-time display by adopting the refreshing method.

Since the frame corresponding to the local message list is usually a real-time rendering frame displayed in a layer on the live frame in the process of presenting the instant message, the display device 200 needs to continuously render and refresh the frame displayed in the live interface according to the sending condition of the instant message. Therefore, when the number of people in the live broadcasting room accessed by the display apparatus 200 is large and the speaking is frequent, the display apparatus 200 receives instant communication messages sent by a plurality of users in a short time, and in order to display the received messages, the display apparatus 200 needs to frequently refresh, render and display a local message list.

Based on this, when the number of instant communication messages received by the display apparatus 200 per unit time is excessive, the main thread is blocked, causing a problem of interface jamming. For example, if the screen frame rate of the display device 200 such as a smart terminal is typically 60FPS, that is, 60 times per second, when the number of instant messaging messages received by the display device 200 per second exceeds 60, the main thread may be blocked, resulting in interface jamming.

In order to improve the problem of interface jamming in the case of high concurrent messages, a display method is provided in some embodiments of the present application, which can be applied to the display apparatus 200. Also, to meet the implementation of the method, the display device 200 should include at least a display 260, a communicator 220, and a controller 250. Wherein the display 260 is configured to display a user interface, including a live interface. The communicator 220 is configured to establish a communication connection with the server 400 in order to acquire a live view and an instant communication message from the server 400. The controller 250 is configured to perform the above-described display method to control the display process of the live view and the instant communication message. Fig. 8 is a diagram of a situation and information flow to which the display method of the embodiment of the present application is applicable. As shown in fig. 8, the system includes a server 400, a control apparatus 100, and a display device 200. The display device 200 may be a display device as shown in fig. 3. The display device interacts with the server 400 through the communicator 220, and the controller 250 receives input control instructions for entering a live room. When the display apparatus 200 is used, various control instructions may be input through the control device 100 according to a user interaction policy defined by an operating system of the display apparatus 200. Wherein, the partial control instruction is used for controlling the display device 200 to enter the live broadcast room and present the live broadcast picture. Therefore, when detecting an input control instruction, the display device 200 may start to display the live broadcast interface, and display the live broadcast screen and the instant messaging message by applying the display method in the embodiment of the present application.

The control instruction for entering the living room may be input in various ways according to an interaction policy defined in the operating system of the display apparatus 200. In some embodiments, the control device 100, such as a remote controller or an intelligent terminal, matched with the display device 200 may control the focus cursor in the interface of the display device 200 to move, and sequentially select a specific option based on different user interfaces, so as to control the display device 200 to enter the live broadcast room. For example, the focus cursor may be controlled to sequentially select "my" - "application" - "x×class", and the display apparatus 200 may be controlled to start the live-type application. And selecting any direct-broadcasting link option from the presented application interface to control entering the live broadcasting room.

In some embodiments, for the display device 200 supporting touch interaction, the interaction may also be performed by touch. For example, in an embodiment, a live application is started by sequentially selecting "my" - "application" - "xx classroom", and then any one of the direct broadcast link options is selected by touch interaction, so that control enters the live room.

In some embodiments, for display device 200 supporting intelligent voice interactions, control instructions for entering a live room may also be entered based on the intelligent voice system. For example, voice contents such as "i want to watch live lessons", "open x class", etc. may be input through a far-field microphone of the display device 200 or a microphone built in the control apparatus 100. The intelligent voice system converts voice into words after receiving the voice content, and extracts the semantics through the natural language processing model, so as to generate a control instruction according to the semantics, control the display device 200 to open the live broadcast application, and enter the live broadcast room.

Note that the manner of the control command described above is merely an example of a specific input manner, and the input process of the control command is not limited thereto. Other input modes that can be imagined by those skilled in the art on the basis of the above input modes, and other input modes that are adopted to adapt to the interaction strategies of different display devices 200, fall within the protection scope of the present application.

After a control instruction for entering a living room is input, the display apparatus 200 may receive a living picture in response to the control instruction. Live scenes are typically generated by recording a particular scene in real time. After the display device 200 of the live broadcasting room is started to generate the live broadcasting picture, the live broadcasting picture can be transmitted to the server 400 in real time, and the server 400 can distribute the live broadcasting picture to the display devices 200 corresponding to different access users of the live broadcasting room, so that the display device 200 can receive the live broadcasting picture. After receiving the live view, the display device 200 may render the live view, generate a live interface, and display the live view through the display 260.

The display device 200 may also receive instant communication messages in real time while receiving live pictures. The instant communication message can be sent by any user accessing the current live broadcast room, the sent instant communication message is sent to the server 400, and the server 400 pushes the instant communication message to each user in the current live broadcast room, including the user initiating the live broadcast room and the user accessing the live broadcast room. Each user may display the instant communication message according to the real-time display or the buffer delay after receiving the instant communication message.

When the number of users in the live broadcasting room is large, the number of instant messaging messages is large, so that interface blocking is easy to occur due to the fact that the main thread is blocked by high concurrent messages. Therefore, in the embodiment of the present application, the display device 200 may acquire the current number of users in the live broadcasting room in real time while acquiring the live broadcasting picture and the instant messaging message, so as to determine whether to adjust the display mode of the instant messaging message according to the current number of users.

As shown in fig. 9, in some embodiments, the display apparatus 200 acquires the current number of users within the living room at step S910. At S911, the current number of users may be compared to a threshold number of users. At S912, it is determined whether the current number of users is greater than a user number threshold. If the current number of users is less than or equal to the threshold number of users (i.e., no branch), the number of users in the current live broadcast room is smaller, and the problem of high concurrency of messages is not easy to occur, so the display device 200 does not need to adjust the display mode of the instant messaging messages. In step S913, the direct control display 260 displays the instant communication message in real time. According to the comparison result, if the number of the current users is greater than the threshold value of the number of the users (namely, the 'yes' branch), the number of the users in the current live broadcasting room is more, and the problem of high concurrent instant messaging messages is easy to occur, so that the display mode of the instant messaging messages can be adjusted, the influence of the refreshing process of the instant messaging messages on a main thread is reduced by delaying the display mode of the instant messaging messages, and the phenomenon of blocking is improved.

In an embodiment of the present application, the current number of users may also be used to control the delay display process, and when the display device 200 displays the instant communication message in a delay display manner, the display device 200 may create a message buffer list for storing the instant communication message in step S914, that is, the instant communication message received from the server 400 may not be displayed in real time but be temporarily stored in the message buffer list. When the instant messaging messages stored in the message cache list reach preset display conditions, the interface is refreshed again so as to display the stored instant messaging messages.

Since the number of users in a live room typically has a positive correlation with the number of concurrent instant messaging messages. I.e., the greater the number of users, the greater the instant messaging messages. The blocking degree of the instant messaging message to the main thread and the display timeliness are directly affected by different concurrent numbers of messages, so that the upper limit of the cache number and the refresh delay time of the message cache list can be set according to the number of current users in order to achieve both smoothness and display timeliness.

To set the upper limit of the number of caches and the refresh delay time of the message cache list, in some embodiments, the display device 200 may obtain the refresh frequency of the display 260 after obtaining the current number of users. It is apparent that the display 260 screen refresh frequency is different for different display devices 200. For example, the refresh frequency of the normal display 260 is 60Hz, the refresh frequency of the professional display 260 is 120Hz, etc. And, for the same display device 200, different refresh frequencies can be adopted in different display modes, for example, the screen refresh frequency of the smart television in displaying the media asset picture is 60Hz, and in the process of accessing the game device to display the game picture, the screen refresh frequency is 120Hz. Accordingly, the display device 200 may determine the refresh frequency when acquiring the refresh frequency of the display 260, integrating the type and operating mode of the display device 200.

After acquiring the refresh frequency of display 260, display device 200 may calculate a ratio of the current number of users to the refresh frequency of display 260. And calculating the upper limit of the buffer memory number according to the ratio of the current user number to the refresh frequency of the display 260, wherein the upper limit of the buffer memory number is the minimum integer greater than or equal to the ratio of the current user number to the refresh frequency of the display 260, namely:

maxChacheCount＝ceil(memberCount/fps)；

wherein maxChacheCount denotes an upper limit of the number of caches; ceil (… …) represents returning a minimum integer calculation function that is greater than or equal to the specified expression; memberCount denotes the current number of users; fps represents the refresh frequency of display 260.

After the upper limit of the buffer amount is obtained through the calculation of the above formula, the display device 200 calculates a minimum refresh interval according to the refresh frequency, where the minimum refresh interval is a time interval between display pictures of adjacent frames, and may be obtained through the reciprocal calculation of the refresh frequency. For example, when the refresh frequency of the display 260 is 60Hz, the minimum refresh interval is 1/60=0.016 s.

Finally, the display apparatus 200 may calculate the refresh delay time from the upper limit of the number of buffers and the minimum refresh interval, that is, by calculating the product of the upper limit of the number of buffers and the minimum refresh interval as the refresh delay time delayTime. For example, after calculating the obtained buffer amount upper limit maxChacheCount and the minimum refresh interval of 0.016s, the display device 200 may calculate maxChacheCount ×0.016 as the refresh delay time delayTime.

After creating the message buffer list and setting the upper limit of the buffer number and the refresh delay time of the message buffer list according to the current user number, the display device 200 may store the acquired instant communication message in the message buffer list and delay display the instant communication message based on the created message buffer list. In implementing the delay display, the display apparatus 200 may detect the instant communication message stored in the message cache list, and determine parameters such as the number of caches and/or the storage time of the instant communication message in the message cache list in steps S915 and S918.

In the embodiment of the application, the instant messaging messages in the message cache list can be displayed according to the parameters of the instant messaging messages in the message cache list.

For example, in steps S916 and S919, it is determined whether the display condition of the instant communication message is satisfied by comparing the buffer number with the upper limit of the buffer number, and the storage time with the refresh delay time. When the condition (i.e., the "yes" branch) is satisfied, that is, when the number of instant communication messages in the message buffer list is greater than or equal to the upper limit of the buffer number, or when the instant communication message storage time in the message buffer list is greater than or equal to the refresh delay time, it is determined that the display condition of the instant communication message is satisfied, and thus the display 260 may be controlled to display the instant communication message in the message buffer list in step S917.

According to the embodiment, when the number of users in the live broadcasting room is large, the message cache list is created to enable the message delay display function, so that the refreshing times of the instant messaging message display process are reduced, and the interface jamming problem is improved. In addition, the upper limit of the cache quantity and the refresh delay time in the message cache list can be set according to the current user quantity, so that different judging conditions are adopted when different user quantities are adopted, the display timeliness and the interface smoothness of even communication messages can be considered, and the user experience is improved.

Since the live broadcast pictures corresponding to the live broadcast room can be simultaneously pushed to the display devices 200 of different users, and the different display devices 200 can enter the live broadcast room at different times, in order to timely acquire the chat status in the live broadcast room, as shown in fig. 10, in some embodiments, for the display devices 200 entering the live broadcast room later, a history message can also be acquired when entering the live broadcast room. In this regard, the display device 200 may create a local message list after entering the live room, wherein the local message list is used to display instant communication messages in real time. For ease of display, instant messaging messages may be arranged in the local message list in the same order as the message columns in the live interface, e.g., with new messages located below old messages. Therefore, when the instant communication message is displayed, the display screen can be directly rendered according to the local message list.

After creating the local message list, the display apparatus 200 may extract the reception time of the control instruction, that is, after the display apparatus 200 receives the control instruction input by the user, the input time of the control instruction may be recorded as the reception time. The history message is then requested from the server 400 according to the reception time, that is, after the reception time is extracted, the display device 200 may generate a request instruction, and the request instruction may include the reception time. And then the generated request instruction is sent to the server 400, so that the server 400 can feed back the history message for the request instruction.

The history message is an instant communication message in a preset synchronization period before the receiving time. The history messages fed back by the server 400 should not be excessive so as to reduce the synchronization time; and the historical information fed back by the server 400 is not too small, so that the user can know the communication condition in the live broadcast room, and the user requirement is met. Therefore, the preset synchronization period may be comprehensively determined according to the storage capacity of the server 400, the communication frequency of the user in the current live broadcasting room, and the like. For example, the preset synchronization period may be an integer multiple of the refresh delay time.

After the display device 200 obtains the history message, the history message is added to the local message list to be displayed together with the live broadcast picture, so as to form a live broadcast interface. For example, when user 1 enters any live room in a live classroom through the display device 200, the display device 200 may send an HTTP request to the instant messaging module of the server 400, obtain a live room history message (historyMessages), add historyMessages to the local message list (msgList), and then load and display the message in msgList through the UI refresh method.

In some embodiments, when the display device 200 establishes the local message list, the display of the instant communication messages in the cache list may also be achieved by adding the instant communication messages in the message cache list to the local message list to refresh the user interface based on the local message list.

As can be seen from the above embodiments, in the above embodiments, the display device 200 can display the history message and the instant messaging message in real time based on the local message list, and since the display device 200 can add the message to the local message list according to the time sequence, the message displayed in the live interface can still maintain the original speaking sequence of the instant message, thereby alleviating the problem of display errors.

In the above embodiment, since the message to be delayed for display can be temporarily stored through the message cache list, and displayed when the storage number is greater than the upper limit of the cache number or the storage time reaches the refresh delay time. The upper limit of the number of caches and the refresh delay time are set according to the number of users in the current live broadcasting room, but the number of users in the live broadcasting room is continuously changed along with the live broadcasting, that is, users enter or exit the live broadcasting room at intervals in the live broadcasting process, so as shown in fig. 11, in some embodiments, the display device 200 may modify the upper limit of the number of caches and the refresh delay time according to the number of users in the live broadcasting room, so that the display process of the live broadcasting picture is smooth and time-efficient.

In step S1101, the display apparatus 200 may acquire user update information of the live broadcasting room, which may include information contents such as a user name of entering or exiting the live broadcasting room, a time of entering or exiting, etc., for indicating user information of entering or exiting the current live broadcasting room. The user update information may also be obtained by the server 400, that is, when any user enters or leaves the live broadcast room, the server 400 may be triggered to generate the user update information, and the generated update information may also be sent to all users in the live broadcast room by means of data push.

After acquiring the user update information from the server 400, the display apparatus 200 may modify the current user number according to the number update information and set the upper limit of the cache number and the refresh delay time according to the modified current user number in step S1102. For example, when the user 1 enters the live broadcasting room, the server 400 may push the user update information to other display devices 200 in the live broadcasting room except for the display device 200 of the user 1, and the display devices 200 may re-determine the current user number according to the previously received user number and the user update information, that is, the current user number=the original user number+1. After modifying the current number of users, the display device 200 recalculates the upper limit of the number of buffers and the refresh delay time according to the manner provided in the above embodiment, that is:

maxChacheCount＝ceil((memberCount+1)/fps)；

delayTime＝maxChacheCount×0.016；

Wherein maxChacheCount denotes an upper limit of the number of caches; ceil (… …) represents returning a minimum integer calculation function that is greater than or equal to the specified expression; (memberCount +1) represents the current number of users; fps represents the refresh frequency of display 260; delayTime represents the refresh delay time.

Therefore, through the above calculation method, the display device 200 can reset the upper limit of the buffer number and the refresh delay time according to the modified current user number, so that the delay display process of the display device 200 can automatically adapt to the user number in the live broadcasting room, and both the display smoothness and timeliness are considered.

Since the user entering or exiting live broadcast is generally a personal behavior of the user, the number of users in the live broadcast room generally changes slowly, and when the change of the number of users is small, the smoothness or timeliness of display is not significantly affected, so in order to reduce the parameters of frequently updating the message cache list, in some embodiments, the display device 200 may further traverse the number of user variations in the user update information when setting the upper limit of the number of caches and the refresh delay time according to the modified current number of users, and compare the number of user variations obtained by the traversal with a preset update threshold to determine whether the number of user variations is greater than or equal to the update threshold (step S1104).

If the number of user changes is greater than or equal to the update threshold (i.e., yes branch), in step S1105, the upper limit of the number of caches and the refresh delay time are set according to the modified current number of users, so that the delay display function is executed according to the reset upper limit of the number of caches and the refresh delay time, so as to achieve both the smoothness and the timeliness. If the number of user variations is smaller than the update threshold (no branch), in step S1107, the upper limit of the number of caches and the refresh delay time are maintained, i.e., the message cache list is not modified to avoid frequent operations, which excessively consume the processing power of the display apparatus 200.

For the live interface, the display device 200 may display a live screen and an instant communication message, and simultaneously display an entry or exit state of a user in the live room. For example, when user 1 enters the live room, the live interface may display a prompt text such as "user 1 has entered the live room". These prompt messages are generally displayed in real time along with the user entering or exiting the live broadcast room, and when the number of people in the live broadcast room is large, the display device 200 needs to frequently refresh the UI interface, which may cause a problem of jamming. To this end, in some embodiments, the display apparatus 200 may also enable the delay display function when displaying the prompt information, that is, add the user information added to the current live room in the user update information to the message cache list (step S1106).

Because the message display method provided in the above embodiment can reduce the influence of the high concurrency message refreshing process on the main thread by delaying the display of the instant communication message when the number of users in the live broadcast room is large, the delay display process can be triggered by two conditions, and different trigger conditions can be adopted, and different display control methods can be adopted in the display process. That is, in some embodiments, the display device 200 may detect the on state of the local deferred refresh task when the number of instant messages in the message cache list is greater than or equal to the upper limit of the number of caches, where the local deferred refresh task is a task that controls deferred display, and after the task is started, may be displayed according to a set delay time. For example, when a delay of 1s is set to display a message, the display apparatus 200 may display the contents in the message buffer list every 1 s.

When the number of instant communication messages in the message cache list is determined to be greater than or equal to the upper limit of the number of caches, the display device 200 is not controlled to complete the delayed display by the local delayed refresh task at this time, i.e. if the on state of the local delayed refresh task is on, the delay timing of the local delayed refresh task can be stopped, so as to display the instant communication messages in the message cache list in real time, and after the instant communication messages in the message cache list are displayed, the delay timing of the local delayed refresh task is started.

For example, when the number of users in the message cache list msgcchelist.count is no less than maxChacheCount, the message of MSGCACHELIST is added to the local message list msgList, at this time, if the local deferred refresh task is already on, the task is canceled and the live interface is refreshed, and all messages in MSGCACHELIST at this time are displayed.

Similarly, in some embodiments, when it is determined that the number of instant messages in the message buffer list is less than the upper limit of the buffer number, the display device 200 may also detect an on state of the local deferred refresh task, and if the on state of the local deferred refresh task is unopened, open the local deferred refresh task to control the deferred display process according to the local deferred refresh task.

For example, when the number of users msgcachlist.count < maxChacheCount in the message cache list is judged, if the local delay refresh task is not started, starting the delay refresh task, and setting the delay time as delay time, so that after the delay time is reached, the live interface refresh operation is executed, and all the messages are displayed.

As can be seen from the above embodiments, in the method for displaying high concurrency messages provided in the above embodiments, the refresh frequency of messages can be reduced by delaying the refresh of the live interface, so that the messages received by the display device 200 are cached first, and the message interface is refreshed after a certain time, thereby improving the smoothness of the display process. Meanwhile, in order to avoid untimely display caused by more messages in delay time, the message interface is refreshed in time to display all the messages after a certain number of buffer memories are limited. In addition, the display device 200 can dynamically adjust the delay refresh time and the maximum buffer limit according to the number of users in the live broadcasting room, flexibly adjust the refresh frequency, and improve the timeliness of message display to the greatest extent while relieving the interface refresh katon problem caused by message concurrency.

Based on the high concurrency message display method provided in the foregoing embodiments, in some embodiments of the present application, there is further provided a display apparatus 200, where the display apparatus 200 includes: a display 260, a communicator 220 and a controller 250. Wherein the display 260 is configured to display a user interface; the communicator 220 is used to establish a communication connection between the display device 200 and the server 400. As shown in fig. 12, the controller 250 is configured to perform the steps of:

In step S1201, an input control instruction for entering a live broadcast room is received;

In step S1202, in response to the control instruction, requesting to the server to acquire the current number of users and/or instant communication messages in the live broadcasting room;

in step S1203, the current number of users is acquired from the server;

in step S1204, a message cache list is created, where the message cache list is used to store the instant communication message; the upper limit of the cache quantity and the refreshing delay time of the message cache list are set according to the current user quantity;

In step S1205 (including S1205A and S1205B), it is determined whether the number of instant communication messages in the message cache list is greater than or equal to the upper limit of the number of caches, or whether the instant communication message storage time in the message cache list is greater than or equal to a refresh delay time. When the condition is satisfied (i.e., based on the parameters of the instant communication message), the instant communication message in the message cache list is displayed in step S1206 (including S1206A and S1206B).

As can be seen from the above embodiments, the display device 200 provided in the above embodiments may obtain the current number of users in the live broadcast room after the user controls the display device 200 to enter the live broadcast room, and then create a message cache list for temporarily caching the instant communication message according to the current number of users, so as to display the instant communication message in the message cache list when the message status in the message cache list meets a specific condition. The specific condition includes that the number of instant messaging messages in the message cache list is greater than or equal to the upper limit of the cache number, or the storage time of the instant messaging messages in the message cache list is greater than or equal to the refresh delay time. The display device 200 can temporarily store the instant messaging message through the message cache list, and can reduce the refreshing times of the live broadcasting room pictures when the instant messaging message is highly concurrent, thereby alleviating the problem of interface jamming.

The above-provided embodiments are only examples under the general inventive concept and do not constitute limitations on the scope of the application. Any other implementation of the embodiments according to the present application, without any inventive effort, is within the scope of the present application for a person skilled in the art.

Claims

A display device, comprising:

a display configured to display images and user interfaces acquired through a network and/or a broadcast system;

A communicator configured to establish a communication connection with a server;

a controller configured to:

Receiving a control instruction input by a user and used for entering a live broadcasting room;

responding to the control instruction, and acquiring the current user quantity and instant communication information in the live broadcasting room;

creating a message cache list, wherein the message cache list is used for storing the instant messaging messages, and the upper limit of the cache quantity and/or the refresh delay time of the message cache list are set according to the quantity of the current users; and

And displaying the instant communication messages in the message cache list according to the parameters of the instant communication messages in the message cache list.
The display device of claim 1, wherein the parameters of the instant communication messages include the number of instant communication messages and/or a time of storage of the instant communication messages, the controller being further configured to:

And displaying the instant communication messages in the message cache list when the number of the instant communication messages in the message cache list is greater than or equal to the upper limit of the cache number and/or the storage time of the instant communication messages in the message cache list is greater than or equal to the refresh delay time.
The display device of claim 1, wherein the controller is further configured to:

creating a local message list, wherein the local message list is used for displaying instant communication messages in real time;

extracting the receiving time of the control instruction;

Requesting a history message to the server according to the receiving time, wherein the history message is an instant communication message in a preset synchronization period before the receiving time;

The history message is added to the local message list.
The display device of claim 2, wherein the controller is further configured to:

In the step of displaying the instant messaging messages in the message cache list, adding the instant messaging messages in the message cache list to the local message list;

refreshing the user interface based on the local message list.
The display device of claim 1, wherein the controller is further configured to:

acquiring user update information of a live broadcasting room, wherein the user update information is used for representing user information of joining or exiting a current live broadcasting room;

modifying the current user number according to the number updating information;

and setting the upper limit of the cache quantity and/or the refresh delay time according to the modified current user quantity.
The display device of claim 5, wherein the controller is further configured to:

Traversing the user variation number in the user update information in the step of setting the upper limit of the cache number and/or the refresh delay time according to the modified current user number;

if the user variation quantity is larger than or equal to an updating threshold value, setting the upper limit of the cache quantity and the refreshing delay time according to the modified current user quantity;

Adding the user information of the current live broadcasting room into the user updating information to the message cache list;

If the user variation number is smaller than the update threshold, maintaining the upper limit of the cache number and the refresh delay time.
The display device of claim 1, wherein when the number of instant communication messages within the message cache list is greater than or equal to the upper cache number limit, the controller is further configured to:

detecting the starting state of a local delay refreshing task;

If the starting state of the local delay refreshing task is started, stopping delay timing of the local delay refreshing task so as to display instant communication messages in the message cache list in real time;

and after the instant communication messages in the message cache list are displayed, starting delay timing of the local delay refreshing task.
The display device of claim 1, wherein when the number of instant communication messages within the message cache list is less than the upper cache number limit, the controller is further configured to:

detecting the starting state of a local delay refreshing task;

and if the starting state of the local delay refreshing task is not started, starting the local delay refreshing task.
The display device of claim 1, wherein the controller is further configured to:

Before the step of creating the message cache list, comparing the current user number with a user number threshold;

if the current user quantity is smaller than or equal to the user quantity threshold value, displaying the instant communication message in real time;

And if the current user quantity is larger than the user quantity threshold value, creating a message cache list.
The display device of claim 1, wherein the controller is further configured to:

in the step of creating a message cache list, acquiring the refresh frequency of the display;

Calculating the ratio of the number of current users to the refresh frequency of the display;

Calculating the upper limit of the number of the caches according to the ratio, wherein the upper limit of the number of the caches is a minimum integer which is greater than or equal to the ratio;

Calculating a minimum refresh interval according to the refresh frequency;

And calculating the product of the upper limit of the number of the caches and the minimum refresh interval as the refresh delay time.
A display method applied to a display device, the display device including a display, a communicator, and a controller, the method comprising:

Receiving a control instruction input by a user and used for entering a live broadcasting room;

responding to the control instruction, and acquiring the current user quantity and instant communication information in the live broadcasting room;

Creating a message cache list, wherein the message cache list is used for storing the instant communication message; the upper limit of the cache quantity and/or the refresh delay time of the message cache list are set according to the current user quantity;

And displaying the instant communication messages in the message cache list according to the parameters of the instant communication messages in the message cache list.
The method of claim 11, wherein the parameters of the instant communication message include the number of instant communication messages and/or a time of storage of the instant communication messages, and displaying the instant communication messages in the message cache column includes:

And displaying the instant communication messages in the message cache list when the number of the instant communication messages in the message cache list is greater than or equal to the upper limit of the cache number and/or the storage time of the instant communication messages in the message cache list is greater than or equal to the refresh delay time.