CN118301393A

CN118301393A - Display equipment and media data display switching method

Info

Publication number: CN118301393A
Application number: CN202410312787.9A
Authority: CN
Inventors: 游灿虹; 蔡罡霞; 雷云; 王本杰
Original assignee: Vidaa Netherlands International Holdings BV
Current assignee: Vidaa Netherlands International Holdings BV
Priority date: 2024-03-19
Filing date: 2024-03-19
Publication date: 2024-07-05

Abstract

The application provides a display device and a media data display switching method, which are used for responding to a play instruction input by a user, controlling a first decoder to decode first media data in a first decoding mode, caching second media data and controlling a display to display a first media picture corresponding to the first media data. After detecting a switching instruction sent by the server, recording the current playing progress of the first media data, replacing the currently displayed first media data picture by using the second media data picture, and after the second media data picture is displayed, controlling the display to continuously display the first media data picture according to the current playing progress. The application decodes the media data through a plurality of decoders, can adapt to the media data with different encryption types, and directly displays decoded media pictures after switching when the media data need to be switched and played, thereby improving the success rate of switching and playing.

Description

Display equipment and media data display switching method

Technical Field

The present application relates to the field of data display technologies, and in particular, to a display device and a media data display switching method.

Background

Streaming media applications are an internet-based technology to enable the transmission and playback of audio, video and other multimedia content in real-time in a display device. These applications do not require the user to download the entire file to the display device, but rather can be played directly online to save storage space on the display device.

In the feature video played in real time, an advertisement video can be inserted through an SSAI technology (Server-SideAdInsertion, technical service end advertisement insertion) so as to improve the product popularization effect. The advertisement video is clear stream video, i.e. raw video stream which is not processed or processed, and the feature video is encrypted stream video, i.e. video stream which is encrypted. When the display device switches to play the feature video and the advertisement video, the switching to play fails due to different encryption types.

Disclosure of Invention

In order to solve the problem of abnormal playing of the display device when switching to play video streams of different encryption types, in a first aspect, some embodiments of the present application provide a display device, including a display configured to display a media asset picture, a first decoder configured to perform decoding on the media asset data in a first decoding manner, a second decoder configured to perform decoding on the media asset data in a second decoding manner, the first decoding manner and the second decoding manner being different; the communicator is configured to establish a communication connection with a server, and the controller is configured to:

Responding to a play instruction input by a user, controlling the first decoder to decode first media data in a first decoding mode, and caching second media data;

Controlling the display to display a first media resource picture corresponding to the first media resource data, and detecting a switching instruction sent by the server, wherein the switching instruction is generated after a preset duration of the first media resource picture is displayed;

Responding to the switching instruction, recording the current playing progress of the first media asset data, and replacing the currently displayed first media asset picture by using a second media asset picture; the second media asset picture is obtained by decoding the second media asset data in a second decoding mode through the second decoder;

And after the second media asset picture is displayed, controlling the display to continuously display the first media asset picture according to the current playing progress.

In some embodiments, the system further comprises an audio output interface configured to play audio data in the media asset data; the controller is used for executing and controlling the display to display a first media resource picture corresponding to the first media resource data, and is configured to:

parsing first audio data of first media asset data, the first audio data comprising a plurality of first audio frames;

and controlling the audio output interface to synchronously play the first audio frame in the process of displaying the first media data corresponding to the first media data by the display.

In some embodiments, the controller is further configured to control the display to display a first media asset screen corresponding to the first media asset data:

Acquiring a pushing progress of the first media data, wherein the pushing progress comprises a picture pushing progress and an audio pushing progress;

When the picture pushing progress is ahead of the audio pushing progress, controlling the display to delay displaying the first media resource picture according to a first progress difference; the first progress difference is the progress difference between the picture pushing progress and the audio pushing progress;

When the audio pushing progress is ahead of the picture pushing progress, controlling the audio output interface to delay playing of a first audio frame corresponding to the first media resource picture according to a second progress difference; the second progress difference is the progress difference between the audio pushing progress and the picture pushing progress.

In some embodiments, the controller performs control of the display to display a first media asset screen corresponding to the first media asset data, and is configured to:

acquiring a first picture switching time length, wherein the first picture switching time length is the time length of switching a currently displayed first media picture to a first media picture displayed in the next frame;

And when the switching time of the first picture is longer than the timeout waiting threshold, controlling the display to skip frames to display the first media picture.

In some embodiments, the controller is further configured to, before executing replacing the currently displayed first asset screen with the second asset screen:

when the display displays the first media asset picture, acquiring the pushing progress of the second media asset data;

When the picture pushing progress is synchronous with the audio pushing progress, the second media resource picture is used for replacing the first media resource picture which is currently displayed, and the second audio frame corresponding to the second media resource picture is used for replacing the first audio frame corresponding to the first media resource picture.

In some embodiments, the controller is further configured to:

When the pushed media asset data is switched from the second media asset data to the first media asset data, generating an end play instruction;

Responding to the play ending instruction, and controlling the display to stop displaying the second media asset picture;

And after the display stops displaying the second media asset picture, controlling the display to switch and display the first media asset picture.

In some embodiments, the controller is further configured to:

Responding to the play ending instruction, taking the time point for generating the play ending instruction as a starting point, taking the time point for stopping playing the second media asset picture by the display as an ending point, and recording the play ending time;

and when the playing ending time is longer than the ending time threshold, controlling the display to switch and display the first media resource picture.

In some embodiments, the controller performing control of the first decoder to decode the first media data in a first decoding manner is configured to:

Acquiring a data type of the first media data, wherein the data type comprises encrypted stream data and clear stream data;

If the first media asset data is encrypted stream data, requesting decryption key information of the encrypted stream data from the server; and decoding, by the first decoder, the first asset data according to the decryption key information;

And if the first media asset data is clear stream data, directly decoding the first media asset data through the first decoder.

In some embodiments, the controller is further configured to:

A URL link for requesting media asset data from the server, the URL link including a first URL link and a second URL link;

And loading the first media asset data according to the first URL link, and loading the second media asset data according to the second URL link.

In a second aspect, some embodiments of the present application further provide a media data display switching method, which is applied to the display device of the first aspect, where the display device includes a display, a first decoder, a second decoder, a communicator, and a controller, where the display is configured to display a media picture; the first decoder is configured to perform decoding on the media asset data in a first decoding manner; the second decoder is configured to perform decoding on the media asset data according to a second decoding manner, the first decoding manner being different from the second decoding manner; the communicator is configured to establish a communication connection with a server; the method comprises the following steps:

According to the technical scheme, the application provides the display equipment and the media data display switching method, which are used for responding to the playing instruction input by the user, controlling the first decoder to decode the first media data in a first decoding mode, caching the second media data and controlling the display to display a first media picture corresponding to the first media data. After detecting a switching instruction sent by the server, recording the current playing progress of the first media data, replacing the currently displayed first media data picture by using the second media data picture, and after the second media data picture is displayed, controlling the display to continuously display the first media data picture according to the current playing progress. The application decodes the media data through a plurality of decoders, can adapt to the media data with different encryption types, and directly displays decoded media pictures after switching when the media data need to be switched and played, thereby improving the success rate of switching and playing.

Drawings

In order to more clearly illustrate the technical solution of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 is a usage scenario of a display device according to an embodiment of the present application;

FIG. 2 is a hardware configuration diagram of a display device according to an embodiment of the present application;

Fig. 3 is a hardware configuration block diagram of a control device according to an embodiment of the present application;

fig. 4 is a schematic diagram of software configuration in a display device according to an embodiment of the present application;

FIG. 5 is a schematic flow chart of switching and displaying media data by a display device according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a screen for switching media asset data at intervals according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a screen for switching media asset data according to a time point according to an embodiment of the present application;

FIG. 8 is a schematic diagram of a decoder in switching media frames according to an embodiment of the present application;

FIG. 9 is a schematic diagram showing a delay picture according to an embodiment of the present application;

FIG. 10 is a schematic diagram illustrating a delay of audio progress according to an embodiment of the present application;

FIG. 11 is a flowchart illustrating a playback process when a damaged picture exists in the same media data according to an embodiment of the present application;

Fig. 12 is a flowchart of playing when a damaged screen exists when media data is switched according to an embodiment of the present application.

Detailed Description

For the purposes of making the objects and embodiments of the present application more apparent, an exemplary embodiment of the present application will be described in detail below with reference to the accompanying drawings in which exemplary embodiments of the present application are illustrated, it being apparent that the exemplary embodiments described are only some, but not all, of the embodiments of the present application.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The terminal device provided by the embodiment of the application can have various implementation forms, for example, a television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table) and the like.

Fig. 1 is a schematic diagram of an operation scenario between a terminal device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the terminal device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device 200 includes infrared protocol communication or bluetooth protocol communication, and other short-range communication methods, and the display device 200 is controlled by a wireless or wired method. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, the terminal device 300 (e.g., mobile phone, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on the terminal device 300.

In some embodiments, the display device 200 may receive not an instruction using the terminal device 300 or the control apparatus 100 described above, but a control of a user through a touch or a gesture or the like.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the terminal device 300, for example, the voice instruction control of the user may be directly received through a module configured inside the display device 200 device to obtain voice instructions, or the voice instruction control of the user may be received through a voice terminal device configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

As shown in fig. 2, the display apparatus 200 may include at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments, the controller 250 may include a processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, and first to nth interfaces for input/output.

Display 260 may include the following components, namely: a display screen assembly for presenting a picture; a driving assembly driving the image display; a component for receiving an image signal outputted from the controller 250, performing display of video content, image content, and a menu manipulation interface, a component for manipulating a UI interface by a user, and the like.

The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.

The communicator 220 is a component for communicating with an external device or server 400 according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; either the detector 230 comprises an image collector, such as a camera, which may be used to collect external environmental scenes, user attributes or user interaction gestures, or the detector 230 comprises a sound collector, such as a microphone, which may be used to receive external sounds or voice commands from a user.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

Fig. 3 is a block diagram of a hardware configuration of the control device in fig. 1 according to some embodiments of the present application. As shown in fig. 3, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface, a memory, and a power supply.

The control device 100 is configured to control the display device 200, and can receive an input operation instruction of a user, and convert the operation instruction into an instruction recognizable and responsive to the display device 200, functioning as an interaction between the user and the display device 200.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications for controlling the display apparatus 200 according to user's needs.

In some embodiments, as shown in fig. 1, a mobile terminal 300 or other intelligent electronic device may function similarly to the control device 100 after installing an application that manipulates the display device 200.

The controller 110 includes a processor 112 and RAM 113 and ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication collaboration among the internal components and the external and internal data processing functions.

The communication interface 130 enables communication of control signals and data signals with the display device 200 under the control of the controller 110. The communication interface 130 may include at least one of a WiFi chip 131, a bluetooth module 132, an NFC module 133, and other near field communication modules.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, keys 144, and other input interfaces.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input-output interface 140. The control device 100 is provided with a communication interface 130 such as: the WiFi, bluetooth, NFC, etc. modules may send the user input instruction to the display device 200 through a WiFi protocol, or a bluetooth protocol, or an NFC protocol code.

A memory 190 for storing various operation programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 may store various control signal instructions input by a user.

A power supply 180 for providing operating power support for the various elements of the control device 100 under the control of the controller.

Fig. 4 is a schematic software configuration diagram of the display device in fig. 1 according to some embodiments of the present application, and in some embodiments, the system of the display device 200 may be divided into three layers, namely, an application layer, a middleware layer, and a hardware layer from top to bottom.

The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5 APPs; a native application (NATIVE APPS);

The application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, etc., and the interface for the use of these functions (toolbar, status column, menu, dialog box).

The native application (NATIVEAPPS) may support online or offline, message pushing, or local resource access.

The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In some embodiments, the external device interface 240 may also include an audio input interface, which may be coupled with an audio acquisition device, such as an external microphone, or other acquisition device that may collect audio data.

In some embodiments, based on the Internet application technology, the display device 200 may further have an open operating system and a chip, and have an open application platform, so as to implement a bidirectional man-machine interaction function. Taking the display device 200 as an example of intelligent electricity, the display device 200 can be a television product integrating multiple functions of video, entertainment, data and the like, and is used for meeting the needs of diversification and individuation of users.

When the display device 200 is in the activated state, the display 260 displays a user interface, which is a media interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of a user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a graphically displayed user interface that is related to computer operations. It may be an interface element such as an icon, window, control, etc., displayed in the display screen of the display device 200, where the control may include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.

The user may activate a control through the control device 100 to control the display device 200 to run a corresponding application program, for example, the user may click a video player icon in the user interface with a touch function to control the display device 200 to run a video play program to control the display 260 to play media data.

The media asset video has a certain audience rating, and before the media asset video is played by the display device 200 or in the process of playing the media asset video, the advertising video can be inserted so as to promote the popularization effect of the advertising product. However, in order to avoid leakage of the playing source of the asset video, a specific encryption algorithm needs to be used to perform encryption encoding on the asset data corresponding to the asset video, so that the asset video is an encrypted streaming video, and when the display device 200 plays the asset video, it needs to use a key to perform decoding on the asset data, and then control the display 260 to display the asset picture. In order to facilitate the transmission, the advertisement video does not need to be encrypted, so the advertisement video is a clear stream video.

When switching play between the media asset video and the advertisement video, the two videos are not the same play source, so that the client of the video platform may shield other play source videos except the media asset video, namely, shield the advertisement video. For this reason, the display apparatus 200 may insert the advertisement video into the media video through SSAI technology to merge the two-end video sources into the same video source, but when the display apparatus 200 switches the playback in the video of different encryption types, the playback is abnormal due to incompatibility of the decoding types.

In order to solve the problem that the display device displays abnormal playback when switching video streams of different encryption types, some embodiments of the present application provide a display device 200, where the display device 200 includes a display 260, a first decoder, a second decoder, a communicator 220, and a controller 250, where the display 260 is used to display a media asset picture, and the media asset picture may be decoded from media asset data, and in this embodiment, the media asset data may be a movie picture, a variety program picture, a music video tape picture, or an advertisement picture.

The display device 200 may be configured to switch playing of media data of different encryption types, in order to reduce a switching duration of switching the media data, the display device 200 may control the first decoder to perform decoding on the media data in a first decoding manner, or control the second decoder to perform decoding on the media data in a second decoding manner, where the first decoding manner is different from the second decoding manner, for example, the video data played by the display device 200 includes the first media data and the second media data, where the first media data performs encoding in the first encryption manner and the second media data performs encoding in the second encryption manner, at which time the display device 200 may control the first encoder to perform decoding on the first media data and control the second decoder to perform decoding on the second media data.

In some embodiments, the first decoding mode and the second decoding mode may also be the same, for example, the first media asset data and the second media asset data may each be encoded using the same encryption mode, where the first decoder and the second decoder may each perform decoding on the first media asset data or the second media asset data. The first decoder and the second decoder need to keep a one-to-one corresponding decoding relation with the first media data and the second media data, so that one decoder can decode one media data, and decoding efficiency is improved.

It should be noted that the amount of the media data in which the display device 200 performs the decryption operation at the same time is determined by the number of decoders, that is, one decoder can perform the decoding operation on one type of media data. The present embodiment only exemplifies that the decoding operation is performed on two different pieces of media data at the same time, and in practical application of the display apparatus 200, the decoding operation may be performed on one or more pieces of media data at the same time according to the number of decoders of the display apparatus 200, for example, when the display apparatus 200 includes three decoders, the display apparatus 200 may perform decoding on three different pieces of media data at the same time and switch the playback, and the number of decoders in the display apparatus 200 is not particularly limited.

Before the display device 200 plays the media data, a communication connection can be established between the communicator 220 and the server 400, and the media video is requested to the server 400 through the internet, and then the media picture corresponding to the media video is displayed through the display 260, so that the storage space of the display device is saved.

The controller 250 is configured to perform a media data display switching method to decode media data of different encryption types through different decoders to improve video playing efficiency when switching playing media data. Fig. 5 is a flowchart of a display device performing media data display switching in an embodiment of the present application. Referring to fig. 5, the method includes:

S100: and responding to the playing instruction input by the user, controlling the first decoder to decode the first media data in a first decoding mode, and caching the second media data.

The user may generate a play instruction through the control device 100, the control device 100 may move a focus option in the user interface through a direction key, when the focus option moves to the video player icon, the user may click a "ok" key to control the display device 200 to run a video play program and control the display 260 to display a video play interface, the user may click a play option in the video play interface through the control device 100 to generate a play instruction, and the controller 250 decodes the media asset video through the decoder in response to the play instruction.

It should be noted that the above is only an example of a manner of generating the play command, and the user may also click the play options in the video play interface through the touch function of the display device 200 and the external control device of the display device 200, such as a mouse, a keyboard, etc., to generate the play command. The mode of generating the play instruction is not particularly limited in the embodiment of the application.

When the display device 200 switches between two different media data, the display device 200 may first control the display 260 to display a media picture corresponding to one of the media data. For convenience of description, the present embodiment defines two kinds of media data as first media data and second media data, respectively.

Taking the first media asset data as feature data and the second media asset data as advertisement data as examples, wherein the feature data is video data for playing media asset content, for example, television data, movie data, broadcast data, etc., and the advertisement data is video data other than the media asset content, for example, promotion video of a certain product, public service advertisement video, etc. The controller 250 may first request advertisement data and feature data from the server 400 to perform decoding of the media asset data through the decoder in advance before responding to the play instruction. After responding to the play command, the controller 250 can directly control the display 260 to display the media data corresponding to the media data, so as to improve the play efficiency.

The embodiment of the application does not limit the playing sequence of the first media asset data and the second media asset data, for example, the display device 200 may play the advertisement video first, and switch to play the feature video after the advertisement video is played, or play the feature video first, and insert the advertisement video in the playing process of the feature video.

Taking the display device 200 to play the first media data first as an example, the controller 250 may control the first decoder to decode the first media data in the first decoding manner in preparation for starting playing the first media data. While the first decoder decodes the first media data, the controller 250 may buffer the second media data to shorten the buffering time of the second media data when switching the first media data and the second media data, thereby improving the fluency of video playing.

In some embodiments, for the second asset data, online playing and offline playing may be included, where online playing is to start the second asset data buffering when the display device 200 is in a state of being connected to the internet, for example, the controller 250 may start buffering advertisement data when the user opens the video player to pick up a movie, and when switching to playing the advertisement data, control the display 260 to display an advertisement screen in a state of being connected to the internet. The offline play is that the display device 200 stores advertisement data, and the display 260 may display an advertisement screen in an offline state after responding to a play instruction.

S200: and controlling the display to display a first media resource picture corresponding to the first media resource data, and detecting a switching instruction sent by the server.

After buffering of the first media data is completed, the controller 250 controls the display 260 to display a first media picture corresponding to the first media data, where the first media data may include a plurality of first media pictures, and the display 260 may display the first media picture frame by frame according to a time sequence of the first media data, for example, taking a case of playing 12 frames per second as an example, after the display 260 displays the first media picture for 1/12 of a second, the display 260 switches to display a next media picture of the current first media picture, so as to realize playing the first media data.

Taking the feature video as an example, the controller 250 may send a switching instruction to the display device 200 when controlling the display 260 to display the feature screen to play the feature video. The switching instruction is used for switching the feature video being played by the display device 200 into the advertisement video, so that the advertisement video is alternately played in the feature video, and the product popularization effect is improved.

It should be noted that, the switching object of the switching instruction is the currently displayed media asset frame of the display 260, for example, when the display 260 displays the first media asset frame, the switching instruction may be used to switch the currently displayed first media asset frame to the second media asset frame. When the display 260 displays the second asset screen, the switching instruction may be used to switch the currently displayed second asset screen to the first asset screen.

In some embodiments, the switching instruction is generated after the display 260 displays the preset time period of the first asset screen, for example, as shown in fig. 6, the server 400 generates and transmits a switching instruction once to the display device 200 every 20 minutes the display 260 displays the feature screen, to control the display device 200 to switch to displaying the advertisement screen. Or the switching instruction may also be generated when the first media data is played to a specific time point, for example, as shown in fig. 7, the total playing duration of the feature data is 56 minutes, and the server 400 may generate the switching instruction when the display 260 displays the feature screen of 20 minutes and the feature screen of 45 minutes.

S300: and responding to the switching instruction, recording the current playing progress of the first media asset data, and replacing the currently displayed first media asset picture by using a second media asset picture.

The controller 250 may switch the first asset picture currently displayed on the display 260 to display a second asset picture decoded by the second decoder in the second decoding manner in response to the switching instruction. After the display 260 finishes displaying the second media asset image, the first media asset image which is not played is continuously displayed. In order to maintain the playback progress of the first media asset data, the controller 250 may record the current playback progress of the first media asset data in response to the switching instruction.

The current playing progress may be the playing progress of the same media asset data, or may be the playing progress of different media asset data, for example, the total playing duration of the feature video is 30 minutes, when the display 260 displays the 15 th minute, the display device 200 receives the switching instruction sent by the server 400, and the controller 250 obtains the current playing progress of the feature video, that is, 15 minutes. For another example, when the playing of the first segment of feature video is finished, the display device 200 receives a switching instruction sent by the server 400 to control the display 260 to switch to display the advertisement picture, and after the display 260 finishes displaying the advertisement picture, the display device 200 plays the second segment of feature video according to a specific sequence, and the controller 250 obtains the current playing progress of the feature video as the initial playing progress of the second segment of feature video.

As shown in fig. 8, after the second asset frame replaces the first asset frame, the controller 250 stops playing the first asset data continuously, and at this time, the first decoder stops decoding the first asset data continuously to maintain the current playing progress of the first asset data. After the display 260 starts displaying the second media asset picture, the second decoder starts decoding the second media asset data to control the display 260 to display the second media asset picture frame by frame according to the time sequence of the second media asset data, so as to improve the play switching efficiency between the first media asset data and the second media asset data.

S400: and after the second media asset picture is displayed, controlling the display to continuously display the first media asset picture according to the current playing progress.

After the display 260 may continue to display the first asset picture according to the current playing progress of the first asset data after the second asset picture is displayed, at this time, the second decoder stops continuing decoding due to the ending display of the second asset picture. The controller 250 controls the first decoder to continue decoding according to the current playing progress of the first media data.

In some embodiments, the first decoder may further decode the first media data continuously during the display of the second media frame, and after the display of the second media frame is finished, the controller 250 may control the display 260 to directly display the decoded first media frame, so as to save the decoding time of the first media frame and improve the smoothness of video switching.

In some embodiments, the display device 200 further includes an audio output interface 270, where the audio output interface 270 is configured to output audio data in the media asset data, so as to synchronously hear the media asset audio corresponding to the media asset screen when the user views the media asset screen through the display 260. The media asset audio may include character speech, background sounds, different environmental sounds set by the user and the like in the media asset data, the audio of the media resource can be one of the above-mentioned audio, and also can be the superposition of various audio, for example, the superposition of the speech of the character speech and the background sound.

In the process that the controller 250 controls the display 260 to display the first media asset picture, the controller 250 may further parse the first audio data of the first media asset data. The first audio data comprises a plurality of first audio frames, and the first audio frames are in one-to-one correspondence with the first media asset pictures so as to realize the sound and picture synchronization effect in the process of playing the first media asset data. For this, the controller 250 controls the audio output interface 270 to synchronously play the first audio frame in the process of controlling the display 260 to display the first media asset picture.

In some embodiments, the first decoder may include a video decoding module and an audio decoding module to simultaneously have a picture decoding manner and an audio decoding manner. In the process that the first decoder decodes the first media data in the first decoding mode, the video decoding module decodes the video data in the first media data, and the audio decoding module decodes the audio data in the first media data. The decoding speed of the video decoding module and the audio decoding module may be the same to ensure the synchronicity of the output of the first audio frame and the first media asset picture. When the decoding speed of a first media frame is different from the decoding speed of a first audio frame, the controller 250 may adjust the decoding speed of the video decoding module or the audio decoding module, for example, the video decoding module needs 0.2ms to decode a first media frame and the audio decoding module needs 0.4ms to decode an audio frame, and the controller 250 may reduce the decoding speed of the video decoding module to 1/2 of the original decoding speed, so that the decoding speeds of the video decoding module and the audio decoding module are the same, and the synchronization of audio and video output is improved.

When the display 260 displays the first media data, the controller 250 needs to continuously push the first media data that is not played, so as to improve the smoothness of playing the first media data. For this purpose, the controller 250 may obtain a pushing progress of the first media asset data, where the pushing progress includes a frame pushing progress and an audio pushing progress, the frame pushing progress is a pushing progress of the first media asset frame obtained after decoding, and the audio pushing progress is a pushing progress of the first audio frame obtained after decoding. In order to improve the synchronization of the audio and video, the picture pushing progress should be synchronized with the audio pushing progress, and when the picture pushing progress is not synchronized with the audio pushing progress, the display device 200 may generate the problem of asynchronous audio and video when playing the first media data.

As shown in fig. 9, if the frame pushing progress leads the audio pushing progress, the display device 200 displays the current first media data frame when playing the first media data, and the audio output interface 270 plays the first audio frame corresponding to the previous frame of the first media data frame, so that the playing progress of the first media data frame is faster than that of the first audio frame. At this time, the controller 250 may calculate the first progress difference according to the frame pushing progress and the audio pushing progress, for example, the frame pushing progress leads the audio pushing progress by two frames, that is, the first media resource frame currently displayed by the display 260 corresponds to the first audio frame after two frames, and the first progress difference between the frame pushing progress and the audio pushing progress is two frames. The controller 250 may control the display 260 to delay two frames of displaying the first media asset picture according to the first progress difference, so that the first audio frame corresponding to the first media asset picture is synchronously output through the audio output interface 270 while the first media asset picture is displayed.

As shown in fig. 10, if the audio pushing progress is ahead of the frame pushing progress, the display device 200 displays the current first media data frame when playing the first media data, and the audio output interface 270 plays the first audio frame corresponding to the next frame of the first media data frame, so that the playing progress of the first media data frame is slower than the playing progress of the first audio frame. At this time, the controller 250 may calculate the second pushing difference according to the audio pushing progress and the picture pushing progress, for example, the audio pushing progress leads the picture pushing progress by two frames, that is, the first audio frame played by the audio output interface 270 corresponds to the first media picture after two frames, and the second pushing difference of the audio pushing progress and the picture pushing progress is two frames. The controller 250 may control the audio output interface 270 to delay two frames to play the first audio frame according to the second progress difference, so that the display 260 synchronously displays the first media frames corresponding to the first audio frame while the audio output interface 270 plays the first audio frame, thereby improving the synchronization of audio and video.

It should be noted that, in the process of switching and playing the first media data and the second media data by the controller 250, the audio-video synchronicity of the second media data may also be adjusted by obtaining the pushing progress of the second media data, so as to maintain the audio-video synchronicity of playing the media data when switching and playing. The embodiment can execute delay operations on the data with the push progress relatively leading in various delay modes, for example, delay programs, a progress balancing module and the like, and adjust the synchronicity of the picture push progress and the audio push progress.

In some embodiments, before the controller 250 responds to the switching instruction, the pushing progress of the second media asset data may be obtained, when the frame pushing progress of the second media asset data is synchronous with the audio pushing progress, it is indicated that the audio data and the video data of the second media asset data are in a synchronous playing state, at this time, the controller 250 may replace the currently displayed first media asset frame with the second media asset frame, and replace the first audio frame corresponding to the first media asset frame with the second audio frame corresponding to the second media asset frame, so that the display 260 displays the second media asset frame, and the audio output interface 270 plays the second audio frame corresponding to the second media asset frame, to realize that the second media asset data replace the first media asset data. Meanwhile, the first media data is stopped after being replaced, and the controller 250 may switch the operation state of the first decoder from the operation state to the stop state, and switch the operation state of the second decoder from the stop state to the operation state.

When the picture pushing progress of the second media asset data is not synchronized with the audio pushing progress, the controller 250 may calculate a progress difference according to the picture pushing progress of the second media asset data and the audio pushing progress of the second media asset data, thereby delaying the media asset data whose pushing progress is relatively leading according to the progress difference.

In some embodiments, when the display device 200 plays the first media asset data or plays the second media asset data, the controller 250 switches the media asset frames in the media asset data according to the frame display duration to display the dynamic playing effect. Taking the first media data as an example, when there is a damaged first media picture in the first media data, the display 260 cannot display the damaged first media picture, which causes the display 260 to display the first media picture of the previous frame of the damaged media picture, and cannot switch to the first media picture of the next frame, so as to affect the playing progress of the first media data.

For this purpose, the controller 250 may acquire a first screen switching duration when controlling the display 260 to switch the first media screen, where the first screen switching duration is a duration of switching the currently displayed first media screen to the first media screen displayed in the next frame. In order to accurately determine the validity of the first media asset picture of the next frame, as shown in fig. 11, the controller 250 may set a timeout waiting threshold, where the timeout waiting threshold may be a maximum decoding duration for the first decoder to decode the first media asset data in the first decoding manner, or a maximum pushing duration for the controller 250 to push the first media asset data.

When the first frame switching duration is less than or equal to the timeout waiting threshold, the controller 250 may determine that the next frame of the first asset frame is a normal asset frame, and the display 260 may be controlled to continue displaying the next frame of the first asset frame. When the first frame switching time is longer than the timeout waiting threshold, the controller 250 may determine that the next frame of the first media asset frame is a damaged media asset frame, and the controller 250 may control the display 260 to skip the frame to display the first media asset frame so as to display the next frame of the first media asset frame of the damaged media asset frame, thereby improving the playing smoothness of the first media asset data.

In some embodiments, after the second media data is played, the controller 250 may control the display 260 to continue to display the first media frame corresponding to the first media data with the current display progress. When the media data pushed by the controller 250 is switched from the second media data to the first media data, the display 260 is indicated to be about to finish displaying the second media picture, and the first media picture is continuously displayed. The controller 250 may generate an end play command for instructing the display 260 to end playing the second media asset picture. The controller 250 may control the display 260 to stop displaying the second asset screen in response to the end play instruction.

However, when the second media data frame is not displayed, stopping displaying the second media data frame in advance may cause frame loss when switching the display of the first media data frame, resulting in incontinuous progress of the first media data before and after the second media data frame. For this reason, in response to the end of the play command, the controller 250 may obtain the play progress of the second media asset data, and when the play of the second media asset data is ended, the controller 250 generates play end information, and according to the play end information, controls the display 260 to continue displaying the first media asset picture at the current play progress, so as to alleviate the frame loss problem and improve the play consistency.

In some embodiments, when there is a damaged media asset frame in the second media asset data, the display 260 ends playing the remaining second media asset frame for too long, which affects the playing progress. For this, as shown in fig. 12, the controller 250 may record the end play duration with a point of time at which the end play command is generated as a start point and a point of time at which the display 260 stops playing the second media asset screen as an end point in response to the end play command. For example, when controller 250 generates an end play instruction at 08:00:00, at 08: and (5) stopping displaying the second media asset picture at the position of 00:05, and ending the playing time for 5s. In order to improve the smoothness of switching between different media data, the controller 250 may determine the timeout condition of the ending play duration by setting an ending duration threshold, and when the ending play duration is less than or equal to the ending duration threshold, it indicates that the ending play duration is not timeout, and no damaged media picture exists in the second media data. When the end play time is longer than the end time threshold, which indicates that the end play time is over, the second media asset data has a damaged media asset picture, which results in the end play time being over, and the controller 250 may control the display 260 to directly switch and display the first media asset picture.

In some embodiments, the first asset data and the second asset data may be of different encryption encoding types or may be of the same encryption encoding type. Taking the first decoder decoding the first asset data as an example, the controller 250 analyzes the first asset data to obtain a data type of the first asset data, where the data type includes encrypted stream data and clear stream data.

The encrypted stream data is a video data stream of the encrypted data, decryption decoding is needed to be performed on the encrypted stream data through a first decoder, the clear stream data is a video data stream which is not processed or processed, and the data content can be directly decoded through the first decoder. If the first asset data is encrypted stream data, the controller 250 may request decryption key information corresponding to the encrypted stream data from the server 400, where the decryption key information is used to decrypt an encryption algorithm of the encrypted stream data, so as to decode the decrypted first asset data by the first decoder, thereby obtaining a first asset picture. If the first media data is clear stream data, the first decoder can directly decode the first media data without decoding the clear stream data to obtain a first media picture.

Illustratively, the feature data may be encrypted stream data, the advertisement data may be clear stream data, and the first decoder may perform decoding on the feature data and display the feature picture by decrypting the key information when the controller 250 controls the display 260 to display the feature data. When the feature data is switched to the advertisement data, the first decoder stops decrypting the decoded feature data, the second decoder starts decoding the advertisement data, and the second decoder can directly decode and display the advertisement picture since the advertisement data is not encrypted.

In some embodiments, when requesting the media asset data from the server 400, the controller 250 may acquire a URL link corresponding to the media asset data fed back by the server 400, where the URL link may include a first URL link and a second URL link, and the controller 250 may acquire the first media asset data by loading the first URL link and acquire the second media asset data according to loading the second URL link. Depending on the number of media asset data, a plurality of URL links may be included, for example, when the display apparatus 200 needs to continuously play a plurality of advertisement videos, the server 400 may feed back a plurality of second URL links to the display apparatus 200 to enable loading of a plurality of advertisement videos.

The application also provides a media data display switching method, which comprises the following steps:

The switching instruction is generated after a preset duration of the first media resource picture is displayed.

And the second media asset picture is obtained by decoding the second media asset data in a second decoding mode through the second decoder.

It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, in essence or contributing to the prior art.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; the foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. The illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the present disclosure and to enable others skilled in the art to best utilize the embodiments.

Claims

1. A display device, characterized by comprising:

A display configured to display a media asset screen;

A first decoder configured to perform decoding on the media asset data in a first decoding manner;

A second decoder configured to perform decoding on the media data in a second decoding manner, the first decoding manner being different from the second decoding manner;

a communicator configured to establish a communication connection with a server;

A controller configured to:

2. The display device of claim 1, further comprising an audio output interface configured to play audio data in the media data; the controller is used for executing and controlling the display to display a first media resource picture corresponding to the first media resource data, and is configured to:

3. The display device of claim 2, wherein the controller executing controls the display to display a first asset screen corresponding to the first asset data is further configured to:

4. The display device of claim 3, wherein the controller executing control of the display to display a first asset screen corresponding to the first asset data is configured to:

5. The display device of claim 3, wherein the controller, before executing the replacement of the currently displayed first asset screen with the second asset screen, is further configured to:

6. The display device of claim 1, wherein the controller is further configured to:

7. The display device of claim 6, wherein the controller is further configured to:

8. The display device of claim 1, wherein the controller executing control of the first decoder to decode first media data in a first decoding manner is configured to:

9. The display device of claim 1, wherein the controller is further configured to:

10. A media data display switching method, applied to the display device of any one of claims 1 to 9, the display device comprising a display, a first decoder, a second decoder, a communicator, and a controller, wherein the display is configured to display a media picture; the first decoder is configured to perform decoding on the media asset data in a first decoding manner; the second decoder is configured to perform decoding on the media asset data according to a second decoding manner, the first decoding manner being different from the second decoding manner; the communicator is configured to establish a communication connection with a server; the method comprises the following steps: