CN113923530A - Interactive information display method and device, electronic equipment and storage medium - Google Patents
Interactive information display method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113923530A CN113923530A CN202111211077.XA CN202111211077A CN113923530A CN 113923530 A CN113923530 A CN 113923530A CN 202111211077 A CN202111211077 A CN 202111211077A CN 113923530 A CN113923530 A CN 113923530A
- Authority
- CN
- China
- Prior art keywords
- target
- interactive information
- video data
- video
- playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 225
- 238000000034 method Methods 0.000 title claims abstract description 85
- 230000003993 interaction Effects 0.000 claims abstract description 49
- 230000000153 supplemental effect Effects 0.000 claims abstract description 40
- 230000008569 process Effects 0.000 abstract description 29
- 238000010586 diagram Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 10
- 238000004590 computer program Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000009877 rendering Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000000694 effects Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the disclosure discloses an interactive information display method, an interactive information display device, electronic equipment and a storage medium, wherein the method applied to a cloud director server comprises the following steps: writing supplementary enhancement information into the target video data to be relayed according to a preset time interval, and forwarding the target video data to be relayed to a target client for video playing, wherein the supplementary enhancement information comprises the playing time of a first frame video image in the target video data to be relayed in which the supplementary enhancement information is written; and sending an interactive information display instruction to the target client, so that the client determines a target video frame for displaying the target interactive information according to the interactive information display instruction, the supplemental enhancement information and the video playing frame rate, and displaying the target interactive information when the target video frame is played. According to the technical scheme of the embodiment of the disclosure, the interactive information can be inserted and displayed in real time in the process of broadcasting the rebroadcast video, and the interaction sense and the participation sense of the user and the video content are enhanced.
Description
Technical Field
The embodiment of the disclosure relates to the field of live broadcast technologies, and in particular, to an interactive information display method and apparatus, an electronic device, and a storage medium.
Background
At present, in a video playing application client, a television program of a television station can be synchronously rebroadcast. Therefore, the user can watch the video content synchronized with the television station through the video playing application client. However, the user can only express the experience of watching the video and the evaluation of the video content through the message leaving window of the video playing interface, and the experience of the user on the participation and the interaction of the program is poor. Meanwhile, the program producer of the television station cannot timely and effectively collect and count the post-viewing feedback of the program by the audience. Therefore, the interactivity of the user with the video content is to be enhanced.
Disclosure of Invention
The embodiment of the disclosure provides an interactive information display method and device, electronic equipment and a storage medium, which can insert and display interactive information in real time in the process of broadcasting a rebroadcast video, and enhance the interactive sense and the participation sense of a user and video content.
In a first aspect, an embodiment of the present disclosure provides an interactive information display method, which is applied to a cloud director server, and the method includes:
writing supplementary enhancement information into target video data to be relayed according to a preset time interval, and forwarding the target video data to be relayed to a target client side for video playing, wherein the supplementary enhancement information comprises playing time of a first frame video image in the target video data to be relayed in which the supplementary enhancement information is written;
and sending an interactive information display instruction to the target client, so that the client determines a target video frame for displaying the target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displaying the target interactive information when the target video frame is played.
In a second aspect, an embodiment of the present disclosure provides an interactive information display method, which is applied to a client, and the method includes:
receiving and playing video data to be played forwarded by a cloud program director server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
when an interactive information display instruction issued by the cloud director server is received, determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate;
and when the target video frame is played, displaying the target interaction information.
In a third aspect, an embodiment of the present disclosure further provides an interactive information display device, configured at a cloud director server, where the interactive information display device includes:
the video data forwarding module is used for writing supplementary enhancement information into target video data to be relayed according to a preset time interval and forwarding the target video data to be relayed to a target client side for video playing, wherein the supplementary enhancement information comprises playing time of a first frame video image in the target video data to be relayed, in which the supplementary enhancement information is written;
and the interactive information display control module is used for sending an interactive information display instruction to the target client so that the client determines a target video frame for displaying the target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displays the target interactive information when the target video frame is played.
In a fourth aspect, an embodiment of the present disclosure further provides an interactive information display device, configured at a client, where the interactive information display device includes:
the video data receiving module is used for receiving and playing video data to be played, which are forwarded by the cloud director server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
the interactive video frame determining module is used for determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate when receiving an interactive information display instruction issued by the cloud director server;
and the interactive information display module is used for displaying the target interactive information when the target video frame is played.
In a fifth aspect, an embodiment of the present disclosure further provides an electronic device, where the electronic device includes:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the interactive information display method applied to the cloud director server or the client according to any one of the embodiments of the present disclosure.
In a sixth aspect, the present disclosure further provides a storage medium containing computer-executable instructions, where the computer-executable instructions are executed by a computer processor to perform the method for displaying interactive information applied to a cloud director server or a client according to any one of the embodiments of the present disclosure.
In the technical scheme of the embodiment of the disclosure, in the process of forwarding the target video data to be rebroadcast to the client by the cloud broadcasting guide server, writing supplementary enhancement information in the target video data to be rebroadcast according to a preset time interval, wherein, the supplemental enhancement information comprises the playing time of the first frame video image in a group of video data packets in which the supplemental enhancement information is written, so that the target client receives the target video data to be relayed to realize video relay, and simultaneously, in the process of forwarding the target video data to be relayed to the client, sending an interactive information display instruction to the target client, so that the client determines the target video frame for displaying the target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and when the target video frame is played, the target interaction information is displayed, so that a real-time interaction channel between the client user and the rebroadcast video is established. The technical scheme of the embodiment of the disclosure solves the problems that in the prior art, a program party cannot timely obtain feedback of audiences to program content, and interactivity of the audiences in the process of watching the program video is poor, realizes real-time insertion and display of interactive information at an accurate time point in the process of rebroadcasting video playing, and enhances interactive feeling and participation feeling of users and the video content.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.
Fig. 1 is a schematic flowchart of an interaction information display method applied to a cloud director server according to a first embodiment of the present disclosure;
fig. 2 is a schematic view of a video relay provided in an embodiment of the present disclosure;
fig. 3 is a schematic flowchart illustrating an interactive information displaying method applied to a client according to a second embodiment of the disclosure;
fig. 4 is a schematic diagram illustrating an interactive information display according to a second embodiment of the disclosure;
fig. 5 is a schematic structural diagram of an interactive information display device configured at a cloud director server according to a third embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of an interactive information display device configured at a client according to a fourth embodiment of the disclosure;
fig. 7 is a schematic structural diagram of an electronic device according to a fifth embodiment of the disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.
Example one
Fig. 1 is a schematic flow chart of an interactive information display method applied to a cloud director server according to a first embodiment of the present disclosure, where the first embodiment of the present disclosure is applicable to a situation where real-time interactive information is inserted and displayed in a video relay process of a program in a television station. The method can be executed by an interactive information display device configured in the cloud director service terminal, the interactive information display device can be implemented in the form of software and/or hardware, and the interactive information display device can be configured in electronic equipment, such as server equipment.
As shown in fig. 1, the interactive information display method applied to the cloud director server provided in this embodiment includes:
and S110, writing the supplementary enhancement information into the target video data to be relayed according to a preset time interval, and forwarding the target video data to be relayed to a target client for video playing.
Specifically, in some video playing applications, a program video of a television station can be rebroadcast, so that a user can watch the program video which is played synchronously with the television station through a video playing application client. In this embodiment, the cloud director service end relays (distributes) video data of a television station, that is, target video data to be relayed, to a target client of a video playing application that views the target video data to be relayed. After the target client receives the target video data to be relayed, the target client can decode the video data to obtain a frame-by-frame image after reduction, and then play the video. Fig. 2 is a schematic view of video data relay, where image content obtained after a client receives video data and performs data decoding is the same as original data content of video data encoded and forwarded by a cloud director server.
Supplemental Enhancement Information (SEI), Information belonging to the category of codestreams, provides a method for adding additional Information to encoded video codestreams. In this embodiment, the additional information provided by the supplemental enhancement information includes the playing time of the first frame of video image of a group of video data packets, i.e. the target video data to be relayed, in which the supplemental enhancement information is written. The first frame of video image in the video data packet can be understood as the first frame of the multi-frame video image obtained after the client side receives the video data packet and decodes the video data packet.
Further, before the cloud broadcasting guide server performs target video data to be broadcasted, the cloud broadcasting guide server first identifies the video data and determines that the video data received from the television station is the target television data to be broadcasted. Generally, a manual switching mode can be adopted, video data to be relayed is monitored through special staff, and when the target video data to be relayed arrives, the forwarded data content is switched to the target video data to be relayed from the video data content such as platform advertisements of the client. In order to avoid the time delay problem and the switching error problem of manual switching, preferably, an artificial intelligent image recognition algorithm is adopted to recognize target video data to be relayed. Specifically, one or more frames of images of a target video to be relayed are stored in advance in the cloud broadcasting service terminal. The method comprises the steps of playing the video data of a program to be rebroadcast at a cloud broadcasting server after the video data of the program to be rebroadcast is received, triggering the cloud broadcasting server to call a preset image recognition algorithm, carrying out image recognition matching on the image of a pre-stored one-frame or multi-frame target video to be rebroadcast and the image of the program to be rebroadcast which is played currently, determining the received video data to be rebroadcast as the target video data to be rebroadcast when the matching is successful, and automatically distributing the received video data to be rebroadcast to a target client as the target video data to be rebroadcast. By the method, the video data can be accurately forwarded from the beginning, and the target client plays the target video to be relayed from the beginning without causing delay or mismatching of subsequent interactive display information.
When writing the supplemental enhancement information in the forwarded target video data packet to be relayed, it may be that, when it is determined that the received video data to be relayed is the target video data to be relayed, the first supplemental enhancement information is written in the forwarded data packet of the first target video data to be relayed, where the first supplemental enhancement information is an initial time for forwarding the target video data to be relayed. And then, after the first supplemental enhancement information is written, inserting the corresponding supplemental enhancement information into the target video data to be relayed which is continuously forwarded according to a preset time interval. The preset time interval can be set according to the requirement, the length of the time interval can be time data in the millisecond, second or minute level, and the time interval can be set individually according to the actual data sending condition.
It can be understood that the playing time of the first frame of video image in a group of video data packets written with the supplemental enhancement information in the supplemental enhancement information is an absolute time, for example, when the target video data to be retransmitted starts to be played at eight pm, the playing time of the first supplemental enhancement information is eight pm, SEI is inserted into the retransmitted video stream at a time interval of 2 seconds, the playing time of the second SEI is zero two seconds at eight pm, and so on.
S120, sending an interactive information display instruction to the target client, so that the client determines a target video frame for displaying the target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displaying the target interactive information when the target video frame is played.
According to the interaction requirement of the target video to be rebroadcast, the cloud director server side can send an interaction information display instruction to the client side in advance. The interactive information display instruction comprises the content of the interactive information and the time for displaying the interactive information. In addition, rendering scheme new information of the interactive information display can be included. For example, when the target video to be relayed is played for the 20 th minute 06 second, a viewpoint output exists in the played video content, and when the target video to be relayed is played to the position, the interactive information can be displayed to ask whether the audience supports the viewpoint output in the video content. Alternatively, when the video is played for 53 seconds at 10 minutes, a climax of the episode of the television series may appear, and the viewer may be asked to score the actors playing the climax content.
Then, after the client receives the interactive information display instruction, the playing time of each frame of video image is determined according to the SEI and the video playing frame rate in the target video data to be rebroadcast, then the target video frame for displaying the interactive information is determined based on the time for displaying the interactive information specified in the interactive information display instruction, and when the target video frame is played, the content of the interactive information specified in the interactive information display instruction is displayed.
Further, if the audience participates in the interaction of the interactive information through the target client and generates the interactive feedback information, the cloud director service end can also receive the interactive feedback result of the target client and the interactive information so as to perform statistical analysis on the feedback result subsequently.
The technical scheme of the embodiment of the disclosure includes identifying a target video to be rebroadcast through an image recognition algorithm, writing supplementary enhancement information into the target video data to be rebroadcast according to a preset time interval in the process of forwarding the target video data to be rebroadcast to a client, wherein the supplementary enhancement information comprises the playing time of a first frame video image in a group of video data packets in which the supplementary enhancement information is written, enabling the target client to receive the target video data to be rebroadcast to realize video rebroadcast, simultaneously, sending an interaction information display instruction to the target client in the process of forwarding the target video data to be rebroadcast to the client, enabling the client to determine a target video frame displaying the target interaction information according to the interaction information display instruction, the supplementary enhancement information and a video playing frame rate, and displaying the target interaction information when the target video frame is played, therefore, a real-time interaction channel between the client user and the rebroadcast video is established. The technical scheme of the embodiment of the disclosure solves the problems that in the prior art, a program party cannot timely obtain feedback of the audience to the program content, and interactivity of the audience in the process of watching the program video is poor, and realizes that target video data to be rebroadcast can be accurately retransmitted in the process of rebroadcast video playing, interactive information can be inserted and displayed in real time at an accurate time point, and interaction feeling and participation feeling between a user and the video content are enhanced.
Example two
The embodiment of the disclosure and the interactive information display method applied to the cloud director server provided in the embodiment belong to the same inventive concept. The method for displaying interactive information applied to the client further describes a process of displaying interactive information by the video playing application client in a process of playing a rebroadcast video synchronized with a television station. The method can be executed by an interactive information display device configured in the client, the interactive information display device can be realized in the form of software and/or hardware, and the interactive information display device can be configured in electronic equipment or server equipment.
Fig. 3 is a flowchart illustrating an interactive information displaying method applied to a client according to a second embodiment of the disclosure. As shown in fig. 3, the interactive information display method provided in this embodiment includes:
s210, receiving and playing the video data to be played, which is forwarded by the cloud director server.
In this embodiment, the client may be an application platform for playing video, and the user may watch the program video played synchronously with the television station through the client. After the user selects the program video to be watched at the client, the client requests the video data to be played from the cloud broadcasting guide server, namely the target video data to be broadcasted forwarded by the cloud broadcasting guide server. After the client receives the video data to be played, the video data is decoded and played.
The part of video data to be played is written with supplementary enhancement information containing video frame playing time. The supplemental enhancement information is extra information added into the coded video data packet when the cloud director server forwards the video data to be played. The video frame playing time refers to the playing time of the first frame video image in a group of video data packets in which the supplemental enhancement information is written. The first frame of video image can be understood as the first frame of the multi-frame video image obtained by decoding the video data packet after the client receives the video data packet.
And S220, when an interactive information display instruction issued by the cloud director server is received, determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate.
The interactive information display instruction comprises the content of the interactive information and the time for displaying the interactive information. After the time for displaying the interactive information is determined, the client needs to determine the target video frame played at the time for displaying the interactive information, so as to render the interactive information before displaying the interactive information, so that the interactive information is matched with the content of the target video frame.
Specifically, the process of determining the target video frame is to determine the playing time difference between two corresponding video frames according to the playing time of each two adjacent video frames of the supplemental enhancement information. Equivalently, the playing time of two video frames and the playing time difference between the two video frames can be determined according to the two supplemental enhancement information. Furthermore, in combination with the video playing frame rate, the playing time corresponding to each video frame between two video frames of which the determined playing time is known can be determined. And the video frame with the playing time same as the display time of the target interactive information specified in the interactive information display instruction is the target video frame.
And S230, when the target video frame is played, displaying the target interaction information.
Specifically, the target interaction information may be an interaction component, and the user may perform interaction feedback by triggering the corresponding component. The interactive component comprises a content selection button or a scoring menu. For example, fig. 4 is a schematic diagram illustrating an interactive information display. In fig. 4, the area enclosed by the dotted line is an interactive information display area, and "xxxxxxxxxx" in the area represents the text content of the interactive information, such as "whether to support the transaction of the person a in the video at event B", and the user can trigger the corresponding "support" or "objection" button to express the view as the interactive feedback information. Correspondingly, the client side can also upload the feedback information to the cloud director server side. In addition, the pentagram shape is used for representing the rendering effect of the display information, and can be a feasible rendering mode such as adding a sticker to the interactive information or dynamically displaying the interactive information.
According to the technical scheme of the embodiment, in the process of receiving and playing video data to be played, which are sent by a cloud director server, when an interactive information display instruction sent by the cloud director server is received, a target video frame for displaying target interactive information is determined according to the interactive information display instruction, supplementary enhancement information in the video data to be played and a video playing frame rate; and when the target video frame is played, the target interaction information is displayed, so that a real-time interaction channel between the client user and the rebroadcast video is established. The technical scheme of the embodiment of the disclosure solves the problems that in the prior art, a program party cannot timely obtain feedback of the audience to the program content, and interactivity of the audience in the process of watching the program video is poor, and realizes that target video data to be rebroadcast can be accurately retransmitted in the process of rebroadcast video playing, interactive information can be inserted and displayed in real time at an accurate time point, and interaction feeling and participation feeling between a user and the video content are enhanced.
EXAMPLE III
Fig. 5 is a schematic structural diagram of an interactive information display device configured at a cloud director server according to a third embodiment of the present disclosure. The interactive information display device configured at the cloud program guide service end provided by the embodiment is suitable for displaying real-time interactive information in the process of video rebroadcasting of a program of a television station.
As shown in fig. 5, the interactive information display device configured at the cloud director server includes: a video data forwarding module 310 and an interactive information presentation control module 320.
The video data forwarding module 310 is configured to write supplemental enhancement information into target video data to be relayed according to a preset time interval, and forward the target video data to be relayed to a target client for video playing, where the supplemental enhancement information includes playing time of a first frame video image in the target video data to be relayed in which the supplemental enhancement information is written; the interactive information display control module 320 is configured to send an interactive information display instruction to the target client, so that the client determines a target video frame displaying the target interactive information according to the interactive information display instruction, the supplemental enhancement information, and the video play frame rate, and displays the target interactive information when the target video frame is played.
In the technical scheme of the embodiment of the disclosure, in the process of forwarding the target video data to be rebroadcast to the client by the cloud broadcasting guide server, writing supplementary enhancement information in the target video data to be rebroadcast according to a preset time interval, wherein, the supplemental enhancement information comprises the playing time of the first frame video image in a group of video data packets in which the supplemental enhancement information is written, so that the target client receives the target video data to be relayed to realize video relay, and simultaneously, in the process of forwarding the target video data to be relayed to the client, sending an interactive information display instruction to the target client, so that the client determines the target video frame for displaying the target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and when the target video frame is played, the target interaction information is displayed, so that a real-time interaction channel between the client user and the rebroadcast video is established. The technical scheme of the embodiment of the disclosure solves the problems that in the prior art, a program party cannot timely obtain feedback of audiences to program content, and interactivity of the audiences in the process of watching the program video is poor, realizes real-time insertion and display of interactive information at an accurate time point in the process of rebroadcasting video playing, and enhances interactive feeling and participation feeling of users and the video content.
In some optional implementation manners, the interactive information display device configured at the cloud director server further includes a video data identification module, configured to perform image matching on a first frame image of received video data to be relayed and a pre-stored image of the target video data to be relayed before writing supplementary enhancement information into the target video data to be relayed according to a preset time interval; and when the image matching is successful, determining the received video data to be relayed as target video data to be relayed.
In some optional implementations, the video data forwarding module 310 is further configured to:
when the received video data to be rebroadcast is determined to be the target video data to be rebroadcast, writing first supplementary enhancement information into a data packet of the forwarded first target video data to be rebroadcast, wherein the first supplementary enhancement information is the initial moment of forwarding the target video data to be rebroadcast;
and after the first supplemental enhancement information is written, inserting corresponding supplemental enhancement information into the continuously forwarded target video data to be relayed according to a preset time interval.
In some optional implementation manners, the interactive information display device configured at the cloud director server further includes an interactive feedback information collection module, configured to:
and receiving an interaction feedback result of the target client and the interaction information.
The interactive information display device configured at the cloud director server provided by the embodiment of the disclosure can execute the interactive information display method applied to the cloud director server provided by any embodiment of the disclosure, and has corresponding functional modules and beneficial effects of the execution method.
It should be noted that, the units and modules included in the apparatus are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only used for distinguishing one functional unit from another, and are not used for limiting the protection scope of the embodiments of the present disclosure.
Example four
Fig. 6 is a schematic structural diagram of an interactive information display device configured at a client according to a fourth embodiment of the disclosure. The interactive information display device configured at the client is suitable for a process of displaying interactive information by a video playing application client in a process of playing a rebroadcast video synchronized with a television station.
As shown in fig. 6, the interactive information display device configured at the client includes: a video data receiving module 410, an interactive video frame determining module 420 and an interactive information displaying module 430.
The video data receiving module 410 is configured to receive and play video data to be played, which is forwarded by a cloud director server, where supplemental enhancement information including video frame playing time is written in part of the video data to be played; an interactive video frame determining module 420, configured to determine, when receiving an interactive information display instruction issued by the cloud director server, a target video frame for displaying target interactive information according to the interactive information display instruction, the supplemental enhancement information, and a video play frame rate; and an interactive information display module 430, configured to display the target interactive information when the target video frame is played.
According to the technical scheme of the embodiment, in the process of receiving and playing video data to be played, which are sent by a cloud director server, when an interactive information display instruction sent by the cloud director server is received, a target video frame for displaying target interactive information is determined according to the interactive information display instruction, supplementary enhancement information in the video data to be played and a video playing frame rate; and when the target video frame is played, the target interaction information is displayed, so that a real-time interaction channel between the client user and the rebroadcast video is established. The technical scheme of the embodiment of the disclosure solves the problems that in the prior art, a program party cannot timely obtain feedback of the audience to the program content, and interactivity of the audience in the process of watching the program video is poor, and realizes that target video data to be rebroadcast can be accurately retransmitted in the process of rebroadcast video playing, interactive information can be inserted and displayed in real time at an accurate time point, and interaction feeling and participation feeling between a user and the video content are enhanced.
In some optional implementations, the interactive video frame determination module 420 is specifically configured to:
determining the playing time difference of two corresponding video frames according to the playing time of each two adjacent video frames of the supplementary enhancement information;
determining the number of video frames in the playing time difference and the playing time corresponding to each video frame in the playing time difference based on the video playing frame rate;
and taking the video frame with the playing time same as the display time of the target interactive information specified in the interactive information display instruction as a target video frame.
In some optional implementations, the target interaction information is an interaction component, including a content selection button or a scoring menu.
The interactive information display device configured at the client, provided by the embodiments of the present disclosure, can execute the method applied to the client interactive information display provided by any embodiments of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
It should be noted that, the units and modules included in the apparatus are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only used for distinguishing one functional unit from another, and are not used for limiting the protection scope of the embodiments of the present disclosure.
EXAMPLE five
Referring now to fig. 7, a schematic diagram of an electronic device (e.g., the terminal device or the server in fig. 7) 500 suitable for implementing embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 7, the electronic device 500 may include a processing means (e.g., central processor, graphics processor, etc.) 501 that may perform various appropriate actions and processes in accordance with a program stored in a Read-Only Memory (ROM) 502 or a program loaded from a storage means 506 into a Random Access Memory (RAM) 503. In the RAM503, various programs and data necessary for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM502, and the RAM503 are connected to each other through a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
Generally, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 507 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; storage devices 508 including, for example, magnetic tape, hard disk, etc.; and a communication device 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 7 illustrates an electronic device 500 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or installed from the storage means 506, or installed from the ROM 502. When executed by the processing device 501, the computer program performs the above-mentioned functions defined in the interactive information presentation method applied to the cloud director server or the client according to the embodiment of the present disclosure.
The electronic device provided by the embodiment of the present disclosure and the interactive information display method applied to the cloud director server or the client provided by the embodiment belong to the same public concept, and technical details that are not described in detail in the embodiment can be referred to the embodiment, and the embodiment have the same beneficial effects.
EXAMPLE six
The embodiment of the disclosure provides a computer storage medium, on which a computer program is stored, and when the program is executed by a processor, the method for displaying interaction information applied to a client or a cloud director server is implemented.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read-Only Memory (ROM), an Erasable Programmable Read-Only Memory (EPROM) or FLASH Memory (FLASH), an optical fiber, a portable compact disc Read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to:
writing supplementary enhancement information into target video data to be relayed according to a preset time interval, and forwarding the target video data to be relayed to a target client for video playing, wherein the supplementary enhancement information comprises playing time of the target video data to be relayed in a group of video data packets in which the supplementary enhancement information is written;
and sending an interactive information display instruction to the target client, so that the client determines a target video frame for displaying the target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displaying the target interactive information when the target video frame is played.
The computer readable medium carries one or more programs which, when executed by the electronic device, further cause the electronic device to:
receiving and playing video data to be played forwarded by a cloud program director server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
when an interactive information display instruction issued by the cloud director server is received, determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate;
and when the target video frame is played, displaying the target interaction information.
Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. The names of the units and modules do not limit the units and modules in some cases, and for example, the data generation module may be described as a "video data generation module".
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Part (ASSP), a System On Chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, [ example one ] there is provided an interactive information presentation method applied to a cloud director server, the method including:
writing supplementary enhancement information into target video data to be relayed according to a preset time interval, and forwarding the target video data to be relayed to a target client side for video playing, wherein the supplementary enhancement information comprises playing time of a first frame video image in the target video data to be relayed in which the supplementary enhancement information is written;
and sending an interactive information display instruction to the target client, so that the client determines a target video frame for displaying the target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displaying the target interactive information when the target video frame is played.
According to one or more embodiments of the present disclosure, [ example two ] there is provided an interactive information presentation method applied to a cloud director server, further comprising:
in some optional embodiments, before writing the supplemental enhancement information in the target video data to be retransmitted at preset time intervals, the method further includes:
carrying out image matching on the first frame image of the received video data to be relayed and the image of the target video data to be relayed which is stored in advance;
and when the image matching is successful, determining the received video data to be relayed as target video data to be relayed.
According to one or more embodiments of the present disclosure, [ example three ] there is provided an interactive information presentation method applied to a cloud director server, further comprising:
in some optional implementations, writing the supplemental enhancement information in the target video data to be retransmitted at preset time intervals includes:
when the received video data to be rebroadcast is determined to be the target video data to be rebroadcast, writing first supplementary enhancement information into a data packet of the forwarded first target video data to be rebroadcast, wherein the first supplementary enhancement information is the initial moment of forwarding the target video data to be rebroadcast;
and after the first supplemental enhancement information is written, inserting corresponding supplemental enhancement information into the continuously forwarded target video data to be relayed according to a preset time interval.
According to one or more embodiments of the present disclosure, [ example four ] there is provided an interactive information presentation method applied to a cloud director server, further comprising:
in some alternative implementations of the method of the present invention,
and receiving an interaction feedback result of the target client and the interaction information.
According to one or more embodiments of the present disclosure, [ example five ] there is provided an interactive information presentation method applied to a client, including:
receiving and playing video data to be played forwarded by a cloud program director server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
when an interactive information display instruction issued by the cloud director server is received, determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate;
and when the target video frame is played, displaying the target interaction information.
According to one or more embodiments of the present disclosure, [ example six ] there is provided an interactive information presentation method applied to a client, further comprising:
in some optional implementation manners, the determining, according to the interaction information display instruction, the supplemental enhancement information, and the video play frame rate, a target video frame displaying target interaction information includes:
determining the playing time difference of two corresponding video frames according to the playing time of each two adjacent video frames of the supplementary enhancement information;
determining the number of video frames in the playing time difference and the playing time corresponding to each video frame in the playing time difference based on the video playing frame rate;
and taking the video frame with the playing time same as the display time of the target interactive information specified in the interactive information display instruction as a target video frame.
According to one or more embodiments of the present disclosure, [ example seven ] there is provided an interactive information presentation method applied to a client, further comprising:
in some optional implementations, the target interaction information is an interaction component, including a content selection button or a scoring menu.
According to one or more embodiments of the present disclosure, [ example eight ] there is provided an interactive information presentation apparatus configured at a cloud director server, including:
the video data forwarding module is used for writing supplementary enhancement information into target video data to be relayed according to a preset time interval and forwarding the target video data to be relayed to a target client side for video playing, wherein the supplementary enhancement information comprises playing time of a first frame video image in the target video data to be relayed, in which the supplementary enhancement information is written;
and the interactive information display control module is used for sending an interactive information display instruction to the target client so that the client determines a target video frame for displaying the target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displays the target interactive information when the target video frame is played.
According to one or more embodiments of the present disclosure, [ example nine ] there is provided an interactive information presentation apparatus configured at a cloud director server, further comprising:
in some optional implementation manners, the interactive information display device configured at the cloud director server further includes a video data identification module, configured to perform image matching on a first frame image of received video data to be relayed and a pre-stored image of the target video data to be relayed before writing supplementary enhancement information into the target video data to be relayed according to a preset time interval; and when the image matching is successful, determining the received video data to be relayed as target video data to be relayed.
According to one or more embodiments of the present disclosure, [ example ten ] there is provided an interactive information presentation apparatus configured at a cloud director server, further comprising:
in some optional implementations, the video data forwarding module is further configured to:
when the received video data to be rebroadcast is determined to be the target video data to be rebroadcast, writing first supplementary enhancement information into a data packet of the forwarded first target video data to be rebroadcast, wherein the first supplementary enhancement information is the initial moment of forwarding the target video data to be rebroadcast;
and after the first supplemental enhancement information is written, inserting corresponding supplemental enhancement information into the continuously forwarded target video data to be relayed according to a preset time interval.
According to one or more embodiments of the present disclosure, [ example eleven ] there is provided an interactive information presentation apparatus configured at a cloud director server, further comprising:
in some optional implementation manners, the interactive information display device configured at the cloud director server further includes an interactive feedback information collection module, configured to:
and receiving an interaction feedback result of the target client and the interaction information.
According to one or more embodiments of the present disclosure, [ example twelve ] there is provided an interactive information presentation apparatus configured at a client, including:
the video data receiving module is used for receiving and playing video data to be played, which are forwarded by the cloud director server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
the interactive video frame determining module is used for determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate when receiving an interactive information display instruction issued by the cloud director server;
and the interactive information display module is used for displaying the target interactive information when the target video frame is played.
According to one or more embodiments of the present disclosure, [ example thirteen ] there is provided an interactive information presentation apparatus configured at a client, further comprising:
in some optional implementations, the interactive video frame determination module 420 is specifically configured to:
determining the playing time difference of two corresponding video frames according to the playing time of each two adjacent video frames of the supplementary enhancement information;
determining the number of video frames in the playing time difference and the playing time corresponding to each video frame in the playing time difference based on the video playing frame rate;
and taking the video frame with the playing time same as the display time of the target interactive information specified in the interactive information display instruction as a target video frame.
According to one or more embodiments of the present disclosure, [ example fourteen ] there is provided an interactive information presentation apparatus configured to a client, further comprising:
in some optional implementations, the target interaction information is an interaction component, including a content selection button or a scoring menu.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims (11)
1. An interactive information display method is applied to a cloud director server side and is characterized by comprising the following steps:
writing supplementary enhancement information into target video data to be relayed according to a preset time interval, and forwarding the target video data to be relayed to a target client side for video playing, wherein the supplementary enhancement information comprises playing time of a first frame video image in the target video data to be relayed in which the supplementary enhancement information is written;
and sending an interactive information display instruction to the target client, so that the client determines a target video frame for displaying the target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displaying the target interactive information when the target video frame is played.
2. The method of claim 1, wherein before writing the supplemental enhancement information in the target video data to be relayed at preset time intervals, the method further comprises:
carrying out image matching on the first frame image of the received video data to be relayed and the image of the target video data to be relayed which is stored in advance;
and when the image matching is successful, determining the received video data to be relayed as target video data to be relayed.
3. The method of claim 2, wherein writing supplemental enhancement information in the target video data to be relayed at predetermined time intervals comprises:
when the received video data to be rebroadcast is determined to be the target video data to be rebroadcast, writing first supplementary enhancement information into a data packet of the forwarded first target video data to be rebroadcast, wherein the first supplementary enhancement information is the initial moment of forwarding the target video data to be rebroadcast;
and after the first supplemental enhancement information is written, inserting corresponding supplemental enhancement information into the continuously forwarded target video data to be relayed according to a preset time interval.
4. The method of claim 1, further comprising:
and receiving an interaction feedback result of the target client and the interaction information.
5. An interactive information display method is applied to a client side and is characterized by comprising the following steps:
receiving and playing video data to be played forwarded by a cloud program director server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
when an interactive information display instruction issued by the cloud director server is received, determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate;
and when the target video frame is played, displaying the target interaction information.
6. The method of claim 5, wherein determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplemental enhancement information, and a video frame rate comprises:
determining the playing time difference of two corresponding video frames according to the playing time of each two adjacent video frames of the supplementary enhancement information;
determining the number of video frames in the playing time difference and the playing time corresponding to each video frame in the playing time difference based on the video playing frame rate;
and taking the video frame with the playing time same as the display time of the target interactive information specified in the interactive information display instruction as a target video frame.
7. The method of claim 5 or 6, wherein the target interaction information is an interaction component, and comprises a content selection button or a scoring menu.
8. An interactive information display device configured at a cloud director server, comprising:
the video data forwarding module is used for writing supplementary enhancement information into target video data to be relayed according to a preset time interval and forwarding the target video data to be relayed to a target client side for video playing, wherein the supplementary enhancement information comprises playing time of a first frame video image in the target video data to be relayed, in which the supplementary enhancement information is written;
and the interactive information display control module is used for sending an interactive information display instruction to the target client so that the client determines a target video frame for displaying the target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displays the target interactive information when the target video frame is played.
9. An interactive information display device configured at a client, comprising:
the video data receiving module is used for receiving and playing video data to be played, which are forwarded by the cloud director server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
the interactive video frame determining module is used for determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate when receiving an interactive information display instruction issued by the cloud director server;
and the interactive information display module is used for displaying the target interactive information when the target video frame is played.
10. An electronic device, characterized in that the electronic device comprises:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the interactive information presentation method applied to the cloud director server or the client according to any one of claims 1 to 7.
11. A storage medium containing computer-executable instructions for performing the interactive information presentation method applied to a cloud director server or a client according to any one of claims 1 to 7 when executed by a computer processor.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111211077.XA CN113923530B (en) | 2021-10-18 | 2021-10-18 | Interactive information display method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111211077.XA CN113923530B (en) | 2021-10-18 | 2021-10-18 | Interactive information display method and device, electronic equipment and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113923530A true CN113923530A (en) | 2022-01-11 |
CN113923530B CN113923530B (en) | 2023-12-22 |
Family
ID=79241263
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111211077.XA Active CN113923530B (en) | 2021-10-18 | 2021-10-18 | Interactive information display method and device, electronic equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113923530B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115243063A (en) * | 2022-07-13 | 2022-10-25 | 广州博冠信息科技有限公司 | Video stream processing method, processing device and processing system |
Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100008419A1 (en) * | 2008-07-10 | 2010-01-14 | Apple Inc. | Hierarchical Bi-Directional P Frames |
US20110016172A1 (en) * | 2009-05-27 | 2011-01-20 | Ajay Shah | Synchronized delivery of interactive content |
CN104135671A (en) * | 2014-07-25 | 2014-11-05 | 宁波创视信息技术有限公司 | Television video content interactive question and answer method |
CN104168491A (en) * | 2013-05-17 | 2014-11-26 | 腾讯科技(北京)有限公司 | Information processing method and device in video playing processes |
CN104954879A (en) * | 2015-06-17 | 2015-09-30 | 北京奇艺世纪科技有限公司 | Video interaction content display method and device |
CN105245968A (en) * | 2015-09-30 | 2016-01-13 | 天脉聚源(北京)科技有限公司 | Method and device for dynamically displaying interactive entry information on video program |
CN105451086A (en) * | 2015-09-22 | 2016-03-30 | 合一网络技术(北京)有限公司 | Method and apparatus for realizing video interaction |
CN108234997A (en) * | 2017-12-12 | 2018-06-29 | 北京百度网讯科技有限公司 | Time-delay measuring method, equipment, system and the computer-readable medium of live video |
CN110062270A (en) * | 2019-04-24 | 2019-07-26 | 北京豆萌信息技术有限公司 | Advertisement demonstration method and device |
WO2020103203A1 (en) * | 2018-11-19 | 2020-05-28 | 网宿科技股份有限公司 | Method and apparatus for synchronizing whiteboard with video, computing device, and storage medium |
CN111711859A (en) * | 2020-06-28 | 2020-09-25 | 北京奇艺世纪科技有限公司 | Video image processing method, system and terminal equipment |
CN111836114A (en) * | 2020-07-08 | 2020-10-27 | 北京达佳互联信息技术有限公司 | Video interaction method and device, electronic equipment and storage medium |
CN111932322A (en) * | 2020-09-24 | 2020-11-13 | 腾讯科技(深圳)有限公司 | Advertisement display method, related device, equipment and storage medium |
CN112468822A (en) * | 2020-11-06 | 2021-03-09 | 上海钦文信息科技有限公司 | Multimedia recording and broadcasting course interaction method based on video SEI message |
WO2021047419A1 (en) * | 2019-09-12 | 2021-03-18 | 广州华多网络科技有限公司 | Live broadcast interaction method, live broadcast system, electronic device and storage medium |
CN112911343A (en) * | 2021-01-18 | 2021-06-04 | 北京奇艺世纪科技有限公司 | Multi-channel video playing method and device, electronic equipment and storage medium |
CN112954251A (en) * | 2019-12-10 | 2021-06-11 | RealMe重庆移动通信有限公司 | Video processing method, video processing device, storage medium and electronic equipment |
CN113163222A (en) * | 2021-03-31 | 2021-07-23 | 杭州奥点科技股份有限公司 | Video frame synchronization method, system, equipment and readable storage medium |
CN113507617A (en) * | 2021-06-24 | 2021-10-15 | 广州易方信息科技股份有限公司 | SEI frame playback data synchronization method, system, device and medium based on video stream |
-
2021
- 2021-10-18 CN CN202111211077.XA patent/CN113923530B/en active Active
Patent Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100008419A1 (en) * | 2008-07-10 | 2010-01-14 | Apple Inc. | Hierarchical Bi-Directional P Frames |
US20110016172A1 (en) * | 2009-05-27 | 2011-01-20 | Ajay Shah | Synchronized delivery of interactive content |
CN104168491A (en) * | 2013-05-17 | 2014-11-26 | 腾讯科技(北京)有限公司 | Information processing method and device in video playing processes |
CN104135671A (en) * | 2014-07-25 | 2014-11-05 | 宁波创视信息技术有限公司 | Television video content interactive question and answer method |
CN104954879A (en) * | 2015-06-17 | 2015-09-30 | 北京奇艺世纪科技有限公司 | Video interaction content display method and device |
CN105451086A (en) * | 2015-09-22 | 2016-03-30 | 合一网络技术(北京)有限公司 | Method and apparatus for realizing video interaction |
CN105245968A (en) * | 2015-09-30 | 2016-01-13 | 天脉聚源(北京)科技有限公司 | Method and device for dynamically displaying interactive entry information on video program |
CN108234997A (en) * | 2017-12-12 | 2018-06-29 | 北京百度网讯科技有限公司 | Time-delay measuring method, equipment, system and the computer-readable medium of live video |
WO2020103203A1 (en) * | 2018-11-19 | 2020-05-28 | 网宿科技股份有限公司 | Method and apparatus for synchronizing whiteboard with video, computing device, and storage medium |
CN110062270A (en) * | 2019-04-24 | 2019-07-26 | 北京豆萌信息技术有限公司 | Advertisement demonstration method and device |
WO2021047419A1 (en) * | 2019-09-12 | 2021-03-18 | 广州华多网络科技有限公司 | Live broadcast interaction method, live broadcast system, electronic device and storage medium |
CN112954251A (en) * | 2019-12-10 | 2021-06-11 | RealMe重庆移动通信有限公司 | Video processing method, video processing device, storage medium and electronic equipment |
CN111711859A (en) * | 2020-06-28 | 2020-09-25 | 北京奇艺世纪科技有限公司 | Video image processing method, system and terminal equipment |
CN111836114A (en) * | 2020-07-08 | 2020-10-27 | 北京达佳互联信息技术有限公司 | Video interaction method and device, electronic equipment and storage medium |
CN111932322A (en) * | 2020-09-24 | 2020-11-13 | 腾讯科技(深圳)有限公司 | Advertisement display method, related device, equipment and storage medium |
CN112468822A (en) * | 2020-11-06 | 2021-03-09 | 上海钦文信息科技有限公司 | Multimedia recording and broadcasting course interaction method based on video SEI message |
CN112911343A (en) * | 2021-01-18 | 2021-06-04 | 北京奇艺世纪科技有限公司 | Multi-channel video playing method and device, electronic equipment and storage medium |
CN113163222A (en) * | 2021-03-31 | 2021-07-23 | 杭州奥点科技股份有限公司 | Video frame synchronization method, system, equipment and readable storage medium |
CN113507617A (en) * | 2021-06-24 | 2021-10-15 | 广州易方信息科技股份有限公司 | SEI frame playback data synchronization method, system, device and medium based on video stream |
Non-Patent Citations (2)
Title |
---|
MATHIAS WIEN: "Guest Editorial Immersive Video Coding and Transmission", IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS ( VOLUME: 9, ISSUE: 1, MARCH 2019), pages 1 - 4 * |
周玉宝;刘强;: "基于H264的嵌入式平台实时视频通信***的设计与实现", 微计算机信息, no. 14, pages 1 - 3 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115243063A (en) * | 2022-07-13 | 2022-10-25 | 广州博冠信息科技有限公司 | Video stream processing method, processing device and processing system |
CN115243063B (en) * | 2022-07-13 | 2024-04-19 | 广州博冠信息科技有限公司 | Video stream processing method, processing device and processing system |
Also Published As
Publication number | Publication date |
---|---|
CN113923530B (en) | 2023-12-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111970524B (en) | Control method, device, system, equipment and medium for interactive live broadcast and microphone connection | |
CN111314720A (en) | Live broadcast and microphone connection control method and device, electronic equipment and computer readable medium | |
CN113225577B (en) | Live stream processing method, device and system, electronic equipment and storage medium | |
CN106792230B (en) | Advertisement interaction method and system based on live video | |
CN112291498B (en) | Audio and video data transmission method and device and storage medium | |
CN112492357A (en) | Method, device, medium and electronic equipment for processing multiple video streams | |
CN112291502B (en) | Information interaction method, device and system and electronic equipment | |
CN110290398B (en) | Video issuing method and device, storage medium and electronic equipment | |
CN112337100B (en) | Live broadcast-based data processing method and device, electronic equipment and readable medium | |
CN112337101A (en) | Live broadcast-based data interaction method and device, electronic equipment and readable medium | |
CN114071179A (en) | Live broadcast preview method, device, equipment, program product and medium | |
CN114095671A (en) | Cloud conference live broadcast system, method, device, equipment and medium | |
CN113891132A (en) | Audio and video synchronization monitoring method and device, electronic equipment and storage medium | |
CN113923530B (en) | Interactive information display method and device, electronic equipment and storage medium | |
CN114679628A (en) | Bullet screen adding method and device, electronic equipment and storage medium | |
CN112492324A (en) | Data processing method and system | |
CN113364767B (en) | Streaming media data display method and device, electronic equipment and storage medium | |
CN114125358A (en) | Cloud conference subtitle display method, system, device, electronic equipment and storage medium | |
CN113891168A (en) | Subtitle processing method, subtitle processing device, electronic equipment and storage medium | |
CN113794942A (en) | Method, apparatus, system, device and medium for switching view angle of free view angle video | |
CN114817698A (en) | Information pushing method and device, information display method and device, equipment and medium | |
CN115174946A (en) | Display method, device, equipment, storage medium and program product of live broadcast page | |
CN112887742B (en) | Live stream processing method, device, equipment and storage medium | |
CN115086745A (en) | Live video processing method, device, equipment and medium | |
CN115474065B (en) | Subtitle processing method and device, electronic equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |