CN108881185B - Data transmitting apparatus and method, data receiving apparatus and method, and storage medium - Google Patents
Data transmitting apparatus and method, data receiving apparatus and method, and storage medium Download PDFInfo
- Publication number
- CN108881185B CN108881185B CN201810547653.XA CN201810547653A CN108881185B CN 108881185 B CN108881185 B CN 108881185B CN 201810547653 A CN201810547653 A CN 201810547653A CN 108881185 B CN108881185 B CN 108881185B
- Authority
- CN
- China
- Prior art keywords
- data
- data packet
- streaming media
- frame
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
- H04N21/4758—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for providing answers, e.g. voting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a data transmitting device and method, a data receiving device and method and a storage medium. Determining a media frame as an initial frame in a to-be-packaged media frame queue; storing the character data to be issued into the initial frame and the subsequent media frames according to a predetermined storage rule; when the media frame is packaged, if the fact that the text data are stored in the media frame is recognized for the first time, the text data are packaged into the corresponding streaming media data packet according to a predetermined packaging rule, and the generated streaming media data packet is issued to a network. Compared with the prior art, the method and the device solve the problem that the text information cannot be displayed in time when the network is congested.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a data transmitting apparatus and method, a data receiving apparatus and method, and a storage medium.
Background
With the development of network technology, live broadcasting has become a popular interactive mode. In the live broadcast process, the anchor often needs to issue some text information to be displayed to the audience, for example, when answering questions in the live broadcast, the audience needs to be displayed with questions or answers.
At present, a method for issuing text information by a live broadcast platform is to issue text information to audiences through an Instant Messaging (IM) system, and although this method can realize the display of text information, the method still has a defect that when a network is congested, the loss of the IM information may be caused, and once the IM information carrying the text information is lost, the timely display of the text information cannot be realized.
Disclosure of Invention
The invention mainly aims to provide a data sending device and method, a data receiving device and method and a storage medium, and aims to solve the problem that text information cannot be displayed in time when a network is congested.
In order to achieve the above object, the present invention provides a data transmission method, which includes the steps of:
when a text data issuing instruction is received, determining a media frame as an initial frame in a to-be-packaged media frame queue;
storing the character data to be issued into the initial frame and the subsequent media frames according to a predetermined storage rule;
when the media frame is packaged, if the fact that the text data are stored in the media frame is recognized for the first time, the text data are packaged into a plurality of streaming media data packets according to a predetermined packaging rule;
and issuing the generated streaming media data packet to a network.
Preferably, the predetermined storage rule includes:
storing the character data into the initial frame and each subsequent frame of media frame until a first preset condition is met, and stopping the storage operation of the character data;
or, the starting frame is used as a first storage frame, the text data is stored in the first storage frame, a storage frame is determined every first preset number of media frames or every first preset duration from the first storage frame, the text data is stored in the determined storage frame, and the storage operation of the text data is stopped until a second preset condition is met.
Preferably, the predetermined encapsulation rule includes:
when it is recognized that a media frame stores the text data for the first time, the text data is packaged into a first type streaming media data packet, the media data in the media frame is packaged into a second type streaming media data packet, and the first type streaming media data packet and the second type streaming media data packet generated by packaging are sequentially added into a queue to be sent;
and after the first streaming media data packet of the first type corresponding to the text data is added into the queue to be sent, encapsulating the text data into a streaming media data packet of the first type at intervals of a second preset duration and adding the streaming media data packet of the first type into the queue to be sent, and stopping the encapsulation operation of the text data until a third preset condition is met.
In addition, in order to achieve the above object, the present invention further provides a data receiving method, including:
sequentially receiving the streaming media data packets through a network, wherein the streaming media data packets comprise two types, namely a first type streaming media data packet and a second type streaming media data packet which carry the text data respectively;
analyzing the streaming media data packets according to a receiving sequence, and adding the analyzed data packets to a cache queue when each analyzed data packet is obtained, wherein the analyzed data packets comprise a first type analyzed data packet corresponding to the first type streaming media data packet and a second type analyzed data packet corresponding to the second type streaming media data packet;
and when the analysis data packet in the cache queue is read, if the character data is identified for the first time, displaying the character data according to a predetermined display rule.
Preferably, the predetermined display rule includes:
when the character data are recognized for the first time, displaying the character data according to a predetermined display duration;
or when the character data is recognized for the first time, displaying the character data until new character data is recognized, and stopping displaying the character data to display the new character data.
Preferably, the method further comprises:
acquiring a cache time length corresponding to the cache queue, and detecting whether the cache time length is greater than a preset threshold value in real time;
and deleting a second preset number of second type analysis data packets in the cache queue when the cache duration is greater than the preset threshold.
In addition, in order to achieve the above object, the present invention further provides a data transmission apparatus, including a memory and a processor, wherein the memory stores a data transmission program, and the data transmission program, when executed by the processor, implements the following steps:
when a text data issuing instruction is received, determining a media frame as an initial frame in a to-be-packaged media frame queue;
storing the character data to be issued into the initial frame and the subsequent media frames according to a predetermined storage rule;
when the media frame is packaged, if the fact that the text data are stored in the media frame is identified for the first time, the text data are packaged into a plurality of streaming media data packets according to a predetermined packaging rule;
and issuing the generated streaming media data packet to a network.
Preferably, the predetermined storage rule includes:
storing the character data into the initial frame and each subsequent frame of media frame until a first preset condition is met, and stopping the storage operation of the character data;
or, the starting frame is used as a first storage frame, the text data is stored in the first storage frame, from the first storage frame, a storage frame is determined at intervals of a first preset number of media frames or at intervals of a first preset duration, and meanwhile the text data is stored in the determined storage frame until a second preset condition is met, and the storage operation on the text data is stopped.
Preferably, the predetermined encapsulation rule includes:
when it is recognized that a media frame stores the text data for the first time, the text data is packaged into a first type streaming media data packet, the media data in the media frame is packaged into a second type streaming media data packet, and the first type streaming media data packet and the second type streaming media data packet generated by packaging are sequentially added into a queue to be sent;
and after adding the first type streaming media data packet corresponding to the text data into the queue to be sent, encapsulating the text data into the first type streaming media data packet at intervals of a second preset duration and adding the first type streaming media data packet into the queue to be sent, and stopping the encapsulation operation of the text data until a third preset condition is met.
In order to achieve the above object, the present invention further provides a data receiving apparatus, including a memory and a processor, wherein the memory stores a data receiving program, and the data receiving program, when executed by the processor, implements the steps of:
sequentially receiving the streaming media data packets through a network, wherein the streaming media data packets comprise two types, namely a first type streaming media data packet and a second type streaming media data packet which carry the text data respectively;
analyzing the streaming media data packets according to a receiving sequence, and adding the analyzed data packets to a cache queue when each analyzed data packet is obtained, wherein the analyzed data packets comprise a first type analyzed data packet corresponding to the first type streaming media data packet and a second type analyzed data packet corresponding to the second type streaming media data packet;
and when the analysis data packet in the cache queue is read, if the character data is identified for the first time, displaying the character data according to a predetermined display rule.
Preferably, the predetermined display rule includes:
when the character data are recognized for the first time, displaying the character data according to a predetermined display duration;
or when the character data is recognized for the first time, displaying the character data until new character data is recognized, and stopping displaying the character data to display the new character data.
Preferably, the processor executes the data receiving program, and further implements the steps of:
acquiring a cache time length corresponding to the cache queue, and detecting whether the cache time length is greater than a preset threshold value in real time;
and deleting a second preset number of second type analysis data packets in the cache queue when the cache duration is greater than the preset threshold.
Further, to achieve the above object, the present invention also proposes a computer-readable storage medium storing a data transmission program, which is executable by at least one processor to cause the at least one processor to execute the steps of the data transmission method according to any one of the above.
Further, to achieve the above object, the present invention also proposes a computer-readable storage medium storing a data reception program executable by at least one processor to cause the at least one processor to execute the steps of the data reception method according to any one of the above.
Determining a media frame as an initial frame in a to-be-packaged media frame queue; storing the character data to be issued into the initial frame and the subsequent media frames according to a predetermined storage rule; when the media frame is packaged, if the fact that the text data are stored in the media frame is recognized for the first time, the text data are packaged into the corresponding streaming media data packet according to a predetermined packaging rule, and the generated streaming media data packet is issued to a network. Compared with the prior art, the method and the device have the advantages that the text data to be issued are stored in the initial frame, the text data are stored in the subsequent media frames, and the text data are packaged into the streaming media data packets when the media frames are packaged. When network congestion occurs, even if part of media frames are lost, text data can still be extracted from other media frames which are not lost. The problem that the text information cannot be displayed in time when the network is congested is solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the structures shown in the drawings without creative efforts.
FIG. 1 is a schematic diagram of a system architecture of a data transceiving system according to the present invention;
FIG. 2 is a schematic diagram of an operating environment of a first embodiment of a data transmission program according to the present invention;
FIG. 3 is a block diagram of a first embodiment of a data transmission process according to the present invention;
FIG. 4 is a schematic diagram of an operating environment of a data receiving program according to a first embodiment of the present invention;
FIG. 5 is a block diagram of a first embodiment of a data receiving process according to the present invention;
FIG. 6 is a block diagram of a data receiving process according to a second embodiment of the present invention;
fig. 7 is a flowchart illustrating a first embodiment of a data transmission method according to the present invention;
fig. 8 is a flowchart illustrating a data receiving method according to a first embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth to illustrate, but are not to be construed to limit the scope of the invention.
The invention provides a data transceiving system.
Referring to fig. 1, fig. 1 is a schematic diagram of a system architecture of a data transceiving system according to the present invention
The system comprises a data transmitting device 1 and a data receiving device 2, wherein:
the data transmission apparatus 1 includes a memory having a data transmission program stored thereon and a processor for executing the data transmission program to implement the steps of the data transmission method.
The data transmitting apparatus 2 includes a memory on which a data receiving program is stored and a processor for executing the data receiving program to realize the steps of the data receiving method.
The data transmission device 1, the data transmission program 10, the data transmission method, the data reception device 2, the data reception program 20, and the data reception method can be referred to the description of the following embodiments.
The invention provides a data transmission program.
Please refer to fig. 2, which is a schematic diagram of an operating environment of a data sending program 10 according to a first embodiment of the present invention.
In the present embodiment, the data transmission program 10 is installed and run in the data transmission device 1. The data transmission device 1 may be a computing device such as a desktop computer, a notebook computer, a palmtop computer, or a server. The data transmission device 1 may include, but is not limited to, a memory 11, a processor 12, and a display 13. Fig. 2 only shows the data transmission device 1 with components 11-13, but it is to be understood that not all of the shown components are required to be implemented, and that more or fewer components may alternatively be implemented.
The memory 11 may in some embodiments be an internal storage unit of the data transmission apparatus 1, such as a hard disk or a memory of the data transmission apparatus 1. The memory 11 may be an external storage device of the data transmission apparatus 1 in other embodiments, such as a plug-in hard disk provided on the data transmission apparatus 1, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like. Further, the memory 11 may also include both an internal storage unit and an external storage device of the data transmission apparatus 1. The memory 11 is used for storing application software installed in the data transmission device 1 and various types of data, for example, a program code of the data transmission program 10. The memory 11 may also be used to temporarily store data that has been output or is to be output.
The processor 12 may be a Central Processing Unit (CPU), a microprocessor or other data Processing chip in some embodiments, and is used for executing program codes stored in the memory 11 or Processing data, such as executing the data transmission program 10.
The display 13 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch panel, or the like in some embodiments. The display 13 is used to display information processed in the data transmission apparatus 1 and to display a user interface for visualization. The components 11-13 of the data transmission device 1 communicate with each other via a program bus.
Please refer to fig. 3, which is a block diagram of a data transmission program 10 according to a first embodiment of the present invention. In this embodiment, the data transmission program 10 may be divided into one or more modules, and the one or more modules are stored in the memory 11 and executed by one or more processors (in this embodiment, the processor 12) to complete the present invention. For example, in fig. 3, the data transmission program 10 may be divided into a determination module 101, a storage module 102, a packaging module 103, and a distribution module 104. The module referred to in the present invention refers to a series of instruction segments of a computer program capable of performing specific functions, and is more suitable than a program for describing the execution process of the data transmission program 10 in the data transmission device 1, wherein:
the determining module 101 is configured to determine a media frame as a start frame in a to-be-packaged media frame queue when receiving a text data issuing instruction.
The media frames include audio frames or video frames. The media frame is rendered, encoded and encapsulated to generate a corresponding streaming media data packet, wherein the streaming media refers to a media format played on the internet in a streaming transmission mode and comprises an audio stream, a video stream, a text stream, an image stream, an animation stream and the like.
When the streaming media required to be transmitted by the data sending program 10 is a video stream capable of playing audio, the media frame queues to be encapsulated include an audio frame queue to be encapsulated and a video frame queue to be encapsulated, and one of the media frame queues to be encapsulated can be selected as a processing object. Preferably, in this embodiment, the queue of video frames to be encapsulated is used as a processing object, that is, a video frame is determined as a start frame in the queue of video frames to be encapsulated.
When the streaming media required to be transmitted by the data sending program 10 is a video stream that can not play audio, and the media frame queue to be encapsulated is a video frame queue to be encapsulated, the video frame queue to be encapsulated is used as a processing object.
When the streaming media required to be transmitted by the data sending program 10 is an audio stream, and the media frame queue to be encapsulated is an audio frame queue to be encapsulated, the audio frame queue to be encapsulated is taken as a processing object.
The step of determining a media frame as an initial frame includes:
and taking the audio frame or the video frame which is performing rendering when the text data issuing instruction is received as an initial frame. In the step, the audio frame or the video frame which is currently performing rendering is taken as an initial frame, so that the precise synchronization of the live broadcast media data playing process and the character data display can be realized.
And the storage module 102 is configured to store the text data to be delivered to the start frame and the subsequent media frames according to a predetermined storage rule.
The text data to be delivered can be set by self-definition according to different application scenes, for example, in an application scene of a live question and answer, the text data can be questions, answers, statistical data and the like, and a main broadcaster or other staff can edit a plurality of questions and corresponding answers in advance and correspondingly store each question or answer as text data.
The character data may be stored in advance in the data transmission device 1 (e.g., the host device) or the server. If the text data is stored in the server, the data transmission device 1 establishes network connection with the server, and the storage module 102 acquires the text data in real time by polling a text data list of the server. If the text data is stored in the data transmission device 1, the storage module 102 may directly fetch the text data with the corresponding serial number from the local text data storage queue.
Preferably, in this embodiment, the predetermined storage rule includes the following two schemes:
the first scheme is as follows: and storing the character data into the initial frame and each subsequent frame of media frame until a first preset condition is met, and stopping the storage operation of the character data.
The first preset condition includes that the number of media frames for storing the text data exceeds a first preset threshold, or the storage operation time length of the text data exceeds a first preset operation time length, or a new text data issuing instruction is received.
Scheme II: and taking the starting frame as a first storage frame, storing the text data into the first storage frame, determining a storage frame every a first preset number of media frames (for example, every two media frames) or every a first preset duration (for example, 0.2 second) from the first storage frame, and storing the text data into the determined storage frame until a second preset condition is met, wherein the first preset number of media frames is equal to the second preset number of media frames.
The second preset condition includes that the number of media frames for storing the text data exceeds a second preset threshold, or the storage operation time length of the text data exceeds a second preset operation time length, or a new text data issuing instruction is received.
The predetermined storage rule stores the text data to be delivered to the initial frame and the subsequent media frames thereof, and even if the initial frame is lost due to network congestion subsequently, the text data to be delivered can be obtained from the subsequent media frames which are not lost.
A packaging module 103, configured to package the text data into multiple streaming media data packets according to a predetermined packaging rule if it is first identified that one media frame stores the text data when the media frame is packaged.
Preferably, in this embodiment, the predetermined encapsulation rule includes:
when the encapsulation module 103 recognizes that a media frame stores the text data for the first time, it encapsulates the text data into a first type streaming media data packet, encapsulates the media data in the media frame into a second type streaming media data packet, and sequentially adds the first type streaming media data packet and the second type streaming media data packet generated by encapsulation into a queue to be sent.
For example, if the streaming media format is FLV (FLASH VIDEO), the streaming media data packet is an FLV Tag data packet, the text data is encapsulated into a Tag of 0x12 type (i.e., a first type of streaming media data packet), and when the media frame is an audio frame, the audio data in the audio frame is encapsulated into a Tag of 0x08 type, and when the media frame is a VIDEO frame, the VIDEO data in the VIDEO frame is encapsulated into a Tag of 0x09 type, where the Tag of 0x08 type and the Tag of 0x09 type are collectively referred to as a second type of streaming media data packet.
When the encapsulation module 103 recognizes that the text data is stored in a media frame for the first time, a first type streaming media data packet generated by encapsulating the text data is a first type streaming media data packet corresponding to the text data, the first type streaming media data packet is added to a queue to be sent before a second type streaming media data packet corresponding to the first type streaming media data packet, so that the first type streaming media data packet is sent to a data receiving device before the second type streaming media data packet corresponding to the first type streaming media data packet, the data receiving device analyzes and reads the streaming media data packets according to a receiving sequence, if the first type streaming media data packet is read, text data in the first type streaming media data packet is displayed, and media data (for example, audio data or video data) in the second type streaming media data packet corresponding to the first type streaming media data packet is played at the same time.
If the second type streaming media data packet corresponding to the first type streaming media data packet is added to the queue to be sent before the first type streaming media data packet, the data receiving device will receive the second type streaming media data packet corresponding to the first type streaming media data packet first, and analyze, read and play the second type streaming media data packet first, so that the display of the text data is later than the play of the media data in the corresponding second type streaming media data packet. Therefore, the step of adding the first type streaming media data packet to the queue to be sent before the corresponding second type streaming media data packet is beneficial to improving the consistency of the live broadcast media data playing process and the text data display.
Then, starting from adding the first type streaming media data packet corresponding to the text data into the queue to be sent, the encapsulation module 103 encapsulates the text data into the first type streaming media data packet at intervals of a second preset duration (for example, 1 second) and adds the first type streaming media data packet into the queue to be sent, and stops the encapsulation operation on the text data until a third preset condition is met.
The second preset duration may be set as required, but the smaller the value of the second preset duration is, the higher the generation frequency of the first type streaming media data packet is, which causes an increase in the amount of data issued to the network by the data transmission device 1, and the network transmission load is also increased. The larger the value of the second preset duration is, the lower the generation frequency of the first type of streaming media data packet is, and when the first type of streaming media data packet is lost, the longer the data receiving device needs to wait for acquiring text data from the subsequent first type of streaming media data packet.
The third preset condition includes that the number of media frames storing the text data exceeds a third preset threshold, or the packaging operation duration of the text data exceeds a third preset operation duration, or new text data is identified.
The third preset operation duration may be determined according to a preset display duration of the text data on the data receiving apparatus.
In addition, in the present embodiment, in the process of encapsulating the media frame, a corresponding timestamp may also be added to each generated streaming media data.
In this embodiment, the step of encapsulating the text data into a first type streaming media data packet and adding the first type streaming media data packet to the queue to be sent every second preset time interval may be replaced with: and when a third preset number of streaming media data packets are generated by packaging, packaging the text data into a first type of streaming media data packet, adding the first type of streaming media data packet into the queue to be sent, and stopping the packaging operation of the text data until a third preset condition is met.
And the publishing module 104 is configured to publish the generated streaming media data packet to a network.
The publishing module 104 publishes the streaming media data packet through a CDN (Content Delivery Network) according to the queue to be sent. The CDN system can redirect the user request to the service node closest to the user according to the network flow, the connection of each node, the load state, the distance of the user, the response time and other comprehensive information in real time. The method aims to enable the user to obtain the required content nearby, solve the network congestion condition and improve the response speed of the user for accessing the website.
In the embodiment, a media frame is determined as a starting frame in a to-be-packaged media frame queue; storing the character data to be issued into the initial frame and the subsequent media frames according to a predetermined storage rule; when the media frame is packaged, if the media frame is identified to have the text data stored therein for the first time, the text data is packaged into the corresponding streaming media data packet according to a predetermined packaging rule, and the generated streaming media data packet is issued to the network. Compared with the prior art, the embodiment not only stores the text data to be sent to the start frame, but also stores the text data to a plurality of subsequent media frames, and when the media frames are encapsulated, the text data are encapsulated into a plurality of streaming media data packets. When network congestion occurs, even if part of media frames are lost, text data can still be extracted from other media frames which are not lost. The problem that the text information cannot be displayed in time when the network is congested is solved.
In addition, the invention also provides a data receiving program on the basis of the data transmitting program.
Fig. 4 is a schematic diagram of an operating environment of the data receiving program 20 according to the first and second embodiments of the present invention.
In the present embodiment, the data reception program 20 is installed and run in the data reception apparatus 2. The data receiving device 2 may be a computing device such as a desktop computer, a notebook, a palmtop computer, and a server. The data receiving device 2 may include, but is not limited to, a memory 21, a processor 22, and a display 23. Fig. 4 only shows the data receiving device 2 with components 21-23, but it is to be understood that not all of the shown components are required to be implemented, and that more or fewer components may alternatively be implemented.
The memory 21 may in some embodiments be an internal storage unit of the data receiving apparatus 2, such as a hard disk or a memory of the data receiving apparatus 2. The memory 21 may be an external storage device of the data receiving apparatus 2 in other embodiments, such as a plug-in hard disk provided on the data receiving apparatus 2, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like. Further, the memory 21 may also include both an internal storage unit of the data reception apparatus 2 and an external storage device. The memory 21 is used for storing application software installed in the data receiving apparatus 2 and various types of data, such as program codes of the data receiving program 20. The memory 21 may also be used to temporarily store data that has been output or is to be output.
The processor 22 may be a Central Processing Unit (CPU), a microprocessor or other data Processing chip in some embodiments, and is used for executing program codes stored in the memory 21 or Processing data, such as executing the data receiving program 20.
The display 23 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch panel, or the like in some embodiments. The display 23 is used to display information processed in the data receiving apparatus 2 and to display a user interface for visualization. The components 21-23 of the data receiving device 2 communicate with each other via a program bus.
Fig. 5 is a block diagram of a data receiving program 20 according to a first embodiment of the present invention. In this embodiment, the data receiving program 20 may be divided into one or more modules, and the one or more modules are stored in the memory 21 and executed by one or more processors (in this embodiment, the processor 22) to complete the present invention. For example, in fig. 5, the data receiving program 20 may be divided into a receiving module 201, an analyzing module 202, and a display module 203. The module referred to in the present invention refers to a series of computer program instruction segments capable of performing specific functions, and is more suitable than a program for describing the execution process of the data receiving program 20 in the data receiving apparatus 2, wherein:
a receiving module 201, configured to receive the streaming media data packets sequentially through a network.
The stream media data packet comprises two types, namely a first type stream media data packet and a second type stream media data packet which carry the text data. The second type of streaming media data packet can be further divided into two types: audio data packets carrying audio data and video data packets carrying video data.
The parsing module 202 is configured to parse the streaming media data packets according to the receiving sequence, and add the parsed data packets to the buffer queue every time a parsed data packet is obtained through parsing.
The analysis data packet comprises a first type analysis data packet corresponding to the first type streaming media data packet and a second type analysis data packet corresponding to the second type streaming media data packet.
When the streaming media is a video stream capable of playing audio, the streaming media data packet received by the receiving module 201 includes the following three types: a text data packet carrying the text data, an audio data packet carrying audio data and a video data packet carrying video data. Based on the three streaming media data packets, three analysis data packets can be generated by respectively analyzing: a text parsing packet, an audio parsing packet, and a video parsing packet. And adding the audio analysis data packet into an audio buffer queue, adding the video analysis data packet into a video buffer queue, and adding the character analysis data packet into the audio buffer queue or the video buffer queue.
When the streaming media is a video stream of unplayable audio, the streaming media data packet received by the receiving module 201 includes the following two types: a text data packet carrying the text data and a video data packet carrying video data. When the text analysis data packet corresponding to the text data packet is generated, the text analysis data packet is directly added to the video cache queue.
When the streaming media is an audio stream, the streaming media data packets received by the receiving module 201 include the following two types: a text data packet carrying the text data and an audio data packet carrying audio data. When the text analysis data packet corresponding to the text data packet is generated, the text analysis data packet is directly added into the audio buffer queue.
The display module 203 is configured to, when reading the analysis data packet in the cache queue, display the text data according to a predetermined display rule if the text data is identified for the first time.
Preferably, in this embodiment, the predetermined display rule includes:
when the display module 203 recognizes the text data for the first time, the text data is displayed according to a predetermined display duration. Or when the character data is recognized for the first time, displaying the character data until new character data is recognized, and stopping displaying the character data to display the new character data.
The embodiment receives the streaming media data packets in sequence through a network; analyzing the streaming media data packets according to the receiving sequence, and adding the analyzed data packets to a cache queue when each analyzed data packet is obtained; when the analysis data packet in the cache queue is read, if the character data is identified for the first time, the character data is displayed according to a predetermined display rule. Compared with the prior art, in the embodiment, the streaming media data packets are analyzed according to the receiving sequence, and the generated analysis data packets are sequentially placed in the buffer queue according to the analysis sequence, so that the sequence of analyzing the data packets in the buffer queue is consistent with the arrangement sequence of the streaming media data in the queue to be sent in the data sending device, and therefore, the display of the text data is consistent with the playing process of the live media data.
Referring to fig. 6, fig. 6 is a block diagram of a data receiving program 20 according to a second embodiment of the present invention.
This embodiment is based on the first embodiment, and the data receiving program 20 further includes a synchronization module 204, where the synchronization module 204 is configured to:
firstly, the cache duration corresponding to the cache queue is obtained, and whether the cache duration is greater than a fourth preset threshold (for example, 2 seconds) is detected in real time.
The cache duration corresponding to the cache queue can be determined according to the timestamp of the first analyzed data packet of the cache queue and the timestamp of the last analyzed data packet of the cache queue.
And then, when the caching duration is greater than the fourth preset threshold, deleting a preset number of second-type analysis data packets from the caching queue.
When the streaming media is a video stream capable of playing audio, the synchronization module 204 deletes the audio analysis data packet in the audio buffer queue, and at this time, triggers and starts a preset frame tracking mechanism, and controls to read the video analysis data packet in the video buffer queue at an accelerated speed in order to keep the audio and video playing synchronization, so as to realize the accelerated playing of the video data, thereby ensuring the low latency of live broadcasting.
When the streaming media is a video stream of the unplayable audio, the synchronization module 204 deletes the video parsing data packet in the video buffer queue, and at this time, the subsequent video parsing data packet can be read at an accelerated speed, so as to ensure the low latency of live broadcasting.
When the streaming media is an audio stream, the synchronization module 204 deletes the audio parsing packet in the audio buffer queue, and at this time, the subsequent audio parsing packet can be read at an accelerated speed, so as to ensure low latency of live broadcasting.
It should be noted that, in this embodiment, the synchronization module 204 only deletes the second type of parsing packet in the buffer queue, instead of deleting the first type of parsing packet in the buffer queue, and the deletion of the first type of parsing packet may cause that the text data cannot be displayed in time.
In addition, the invention also provides a data transmission method.
As shown in fig. 7, fig. 7 is a flowchart illustrating a data transmission method according to a first embodiment of the present invention.
In this embodiment, the method includes:
step S11, when receiving the text data issuing command, determining a media frame as a start frame in a to-be-packaged media frame queue.
The media frames include audio frames or video frames. The media frame is rendered, encoded and encapsulated to generate a corresponding streaming media data packet, wherein the streaming media refers to a media format played on the internet in a streaming transmission mode and comprises an audio stream, a video stream, a text stream, an image stream, an animation stream and the like.
When the streaming media to be transmitted is a video stream capable of playing audio, the to-be-packaged media frame queue comprises an audio frame queue to be packaged and a video frame queue to be packaged, and one of the to-be-packaged media frame queues can be selected as a processing object. Preferably, in this embodiment, the queue of video frames to be encapsulated is used as a processing object, that is, a video frame is determined as a start frame in the queue of video frames to be encapsulated.
And when the streaming media to be transmitted is the video stream of the unplayable audio, and the media frame queue to be packaged is a video frame queue to be packaged, taking the video frame queue to be packaged as a processing object.
And when the streaming media to be transmitted is audio streams, and the media frame queue to be packaged is an audio frame queue to be packaged, taking the audio frame queue to be packaged as a processing object.
The step of determining a media frame as an initial frame includes:
and taking the audio frame or the video frame which is performing rendering when the text data issuing instruction is received as an initial frame. In the step, the audio frame or the video frame which is currently performing rendering is taken as an initial frame, so that the precise synchronization of the live broadcast media data playing process and the character data display can be realized.
And S12, storing the character data to be issued into the initial frame and the subsequent media frames according to a predetermined storage rule.
The text data to be delivered can be set by self-definition according to different application scenes, for example, in an application scene of a live question and answer, the text data can be questions, answers, statistical data and the like, and a main broadcaster or other staff can edit a plurality of questions and corresponding answers in advance and correspondingly store each question or answer as text data.
The above-mentioned character data may be stored in advance in a data transmission device (e.g., an anchor device) or a server. If the character data are stored in the server, the data sending device establishes network connection with the server, and the character data are obtained in real time in a mode of polling a character data list of the server. If the text data is stored in the data sending device, the data sending device directly takes out the text data with the corresponding serial number from the local text data storage queue.
Preferably, in this embodiment, the predetermined storage rule includes the following two schemes:
the first scheme is as follows: and storing the character data into the initial frame and each subsequent frame of media frame until a first preset condition is met, and stopping the storage operation of the character data.
The first preset condition includes that the number of media frames for storing the text data exceeds a first preset threshold, or the storage operation time of the text data exceeds a first preset operation time, or a new text data issuing instruction is received.
Scheme II: and taking the starting frame as a first storage frame, storing the text data into the first storage frame, determining a storage frame at intervals of a first preset number of media frames (for example, at intervals of two media frames) or at intervals of a first preset duration (for example, 0.2 second) from the first storage frame, and storing the text data into the determined storage frame until a second preset condition is met, wherein the text data are stored in the determined storage frame.
The second preset condition includes that the number of media frames storing the text data exceeds a second preset threshold, or the storage operation duration of the text data exceeds a second preset operation duration, or a new text data issuing instruction is received.
The predetermined storage rule stores the text data to be delivered to the initial frame and the subsequent media frames thereof, and even if the initial frame is lost due to network congestion subsequently, the text data to be delivered can be obtained from the subsequent media frames which are not lost.
Step S13, when the media frame is encapsulated, if it is identified for the first time that the text data is stored in a media frame, encapsulating the text data into a plurality of streaming media data packets according to a predetermined encapsulation rule.
Preferably, in this embodiment, the predetermined encapsulation rule includes:
when the fact that a media frame stores the text data is recognized for the first time, the text data is packaged into a first type streaming media data packet, the media data in the media frame is packaged into a second type streaming media data packet, and the first type streaming media data packet and the second type streaming media data packet generated by packaging are sequentially added into a queue to be sent.
For example, if the streaming media format is FLV (FLASH VIDEO), the streaming media data packet is an FLV Tag data packet, the text data is encapsulated into a Tag of 0x12 type (i.e. a first type of streaming media data packet), and when the media frame is an audio frame, the audio data in the audio frame is encapsulated into a Tag of 0x08 type, and when the media frame is a VIDEO frame, the VIDEO data in the VIDEO frame is encapsulated into a Tag of 0x09 type, where the Tag of 0x08 type and the Tag of 0x09 type are collectively referred to as a second type of streaming media data packet.
When it is recognized that a media frame stores the text data for the first time, the first type streaming media data packet generated by the text data package is the first type streaming media data packet corresponding to the text data, the first type streaming media data packet is added to a queue to be sent before the second type streaming media data packet corresponding to the first type streaming media data packet, and if the first type streaming media data packet is read, displaying character data in the first type streaming media data packet, and simultaneously playing media data in the second type streaming media data packet corresponding to the first type streaming media data packet.
If the second type streaming media data packet corresponding to the first type streaming media data packet is added to the queue to be sent before the first type streaming media data packet, the data receiving device will receive the second type streaming media data packet corresponding to the first type streaming media data packet first, and analyze, read and play the second type streaming media data packet first, so that the display of the text data is later than the play of the media data in the corresponding second type streaming media data packet. Therefore, the step of adding the first type streaming media data packet to the queue to be sent before the corresponding second type streaming media data packet is beneficial to improving the consistency of the live broadcast media data playing process and the text data display.
Then, starting from adding the first type streaming media data packet corresponding to the text data into the queue to be sent, encapsulating the text data into a first type streaming media data packet every second preset time (for example, 1 second) and adding the first type streaming media data packet into the queue to be sent, and stopping the encapsulation operation on the text data until a third preset condition is met.
The second preset duration may be set as required, but the smaller the value of the second preset duration is, the higher the generation frequency of the first type streaming media data packet is, which causes an increase in the amount of data issued by the data sending apparatus to the network and a consequent increase in the network transmission load. The larger the value of the second preset duration is, the lower the generation frequency of the first type of streaming media data packet is, and when the first type of streaming media data packet is lost, the longer the data receiving device needs to wait for acquiring text data from the subsequent first type of streaming media data packet.
The third preset condition includes that the number of media frames storing the text data exceeds a third preset threshold, or the packaging operation duration of the text data exceeds a third preset operation duration, or new text data is identified.
The third preset operation duration may be determined according to a preset display duration of the text data on the data receiving apparatus.
In addition, in the present embodiment, in the process of encapsulating the media frame, a corresponding timestamp may also be added to each generated streaming media data.
In this embodiment, the step of encapsulating the text data into a first type streaming media data packet and adding the first type streaming media data packet to the queue to be sent every second preset time interval may be replaced by: and when a third preset number of streaming media data packets are generated by packaging, packaging the text data into a first type of streaming media data packet, adding the first type of streaming media data packet into the queue to be sent, and stopping the packaging operation of the text data until a third preset condition is met.
And S14, issuing the generated streaming media data packet to a network.
And the data sending device issues the streaming media data packet through a Content Delivery Network (CDN) according to the queue to be sent. The CDN system can redirect the user request to the service node closest to the user according to the network flow, the connection of each node, the load state, the distance of the user, the response time and other comprehensive information in real time. The method aims to enable the user to obtain the required content nearby, solve the network congestion condition and improve the response speed of the user for accessing the website.
In the embodiment, a media frame is determined as a starting frame in a to-be-packaged media frame queue; storing the character data to be issued into the initial frame and the subsequent media frames according to a predetermined storage rule; when the media frame is packaged, if the media frame is identified to have the text data stored therein for the first time, the text data is packaged into the corresponding streaming media data packet according to a predetermined packaging rule, and the generated streaming media data packet is issued to the network. Compared with the prior art, the embodiment not only stores the text data to be sent to the start frame, but also stores the text data to a plurality of subsequent media frames, and when the media frames are encapsulated, the text data are encapsulated into a plurality of streaming media data packets. When network congestion occurs, even if part of media frames are lost, text data can still be extracted from other media frames which are not lost. The problem that the text information cannot be displayed in time when the network is congested is solved.
In addition, the invention also provides a data receiving method on the basis of the data transmitting method.
As shown in fig. 8, fig. 8 is a schematic flowchart of a data receiving method according to a first embodiment of the present invention.
In this embodiment, the method includes:
and S21, sequentially receiving the streaming media data packets through the network.
The stream media data packet comprises two types, namely a first type stream media data packet and a second type stream media data packet which carry the text data. The second type of streaming media data packets can be further divided into two types: audio data packets carrying audio data and video data packets carrying video data.
And S22, analyzing the streaming media data packets according to the receiving sequence, and adding the analyzed data packets to a buffer queue when each analyzed data packet is obtained.
The analysis data packet comprises a first type analysis data packet corresponding to the first type streaming media data packet and a second type analysis data packet corresponding to the second type streaming media data packet.
When the streaming media is a video stream capable of playing audio, the received streaming media data packet includes the following three types: a text data packet carrying the text data, an audio data packet carrying audio data and a video data packet carrying video data. Based on the three streaming media data packets, three analysis data packets can be generated by respectively analyzing: a text parsing packet, an audio parsing packet, and a video parsing packet. And adding the audio analysis data packet into an audio buffer queue, adding the video analysis data packet into a video buffer queue, and adding the text analysis data packet into the audio buffer queue or the video buffer queue.
When the streaming media is a video stream of unplayable audio, the received streaming media data packet includes the following two types: a text data packet carrying the text data and a video data packet carrying video data. When the text analysis data packet corresponding to the text data packet is generated, the text analysis data packet is directly added into the video cache queue.
When the streaming media is an audio stream, the received streaming media data packet includes the following two types: a text data packet carrying the text data and an audio data packet carrying audio data. When the text analysis data packet corresponding to the text data packet is generated, the text analysis data packet is directly added into the audio buffer queue.
And step S23, when the analysis data packet in the cache queue is read, if the character data is identified for the first time, displaying the character data according to a predetermined display rule.
Preferably, in this embodiment, the predetermined display rule includes:
and when the character data are recognized for the first time, displaying the character data according to a predetermined display duration. Or when the character data is recognized for the first time, displaying the character data until new character data is recognized, and stopping displaying the character data to display the new character data.
The embodiment receives the streaming media data packets in sequence through a network; analyzing the streaming media data packets according to the receiving sequence, and adding the analyzed data packets into a cache queue when each analyzed data packet is obtained; when the analysis data packet in the cache queue is read, if the character data is identified for the first time, the character data is displayed according to a predetermined display rule. Compared with the prior art, the embodiment analyzes the streaming media data packets according to the receiving sequence, and sequentially puts the generated analyzed data packets into the buffer queue according to the analyzing sequence, so that the sequence of analyzing the data packets in the buffer queue is consistent with the arrangement sequence of the streaming media data in the queue to be sent in the data sending device, and therefore, the display of the text data can be consistent with the playing process of the live media data.
Further, in this embodiment, the method further includes:
firstly, the cache duration corresponding to the cache queue is obtained, and whether the cache duration is greater than a fourth preset threshold (for example, 2 seconds) is detected in real time.
The buffer duration corresponding to the buffer queue can be determined according to the timestamp of the analysis data packet at the first bit of the buffer queue and the timestamp of the analysis data packet at the last bit of the buffer queue.
And then, when the caching duration is greater than the fourth preset threshold, deleting a preset number of second-type analysis data packets in the caching queue.
When the streaming media are video streams capable of playing audio, deleting the audio analysis data packets in the audio buffer queue, triggering and starting a preset frame tracking mechanism, and controlling to accelerate the reading of the video analysis data packets in the video buffer queue by the frame tracking mechanism in order to keep the audio and video playing synchronization so as to realize the accelerated playing of the video data and ensure the low delay of live broadcasting.
When the streaming media are video streams of unplayable audio, the video analysis data packets in the video cache queue are deleted, and at the moment, the subsequent video analysis data packets can be read in an accelerated manner, so that the low latency of live broadcasting is ensured.
When the streaming media are audio streams, the audio analysis data packets in the audio buffer queue are deleted, and at the moment, the reading of the subsequent audio analysis data packets can be accelerated, so that the low time delay of live broadcasting is ensured.
It should be noted that, in this embodiment, only the second-type parsing packets in the buffer queue are deleted, and the first-type parsing packets in the buffer queue do not need to be deleted, and the deletion of the first-type parsing packets may cause that the text data cannot be displayed in time.
Further, the present invention also provides a computer-readable storage medium storing a data transmission program, which is executable by at least one processor to cause the at least one processor to execute the steps of the data transmission method in any one of the above embodiments.
Further, the present invention also proposes a computer-readable storage medium storing a data reception program, which is executable by at least one processor to cause the at least one processor to execute the steps of the data reception method in any of the above embodiments.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and all equivalent structural changes made by using the contents of the present specification and the drawings, or any other related technical fields, which are directly or indirectly applied to the present invention, are included in the scope of the present invention.
Claims (7)
1. A method for transmitting data, the method comprising the steps of:
when a text data issuing instruction is received, determining a media frame as an initial frame in a to-be-packaged media frame queue;
storing the text data to be delivered into the initial frame and the subsequent media frames thereof according to a predetermined storage rule, wherein the text data to be delivered is stored in a data sending device or a server in advance, and the predetermined storage rule comprises: storing the character data into the initial frame and each subsequent frame of media frame until a first preset condition is met, and stopping the storage operation of the character data; or, taking the starting frame as a first storage frame, storing the text data into the first storage frame, determining a storage frame from the first storage frame at intervals of a first preset number of media frames or at intervals of a first preset duration, and storing the text data into the determined storage frame until a second preset condition is met, wherein the first preset duration is a duration of the first preset duration;
when the media frame is encapsulated, if it is identified for the first time that the text data is stored in a media frame, encapsulating the text data into a plurality of streaming media data packets according to a predetermined encapsulation rule, where the predetermined encapsulation rule includes: when the fact that one media frame stores the text data is recognized for the first time, the text data is packaged into a first type streaming media data packet, the media data in the media frame is packaged into a second type streaming media data packet, and the first type streaming media data packet and the second type streaming media data packet generated by packaging are sequentially added into a queue to be sent, wherein the first type streaming media data packet is added into the queue to be sent in advance of the second type streaming media data packet corresponding to the first type streaming media data packet; starting to add a first type streaming media data packet corresponding to the text data into the queue to be sent, encapsulating the text data into a first type streaming media data packet at intervals of a second preset duration and adding the first type streaming media data packet into the queue to be sent, and stopping the encapsulation operation of the text data until a third preset condition is met;
and issuing the encapsulated streaming media data packet to a network.
2. A data receiving method, characterized in that the method comprises the steps of:
sequentially receiving streaming media data packets through a network, wherein the streaming media data packets comprise two types, namely a first type of streaming media data packet carrying character data and a second type of streaming media data packet carrying media data;
analyzing the streaming media data packets according to a receiving sequence, and adding the analyzed data packets to a cache queue when each analyzed data packet is obtained, wherein the analyzed data packets comprise a first type analyzed data packet corresponding to the first type streaming media data packet and a second type analyzed data packet corresponding to the second type streaming media data packet;
when reading the analysis data packet in the cache queue, if the text data is identified for the first time, displaying the text data according to a predetermined display rule, and simultaneously playing media data in a second type analysis data packet corresponding to a first type analysis data packet to which the text data belongs, wherein the first type analysis data packet is a text analysis data packet, the second type analysis data packet is an audio analysis data packet and/or a video analysis data packet, and the predetermined display rule comprises: when the character data are recognized for the first time, displaying the character data according to a predetermined display duration; or when the character data is recognized for the first time, displaying the character data until new character data is recognized for the first time, and stopping displaying the character data to display the new character data.
3. The data receiving method as claimed in claim 2, wherein the method further comprises:
acquiring cache duration corresponding to the cache queue, and detecting whether the cache duration is greater than a preset threshold value in real time;
and deleting a second preset number of second type analysis data packets in the buffer queue when the buffer duration is greater than the preset threshold.
4. A data transmission apparatus comprising a memory and a processor, wherein the memory has stored thereon a data transmission program executable by at least one processor to cause the at least one processor to perform the steps of the data transmission method as claimed in claim 1.
5. A data receiving device comprising a memory and a processor, wherein the memory has stored thereon a data receiving program executable by at least one processor to cause the at least one processor to perform the steps of the data receiving method as claimed in any one of claims 2 to 3.
6. A computer-readable storage medium storing a data transmission program executable by at least one processor to cause the at least one processor to perform the steps of the data transmission method according to claim 1.
7. A computer-readable storage medium, characterized in that it stores a data reception program executable by at least one processor to cause the at least one processor to perform the steps of the data reception method according to any one of claims 2-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810547653.XA CN108881185B (en) | 2018-05-31 | 2018-05-31 | Data transmitting apparatus and method, data receiving apparatus and method, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810547653.XA CN108881185B (en) | 2018-05-31 | 2018-05-31 | Data transmitting apparatus and method, data receiving apparatus and method, and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108881185A CN108881185A (en) | 2018-11-23 |
| CN108881185B true CN108881185B (en) | 2022-10-25 |
Family
ID=64336886
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810547653.XA Active CN108881185B (en) | 2018-05-31 | 2018-05-31 | Data transmitting apparatus and method, data receiving apparatus and method, and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108881185B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113938656A (en) * | 2021-10-27 | 2022-01-14 | 南京工业大学 | Method for playing network monitoring camera video without plug-in and low delay by browser |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102932667A (en) * | 2012-11-15 | 2013-02-13 | 掌赢信息科技（上海）有限公司 | Frame loss control and retransmission method and system in real-time streaming media uploading |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101035262A (en) * | 2007-04-19 | 2007-09-12 | 深圳市融合视讯科技有限公司 | Video information transmission method |
| CN107690089A (en) * | 2016-08-05 | 2018-02-13 | 阿里巴巴集团控股有限公司 | Data processing method, live broadcasting method and device |
| CN106454395B (en) * | 2016-09-20 | 2018-10-12 | 北京百度网讯科技有限公司 | It is used to adaptively provide the method and device of multi code Rate of Chinese character Streaming Media in the server |
-
2018
- 2018-05-31 CN CN201810547653.XA patent/CN108881185B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102932667A (en) * | 2012-11-15 | 2013-02-13 | 掌赢信息科技（上海）有限公司 | Frame loss control and retransmission method and system in real-time streaming media uploading |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108881185A (en) | 2018-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111277869B (en) | Video playing method, device, equipment and storage medium | |
| WO2021114845A1 (en) | Interactive service processing method, system and device, and storage medium | |
| CN109068153B (en) | Video playing method and device and computer readable storage medium | |
| CN112653700B (en) | Website video communication method based on WEBRTC | |
| CN111147947B (en) | Websocket-based flv video transmission and webpage playing method | |
| US9015337B2 (en) | Systems, methods, and apparatus for stream client emulators | |
| US10667001B2 (en) | Method and system for display of mixed media content on devices without standard video | |
| EP3866481A1 (en) | Audio/video switching method and apparatus, and computer device and readable storage medium | |
| WO2021103366A1 (en) | Bullet screen processing method and system based on wechat mini-program | |
| CN111510789B (en) | Video playing method, system, computer equipment and computer readable storage medium | |
| US11706498B2 (en) | Playback method, system, device and readable storage medium of live broadcast content | |
| CN113225607B (en) | Method and system for displaying gift in live broadcast room | |
| CN110996160B (en) | Video processing method and device, electronic equipment and computer readable storage medium | |
| US20180324238A1 (en) | A System and Methods Thereof for Auto-playing Video Content on Mobile Devices | |
| CN112953850A (en) | Data transmission method and device, computer readable medium and electronic equipment | |
| CN113079386B (en) | Video online playing method and device, electronic equipment and storage medium | |
| CN108881185B (en) | Data transmitting apparatus and method, data receiving apparatus and method, and storage medium | |
| EP3125541A1 (en) | Data acquisition and interaction method, set top box, server and multimedia system | |
| CN113115120A (en) | Video slicing method and device, electronic equipment and storage medium | |
| US9495082B2 (en) | Service in support of browser for multi-media content | |
| CN116600169A (en) | Method and device for preloading media files, electronic equipment and storage medium | |
| CN115942000B (en) | H.264 format video stream transcoding method, device, equipment and medium | |
| EP4216555A1 (en) | Computer implemented method for processing streaming requests and responses | |
| US12022150B2 (en) | Bullet comment processing method and system based on WeChat mini-program | |
| WO2021103365A1 (en) | Bullet screen processing method and system based on wechat applet |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |