CN110691212A - Method and system for coding and decoding data - Google Patents
Method and system for coding and decoding data Download PDFInfo
- Publication number
- CN110691212A CN110691212A CN201810725166.8A CN201810725166A CN110691212A CN 110691212 A CN110691212 A CN 110691212A CN 201810725166 A CN201810725166 A CN 201810725166A CN 110691212 A CN110691212 A CN 110691212A
- Authority
- CN
- China
- Prior art keywords
- frame
- transmitted
- code stream
- reference frame
- picture identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a method and a system for coding and decoding data. Wherein, the method comprises the following steps: coding a frame to be coded according to the reference frame to obtain a code stream to be transmitted, wherein the code stream to be transmitted comprises: the first picture identification is used for representing a frame to be coded; generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; and packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain the data packet to be transmitted. The invention solves the technical problem that the video display frame rate of the terminal is reduced in the decoding process caused by packet loss in the transmission process.
Description
Technical Field
The invention relates to the field of image technology application, in particular to a method and a system for coding and decoding data.
Background
In real-time audio and video communication, a real-time transport protocol (RTP) standard is generally adopted to transmit video streams, and a video compression format is a format that utilizes hardware characteristics, and particularly for a mobile internet, a video coding standard H264/AVC coding compression is generally adopted:
the reference frame relation in the H264 standard ensures the consistency of the codec through a relatively complex logic, which relates to the marking operation of the reference frame in the decoded picture buffer (DPB buffer), and the reference frame list rearrangement instruction cannot be simply obtained by analyzing the code stream, and especially when the code stream input to the decoder is incomplete, the correct decoding is difficult;
in addition, in order to improve timeliness and reduce transmission delay, a user datagram Protocol (udp) is generally adopted for real-time communication, but wifi, 4g and other mobile networks are unstable and have discontinuous packet loss sometimes, when packet loss occurs, the RTP packet sequence number is about to have discontinuous phenomenon, if the packet loss is judged to occur, the code stream is considered to be incomplete at the receiving end side and is not connected with codes, and then the video playing frame rate is reduced; if the judgment is not carried out, how many code streams are received and directly sent to the decoder, the wrong code stream playing can cause very poor video experience such as mosaic and the like, and even some decoders are directly crashed and quit the application;
the user experience caused by network packet loss is worse for a multi-user real-time video communication scene, the multi-user scene is widely applied to a Selective Forwarding Unit (SFU) to forward a media packet, when the communication uplink generates packet loss, if the SFU judges that the packet loss is not forwarded according to a serial number, the communication is interrupted, if only simple Forwarding is performed, whether the current stream can be effectively decoded is not judged, the transmission bandwidth is wasted, and the transmission efficiency is reduced.
In the webrtc open source, when video frames are received, the mandatory requirements are continuous and the frames are regarded as correctly decodable frames, and the mandatory relationship causes that one frame is lost, all frames behind the lost frame are judged as invalid frames until the next key frame, and actually, a plurality of frames which can be correctly decoded can be generated behind the lost frame, so that the video display frame rate of the terminal is greatly reduced; that is, if frames 1, 17, 33 … are key frames (inter 16 frames), then if frame 2 is lost, frames 2-16 are all judged to be invalid frames until the next key frame 17 is encountered, and in fact, frames 3-16 following frame 2 are all correctly decodable frames.
Aiming at the problem that the video display frame rate of the terminal is reduced in the decoding process caused by packet loss in the transmission process, an effective solution is not provided at present.
Disclosure of Invention
The embodiment of the invention provides a method and a system for coding and decoding data, which at least solve the technical problem that the video display frame rate of a terminal is reduced in the decoding process caused by packet loss in the transmission process.
According to an aspect of an embodiment of the present invention, there is provided a data encoding method, including: coding a frame to be coded according to the reference frame to obtain a code stream to be transmitted, wherein the code stream to be transmitted comprises: the first picture identification is used for representing a frame to be coded; generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; and packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain the data packet to be transmitted.
Optionally, encoding the frame to be encoded according to the reference frame to obtain the code stream to be transmitted includes: and under the condition that the frame closest to the frame to be coded is taken as the reference frame, coding the frame to be coded according to the frame closest to the frame to be coded as the reference frame to obtain the code stream to be transmitted.
Further, optionally, the encoding the frame to be encoded according to the frame closest to the frame to be encoded as the reference frame includes: acquiring a picture identification code with preset digits increasing monotonically for a frame to be coded, wherein the picture identification code is used for marking the frame to be coded; obtaining a picture identification code of the reference frame according to the picture identification code; and coding the frame to be coded according to the picture identification code of the frame to be coded and the picture identification code of the reference frame to obtain a code stream to be transmitted.
Optionally, generating the extension header according to the code stream information includes: acquiring a reference frame picture identification relation between a first picture identification code and a second picture identification code in code stream information; and generating an expansion head according to the relation between the first picture identification code in the code stream information and the reference frame picture identification code.
Further, optionally, the obtaining of the reference frame picture identification relationship between the first picture identification code and the second picture identification code in the code stream information includes: acquiring a picture identification residual error between the first picture identification code and the second picture identification code; determining the picture identification residual as a reference frame picture identification relationship.
Optionally, encoding the frame to be encoded according to the reference frame to obtain the code stream to be transmitted includes: and under the condition that the frame which is separated from the frame to be coded by the preset bit is taken as the reference frame, coding the frame to be coded according to the frame which is separated from the frame to be coded by the preset bit as the reference frame to obtain the code stream to be transmitted.
According to another aspect of the embodiments of the present invention, there is also provided a data decoding method, including: receiving a data packet to be transmitted; analyzing a data packet to be transmitted to obtain an extension header; and acquiring a reference frame according to the expansion head, and decoding according to the reference frame to obtain a code stream to be displayed.
Optionally, obtaining a reference frame according to the extension header, and decoding according to the reference frame to obtain a code stream to be displayed includes: acquiring a reference frame in an extension header; judging whether all reference frames are received or not; and under the condition that the judgment result is yes, decoding according to the reference frame to obtain the code stream to be displayed.
According to another aspect of the embodiments of the present invention, there is also provided an apparatus for encoding data, including: the encoding module is configured to encode a frame to be encoded according to the reference frame to obtain a code stream to be transmitted, where the code stream to be transmitted includes: the first picture identification is used for representing a frame to be coded; the information generation module is used for generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; and the packaging module is used for packaging the code stream to be transmitted and generating an expansion head according to the code stream information to obtain the data packet to be transmitted.
According to still another aspect of the embodiments of the present invention, there is also provided an apparatus for decoding data, including: the receiving module is used for receiving the data packet to be transmitted; the analysis module is used for analyzing the data packet to be transmitted to obtain an expansion head; and the decoding module is used for acquiring the reference frame according to the expansion head and decoding according to the reference frame to obtain the code stream to be displayed.
According to an aspect of another embodiment of the present invention, there is also provided a data coding and decoding system, including: the device comprises data encoding equipment, data decoding equipment and forwarding equipment, wherein the data encoding equipment is used for encoding a frame to be encoded according to a reference frame to obtain a code stream to be transmitted, and the code stream to be transmitted comprises: the first picture identification is used for representing a frame to be coded; generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain a data packet to be transmitted; the data decoding equipment is used for receiving a data packet to be transmitted; analyzing a data packet to be transmitted to obtain an extension header; acquiring a reference frame according to the expansion head, and decoding according to the reference frame to obtain a code stream to be displayed; and the forwarding equipment is respectively connected with the data coding equipment and the data decoding equipment and is used for analyzing the expansion head in the data packet to be transmitted when the data packet to be transmitted with discontinuous serial numbers is received, determining the code stream of the effective decoding frame in the data packet to be transmitted as the code stream capable of being decoded correctly and forwarding the code stream.
According to another aspect of another embodiment of the present invention, there is also provided a storage medium including a stored program, wherein when the program is executed, a device on which the storage medium is located is controlled to perform: coding a frame to be coded according to the reference frame to obtain a code stream to be transmitted, wherein the code stream to be transmitted comprises: the first picture identification is used for representing a frame to be coded; generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; and packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain the data packet to be transmitted.
According to another aspect of another embodiment of the present invention, there is also provided a processor for executing a program, wherein the program executes to perform: coding a frame to be coded according to the reference frame to obtain a code stream to be transmitted; generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; and packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain the data packet to be transmitted.
In the embodiment of the present invention, a mode of extracting a reference frame relationship is adopted, and a code stream to be transmitted is obtained by encoding a frame to be encoded according to a reference frame, wherein the code stream to be transmitted includes: the first picture identification is used for representing a frame to be coded; generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; the method comprises the steps of packaging a code stream to be transmitted, generating an expansion head according to code stream information, obtaining a data packet to be transmitted, achieving the purpose of improving the video display frame rate, achieving the technical effect that the decoding end can still correctly decode even if packet loss occurs, and further solving the technical problem that the video display frame rate of a terminal is reduced in the decoding process due to the packet loss in the transmission process.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a block diagram of a hardware configuration of a computer terminal of a method of data encoding according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method of encoding data according to a first embodiment of the invention;
fig. 3 is a flowchart of a method of data decoding according to a second embodiment of the present invention;
fig. 4 is a structural diagram of an apparatus for data encoding according to a third embodiment of the present invention;
fig. 5 is a structural diagram of an apparatus for data decoding according to a fourth embodiment of the present invention;
fig. 6 is a flowchart of the system for decoding data according to the fifth embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The technical terms related to the present application are:
H264/AVC, video coding standard H264 jointly proposed by ITU-T/MPEG;
RTP, real time transport protocol, see rfc 3550;
RTP extension header: the RTP header is proposed in RFC3550 to support user-defined extension;
reference frame: in video (consisting of a succession of pictures) compression, the decoding of a current frame (picture) depends on a frame (picture) that has been decoded before, this depended frame (picture) being called the reference frame;
the SFU is a Selective Forwarding Unit, a Selective Forwarding Unit and a SFU, is widely applied to a multi-user audio and video real-time transmission scene, has the function different from that of an MCU, only performs simple Forwarding and does not perform complex media processing logic;
DPB, decoded picture buffer, decoding picture buffer area;
explicit transmission of reference frame relationships: each encoded frame is marked with monotonically increasing pictureID, the relationship between reference frames is defined as the residual between pictureID, and the residual is written in RTP extension header for transmission.
Example 1
There is also provided, in accordance with an embodiment of the present invention, an embodiment of a method of data encoding, it being noted that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than that presented herein.
The method provided by the first embodiment of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking the example of running on a computer terminal, fig. 1 is a hardware structure block diagram of a computer terminal of a data encoding method according to an embodiment of the present invention. As shown in fig. 1, the computer terminal 10 may include one or more (only one shown) processors 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission module 106 for communication functions. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the electronic device. For example, the computer terminal 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 may be used to store software programs and modules of application software, such as program instructions/modules corresponding to the data encoding method in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing, i.e., implements the data encoding method of the application program, by executing the software programs and modules stored in the memory 104. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the computer terminal 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission device 106 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission device 106 can be a Radio Frequency (RF) module, which is used to communicate with the internet in a wireless manner.
In the above operating environment, the present application provides a method of data encoding as shown in fig. 2. On the device side of data encoding, fig. 2 is a flowchart of a data encoding method according to a first embodiment of the present invention.
Step S202, encoding the frame to be encoded according to the reference frame to obtain a code stream to be transmitted, wherein the code stream to be transmitted comprises: the first picture identification is used for representing a frame to be coded;
in step S202, the data encoding method provided by the present application may be applied to a real-time video communication application scenario, and at a data encoding device side, a video inter-frame reference relationship is extracted by a customized development H264/AVC encoder, that is, a to-be-encoded frame is encoded according to an adjacent frame as a reference frame, so as to obtain a to-be-transmitted code stream.
Wherein, the frame to be coded is input into the H264/AVC coder, the coder is customized and developed or certain parameter settings are set, such as limiting the number of reference frames, limiting the use of the nearest frame as a reference frame, etc., where besides the nearest frame can be used as a reference frame, it is also possible to use the adjacent frame with a fixed interval as a reference frame, where the fixed interval may include: interval 1-3 frames. It should be noted that, in the present application, a frame closest to a frame to be encoded is taken as a reference frame to be described as a preferred example, so as to implement the data encoding method provided in the present application, which is not particularly limited.
Specifically, the data coding method provided by the application is suitable for a real-time transport protocol (RTP) transmission scene, and in the process of coding a frame to be coded, a standard H264/AVC code stream is obtained by coding a customized and developed H264/AVC coder, wherein in the coding process, the data coding method provided by the application does not mark the frame by using a frame No. in the H264 standard, but marks a unique frame in a communication process by using a 16-bit single-tone increasing pictureID parameter, and because the pictureID is marked and the pictureID is monotonically increased, the occurrence of a repeated condition is avoided, and factors such as coder restart, coder parameter reset, key frame and the like are prevented;
in addition, in the encoding process, according to the pictureID of the frame to be encoded, in combination with a reference frame management means in the H264 standard, the pictureIDs of one or the reference frames thereof are obtained, wherein the reference frame in the related art is set forward, that is, for a certain frame (for example, the 3 rd frame), the reference frame thereof is the 2 nd frame. In the data encoding method provided by the application, if the second frame is successfully decoded, the backward third frame can be decoded. Thereby avoiding the problems of the prior art described above.
It should be noted that, in the present application, the adjacent frame mentioned may be a frame closest to a frame to be encoded, or may be a frame separated by several frames, and the frame closest to the frame to be encoded is taken as a preferred example for description in the present application, so as to implement the data encoding method provided in the present application, and the method is not particularly limited.
Step S204, code stream information is generated according to a first picture identification code in the code stream to be transmitted and a second picture identification code of the reference frame;
in step S204, based on the code stream to be transmitted obtained in step S202, the code stream information generated in this application is transmitted as information outside the code stream according to the first picture identification code in the code stream to be transmitted, that is, the pictureID of the frame to be encoded and the pictureids of 1 or more reference frames.
Step S206, packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain the data packet to be transmitted.
In step S206 of the present application, based on the code stream to be transmitted and the code stream information obtained in step S202 and step S204, RTP packaging is performed on the code stream to be transmitted in compliance with RFC6884, and a reference frame relationship in the code stream information is transmitted in a custom extension header, that is, RTP packaging is performed on the standard H264/AVC code stream obtained in step S202 in compliance with RFC6884, and a pictureID relationship and a reference frame pictureID relationship in a frame to be encoded in step S204 are transmitted in a semantic extension header.
In order to improve the engineering practicability and reduce the load of additionally transmitting the information, in a real-time communication scene, in order to reduce the dependency between frames, a multi-frame reference is defined as one frame, and specific examples are as follows:
the following table (1) is an implementation manner of the data encoding method provided by the present application:
16 bits of frame pictureID to be coded, 16 bits of residual error between the frame pictureID and reference frame
Watch (1)
Where ref picture is the difference between picture ids between the frame to be encoded and its reference frame.
The difference is used as a preferred example for explanation, and a method for implementing data coding provided by the present application is not specifically limited.
In the embodiment of the invention, a reference frame relation is extracted, and a code stream to be transmitted is obtained by encoding a frame to be encoded according to a reference frame; generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; the method comprises the steps of packaging a code stream to be transmitted, generating a custom expansion head according to code stream information, obtaining a data packet to be transmitted, achieving the purpose of improving the video display frame rate, achieving the technical effect that the decoding end can still correctly decode even if packet loss occurs, and further solving the technical problem that the video display frame rate of a terminal is reduced in the decoding process due to the packet loss in the transmission process.
Optionally, the encoding the frame to be encoded according to the reference frame in step S202 to obtain the code stream to be transmitted includes:
step S2021, under the condition that the frame closest to the frame to be encoded is taken as the reference frame, encoding the frame to be encoded according to the frame closest to the frame to be encoded, so as to obtain the code stream to be transmitted.
Specifically, in the above step S2021, that is, in the step S202, in the encoding process, the frame to be encoded is encoded according to the frame closest to the frame to be encoded as the reference frame, so as to obtain the code stream to be transmitted.
Further, optionally, the encoding the frame to be encoded according to the frame closest to the frame to be encoded as the reference frame in step S2021 includes:
step S20211, acquiring a picture identification code with preset number monotonically increasing of the frame to be encoded, wherein the picture identification code is used for marking the frame to be encoded;
specifically, in the process of acquiring the picture identification code with monotonically increasing preset digits of the frame to be encoded in step S20211, the preset digits may include: 16 bits; the unique frame in the communication process is marked by the 16-bit single-tone increasing picture identification code pictureID parameter, so that the restarting of the encoder and the resetting of the encoder parameter are prevented.
Step S20212, obtaining a picture identification code of the reference frame according to the picture identification code;
specifically, according to the picture identifier obtained in step S20211 and a reference frame management means in the H264 standard, the pictureIDs of one or the reference frames thereof, that is, the picture identifier of the reference frame provided in the present application, are obtained, where in the related art, the reference frame is set forward, that is, for a certain frame (for example, the 3 rd frame), the reference frame is the 2 nd frame. In the data encoding method provided by the application, if the second frame is successfully decoded, the backward third frame can be decoded. Thereby avoiding the problems of the prior art described above.
Step S20213, encoding the frame to be encoded according to the picture identification code of the frame to be encoded and the picture identification code of the reference frame to obtain a code stream to be transmitted.
Specifically, according to the picture identification code of the frame to be encoded and the picture identification code of the reference frame respectively obtained in step S20211 and step S20212, the pictureID of the encoded frame to be encoded and the pictureids of 1 or more reference frames are transmitted as information outside the code stream, that is, transmitted as code stream information.
Optionally, the step S206 of generating the extension header according to the code stream information includes:
step S2061, acquiring a reference frame picture identification relationship between a first picture identification code and a second picture identification code in the code stream information;
step S2062, an expansion head is generated according to the relation between the first picture identification code and the reference frame picture identification code in the code stream information.
Here, the pictureID in the code stream information in step S204 and the reference frame pictureID relationship are placed in the extension header for transmission.
Further, optionally, the step S2061 of obtaining the reference frame picture identifier relationship between the first picture identifier and the second picture identifier in the code stream information includes:
step S20611, obtaining a picture identification residual error between the first picture identification code and the second picture identification code;
in step S20612, the picture identification residual is determined as the reference frame picture identification relationship.
Specifically, see table (1) in step S206 for details, in order to improve the engineering practicability and reduce the load of additionally transmitting the information, in a real-time communication scenario, in order to reduce inter-frame dependency, a multi-frame reference is defined as one frame, and table (1) is an implementation manner in the data encoding method provided by the present application, in which 16 bits of frames pictureID to be encoded are transmitted, and 16 bits of residual errors between the frames pictureID and the reference frame are transmitted.
The data packet to be transmitted finally obtained is an RTP stream, the RTP stream is a standard RTP stream, the user-defined expansion head is identified by negotiation with a receiving end, and the unrecognized data packet is directly thrown away without being analyzed, so that the normal analysis of the RTP packet is not influenced.
Optionally, the encoding the frame to be encoded according to the reference frame in step S202 to obtain the code stream to be transmitted includes:
and under the condition that the frame which is separated from the frame to be coded by the preset bit is taken as the reference frame, coding the frame to be coded according to the frame which is separated from the frame to be coded by the preset bit as the reference frame to obtain the code stream to be transmitted.
The method is different from a scheme that a frame closest to a frame to be coded is a reference frame, and in the scheme that the frame closest to the frame to be coded is the reference frame, because adjacent frames have a great similar area, the decoding accuracy can be improved according to the adjacent frames when coding is performed, and for pictures of continuous same frames, a mode of spacing a plurality of frames can be selected for coding.
Example 2
The present application provides a method of data decoding as shown in fig. 3. On the device side of data decoding, as shown in fig. 3, fig. 3 is a flowchart of a data decoding method according to the second embodiment of the present invention.
Step S302, receiving a data packet to be transmitted;
step S304, analyzing the data packet to be transmitted to obtain an extension header;
specifically, combining step S302 and step S304, on the receiving end side, in the case that the receiving end includes a data decoding device, in a real-time video communication application scenario, for example, 4G, wifi, packet loss and jitter sometimes occur, the RTP sequence number is discontinuous with a high probability, and it is determined whether the current code stream can be correctly decoded according to the RTP packet sequence number, which is too strict, the misjudgment rate is high, and the video code stream still has a certain redundancy.
In the process of determining how to decode the received frame, the data packet to be transmitted needs to be parsed first to obtain an extension header of the data packet to be transmitted, and then only the determination is performed according to information in the extension header, specifically see step S306.
And S306, acquiring a reference frame according to the expansion head, and decoding according to the reference frame to obtain a code stream to be displayed.
In the above step S306, the obtaining a reference frame according to the extension header, and decoding according to the reference frame includes: under the situation that an RTP transmission protocol transmits a data packet, the data packet to be transmitted can be the RTP packet, only needs to judge whether reference frames of the RTP packet arrive or not by acquiring pictureIDs of the RTP packet and pictureIDs of reference frames which are required to be depended on by decoding of the RTP packet, does not need all RTP packets or frames to completely arrive, and obtains a code stream to be displayed under the condition that the judgment result is yes, and then decodes the code stream to be displayed through an H264/AVC decoder, and finally displays the code stream through a playing device.
In the embodiment of the invention, a mode of extracting a reference frame relation is adopted, and a data packet to be transmitted is received; analyzing a data packet to be transmitted to obtain an extension header; the method comprises the steps of obtaining a reference frame according to an expansion head, decoding according to the reference frame to obtain a code stream to be displayed, and achieving the purpose of improving the video display frame rate, so that the technical effect that the decoding can still be correctly performed at a decoding end even if packet loss occurs is achieved, and the technical problem that the video display frame rate of a terminal is reduced in the decoding process due to the packet loss in the transmission process is solved.
Optionally, in step S306, obtaining a reference frame according to the extension header, and decoding according to the reference frame to obtain a code stream to be displayed includes:
step S3061, acquiring a reference frame in the expansion head;
step S3062, determining whether all reference frames are received;
and step S3063, decoding according to the reference frame under the condition that the judgment result is yes, and obtaining the code stream to be displayed.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method for decoding data according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
Example 3
According to an embodiment of the present invention, there is also provided an apparatus for implementing the above data encoding, as shown in fig. 4, on the apparatus side of data encoding, fig. 4 is a flowchart of an apparatus for data encoding according to a third embodiment of the present invention, where the apparatus includes: an encoding module 42, an information generating module 44, and a packing module 46.
The encoding module 42 is configured to encode a frame to be encoded according to a reference frame to obtain a code stream to be transmitted, where the code stream to be transmitted includes: the first picture identification is used for representing a frame to be coded; the information generation module 44 is configured to generate code stream information according to the first picture identification code in the code stream to be transmitted and the second picture identification code of the reference frame; and the packing module 46 is configured to pack the code stream to be transmitted, and generate an extension header according to the code stream information to obtain a data packet to be transmitted.
In the embodiment of the invention, a mode of extracting a reference frame relation is adopted, and a code stream to be transmitted is obtained by coding a frame to be coded according to an adjacent frame as a reference frame; generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; the method comprises the steps of packaging a code stream to be transmitted, generating an expansion head according to code stream information, obtaining a data packet to be transmitted, achieving the purpose of improving the video display frame rate, achieving the technical effect that the decoding end can still correctly decode even if packet loss occurs, and further solving the technical problem that the video display frame rate of a terminal is reduced in the decoding process due to the packet loss in the transmission process.
It should be noted here that the encoding module 42, the information generating module 44, and the packaging module 46 correspond to steps S202 to S206 in the first embodiment, and the three modules are the same as the corresponding steps in the implementation example and application scenarios, but are not limited to the disclosure in the first embodiment. It should be noted that the modules described above as a part of the apparatus may run in the network device provided in the first embodiment, and may be implemented by software or hardware.
Example 4
According to still another aspect of the embodiments of the present invention, there is also provided a data decoding apparatus, as shown in fig. 5, on the data decoding apparatus side, fig. 5 is a flowchart of a data decoding apparatus according to a fourth embodiment of the present invention, including: a receiving module 52, a parsing module 54 and a decoding module 56.
The receiving module 52 is configured to receive a data packet to be transmitted; the parsing module 54 is configured to parse the data packet to be transmitted to obtain an extension header; and the decoding module 56 is configured to obtain the reference frame according to the extension header, and decode according to the reference frame to obtain the code stream to be displayed.
In the embodiment of the invention, a mode of extracting a reference frame relation is adopted, and a data packet to be transmitted is received; analyzing a data packet to be transmitted to obtain an extension header; the method comprises the steps of obtaining a reference frame according to an expansion head, decoding according to the reference frame to obtain a code stream to be displayed, and achieving the purpose of improving the video display frame rate, so that the technical effect that the decoding can still be correctly performed at a decoding end even if packet loss occurs is achieved, and the technical problem that the video display frame rate of a terminal is reduced in the decoding process due to the packet loss in the transmission process is solved.
It should be noted here that the receiving module 52, the parsing module 54, and the decoding module 56 correspond to steps S302 to S306 in the first embodiment, and the three modules are the same as the corresponding steps in the implementation example and application scenarios, but are not limited to the disclosure in the second embodiment. It should be noted that the modules described above as a part of the apparatus may run in the network device provided in the second embodiment, and may be implemented by software or hardware.
Example 5
According to an aspect of another embodiment of the present invention, there is further provided a data coding and decoding system, and fig. 6 is a flowchart illustrating an implementation of a data decoding system according to a fifth embodiment of the present invention, as shown in fig. 6, including: a data encoding device 62, a data decoding device 64, and a forwarding device 66.
The data encoding device 62 is configured to encode a frame to be encoded according to a reference frame to obtain a code stream to be transmitted, where the code stream to be transmitted includes: the first picture identification is used for representing a frame to be coded; generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain a data packet to be transmitted; a data decoding device 64 for receiving data packets to be transmitted; analyzing a data packet to be transmitted to obtain an extension header; acquiring a reference frame according to the expansion head, and decoding according to the reference frame to obtain a code stream to be displayed; and the forwarding device 66 is respectively connected with the data encoding device and the data decoding device, and is used for analyzing the extension header in the data packet to be transmitted when receiving the data packet to be transmitted with a discontinuous serial number, determining the code stream of an effective decoding frame in the data packet to be transmitted as the code stream capable of being decoded correctly, and forwarding the code stream.
In the system for encoding and decoding data provided by the present application, as a receiving party, the receiving party may include a data decoding device 64 or a forwarding device 66, where the forwarding device 66 may include a relay such as an SFU, an MCU, or the like;
after receiving an RTP stream (i.e., a data packet to be transmitted provided by the present application), an extension header of the RTP stream is analyzed to obtain a reference relationship between video frames, and it can be determined whether a currently received H264 code stream is a frame that can be correctly decoded with a very low load or a low calculation cost, thereby improving the overall video communication efficiency.
Example 6
According to another aspect of another embodiment of the present invention, there is also provided a storage medium including a stored program, wherein when the program is executed, a device on which the storage medium is located is controlled to perform: coding a frame to be coded according to the reference frame to obtain a code stream to be transmitted; generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; and packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain the data packet to be transmitted.
Example 7
According to another aspect of another embodiment of the present invention, there is also provided a processor for executing a program, wherein the program executes to perform: coding a frame to be coded according to the reference frame to obtain a code stream to be transmitted; generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; and packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain the data packet to be transmitted.
Example 8
The embodiment of the invention also provides a storage medium. Optionally, in this embodiment, the storage medium may be configured to store a program code executed by the data encoding method provided in the first embodiment.
Optionally, in this embodiment, the storage medium may be located in any one of computer terminals in a computer terminal group in a computer network, or in any one of mobile terminals in a mobile terminal group.
Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: coding a frame to be coded according to the reference frame to obtain a code stream to be transmitted, wherein the code stream to be transmitted comprises: the first picture identification is used for representing a frame to be coded; generating code stream information according to a first picture identification code in a code stream to be transmitted and a second picture identification code of a reference frame; and packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain the data packet to be transmitted.
Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: encoding a frame to be encoded according to a reference frame to obtain a code stream to be transmitted, comprising: and under the condition that the frame closest to the frame to be coded is taken as the reference frame, coding the frame to be coded according to the frame closest to the frame to be coded as the reference frame to obtain the code stream to be transmitted.
Further, optionally, in the present embodiment, the storage medium is configured to store program code for performing the following steps: the encoding of the frame to be encoded according to the frame closest to the frame to be encoded as a reference frame comprises: acquiring a picture identification code with preset digits increasing monotonically for a frame to be coded, wherein the picture identification code is used for marking the frame to be coded; obtaining a picture identification code of the reference frame according to the picture identification code; and coding the frame to be coded according to the picture identification code of the frame to be coded and the picture identification code of the reference frame to obtain a code stream to be transmitted.
Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: generating the extension header according to the code stream information comprises: acquiring a reference frame picture identification relation between a first picture identification code and a second picture identification code in code stream information; and generating an expansion head according to the relation between the first picture identification code in the code stream information and the reference frame picture identification code.
Further, optionally, in the present embodiment, the storage medium is configured to store program code for performing the following steps: the method for acquiring the reference frame picture identification relationship between the first picture identification code and the second picture identification code in the code stream information comprises the following steps: acquiring a picture identification residual error between the first picture identification code and the second picture identification code; determining the picture identification residual as a reference frame picture identification relationship.
Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: encoding a frame to be encoded according to a reference frame to obtain a code stream to be transmitted, comprising: and under the condition that the frame which is separated from the frame to be coded by the preset bit is taken as the reference frame, coding the frame to be coded according to the frame which is separated from the frame to be coded by the preset bit as the reference frame to obtain the code stream to be transmitted.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (12)
1. A method of data encoding, comprising:
coding a frame to be coded according to the reference frame to obtain a code stream to be transmitted, wherein the code stream to be transmitted comprises: a first picture identifier, configured to represent the frame to be encoded;
generating code stream information according to the first picture identification code in the code stream to be transmitted and the second picture identification code of the reference frame;
and packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain a data packet to be transmitted.
2. The data encoding method according to claim 1, wherein the encoding the frame to be encoded according to the reference frame to obtain the code stream to be transmitted includes:
and under the condition that the frame closest to the frame to be coded is taken as a reference frame, coding the frame to be coded according to the frame closest to the frame to be coded as the reference frame to obtain the code stream to be transmitted.
3. The method of data encoding according to claim 2, wherein said encoding the frame to be encoded according to the frame closest to the frame to be encoded as a reference frame comprises:
acquiring a picture identification code with preset digits increasing monotonically for the frame to be coded, wherein the picture identification code is used for marking the frame to be coded;
obtaining the picture identification code of the reference frame according to the picture identification code;
and coding the frame to be coded according to the picture identification code of the frame to be coded and the picture identification code of the reference frame to obtain the code stream to be transmitted.
4. The data encoding method of claim 1, wherein the generating an extension header according to the codestream information comprises:
acquiring a reference frame picture identification relation between the first picture identification code and the second picture identification code in the code stream information;
and generating the extension head according to the relation between the first picture identification code and the reference frame picture identification code in the code stream information.
5. The data encoding method according to claim 4, wherein the obtaining of the reference frame picture identification relationship between the first picture identification code and the second picture identification code in the codestream information includes:
acquiring a picture identification residual error between the first picture identification code and the second picture identification code;
and determining the picture identification residual as the reference frame picture identification relation.
6. The data encoding method according to claim 1, wherein the encoding the frame to be encoded according to the reference frame to obtain the code stream to be transmitted includes:
and under the condition that a frame which is separated from the frame to be coded by a preset bit is taken as a reference frame, coding the frame to be coded according to the frame which is separated from the frame to be coded by the preset bit as the reference frame, and obtaining the code stream to be transmitted.
7. A method of data decoding, comprising:
receiving a data packet to be transmitted;
analyzing the data packet to be transmitted to obtain an extension header;
and acquiring a reference frame according to the expansion head, and decoding according to the reference frame to obtain a code stream to be displayed.
8. The data decoding method according to claim 7, wherein the obtaining a reference frame according to the extended header and decoding according to the reference frame to obtain a code stream to be displayed comprises:
acquiring a reference frame in the extension header;
judging whether all reference frames are received or not;
and under the condition that the judgment result is yes, decoding according to the reference frame to obtain a code stream to be displayed.
9. An apparatus for encoding data, comprising:
the encoding module is configured to encode a frame to be encoded according to a reference frame to obtain a code stream to be transmitted, where the code stream to be transmitted includes: a first picture identifier, configured to represent the frame to be encoded;
the information generation module is used for generating code stream information according to the first picture identification code in the code stream to be transmitted and the second picture identification code of the reference frame;
and the packaging module is used for packaging the code stream to be transmitted and generating an expansion head according to the code stream information to obtain a data packet to be transmitted.
10. An apparatus for data decoding, comprising:
the receiving module is used for receiving the data packet to be transmitted;
the analysis module is used for analyzing the data packet to be transmitted to obtain an expansion head;
and the decoding module is used for acquiring a reference frame according to the expansion head and decoding according to the reference frame to obtain a code stream to be displayed.
11. A system for encoding and decoding data, comprising: a data encoding device, a data decoding device, and a forwarding device, wherein,
the data encoding device is configured to encode a frame to be encoded according to a reference frame to obtain a code stream to be transmitted, where the code stream to be transmitted includes: a first picture identifier, configured to represent the frame to be encoded; generating code stream information according to the first picture identification code in the code stream to be transmitted and the second picture identification code of the reference frame; packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain a data packet to be transmitted;
the data decoding device is used for receiving the data packet to be transmitted; analyzing the data packet to be transmitted to obtain an extension header; acquiring a reference frame according to the expansion head, and decoding according to the reference frame to obtain a code stream to be displayed;
the forwarding device is respectively connected with the data encoding device and the data decoding device, and is used for analyzing the extension header in the data packet to be transmitted when the data packet to be transmitted with a discontinuous serial number is received, determining the code stream of an effective decoding frame in the data packet to be transmitted as a code stream capable of being decoded correctly, and forwarding the code stream.
12. A storage medium comprising a stored program, wherein the program, when executed, controls an apparatus on which the storage medium is located to perform: coding a frame to be coded according to the reference frame to obtain a code stream to be transmitted, wherein the code stream to be transmitted comprises: a first picture identifier, configured to represent the frame to be encoded; generating code stream information according to the first picture identification code in the code stream to be transmitted and the second picture identification code of the reference frame; and packaging the code stream to be transmitted, and generating an expansion head according to the code stream information to obtain a data packet to be transmitted.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810725166.8A CN110691212A (en) | 2018-07-04 | 2018-07-04 | Method and system for coding and decoding data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810725166.8A CN110691212A (en) | 2018-07-04 | 2018-07-04 | Method and system for coding and decoding data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110691212A true CN110691212A (en) | 2020-01-14 |
Family
ID=69106533
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810725166.8A Pending CN110691212A (en) | 2018-07-04 | 2018-07-04 | Method and system for coding and decoding data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110691212A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113573063A (en) * | 2021-06-16 | 2021-10-29 | 百果园技术(新加坡)有限公司 | Video coding and decoding method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1775954A1 (en) * | 2005-10-14 | 2007-04-18 | Thomson Licensing | Method and apparatus for reconstructing a video frame for spatial multi-layer video sequence |
| CN104253996A (en) * | 2014-09-18 | 2014-12-31 | 中安消技术有限公司 | Video data sending and receiving methods, video data sending and receiving devices and video data transmission system |
| CN104980763A (en) * | 2014-04-05 | 2015-10-14 | 浙江大学 | Video code stream and video encoding and decoding method and device |
| CN105847825A (en) * | 2015-01-16 | 2016-08-10 | 杭州海康威视数字技术股份有限公司 | Encoding, index storage and access methods for video encoding code stream and corresponding apparatus |
| CN108076346A (en) * | 2017-12-21 | 2018-05-25 | 北京奇艺世纪科技有限公司 | A kind of image coding/decoding method and device |
-
2018
- 2018-07-04 CN CN201810725166.8A patent/CN110691212A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1775954A1 (en) * | 2005-10-14 | 2007-04-18 | Thomson Licensing | Method and apparatus for reconstructing a video frame for spatial multi-layer video sequence |
| CN104980763A (en) * | 2014-04-05 | 2015-10-14 | 浙江大学 | Video code stream and video encoding and decoding method and device |
| CN104253996A (en) * | 2014-09-18 | 2014-12-31 | 中安消技术有限公司 | Video data sending and receiving methods, video data sending and receiving devices and video data transmission system |
| CN105847825A (en) * | 2015-01-16 | 2016-08-10 | 杭州海康威视数字技术股份有限公司 | Encoding, index storage and access methods for video encoding code stream and corresponding apparatus |
| CN108076346A (en) * | 2017-12-21 | 2018-05-25 | 北京奇艺世纪科技有限公司 | A kind of image coding/decoding method and device |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113573063A (en) * | 2021-06-16 | 2021-10-29 | 百果园技术(新加坡)有限公司 | Video coding and decoding method and device |
| WO2022262602A1 (en) * | 2021-06-16 | 2022-12-22 | 百果园技术(新加坡)有限公司 | Video coding and decoding method and apparatus |
| CN113573063B (en) * | 2021-06-16 | 2024-06-14 | 百果园技术(新加坡)有限公司 | Video encoding and decoding method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5778672B2 (en) | Backward looking robust header compression receiver | |
| US8358688B2 (en) | Method for transmitting moving image data and communication apparatus | |
| KR101122143B1 (en) | Signaling buffer parameters indicative of receiver buffer architecture | |
| US8953671B2 (en) | Codec capability negotiation method and terminal thereof | |
| CN113766317A (en) | Video transmission method, video transmission device, electronic equipment and storage medium | |
| CN105191248A (en) | Method and apparatus for packet header compression | |
| CN110740380A (en) | Video processing method and device, storage medium and electronic device | |
| KR101959319B1 (en) | Video data encoding and decoding methods and apparatuses | |
| CN108419041B (en) | Video data processing method and device | |
| US20140092997A1 (en) | Error resilient transmission of random access frames and global coding parameters | |
| CN104270594A (en) | Data packet sending and receiving method and device | |
| US9936266B2 (en) | Video encoding method and apparatus | |
| CN1939060B (en) | Method and device for promoting flow type transmission of video frequency information | |
| CN110691212A (en) | Method and system for coding and decoding data | |
| CN113301051A (en) | Data transmission method and device, computer storage medium and processor | |
| CN115604481B (en) | Method, device and system for improving parallelism of encoding and decoding and transmission | |
| CN101296166B (en) | Method for measuring multimedia data based on index | |
| JP2007324876A (en) | Data transmitter, data receiver, data transmitting method, data receiving method, and program | |
| CN115103228A (en) | Video streaming transmission method, device, electronic equipment, storage medium and product | |
| CN101401373B (en) | Encoded stream sending device | |
| US20140348076A1 (en) | Communication system and method | |
| CN105407351A (en) | Method and apparatus for reconstructing encoding mode from real-time transport protocol packet | |
| US11778219B2 (en) | Method and system for live video streaming with integrated encoding and transmission semantics | |
| WO2023078048A1 (en) | Video bitstream encapsulation method and apparatus, video bitstream decoding method and apparatus, and video bitstream access method and apparatus | |
| WO2024032107A1 (en) | Method, apparatus, and medium for visual data processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200114 |
|
| RJ01 | Rejection of invention patent application after publication |