CN117336534A - Data transmission method, device, electronic equipment and storage medium - Google Patents
Data transmission method, device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN117336534A CN117336534A CN202311286847.6A CN202311286847A CN117336534A CN 117336534 A CN117336534 A CN 117336534A CN 202311286847 A CN202311286847 A CN 202311286847A CN 117336534 A CN117336534 A CN 117336534A
- Authority
- CN
- China
- Prior art keywords
- reference frame
- frame
- target reference
- receiving end
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 68
- 230000005540 biological transmission Effects 0.000 title claims abstract description 41
- 238000011084 recovery Methods 0.000 claims abstract description 21
- 230000007774 longterm Effects 0.000 claims description 42
- 230000002596 correlated effect Effects 0.000 claims description 3
- 230000006870 function Effects 0.000 description 12
- 238000012545 processing Methods 0.000 description 11
- 238000004590 computer program Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 7
- 230000000875 corresponding effect Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000000903 blocking effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
- H04N21/2353—Processing of additional data, e.g. scrambling of additional data or processing content descriptors specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Library & Information Science (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The present disclosure relates to a data transmission method, apparatus, electronic device, and storage medium, where the method includes: acquiring multimedia data transmitted by a transmitting end, and acquiring decodable frame information based on the multimedia data; transmitting the decodable frame information to the transmitting terminal; and acquiring a target reference frame sent by the sending end, and carrying out data recovery on the multimedia data based on the target reference frame. Because the target reference frame is generated based on the decodable frame information, when the multimedia data received by the receiving end has the packet loss phenomenon, the receiving end can realize the rapid recovery of the packet loss data according to the received target reference frame, so that a decoder can decode the multimedia data conveniently, and further the phenomena of video jamming and the like are avoided.
Description
Technical Field
The disclosure relates to the field of network technologies, and in particular, to a data transmission method, a data transmission device, electronic equipment and a storage medium.
Background
With the continuous development of networks, a user is unavoidably stuck in the process of watching a video. To solve the video clip problem, the related art generally needs to retransmit the data packet.
Video clip may be caused by packet loss or network congestion. If the network congestion is caused, the video jam is aggravated by the retransmission of the data packet, so that the efficiency of the related technology in solving the video jam is lower.
Disclosure of Invention
The disclosure provides a data transmission method, a data transmission device, electronic equipment and a storage medium.
According to a first aspect of the present disclosure, there is provided a data transmission method, the method being used for a receiving end, the method including:
acquiring multimedia data transmitted by a transmitting end, and acquiring decodable frame information based on the multimedia data;
transmitting the decodable frame information to the transmitting terminal;
and acquiring a target reference frame sent by the sending end, and carrying out data recovery on the multimedia data based on the target reference frame.
According to a second aspect of the present disclosure, there is provided a data transmission method, the method being used for a transmitting end, the method including:
transmitting multimedia data to a receiving end, and acquiring decodable frame information transmitted by the receiving end;
and generating a target reference frame based on the decodable frame information, and transmitting the target reference frame to the receiving end.
According to a third aspect of the present disclosure, there is provided a data transmission apparatus for a receiving end, the apparatus comprising:
the multimedia data acquisition module is used for acquiring the multimedia data sent by the sending end;
a decodable frame information obtaining module for obtaining decodable frame information based on the multimedia data;
the information sending module is used for sending the decodable frame information to the sending end;
the target reference frame receiving module is used for acquiring a target reference frame sent by the sending end;
and the data recovery module is used for carrying out data recovery on the multimedia data based on the target reference frame.
According to a fourth aspect of the present disclosure, there is provided a data transmission apparatus, the apparatus being used at a transmitting end, the apparatus comprising:
the multimedia data transmitting module is used for transmitting the multimedia data to the receiving end;
the information acquisition module is used for acquiring the decodable frame information sent by the receiving end;
a target reference frame generation module for generating a target reference frame based on the decodable frame information;
and the target reference frame sending module is used for sending the target reference frame to the receiving end.
According to a fifth aspect of the present disclosure, an electronic device is provided. The electronic device includes: a memory and a processor, the memory having stored thereon a computer program, the processor implementing the method as described above when executing the program.
According to a sixth aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program which when executed by a processor implements the above-described method of the present disclosure.
According to the data transmission method, the data transmission device, the electronic equipment and the storage medium, the multimedia data sent by the sending end are obtained, the received decodable frame information can be obtained based on the multimedia data, and the decodable frame information is sent to the sending end. And acquiring a target reference frame sent by the sending end, and carrying out data recovery on the multimedia data based on the target reference frame. Because the target reference frame is generated based on the decodable frame information, when the multimedia data received by the receiving end has the packet loss phenomenon, the receiving end can realize the rapid recovery of the packet loss data according to the received target reference frame, so that a decoder can decode the multimedia data conveniently, and further the phenomena of video jamming and the like are avoided.
Drawings
Further details, features and advantages of the present disclosure are disclosed in the following description of exemplary embodiments, with reference to the following drawings, wherein:
FIG. 1 is a schematic illustration of a scenario provided by an exemplary embodiment of the present disclosure;
Fig. 2 is a flowchart of a data transmission method according to an exemplary embodiment of the present disclosure;
fig. 3 is a flowchart of a data transmission method according to still another exemplary embodiment of the present disclosure;
fig. 4 is a schematic block diagram of functional modules of a data transmission apparatus according to an exemplary embodiment of the present disclosure;
FIG. 5 is a block diagram of an electronic device provided in an exemplary embodiment of the present disclosure;
fig. 6 is a block diagram of a computer system according to an exemplary embodiment of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below. It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.
It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.
The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
It will be appreciated that prior to using the technical solutions disclosed in the embodiments of the present disclosure, the user should be informed and authorized of the type, usage range, usage scenario, etc. of the personal information related to the present disclosure in an appropriate manner according to the relevant legal regulations.
For example, in response to receiving an active request from a user, a prompt is sent to the user to explicitly prompt the user that the operation it is requesting to perform will require personal information to be obtained and used with the user. Thus, the user can autonomously select whether to provide personal information to software or hardware such as an electronic device, an application program, a server or a storage medium for executing the operation of the technical scheme of the present disclosure according to the prompt information.
As an alternative but non-limiting implementation, in response to receiving an active request from a user, the manner in which the prompt information is sent to the user may be, for example, a popup, in which the prompt information may be presented in a text manner. In addition, a selection control for the user to select to provide personal information to the electronic device in a 'consent' or 'disagreement' manner can be carried in the popup window. It will be appreciated that the above-described notification and user authorization process is merely illustrative and not limiting of the implementations of the present disclosure, and that other ways of satisfying relevant legal regulations may be applied to the implementations of the present disclosure.
In order to improve the transmission efficiency in the data transmission process, the problems of blocking and the like in the video are solved. As shown in fig. 1, in the embodiment provided in the present disclosure, a transmitting end 10 may transmit multimedia data, which may be data such as video or audio/video, to a receiving end 30 through a server 20. In the embodiment, the multimedia data is taken as an example of video, and the embodiment is not limited thereto.
Because the receiver 30 may have a blocking condition during the process of receiving the video transmitted by the transmitter 10 due to factors such as network bandwidth, the receiver 30 may transmit the decodable frame information to the transmitter 10 when receiving the decodable video frame, where the decodable frame information includes the frame number of the decodable video frame. In an embodiment, the decodable frames are video frames that the decoder is capable of decoding, or the dependence is that the video frames are decodable by the decoder (by which the dependent frames can be recovered), which in an embodiment may also be decodable frames.
In an embodiment, when the receiving end 30 sends the decodable frame information to the sending end 10, the decodable frame information may carry the frame number of the decodable frame with the history of at most, for example, if the decodable frame information may carry the frame number of 10 decodable frames at a time, the receiving end 30 may also include the frame number of the current decodable frame and the frame number of the decodable frame adjacent to the current decodable frame in the decodable frame information, that is, the decodable frame information may include the frame number of one current decodable frame and the frame number of the decodable frame adjacent to the frame number of the current decodable frame in 9 histories.
In the embodiment, the receiving end 30 may immediately transmit the decodable frame information including the frame number of the resolvable frame to the transmitting end 10 when one resolvable frame is currently obtained, may also transmit the decodable frame information including the frame number of the resolvable frame at intervals, or may transmit the decodable frame information including the frame numbers of the N resolvable frames to the transmitting end when N resolvable frames are accumulated and received at a time, and the embodiment is not limited thereto. Wherein N is a positive integer. When receiving the decodable frame information sent by the receiving end 30, the sending end 10 can know which decodable frames are received by the receiving end 30, so that a target reference frame is generated based on the decodable frames, and the receiving end 30 can perform data recovery on the data of the undegradable frames or the packet loss through the target reference frame. The non-decodable frames may comprise video frames that cannot be decoded by a decoder, or frames on which they depend cannot be decoded by a decoder. The target reference frame may be a long-term reference frame or a key frame.
In an embodiment, the receiving end 30 may also send packet loss information to the sending end 10, where the packet loss information may be determined according to a packet sequence number of a data packet received by the receiving end 30, for example, if the receiving end 30 indicates that there is a packet loss according to a discontinuity of the sequence numbers of the received data packets, the packet loss information may be generated, and the packet loss information may be sent to the sending end 10. When receiving the packet loss information sent by the receiving end 30, the sending end 10 can determine that the receiving end 30 has the packet loss phenomenon, generate a target reference frame according to the decodable frame information sent by the receiving end 30, and send the target reference frame to the receiving end 30, so that the receiving end 30 can conveniently realize data recovery according to the target reference frame.
In the embodiment, if the sequence numbers of the data packets received by the receiving end 30 are continuous, it can be confirmed that there is no packet loss at this time, and the data packets are likely to be in a non-disordered scene caused by deep buffer congestion. At this time, the receiving end 30 may send the non-disordered information of the data packet to the sending end 10, and inform the sending end 30 that there is no packet loss, so that when the sending end 10 receives the non-disordered information of the data packet, the receiving end 30 will not send the target reference frame, thereby avoiding further deepening the network congestion. The target reference frame in the embodiment may be a long-term reference frame or a key frame, etc. used by the receiving end 30 to recover the packet loss data, where the target reference frame is generated based on the resolvable frame received by the receiving end 30.
In an embodiment, the receiving end 30 may actively request the target reference frame from the transmitting end 10, and may also passively receive the target reference frame sent by the transmitting end 10.
The receiving end 30 may actively request the target reference frame from the transmitting end 30 when the target condition is satisfied. The target condition may be that the receiving end 30 sends a target reference frame request to the transmitting end 10 when the receiving end 30 does not receive the resolvable frame or there is a packet loss condition beyond a target duration. In an embodiment, the target duration may be a threshold, which may be represented by threshold, where:
threshold ＝ 2*(T1+ T2) + T3/10 * N (1)
Where T1 represents a frame interval, T2 represents a reception jitter or a network jitter, T3 represents a time interval from the last packet loss, N is a constant, and may be set as needed, for example, N may be 100ms, and the embodiment is not limited thereto. In the embodiment, the maximum value of threshold may be 500ms or 1.5 times the minimum frame interval.
In an embodiment, if there is a packet loss, the receiving end 30 may send a target reference frame request to the sending end 10 in time, or the sending end 10 actively sends a target reference frame to the receiving end 30. If no packet loss exists, whether the packet loss exists is further judged, and the situation that the network congestion is caused when the transmitting end 10 transmits the target reference frame to the receiving end is avoided.
In the embodiment provided in the present disclosure, when receiving the decodable frame information sent by the receiving end 30, the sending end 10 stores the frame number of the decodable frame in the decodable information into a buffer frame list, where the buffer frame list is used to characterize which frames in the video frames received by the receiving end 30 are decodable video frames, so that the sending end 10 is convenient to generate a target reference frame according to the decodable frames in the buffer frame list.
In an embodiment, the target reference frame may be a key frame, or may be a long-term reference frame. That is, the transmitting end 10 may encode a key frame or encode a long-term reference frame according to the current resolvable frame of the receiving end 30, and use the encoded key frame or the long-term reference frame as a target reference frame, and send the target reference frame to the receiving end 30, so that the receiving end 30 can recover the lost packet data according to the target reference frame.
In an embodiment, the transmitting end 10 may determine the key frame or the long-term reference frame according to the complexity of the image texture and the complexity of the long-term reference frame with the previous frame, if the image texture is complex, but the current frame is greatly changed (for example, the data size exceeds the preset threshold value) compared with the long-term reference frame with the previous frame, the key frame is used as the target reference frame, or the image texture is relatively simple, or the key frame is also encoded, otherwise, the long-term reference frame is encoded. The size of the image can be compared with a relevant threshold value, for example, the image frame is smaller than the threshold value, so that the image texture is simple and not complex; otherwise, the image texture may be regarded as relatively complex. In this embodiment, for example, a key frame and a long-term reference frame may be generated according to the current resolvable frame of the transmitting end 30, and by comparing the size relationship between the key frame and the long-term reference frame, a smaller data amount may be selected as the target reference frame. Thus, the transmitting end 10 is convenient to transmit the target reference frame to the receiving end 30, and network congestion or aggravating packet loss caused by oversized target reference frame is avoided. The key frame or the long-term reference frame in the embodiment can be understood as a generated key frame or a generated long-term reference frame.
In the embodiment, in order to reduce the situation that the calculation amount is large due to the fact that the key frame and the long-term reference frame are respectively encoded, the adjacent previous key frame and the previous long-term reference frame can be respectively referred to, the sizes of the previous key frame and the previous long-term reference frame are compared to serve as judgment basis, and the data amount of the previous key frame is larger than that of the previous reference frame, so that the long-term reference frame can be encoded as the target reference frame.
In an embodiment, the long-term reference frame may be an SP frame, for example, a current SP frame and a previous key frame may be compared to each other. For example, both may be coded to compare their sizes. Alternatively, if the interval between the previous SP-frame and the current frame is small (e.g., the interval is less than a threshold), the SP-frame may be used as a long-term reference frame, and if the interval is large, the size between the long-term reference frame and the key frame may be compared. Assuming that the reference long-term reference frame has exceeded 5 seconds, it is determined whether to encode a key frame or an SP as the long-term reference frame by comparing the sizes of the two.
In the embodiment, the sending end 10 needs to meet the minimum transmission interval to send the long-term reference frame to the receiving end 30, namely:
min_interval_ms ＝ min(avg_ack_elase_ms,150) (2)
wherein min_interval_ms represents a minimum transmission interval for transmitting a long-term reference frame, and avg_ack_elase_ms represents an average feedback delay; min_interval_ms takes the minimum between the average feedback delay, which may be the average delay time of the receiving end 30, and 150 ms.
In the embodiment provided in the present disclosure, the transmitting end 10 may actively generate a long-term reference frame according to the received decodable frame information, that is, the transmitting end 10 transmits a target reference frame to the receiving end 30 every time a period after receiving the decodable frame information transmitted by the receiving end 30. The closer the transmitting end 10 is to the last time when the receiving end 30 receives the request of the target reference frame, or the closer is to the receiving end 30 when the feedback of the packet loss information, the smaller the time interval of the transmitting end 10 for transmitting the target reference frame to the receiving end 30, and the smaller the duration of the transmitting the target reference frame; conversely, the larger the time interval, the greater the duration. Therefore, the data transmission of the target reference frame when the receiving end does not need the target reference frame to recover the data can be reduced as much as possible, and the data transmission efficiency of the target reference frame is improved. In addition, in the embodiment of the disclosure, the allocation of network bandwidth can be performed by combining the target reference frame and the forward redundancy.
Specifically, the base code rate (i.e., P-frame code rate) allocated to the video may be obtained by obtaining the current available bandwidth of the video, obtaining the minimum code rate and the maximum code rate constraint of the video, and dividing the available bandwidth by the sum of the required retransmission redundancy rate, the redundancy rate required by the target reference frame, and the redundancy rate required by the forward redundancy. The residual bandwidth allocation retransmission bandwidth can be obtained by obtaining the base bandwidth of the video and subtracting the video base bandwidth from the video available bandwidth, and if the residual bandwidth allocation retransmission bandwidth is less than 0, the method needs to be finished in advance. Otherwise, obtaining the retransmission budget bandwidth, subtracting the retransmission budget bandwidth from the residual bandwidth, and performing bandwidth allocation of the target reference frame of the residual bandwidth, if the obtained residual bandwidth is smaller than 0, ending in advance, otherwise, obtaining the bandwidth required by the target reference frame. The subsequent step can be finished in advance if the residual bandwidth is smaller than 0 by subtracting the retransmission bandwidth from the residual bandwidth; otherwise, the bandwidth required by the forward redundancy is obtained, and the corresponding bandwidth is allocated for the forward redundancy.
Based on the foregoing embodiments, in still another embodiment provided by the present disclosure, there is further provided a data transmission method, as shown in fig. 2, where the method may be applied to a receiving end, and the method may include the following steps:
in step S210, multimedia data transmitted from a transmitting end is acquired, and decodable frame information is acquired based on the multimedia data.
In the embodiment, the transmitting end may send the multimedia data to the receiving end, and the embodiment may be described by taking the multimedia data as video as an example, which is not limited thereto.
In step S220, the decodable frame information is transmitted to the transmitting end.
In an embodiment, during the process of receiving a video frame, if the received video frame is a decodable video frame, the sending end may send decodable frame information including a frame number of the decodable video frame to the sending end. The transmitting end may transmit the decodable frame information to the transmitting end immediately upon receiving the decodable video frame, and may also transmit the decodable frame information to the transmitting end once at intervals, and the decodable frame information may include frame numbers of a plurality of historical decodable frames. Since the decodable frame information contains the frame number of the decodable frame, the data amount is not very large, so that the network transmission is not greatly affected.
In step S230, a target reference frame sent by the sender is acquired, and data recovery is performed on the multimedia data based on the target reference frame.
The receiving end sends the decodable frame information to the sending end, so that the sending end can generate a target reference frame based on the received decodable frame information, and the data rapid recovery of the multimedia data can be realized based on the target reference frame under the condition that the receiving end loses packets and the like.
According to the data transmission method provided by the embodiment of the disclosure, the received decodable frame information can be obtained by acquiring the multimedia data sent by the sending end and based on the multimedia data, and the decodable frame information is sent to the sending end. And acquiring a target reference frame sent by the sending end, and carrying out data recovery on the multimedia data based on the target reference frame. Because the target reference frame is generated based on the decodable frame information, when the multimedia data received by the receiving end has the packet loss phenomenon, the receiving end can realize the rapid recovery of the packet loss data according to the received target reference frame, so that a decoder can decode the multimedia data conveniently, and further the phenomena of video jamming and the like are avoided.
Based on the above embodiments, in the embodiments provided in the present disclosure, the receiving end may also actively send a target reference frame request to the transmitting end. Thus, the method may further comprise the steps of:
In step S240, the receiving end sends a target reference frame request to the transmitting end when the target condition is satisfied.
In an embodiment, the target condition may include: at least one of a decodable frame not received and a packet loss condition exists beyond a target duration.
In an embodiment, the target duration may be determined by acquiring a frame interval, network jitter information, and a packet loss duration between adjacent frames in the multimedia data, and determining the target duration based on the frame interval, the network jitter information, and the packet loss duration. If the receiving end does not receive the video frame which can be decoded under the condition that the target duration is exceeded, or the receiving end does not receive the video frame under the condition that the target duration is exceeded, the receiving end can send a target reference frame request to the sending end, so that the sending end can send the target reference frame to the receiving end when receiving the target reference frame request, and the receiving end can recover the lost packet data based on the target reference frame. See the above formula (1), and will not be described here again.
In an embodiment, a receiving end obtains multimedia data sent by a sending end, and the multimedia data can be transmitted in the form of a data packet, and the receiving end indicates that a packet loss exists by judging whether the received data packet has disorder or not through the obtained sequence number of the data packet, for example, the received data packet has discontinuous sequence number of the data packet.
Therefore, in the embodiment, when at least one of the decodable frame and the packet loss exists in the decodable frame is not received beyond the target duration, the target reference frame request can be sent to the sending end, so that the sending end sends the target reference frame generated based on the decodable frame information to the receiving end when receiving the target reference frame request, and the receiving end can realize the data recovery of the packet loss data based on the target reference frame.
In the embodiment provided by the disclosure, the receiving end can also actively send the packet loss information to the sending end, so that the sending end can send the target reference frame to the receiving end according to the packet loss information. Thus, the method may further comprise the steps of:
step S250, obtain the data packet sequence number based on the multimedia data.
Step S260, generating packet loss information based on the data packet sequence number, and sending the packet loss information to the sending end.
In the embodiment, the data packet received by the receiving end carries a sequence number, when the sending end sends the data packet to the receiving end, the sequence number of the data packet is continuous, so when the receiving end receives the data packet sent by the sending end, if the data packet is discontinuous based on the sequence number of the data packet, the situation that the data packet is lost in the transmission process of the data packet is indicated, and otherwise, the situation that the data packet is lost is not indicated in the description. Thus, the packet loss information can be generated according to the received data packet sequence number, and the packet loss information is sent to the sending terminal.
Based on the foregoing embodiments, in still another embodiment provided by the present disclosure, as shown in fig. 3, there is further provided a data transmission method, where the method may be applied to a transmitting end, and the method may include the following steps:
in step S310, multimedia data is transmitted to the receiving end, and decodable frame information transmitted by the receiving end is obtained.
In step S320, a target reference frame is generated based on the decodable frame information, and the target reference frame is transmitted to the receiving end.
In an embodiment, the transmitting end may transmit multimedia data to the receiving end, for example, the transmitting end may transmit audio and video data to the receiving end, and the transmitting end may acquire decodable frame information transmitted by the receiving end.
In an embodiment, the decodable frame information includes a frame number of a decodable frame received by the receiving end, so that the transmitting end can know which decodable frames are received by both receiving ends currently according to the frame number of the decodable frame in the decodable frame information. And the transmitting end can generate a target reference frame according to the decodable frame information, wherein the target reference frame can be a key frame or a long-term reference frame, and the target reference frame is transmitted to the receiving end. Thus, the receiving end can realize the rapid recovery of the lost packet data according to the received target reference frame.
In an embodiment, the transmitting end may send the target reference frame to the receiving end when receiving the target reference frame request sent by the receiving end, or when receiving the packet loss information sent by the receiving end. Because the transmitting end indicates that the receiving end has the packet loss phenomenon when receiving the target reference frame request or the packet loss information sent by the receiving end, and needs to recover the data of the packet loss as soon as possible, the transmitting end needs to send the target reference frame to the receiving end under the condition, so that the receiving end can realize the data recovery of the data of the packet loss based on the received target reference frame.
In the embodiment, in the process of generating the target reference frame by the transmitting end based on the decodable frame information, the target reference frame may be generated by acquiring the interval duration of generating the target reference frame and based on the interval duration. The interval time length is positively correlated with the time length between the interval time length and the target time, and the target time comprises the time when the receiving end sends the packet loss information. For example, the sending end corresponds to the time when the packet loss information is received, or the sending time carried in the packet loss information. In addition, the target time may further include a time corresponding to the target reference frame request received by the transmitting end, or a transmitting time carried in the target reference frame request.
In an embodiment, the target reference frame may be a key frame or a long term reference frame. When the sending end determines to be the key frame or the long-term reference frame as the target reference frame, the sending end can consider the data size of the key frame or the long-term reference frame and can select the smaller data size as the target reference frame. For example, a first amount of data of a key frame generated based on the decodable frame information and a second amount of data of a long-term reference frame generated based on the decodable frame information may be obtained. And determining the long-term reference frame as a target reference frame if the first amount of data is greater than the second amount; alternatively, the key frame is determined to be the target reference frame in the event that the first amount of data is not greater than the second amount. The sending end can obtain the data size of the key frame or the long-term reference frame in advance, and select the key frame or the long-term reference frame as the target reference frame based on the data size of the key frame or the long-term reference frame. Of course, in order to reduce the complexity of calculation as much as possible, when judging the sizes of the two data amounts, the sizes of the data amounts of the key frame and the long-term reference frame (such as the SP frame) of the previous frame can be referred to, so that the need of simultaneously encoding the key frame and the long-term reference frame can be avoided, and the calculation amount can be reduced.
In the embodiment provided by the disclosure, the available bandwidth can be reasonably allocated according to the current available bandwidth, for example, the available bandwidth is allocated with the basic code rate (including the P frame code rate) of the video respectively according to the priority order, and then the retransmission bandwidth, the target reference frame and the forward redundancy bandwidth are subdivided. Therefore, in the video transmission process, the current available bandwidth can be acquired, and if the current available bandwidth is larger than the threshold value, the target bandwidth is allocated to the target reference frame, and the target reference frame is sent to the receiving end based on the target bandwidth. In the video transmission process, the transmission of the video already occupies the bandwidth of the basic code rate, so that the bandwidth is convenient to be reasonably allocated for the transmission target reference frame by detecting whether the current available bandwidth is larger than a threshold value. For example, when the current available bandwidth is smaller than the threshold value, it is indicated that the current available bandwidth is too small, the sending of the target reference frame can be stopped, the aggravation of network blocking is avoided, otherwise, the bandwidth can be allocated to the target reference frame for network transmission through the current available bandwidth.
In the case of dividing each functional module by corresponding each function, the embodiments of the present disclosure provide a data transmission device, which may be a server or a chip applied to the server. Fig. 4 is a schematic block diagram of functional modules of a data transmission apparatus according to an exemplary embodiment of the present disclosure. As shown in fig. 4, the apparatus is used at a receiving end, and the data transmission apparatus includes:
A multimedia data acquisition module 11, configured to acquire multimedia data sent by a sending end;
a decodable frame information obtaining module 12 for obtaining decodable frame information based on the multimedia data;
an information sending module 13, configured to send the decodable frame information to the sending end;
a target reference frame receiving module 14, configured to obtain a target reference frame sent by the sending end;
and the data recovery module 15 is used for carrying out data recovery on the multimedia data based on the target reference frame.
In yet another embodiment provided by the present disclosure, the apparatus further comprises:
and sending a target reference frame request to the sending end under the condition that the target condition is met.
In yet another embodiment provided by the present disclosure, the target condition includes: at least one of a decodable frame not received and a packet loss condition exists beyond a target duration.
In yet another embodiment provided by the present disclosure, the apparatus further comprises:
the data acquisition module is used for acquiring frame intervals, network jitter information and packet loss time length between adjacent frames in the multimedia data;
and the target duration determining module is used for determining the target duration based on the frame interval, the network jitter information and the packet loss duration.
In yet another embodiment provided by the present disclosure, the apparatus further comprises:
the sequence number receiving module is used for acquiring a data packet sequence number based on the multimedia data;
and the packet loss information sending module is used for generating packet loss information based on the data packet sequence number and sending the packet loss information to the sending end.
Based on the above embodiments, in the case where respective functional modules are divided with corresponding respective functions, the embodiments of the present disclosure provide a data transmission apparatus, which may be a server or a chip applied to the server. The device is used for a transmitting end, and the data transmission device comprises:
the multimedia data transmitting module is used for transmitting the multimedia data to the receiving end;
the information acquisition module is used for acquiring the decodable frame information sent by the receiving end;
a target reference frame generation module for generating a target reference frame based on the decodable frame information;
and the target reference frame sending module is used for sending the target reference frame to the receiving end.
In yet another embodiment provided in the present disclosure, the target reference frame sending module is specifically configured to:
and under the condition that a target reference frame request sent by the receiving end is received or the packet loss information sent by the receiving end is received, sending the target reference frame to the receiving end.
In yet another embodiment provided by the present disclosure, the target reference frame generation module is specifically configured to:
acquiring the interval duration of a generated target reference frame; the interval duration is positively correlated with the duration between the interval duration and the target time, wherein the target time comprises the time when the receiving end sends the packet loss information;
and generating the target reference frame based on the interval duration.
In yet another embodiment provided by the present disclosure, the target reference frame comprises a key frame or a long-term reference frame.
In yet another embodiment provided by the present disclosure, the apparatus further comprises a processing module, the processing module specifically ending in:
acquiring a first data amount of a key frame generated based on the decodable frame information and a second data amount of a long-term reference frame generated based on the decodable frame information;
determining the long-term reference frame as the target reference frame if the first amount of data is greater than the second amount;
alternatively, the key frame is determined to be the target reference frame if the first amount of data is not greater than the second amount.
In yet another embodiment provided in the present disclosure, the target reference frame sending module is specifically configured to:
Acquiring a current available bandwidth;
and under the condition that the current available bandwidth is larger than a threshold value, distributing a target bandwidth for the target reference frame, and sending the target reference frame to the receiving end based on the target bandwidth.
The relevant device parts correspond to the above method embodiments, and detailed description of the corresponding embodiments is omitted herein.
The embodiment of the disclosure also provides an electronic device, including: at least one processor; a memory for storing the at least one processor-executable instruction; wherein the at least one processor is configured to execute the instructions to implement the above-described methods disclosed by embodiments of the present disclosure.
Fig. 5 is a schematic structural diagram of an electronic device according to an exemplary embodiment of the present disclosure. As shown in fig. 5, the electronic device 1800 includes at least one processor 1801 and a memory 1802 coupled to the processor 1801, the processor 1801 may perform corresponding steps in the above-described methods disclosed by embodiments of the present disclosure.
The processor 1801 may also be referred to as a central processing unit (central processing unit, CPU), which may be an integrated circuit chip with signal processing capabilities. The steps of the above-described methods disclosed in the embodiments of the present disclosure may be accomplished by instructions in the form of integrated logic circuits or software in hardware in the processor 1801. The processor 1801 may be a general purpose processor, a digital signal processor (digital signal processing, DSP), an ASIC, an off-the-shelf programmable gate array (field-programmable gate array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the embodiments of the present disclosure may be embodied directly in hardware, in a decoded processor, or in a combination of hardware and software modules in a decoded processor. The software modules may reside in a memory 1802 such as random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, etc. as is well known in the art. The processor 1801 reads the information in the memory 1802 and, in combination with its hardware, performs the steps of the method described above.
In addition, various operations/processes according to the present disclosure, when implemented by software and/or firmware, may be installed from a storage medium or network to a computer system having a dedicated hardware structure, such as computer system 1900 shown in fig. 6, which is capable of performing various functions including functions such as those described previously, and the like, when various programs are installed. Fig. 6 is a block diagram of a computer system according to an exemplary embodiment of the present disclosure.
Computer system 1900 is intended to represent various forms of digital electronic computing devices, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 6, the computer system 1900 includes a computing unit 1901, and the computing unit 1901 may perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 1902 or a computer program loaded from a storage unit 1908 into a Random Access Memory (RAM) 1903. In the RAM 1903, various programs and data required for the operation of the computer system 1900 may also be stored. The computing unit 1901, ROM 1902, and RAM 1903 are connected to each other via a bus 1904. An input/output (I/O) interface 1905 is also connected to bus 1904.
Various components in computer system 1900 are connected to I/O interface 1905, including: an input unit 1906, an output unit 1907, a storage unit 1908, and a communication unit 1909. The input unit 1906 may be any type of device capable of inputting information to the computer system 1900, and the input unit 1906 may receive input numeric or character information and generate key signal inputs related to user settings and/or function controls of the electronic device. The output unit 1907 may be any type of device capable of presenting information and may include, but is not limited to, a display, speakers, video/audio output terminals, vibrators, and/or printers. Storage unit 1908 may include, but is not limited to, magnetic disks, optical disks. The communication unit 1909 allows the computer system 1900 to exchange information/data with other devices over a network, such as the internet, and may include, but is not limited to, modems, network cards, infrared communication devices, wireless communication transceivers and/or chipsets, such as bluetooth (TM) devices, wiFi devices, wiMax devices, cellular communication devices, and/or the like.
The computing unit 1901 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 1901 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 1901 performs the various methods and processes described above. For example, in some embodiments, the above-described methods disclosed by embodiments of the present disclosure may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 1908. In some embodiments, some or all of the computer programs may be loaded and/or installed onto electronic device 1900 via ROM 1902 and/or communication unit 1909. In some embodiments, the computing unit 1901 may be configured to perform the above-described methods of the disclosed embodiments by any other suitable means (e.g., by means of firmware).
The disclosed embodiments also provide a computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the above-described method disclosed by the disclosed embodiments.
A computer readable storage medium in embodiments of the present disclosure may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium described above can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specifically, the computer-readable storage medium described above may include one or more wire-based electrical connections, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.
The disclosed embodiments also provide a computer program product comprising a computer program, wherein the computer program, when executed by a processor, implements the above-described methods of the disclosed embodiments.
In an embodiment of the present disclosure, computer program code for performing the operations of the present disclosure may be written in one or more programming languages, including but not limited to an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of remote computers, the remote computers may be connected to the user computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to external computers.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules, components or units referred to in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of a module, component or unit does not in some cases constitute a limitation of the module, component or unit itself.
The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.
The above description is merely illustrative of some embodiments of the present disclosure and of the principles of the technology applied. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).
Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It will be appreciated by those skilled in the art that modifications may be made to the above embodiments without departing from the scope and spirit of the disclosure. The scope of the present disclosure is defined by the appended claims.
Claims (15)
1. A data transmission method, wherein the method is used for a receiving end, and the method comprises:
acquiring multimedia data transmitted by a transmitting end, and acquiring decodable frame information based on the multimedia data;
transmitting the decodable frame information to the transmitting terminal;
and acquiring a target reference frame sent by the sending end, and carrying out data recovery on the multimedia data based on the target reference frame.
2. The method according to claim 1, wherein the method further comprises:
and sending a target reference frame request to the sending end under the condition that the target condition is met.
3. The method of claim 2, wherein the target condition comprises: at least one of a decodable frame not received and a packet loss condition exists beyond a target duration.
4. A method according to claim 3, characterized in that the method further comprises:
acquiring frame intervals, network jitter information and packet loss time length between adjacent frames in the multimedia data;
and determining the target duration based on the frame interval, the network jitter information and the packet loss duration.
5. The method according to any one of claims 1 to 4, further comprising:
Acquiring a data packet sequence number based on the multimedia data;
and generating packet loss information based on the data packet sequence number, and sending the packet loss information to the sending end.
6. A data transmission method, wherein the method is used for a transmitting end, and the method comprises:
transmitting multimedia data to a receiving end, and acquiring decodable frame information transmitted by the receiving end;
and generating a target reference frame based on the decodable frame information, and transmitting the target reference frame to the receiving end.
7. The method of claim 6, wherein the transmitting the target reference frame to the receiving end comprises:
and under the condition that a target reference frame request sent by the receiving end is received or the packet loss information sent by the receiving end is received, sending the target reference frame to the receiving end.
8. The method of claim 7, wherein generating the target reference frame based on the decodable frame information comprises:
acquiring the interval duration of a generated target reference frame; the interval duration is positively correlated with the duration between the interval duration and the target time, wherein the target time comprises the time when the receiving end sends the packet loss information;
And generating the target reference frame based on the interval duration.
9. The method of claim 6, wherein the target reference frame comprises a key frame or a long-term reference frame.
10. The method according to claim 9, wherein the method further comprises:
acquiring a first data amount of a key frame generated based on the decodable frame information and a second data amount of a long-term reference frame generated based on the decodable frame information;
determining the long-term reference frame as the target reference frame if the first amount of data is greater than the second amount;
alternatively, the key frame is determined to be the target reference frame if the first amount of data is not greater than the second amount.
11. The method of claim 6, wherein the transmitting the target reference frame to the receiving end comprises:
acquiring a current available bandwidth;
and under the condition that the current available bandwidth is larger than a threshold value, distributing a target bandwidth for the target reference frame, and sending the target reference frame to the receiving end based on the target bandwidth.
12. A data transmission apparatus, wherein the apparatus is configured for a receiving end, the apparatus comprising:
The multimedia data acquisition module is used for acquiring the multimedia data sent by the sending end;
a decodable frame information obtaining module for obtaining decodable frame information based on the multimedia data;
the information sending module is used for sending the decodable frame information to the sending end;
the target reference frame receiving module is used for acquiring a target reference frame sent by the sending end;
and the data recovery module is used for carrying out data recovery on the multimedia data based on the target reference frame.
13. A data transmission apparatus, wherein the apparatus is configured for a transmitting end, the apparatus comprising:
the multimedia data transmitting module is used for transmitting the multimedia data to the receiving end;
the information acquisition module is used for acquiring the decodable frame information sent by the receiving end;
a target reference frame generation module for generating a target reference frame based on the decodable frame information;
and the target reference frame sending module is used for sending the target reference frame to the receiving end.
14. An electronic device, comprising:
at least one processor;
a memory for storing the at least one processor-executable instruction;
wherein the at least one processor is configured to execute the instructions to implement the method of any of claims 1-11.
15. A computer readable storage medium, characterized in that instructions in the computer readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the method of any one of claims 1-11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311286847.6A CN117336534A (en) | 2023-10-07 | 2023-10-07 | Data transmission method, device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311286847.6A CN117336534A (en) | 2023-10-07 | 2023-10-07 | Data transmission method, device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117336534A true CN117336534A (en) | 2024-01-02 |
Family
ID=89278645
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311286847.6A Pending CN117336534A (en) | 2023-10-07 | 2023-10-07 | Data transmission method, device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117336534A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117520252A (en) * | 2024-01-08 | 2024-02-06 | 芯瞳半导体技术(山东)有限公司 | Communication control method, system-level chip, electronic equipment and storage medium |
-
2023
- 2023-10-07 CN CN202311286847.6A patent/CN117336534A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117520252A (en) * | 2024-01-08 | 2024-02-06 | 芯瞳半导体技术(山东)有限公司 | Communication control method, system-level chip, electronic equipment and storage medium |
| CN117520252B (en) * | 2024-01-08 | 2024-04-16 | 芯瞳半导体技术(山东)有限公司 | Communication control method, system-level chip, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10819766B2 (en) | Voice encoding and sending method and apparatus | |
| US10924745B2 (en) | Image processing method and device | |
| US9369255B2 (en) | Method and apparatus for reducing feedback and enhancing message dissemination efficiency in a multicast network | |
| CN107277423B (en) | Method and device for packet loss retransmission | |
| CN106817585B (en) | Video coding method, electronic equipment and system using long-term reference frame | |
| CN111147606B (en) | Data transmission method, device, terminal and storage medium | |
| CN117336534A (en) | Data transmission method, device, electronic equipment and storage medium | |
| CN111263153B (en) | Video encoding method, device, equipment and storage medium | |
| CN111629210A (en) | Data processing method and device and electronic equipment | |
| CN114039703B (en) | Data transmission method, device, equipment and medium | |
| US10313083B2 (en) | Method for hybrid automatic repeat request process, network device and terminal device | |
| CN104601521A (en) | Method, device and system for dynamically selecting communication transmission protocol | |
| CN111082896A (en) | Data transmission method and transmitting and receiving device | |
| US11546884B2 (en) | Method and device for determining time-frequency resource preemption, user equipment and base station | |
| CN110996035B (en) | Information sending method and device | |
| CN107566795A (en) | A kind of method, apparatus and system for improving real-time pictures fluency | |
| CN103929682A (en) | Method and device for setting key frames in video live broadcast system | |
| CN110912922B (en) | Image transmission method and device, electronic equipment and storage medium | |
| CN111327864A (en) | Video call control method and device, terminal equipment and storage medium | |
| CN107566291B (en) | Multicast transmission method, device, electronic equipment and storage medium | |
| US10003470B2 (en) | Method and terminal for transmitting and receiving data | |
| CN104796735B (en) | A kind of method of transmitting video data and device | |
| CN116996649B (en) | Screen projection method and device, storage medium and electronic equipment | |
| CN109451796B (en) | Method, device and system for transmitting uplink service data | |
| CN118138776A (en) | Video coding method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |