CN110636334A - Data transmission method and system - Google Patents
Data transmission method and system Download PDFInfo
- Publication number
- CN110636334A CN110636334A CN201910784832.XA CN201910784832A CN110636334A CN 110636334 A CN110636334 A CN 110636334A CN 201910784832 A CN201910784832 A CN 201910784832A CN 110636334 A CN110636334 A CN 110636334A
- Authority
- CN
- China
- Prior art keywords
- image frame
- target
- macro block
- sequence
- frame sequence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 230000005540 biological transmission Effects 0.000 title claims abstract description 48
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 230000006835 compression Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 239000002699 waste material Substances 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 238000012163 sequencing technique Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides a data transmission method and a data transmission system, relates to the technical field of electronic information, and can solve the problem of low data processing efficiency caused by increased data volume when coding an image frame sequence due to low contrast similarity between a reference image frame and the image frame sequence when data is transmitted by a reference image frame coding method. The specific technical scheme is as follows: after acquiring the image frame sequence, the sending device acquires a target reference image frame corresponding to the image frame sequence according to a preset algorithm, performs coding processing on the image frame sequence through the target reference image frame, and sends the image frame sequence after the coding processing and the target reference image frame after the coding processing to the receiving device. And after the receiving equipment acquires the coded image frame sequence and the target reference image frame corresponding to the coded target frame sequence, decoding the coded image frame sequence according to the target reference image frame to obtain the image frame sequence. The present disclosure is for data transmission.
Description
Technical Field
The present disclosure relates to the field of electronic information technologies, and in particular, to a data transmission method and system.
Background
With the development of information technology, the demand of people for communication service is continuously increasing, and the contradiction between image communication and the capacity of a communication network is increasingly prominent. Especially for video image communication, due to its huge data volume, it is difficult to transmit and store data without image compression. Therefore, image compression capability is particularly important for video images.
Image compression is the application of data compression techniques to digital images with the goal of reducing redundant information in the image data, thereby storing and transmitting the data in a more efficient format.
In order to improve the efficiency of data transmission and storage, the prior art transmits the data by a reference frame coding method when video coding is performed, and the principle of interframe reference frame coding is as follows: when the current image frame is coded, the current frame and the reference frame are compared, partial data which are the same as or similar to the reference frame are removed, and the positions of the same data are marked, so that the purpose of compression is achieved. However, in the prior art, when a reference frame is determined according to an image frame at a fixed position, the reference frame and the image frame in an image frame sequence have low similarity, so that the referenceability with a subsequent image frame is reduced, and when the subsequent image is encoded according to the reference frame, the data amount of the removed similar part is reduced, so that the data amount is increased during image encoding, transmission and decoding, the data processing efficiency is low, and the problems of calculation resource waste and transmission bandwidth waste are also caused.
Disclosure of Invention
The embodiment of the disclosure provides a data transmission method and system, which can solve the problems of low data processing efficiency and waste of transmission bandwidth caused by increased data volume when encoding an image frame sequence due to low contrast similarity between a reference image frame and the image frame sequence when transmitting data by a reference image frame encoding method. The technical scheme is as follows:
according to a first aspect of the embodiments of the present disclosure, there is provided a data transmission method applied to a sending device, the method including:
acquiring a sequence of image frames, the sequence of image frames comprising at least one image frame;
generating a target reference image frame corresponding to the image frame sequence according to the image frame sequence and a preset rule;
according to the target reference image frame, coding the image frame sequence;
the encoded image frame sequence and the target reference image frame are transmitted to a receiving device.
In one embodiment, the method, when generating the target reference image frame corresponding to the image frame sequence, includes:
dividing each image frame in the image frame sequence into M × N macro blocks, and acquiring position information corresponding to each macro block in each image frame, wherein M is more than or equal to 1, and N is more than or equal to 1;
according to the position information and the target position information corresponding to each macro block in each image frame, acquiring an alternative macro block corresponding to each image frame at the target position;
comparing each candidate macro block by block, and determining the target number corresponding to each candidate macro block, wherein the target number refers to the number of macro blocks with the similarity reaching a preset value with the candidate macro blocks;
after the target number corresponding to each candidate macro block is sequenced, the candidate macro block with the maximum target number is used as a reference macro block;
and generating a target reference image frame according to the reference macro block and the target position information.
In one embodiment, the method includes, when encoding the sequence of image frames:
comparing whether the image frame sequence and the target reference image frame have the same macro blocks on a block-by-block basis;
according to the comparison result, when the image frame sequence and the target reference image frame have the same macro block, acquiring the corresponding reference position information of the macro block in the image frame sequence in the target reference image frame;
according to the comparison result, when the image frame sequence and the target reference image frame have different macro blocks, determining the macro block in the image frame sequence as a target macro block;
and carrying out coding processing on the image frame sequence according to the reference position information and the target macro block.
In one embodiment, the method wherein the target reference image frame comprises a reference macro block, the method comprising, upon transmitting the target reference image frame:
marking the reference macro block according to the reference macro block in the image frame sequence and the target position information corresponding to the reference macro block;
the target reference image frame is transmitted by the transmitting of the marked reference macro block.
In one embodiment, the method, when transmitting a sequence of image frames, comprises:
the image frame sequence is transmitted after being marked according to the ordering information of each image frame in the image frame sequence.
According to the data transmission method provided by the embodiment of the disclosure, after the sending device obtains the image frame sequence, the target reference image frame corresponding to the image frame sequence is obtained according to the preset algorithm. And after the image frame sequence is coded according to the target reference image frame, the coded image frame sequence and the target reference image frame are sent. According to the data transmission method provided by the embodiment of the disclosure, when the target reference image frame is determined, the reference macro block is determined based on the encoding referenceability in the image frame sequence, and the reference macro block can be the macro block with the largest number of the same macro blocks in the image frame sequence, so that the proportion of the same macro blocks in the image frame sequence and the reference target frame is improved, therefore, when the image frame sequence is encoded based on the reference frame encoding principle, the target macro blocks needing to be encoded in the image frame sequence are reduced, the encoded data amount is reduced, the encoding processing efficiency is improved, and the transmission bandwidth is saved.
According to a second aspect of the embodiments of the present disclosure, there is provided a data transmission method applied to a receiving device, the method including:
acquiring an encoded image frame sequence and a target reference image frame corresponding to the encoded image frame sequence, wherein the image frame sequence comprises a target macro block and reference position information, the reference position information refers to position information of a macro block in the image frame sequence, which is the same as that in the target reference image frame, and the target macro block refers to a macro block in the image frame sequence, which is different from that in the target reference image frame;
and decoding the coded image frame sequence according to the target reference image frame.
In one embodiment, the method acquires a target reference image frame corresponding to the encoded image frame sequence, including,
analyzing the coded image frame sequence, and acquiring mark information corresponding to a target reference image frame in the image frame sequence according to an analysis result, wherein the mark information is used for indicating macro block information forming the target reference image frame in the target frame sequence;
and acquiring a corresponding reference macro block according to the mark information, and generating a target reference image frame according to the reference macro block.
In one embodiment, the method performs a decoding process on the encoded image frame sequence, including,
determining a macro block corresponding to the reference position information in the target reference image frame according to the reference position information and the target reference image frame;
and decoding the coded image frame sequence according to the target macro block and the macro block corresponding to the reference position information in the target reference image frame. According to the data transmission method provided by the embodiment of the disclosure, after the sending device obtains the image frame sequence, the target reference image frame corresponding to the image frame sequence is obtained according to the preset algorithm. And after the image frame sequence is coded according to the target reference image frame, the coded image frame sequence and the target reference image frame are sent. According to the data transmission method provided by the embodiment of the disclosure, when the target reference image frame is determined, the reference macro block is determined based on the encoding referenceability in the image frame sequence, and the reference macro block can be the macro block with the largest number of the same macro blocks in the image frame sequence, so that the proportion of the same macro blocks in the image frame sequence and the reference target frame is improved, therefore, when the image frame sequence is encoded based on the reference frame encoding principle, the target macro blocks needing to be encoded in the image frame sequence are reduced, the encoded data amount is reduced, the encoding processing efficiency is improved, and the transmission bandwidth is saved.
The data transmission method provided by the embodiment of the disclosure acquires, by a receiving device, an encoded image frame sequence and a target reference image frame corresponding to the image frame sequence, where the image frame sequence includes: the image processing device comprises a target macro block and reference position information, wherein the target macro block is a macro block which is different from a target reference image frame in an image frame sequence, and the reference position information is the position information of the same macro block in the target reference image frame in the image frame sequence and the target reference image frame. The encoded image frame sequence is parsed from the target reference image frame. According to the data transmission method provided by the embodiment of the disclosure, when the receiving device decodes the image frame sequence, only the target macro block and the reference position information need to be decoded, so that the data volume during decoding processing is greatly reduced, and the decoding efficiency is improved.
According to a third aspect of the embodiments of the present disclosure, there is provided a data transmission system including: a sending device and a receiving device,
the sending device is connected to the receiving device,
the sending device is used for acquiring an image frame sequence, and the image frame sequence comprises at least one image frame;
generating a target reference image frame corresponding to the image frame sequence according to the image frame sequence and a preset rule;
according to the target reference image frame, coding the image frame sequence;
the encoded image frame sequence and the target reference image frame are transmitted to a receiving device.
The receiving device is used for acquiring an encoded image frame sequence and a target reference image frame corresponding to the encoded image frame sequence, wherein the image frame sequence comprises a target macro block and reference position information, the reference position information refers to position information of the same macro block in the image frame sequence and the target reference image frame in the target reference image frame, and the target macro block refers to a macro block different from the target reference image frame in the image frame sequence;
and decoding the coded image frame sequence according to the target reference image frame.
The transmitting device in the system, in one embodiment, is further configured to,
comparing whether the image frame sequence and the target reference image frame have the same macro blocks on a block-by-block basis;
according to the comparison result, when the image frame sequence and the target reference image frame have the same macro block, acquiring the corresponding reference position information of the macro block in the image frame sequence in the target reference image frame;
according to the comparison result, when the image frame sequence and the target reference image frame have different macro blocks, determining the macro block in the image frame sequence as a target macro block;
and carrying out coding processing on the image frame sequence according to the reference position information and the target macro block.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flowchart of a data transmission method provided by an embodiment of the present disclosure;
fig. 2 is a flowchart 1 of a data transmission method provided by an embodiment of the present disclosure;
fig. 3 is a structural diagram of a data transmission system according to an embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
Example one
The embodiment of the present disclosure provides a data transmission method, which is applied to a sending device, and as shown in fig. 1, the data transmission method includes the following steps:
101. a sequence of image frames is acquired.
The image frame sequence comprises at least one image frame.
The image frame sequence may be an image frame sequence in a video, and the image frame sequence may have similar or identical macroblocks based on characteristics of the video image, and specifically, each frame of image may be divided into a plurality of M × N macroblocks, for example, each frame of image may be divided into 16 × 16 macroblocks, or 8 × 8 macroblocks.
102. And generating a target reference image frame corresponding to the image frame sequence according to the image frame sequence and a preset rule.
The present disclosure provides a method in which a target reference image frame is composed of a reference macro block, and the image frame sequence is generated based on the reference macro block. The reference macroblock is used to indicate a macroblock of the image frame sequence that can be a reference for encoding. The method for determining the reference macro block comprises the following steps: based on the macroblock composition with the largest number of occurrences at the target position in each image frame in the target frame sequence, a specific generation method may include:
dividing each image frame in the image frame sequence into M × N macro blocks, and acquiring position information corresponding to each macro block in each image frame, wherein M is more than or equal to 1, and N is more than or equal to 1;
according to the position information and the target position information corresponding to each macro block in each image frame, acquiring an alternative macro block corresponding to each image frame at the target position;
comparing each candidate macro block by block, and determining the target number corresponding to each candidate macro block, wherein the target number refers to the number of macro blocks with the similarity reaching a preset value with the candidate macro blocks;
after the target number corresponding to each candidate macro block is sequenced, the candidate macro block with the maximum target number is used as a reference macro block;
and generating a target reference image frame according to the reference macro block and the target position information.
And if the target number corresponding to a certain candidate macro block is the same as that corresponding to other candidate macro blocks, taking the macro block with the prior image frame sequence number corresponding to the two candidate macro blocks as a reference macro block.
Here, taking the image frame sequence including image frame a, image frame B, image frame C, and image frame D as an example, a specific example is listed for explanation:
step one, dividing each frame image in the image frame sequence into 4 × 4 macroblocks, namely 16 macroblocks including four rows and four columns, according to a preset rule, and determining target position information corresponding to each macroblock, wherein the position information can be marked by a row number and a column number.
Step two, based on the macro block dividing method, obtaining candidate macro blocks corresponding to the image frame A, the image frame B, the image frame C and the image frame D at the first target position: the candidate macro block A, the candidate macro block B, the candidate macro block C and the candidate macro block D are determined in sequence according to a row-by-row or column-by-column sequence, and the position of the first row and the first column is taken as a first target position.
Comparing the candidate macro block A, the candidate macro block B, the candidate macro block C and the candidate macro block D in sequence, and determining the number of targets corresponding to the candidate macro block A, the number of targets corresponding to the candidate macro block B, the number of targets corresponding to the candidate macro block C and the number of targets corresponding to the candidate macro block D, for example, comparing the candidate macro block A with the candidate macro block B, the candidate macro block C and the candidate macro block D in sequence, wherein the degree of acquaintance between the candidate macro block B, the candidate macro block C and the candidate macro block A is greater than a preset value, so that the number of targets corresponding to the candidate macro block A is 2; similarly, it can be determined that the number of targets corresponding to the candidate macroblock B is 1, the number of targets corresponding to the candidate macroblock C is 1, and the number of targets corresponding to the candidate macroblock D is 1;
step four, sequencing the number of targets corresponding to the candidate macro block A, the number of targets corresponding to the candidate macro block B, the number of targets corresponding to the candidate macro block C and the number of targets corresponding to the candidate macro block D, wherein the candidate macro block with the largest number of targets is used as a reference macro block, and the candidate macro block A is used as a reference macro block in the example;
in addition, if the number of the targets corresponding to the candidate macro block a is 2, the number of the targets corresponding to the candidate macro block B is 2, the number of the targets corresponding to the candidate macro block C is 1, and the number of the targets corresponding to the candidate macro block D is 1; when the candidate macro block with the largest target number is taken as a reference macro block, two candidate macro blocks are provided; further judging the sequence of the image A corresponding to the candidate macro block A in the image frame sequence and the sequence of the image B corresponding to the candidate macro block B in the image frame sequence; since picture a is ordered before picture B, candidate macroblock a is taken as the reference macroblock.
Step five, the candidate macro block A and the first target position information are used as a reference macro block corresponding to the first target position of the target reference image frame; i.e., the macroblock in the first row and column position.
Continuing to follow the line-by-line processing based on the determining step, the second target position: reference macroblock of first row second column macroblock:
and determining the macro block which appears most frequently at the position of the first row and the second column of each image frame from the image frame sequence, and determining the macro block as the macro block at the position of the first row and the second column in the virtual image frame.
The determination method for determining the macro block content of the target reference image frame at other positions of the reference macro block corresponding to each target position according to the reference macro block corresponding to each target position is similar to that described above, and is not repeated here.
The method provided by the present disclosure, when determining the target reference image frame, replaces the prior art that by fixing the sequence starting image frame as the target reference image frame, but the reference macro block of the target reference image frame is flexibly adjusted according to the macro blocks of the image frame sequence, specifically, the macro block in the target reference image frame is determined to be the macro block with the maximum reference degree in the image frame sequence as the reference macro block by analyzing the macro block corresponding to each position in the contrast image frame sequence, such as the macro block with the maximum occurrence frequency, or macroblocks in the first frame image, thereby increasing the proportion of the image frame sequence that is the same as the reference target frame, therefore, when the image frame sequence is coded based on the reference frame coding principle, the target macro blocks needing to be coded in the image frame sequence can be reduced, the coded data amount is reduced, the coding processing efficiency is improved, and the transmission bandwidth is saved.
103. And carrying out coding processing on the image frame sequence according to the target reference image frame.
When the image frame sequence is coded according to the target reference image, whether the same target macro block exists in the image frame sequence and the target reference image frame is determined; then, the target macro block is coded to complete the coding of the image frame sequence, which specifically comprises the following steps:
judging whether each image frame in the image frame sequence has a macro block different from the target reference image frame or not according to the target reference image frame;
according to the judgment result, when each image frame and the target reference image frame have the same macro block, acquiring the reference position information corresponding to the macro block in each image frame in the target reference image frame;
according to the judgment result, when each image frame and the target reference image frame have different macro blocks, acquiring a target macro block in each image frame;
and carrying out coding processing on the image frame sequence according to the reference position information and the target macro block.
Specific examples are listed here for illustration:
after the target reference image frame is determined, each frame in the image sequence group to be coded is coded, and the coding mode for each frame is as follows: the data is transmitted in a predetermined order, such as row-by-row or column-by-column,
sequentially comparing each image frame in the image frame sequence to be coded with the macro block of the target reference image frame at the corresponding position, and marking the position information of the macro block corresponding to the macro block in the target reference image frame for the macro block which is the same as the macro block at the corresponding position of the target reference image frame in each image frame; and directly coding and transmitting the macro blocks which are different from the macro blocks at the corresponding positions of the target reference image frame in the image frame sequence to be coded.
The comparison method between the macro blocks in the image frame sequence to be encoded and the macro blocks in the target reference image frame may be as follows: and respectively extracting the data features in the two macro blocks, comparing the data features and determining a comparison result, wherein the extraction of the data features can be realized by a perceptual hash algorithm or other technologies.
According to the method provided by the disclosure, when the image frame sequence is coded, because the target reference image frame is composed of macro blocks with the highest occurrence frequency in the image frame sequence, when the image frame sequence is coded according to the target reference image frame, the same macro blocks only need to be coded and processed with the position information of the macro blocks, so that the coded data amount can be reduced, and the transmission bandwidth is reduced.
104. The encoded image frame sequence and the target reference image frame are transmitted to a receiving device.
When the target reference image frame is sent, the method provided by the disclosure comprises the steps of directly coding and transmitting the target reference image frame, and also comprises the steps of coding and transmitting the marking information after the marking information corresponding to the target reference image frame is determined;
marking the reference macro block according to the reference macro block in the image frame sequence and the target position information corresponding to the reference macro block;
the target reference image frame is transmitted by the transmitting of the marked reference macro block.
Wherein the flag information for marking the reference macro block includes: an identification bit and a position information bit; the specific identification bit is used for identifying that the macro block is a macro block forming the target reference image frame, and the position information bit is used for identifying the position of the macro block in the target reference image frame. The position information may be represented by information representing a row number and a column number, or may be a serial number. For example, the target reference image frame is composed of 16 macro blocks, each macro block constituting the target reference image frame is marked by a sequence number, and the receiving device sequentially arranges the macro blocks according to the sequence number from small to large, that is, from 1 to 16, according to a specific default sequence, so as to generate the target reference image frame.
By means of sending the image frame sequence marked with the reference macro block, the target reference image frame can be sent instead of the reference target image frame, so that the transmitted data volume can be reduced, the bandwidth can be reduced, and the coding and decoding efficiency can be improved.
The method provided by the present disclosure further includes, prior to transmitting the image frame sequence, tagging the image frame sequence.
The image frame sequence is transmitted after being marked according to the ordering information of each image frame in the image frame sequence.
That is, when transmitting an encoded image sequence, the frame is marked as the start frame in the first frame in the sequence ordering of the image sequences, and the frame is marked as the end frame in the last frame in the sequence, for example, the group number of the image sequence group in which the frame is located may be marked in the first frame in the sequence, and the frame is marked as the start frame, and correspondingly, the group number of the image sequence group in which the frame is located may be marked in the last frame in the sequence and the frame is marked as the end frame, thereby facilitating the receiving device to determine the head frame and the end frame of the image sequence group.
Further, the group number of the image sequence group in which the image frame is located and the serial number of the frame in the group may be marked at each frame of each image frame sequence.
By marking the sequence information in the image sequence group, the receiving device can accurately identify the image frames belonging to the same image sequence group according to the information and accurately sequence the image frames, so that the situation that the receiving device generates wrong grouping during decoding can be avoided, for example, a starting frame of one image sequence group and an ending frame of another image sequence group are identified as a head frame and a tail frame of one image sequence group, so that a wrong image sequence group can be formed during decoding, and finally a wrong decoding result is caused.
According to the data transmission method provided by the embodiment of the disclosure, after the sending device obtains the image frame sequence, the target reference image frame corresponding to the image frame sequence is obtained according to the preset algorithm. And after the image frame sequence is coded according to the target reference image frame, the coded image frame sequence and the target reference image frame are sent. According to the data transmission method provided by the embodiment of the disclosure, when the target reference image frame is determined, the reference macro block is determined based on the encoding referenceability in the image frame sequence, and the reference macro block can be the macro block with the largest number of the same macro blocks in the image frame sequence, so that the proportion of the same macro blocks in the image frame sequence and the reference target frame is improved, therefore, when the image frame sequence is encoded based on the reference frame encoding principle, the target macro blocks needing to be encoded in the image frame sequence are reduced, the encoded data amount is reduced, the encoding processing efficiency is improved, and the transmission bandwidth is saved.
Example two
Based on the data transmission method provided by the embodiment corresponding to fig. 1, another embodiment of the present disclosure provides a data transmission method, which may be applied to a receiving device, for example, the receiving device may also be a terminal device or a network server. Referring to fig. 2, the data transmission method provided in this embodiment includes the following steps:
201. and acquiring the coded image frame sequence and a target reference image frame corresponding to the image frame sequence.
The image frame sequence comprises a target macro block and reference address information, wherein the target macro block is a macro block different from a target reference image frame in the image frame sequence, and the reference address information is address information of the same macro block in the target reference image frame in the image frame sequence and the target reference image frame.
The method provided by the present disclosure may further obtain, by parsing the image frame sequence, the corresponding ordering information of the image frame, that is, the position of the image frame in the image frame sequence, such as a start frame, an intermediate frame, or an end frame, according to the parsing result. By acquiring the sequencing information corresponding to the image frames, the image frames belonging to the same image sequence group can be accurately identified, and the image frames are accurately sequenced, so that the disorder generated when a plurality of groups of image frame sequences are received is avoided.
The method provided by the present disclosure requires to acquire a target reference image frame before decoding the encoded image frame sequence, wherein the method of acquiring a target image frame may include: the target reference image frame directly received may also be a target reference image frame generated by combining according to the marker information in the image sequence group.
The method for generating the target reference image frame by combining according to the mark information in the image sequence group comprises the following steps:
analyzing the coded image frame sequence, and acquiring mark information corresponding to a target reference image frame in the image frame sequence according to an analysis result, wherein the mark information is used for indicating macro block information forming the target reference image frame in the target frame sequence;
and acquiring a corresponding reference macro block according to the mark information, and generating a target reference image frame according to the reference macro block.
For the receiving device, after receiving the whole image frame sequence to be decoded, finding out the macro blocks containing the marking information from the image sequence group, combining the macro blocks according to the position information marked by the corresponding macro blocks to form a complete target reference image frame, and then decoding each frame image in the image sequence group according to the target reference image frame.
Furthermore, the target reference image frame can be only used for decoding the received image frame, the target reference image frame does not need to be decoded and displayed at a decoding end, and the target reference image frame can be discarded after decoding is finished, so that the data storage space is saved.
202. And decoding the coded image frame sequence according to the target reference image frame.
The method provided by the present disclosure is decoding an encoded image frame sequence, and includes:
determining a macro block corresponding to the reference position information in the target reference image frame according to the reference position information and the target reference image frame;
and decoding the coded image frame sequence according to the target macro block and the macro block corresponding to the reference position information in the target reference image frame.
In the data transmission method provided by the embodiment of the present disclosure, a receiving device acquires an encoded image frame sequence and a target reference image frame corresponding to the image frame sequence, where the image frame sequence includes: the image processing device comprises a target macro block and reference position information, wherein the target macro block is a macro block which is different from a target reference image frame in an image frame sequence, and the reference position information is the position information of the same macro block in the target reference image frame in the image frame sequence and the target reference image frame. The encoded image frame sequence is parsed from the target reference image frame. According to the data transmission method provided by the embodiment of the disclosure, when the receiving device decodes the image frame sequence, only the target macro block and the reference position information need to be decoded, so that the data volume during decoding processing is greatly reduced, and the decoding efficiency is improved.
EXAMPLE III
Based on the data transmission method described in the embodiments corresponding to fig. 1 and fig. 2, the following is an embodiment of the apparatus of the present disclosure, which can be used to execute the embodiment of the method of the present disclosure.
An embodiment of the present disclosure provides a data transmission system, as shown in fig. 3, the data transmission system 30 includes: a transmitting device 301 and a receiving device 302,
the sending device 301 is connected to the receiving device 302, and the connection mode may be a wired mode or a wireless mode;
the transmitting device 301 is configured to acquire a sequence of image frames, the sequence of image frames comprising at least one image frame;
generating a target reference image frame corresponding to the image frame sequence according to the image frame sequence and a preset rule;
according to the target reference image frame, coding the image frame sequence;
the encoded image frame sequence and the target reference image frame are transmitted to the receiving device 302.
In an alternative embodiment, the sending device 301 in the system 30 is further adapted to,
comparing whether the image frame sequence and the target reference image frame have the same macro blocks on a block-by-block basis;
according to the comparison result, when the image frame sequence and the target reference image frame have the same macro block, acquiring the corresponding reference position information of the macro block in the image frame sequence in the target reference image frame;
according to the comparison result, when the image frame sequence and the target reference image frame have different macro blocks, determining the macro block in the image frame sequence as a target macro block;
and carrying out coding processing on the image frame sequence according to the reference position information and the target macro block.
The receiving device 302 is configured to obtain an encoded image frame sequence and a target reference image frame corresponding to the encoded image frame sequence, where the image frame sequence includes a target macro block and reference position information, the reference position information refers to position information of a same macro block in the image frame sequence as in the target reference image frame, and the target macro block refers to a different macro block in the image frame sequence from the target reference image frame;
and decoding the coded image frame sequence according to the target reference image frame.
In the data transmission system provided by the embodiment of the present disclosure, after acquiring an image frame sequence, a sending device acquires a target reference image frame corresponding to the image frame sequence according to a preset algorithm, encodes the image frame sequence through the target reference image frame, and sends the encoded image frame sequence and the encoded target reference image frame to a receiving device. And after the receiving equipment acquires the coded image frame sequence and the target reference image frame corresponding to the coded target frame sequence, decoding the coded image frame sequence according to the target reference image frame to obtain the image frame sequence.
According to the data transmission system provided by the embodiment of the disclosure, by improving the similarity between the target reference image frame and the macro block of the image frame sequence, when the image frame sequence is subjected to coding and decoding processing, for the macro block same as the target reference image frame, the macro block is not required to be processed, but the reference position information corresponding to the macro block is processed, so that the data volume when the image frame sequence is subjected to coding and decoding processing is reduced, the coding and decoding efficiency is improved, and the transmission bandwidth is reduced.
Based on the data transmission method described in the embodiment corresponding to fig. 1 and fig. 2, an embodiment of the present disclosure further provides a computer-readable storage medium, for example, the non-transitory computer-readable storage medium may be a Read Only Memory (ROM), a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. The storage medium stores computer instructions for executing the data transmission method described in the embodiment corresponding to fig. 1 and fig. 2, which is not described herein again.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
Claims (10)
1. A data transmission method, applied to a transmitting device, the method comprising:
acquiring a sequence of image frames, the sequence of image frames comprising at least one image frame;
generating a target reference image frame corresponding to the image frame sequence according to the image frame sequence and a preset rule;
according to the target reference image frame, encoding the image frame sequence;
transmitting the encoded sequence of image frames and the target reference image frame to a receiving device.
2. The method of claim 1, wherein generating the target reference image frame corresponding to the sequence of image frames comprises:
dividing each image frame in the image frame sequence into M × N macro blocks, and acquiring position information corresponding to each macro block in each image frame, wherein M is more than or equal to 1, and N is more than or equal to 1;
according to the position information and the target position information corresponding to each macro block in each image frame, acquiring a candidate macro block corresponding to each image frame at the target position;
comparing each candidate macro block by block, and determining the target number corresponding to each candidate macro block, wherein the target number refers to the number of macro blocks with the similarity reaching a preset value with the candidate macro blocks;
after the target number corresponding to each candidate macro block is sequenced, the candidate macro block with the largest target number is used as a reference macro block;
and generating a target reference image frame according to the reference macro block and the target position information.
3. The method of claim 1, wherein encoding the sequence of image frames comprises:
comparing, block by block, whether the image frame sequence and the target reference image frame have the same macro blocks;
according to the comparison result, when the image frame sequence and the target reference image frame have the same macro blocks, acquiring the corresponding reference position information of the macro blocks in the image frame sequence in the target reference image frame;
according to the comparison result, when the image frame sequence and the target reference image frame have different macro blocks, determining the macro block in the image frame sequence as a target macro block;
and carrying out coding processing on the image frame sequence according to the reference position information and the target macro block.
4. The method of claim 2, wherein the target reference image frame comprises a reference macroblock, and wherein the sending the target reference image frame comprises:
marking the reference macro block according to the reference macro block in the image frame sequence and target position information corresponding to the reference macro block;
transmitting the target reference image frame by the transmitting the marked reference macro block.
5. The method of claim 1, wherein the transmitting the sequence of image frames comprises:
and according to the ordering information of each image frame in the image frame sequence, marking the image frame sequence, and then sending the image frame sequence.
6. A data transmission method, applied to a receiving device, the method comprising:
acquiring target data, wherein the target data comprises: the image coding method comprises the steps of encoding an image frame sequence and a target reference image frame corresponding to the encoded image frame sequence;
and decoding the coded image frame sequence according to the target reference image frame.
7. The method of claim 6, wherein said obtaining a target reference image frame corresponding to said encoded sequence of image frames comprises,
analyzing the coded image frame sequence, and acquiring marking information corresponding to a target reference image frame in the image frame sequence according to an analysis result, wherein the marking information is used for indicating macro block information forming the target reference image frame in the target frame sequence;
and acquiring a corresponding reference macro block according to the marking information, and generating a target reference image frame according to the reference macro block.
8. The method according to claim 6, wherein the image frame sequence comprises a target macro block and reference position information, the reference position information refers to position information corresponding to the same macro block in the image frame sequence as in the target reference image frame, the target macro block refers to a macro block in the image frame sequence different from the target reference image frame, the decoding process for the encoded image frame sequence comprises,
determining a macro block corresponding to the reference position information in the target reference image frame according to the reference position information and the target reference image frame;
and decoding the coded image frame sequence according to the target macro block and the macro block corresponding to the reference position information in the target reference image frame.
9. A data transmission system, the system comprising: a sending device and a receiving device,
the sending device is connected with the receiving device,
the sending device is used for acquiring an image frame sequence, and the image frame sequence comprises at least one image frame;
generating a target reference image frame corresponding to the image frame sequence according to the image frame sequence and a preset rule;
according to the target reference image frame, encoding the image frame sequence;
transmitting the encoded sequence of image frames and the target reference image frame to a receiving device.
The receiving device is configured to acquire an encoded image frame sequence and a target reference image frame corresponding to the encoded image frame sequence, where the image frame sequence includes a target macro block and reference position information, the reference position information refers to position information of a macro block in the image frame sequence, which is the same as that in the target reference image frame, and the target macro block refers to a macro block in the image frame sequence, which is different from that in the target reference image frame;
and decoding the coded image frame sequence according to the target reference image frame.
10. The system of claim 9, wherein the sending device is further configured to,
comparing, block by block, whether the image frame sequence and the target reference image frame have the same macro blocks;
according to the comparison result, when the image frame sequence and the target reference image frame have the same macro blocks, acquiring the corresponding reference position information of the macro blocks in the image frame sequence in the target reference image frame;
according to the comparison result, when the image frame sequence and the target reference image frame have different macro blocks, determining the macro block in the image frame sequence as a target macro block;
and carrying out coding processing on the image frame sequence according to the reference position information and the target macro block.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910784832.XA CN110636334B (en) | 2019-08-23 | 2019-08-23 | Data transmission method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910784832.XA CN110636334B (en) | 2019-08-23 | 2019-08-23 | Data transmission method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110636334A true CN110636334A (en) | 2019-12-31 |
| CN110636334B CN110636334B (en) | 2022-12-09 |
Family
ID=68970788
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910784832.XA Active CN110636334B (en) | 2019-08-23 | 2019-08-23 | Data transmission method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110636334B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111447451A (en) * | 2020-03-23 | 2020-07-24 | 西安万像电子科技有限公司 | Image coding and decoding method and device |
| CN111800634A (en) * | 2020-06-30 | 2020-10-20 | 西安万像电子科技有限公司 | Image processing method and device |
| CN111800631A (en) * | 2020-06-22 | 2020-10-20 | 西安万像电子科技有限公司 | Data processing method and system |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009833A (en) * | 2006-01-23 | 2007-08-01 | 三星电子株式会社 | Method of and apparatus for deciding encoding mode for variable block size motion estimation |
| RU2009115654A (en) * | 2006-10-30 | 2010-10-27 | Ниппон Телеграф Энд Телефон Корпорейшн (Jp) | CODING METHOD AND VIDEO DECODING METHOD, DEVICES FOR THEM, PROGRAMS FOR THEM, AND ALSO DATA STORAGE CARRIERS THAT STORE PROGRAMS |
| CN101931803A (en) * | 2009-06-26 | 2010-12-29 | 华为技术有限公司 | Method, device and equipment for acquiring motion information of video image and template constructing method |
| CN103167283A (en) * | 2011-12-19 | 2013-06-19 | 华为技术有限公司 | Video coding method and device |
| KR20140118958A (en) * | 2014-08-26 | 2014-10-08 | 에스케이텔레콤 주식회사 | Reference Frame Creating Method and Apparatus and Video Encoding/Decoding Method and Apparatus Using Same |
| CN105872556A (en) * | 2016-04-11 | 2016-08-17 | 华为技术有限公司 | Video coding method and device |
| CN106022010A (en) * | 2016-05-20 | 2016-10-12 | 乐视控股（北京）有限公司 | File display method and device |
| CN106791829A (en) * | 2016-11-18 | 2017-05-31 | 华为技术有限公司 | The method for building up and equipment of virtual reference frame |
| CN108600755A (en) * | 2018-04-19 | 2018-09-28 | 西安万像电子科技有限公司 | Image frame coding method and device |
| CN110020551A (en) * | 2019-02-26 | 2019-07-16 | 努比亚技术有限公司 | One kind preventing the method for divulging a secret, terminal and computer readable storage medium |
-
2019
- 2019-08-23 CN CN201910784832.XA patent/CN110636334B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009833A (en) * | 2006-01-23 | 2007-08-01 | 三星电子株式会社 | Method of and apparatus for deciding encoding mode for variable block size motion estimation |
| RU2009115654A (en) * | 2006-10-30 | 2010-10-27 | Ниппон Телеграф Энд Телефон Корпорейшн (Jp) | CODING METHOD AND VIDEO DECODING METHOD, DEVICES FOR THEM, PROGRAMS FOR THEM, AND ALSO DATA STORAGE CARRIERS THAT STORE PROGRAMS |
| CN101931803A (en) * | 2009-06-26 | 2010-12-29 | 华为技术有限公司 | Method, device and equipment for acquiring motion information of video image and template constructing method |
| CN103167283A (en) * | 2011-12-19 | 2013-06-19 | 华为技术有限公司 | Video coding method and device |
| KR20140118958A (en) * | 2014-08-26 | 2014-10-08 | 에스케이텔레콤 주식회사 | Reference Frame Creating Method and Apparatus and Video Encoding/Decoding Method and Apparatus Using Same |
| CN105872556A (en) * | 2016-04-11 | 2016-08-17 | 华为技术有限公司 | Video coding method and device |
| CN106022010A (en) * | 2016-05-20 | 2016-10-12 | 乐视控股（北京）有限公司 | File display method and device |
| CN106791829A (en) * | 2016-11-18 | 2017-05-31 | 华为技术有限公司 | The method for building up and equipment of virtual reference frame |
| CN108600755A (en) * | 2018-04-19 | 2018-09-28 | 西安万像电子科技有限公司 | Image frame coding method and device |
| CN110020551A (en) * | 2019-02-26 | 2019-07-16 | 努比亚技术有限公司 | One kind preventing the method for divulging a secret, terminal and computer readable storage medium |
Non-Patent Citations (2)
| Title |
|---|
| J. TEBELSKIS; A. WAIBEL; B. PETEK; O. SCHMIDBAUER: "Continuous speech recognition using linked predictive neural networks", 《[PROCEEDINGS] ICASSP 91: 1991 INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING》 * |
| 贾国强: "基于虚拟参考帧的交通视频编码技术研究", 《基于虚拟参考帧的交通视频编码技术研究》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111447451A (en) * | 2020-03-23 | 2020-07-24 | 西安万像电子科技有限公司 | Image coding and decoding method and device |
| CN111800631A (en) * | 2020-06-22 | 2020-10-20 | 西安万像电子科技有限公司 | Data processing method and system |
| CN111800634A (en) * | 2020-06-30 | 2020-10-20 | 西安万像电子科技有限公司 | Image processing method and device |
| CN111800634B (en) * | 2020-06-30 | 2024-06-04 | 西安万像电子科技有限公司 | Image processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110636334B (en) | 2022-12-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110636334B (en) | Data transmission method and system | |
| US9906789B2 (en) | Encoding or decoding method and apparatus | |
| CN109640089B (en) | Image coding and decoding method and device | |
| CN109862365B (en) | Image data processing method and device | |
| CN110149515B (en) | Data transmission method and device | |
| CN111263243B (en) | Video coding method and device, computer readable medium and electronic equipment | |
| US20110058613A1 (en) | Method and apparatus for generating bitstream based on syntax element | |
| CN109982091B (en) | Image processing method and device | |
| CN108600755B (en) | Image frame coding method and device | |
| CN113079375B (en) | Method and device for determining video coding and decoding priority order based on correlation comparison | |
| CN112004114B (en) | Video processing method and device, readable storage medium and electronic equipment | |
| CN110460855B (en) | Image processing method and system | |
| CN111447451A (en) | Image coding and decoding method and device | |
| CN108307191B (en) | Image data alignment method and device | |
| CN111031325A (en) | Data processing method and system | |
| CN111279694A (en) | GDR code stream encoding method, terminal device and machine readable storage medium | |
| CN112714336B (en) | Video segmentation method and device, electronic equipment and computer readable storage medium | |
| WO2022110870A1 (en) | Image encoding and decoding method, encoding and decoding apparatus, encoder, and decoder | |
| CN110545431B (en) | Video decoding method and device, video encoding method and device | |
| CN114092577A (en) | Image data processing method, image data processing device, computer equipment and storage medium | |
| KR100927353B1 (en) | Video encoding and decoding method of mitigating data losses in an encoded video signal transmitted through a channel | |
| CN110740335A (en) | Data transmission method, system and equipment | |
| CN114650439A (en) | Information monitoring method, terminal, server and computer readable storage medium | |
| CN111586416A (en) | Video coding method, video coding device, video coder and storage device | |
| CN112114760A (en) | Image processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Data transmission methods and systems Granted publication date: 20221209 Pledgee: Pudong Development Bank of Shanghai Limited by Share Ltd. Xi'an branch Pledgor: XI'AN VANXVM ELECTRONICS TECHNOLOGY Co.,Ltd. Registration number: Y2024610000022 |