CN104780376B - A kind of video coding and decoding system with ultralow end-to-end time delay, method and device - Google Patents
A kind of video coding and decoding system with ultralow end-to-end time delay, method and device Download PDFInfo
- Publication number
- CN104780376B CN104780376B CN201510166114.8A CN201510166114A CN104780376B CN 104780376 B CN104780376 B CN 104780376B CN 201510166114 A CN201510166114 A CN 201510166114A CN 104780376 B CN104780376 B CN 104780376B
- Authority
- CN
- China
- Prior art keywords
- video
- module
- coding
- decoding
- cache modules
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The present invention proposes a kind of video coding and decoding system with ultralow end-to-end time delay, method and device, system includes video encoding unit and video decoding unit, video encoding unit includes receive and control module, video reception module, video down sample module, video encoding module, first coding ping cache modules, first coding pong cache modules, second coding ping cache modules and the second coding pong cache modules, receive and control module receives configuration parameter, ping/pong coding control signals and configuration parameter are sent to video reception module, video down sample module and video encoding module, video encoding module reads data and encoded from coding ping/pong cache modules, and encoded video data are sent to video decoding unit and decoded.Implement the video coding and decoding system with ultralow end-to-end time delay, the method and device of the present invention, have the advantages that：End-to-end time delay is smaller.
Description
Technical field
The present invention relates to coding and decoding video field, more particularly to a kind of coding and decoding video system with ultralow end-to-end time delay
System, method and device.
Background technology
At this stage, Video coding decoding device is widely used in the various aspects of social life.Common application, including
Video conference, traffic monitoring etc.；Special applications, including military investigation, unmanned plane boat oceangoing ship, remote control, missile guidance control and
Machine vision etc..For above-mentioned special applications, it is necessary to be controlled in real time using video image, therefore to video from encoding device
End-to-end time delay when being transmitted to decoding device has the requirement of harshness.Commonly safety monitoring class video decoding/encoding device is end-to-end
Time delay is generally 300~500ms, 120~180ms of some audio/video encoding/decoding equipment end-to-end time delay of low time delay optimization.It is right
In special applications such as military affairs, it requires end-to-end time delay≤100ms.
At least include three process parts inside one video encoder：Video reception module, video down sample module
And video encoding module；At least include three process parts inside one video decoding apparatus：Adopted on Video decoding module, video
Egf block and video sending module.These modules are handled in units of a frame of video, and frame of video is with fixed input
Frame per second enters a module, after the processing time in a frame period, into next module.So, whole coding and decoding
Time delay is exactly that all number of modules are multiplied by the frame period, causes very big end-to-end time delay.
The content of the invention
The technical problem to be solved in the present invention is, for prior art above-mentioned end-to-end time delay it is larger the defects of, carry
For a kind of less video coding and decoding system with ultralow end-to-end time delay of end-to-end time delay, method and device.
The technical solution adopted for the present invention to solve the technical problems is：Construct a kind of regarding with ultralow end-to-end time delay
Frequency coding/decoding system, including video encoding unit and video decoding unit, the video encoding unit include receive and control module,
Video reception module, video down sample module, video encoding module, the first coding ping cache modules, the first coding pong delay
Storing module, the second coding ping cache modules and the second coding pong cache modules, the receive and control module receive configuration ginseng
Number, is configured, and ping/pong coding control signals and the configuration parameter are respectively transmitted to according to the configuration parameter
The video reception module, video down sample module and video encoding module, the video reception module often receive a frame video
After the setting line number of data, it is deposited into the first coding ping cache modules and the first coding pong cache modules,
The video down sample module reads number from the described first coding ping cache modules and the first coding pong cache modules respectively
According to being deposited into the second coding ping cache modules and the second coding after the data progress down-sampling processing of the reading
Pong cache modules, the video encoding module encode pong cache modules from the described second coding ping cache modules and second
Middle reading data are simultaneously encoded, and encoded video data are sent into the video decoding unit and decoded.
Of the present invention with the video coding and decoding system of ultralow end-to-end time delay, the video decoding unit bag
Include Video decoding module, video up-sampling module, video sending module, send control module, the first decoding ping cache modules,
First decoding pong cache modules, the second decoding ping cache modules and the second decoding pong cache modules, the video decoding
Module decodes to encoded video data, extracts the configuration parameter and is written into the transmission control module, institute
State transmission control module and be respectively written into the video up-sampling module and video sending module again, the video decodes mould
Block will set the decoded video data of line number and be written to the first decoding ping cache modules and the first decoding pong cachings
Module, the video up-sampling module read institute from the described first decoding ping cache modules and the first decoding pong cache modules
Video data is stated, the second decoding ping cache modules and the second solution are stored in after up-sampling processing is carried out to the video data
Code pong cache modules, the video sending module cache mould from the described second decoding ping cache modules and the second decoding pong
Data are read in block and carry out display output.
Of the present invention with the video coding and decoding system of ultralow end-to-end time delay, the configuration parameter includes every
The video line number of secondary processing, the video line number per treatment are the setting line number of one-frame video data.
The invention further relates to a kind of video coding-decoding method with ultralow end-to-end time delay, comprise the following steps：
A configuration parameter) is input to receive and control module, then distinguished the configuration parameter by the receive and control module
The video reception module, video down sample module and video encoding module are sent to, each module is per treatment in setting system
Video line number；
B) receive and control module according to the configuration parameter setting, to the vertical synchronizing signal and water of input video
Flat synchronizing signal is detected and counted, and export corresponding ping/pong coding control signals to the video reception module,
Video down sample module and video encoding module；
C) the video reception module is according to the setting of the ping/pong coding control signals and configuration parameter, often
After the setting line number for receiving one-frame video data, the first coding ping cache modules and the first coding pong cachings are deposited into
In module；
D) video down sample module is according to the setting of the ping/pong coding control signals and configuration parameter, from institute
Interior reading data in the first coding ping cache modules and the first coding pong cache modules are stated, and down-sampling processing is carried out to it
Afterwards, in the coding ping cache modules of deposit second and the second coding pong cache modules；
E) video encoding module is according to the setting of the ping/pong coding control signals and configuration parameter, from described
Data are read in second coding ping cache modules and the second coding pong cache modules, and after carrying out coded treatment to it, will
Encoded video data output；
F) video decoding unit receives the encoded video data, and enters row decoding to it.
Of the present invention with the video coding-decoding method of ultralow end-to-end time delay, the step F) further bag
Include：
F1) Video decoding module decodes to encoded video data, extracts the configuration ginseng in the encoded video data
Number, the configuration parameter is respectively written into the transmission control module, on video using in module and video sending module,
And it is configured；The configuration parameter includes the setting line number；
F2) Video decoding module decodes to the encoded video data, and line number is decoded regards by the setting
Frequency is decoded in pong cache modules according to the first decoding ping cache modules and first are written to, while exports corresponding ping/
Pong decoding control signals give transmission control module；
F3) receive and control module exports corresponding ping/pong decodings control respectively according to the setting of the configuration parameter
Signal is to video up-sampling module and video sending module；
F4) the video up-sampling module is according to the setting of the ping/pong decoding control signals and configuration parameter,
Data are read out of the first decoding ping cache modules and the first decoding pong cache modules, are deposited after carrying out up-sampling processing to it
Enter in the second decoding ping cache modules and the second decoding pong cache modules；
F5) video sending module is according to the setting of the ping/pong decoding control signals and configuration parameter, from described
Data, which are read, in second decoding ping cache modules and the second decoding pong cache modules carries out display output.
The invention further relates to a kind of device for realizing the above-mentioned video coding-decoding method with ultralow end-to-end time delay, bag
Include：
Configuration parameter transmitting element：For configuration parameter to be input into receive and control module, then mould is controlled by described receive
The configuration parameter is respectively transmitted to the video reception module, video down sample module and video encoding module by block, is set
Each module video line number per treatment in system；
Detect counting unit：For making setting of the receive and control module according to the configuration parameter, to input video
Vertical synchronizing signal and horizontal-drive signal detected and counted, and export corresponding ping/pong coding control signals
To the video reception module, video down sample module and video encoding module；
First code storage unit：For making the video reception module according to the ping/pong coding control signals
And the setting of configuration parameter, often after the setting line number of reception one-frame video data, it is deposited into the first coding ping cachings
In module and the first coding pong cache modules；
Down-sampling processing unit：For making video down sample module according to the ping/pong coding control signals and
The setting of configuration parameter, the interior reading data out of the described first coding ping cache modules and the first coding pong cache modules,
And after carrying out down-sampling processing to it, in the coding ping cache modules of deposit second and the second coding pong cache modules；
Coding processing unit：For making video encoding module according to the ping/pong coding control signals and configuration
The setting of parameter, data are read out of the described second coding ping cache modules and the second coding pong cache modules, and to it
After carrying out coded treatment, by encoded video data output；
Decoding unit：For making video decoding unit receive the encoded video data, and row decoding is entered to it.
In device of the present invention, the decoding unit further comprises：
Parameter extraction module：For making Video decoding module decode encoded video data, extract the coding and regard
Configuration parameter of the frequency in, the configuration parameter is respectively written into the transmission control module, on video using module and
In video sending module, and it is configured；The configuration parameter includes the setting line number；
Decode writing module：Set for making the Video decoding module decode the encoded video data, and by described
Determine the decoded video data of line number to be written in the first decoding ping cache modules and the first decoding pong cache modules, simultaneously
Export corresponding ping/pong decoding control signals and give transmission control module；
Decoding control signal output module：It is defeated respectively for making setting of the receive and control module according to the configuration parameter
Go out corresponding ping/pong decoding control signals to video up-sampling module and video sending module；
Decode read module：For make the video up-sampling module according to the ping/pong decoding control signals with
And the setting of configuration parameter, data are read out of the first decoding ping cache modules and the first decoding pong cache modules, to it
The decoding ping cache modules of deposit second and second are decoded in pong cache modules after carrying out up-sampling processing；
Display module：For video sending module according to the ping/pong decoding control signals and configuration parameter
Set, reading data out of the described second decoding ping cache modules and the second decoding pong cache modules carries out display output.
Implement the video coding and decoding system with ultralow end-to-end time delay, the method and device of the present invention, have with following
Beneficial effect：Due to using video encoding unit and video decoding unit, video encoding unit includes receive and control module, video connects
Receive module, video down sample module, video encoding module, the first coding ping cache modules, the first coding pong cache modules,
Second coding ping cache modules and the second coding pong cache modules, receive and control module receives configuration parameter, according to configuration
Parameter is configured, and ping/pong coding control signals and configuration parameter are respectively transmitted under video reception module, video
Sampling module and video encoding module, after video reception module often receives the setting line number of one-frame video data, it is deposited into
In first coding ping cache modules and the first coding pong cache modules, video down sample module is respectively from the first coding ping
Cache module and the first coding pong cache modules read data, to being deposited into second after the data progress down-sampling processing of reading
Encode ping cache modules and the second coding pong cache modules, video encoding module is from the second coding ping cache modules and the
Data are read in two coding pong cache modules and are encoded, and encoded video data are sent to video decoding unit and carried out
Decoding, its each module are handled by processing unit of a frame of video, but with some behaviors in a frame of video
Unit is handled, so as to substantially reduce the end-to-end processing delay of coding and decoding, so end-to-end time delay is smaller.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, without having to pay creative labor, may be used also
To obtain other accompanying drawings according to these accompanying drawings.
Fig. 1 is that the present invention has in the video coding and decoding system of ultralow end-to-end time delay, method and device one embodiment
The structural representation of video encoding unit；
Fig. 2 is the structural representation of video decoding unit in the embodiment；
Fig. 3 is the flow chart of the video coding-decoding method in the embodiment with ultralow end-to-end time delay；
Fig. 4 is that video decoding unit receives the encoded video data in the embodiment, and enters the tool of row decoding to it
Body flow chart；
Fig. 5 is the structural representation of device in the embodiment.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other under the premise of creative work is not made
Embodiment, belong to the scope of protection of the invention.
In self-heterodyne system of the invention wireless and embodiment of the method, structural representation such as Fig. 1 institutes of its is wireless self-heterodyne system
Show.In Fig. 1, video encoding unit and video decoding unit should be included with the video coding and decoding system of ultralow end-to-end time delay,
Video encoding unit includes receive and control module 11, video reception module 12, video down sample module 13, video encoding module
14th, the first coding ping cache modules 15, first encode pong cache modules 16, second and encode ping cache modules 17 and second
Pong cache modules 18 are encoded, receive and control module 11 receives configuration parameter, is configured according to configuration parameter, and by ping/
Pong coding control signals and configuration parameter are respectively transmitted to video reception module 11, video down sample module 12 and Video coding
Module 14, after video reception module 12 often receives the setting line number of one-frame video data, it is deposited into the first coding ping and delays
Storing module 15 and first is encoded in pong cache modules 16, and video down sample module 13 is respectively from the first coding ping cache modules
15 and first encode the reading data of pong cache modules 16, to being deposited into the second coding after the data progress down-sampling processing of reading
Ping cache modules 17 and second encode pong cache modules 18, and video encoding module 14 encodes ping cache modules 17 from second
Encoded with second and data are read in pong cache modules 18 and are encoded, and encoded video data are sent to video decoding list
Member is decoded.It is noted that in the present embodiment, each write/read first encodes ping cache modules 15, first and compiled
Code pong cache modules 16, second encode the video data that ping cache modules 17 and second are encoded in pong cache modules 18
The setting line number of one frame data.The setting line number is specially how many, to be set as the case may be.It is noted that
In the present embodiment, configuration parameter includes video line number per treatment, and video line number per treatment is one-frame video data
Set line number.
Fig. 2 is the structural representation of video decoding unit in the present embodiment.In Fig. 2, video decoding unit includes video solution
Code module 21, video up-sampling module 22, video sending module 23, transmission control module 24, first decode ping cache modules
25th, the first decoding pong cache modules 26, second decode the decoding pong cache modules 28 of ping cache modules 27 and second, video
Decoder module 21 decodes to encoded video data, extracts configuration parameter and is written into transmission control module 24, hair
Control module 24 is sent to be respectively written into video up-sampling module 22 and video sending module 23 again, Video decoding module 21 will
The setting decoded video data of line number is written to the first decoding ping cache modules 25 and the first decoding pong cache modules 26,
Video up-sampling module 22 decodes the reading video data of pong cache modules 26 from the first decoding ping cache modules 25 and first,
The decoding ping of deposit second cache modules 27 and second decode pong cache modules 28 after up-sampling processing is carried out to video data,
Video sending module 23 reads data from the second decoding ping cache modules 27 and the second decoding pong cache modules 28 and carried out
Display output.
Unit is processed with a frame of video in conventional art, and video encoding unit and video decoding are single in the present embodiment
Each module in member handles unit with some behaviors of a frame of video, greatly reduces video encoder, video decoding is set
Standby end-to-end time delay.
The present embodiment further relates to a kind of video coding-decoding method with ultralow end-to-end time delay, its flow chart such as Fig. 3 institutes
Show.In Fig. 3, it should comprise the following steps with the video coding-decoding method of ultralow end-to-end time delay：
Configuration parameter is input to receive and control module by step S01, then is passed configuration parameter respectively by receive and control module
It is sent to video reception module, video down sample module and video encoding module, each module video per treatment in setting system
Line number：In this step, before starting Video coding, configuration parameter is input to receive and control module, then will by receive and control module
Configuration parameter is respectively transmitted to video reception module, video down sample module and video encoding module, each module in setting system
Video line number per treatment.
Step S02 receive and control modules according to configuration parameter setting, to the vertical synchronizing signal and level of input video
Synchronizing signal is detected and counted, and exports corresponding ping/pong coding control signals under video reception module, video
Sampling module and video encoding module：In this step, receive and control module is hung down according to the setting of configuration parameter to input video
Straight synchronizing signal and horizontal-drive signal are detected and counted, and export corresponding ping/pong coding control signals to regarding
Frequency receiving module, video down sample module and video encoding module.
Step S03 video receptions module often receives according to the setting of ping/pong coding control signals and configuration parameter
After the setting line number of one-frame video data, it is deposited into the first coding ping cache modules and the first coding pong cache modules：
In this step, video reception module according to receive and control module input to this module ping/pong coding control signals and
The setting of configuration parameter, often receive the N of one-frame video datalineAfter row, corresponding first coding ping cache modules are deposited into
In the first coding pong cache modules.
Step S04 videos down sample module is according to the setting of ping/pong coding control signals and configuration parameter, from
Interior reading data in one coding ping cache modules and the first coding pong cache modules, and after carrying out down-sampling processing to it,
In the coding ping cache modules of deposit second and the second coding pong cache modules：In this step, frequency down sample module is according to connecing
Ping/pong coding control signals and the setting of configuration parameter that control module inputs to this module are received, from the first coding
Data are read in ping cache modules and the first coding pong cache modules, and after carrying out down-sampling processing to it, deposit second
Encode in ping cache modules and the second coding pong cache modules.
Step S05 video encoding modules are according to the setting of ping/pong coding control signals and configuration parameter, from second
Encode in ping cache modules and the second coding pong cache modules and read data, and after carrying out coded treatment to it, will encode
Video data exports：In this step, the ping/pong that video encoding module inputs to this module according to receive and control module is encoded
The setting of control signal and configuration parameter, read out of the second coding ping cache modules and the second coding pong cache modules
Data, and after carrying out coded treatment to it, by encoded video data output.
Step S06 video decoding units receive encoded video data, and enter row decoding to it：In this step, video decoding
Unit receives encoded video data, and enters row decoding to it.
It is noted that in the present embodiment, each write/read first encodes ping cache modules, the first coding
The video data of pong cache modules, the second coding ping cache modules and the second coding pong cache modules is a frame data
NlineOK.If it is N per the total line number of frame videototal, then Video coding processing delay be reduced to using a frame video as processing unit
Nline/Ntotal。
For the present embodiment, above-mentioned steps S06 can also be refined further, and the flow chart after it is refined is as shown in Figure 4.
In Fig. 4, above-mentioned steps S06 further comprises：
Step S61 Video decoding modules decode to encoded video data, extract the configuration ginseng in encoded video data
Number, configuration parameter is respectively written into and sends control module, on video using in module and video sending module, and it is carried out
Configuration：In this step, Video decoding module decodes to encoded video data, extracts the configuration ginseng in encoded video data
Number, configuration parameter is respectively written into and sends control module, on video using in module and video sending module, and respectively to hair
Send control module, configured using module and video sending module on video, configuration parameter includes setting line number, that is, matches somebody with somebody
Put and video line number N per treatment is contained in parameterline。
Step S62 Video decoding modules decode to encoded video data, and will set the decoded video data of line number and write
Enter into the first decoding ping cache modules and the first decoding pong cache modules, while export corresponding ping/pong decodings
Control signal gives transmission control module：In this step, Video decoding module decodes to encoded video data, and by NlineRow decoding
Video data afterwards is written in the first decoding ping cache modules and the first decoding pong cache modules, while is exported corresponding
Ping/pong decoding control signals give transmission control module.
Step S63 receive and control modules export corresponding ping/pong decodings control respectively according to the setting of configuration parameter
Signal is to video up-sampling module and video sending module：In this step, receive and control module according to configuration parameter setting, and
The ping/pong control signals exported according to the Video decoding module received, corresponding ping/pong decodings control is exported respectively
Signal processed is to video up-sampling module and video sending module.
Step S64 video up-samplings module is according to the setting of ping/pong decoding control signals and configuration parameter, from
Data are read in one decoding ping cache modules and the first decoding pong cache modules, carry out being stored in after up-sampling processing the to it
In two decoding ping cache modules and the second decoding pong cache modules：In this step, video up-sampling module is controlled according to transmission
Molding block inputs to the setting of the decoding control signal and configuration parameter of this module, from the first decoding ping cache modules and the
Data are read in one decoding pong cache modules, the decoding ping cache modules of deposit second and the are carried out after up-sampling processing to it
In two decoding pong cache modules.
Step S65 videos sending module is according to the setting of ping/pong decoding control signals and configuration parameter, from second
Decode in ping cache modules and the second decoding pong cache modules and read data progress display output：In this step, video hair
Module is sent to input to the ping/pong decoding control signals and the setting of configuration parameter of this module according to transmission control module,
Data are read out of the second decoding ping cache modules and the second decoding pong cache modules, and carry out display output.
It is noted that in the present embodiment, each write/read first decodes ping cache modules, the first decoding
Video data in pong cache modules, the second decoding ping cache modules and the second decoding pong cache modules is a frame data
NlineOK.If it is N per the total line number of frame videototal, then Video coding processing delay be reduced to using a frame video as processing unit
Nline/Ntotal。
The present embodiment further relates to a kind of device for realizing the above-mentioned video coding-decoding method with ultralow end-to-end time delay, its
Structural representation is as shown in Figure 5.In Fig. 5, the device includes configuration parameter transmitting element 1, detection counting unit 2, first encodes
Memory cell 3, down-sampling processing unit 4, coding processing unit 5 and decoding unit 6；Wherein, configuration parameter transmitting element 1 is used for
Configuration parameter is input to receive and control module, then configuration parameter is respectively transmitted to video reception mould by receive and control module
Block, video down sample module and video encoding module, each module video line number per treatment in setting system；Detection counts single
Member 2 is used to make setting of the receive and control module according to configuration parameter, vertical synchronizing signal and horizontal synchronization letter to input video
Number detected and counted, and export corresponding ping/pong coding control signals to video reception module, video down-sampling mould
Block and video encoding module；First code storage unit 3 is used to make video reception module according to ping/pong coding control signals
And the setting of configuration parameter, often after the setting line number of reception one-frame video data, it is deposited into the first coding ping cache modules
In the first coding pong cache modules；Down-sampling processing unit 4 is used to make video down sample module be encoded according to ping/pong
The setting of control signal and configuration parameter, read out of the first coding ping cache modules and the first coding pong cache modules
Data, and after carrying out down-sampling processing to it, in the coding ping cache modules of deposit second and the second coding pong cache modules；
Coding processing unit 5 is used to make setting of the video encoding module according to ping/pong coding control signals and configuration parameter, from
Data are read in second coding ping cache modules and the second coding pong cache modules, and after carrying out coded treatment to it, will
Encoded video data output；Decoding unit 6 is used to make video decoding unit receive encoded video data, and enters row decoding to it.
In the present embodiment, each write/read first encodes ping cache modules, the first coding pong cache modules, the
The video data of two coding ping cache modules and the second coding pong cache modules is the N of a frame datalineOK.If regarded per frame
The total line number of frequency is Ntotal, then Video coding processing delay be reduced to using a frame video as processing unit Nline/Ntotal。
In the present embodiment, decoding unit 6 further comprises parameter extraction module 61, decoding writing module 62, decoding control
Signal output module 63, decoding read module 64 and display module 65；Wherein, parameter extraction module 61 is used to make video decode mould
Block decodes to encoded video data, extracts the configuration parameter in encoded video data, configuration parameter is respectively written into hair
Send control module, on video using in module and video sending module, and it is configured；Configuration parameter includes setting and gone
Number；Decoding writing module 62 is used to make Video decoding module decode encoded video data, and will set that line number is decoded to be regarded
Frequency is decoded in pong cache modules according to the first decoding ping cache modules and first are written to, while exports corresponding ping/
Pong decoding control signals give transmission control module；Decoding control signal output module 63 be used for make receive and control module according to
The setting of parameter is put, corresponding ping/pong decoding control signals is exported respectively and sends mould to video up-sampling module and video
Block；Decoding read module 64 is used to make video up-sampling module according to ping/pong decoding control signals and configuration parameter
Set, read data out of the first decoding ping cache modules and the first decoding pong cache modules, it is carried out at up-sampling
After reason in the decoding ping cache modules of deposit second and the second decoding pong cache modules；Display module 65 is used for video and sends mould
Root tuber solves according to the setting of ping/pong decoding control signals and configuration parameter from the second decoding ping cache modules and second
Data, which are read, in code pong cache modules carries out display output.
In the present embodiment, each write/read first decodes ping cache modules, the first decoding pong cache modules, the
Video data in two decoding ping cache modules and the second decoding pong cache modules is the N of a frame datalineOK.If per frame
The total line number of video is Ntotal, then Video coding processing delay be reduced to using a frame video as processing unit NlineNtotal。
In a word, in the present embodiment, by transforming video encoding unit and video decoding unit, its internal place
Reason module is handled by processing unit of a frame of video, but is carried out with some behavior units in a frame of video
Processing, it so as to substantially reduce the end-to-end processing delay of coding and decoding, can reach≤50ms end-to-end time delay.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all essences in the present invention
God any modification, equivalent substitution and improvements made etc., should be included in the scope of the protection with principle.
Claims (6)
1. a kind of video coding and decoding system with ultralow end-to-end time delay, it is characterised in that the ultralow end-to-end time delay reaches
To≤50ms end-to-end time delay, including video encoding unit and video decoding unit, the video encoding unit includes receiving
Control module, video reception module, video down sample module, video encoding module, the first coding ping cache modules, first are compiled
Code pong cache modules, the second coding ping cache modules and the second coding pong cache modules, the receive and control module connect
Configuration parameter is received, is configured according to the configuration parameter, and ping/pong coding control signals and the configuration parameter are divided
Supplementary biography is sent to the video reception module, video down sample module and video encoding module, and the video reception module often receives
After the setting line number of one-frame video data, the first coding ping cache modules and the first coding pong cachings are deposited into
In module, the video down sample module is respectively from the described first coding ping cache modules and the first coding pong cache modules
Data are read, to being deposited into the second coding ping cache modules and second after the data progress down-sampling processing of the reading
Pong cache modules are encoded, the video encoding module caches from the described second coding ping cache modules and the second coding pong
Data are read in module and are encoded, and encoded video data are sent to the video decoding unit and decoded；
The video decoding unit includes Video decoding module, video up-sampling module, video sending module, transmission control mould
Block, the first decoding ping cache modules, the first decoding pong cache modules, the second decoding ping cache modules and the second decoding
Pong cache modules, the Video decoding module decode to encoded video data, extract the configuration parameter and by its
The transmission control module is written to, the transmission control module is respectively written into the video up-sampling module and regarded again
Frequency sending module, the Video decoding module will set the decoded video data of line number be written to it is described first decoding ping delay
Storing module and the first decoding pong cache modules, the video up-sampling module is from the described first decoding ping cache modules and the
One decoding pong cache modules read the video data, and described second is stored in after up-sampling processing is carried out to the video data
Ping cache modules and the second decoding pong cache modules are decoded, the video sending module caches from the described second decoding ping
Data, which are read, in module and the second decoding pong cache modules carries out display output；
Each module in video encoding unit and video decoding unit handles unit with some behaviors of a frame of video；Write every time
Enter/read the first coding ping cache modules, the first coding pong cache modules, the second coding ping cache modules and second to compile
The video data of code pong cache modules is the N of a frame datalineOK, if being N per the total line number of frame videototal, then Video coding
Processing delay is reduced to the N using a frame video as processing unitline/Ntotal。
2. the video coding and decoding system according to claim 1 with ultralow end-to-end time delay, it is characterised in that described to match somebody with somebody
Putting parameter includes video line number per treatment, and the video line number per treatment is the setting line number of one-frame video data.
3. a kind of video coding-decoding method with ultralow end-to-end time delay, it is characterised in that the ultralow end-to-end time delay reaches
To≤50ms end-to-end time delay, comprise the following steps：
A configuration parameter) is input to receive and control module, then is respectively transmitted the configuration parameter by the receive and control module
To the video reception module, video down sample module and video encoding module, each module is per treatment in setting system regards
Frequency line number；
B) receive and control module according to the configuration parameter setting, it is same to the vertical synchronizing signal and level of input video
Step signal is detected and counted, and exports corresponding ping/pong coding control signals to the video reception module, video
Down sample module and video encoding module；
C) the video reception module often receives according to the setting of the ping/pong coding control signals and configuration parameter
After the setting line number of one-frame video data, it is deposited into the first coding ping cache modules and the first coding pong cache modules；
D) video down sample module is according to the setting of the ping/pong coding control signals and configuration parameter, from described
Interior reading data in one coding ping cache modules and the first coding pong cache modules, and after carrying out down-sampling processing to it,
In the coding ping cache modules of deposit second and the second coding pong cache modules；
E) video encoding module is according to the setting of the ping/pong coding control signals and configuration parameter, from described second
Encode in ping cache modules and the second coding pong cache modules and read data, and after carrying out coded treatment to it, will encode
Video data exports；
F) video decoding unit receives the encoded video data, and enters row decoding to it；Each write/read first encodes
Ping cache modules, the first coding pong cache modules, the second coding ping cache modules and the second coding pong cache modules
Video data be a frame data NlineOK, if being N per the total line number of frame videototal, then Video coding processing delay be reduced to
N using a frame video as processing unitline/Ntotal。
4. the video coding-decoding method according to claim 3 with ultralow end-to-end time delay, it is characterised in that the step
Rapid F) further comprise：
F1) Video decoding module decodes to encoded video data, extracts the configuration parameter in the encoded video data, will
The configuration parameter is respectively written into and sends control module, on video using in module and video sending module, and it is carried out
Configuration；The configuration parameter includes the setting line number；
F2) Video decoding module decodes to the encoded video data, and sets the decoded video counts of line number by described
Decoded according to the first decoding ping cache modules and first are written in pong cache modules, while export corresponding ping/pong
Decoding control signal gives transmission control module；
F3) receive and control module exports corresponding ping/pong decoding control signals respectively according to the setting of the configuration parameter
To video up-sampling module and video sending module；
F4) the video up-sampling module is according to the setting of the ping/pong decoding control signals and configuration parameter, from
Data are read in one decoding ping cache modules and the first decoding pong cache modules, carry out being stored in after up-sampling processing the to it
In two decoding ping cache modules and the second decoding pong cache modules；
F5) video sending module is according to the setting of the ping/pong decoding control signals and configuration parameter, from described second
Decode in ping cache modules and the second decoding pong cache modules and read data progress display output.
5. a kind of device for realizing the video coding-decoding method with ultralow end-to-end time delay as claimed in claim 3, it is special
Sign is, the ultralow end-to-end time delay reaches≤50ms end-to-end time delay, including：
Configuration parameter transmitting element：For configuration parameter to be input into receive and control module, then will by the receive and control module
The configuration parameter is respectively transmitted to the video reception module, video down sample module and video encoding module, sets system
Interior each module video line number per treatment；
Detect counting unit：For making setting of the receive and control module according to the configuration parameter, input video is hung down
Straight synchronizing signal and horizontal-drive signal are detected and counted, and export corresponding ping/pong coding control signals to institute
State video reception module, video down sample module and video encoding module；
First code storage unit：For making the video reception module according to the ping/pong coding control signals and
The setting of configuration parameter, after the setting line number for often receiving one-frame video data, it is deposited into the first coding ping cache modules and the
In one coding pong cache modules；
Down-sampling processing unit：For making video down sample module according to the ping/pong coding control signals and configuration
The setting of parameter, the interior reading data out of the described first coding ping cache modules and the first coding pong cache modules, and it is right
After it carries out down-sampling processing, in the coding ping cache modules of deposit second and the second coding pong cache modules；
Coding processing unit：For making video encoding module according to the ping/pong coding control signals and configuration parameter
Setting, read data out of the described second coding ping cache modules and the second coding pong cache modules, and it carried out
After coded treatment, by encoded video data output；
Decoding unit：For making video decoding unit receive the encoded video data, and row decoding is entered to it；Write every time/
Read the first coding ping cache modules, the first coding pong cache modules, the second coding ping cache modules and the second coding
The video data of pong cache modules is the N of a frame datalineOK, if being N per the total line number of frame videototal, then at Video coding
Reason time delay is reduced to the N using a frame video as processing unitline/Ntotal。
6. device according to claim 5, it is characterised in that the decoding unit further comprises：
Parameter extraction module：For making Video decoding module decode encoded video data, the encoded video number is extracted
According to interior configuration parameter, the configuration parameter is respectively written into and sends control module, is sent using module and video on video
In module, and it is configured；The configuration parameter includes the setting line number；
Decode writing module：Gone for making the Video decoding module decode the encoded video data, and by the setting
Video data after number decoder is written in the first decoding ping cache modules and the first decoding pong cache modules, is exported simultaneously
Corresponding ping/pong decoding control signals give transmission control module；
Decoding control signal output module：For making setting of the receive and control module according to the configuration parameter, phase is exported respectively
The ping/pong decoding control signals answered are to video up-sampling module and video sending module；
Decode read module：For making the video up-sampling module according to the ping/pong decoding control signals and matching somebody with somebody
The setting of parameter is put, data is read out of the first decoding ping cache modules and the first decoding pong cache modules, it is carried out
After up-sampling processing in the decoding ping cache modules of deposit second and the second decoding pong cache modules；
Display module：Setting for video sending module according to the ping/pong decoding control signals and configuration parameter,
Data, which are read, out of the described second decoding ping cache modules and the second decoding pong cache modules carries out display output.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510166114.8A CN104780376B (en) | 2015-04-09 | 2015-04-09 | A kind of video coding and decoding system with ultralow end-to-end time delay, method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510166114.8A CN104780376B (en) | 2015-04-09 | 2015-04-09 | A kind of video coding and decoding system with ultralow end-to-end time delay, method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104780376A CN104780376A (en) | 2015-07-15 |
| CN104780376B true CN104780376B (en) | 2018-03-23 |
Family
ID=53621573
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510166114.8A Active CN104780376B (en) | 2015-04-09 | 2015-04-09 | A kind of video coding and decoding system with ultralow end-to-end time delay, method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104780376B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106792133A (en) * | 2016-12-30 | 2017-05-31 | 北京华为数字技术有限公司 | Virtual reality server, method of transmitting video data and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1964495A (en) * | 2006-12-08 | 2007-05-16 | 北京中星微电子有限公司 | A method and device for carrying out buffer control to real time digital video stream |
| CN101119118A (en) * | 2007-09-06 | 2008-02-06 | 上海交通大学 | Encoder of LDPC code of layered quasi-circulation extended structure |
| CN102724489A (en) * | 2012-04-20 | 2012-10-10 | 苏州汉辰数字科技有限公司 | Method for reducing video coding time delay |
| CN103763556A (en) * | 2014-01-29 | 2014-04-30 | 广东威创视讯科技股份有限公司 | Video image encoding and decoding device and method and transmission system and method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7307669B2 (en) * | 2003-06-24 | 2007-12-11 | Broadcom Corporation | System, method, and apparatus for displaying streams with dynamically changing formats |
-
2015
- 2015-04-09 CN CN201510166114.8A patent/CN104780376B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1964495A (en) * | 2006-12-08 | 2007-05-16 | 北京中星微电子有限公司 | A method and device for carrying out buffer control to real time digital video stream |
| CN101119118A (en) * | 2007-09-06 | 2008-02-06 | 上海交通大学 | Encoder of LDPC code of layered quasi-circulation extended structure |
| CN102724489A (en) * | 2012-04-20 | 2012-10-10 | 苏州汉辰数字科技有限公司 | Method for reducing video coding time delay |
| CN103763556A (en) * | 2014-01-29 | 2014-04-30 | 广东威创视讯科技股份有限公司 | Video image encoding and decoding device and method and transmission system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104780376A (en) | 2015-07-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2018150083A1 (en) | A method and technical equipment for video processing | |
| CN103763556B (en) | Video image encoding and decoding devices and methods therefor, Transmission system and its method | |
| CN102238390B (en) | Image-library-based video and image coding and decoding method and system | |
| RU2016131431A (en) | TRANSMISSION DEVICE, TRANSMISSION METHOD, RECEIVING DEVICE, RECEIVING METHOD, DISPLAY DEVICE AND DISPLAY METHOD | |
| US20110007979A1 (en) | Image data compression involving sub-sampling of luma and chroma values | |
| US11778190B2 (en) | Method and device for intra-predictive encoding/decoding a coding unit comprising picture data, said intra-predictive encoding depending on a prediction tree and a transform tree | |
| US11968379B2 (en) | Video decoding method and apparatus, video encoding method and apparatus, storage medium, and electronic device | |
| WO2019070952A1 (en) | A method and apparatus for encoding/decoding the geometry of a point cloud representing a 3d object | |
| CN105306110A (en) | Methods and system for realizing music synchronous play | |
| CN102724516B (en) | Adaptive signal processing method, device and decoder | |
| CN115115720A (en) | Image decoding and encoding method, device and equipment | |
| CN104780376B (en) | A kind of video coding and decoding system with ultralow end-to-end time delay, method and device | |
| CN106656195A (en) | Data compression decompression method and data compression decompression system | |
| CN104067615A (en) | Encoding device and encoding method, and decoding device and decoding method | |
| CN109040818B (en) | Audio and video synchronization method, storage medium, electronic equipment and system during live broadcasting | |
| AU2022286517A1 (en) | Feature data encoding method and apparatus and feature data decoding method and apparatus | |
| CN106385627B (en) | video encoding method and apparatus | |
| EP3258685A1 (en) | Video controller, play controller and display system | |
| CN204481853U (en) | A kind of isolation gap based on SDI | |
| CN106782573B (en) | Method for generating AAC file through coding | |
| EP3989549A1 (en) | Video image processing method and device, and storage medium | |
| JP2016111705A5 (en) | ||
| CN110545431B (en) | Video decoding method and device, video encoding method and device | |
| WO2020107376A1 (en) | Image processing method, device, and storage medium | |
| EP3637734B1 (en) | Video data display method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |