CN101217671A - A method of flexible macro-block sequencing mode in self-adapting selection H.264 video standard - Google Patents
A method of flexible macro-block sequencing mode in self-adapting selection H.264 video standard Download PDFInfo
- Publication number
- CN101217671A CN101217671A CN 200810046651 CN200810046651A CN101217671A CN 101217671 A CN101217671 A CN 101217671A CN 200810046651 CN200810046651 CN 200810046651 CN 200810046651 A CN200810046651 A CN 200810046651A CN 101217671 A CN101217671 A CN 101217671A
- Authority
- CN
- China
- Prior art keywords
- fmo
- macro
- frame
- block
- cost
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/129—Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a method to self-adaptively select the flexible macro block sequencing model in H.264 video standard. The method is that: firstly, information corresponding to current coding frames is respectively initialized according to the definitions of 6 fixed FMO models stipulated in the H.264 video standard; secondly, error concealment distortion of the current coding frames under the 6 fixed FMO models is predicted respectively according to known macro block information of a prior coding frame; thirdly, the number of header information bits used for coding the current frames by adopting the 6 fixed FMO models is predicted respectively according to the known macro block information of the prior coding frame; fourthly, cost values of adopting 6 fixed FMO models in the current coding frame are respectively calculated according to Rate-Distortion Optimization; finally, the FMO model corresponding to the smallest cost value in the 6 cost values is selected as the FMO model of the current coding frame. The invention is more suitable for the fault tolerance of video transmission under wireless circumstances.
Description
Technical field
The present invention relates to the method for flexible macro-block sequencing mode in a kind of adaptively selected H.264 video standard, belong to field of video encoding.
Background technology
H.264 video standard is the cover video encoding and decoding standard of ITU-T International Standards Organization in formal issue of in March, 2005, be directed to the video transmission under the wireless environment, H.264 provide flexible macro-block ordering (FMO) this error resilience tool in, it has defined 6 kinds of fixing sheet group templates and 1 group self-defined group template, space neighboring macro-blocks in one two field picture can be divided in the different sheet groups, weaken the correlation of its adjacent macroblocks, thereby improve the validity of decoding end error concealment mechanism.At present, the research of using FMO to improve the video transmission fault-tolerance mainly is divided into two big classes: a class is to improve transmission error tolerance by fixing certain FMO template of using; Another kind of is under the framework of encoding region of interest, utilizes the FMO template as the specific implementation means, image is simply divided, and interested and non-area-of-interest is implemented different safeguard measures improve transmission error tolerance.Because the flexibility and the compatibility of first kind method are not high, its fault-tolerant effect can't be suitable for various video sequence and image scene; And second class methods as just the realization means of partitioned image, can't make full use of the transmission error tolerance ability that FMO has just as the aid of encoding region of interest.Therefore, find a kind of method of flexible selection current encoded image FMO pattern to have very strong using value.
Summary of the invention
The objective of the invention is to provide the method for FMO pattern in a kind of adaptively selected H.264 video standard in order to overcome above-mentioned the deficiencies in the prior art, this method can improve the flexibility and the compatibility of FMO fault-tolerant ability, makes it to be fit to various image scene and video sequence.
Realize that the technical scheme that the object of the invention adopts is: the method for flexible macro-block sequencing mode in a kind of adaptively selected H.264 video standard may further comprise the steps:
(1) respectively according to 6 kinds of fixed and flexible macro-block sequencing modes definition of stipulating in the video standard H.264, the information of initialization current encoded frame;
(2) according to the error concealment algorithm in the H.264 coder/decoder that uses,, utilize macro block information known in the last coded frame, the error concealment distortion factor D of estimation current encoded frame based on given flexible macro-block sequencing mode information
Frm, ec(s);
(3) according to macro block information known in the last coded frame, the header bit number sum of all macro blocks, the i.e. spent header bit number R of present frame in the estimation current encoded frame
Frm, head(s);
(4) according to the computation rule of the Lagrange multiplier of standard code H.264, the value λ of the Lagrange multiplier during the calculation code present frame;
(5), obtain current network packet loss rate p according to the mapping relations of the error rate and packet loss;
The mapping relations of the error rate and packet loss can obtain according to list of references 1;
(6) according to step (1)～(5) gained information, based on the rate-distortion optimization theory, can calculate present frame and adopt 6 kinds of fixedly corresponding codes cost value cost during the FMO pattern respectively, wherein calculate the FMO cost value of present frame: cost=pD according to following rate-distortion optimization formula
Frm, ec(s)+λ R
Frm, head(s).
(7) get 6 cost value from this and select minimum cost to be worth pairing FMO pattern, as the FMO coding mode of present frame.
The present invention and prior art contrast, and effect is positive and tangible: improve the flexibility and the compatibility of FMO fault-tolerant ability, thereby improve the fault-tolerant ability of H.264 video transmission.
Embodiment
The invention will be further described below in conjunction with embodiment, but do not limit the present invention.
H.264/AVC reference software JM12.2 is as coder/decoder in the present embodiment employing, video transmission channel adopts the wireless WCDMA channel among the wireless transmission reference model MobliIP, " Foreman " and " Hall monitor " sequence of choosing QCIF resolution sizes (176 * 144) is as coded sequence, with the 4th two field picture in the coding Foreman sequence is example, specifically sets forth execution in step of the present invention:
(1) according to 6 kinds that stipulate in the video standard H.264 fixing FMO mode-definition, before the specific coding present frame, by reading fixedly FMO information of configured in advance good 6 kinds, determine sheet group number (SliceGroup_Id) and other initialization informations under each macro block in the current encoded frame;
(2) according to selected a kind of error concealment algorithm,, utilize macro block information known in the last coded frame, the error concealment distortion factor D of estimation current encoded frame based on given FMO pattern information
Frm, ec(s): select " spatial domain weighted interpolation " this error concealment method in the present embodiment: at first, whether belong to same according to damaged macro block and adjacent macroblocks, determine thus whether this adjacent macroblocks can come reference, thereby four macro blocks in upper and lower, left and right that current damaged macro block is adjacent are judged successively, then the pixel value of the available adjacent macroblocks that obtains according to the judgement value of coming each pixel of predictive of impaired interior macroblocks.
Owing in every two field picture of QCIF resolution sizes 99 macro blocks are arranged, successively these 99 macro blocks are covered the distortion estimation by above computation rule, and it is covered the distortion value summation.Adopt FMO pattern 0 to pattern 5 pairing 6 error concealment distortion estimated values thereby obtain present frame, be followed successively by: 23369170,26685642,23275551,23356750,23369170,23369170.
(3), thereby estimate the spent header bit number R of present frame with the motion vector value of macro block information known in the last coded frame-" each macroblock motion vector value " approximately equivalent each macro block in present frame
Frm, head(s).At present frame, obtain adopting FMO pattern 0 to expend bit number to pattern 5 pairing 6 headers, be followed successively by: 796,198,946,849,930,844
(4) according to the computation rule of the Lagrange multiplier of standard code H.264, at first obtain quantization parameter (QP) value of distributing to current encoded frame, and calculate Lagrange multiplier value λ according to formula:
λ＝0.85×2
(Qp-12)/3
At this moment, the quantization parameter QP value of present frame is 16, so Lagrange multiplier value λ=2.1418.
(5) according to the mapping relations of the list of references 1 described error rate and packet loss, obtain current network packet loss rate p=0.03;
(6) utilize the information of step (2)～(5), based on the rate-distortion optimization theory, based on formula:
cost＝p·D
frm，ec(s)+λ·R
frm，head(s)
Calculate present frame respectively and adopt 6 kinds of pairing 6 FMO coding of FMO pattern cost value cost.
At the present embodiment present frame, obtain adopting FMO pattern 0 to be followed successively by 702780,800993,700292,702520,703067,702882 to pattern 5 pairing 6 FMO coding cost value.
(7) from 6 FMO coding cost value that step (6) obtains, select that minimum pairing FMO pattern, as the FMO coding mode of present frame.The final FMO pattern of selecting of present frame is a pattern 2.
Realize effect: present embodiment is tested the Foreman and the Hall monitor sequence of QCIF form.Encoder bit rate is fixed as 64Kbps, and the coding frame number is 100 frames, and order is IPPPPPP.Video sequence (document 2 sees reference) the wireless WCDMA channel in wireless transmission reference model MobliIP that encodes is carried out analogue transmission to be received, Y-PSNR (PSNR) result after H.264 decoding on the identifying code JM12.2, covering is as shown in table 1 for the wrong code stream that will receive then.At different video sequences, fixedly FMO template with best fault-tolerance is different, (the Foreman sequence is a pattern 1, Hall monitor sequence is a mode 3), the video Y-PSNR that obtains with the method for the invention not only is higher than fixedly FMO pattern of great majority, and has better compatibility and adaptability at the different video sequence.
Table 1: different FMO patterns are entered the Y-PSNR PSNR (unit: dB) after decoding is covered
List of references
1.Thomas?Stockhammer，Miska?M.Hannuksela，and?Thomas?Wiegand：H.264/AVCin?wireless?environments.IEEE?Transactions?on?Circuits?and?Systemsfor?Video?Technology，Vol.13，No.7，July?2003.
2.Viktor?Varsa，Marta?Karczewicz，et?al.Common?Test?Conditions?forRTP/IP?over?3GPP/3GPP2.ITU-T?SG16?Document：VCEG-N80，Santa?Barbara，CA，USA，Sept.2001.
Claims (2)
1. the method for flexible macro-block sequencing mode in the adaptively selected H.264 video standard is characterized in that may further comprise the steps:
(1) respectively according to 6 kinds of fixed and flexible macro-block sequencing modes definition of stipulating in the video standard H.264, the information of initialization current encoded frame;
(2) according to the error concealment algorithm in the H.264 coder/decoder that uses,, utilize macro block information known in the last coded frame, the error concealment distortion factor D of estimation current encoded frame based on given flexible macro-block sequencing mode information
Frm, ec(s);
(3) according to macro block information known in the last coded frame, the header bit number sum of all macro blocks, the i.e. spent header bit number R of present frame in the estimation current encoded frame
Frm, head(s);
(4) according to the computation rule of the Lagrange multiplier of standard code H.264, the value λ of the Lagrange multiplier during the calculation code current encoded frame;
(5), obtain current network packet loss rate p according to the mapping relations of the error rate and packet loss;
(6),, can calculate 6 coding cost value cost that current encoded frame adopts 6 kinds of fixed and flexible macro-block sequencing mode correspondences respectively based on the rate-distortion optimization theory according to step (1)～(5) gained information;
(7) from these 6 cost value, select minimum cost to be worth pairing flexible macro-block sequencing mode, as the flexible macro-block sorting coding pattern of current encoded frame.
2. according to the method for flexible macro-block sequencing mode in the described adaptively selected H.264 video standard of claim 1, it is characterized in that: step (6) calculates the FMO cost function value of present frame: cost=pD according to following rate-distortion optimization formula
Frm, ec(s)+λ R
Frm, head(s).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200810046651 CN101217671B (en) | 2008-01-09 | 2008-01-09 | A method of flexible macro-block sequencing mode in self-adapting selection H.264 video standard |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200810046651 CN101217671B (en) | 2008-01-09 | 2008-01-09 | A method of flexible macro-block sequencing mode in self-adapting selection H.264 video standard |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101217671A true CN101217671A (en) | 2008-07-09 |
| CN101217671B CN101217671B (en) | 2011-02-16 |
Family
ID=39624024
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200810046651 Expired - Fee Related CN101217671B (en) | 2008-01-09 | 2008-01-09 | A method of flexible macro-block sequencing mode in self-adapting selection H.264 video standard |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101217671B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101917627A (en) * | 2010-08-20 | 2010-12-15 | 浙江大学 | Video fault-tolerant coding method based on self-adaptation flexible macro-block order |
| CN102340659A (en) * | 2010-07-23 | 2012-02-01 | 联合信源数字音视频技术（北京）有限公司 | Parallel mode decision device and method based on AVS (Audio Video Standard) |
| CN102761906A (en) * | 2012-07-20 | 2012-10-31 | 西安交通大学 | Method for transmitting video packets in wireless local area network |
| CN103248890A (en) * | 2013-03-27 | 2013-08-14 | 陈日清 | Source data acquisition and compression method for wireless projection |
| WO2019114024A1 (en) * | 2017-12-13 | 2019-06-20 | 北京大学 | Lagrange multiplication model-based coding optimization method and device in point cloud frame |
| CN110720222A (en) * | 2017-07-10 | 2020-01-21 | 影图辟开思公司 | Method and apparatus for digital data compression |
| CN115100080A (en) * | 2022-08-24 | 2022-09-23 | 中南大学 | FMO error concealment method, system, equipment and medium for video image |
-
2008
- 2008-01-09 CN CN 200810046651 patent/CN101217671B/en not_active Expired - Fee Related
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102340659A (en) * | 2010-07-23 | 2012-02-01 | 联合信源数字音视频技术（北京）有限公司 | Parallel mode decision device and method based on AVS (Audio Video Standard) |
| CN102340659B (en) * | 2010-07-23 | 2013-09-04 | 联合信源数字音视频技术（北京）有限公司 | Parallel mode decision device and method based on AVS (Audio Video Standard) |
| CN101917627A (en) * | 2010-08-20 | 2010-12-15 | 浙江大学 | Video fault-tolerant coding method based on self-adaptation flexible macro-block order |
| CN101917627B (en) * | 2010-08-20 | 2012-01-25 | 浙江大学 | Video fault-tolerant coding method based on self-adaptation flexible macro-block order |
| CN102761906A (en) * | 2012-07-20 | 2012-10-31 | 西安交通大学 | Method for transmitting video packets in wireless local area network |
| CN102761906B (en) * | 2012-07-20 | 2014-09-03 | 西安交通大学 | Method for transmitting video packets in wireless local area network |
| CN103248890A (en) * | 2013-03-27 | 2013-08-14 | 陈日清 | Source data acquisition and compression method for wireless projection |
| CN110720222A (en) * | 2017-07-10 | 2020-01-21 | 影图辟开思公司 | Method and apparatus for digital data compression |
| WO2019114024A1 (en) * | 2017-12-13 | 2019-06-20 | 北京大学 | Lagrange multiplication model-based coding optimization method and device in point cloud frame |
| CN115100080A (en) * | 2022-08-24 | 2022-09-23 | 中南大学 | FMO error concealment method, system, equipment and medium for video image |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101217671B (en) | 2011-02-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101217671B (en) | A method of flexible macro-block sequencing mode in self-adapting selection H.264 video standard | |
| TWI572189B (en) | Method of deriving quantization parameter | |
| JP5254997B2 (en) | Motion estimation for discovered frame regions | |
| JP4650173B2 (en) | Encoding apparatus, encoding method, encoding method program, and recording medium recording the encoding method program | |
| KR100739714B1 (en) | Method and apparatus for intra prediction mode decision | |
| CN103004194B (en) | Encoding/decoding image equipment and method | |
| CN102301716B (en) | Method for decoding a stream representative of a sequence of pictures, method for coding a sequence of pictures and coded data structure | |
| CN104041003B (en) | Scene change detection for the perceived quality assessment in video sequence | |
| WO2012159306A1 (en) | Method and device for prediction encoding | |
| JP5860491B2 (en) | Motion vector prediction method | |
| WO2009121233A1 (en) | Spatial prediction method for video encoding | |
| CN101313581B (en) | Method and device for coding a video image | |
| KR100757208B1 (en) | Fast multiple reference frame selection method in motion estimation for H.264 video encoding | |
| CN101179734B (en) | Interframe prediction method and system of video compression | |
| CN101227619B (en) | Method for realizing image error covering in video decipher and video decoder | |
| JP2010283495A (en) | Device and method for coding dynamic image | |
| KR20060085004A (en) | A fast macroblock mode selection method in the h.264 standard | |
| Chen et al. | Adaptive FMO selection strategy for error resilient H. 264 coding | |
| Zhang et al. | Enhanced intra prediction and transform for video coding | |
| KR20060085003A (en) | A temporal error concealment method in the h.264/avc standard | |
| KR100359819B1 (en) | An Efficient Edge Prediction Methods In Spatial Domain Of Video Coding | |
| CN111263158B (en) | Multi-transformation-core rapid processing method based on spatial correlation | |
| CN101790848B (en) | Distribute to the selection of the decoding functions of decoder | |
| CN101977327B (en) | Video error-resistance coding and encoding method based on embedded distributed video coding descriptions | |
| CN104539967A (en) | Inter-frame prediction method in mixed video coding standard |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110216 Termination date: 20150109 |
|
| EXPY | Termination of patent right or utility model |