CN107801040A - HEVC/H.265 encoder architectures and its interior Forecasting Methodology with interframe of frame - Google Patents

HEVC/H.265 encoder architectures and its interior Forecasting Methodology with interframe of frame Download PDF

Info

Publication number
CN107801040A
CN107801040A CN201711017670.4A CN201711017670A CN107801040A CN 107801040 A CN107801040 A CN 107801040A CN 201711017670 A CN201711017670 A CN 201711017670A CN 107801040 A CN107801040 A CN 107801040A
Authority
CN
China
Prior art keywords
prediction
hevc
frame
block
encoder
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711017670.4A
Other languages
Chinese (zh)
Inventor
欧阳国胜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jiaxun Feihong Electrical Co Ltd
Original Assignee
Beijing Jiaxun Feihong Electrical Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jiaxun Feihong Electrical Co Ltd filed Critical Beijing Jiaxun Feihong Electrical Co Ltd
Priority to CN201711017670.4A priority Critical patent/CN107801040A/en
Publication of CN107801040A publication Critical patent/CN107801040A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/109—Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/13—Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/573—Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention discloses the Forecasting Methodology in a kind of new HEVC/H.265 encoder architectures and its frame with interframe.The new HEVC/H.265 encoders clear stipulaties implementation process of decoder, and encoded in traditional main flow encoder prediction, transition coding, on the basis of the three-dimensional integrated mixed architecture of entropy code, breach decoding end and there was only compressed bit stream and reconstruction frames this bottlenecks, propose and make reference/predict this brand-new thinking using inputting primitive frame, realize on the premise of any amount of calculation is not increased, HEVC/H.265 encoders intra prediction direction and the degree of accuracy of inter frame motion estimation this vision can be improved, reach the ability that further lifting encoder eliminates the various redundancies of image in video sequence, improve the compression efficiency and Y-PSNR PSNR this purpose of image.

Description

HEVC/H.265 encoder architectures and its interior Forecasting Methodology with interframe of frame
Technical field
The invention belongs to technical field of video communication, and in particular to a kind of new HEVC/H.265 encoder architectures and its frame The interior and Forecasting Methodology of interframe.
Background technology
In the age of this video communication, how the basic problem of video encoder can be regarded as in code check and distortion two Compromised between person, i.e.,：Under given code check, initial data is encoded to obtain reconstruction distortion as small as possible； Either under given reconstruction distortion, alap code check is obtained.Therefore, people employ many new technologies, as new Intraframe prediction algorithm, variable size block motion compensation, the motion vector for supporting 1/4 pixel precision, rate-distortion optimization technology etc..And The lifting of compression performance is obtained, is all often to increase substantial amounts of amount of calculation as cost.
In addition, in the prior art MPEG1/2/4, H.261/3/4/5, the video standard such as VC1, VP8/9 it is not bright Really provide how a codec is realized, but merely specify the sentence of a video bit stream through overcompression Method, and the coding/decoding method of the bit stream.The encoder and decoder of each manufacturer under this framework can intercommunication, realize live In there is larger flexibility, and be advantageous to vie each other.
What all main flow encoders used at present is still predictive coding, transition coding, the Trinitarian hybrid frame of entropy code Structure.Wherein predictive coding part is made reference/predicted using reconstruction frames, is added by conversion, quantified, inverse amount by prediction block Change, the residual error reconstructed block after inverse transformation, obtain the reconstructed block of present encoding block.But merely because primitive frame is not present in decoding end This reason greatly limit the renewal and breakthrough of encoder architecture.
Therefore need new approaches to lift coding compression efficiency, i.e., do not increase or not on the premise of amount of calculation code efficiency and Improving the definition of image becomes particularly important.
The content of the invention
It is contemplated that at least solve one of problems of the prior art.
One of the technical problem to be solved in the present invention is to need new approaches to lift coding compression efficiency, i.e., not increase meter Increase code efficiency on the premise of calculation amount and improve the definition of image.
In order to solve the above technical problems, the present invention provides in a kind of new HEVC/H.265 encoder architectures and its frame and frame Between Forecasting Methodology.
The intra-frame prediction method of the new HEVC/H.265 codings, including：
Each intra prediction direction is all calculated as below：
First, with prediction direction and present frame FnThe periphery initial data of present encoding block generates a prediction according to standard Block P；Secondly, present encoding block and the prediction block P of generation cost are calculated；Then, obtain successively according to the method described above all pre- Survey cost caused by direction, optimum prediction direction of prediction direction of the selection with minimum cost as present encoding block；
Finally, residual block D is calculated with present encoding block and prediction block Pn, by residual block DnEnter along optimum prediction direction Row entropy code.
The inter-frame prediction method of the new HEVC/H.265 codings, including：
First, to present frame FnPresent encoding block in previous frame be reference frame F,n-1Original YUV in carry out motion and estimate Meter obtains motion vector MV and reference key value REF；
Secondly, using motion vector MV, reference key value REF and reference frame F,n-1Calculate prediction block P；Then, with work as Preceding encoding block and prediction block P calculate residual block Dn；
Finally by residual block Dn, motion vector MV, reference key value REF carry out entropy code.
The new HEVC/H.265 encoder architectures, the present frame F of input can be madenHandled by the above method, group Code stream into after a compression, through NAL for transmission and storage, specifically includes following structure：
Single HEVC divides for predictive mode analysis, transform and quantization/inverse transformation and inverse quantization, reordered and entropy code three-level stream Water；
Two-stage decoupled signals loop (prediction and entropy code) is built between each HEVC and a ring is provided with before reconstruction frames Path filter is with noise reduction.
Specifically, it is divided into inter prediction and the small two-stage flowing water of infra-frame prediction again in the predictive mode analysis.
Specifically, prediction decoupled signals are produced in the prime HEVC after the completion of MB inverse quantizations/inverse transformation to subordinate HEVC can infra-frame prediction and inter prediction, subordinate HEVC receive prediction uncoupling signal before can filtered reconstruction frames.
Specifically, in the prime HEVC entropy code produce entropy code uncoupling signal to subordinate HEVC can entropy compile Code.
Compared with existing disclosed technical scheme, the present invention have the advantage that for：
By the use of primitive frame is inputted as reference/prediction, a kind of Novel encoder is proposed, before any amount of calculation is not increased Put, the degree of accuracy of HEVC/H.265 encoders intra prediction direction and inter frame motion estimation can be improved, reach further lifting Encoder eliminates the ability of the various redundancies of image in video sequence, improves the compression efficiency and Y-PSNR of image PSNR。
Brief description of the drawings
Fig. 1 show the new HEVC/H.265 decoder architectures block diagram of the present invention；
Fig. 2 show the encoder architecture block diagram that the new HEVC/H.265 reconstruction frames of the present invention make reference；
Fig. 3 show the encoder architecture block diagram that the new HEVC/H.265 primitive frames of the present invention make reference.
Embodiment
The embodiment and effect of the inventive method are described in detail below in conjunction with specific embodiment.It should be noted that It is that the combination of the technical characteristic or technical characteristic described in following embodiments is not construed as isolated, and they can be with It is mutually combined so as to reach superior technique effect.
Below in conjunction with specific embodiment, the present invention is described in detail.
The new HEVC/H.265 decoder architectures of embodiment 1
The function composition of decoder by the NAL of encoder as shown in figure 1, export the bit stream after a compression, through entropy solution Code is quantified after one group of conversion coefficient, then through obtaining residual block D ' after inverse quantization and inverse transformationn.Using being solved in the bit stream The header of code out, makes decoder produce a prediction block P, and it is identical with the prediction block P in encoder.When the decoding Prediction block P caused by device and residual block D 'nAfter addition, μ F ' are just producedn, then it is filtered, finally just obtain rebuilding F 'n, this F 'n It is exactly the image of last decoding output.
From upper figure, there was only compressed bit stream and reconstruction frames in decoding end, so we are it can be understood that be What is all to be used as prediction by the use of the reconstruction frames of other frames as reference frame, or the reconstructed block data of present frame in the encoder Block, because primitive frame is not present in decoding end, that is, this reason limits the renewal and breakthrough of encoder architecture.
The encoder architecture that the new HEVC/H.265 reconstruction frames of embodiment 2 make reference
What new HEVC/H.265 encoders used is still three-in-one hybrid coding framework.As shown in Fig. 2 input is current Frame FnHandled in units of the matrix of various sizes by encoder.First, by frame or at the method for inter prediction encoding Reason, if using intraframe predictive coding, its prediction block P is by present frame FnThe reconstructed block pixel of middle current block peripheral position, The prediction block generated according to certain rule；If using inter prediction encoding, its prediction block P is pointed to by motion vector MV The reconstruction frames F ' of previous framen-1In matrix, if motion vector is sub-pixel values, then need to carry out the reconstructed block of sensing Motion compensation MC generation prediction blocks P；After prediction block and current block subtract each other, a residual block D is producedn, residual block DnBy conversion and The conversion coefficient X after one group of quantization is produced after quantization, with encode required for other information (such as predictive mode, quantization step, With reference to frame number, motion vector etc.) by entropy code form one compression after code stream, through NAL for transmission and store.
In order to provide the reference picture of prediction, encoder must have the function of reconstruction image.Therefore residual plot must be made As the residual error reconstructed block D ' obtained after inverse quantization, inverse transformationnIt is added with predicted value P, obtains μ F 'n(non-filtered frame).For Caused noise in removal coding and decoding loop, the picture quality of reference frame is improved, so as to improving compression image property, set One loop filter, filtered output are reconstruction image F 'n, can be used as reference picture.
The encoder architecture that the new HEVC/H.265 primitive frames of embodiment 3 make reference
For the deficiency in current encoder device structure, new HEVC/H.265 encoder architectures are made and improved at following two：
1st, infra-frame prediction, as shown in figure 3, first, each intra prediction direction is all calculated as below, with prediction side To with present frame FnPresent encoding block periphery initial data according to standard give birth to a prediction block P；Secondly, present encoding block is calculated With the prediction block P of this generation cost；Then, cost caused by all prediction directions is obtained successively, and selection has minimum flower Optimum prediction direction of the prediction direction of pin as current block.Prediction block is calculated followed by optimum prediction direction and reconstructed block P, then calculate residual block D with present encoding block and prediction block Pn.Finally by residual block DnEntropy code is carried out along optimum orientation.
2nd, the estimation ME of interframe, as shown in figure 3, first to present frame FnCurrent block in previous frame F 'n-1It is original Estimation ME is carried out in YUV and obtains motion vector MV, reference key value REF etc.；Secondly, using motion vector MV, with reference to rope Draw value REF and reference frame F 'n-1Prediction block P is calculated, then residual block D is calculated with encoding block and prediction block Pn.Finally by residual error Block DnThe code stream after entropy code forms a compression is carried out with information such as MV, reference key value REF, through NAL for transmission and storage With.
For new encoder framework in order to provide the reference picture of prediction, new encoder must have the function of reconstruction image.Cause This must make residual block DnQuantified, conversion, then the residual error reconstructed block D ' obtained after inverse quantization, inverse transformationnWith prediction block P phases Add, obtain μ F 'n(non-filtered block).In order to remove caused noise in coding and decoding loop, a loop filtering is set Device, μ F 'nFiltered output is reconstruction image F 'n, can be used as the reference picture F ' of subsequent framesn-1。
Although having been presented for some embodiments of the present invention herein, it will be appreciated by those of skill in the art that Without departing from the spirit of the invention, the embodiments herein can be changed.Above-described embodiment be it is exemplary, no Restriction that should be using the embodiments herein as interest field of the present invention.

Claims (6)

  1. A kind of 1. intra-frame prediction method of new HEVC/H.265 codings, it is characterised in that including：
    Each intra prediction direction is all calculated as below：
    First, with prediction direction and present frame FnThe periphery initial data of present encoding block generates a prediction block P according to standard； Secondly, present encoding block and the prediction block P of generation cost are calculated；Then, all prediction sides are obtained successively according to the method described above To caused cost, optimum prediction direction of prediction direction of the selection with minimum cost as present encoding block；
    Finally, residual block D is calculated with present encoding block and prediction block Pn, by residual block DnEntropy is carried out along optimum prediction direction Coding.
  2. A kind of 2. inter-frame prediction method of new HEVC/H.265 codings, it is characterised in that including：
    First, to present frame FnPresent encoding block in previous frame be reference frame F 'n-1Original YUV in carry out estimation obtain Motion vector MV and reference key value REF；
    Secondly, motion vector MV, reference key value REF and reference frame F ' are utilizedn-1Calculate prediction block P；Then, compiled with current Code block and prediction block P calculate residual block Dn；
    Finally by residual block Dn, motion vector MV, reference key value REF carry out entropy code.
  3. A kind of 3. new HEVC/H.265 encoder architectures, it is characterised in that the present frame F of inputnPass through such as claim 1 or 2 Method processing described in any one, forms the code stream after a compression, through NAL for transmission and storage, specifically includes following structure：
    Single HEVC divides for predictive mode analysis, transform and quantization/inverse transformation and inverse quantization, reordered and entropy code three-level flowing water；
    Two-stage decoupled signals loop (prediction and entropy code) is built between each HEVC and a loop is provided with before reconstruction frames and is filtered Ripple device is with noise reduction.
  4. A kind of 4. new HEVC/H.265 encoder architectures as claimed in claim 3, it is characterised in that the predictive mode point It is divided into inter prediction and the small two-stage flowing water of infra-frame prediction again in analysis.
  5. 5. a kind of new HEVC/H.265 encoder architectures as claimed in claim 4, it is characterised in that in the prime HEVC After the completion of MB inverse quantizations/inverse transformation produce prediction decoupled signals to subordinate HEVC can infra-frame prediction and inter prediction, subordinate HEVC can filtered reconstruction frames before prediction uncoupling signal is received.
  6. 6. a kind of new HEVC/H.265 encoder architectures as claimed in claim 5, it is characterised in that in the prime HEVC Entropy code produce entropy code uncoupling signal to subordinate HEVC can entropy code.
CN201711017670.4A 2017-10-26 2017-10-26 HEVC/H.265 encoder architectures and its interior Forecasting Methodology with interframe of frame Pending CN107801040A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711017670.4A CN107801040A (en) 2017-10-26 2017-10-26 HEVC/H.265 encoder architectures and its interior Forecasting Methodology with interframe of frame

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711017670.4A CN107801040A (en) 2017-10-26 2017-10-26 HEVC/H.265 encoder architectures and its interior Forecasting Methodology with interframe of frame

Publications (1)

Publication Number Publication Date
CN107801040A true CN107801040A (en) 2018-03-13

Family

ID=61548041

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711017670.4A Pending CN107801040A (en) 2017-10-26 2017-10-26 HEVC/H.265 encoder architectures and its interior Forecasting Methodology with interframe of frame

Country Status (1)

Country Link
CN (1) CN107801040A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110351560A (en) * 2019-07-17 2019-10-18 深圳市网心科技有限公司 A kind of coding method, system and electronic equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1943244A (en) * 2004-04-14 2007-04-04 三星电子株式会社 Inter-frame prediction method in video coding, video encoder, video decoding method, and video decoder
CN101841713A (en) * 2010-04-30 2010-09-22 西安电子科技大学 Video coding method for reducing coding code rate and system
CN103796026A (en) * 2012-11-01 2014-05-14 华平信息技术股份有限公司 Motion estimation method based on double reference frames
CN105635731A (en) * 2016-01-07 2016-06-01 西安电子科技大学 Intra-frame prediction reference point preprocessing method for high efficiency video coding

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1943244A (en) * 2004-04-14 2007-04-04 三星电子株式会社 Inter-frame prediction method in video coding, video encoder, video decoding method, and video decoder
CN101841713A (en) * 2010-04-30 2010-09-22 西安电子科技大学 Video coding method for reducing coding code rate and system
CN103796026A (en) * 2012-11-01 2014-05-14 华平信息技术股份有限公司 Motion estimation method based on double reference frames
CN105635731A (en) * 2016-01-07 2016-06-01 西安电子科技大学 Intra-frame prediction reference point preprocessing method for high efficiency video coding

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110351560A (en) * 2019-07-17 2019-10-18 深圳市网心科技有限公司 A kind of coding method, system and electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN105284109B (en) Dynamic image encoding device, moving image decoding apparatus, dynamic image encoding method, dynamic image decoding method and program
US8582904B2 (en) Method of second order prediction and video encoder and decoder using the same
US10091526B2 (en) Method and apparatus for motion vector encoding/decoding using spatial division, and method and apparatus for image encoding/decoding using same
CN103634606B (en) Video encoding method and apparatus
CN103260018B (en) Intra-frame image prediction decoding method and Video Codec
CN110493596B (en) Video coding system and method based on neural network
CN103210646B (en) Intra prediction mode group is selected to carry out the method and apparatus to encoding/decoding image by effective
CN103782598A (en) Fast encoding method for lossless coding
CN104041035A (en) Lossless Coding and Associated Signaling Methods for Compound Video
CN102150427A (en) System and method for video encoding using adaptive loop filter
CN103442228B (en) Code-transferring method and transcoder thereof in from standard H.264/AVC to the fast frame of HEVC standard
CN107888929A (en) Video coding coding/decoding method, equipment and generation and the method for stored bits stream
CN104883565A (en) Decision-making method and device for intra-frame prediction mode of high efficiency video coding
CN104685884A (en) Improved architecture for hybrid video codec
CN106961610A (en) With reference to the ultra high-definition video new type of compression framework of super-resolution rebuilding
CN102187668A (en) Encoding and decoding with elimination of one or more predetermined predictors
CN101742288B (en) Video noise reduction encoding method and video noise reduction encoding device
CN103442229B (en) The bit rate estimation method of SAO mode adjudgings suitable for the encoder of HEVC standard
CN110351552B (en) Fast coding method in video coding
KR100827093B1 (en) Method for video encoding and apparatus for the same
CN103069803A (en) Video encoding method, video decoding method, video encoding device, video decoding device, and programs for same
KR20170114598A (en) Video coding and decoding methods using adaptive cross component prediction and apparatus
CN102082919A (en) Digital video matrix
CN102026002A (en) Downsampling transcoding method and device of frame rate, vector reconstruction method and device thereof
CN111586406B (en) VVC intra-frame inter-frame skipping method, system, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180313

RJ01 Rejection of invention patent application after publication