CN1224270C - Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure - Google Patents

Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure Download PDF

Info

Publication number
CN1224270C
CN1224270C CN 03154474 CN03154474A CN1224270C CN 1224270 C CN1224270 C CN 1224270C CN 03154474 CN03154474 CN 03154474 CN 03154474 A CN03154474 A CN 03154474A CN 1224270 C CN1224270 C CN 1224270C
Authority
CN
China
Prior art keywords
macro block
pixel
coding
group
prediction piece
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 03154474
Other languages
Chinese (zh)
Other versions
CN1492688A (en
Inventor
何芸
朱刚
李国平
付文方
杨平
许晓中
赵海武
陈勇
朱维佳
宋利
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
SVA Group Co Ltd
Original Assignee
Tsinghua University
SVA Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University, SVA Group Co Ltd filed Critical Tsinghua University
Priority to CN 03154474 priority Critical patent/CN1224270C/en
Publication of CN1492688A publication Critical patent/CN1492688A/en
Application granted granted Critical
Publication of CN1224270C publication Critical patent/CN1224270C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The present invention belongs to a video coding and decoding field in signal processing, which relates to an intraframe coding and frame coding method of two stages of predictive code for a macro block group structure. The present invention mainly comprises that each macro block in an original macro block group NS and a derivative macro block group VS is used as a predictive block; in the process of the two stages of predictive code, all rebuilt and interpolation pixels in two, three or four directions around the predictive block are used as a reference pixel collection, reference pixels corresponding to the pixels in the reference pixel collection use various linear or non-linear filters for predicting each pixel in the NS, and the predictive value of the predictive block of each predictive model is obtained. The present invention is characterized in that based on each stage coded by the macro block groups, under various conditions, intraframe prediction is carried out for each macro block in the macro block groups. Surrounding obtainable pixels are fully used as references, and intraframe prediction is carried out for each macro block in the macro block groups.

Description

The intraframe coding frame coding method that is used for the two-stage forecasting coding of macro block group structure
Technical field the invention belongs to the coding and decoding video field in the signal processing, particularly the coded prediction technology of intracoded frame.
H.261 the video encoding standard that background technology is traditional such as ITU formulate, H.263, H.263+, the MPEG-1 that organizes to set up of the MPEG of standard and ISO H.264, MPEG-2, MPEG-4 etc. are based upon hybrid coding, promptly on the Hybrid Coding framework.So-called hybrid encoding frame is a kind of incorporation time space video image code method, and this method comprises: carry out in the frame earlier, the prediction of interframe, to eliminate the correlation of time-domain; Then original picture and the residual error that predicts the outcome are carried out two-dimensional transform (adopting discrete cosine transform or other linear transformation), eliminate spatial coherence; Carry out entropy coding then, remove statistical redundancy.
Two kinds of different coding methods of intracoded frame coding and inter-frame encoding frame coding have been comprised in the hybrid encoding frame.Traditional intracoded frame cataloged procedure is as follows: original image data is carried out two-dimensional transform (adopting discrete cosine transform or integer transform); In transform domain, conversion coefficient is quantized then; Carry out entropy coding at last, i.e. Huffman coding or arithmetic coding etc.The cataloged procedure of inter-frame encoding frame is as follows: adopt estimation to obtain motion vector, adopt inter prediction then based on motion compensation, then the residual block that inter prediction is obtained carries out two-dimensional transform, coefficient in transform domain is quantized again, and carries out entropy coding at last.
In order to improve compression efficiency, prediction is the most frequently used technology.In nearest H.264 video encoding standard, the coding of intracoded frame also uses intra-frame prediction method fully.Adopt the intraframe coding frame coding method of infra-frame prediction to be: the difference of the prediction piece that original picture piece and intra-frame prediction method are obtained is carried out two-dimensional transform (employing discrete cosine transform or integer transform); In transform domain, conversion coefficient is quantized then; Carry out entropy coding at last, i.e. Huffman coding or arithmetic coding etc.
The existing intraframe coding frame coding method of infra-frame prediction that adopts comprises cataloged procedure and decode procedure, and the concrete steps of cataloged procedure wherein are:
1) from original image, extracts a prediction piece;
2) with various predictive modes each pixel in the prediction piece is carried out infra-frame prediction respectively, obtain the predicted value of the prediction piece under each predictive mode;
3) choose the predictive mode of the residual error minimum of interior raw image data of prediction piece and predicted value for the best;
4) residual error of original image data and the predicted value of image under the predictive mode of the best in the prediction piece is carried out two-dimensional transform (adopting discrete cosine transform or integer transform); In transform domain, conversion coefficient is quantized then;
5) at last coefficient after quantizing and best predictive mode are carried out entropy coding, i.e. Hunffman coding or arithmetic coding etc., and the data after will encoding write code stream.
The concrete steps of decode procedure are:
1) at first the data in the encoding code stream are carried out the decoding of entropy coding, decoded data are carried out inverse quantization and inverse transformation after, obtain the residual error data of this prediction piece, and judge optimum prediction mode selected in the cataloged procedure;
2) adopt selected optimum prediction mode,, predicted value is predicted and obtained to the prediction piece according to the reference pixel of prediction piece;
3) with 2) predicted value of the prediction piece that obtains of step adds 1) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.
Prediction piece in the said method (Intra Predictive Block) has the prediction piece of two kinds of sizes: the rectangular block of macro block (16 * 16 pixel) and 4 * 4 pixels, as fundamental forecasting encoding and decoding unit, the intra prediction value of each pixel is to obtain by the encoded reference pixel with the piece of rebuilding around the prediction piece in the prediction piece with this prediction piece.Reference pixel described in the above-mentioned intra-frame prediction method must be a pixel encoded prior to this prediction piece and that rebuild.
In existing standard, the order of infra-frame prediction be level by left-to-right, therefore vertically from top to bottom, when each prediction piece is carried out infra-frame prediction, have only the encoded of the left side and top and the pixel rebuild may be brought as with reference to pixel.Every kind of predictive mode in the above-mentioned intra-frame prediction method corresponds respectively to different linear predictors.The parameter of linear fallout predictor is by the availability decision of the reference pixel of prediction piece top and left part.Every kind of linear predictor with the reference pixel as input, output be the predicted value of corresponding predicted pixel.Said predictive mode in H.264, adopted level, vertical, tiltedly on and tiltedly the linear predictor of inferior a plurality of different directions current prediction piece predicted, wherein the rectangular block with 4 * 4 pixels serves as when predicting piece, adopted the linear predictor of 9 kinds of different directions, i.e. 9 kinds of predictive modes.When being the prediction piece, 4 kinds of predictive modes have been adopted with the macro block.
As mentioned above, in existing intraframe coding frame coding method prediction steps, the order of infra-frame prediction is that level is by left-to-right, vertically from top to bottom, Fig. 1 has marked pixel (lowercase is represented) in the prediction piece of one 4 * 4 pixel size in H.264 and with reference to the position relation of pixel (capitalization is represented).
As can be seen, owing to each prediction piece in the frame has been adopted merely by a left side and right in H.264, therefore coded sequence from top to bottom only may appear at the left side and the upside of prediction piece with reference to pixel.When each prediction piece is carried out infra-frame prediction, the pixel possibility conduct of having only the encoded of the left side and top and rebuilding is with reference to pixel, because the raising that lacks meeting impact prediction efficient with reference to pixel, can not satisfy the needs of various different motion images, hinder the further raising of video signal compression efficiencies.
The present inventor has proposed a kind of predictive coding method stage by stage based on macro block group (Macroblock Group) structure.So-called predictive coding method stage by stage based on macro block group (Macroblock Group) structure is to utilize the characteristics of macro block group data structure, adopts two stages that the macro block group is carried out predictive coding.This predictive coding method is adopted by avs (advanced audio/video encoding standard).
In above-mentioned predictive coding method, the macro block group of definition is: for the original picture of lining by line scan, the square of 32 continuous pixels * 32 pixels constitutes an original macro group; For interleaved original picture, to go up adjacent strange and idol field earlier the time, or idol and strange field pattern resemble by the place position and be combined into frame image, and the square of 32 continuous pixels * 32 pixels just constitutes an original macro group in the frame image that is combined into then, as shown in Figure 2.
In the avs video encoding and decoding standard, the original macro group is made of 4 16 * 16 macro block, and shown in Fig. 3 (a), two macro blocks in upper strata are NS1, the NS2 macro block, and two macro blocks of lower floor are NS3 and NS4 macro block.Specifically be defined as:
NS1(x,y)=MBG(x,y),
NS2(x,y)=MBG(x+16,y),
NS3(x,y)=MBG(x,y+16),
NS4(x,y)=MBG(x+16,y+16),x,y=1,…,16,
The original macro group is carried out vertical 1/2 sampling, just vertically derived from the macro block group, shown in Fig. 3 (b), two macro blocks in upper strata are VS1, the VS2 macro block, and two macro blocks of lower floor are VS3 and VS4 macro block.
Specifically be defined as:
VS1(x,y)=MBG(x,2y),
VS2(x,y)=MBG(x+16,2y),
VS3(x,y)=MBG(x,2y+1),
VS4(x,y)=MBG(x+16,2y+1),x,y=1,…,16,
In the avs video encoding standard, some macro block was encoded in the phase I in the dissimilar macro block groups, and some is encoded in second stage.The principle of distinguishing macroblock coding stage attribute is: each macro block must be encoded and could be obtained satisfied reconstruction macro block among the original macro group NS, so each macro block all must be encoded in the phase I in this macro block group.In deriving from macro block group VS, if this macro block can be obtained satisfied reconstruction macro block by other coded macroblocks by interpolation, then this macro block is stayed the second stage coding, otherwise encodes in the phase I.Concrete condition is as follows:
VS3 can obtain its satisfied reconstruction macro block by the VS1 interpolation, and VS4 can obtain its satisfied reconstruction macro block by the VS2 interpolation.Therefore in this type of mb group, VS1 and VS2 encoded in the phase I, and VS3 and VS4 encode in second stage.
In existing avs video encoding and decoding standard, though adopted predictive coding method stage by stage based on macro block group (Macrobl ock Group) structure, but when each macro block being made infra-frame prediction in each stage, still just adopt the encoded and pixel rebuild in the left side and top as the reference pixel, this Forecasting Methodology does not make full use of the basic characteristics based on the predictive coding method stage by stage of macro block group (MacroblockGroup) structure, thereby the efficient of infra-frame prediction is not high.
Summary of the invention the objective of the invention is the weak point for encoding and decoding technique in the frame that overcomes existing infra-frame prediction, a kind of intraframe coding frame coding method that is encoded to the infra-frame prediction on basis with the macro block component stage has been proposed, got pixel around the present invention can make full use of carries out infra-frame prediction to each macro block in the macro block group as a reference.Can improve efficient, thereby improve the compression efficiency of whole video signal, can be applicable to hybrid coding based on the infra-frame prediction of macro block component stage coding.
A kind of intraframe coding frame coding method that is used for the two-stage forecasting coding of macro block group structure that the present invention proposes comprises cataloged procedure and decode procedure, and the concrete steps of cataloged procedure wherein are:
1) with original macro group NS with derive from each macro block among the macro block group VS as the prediction piece;
2) in the two-stage forecasting cataloged procedure, with the pixel of all reconstructions of two, three or four direction around this prediction piece and interpolation as reference pixel collection, adopt various linearities or nonlinear filter that each pixel of NS inside is predicted with correspondence with reference to the reference pixel in the pixel collection, obtain the predicted value of the prediction piece under each predictive mode;
3) choose the predictive mode of the residual error minimum of interior raw image data of prediction piece and predicted value for the best;
4) residual error of original image data and the predicted value of image under the predictive mode of the best in the prediction piece is carried out two-dimensional transform, promptly adopt discrete cosine transform or integer transform; In transform domain, conversion coefficient is quantized then:
5) at last coefficient after quantizing and best predictive mode are carried out entropy coding, promptly Hunffman (Huffman) encodes or arithmetic coding, and the data after will encoding write code stream;
The concrete steps of decode procedure are:
6) at first the data in the encoding code stream are carried out the decoding of entropy coding, decoded data are carried out inverse quantization and inverse transformation after, obtain the residual error data of this prediction piece, and judge optimum prediction mode selected in the cataloged procedure;
7) adopt selected optimum prediction mode,, predicted value is predicted and obtained to the prediction piece according to the reference pixel of prediction piece;
8) with 7) predicted value of the prediction piece that obtains of step adds 6) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.
The present invention is used for the macroblock coding in two stages, according to the particular type of the macro block of working as the previous crops predictive coding and the macro block (mb) type around this macro block, and the reference pixel collection that can get around setting.
Characteristics of the present invention:
The present invention is according to the characteristics based on the Data Structures of the two-stage forecasting coding method of macro block group (Macroblock Group) structure, and the got pixel around making full use of carries out infra-frame prediction to each macro block in the macro block group as a reference.Can improve efficient, thereby improve the compression efficiency of whole video signal, can be applicable to hybrid coding based on the infra-frame prediction of macro block component stage coding.
Description of drawings
Fig. 1 H.264 in pixel (lowercase is represented) and with reference to the position relation of pixel (capitalization is represented) in the prediction piece of one 4 * 4 pixel size
The original macro group of Fig. 2 32 pixels * 32 pixels
The derivation macro block group VS of Fig. 3 original macro group NS and vertical sampling
The macro block of Fig. 4 original macro group NS is as prediction during piece, reference pixel situation on every side
When Fig. 5 derives from the VS1 of macro block group VS or VS2 macro block as the prediction piece, reference pixel situation on every side
When Fig. 6 derives from the VS3 of macro block group VS or VS4 macro block as the prediction piece, reference pixel situation on every side
The intraframe coding frame coding method of the two-stage forecasting coding that is used for macro block group structure that embodiment the present invention proposes reaches embodiment in conjunction with the accompanying drawings and is described in detail as follows:
Method of the present invention comprises cataloged procedure and decode procedure, and the concrete steps of cataloged procedure wherein are:
1) with original macro group NS with derive from each macro block among the macro block group VS as the prediction piece;
2) in the two-stage forecasting cataloged procedure, with the pixel of all reconstructions of two, three or four direction around this prediction piece and interpolation as reference pixel collection, adopt various linearities or nonlinear filter that each pixel of NS inside is predicted with correspondence with reference to the reference pixel in the pixel collection, obtain the predicted value of the prediction piece under each predictive mode;
3) choose the predictive mode of the residual error minimum of interior raw image data of prediction piece and predicted value for the best;
4) residual error of original image data and the predicted value of image under the predictive mode of the best in the prediction piece is carried out two-dimensional transform, for example adopt discrete cosine transform or integer transform; In transform domain, conversion coefficient is quantized then;
5) at last coefficient after quantizing and best predictive mode are carried out entropy coding, i.e. Huffman encoding or arithmetic coding, and the data after will encoding write code stream;
The concrete steps of decode procedure are:
6) at first the data in the encoding code stream are carried out the decoding of entropy coding, decoded data are carried out inverse quantization and inverse transformation after, obtain the residual error data of this prediction piece, and judge optimum prediction mode selected in the cataloged procedure;
7) adopt selected optimum prediction mode,, predicted value is predicted and obtained to the prediction piece according to the reference pixel of prediction piece;
8) with 7) predicted value of the prediction piece that obtains of step adds 6) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.
The present invention is used for the macroblock coding in two stages, according to the particular type of the macro block of working as the previous crops predictive coding and the macro block (mb) type around this macro block, and the reference pixel collection that can get around setting, the present invention sets with reference to the pixel collection, and various situations illustrate as follows:
When encoding in the phase I:
1) if the macro block that current prediction piece is original macro group NS, the macro block of the left side and top all is the macro block of original macro group VS, as shown in Figure 4: " x " represents field, the end (bottom field) pixel; " o " representative top (topfield) pixel; if field, the end is formerly when (bottom field first); " x " pixel is through the phase I coding and rebuilding, " o " pixel obtains by interpolation in the coding phase I.If push up field formerly (top field first), then " o " pixel is through the phase I coding and rebuilding, and " x " pixel obtained by interpolation in the coding phase I.Above-mentioned mentioned all rebuild and the pixel of interpolation as reference pixel collection.
2) if the macro block that current prediction piece is original macro group NS, the left side is the macro block of original macro group VS, the top is the macro block of interlacing scan gained original macro group NS, as shown in Figure 4, image is that field, the end is formerly the time, Fig. 4 left side then " x " and next-door neighbour's pixel of top all be through the phase I coding and rebuilding, Fig. 4 left side " o " pixel obtains by interpolation in the coding phase I.If the field, top formerly, then next-door neighbour's pixel of " o " on Fig. 4 left side and top all is to pass through the phase I coding and rebuilding, and " x " pixel on Fig. 4 left side obtained by interpolation in the coding phase I.If the macro block of original macro group NS is the gained of lining by line scan, then image is that field, the end is formerly the time, field, the end pixel on the macro block left side of current original macro group NS and top next-door neighbour's pixel all is a process phase I coding and rebuilding, and field, the top pixel on the macro block left side of current original macro group NS obtained by interpolation in the coding phase I.If the field, top formerly, field, the top pixel on the macro block left side of then current original macro group NS and next-door neighbour's pixel of top all are process phase I coding and rebuilding, and field, the end pixel on the macro block left side of current original macro group NS obtained by interpolation in the coding phase I.Above-mentioned mentioned all rebuild and the pixel of interpolation as reference pixel collection.
3) if the macro block that current prediction piece is original macro group NS, the top is the macro block of original macro group VS, the left side is the macro block of interlacing scan gained original macro group NS, as shown in Figure 4, image is that field, the end is formerly the time, Fig. 4 top " x " next-door neighbour's pixel on pixel and the left side all is through the phase I coding and rebuilding, Fig. 4 top " o " pixel obtains by interpolation in the coding phase I.If the field, top formerly, then next-door neighbour's pixel on " o " pixel of Fig. 4 top and the left side all is to pass through the phase I coding and rebuilding, and " x " pixel of Fig. 4 top obtained by interpolation in the coding phase I.If the macro block of original macro group NS is the interlacing scan gained, if image be field, the end formerly, field, the end pixel of the macro block top of then current original macro group NS and next-door neighbour's pixel on the left side all are process phase I coding and rebuilding, and field, the top pixel of the macro block top of current original macro group NS obtained by interpolation in the coding phase I.If the field, top formerly, field, the top pixel of the macro block top of then current original macro group NS and next-door neighbour's pixel on the left side all are process phase I coding and rebuilding, and field, the end pixel of the macro block top of current original macro group NS obtained by interpolation in the coding phase I.Above-mentioned mentioned all rebuild and the pixel of interpolation as reference pixel collection.
4) if the macro block that current prediction piece is original macro group NS, the left side is the macro block of original macro group NS, the top is the macro block of original macro group NS, the macro block left side of then current original macro group NS and next-door neighbour's pixel of top all are the pixel after the coding and rebuilding, and the pixel of above-mentioned mentioned all reconstructions constitutes with reference to the pixel collection.
5) if the macro block that current prediction piece is original macro group VS, the left side and top all are the macro blocks of original macro group VS, because the macro block at the original macro group VS of phase I coding has only VS1 and VS2 macro block, so " x " the expression VS1 macro block of phase I coding and rebuilding or the pixel of VS2 macro block in Fig. 5, " o " the expression pixel is the VS3 macro block that obtains by interpolation in the coding phase I or the pixel of VS4 macro block.Above-mentioned mentioned all rebuild and the pixel of interpolation as reference pixel collection.
6) if the macro block that current prediction piece is original macro group VS, the macro block of left side original macro group VS, the top is the macro block of original macro group NS, the field is formerly the time at the bottom of the image, next-door neighbour's pixel of field pixel and top all is a process phase I coding and rebuilding at the bottom of the macro block left side of then current original macro group VS, and field, the top pixel on the macro block left side of current original macro group VS obtained by interpolation in the coding phase I.If field, image top formerly, top, the macro block left side pixel of then current original macro group VS and next-door neighbour's pixel of top all are process phase I coding and rebuilding, and field, the end pixel on the macro block left side of current original macro group VS obtained by interpolation in the coding phase I.Above-mentioned mentioned all rebuild and the pixel of interpolation as reference pixel collection.
7) if piece is the macro block of original macro group VS before prediction, the macro block of left side original macro group NS, the top is the macro block of original macro group VS, as shown in Figure 4, if the field formerly at the bottom of the image, next-door neighbour's pixel on the field pixel and the left side all is a process phase I coding and rebuilding at the bottom of the macro block top of then current original macro group VS, and field, the top pixel of the macro block top of current original macro group VS obtained by interpolation in the coding phase I.If field, image top formerly, top, the macro block top pixel of then current original macro group VS and next-door neighbour's pixel on the left side all are process phase I coding and rebuilding, and field, the end pixel of the macro block top of current original macro group VS obtained by interpolation in the coding phase I.Above-mentioned mentioned all rebuild and the pixel of interpolation as reference pixel collection.
8) if the macro block that current prediction piece is original macro group VS, the left side is the macro block of original macro group NS, the top is the macro block of original macro group NS, as shown in Figure 5, the macro block left side of current original macro group VS and next-door neighbour's pixel of top all are the pixel after the coding and rebuilding, and the pixel of above-mentioned mentioned all reconstructions constitutes with reference to the pixel collection.
The second stage coding of coding have only VS3 macro block and VS4 macro block, as shown in Figure 6, the situation with reference to pixel around it has following several:
When the VS3 macro block was carried out coded prediction, the four direction up and down of VS3 macro block all can occur with reference to pixel, and the top is the VS1 piece of coding and rebuilding, and the right is the VS2 piece of coding and rebuilding and the VS4 piece that obtained by VS2 piece interpolation.
1) if when the VS3 macro block left side and bottom all are the macro block of original macro group VS, then among Fig. 6, " o " is the pixel of coding and rebuilding among Fig. 6, " x " be by in the phase I cataloged procedure by the resulting pixel of interpolation, the reconstruction of above-mentioned mentioned four direction and the pixel of interpolation are as reference pixel collection.
2) if the VS3 macro block left side and following when all be the macro block of original macro group NS, then four direction next-door neighbour's pixel all be the pixel of coding and rebuilding, the pixel formation after these reconstructions is with reference to the pixel collection.
3) if the left side is the macro block of original macro group NS, when bottom is the macro block of original macro group VS, when image is that field, the end is formerly the time, current VS3 macro block the right and following field, top pixel are obtained by the phase I interpolation, and next-door neighbour's pixel of the left side and top and the right and following field, end pixel are the pixel of coding and rebuilding.When image for top field formerly the time, current VS3 macro block the right and following field, end pixel are obtained by the phase I interpolation, and next-door neighbour's pixel of the left side and top and the right and following field, top pixel are the pixel of coding and rebuilding.The reconstruction of above-mentioned mentioned four direction and the pixel of interpolation are as reference pixel collection.
4) if the left side is the macro block of original macro group VS, bottom is the macro block of original macro group NS, when image is that field, the end is formerly the time, field, the top pixel on the current VS3 macro block the right and the left side is obtained by the phase I interpolation, and field, the end pixel on next-door neighbour's pixel of bottom and top and the right and the left side is the pixel of coding and rebuilding.When image for top field formerly the time, field, the end pixel on the current VS3 macro block the right and the left side is obtained by the phase I interpolation, and field, the top pixel on next-door neighbour's pixel of bottom and top and the right and the left side is the pixel of coding and rebuilding.The reconstruction of above-mentioned mentioned four direction and the pixel of interpolation are as reference pixel collection.
When VS4 is encoded, about the VS4 macro block up and down all four direction may occur with reference to pixel, and VS4 macro block top and the left side all are the pixel of coding and rebuilding.
1) if VS4 macro block the right and bottom all be the macro block of original macro group NS, then next-door neighbour's pixel of four direction all is the pixel of coding and rebuilding, and the pixel formation after these reconstructions is with reference to the pixel collection.
2) if when the right and bottom all are the macro block of original macro group VS, when image is that field, the end is formerly the time, current VS4 macro block the right and following field, top pixel are obtained by the phase I interpolation, and field, the end pixel on next-door neighbour's pixel of the left side and top and the right and the left side is the pixel of coding and rebuilding.When image for top field formerly the time, current VS4 macro block the right and following field, end pixel are obtained by the phase I interpolation, and next-door neighbour's pixel of the left side and top and the right and following field, top pixel are the pixel of coding and rebuilding.The reconstruction of above-mentioned mentioned four direction and the pixel of interpolation are as reference pixel collection.
3) if the right is the macro block of original macro group NS, when bottom is the macro block of original macro group VS, when image is that field, the end is formerly the time, field, the top pixel of current VS4 macro block bottom is obtained by the phase I interpolation, and next-door neighbour's pixel on the left side, top and the right and following field, end pixel are the pixel of coding and rebuilding.When image for top field formerly the time, field, the end pixel of current VS4 macro block bottom is obtained by the phase I interpolation, and next-door neighbour's pixel on the left side, top and the right and following field, top pixel are the pixel of coding and rebuilding.The reconstruction of above-mentioned mentioned four direction and the pixel of interpolation are as reference pixel collection.
4) if the right is the macro block of original macro group VS, when bottom is the macro block of original macro group NS, when image is that field, the end is formerly the time, field, the top pixel on current VS4 macro block the right is obtained by the phase I interpolation, and field, the end pixel on next-door neighbour's pixel on following, the top and the left side and the right is the pixel of coding and rebuilding.When image for top field formerly the time, field, the end pixel on current VS4 macro block the right is obtained by the phase I interpolation, and field, the top pixel on next-door neighbour's pixel on following, the top and the left side and the right is the pixel of coding and rebuilding.The reconstruction of above-mentioned mentioned four direction and the pixel of interpolation are as reference pixel collection.
In coding and decode procedure, all to use the reference pixel collection of afore mentioned rules, concentrating the pixel of interpolation with reference to pixel is that the macroblock interpolation by the coding and rebuilding of this macro block group obtains in the phase I of encoding, during decoding, concentrating the pixel of interpolation with reference to pixel is that the macroblock interpolation of having decoded out by this macro block group obtains in the phase I of decoding.
The difference of above-mentioned intraframe coding frame coding method and setting is used for based on the embodiment of the predictive coding method stage by stage of macro block group (MacroblockGroup) structure as follows with reference to pixel transporting something containerized:
Present embodiment comprises cataloged procedure and decode procedure, and wherein cataloged procedure may further comprise the steps:
1) from original image, extracts an original macro group NS, and the original macro group is carried out vertical 1/2 sampling, obtain deriving from macro block group VS;
2) elder generation encodes to the macro block group form of the original macro group NS of macro block group, and under this group form, the macro block of 4 original macro group NS all must be encoded in the phase I.According to the above-mentioned reference pixel collection of setting in all cases, adopt various linearities or nonlinear filter that each pixel of NS inside is predicted with reference to the reference pixel in the pixel collection with corresponding;
3) choosing the residual error of predicting interior raw image data of piece and predicted value minimum is that (said every kind of predictive mode corresponds respectively to different fallout predictors to best predictive mode; Every kind of fallout predictor with the reference pixel as input, output be the predicted value of corresponding predicted pixel.);
4) residual error of original image data and the predicted value of image under the predictive mode of the best in the prediction piece is encoded and the calculation code cost.
5) the VS piece group form of macro block group is encoded.Under this group form, VS1 and VS2 piece were encoded in the phase I.VS3 and VS4 piece are encoded in second stage.VS1 and VS2 piece being carried out the phase I during coding, in all cases with reference to the setting of pixel collection, adopt various linearities or nonlinear filter that each pixel of NS inside is predicted with reference to the reference pixel in the pixel collection with correspondence according to above-mentioned.
6) choose the predictive mode of the residual error minimum of interior raw image data of prediction piece and predicted value for the best, residual error to original image data and the predicted value of image under the predictive mode of the best in the prediction piece is encoded and the calculation code cost, estimate the coding cost of VS3 and VS4 piece simultaneously, compare with the coding cost under the macro block group form of original macro group NS, that chooses coding cost minimum is optimical block group form.
7) to optimical block group form encode the back together with the coding after residual error data, optimum prediction mode write code stream.Utilize the data reconstruction of VS1 and VS2 piece that VS3 and VS4 piece are carried out interpolation at last, obtain the interpolation pixel of VS3 and VS4 piece.
8) entire frame is finished phase I coding after, begin the macro block that also not have to encode is carried out the coding of second stage.Macro block at this stage coding all is VS3 macro block and VS4 macro block, in all cases with reference to the setting of pixel collection, adopts various linearities or nonlinear filter that each pixel of NS inside is predicted with corresponding with reference to the reference pixel in the pixel collection according to above-mentioned.
9) choose the predictive mode of the residual error minimum of interior raw image data of prediction piece and predicted value for the best;
10) residual error of original image data and the predicted value of image under the predictive mode of the best in the prediction piece is encoded, and write code stream.
This decode procedure may further comprise the steps:
1) at first the data in the encoding code stream is decoded and judge, obtain optimical block group mode selected in the cataloged procedure;
2) if the optimical block group mode is the macro block group of original macro group NS, according to the reference pixel collection around the optimical block group mode of macro block group is determined on every side, adopt selected optimum prediction mode,, predicted value is predicted and obtained to the prediction piece according to the reference pixel of prediction piece;
3) with the 2nd) predicted value of the prediction piece that obtains of step adds the 1st) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.
4) if the optimical block group mode is a VS piece group, need to divide two stage decodings, at first be that VS1 and VS2 piece are decoded, the same with cataloged procedure, according to the reference pixel collection around the optimical block group mode of macro block group is determined on every side, adopt selected optimum prediction mode,, predicted value is predicted and obtained to the prediction piece according to the reference pixel of prediction piece.
5) with the 4th) predicted value of the prediction piece that obtains of step adds the 1st) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.Utilize the data reconstruction of VS1 and VS2 piece that VS3 and VS4 piece are carried out interpolation, obtain the interpolation pixel of VS3 and VS4 piece.
6) finish the decode procedure of phase I after, carry out decoding work again to the second stage of VS3 piece and VS4 piece, be according to the reference pixel collection around the optimical block group mode of macro block group is determined on every side equally, adopt selected optimum prediction mode, according to the reference pixel of prediction piece, predicted value is predicted and obtained to the prediction piece.
7) with the 6th) predicted value of the prediction piece that obtains of step adds the 1st) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.

Claims (1)

1, a kind of intraframe coding frame coding method that is used for the two-stage forecasting coding of macro block group structure comprises cataloged procedure and decode procedure, and the concrete steps of cataloged procedure wherein are:
1) with original macro group NS with derive from each macro block among the macro block group VS as the prediction piece;
2) in the two-stage forecasting cataloged procedure, with the pixel of all reconstructions of two, three or four direction around this prediction piece and interpolation as reference pixel collection, adopt various linearities or nonlinear filter that each pixel of NS inside is predicted with correspondence with reference to the reference pixel in the pixel collection, obtain the predicted value of the prediction piece under each predictive mode;
3) choose the predictive mode of the residual error minimum of interior raw image data of prediction piece and predicted value for the best;
4) residual error of original image data and the predicted value of image under the predictive mode of the best in the prediction piece is carried out two-dimensional transform, promptly adopt discrete cosine transform or integer transform; In transform domain, conversion coefficient is quantized then;
5) at last coefficient after quantizing and best predictive mode are carried out entropy coding, i.e. Huffman encoding or arithmetic coding, and the data after will encoding write code stream;
The concrete steps of decode procedure are:
6) at first the data in the encoding code stream are carried out the decoding of entropy coding, decoded data are carried out inverse quantization and inverse transformation after, obtain the residual error data of this prediction piece, and judge optimum prediction mode selected in the cataloged procedure;
7) adopt selected optimum prediction mode,, predicted value is predicted and obtained to the prediction piece according to the reference pixel of prediction piece;
8) with 7) predicted value of the prediction piece that obtains of step adds 6) residual error data of the prediction piece that obtains of step, just obtained the data reconstruction of this prediction piece.
CN 03154474 2003-09-30 2003-09-30 Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure Expired - Fee Related CN1224270C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 03154474 CN1224270C (en) 2003-09-30 2003-09-30 Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 03154474 CN1224270C (en) 2003-09-30 2003-09-30 Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure

Publications (2)

Publication Number Publication Date
CN1492688A CN1492688A (en) 2004-04-28
CN1224270C true CN1224270C (en) 2005-10-19

Family

ID=34240802

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 03154474 Expired - Fee Related CN1224270C (en) 2003-09-30 2003-09-30 Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure

Country Status (1)

Country Link
CN (1) CN1224270C (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107181950A (en) * 2010-12-08 2017-09-19 Lg 电子株式会社 Interior prediction method and the encoding apparatus and decoding apparatus using this method

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100455021C (en) * 2004-09-30 2009-01-21 华为技术有限公司 Method for selecting intra-prediction mode
DE102005051091A1 (en) 2005-10-25 2007-04-26 Siemens Ag Methods and apparatus for determining and reconstructing a predicted image area
FR2908007A1 (en) * 2006-10-31 2008-05-02 Thomson Licensing Sas Image sequence i.e. video, encoding method for video compression field, involves pre-selecting intra-encoding modes of macro-block with directions that correspond to gradient activities with minimal value to determine encoding mode
CN101453646B (en) 2007-12-04 2012-02-22 华为技术有限公司 Image interpolation method, apparatus and interpolation coefficient obtaining method
EP2304963B1 (en) * 2008-07-01 2015-11-11 Orange Method and device for encoding images using improved prediction, and corresponding decoding method and device, signal and computer software
KR101517768B1 (en) * 2008-07-02 2015-05-06 삼성전자주식회사 Method and apparatus for encoding video and method and apparatus for decoding video
US8867854B2 (en) 2008-10-01 2014-10-21 Electronics And Telecommunications Research Institute Image encoder and decoder using undirectional prediction
KR101356448B1 (en) 2008-10-01 2014-02-06 한국전자통신연구원 Image decoder using unidirectional prediction
JP5490404B2 (en) 2008-12-25 2014-05-14 シャープ株式会社 Image decoding device
CA3017176C (en) 2011-06-28 2020-04-28 Samsung Electronics Co., Ltd. Method and apparatus for image encoding and decoding using intra prediction
KR101947658B1 (en) * 2011-10-24 2019-02-14 (주)대가람 Method and apparatus for decoding image
AU2012200319B2 (en) 2012-01-19 2015-11-26 Canon Kabushiki Kaisha Method, apparatus and system for encoding and decoding the significance map for residual coefficients of a transform unit

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107181950A (en) * 2010-12-08 2017-09-19 Lg 电子株式会社 Interior prediction method and the encoding apparatus and decoding apparatus using this method
CN107181950B (en) * 2010-12-08 2020-11-06 Lg 电子株式会社 Encoding device and decoding device for executing internal prediction

Also Published As

Publication number Publication date
CN1492688A (en) 2004-04-28

Similar Documents

Publication Publication Date Title
CN1224268C (en) Moving picture coding apparatus and moving picture decoding apparatus
CN100336401C (en) Moving image encoder, moving image decoder, moving image encoding method, moving image decoding method
CN104602003B (en) Prediction block produces equipment
CN1874521A (en) Apparatus and method for image encoding and decoding
KR100882949B1 (en) Apparatus and method of encoding and decoding using adaptive scanning of DCT coefficients according to the pixel similarity
CN1290342C (en) Apparatus capable of performing both block-matching motion compensation and global motion compensation and method thereof
CN1224270C (en) Frame coding method of inter-frame coding frame for two stage predicting coding of macro block group structure
RU2649775C1 (en) Image encoding device, image decoding device, image encoding method and image decoding method
CN1929611A (en) Methods and apparatus for video intraprediction encoding and decoding
CN1719735A (en) Method or device for coding a sequence of source pictures
CN1431828A (en) Optimum scanning method for change coefficient in coding/decoding image and video
CN1258925C (en) Multiple visual-angle video coding-decoding prediction compensation method and apparatus
CN1633811A (en) Image encoding method, image decoding method, image encoder, image decode, program, computer data signal, and image transmission system
CN1777283A (en) Microblock based video signal coding/decoding method
CN1870754A (en) Encoding and decoding apparatus and method for reducing blocking phenomenon and computer-readable recording medium
CN1589023A (en) Coding and decoding method and device for multiple coded list lengthening based on context
CN1209928C (en) Inframe coding frame coding method using inframe prediction based on prediction blockgroup
CN104380734A (en) Method and apparatus for intra transform skip mode
JP2007110568A (en) Image coding device
CN1268136C (en) Frame field adaptive coding method based on image slice structure
CN103444171A (en) Methods and devices for encoding and decoding at least one image implementing a selection of pixels to be predicted, and corresponding computer program
CN103747272A (en) Fast transformation method for residual quadtree coding in HEVC (high efficiency video coding)
CN1705376A (en) Method and apparatus for spatial predictive encoding and/or decoding of video data
CN1857002A (en) Rate-distortion video data partitioning using convex hull search
US8363722B2 (en) Method and apparatus for hierarchical bi-directional intra-prediction in a video encoder

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20051019

Termination date: 20100930