A kind of enhancement layer intra-frame prediction method and coding/decoding apparatus
Technical field
The present invention relates to the video processing technique in the communications field, be specifically related to a kind of enhancement layer intra-frame prediction method and coding/decoding apparatus.
Background technology
Rapid popularization along with Development of Multimedia Technology and multimedia application, video image compression standard and technology have obtained paying close attention to widely, particularly uniting the JVT of standard formulation working group that forms by MPEG (Motion Picture Experts Group) and two normal structures of ITU (International Telecommunications Union) H.264 formulates, because its advanced technical characterstic and compression performance preferably, not only be applied, but also have broad application prospects in fields such as video conferencing, video telephone, Streaming Media, HDDVD, video monitoring, Digital Television, 3G.
H.264 compression is handled framework as shown in Figure 1.
In Fig. 1, the basic handling unit that compression is handled is 16 * 16 macro blocks, adopted advanced technologies such as multiframe reference, infra-frame prediction, many macro block modes, 4 * 4 integer transforms and quantification, circle filtering, 1/4 picture element movement prediction, CAVLC and CABAC entropy coding, its compression efficiency than MPEG-2, H.263, MPEG-4 ASP doubles many.
H.264 the main profile H.264 of the basic layer compatibility in the hierarchical coding standard, adopted MCTF (Motion compensation temporal filter, time filtering based on motion compensation) algorithm frame can realize spatial (space) layering, temporal (time) layering, quality or functions such as SNR (quality) layering, complexity (complexity) layering preferably.The up-to-date reference model of JVT (Joint video team, MPEG and ITU-T combination with standard are formulated working group) SVC (vedio layering coding) is JSVM3 (Joint scalable video model, a joint video hierarchical coding model).
H.264 a main feature is to have adopted multidirectional INTRA (intra-frame encoding mode in the video coding) Forecasting Methodology, promptly adopted the intra-frame prediction method of multiple predictive mode, comprise as luma prediction: two kinds of predictions of the infra-frame prediction of the infra-frame prediction of 16 * 16 macro blocks and 4 * 4 macro blocks unit, wherein 16 * 16 macro block infra-frame prediction comprises vertical, horizontal, DC (low frequency component in the cosine transform coefficient) and four kinds of predictive modes of Plane; The infra-frame prediction of 4 * 4 macro blocks comprises Vertical, Horizontal, DC, DiagonalDown-Left, Diagonal Down-Right, Vertical-Left, Horizontal-Down, Vertical-Right and nine kinds of predictive modes of Horizontal-Up, respectively shown in accompanying drawing 2 and accompanying drawing 3.Colorimetric prediction is that unit carries out with 8 * 8 macroblock size for another example, comprises Vertical, Horizontal, DC and four kinds of predictive modes of Plane, is similar to 16 * 16 macro block INTRA luma prediction, specifically as shown in Figure 4.
From Fig. 2, Fig. 3, Fig. 4 as can be seen, aspect INTRA prediction (infra-frame prediction), the basic layer of JSVM3 adopts INTRA Forecasting Methodology H.264, promptly by utilize current coding macro block in the present frame around the information of coded macroblocks come current macro is predicted.
The JSVM3 enhancement layer has increased a kind of new Forecasting Methodology again on the basis of H.264 INTRA Forecasting Methodology, i.e. I_BL.I_BL utilizes in the present frame current macro at each pixel value of the corresponding macro block of low layer current macro to be carried out infra-frame prediction, specifically as shown in Figure 5.The code efficiency of I_BL Forecasting Methodology awaits further to improve.
H.264 the INTRA Predicting Technique all is the prediction of the block message on every side present encoding piece that utilizes present frame to encode, but in enhancement layer coding, except I_BL, H.264 INTRA Predicting Technique has mainly been adopted in JSVM3 enhancement layer INTRA prediction, in INTRA direction prediction method H.264, in the top of current macro/piece or during the pixel non-availability of the left side, just do not consider the prediction of this edge direction, as in the DC prediction, when current macro/piece top and left side pixel non-availability, just with predetermined value as 128 as prediction reference, make the poor accuracy that predicts the outcome, thereby make the code efficiency of enhancement layer INTRA predictive coding of hierarchical coding poor.
Summary of the invention
The objective of the invention is to, a kind of enhancement layer intra-frame prediction method and coding/decoding apparatus are provided, by utilizing the reconstructed pixel value of low layer macroblock/block, to realize improving the purpose of forecasting accuracy in the enhancement layer frame, raising code efficiency.
For achieving the above object, a kind of enhancement layer intra-frame prediction method provided by the invention comprises:
A, the non-availability limit of determining to need in enhancement layer current macro/piece to participate in the enhancement layer infra-frame prediction;
B, definite low layer macroblock/block relevant with current macro/piece position;
C, with the reconstruct pixel value of described low layer macroblock/block prediction reference as described current macro/piece, described current macro/piece is carried out infra-frame prediction.
Described non-availability limit comprises: the top and/or the left side.
When described non-availability limit comprised the top, the reconstructed pixel value of described low layer macroblock/block was: the reconstructed pixel value of top or following reconstructed pixel value or the reconstructed pixel value of going arbitrarily or the linear result of calculation of at least one line reconstruction pixel value;
When described non-availability limit comprised the left side, the reconstructed pixel value of described low layer macroblock/block was: the reconstructed pixel value on the left side or the reconstructed pixel value on the right or the reconstructed pixel value that is listed as arbitrarily or the linear result of calculation of at least one column weight structure pixel value.
The low layer macroblock/block that described and current macro/piece position are relevant is: the low layer macroblock/block of low layer macroblock/block identical with current macro/piece position and/or the low layer macroblock/block adjacency identical with current macro/piece position.
Described macroblock/block is: 16 * 16 based on the macro block of the intra-frame encoding mode in the video coding or 8 * 8 based on the piece of the intra-frame encoding mode in the video coding or 4 * 4 piece based on the intra-frame encoding mode in the video coding.
Be predicted as in the described enhancement layer frame: the infra-frame prediction of Vertical predictive mode or Horizontal predictive mode or DC predictive mode or Diagonal Down-Left predictive mode or Diagonal Down-Right predictive mode or Vertical-Left predictive mode or Horizontal-Down predictive mode or Vertical-Right predictive mode or Horizontal-Up predictive mode or the infra-frame prediction of Plane predictive mode.
The present invention also provides a kind of coding/decoding apparatus, comprising: obtain prediction reference module and intra-framed prediction module;
Obtain the prediction reference module: the non-availability limit of determining to need in current macro/piece to participate in the enhancement layer infra-frame prediction, and determine the low layer macroblock/block relevant with current macro/piece position, the reconstruct pixel value of described low layer macroblock/block is transferred to intra-framed prediction module as the prediction reference of described current macro/piece;
Intra-framed prediction module: described current macro/piece is carried out infra-frame prediction with the described next prediction reference of prediction reference module transmission of obtaining.
Described non-availability limit comprises: the top and/or the left side.
When described non-availability limit comprised the top, the reconstructed pixel value of described low layer macroblock/block was: the reconstructed pixel value of top or following reconstructed pixel value or the reconstructed pixel value of going arbitrarily or the linear result of calculation of at least one line reconstruction pixel value;
When described non-availability limit comprised the left side, the reconstructed pixel value of described low layer macroblock/block was: the reconstructed pixel value on the left side or the reconstructed pixel value on the right or the reconstructed pixel value that is listed as arbitrarily or the linear result of calculation of at least one column weight structure pixel value.
The low layer macroblock/block that described and current macro/piece position are relevant is: the low layer macroblock/block of low layer macroblock/block identical with current macro/piece position and/or the low layer macroblock/block adjacency identical with current macro/piece position.
Description by technique scheme as can be known, the present invention is by making full use of the reconstructed pixel value of the low layer macroblock/block relevant with enhancement layer current macro/piece position, make the present invention realize the enhancement layer infra-frame prediction, and when needing to participate in the limit non-availability of infra-frame prediction in current macro/piece, the non-availability limit that can choose with enhancement layer current macro/piece has the reconstructed pixel value of the low layer macroblock/block of substantial connection to carry out infra-frame prediction, avoided using the phenomenon of the poor accuracy that predicts the outcome that predetermined value causes as 128, make the present invention when not increasing enhancement layer infra-frame prediction complexity, make the interior prediction result of enhancement layer frame approach actual value more as much as possible; The inter-frame predicated reference value of the current macro/piece among the present invention can be the reconstructed pixel value in the low layer macroblock/block identical with current macro/piece position, also can be the reconstructed pixel value in the low layer macroblock/block of the low layer macroblock/block adjacency identical with current macro/piece position, and can make the implementation of enhancement layer intra-frame prediction method of the present invention and coding/decoding apparatus flexible for the top in the low layer macroblock/block, the left side, row, reconstructed pixel values, the linear result of calculation of the reconstructed pixel value of delegation/row at least of row arbitrarily arbitrarily; Thereby realized improving the purpose of forecasting accuracy in the enhancement layer frame, raising video coding efficient by technical scheme provided by the invention.
Description of drawings
Fig. 1 is a compression processing framework schematic diagram H.264;
Fig. 2 is the luma prediction method schematic diagram of 16 * 16 macro blocks H.264 of the prior art;
Fig. 3 is the luma prediction method schematic diagram of 4 * 4 macro blocks H.264 of the prior art;
Fig. 4 is the colorimetric prediction method schematic diagram of 8 * 8 macro blocks H.264 of the prior art;
Fig. 5 is an I_BL predictive mode schematic diagram of the prior art;
Fig. 6 is prediction principle figure in the enhancement layer frame of the present invention.
Embodiment
When the current macro/piece to enhancement layer carries out in infra-frame prediction and the current macro/piece participating in the limit non-availability of infra-frame prediction, carry out infra-frame prediction if can adopt limit with enhancement layer current macro/piece to have the reconstructed pixel value of the low layer macroblock/block of substantial connection to substitute the non-availability limit, then can avoid using the phenomenon of predetermined value as the 128 forecasting accuracy differences that cause as prediction reference, thus can effectively improve the infra-frame prediction of enhancement layer current macro accuracy, improve video coding efficient.
Therefore, the core of enhancement layer intra-frame prediction method of the present invention and coding/decoding apparatus all is: the non-availability limit of determining to need in enhancement layer current macro/piece to carry out the enhancement layer infra-frame prediction, determine the low layer macroblock/block relevant with current macro/piece position, with the reconstruct pixel value of described low layer macroblock/block prediction reference, described current macro/piece is carried out infra-frame prediction as described current macro/piece.
Based on core concept of the present invention technical scheme provided by the invention is further described below.
Because the reconstructed pixel value on the limit of enhancement layer current macro/piece has confidential relation with the reconstructed pixel value on the limit of relevant low layer macroblock/block, and, when enhancement layer current macro/piece is carried out infra-frame prediction, the reconstructed pixel value of low layer macroblock/block can get, so, the present invention is carrying out infra-frame prediction and current macro/piece when participating in the limit non-availability of infra-frame prediction to enhancement layer current macro/piece, made full use of the reconstructed pixel value of low layer macroblock/block.
Macroblock/block among the present invention is the macroblock/block based on the intra-frame encoding mode in the video coding, and the macroblock/block of carrying out infra-frame prediction can be 16 * 16 macro block, can be 8 * 8 piece, also can be 4 * 4 piece.
When enhancement layer current macro/piece was the piece of 16 * 16 macro block or 8 * 8, infra-frame prediction of the present invention can comprise: the infra-frame prediction of the infra-frame prediction of the infra-frame prediction of DC predictive mode, vertical predictive mode, the infra-frame prediction of horizontal predictive mode and Plane predictive mode.
When the enhancement layer current block was 4 * 4 piece, infra-frame prediction of the present invention can comprise: the infra-frame prediction of Vertical predictive mode, the infra-frame prediction of Horizontal predictive mode, the infra-frame prediction of DC predictive mode, the infra-frame prediction of Diagonal Down-Left predictive mode, the infra-frame prediction of Diagonal Down-Right predictive mode, the infra-frame prediction of Vertical-Left predictive mode, the infra-frame prediction of Horizontal-Down predictive mode, the infra-frame prediction of Vertical-Right predictive mode, in these 9 kinds of predictive modes of the infra-frame prediction of Horizontal-Up predictive mode one or more.
The low layer macroblock/block relevant with enhancement layer current macro/piece position can be the low layer macroblock/block identical in the enhancement layer position with current macro/piece among the present invention, also can for: the low layer macroblock/block identical in the enhancement layer position with current macro/piece in abutting connection with the low layer macroblock/block.
The realization principle of enhancement layer intra-frame prediction method of the present invention as shown in Figure 6.
Among Fig. 6, when current macro/piece of the n * n of enhancement layer K layer is carried out infra-frame prediction, if this current macroblock/block participate in exist in the limit of infra-frame prediction the non-availability limit as topmost, Far Left, then need to utilize the infra-frame prediction that carries out enhancement layer current macro/piece with the reconstructed pixel value of the low layer macroblock/block of current macro/K-1 layer that the piece position is relevant.
The position of low layer macroblock/block in the K-1 layer, should be relevant in the position of K layer with current macro/piece, be the low layer macroblock/block can for: the low layer macroblock/block identical in the position of K layer, low layer macroblock/block with current macro/piece also can for: the low layer macroblock/block identical in the position of K layer with current macro/piece in abutting connection with the low layer macroblock/block.
If it is the top of current macro/piece that enhancement layer current macro/piece is participated in the non-availability limit of infra-frame prediction, then the prediction reference pixel value of the infra-frame prediction of current macro/piece can for: in the K-1 layer, the reconstructed pixel value of the top of the low layer macroblock/block identical with current macro/piece position; Can for: in the K-1 layer, the reconstructed pixel value of any delegation of the low layer macroblock/block identical with current macro/piece position; Can for: in the K-1 layer, the linear result of calculation of the reconstructed pixel value of the delegation at least of the low layer macroblock/block identical with current macro/piece position; Also can for: in the K-1 layer, the reconstructed pixel value bottom of the low layer macroblock/block of the top adjacency of the low layer macroblock/block identical with current macro/piece position; Also can for: in the K-1 layer, the reconstructed pixel value of any delegation of the low layer macroblock/block of the top adjacency of the low layer macroblock/block identical with current macro/piece position; Can also be the linear result of calculation of the reconstructed pixel value of the delegation at least of the low layer macroblock/block of the top adjacency of the low layer macroblock/block identical with current macro/piece position.
If it is the left side of current macro/piece that enhancement layer current macro/piece is participated in the non-availability limit of infra-frame prediction, then the prediction reference pixel value of the infra-frame prediction of current macro/piece can for: in the K-1 layer, the leftmost reconstructed pixel value of the low layer macroblock/block identical with current macro/piece position; Can for: in the K-1 layer, the low layer macroblock/block identical with current macro/piece position any one row the reconstructed pixel value; Can for: in the K-1 layer, the linear result of calculation of the reconstructed pixel value of at least one row of the low layer macroblock/block identical with current macro/piece position; Also can for: in the K-1 layer, the rightmost reconstructed pixel value of the low layer macroblock/block of the Far Left adjacency of the low layer macroblock/block identical with current macro/piece position; Also can for: in the K-1 layer, the low layer macroblock/block of the Far Left adjacency of the low layer macroblock/block identical with current macro/piece position any one row the reconstructed pixel value; Can also be the linear result of calculation of the reconstructed pixel value of at least one row of the low layer macroblock/block of the Far Left adjacency of the low layer macroblock/block identical with current macro/piece position.
Among Fig. 6, the non-availability limit of K layer current macro/piece is: the top and the left side.At this moment, the prediction reference pixel value of these two non-availability limit situations can make up from the situation of foregoing description respectively and choose.
The value of n can be 16 or 8 or 4 among Fig. 6.
As can be seen from Figure 6, the present invention mainly is when enhancement layer current macro/piece carries out in infra-frame prediction and the current macro/piece participating in the limit non-availability of infra-frame prediction, reconstructed pixel value in the low layer macroblock/block that will be relevant with current macro/piece position is as the predicted parameter value of current macro/piece, current macro/piece is carried out infra-frame prediction, other implementation procedure of infra-frame prediction of the present invention is with H.264 the INTRA forecasting process is basic identical, this shows that the present invention does not increase the computation complexity in the infra-frame prediction process.Therefore, the present invention is directed to existing H.264 INTRA forecasting process, improved the accuracy that predicts the outcome in the enhancement layer frame, the code efficiency that has improved coding/decoding apparatus.
Coding/decoding apparatus provided by the invention is provided with and obtains prediction reference module and intra-framed prediction module.
Obtaining the prediction reference module is mainly used in when having the non-availability limit in the limit that needs to participate in the enhancement layer infra-frame prediction in determining current macro/piece, determine the low layer macroblock/block relevant, and the reconstructed pixel value of low layer macroblock/block is transferred to intra-framed prediction module as the prediction reference of current macro/piece with current macro/piece position.The non-availability limit here can be the top of current macro/piece, the left side, in the position of low layer macroblock/block, the low layer macroblock/block as the reconstructed pixel value of prediction reference, predictive mode that infra-frame prediction specifically comprises all as the description in the above-mentioned method, be not described in detail at this.
Intra-framed prediction module is mainly used in to receive obtains the prediction reference that the transmission of prediction reference module comes, and according to the prediction reference of its reception current macro/piece is carried out infra-frame prediction.
Intra-framed prediction module realizes that other process of infra-frame prediction with H.264 the INTRA forecasting process is similar substantially, is not described in detail at this.
Though described the present invention by embodiment, those of ordinary skills know, the present invention has many distortion and variation and do not break away from spirit of the present invention, and the claim of application documents of the present invention comprises these distortion and variation.