WO2012011714A2 - 다중 예측 필터를 이용하는 경쟁기반 인트라 예측 부호화/복호화 장치 및 방법 - Google Patents
다중 예측 필터를 이용하는 경쟁기반 인트라 예측 부호화/복호화 장치 및 방법 Download PDFInfo
- Publication number
- WO2012011714A2 WO2012011714A2 PCT/KR2011/005291 KR2011005291W WO2012011714A2 WO 2012011714 A2 WO2012011714 A2 WO 2012011714A2 KR 2011005291 W KR2011005291 W KR 2011005291W WO 2012011714 A2 WO2012011714 A2 WO 2012011714A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- filter
- intra prediction
- prediction
- encoding
- current block
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/13—Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/15—Data rate or code amount at the encoder output by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Definitions
- An embodiment of the present invention relates to an intra prediction encoding / decoding apparatus and method. More specifically, it is possible to select an optimal extrapolation prediction filter for improving the prediction performance of a block to be currently encoded from a plurality of extrapolation prediction filter candidates, thereby competing using a multi prediction filter capable of providing higher encoding / decoding performance.
- An apparatus and method for based intra prediction encoding / decoding are provided.
- intra coding is performed in a form of efficiently compressing a residual signal obtained by efficiently removing spatial redundancy in a frame or a block through a transform technique, quantization, and entropy coding process.
- Typical intra coding methods include JPEG (Joint Photographic coding Experts Group), a block-based Discrete Cosine Transform (DCT) -based compression technique, and JPEG2000, which improves coding efficiency through a wavelet-based arithmetic coding technique. Recently, it is known that the performance of the intra coding scheme through directional based extrapolation prediction of H.264 / AVC is the best.
- JPEG Joint Photographic coding Experts Group
- DCT Discrete Cosine Transform
- Intra coding through the directional-based prediction of H.264 / AVC uses the left and top pixels A to M which have been encoded / decoded based on nine directional directions including DC prediction (mode 2) as shown in FIG. 1.
- Extrapolation prediction is performed. That is, extrapolation prediction is performed in a form in which one pixel value in a block takes values of left and top pixels along a prediction direction and fills them. For example, in mode 0, since extrapolation prediction is performed in the vertical direction, the 4x4 block of FIG. 1 has values filled with the values of A, B, C, and D, which are upper pixels, in the direction of the arrow.
- Embodiments of the present invention have been devised to efficiently solve the limitations of the extrapolation prediction technique, which has a limiting factor in the prediction performance for blocks having various characteristics, and the performance constraint problem in an image having only major edges.
- Competitive-based intra prediction using multiple prediction filters that can provide higher encoding / decoding performance by selecting an optimal extrapolation prediction filter for improving the prediction performance of a block to be currently encoded from a plurality of extrapolation prediction filter candidates.
- An object of the present invention is to provide an encoding / decoding apparatus and method.
- an intra prediction encoding / decoding apparatus includes a plurality of extrapolation prediction filter candidates for filtering pixels around a current block for each intra prediction direction or mode of a current block to be encoded.
- An encoder configured to select a filter having the least encoding cost among the plurality of extrapolated prediction filter candidates and to intra-prediction-encode the current block based on the selected filter; And a plurality of extrapolation prediction filter candidates for filtering pixels around the target block for each intra prediction direction or mode of the target block to be decoded, and filter information used for encoding the target block with respect to the coded signal input from the encoder.
- a decoder configured to intra-prediction decode the target block based on the received filter information.
- An intra prediction encoding apparatus for achieving the above object includes a plurality of extrapolation prediction filter candidates for filtering pixels around a current block for each intra prediction direction or mode of a current block to be encoded.
- An optimal filter selection unit for selecting a filter having the lowest encoding cost among the plurality of extrapolated prediction filter candidates;
- a residual signal generation unit generating an extrapolated prediction value of the current block through a filter selected by the optimum filter selecting unit, and calculating a difference between the extrapolated prediction value of the generated current block and the pixel value of the current block to generate a residual signal;
- a transform and quantizer for transforming and quantizing a residual signal generated by the residual signal generator;
- an entropy coder for entropy encoding the transformed and quantized residual signal.
- the intra prediction encoding apparatus may further include an optimal filter coder that encodes an index of a filter selected for each intra prediction direction or mode of the current block.
- the optimum filter coder may encode an index of the selected filter by using a correlation between neighboring filter indices for each intra prediction direction or mode of the current block.
- the optimum filter coder may allocate a fixed bit value to each extrapolation prediction filter candidate for each intra prediction direction or mode of the current block, and transmit a bit value corresponding to the selected filter to the decoder.
- the intra prediction encoding apparatus may further include a filter updating unit for designing a plurality of extrapolated prediction filter candidates for the current block based on the filter used in the previously encoded block.
- the intra prediction encoding apparatus may include a filter updater configured to design a plurality of extrapolated prediction filter candidates for the current block based on mode information on the current frame to be encoded, pixel values of the current block, and pixel values around the current block. It may further include.
- An intra prediction decoding apparatus for achieving the above object includes an entropy decoding unit for reading and restoring information on a target block to be decoded, with respect to an input coded signal; An inverse quantization and inverse transformation unit for inverse quantization and inverse transformation of information restored by the entropy decoding unit; And a plurality of extrapolated prediction filter candidates for filtering pixels around the target block for each intra prediction direction or mode of the target block, receiving and restoring filter information used for encoding the target block with respect to an input coded signal, A filter selecting unit for selecting a filter corresponding to the received filter information among the extrapolated prediction filter candidates; An extrapolation predictor for predicting an extrapolated pixel value for the target block based on the selected filter; And a current block decoder which adds the inverse quantization and the value output by the inverse transform unit to the extrapolated pixel value predicted by the extrapolation predictor to restore the target block.
- the intra prediction decoding apparatus may further include a filter updater for designing a plurality of extrapolated prediction filter candidates for the target block based on the filter used in the previously decoded block.
- the intra prediction decoding apparatus may include a filter updater configured to design a plurality of extrapolation prediction filter candidates for the target block based on mode information on the target frame to be decoded, pixel values of the target block, and pixel values around the target block. It may further include.
- an intra prediction encoding / decoding method includes a plurality of extrapolation prediction filter candidates for filtering pixels around a current block for each intra prediction direction or mode of a current block to be encoded. Selecting a filter having the least encoding cost among a plurality of extrapolated prediction filter candidates, and performing intra prediction encoding on the current block based on the selected filter; And a plurality of extrapolation prediction filter candidates for filtering pixels around the target block for each intra prediction direction or mode of the target block to be decoded, and for encoding the target block with respect to the coded signal input by the intra prediction encoding step. Receiving the used filter information, and intra prediction decoding the target block based on the received filter information.
- An intra prediction encoding method for achieving the above object includes a plurality of extrapolation prediction filter candidates for filtering pixels around a current block for each intra prediction direction or mode of a current block to be encoded. Selecting a filter having the lowest encoding cost among the plurality of extrapolated prediction filter candidates; Generating an extrapolated prediction value of the current block through the filter selected by the optimum filter selection step, and calculating a difference between the extrapolated prediction value of the generated current block and the pixel value of the current block to generate a residual signal; Converting and quantizing the residual signal generated by the residual signal generating step; And entropy encoding the transformed and quantized residual signal.
- the intra prediction encoding method may further include encoding an index for a filter selected for each intra prediction direction or mode of the current block.
- the index of the selected filter may be encoded using a correlation between neighboring filter indices for each intra prediction direction or mode of the current block.
- the encoding of the index for the selected filter may include assigning a fixed bit value to each extrapolated prediction filter candidate for each intra prediction direction or mode of the current block, and transmitting a bit value corresponding to the selected filter to the decoder. It may be.
- the intra prediction encoding method may further comprise designing a plurality of extrapolative prediction filter candidates for the current block based on the filter used in the previously encoded block.
- the intra prediction encoding method may further include designing a plurality of extrapolated prediction filter candidates for the current block based on mode information on the current frame to be encoded, pixel values of the current block, and pixel values around the current block. It may also include.
- Intra prediction decoding method for achieving the above object, based on the input coded signal, restoring the entropy for the target block to be decoded; And a plurality of extrapolated prediction filter candidates for filtering pixels around the target block for each intra prediction direction or mode of the target block, receiving and restoring filter information used for encoding the target block with respect to an input coded signal, Selecting a filter corresponding to the received filter information among the extrapolated prediction filter candidates; Inverse quantization and inverse transformation of the information restored by the entropy restoration step; Predicting an extrapolated pixel value for the target block based on the selected filter; And reconstructing the object block by adding the values output by the inverse quantization and inverse transformation steps to the extrapolated pixel values predicted by the extrapolated pixel value prediction step.
- the intra prediction decoding method may further include designing a plurality of extrapolative prediction filter candidates for the target block based on the filter used in the previously decoded block.
- the intra prediction decoding method may further include designing a plurality of extrapolated prediction filter candidates for the target block based on mode information on the target frame to be decoded, pixel values of the target block, and pixel values around the target block. It may also include.
- the filter candidates it is possible to select an optimal extrapolation prediction filter for improving the prediction performance of the block to be currently encoded, thereby providing higher encoding / decoding performance.
- 1 is a diagram illustrating an intra prediction mode according to H.264.
- FIG. 2 is a diagram schematically illustrating an intra prediction encoding apparatus according to an embodiment of the present invention.
- FIG. 3 illustrates N different extrapolated prediction filters for M intra prediction modes.
- FIG. 4 is a diagram schematically illustrating an intra prediction decoding apparatus according to an embodiment of the present invention.
- FIG. 5 is a flowchart illustrating an intra prediction encoding method according to an embodiment of the present invention.
- FIG. 6 is a flowchart illustrating an intra prediction decoding method according to an embodiment of the present invention.
- FIG. 2 is a diagram schematically illustrating an intra prediction encoding apparatus according to an embodiment of the present invention.
- the intra prediction encoding apparatus 200 may include an optimal filter selecting unit 210, a residual signal generator 220, a transform and quantization unit 230, and an entropy encoder 240. ), An optimum filter coder 250, and a filter updater 260.
- the optimal filter selecting unit 210 includes a plurality of extrapolation prediction filter candidates for filtering pixels around the current block for each intra prediction direction or mode of the current block to be encoded, and an encoding cost among the plurality of extrapolation prediction filter candidates. Choose this least filter. That is, as illustrated in FIG. 3, N extrapolation prediction filter candidates for filtering pixels around the current block may be provided for each intra prediction direction or prediction mode of the current block to be encoded. For example, in case of nine intra prediction modes according to H.264, N extrapolation prediction filter candidates may be provided for each prediction mode.
- the extrapolation prediction filter may be generated through a training process, and may be differentially provided according to the weight of the pixel value of the neighboring block with respect to the pixel value of the current block.
- the type of intra prediction mode according to an embodiment of the present invention is not limited to nine intra prediction modes of H.264, but may be applied to various modified intra prediction modes.
- the optimal filter selector 210 selects a filter having the lowest coding cost when generating an extrapolated prediction value of the current block by using extrapolated prediction filter candidates provided for each intra prediction direction or prediction mode.
- the optimum filter selector 210 may predict the intra prediction direction of the current block from the neighboring pixels of the current block and select an optimal filter from the extrapolated prediction filter candidates included in the intra prediction direction.
- the optimum filter selector 210 may compare encoding costs according to extrapolation prediction of respective extrapolation prediction filter candidates for all intra prediction directions of the current block, and select a filter having the least encoding cost among them.
- the residual signal generator 220 generates an extrapolated prediction value of the current block through the filter selected by the optimum filter selector 210, and calculates a difference between the extrapolated prediction value of the generated current block and the pixel value of the current block. To generate the residual signal.
- the transform and quantization unit 230 is a block-based transform such as a Karhunen-Loeve Transform (KLT), a Singular Value Decomposition (SVD), a Discrete Cosine Transform (DCT), or the like on the residual signal generated by the residual signal generator 220. Perform and quantize image-based transformations such as the discrete wavelet transform (DWT).
- KLT Karhunen-Loeve Transform
- SVD Singular Value Decomposition
- DCT Discrete Cosine Transform
- the entropy coder 240 converts the residual signal transformed and quantized by the transform and quantizer 230 into an exponential Golomb, context-based adaptive variable length coding (CAVLC), and context-based code. Bit streams of 0 and 1 are generated through entropy techniques such as Context-Adaptive Binary Arithmetic Coding (CABAC).
- CABAC Context-Adaptive Binary Arithmetic Coding
- the optimal filter encoder 250 encodes an index of a filter selected for each intra prediction direction or prediction mode of the current block.
- the optimal filter encoder 250 may encode the index of the selected filter by using the correlation between neighboring filter indices for each intra prediction direction or prediction mode.
- the optimum filter encoder 250 may allocate a fixed bit value to each extrapolation prediction filter candidate for each intra prediction direction or prediction mode of the current block, and may transmit a bit value corresponding to the selected filter to the decoder. .
- the filter updater 260 may design a plurality of extrapolated prediction filter candidates for the current block based on the filter used in the previously encoded block. For example, the intra prediction direction of the target block is predicted from the prediction modes of blocks that are already encoded on the left or top of the target block to be encoded, and the plurality of extrapolated prediction filter candidates are predicted from the neighboring blocks used for the prediction. Extrapolation prediction filter candidates for a block can be designed.
- the filter updater 260 may design a plurality of extrapolated prediction filter candidates for the current block based on mode information on the current frame to be encoded, pixel values of the current block, and pixel values around the current block. . That is, the filter updater 260 determines weights of pixels of the neighboring block with respect to the pixels of the current block based on the mode information of the current frame to be encoded, the pixel value of the current block, and the pixel value of the neighboring current block.
- the extrapolation prediction filter candidate may be designed differentially according to the determined weight.
- FIG. 4 is a diagram schematically illustrating an intra prediction decoding apparatus according to an embodiment of the present invention.
- the intra prediction decoding apparatus 400 includes an entropy decoder 410, an inverse quantization and inverse transform unit 420, a filter selector 430, an extrapolation predictor 440, A current block decoder 450 and a filter update unit 460 may be provided.
- the entropy decoding unit 410 reads and restores information on a target block to be decoded with respect to an encoded signal (bit string) input from the intra prediction encoding apparatus 200.
- the inverse quantization and inverse transform unit 420 decodes the information restored by the entropy decoding unit 410 through inverse quantization and inverse frequency conversion.
- the filter selector 430 includes a plurality of extrapolated prediction filter candidates for filtering pixels around the target block for each intra prediction direction or prediction modes of the target block, and the encoded signal input from the intra prediction encoding apparatus 200. Receives filter information used for encoding a target block, and selects a filter corresponding to the received filter information from the extrapolated prediction filter candidates. That is, the filter selector 430 receives the intra prediction direction of the decoding object block and the filter information about the used extrapolation prediction filter from the bit string received from the intra prediction encoding apparatus 200 and receives the extrapolation prediction filter candidates. Select a filter corresponding to the filter information.
- the extrapolation predictor 440 predicts an extrapolated pixel value for the target block based on the filter selected by the filter selector 430.
- the current block decoder 450 reconstructs the target block by adding the value output by the inverse quantization and inverse transform unit 420 to the extrapolated pixel value predicted by the extrapolation predictor 440.
- the filter updater 460 may design a plurality of extrapolated prediction filter candidates for the current decoding target block based on the filter used in the previously decoded block. For example, the intra prediction direction of the target block is predicted from the prediction modes of blocks that are already encoded on the left or top of the target block to be decoded, and the plurality of extrapolated prediction filter candidates are predicted from the neighboring blocks used for the prediction. Extrapolation prediction filter candidates for a block can be designed.
- the filter updater 460 may design a plurality of extrapolated prediction filter candidates for the target block based on mode information on the target frame to be decoded, pixel values of the target block, and pixel values around the target block. . That is, the filter updater 460 determines weights of pixels of the neighboring block with respect to the pixels of the target block based on mode information of the target frame to be decoded, pixel values of the target block, and pixel values around the target block.
- the extrapolation prediction filter candidate may be designed differentially according to the determined weight.
- FIG. 5 is a flowchart illustrating an intra prediction encoding method according to an embodiment of the present invention.
- the optimal filter selecting unit 210 includes a plurality of extrapolation prediction filter candidates for filtering pixels around the current block for each intra prediction direction or mode of the current block to be encoded, and an encoding cost among the plurality of extrapolation prediction filter candidates. This least filter is selected (S501).
- the optimum filter selector 210 may predict the intra prediction direction of the current block from the neighboring pixels of the current block and select an optimal filter from the extrapolated prediction filter candidates included in the intra prediction direction.
- the optimum filter selector 210 may compare encoding costs according to extrapolation prediction of respective extrapolation prediction filter candidates for all intra prediction directions of the current block, and select a filter having the least encoding cost among them.
- the residual signal generator 220 generates an extrapolated prediction value of the current block through the filter selected by the optimum filter selector 210, and calculates a difference between the extrapolated prediction value of the generated current block and the pixel value of the current block. To generate a residual signal (S503).
- the transform and quantization unit 230 is a block-based transform such as a Karhunen-Loeve Transform (KLT), a Singular Value Decomposition (SVD), a Discrete Cosine Transform (DCT), or the like on the residual signal generated by the residual signal generator 220.
- KLT Karhunen-Loeve Transform
- SVD Singular Value Decomposition
- DCT Discrete Cosine Transform
- An image-based transform such as a discrete wavelet transform (DWT) is performed and quantized (S505).
- the entropy coder 240 converts the residual signal transformed and quantized by the transform and quantizer 230 into an exponential Golomb, context-based adaptive variable length coding (CAVLC), and context-based code. Bit strings of 0 and 1 are generated through entropy techniques such as Context-Adaptive Binary Arithmetic Coding (CABAC) (S507).
- CABAC Context-Adaptive Binary Arithmetic Coding
- the optimal filter encoder 250 encodes an index of a filter selected for each intra prediction direction or prediction mode of the current block (S509).
- the optimal filter encoder 250 may encode the index of the selected filter by using the correlation between neighboring filter indices for each intra prediction direction or prediction mode.
- the optimum filter encoder 250 may allocate a fixed bit value to each extrapolation prediction filter candidate for each intra prediction direction or prediction mode of the current block, and may transmit a bit value corresponding to the selected filter to the decoder. .
- the filter updater 260 may design a plurality of extrapolated prediction filter candidates for the current block based on the filter used in the previously encoded block (S611). For example, the intra prediction direction of the target block is predicted from the prediction modes of blocks that are already encoded on the left or top of the target block to be encoded, and the plurality of extrapolated prediction filter candidates are predicted from the neighboring blocks used for the prediction. Extrapolation prediction filter candidates for a block can be designed. Alternatively, the filter updater 260 may design a plurality of extrapolated prediction filter candidates for the current block based on mode information on the current frame to be encoded, pixel values of the current block, and pixel values around the current block. .
- FIG. 6 is a flowchart illustrating an intra prediction decoding method according to an embodiment of the present invention.
- the entropy decoding unit 410 reads and restores the information on the target block to be decoded from the coded signal (bit string) input from the intra prediction encoding apparatus 200 (S601).
- the filter selector 430 includes a plurality of extrapolated prediction filter candidates for filtering pixels around the target block for each intra prediction direction or prediction modes of the target block, and the encoded signal input from the intra prediction encoding apparatus 200. Receive the filter information used for encoding the target block, and select a filter corresponding to the received filter information from the extrapolated prediction filter candidates (S603). That is, the filter selector 430 receives the intra prediction direction of the decoding object block and the filter information about the used extrapolation prediction filter from the bit string received from the intra prediction encoding apparatus 200 and receives the extrapolation prediction filter candidates. Select a filter corresponding to the filter information.
- the inverse quantization and inverse transform unit 420 decodes the information restored by the entropy decoding unit 410 through inverse quantization and inverse frequency conversion (S605).
- the extrapolation predictor 440 predicts an extrapolated pixel value for the target block based on the filter selected by the filter selector 430 (S607).
- the current block decoder 450 reconstructs the target block by adding the value output by the inverse quantization and inverse transform unit 420 to the extrapolated pixel value predicted by the extrapolation predictor 440 (S609).
- the filter updater 460 may design a plurality of extrapolated prediction filter candidates for the current decoding target block based on the filter used in the previously decoded block (S611). Alternatively, the filter updater 460 may design a plurality of extrapolated prediction filter candidates for the target block based on mode information on the target frame to be decoded, pixel values of the target block, and pixel values around the target block. .
- the embodiment of the present invention can efficiently solve the limitation of the extrapolation prediction technique that has the constraints on the prediction performance for the blocks having various characteristics and the performance constraint problem in the image having only the major edges. It is a very useful invention to generate an effect of providing a higher encoding / decoding performance by selecting an optimal extrapolation prediction filter for improving the prediction performance of a block to be currently encoded from a plurality of extrapolation prediction filter candidates.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims (20)
- 인트라 예측 부호화/복호화 장치에 있어서,부호화하고자 하는 현재블록의 각각의 인트라 예측 방향 또는 모드 별로 상기 현재블록 주변의 화소들을 필터링하는 복수 개의 외삽 예측 필터 후보를 구비하며, 상기 복수 개의 외삽 예측 필터 후보 중 부호화 비용이 가장 적은 필터를 선택하고, 선택된 상기 필터에 기초하여 상기 현재블록을 인트라 예측 부호화하는 부호화기; 및복호화하고자 하는 대상블록의 각각의 인트라 예측 방향 또는 모드 별로 상기 대상블록 주변의 화소들을 필터링하는 복수 개의 외삽 예측 필터 후보를 구비하며, 상기 부호화기로부터 입력되는 부호화 신호에 대하여 상기 대상블록의 부호화에 이용된 필터정보를 수신하고, 수신된 상기 필터정보에 기초하여 상기 대상블록을 인트라 예측 복호화하는 복호화기를 포함하는 것을 특징으로 하는 인트라 예측 부호화/복호화 장치.
- 인트라 예측 부호화 장치에 있어서,부호화하고자 하는 현재블록의 각각의 인트라 예측 방향 또는 모드 별로 상기 현재블록 주변의 화소들을 필터링하는 복수 개의 외삽 예측 필터 후보를 구비하며, 상기 복수 개의 외삽 예측 필터 후보 중 부호화 비용이 가장 적은 필터를 선택하는 최적필터 선택부;상기 최적필터 선택부에 의해 선택된 필터를 통해 상기 현재블록의 외삽 예측 값을 생성하며, 생성된 상기 현재블록의 외삽 예측 값과 상기 현재블록의 화소 값 사이의 차이를 계산하여 잔여 신호를 생성하는 잔여신호 생성부;상기 잔여신호 생성부에 의해 생성된 잔여 신호를 변환 및 양자화하는 변환 및 양자화부; 및변환 및 양자화된 상기 잔여 신호를 엔트로피 부호화하는 엔트로피 부호부를 포함하는 것을 특징으로 하는 인트라 예측 부호화 장치.
- 제 2항에 있어서,상기 현재블록의 각각의 인트라 예측 방향 또는 모드 별로 선택된 필터에 대한 인덱스를 부호화하는 최적필터 부호부를 더 포함하는 것을 특징으로 하는 인트라 예측 부호화 장치.
- 제 3항에 있어서,상기 최적필터 부호부는,상기 현재블록의 각각의 인트라 예측 방향 또는 모드 별로 주변의 필터 인덱스 간의 상관도를 이용하여 상기 선택된 필터에 대한 인덱스를 부호화하는 것을 특징으로 하는 인트라 예측 부호화 장치.
- 제 3항에 있어서,상기 최적필터 부호부는,상기 현재블록의 각각의 인트라 예측 방향 또는 모드 별로 각각의 상기 외삽 예측 필터 후보에 고정된 비트 값을 할당하며, 상기 선택된 필터에 대응하는 비트 값을 복호기로 전송하는 것을 특징으로 하는 인트라 예측 부호화 장치.
- 제 2항에 있어서,이전의 부호화가 완료된 블록에서 이용된 필터에 기초하여 상기 현재블록에 대한 상기 복수 개의 외삽 예측 필터 후보를 설계하는 필터 갱신부를 더 포함하는 것을 특징으로 하는 인트라 예측 부호화 장치.
- 제 2항에 있어서,부호화하고자 하는 현재 프레임에 대한 모드 정보, 상기 현재블록의 화소 값 및 상기 현재블록의 주변의 화소 값에 기초하여 상기 현재블록에 대한 상기 복수 개의 외삽 예측 필터 후보를 설계하는 필터 갱신부를 더 포함하는 것을 특징으로 하는 인트라 예측 부호화 장치.
- 인트라 예측 복호화 장치에 있어서,입력되는 부호화 신호에 대하여, 복호화하고자 하는 대상블록에 대한 정보를 판독하여 복원하는 엔트로피 복호부;상기 엔트로피 복호부에 의해 복원된 정보를 역양자화 및 역변환하는 역양자화 및 역변환부;상기 대상블록의 각각의 인트라 예측 방향 또는 모드 별로 상기 대상블록 주변의 화소들을 필터링하는 복수 개의 외삽 예측 필터 후보를 구비하며, 입력되는 상기 부호화 신호에 대하여 상기 대상블록의 부호화에 이용된 필터정보를 수신하여 복원하고, 상기 외삽 예측 필터 후보 중 수신된 상기 필터정보에 대응하는 필터를 선택하는 필터 선택부;선택된 상기 필터에 기초하여 상기 대상블록에 대한 외삽 화소값을 예측하는 외삽 예측부; 및상기 외삽 예측부에 의해 예측된 상기 외삽 화소값에 상기 역양자화 및 역변환부에 의해 출력되는 값을 가산하여 상기 대상블록을 복원하는 현재블록 복호부를 포함하는 것을 특징으로 하는 인트라 예측 복호화 장치.
- 제 8항에 있어서,이전의 복호화가 완료된 블록에서 이용된 필터에 기초하여 상기 대상블록에 대한 상기 복수 개의 외삽 예측 필터 후보를 설계하는 필터 갱신부를 더 포함하는 것을 특징으로 하는 인트라 예측 복호화 장치.
- 제 8항에 있어서,복호화하고자 하는 대상 프레임에 대한 모드 정보, 상기 대상블록의 화소 값 및 상기 대상블록의 주변의 화소 값에 기초하여 상기 대상블록에 대한 상기 복수 개의 외삽 예측 필터 후보를 설계하는 필터 갱신부를 더 포함하는 것을 특징으로 하는 인트라 예측 복호화 장치.
- 인트라 예측 부호화/복호화 방법에 있어서,부호화하고자 하는 현재블록의 각각의 인트라 예측 방향 또는 모드 별로 상기 현재블록 주변의 화소들을 필터링하는 복수 개의 외삽 예측 필터 후보를 구비하며, 상기 복수 개의 외삽 예측 필터 후보 중 부호화 비용이 가장 적은 필터를 선택하고, 선택된 상기 필터에 기초하여 상기 현재블록을 인트라 예측 부호화하는 단계; 및복호화하고자 하는 대상블록의 각각의 인트라 예측 방향 또는 모드 별로 상기 대상블록 주변의 화소들을 필터링하는 복수 개의 외삽 예측 필터 후보를 구비하며, 상기 인트라 예측 부호화 단계에 의해 입력되는 부호화 신호에 대하여 상기 대상블록의 부호화에 이용된 필터정보를 수신하고, 수신된 상기 필터정보에 기초하여 상기 대상블록을 인트라 예측 복호화하는 단계를 포함하는 것을 특징으로 하는 인트라 예측 부호화/복호화 방법.
- 인트라 예측 부호화 방법에 있어서,부호화하고자 하는 현재블록의 각각의 인트라 예측 방향 또는 모드 별로 상기 현재블록 주변의 화소들을 필터링하는 복수 개의 외삽 예측 필터 후보를 구비하며, 상기 복수 개의 외삽 예측 필터 후보 중 부호화 비용이 가장 적은 필터를 선택하는 단계;상기 최적필터 선택단계에 의해 선택된 필터를 통해 상기 현재블록의 외삽 예측 값을 생성하며, 생성된 상기 현재블록의 외삽 예측 값과 상기 현재블록의 화소 값 사이의 차이를 계산하여 잔여 신호를 생성하는 단계;상기 잔여신호 생성단계에 의해 생성된 잔여 신호를 변환 및 양자화하는 단계; 및변환 및 양자화된 상기 잔여 신호를 엔트로피 부호화하는 단계를 포함하는 것을 특징으로 하는 인트라 예측 부호화 방법.
- 제 12항에 있어서,상기 현재블록의 각각의 인트라 예측 방향 또는 모드 별로 선택된 상기 필터에 대한 인덱스를 부호화하는 단계를 더 포함하는 것을 특징으로 하는 인트라 예측 부호화 방법.
- 제 13항에 있어서,선택된 상기 필터에 대한 인덱스를 부호화하는 단계는,상기 현재블록의 각각의 인트라 예측 방향 또는 모드 별로 주변의 필터 인덱스 간의 상관도를 이용하여 상기 선택된 필터에 대한 인덱스를 부호화하는 것을 특징으로 하는 인트라 예측 부호화 방법.
- 제 13항에 있어서,선택된 상기 필터에 대한 인덱스를 부호화하는 단계는,상기 현재블록의 각각의 인트라 예측 방향 또는 모드 별로 각각의 상기 외삽 예측 필터 후보에 고정된 비트 값을 할당하며, 상기 선택된 필터에 대응하는 비트 값을 복호기로 전송하는 것을 특징으로 하는 인트라 예측 부호화 방법.
- 제 12항에 있어서,이전의 부호화가 완료된 블록에서 이용된 필터에 기초하여 상기 현재블록에 대한 상기 복수 개의 외삽 예측 필터 후보를 설계하는 단계를 더 포함하는 것을 특징으로 하는 인트라 예측 부호화 방법.
- 제 12항에 있어서,부호화하고자 하는 현재 프레임에 대한 모드 정보, 상기 현재블록의 화소 값 및 상기 현재블록의 주변의 화소 값에 기초하여 상기 현재블록에 대한 상기 복수 개의 외삽 예측 필터 후보를 설계하는 단계를 더 포함하는 것을 특징으로 하는 인트라 예측 부호화 방법.
- 인트라 예측 복호화 방법에 있어서,입력되는 부호화 신호에 기초하여, 복호화하고자 하는 대상블록에 대한 엔트로피를 복원하는 단계;상기 대상블록의 각각의 인트라 예측 방향 또는 모드 별로 상기 대상블록 주변의 화소들을 필터링하는 복수 개의 외삽 예측 필터 후보를 구비하며, 입력되는 상기 부호화 신호에 대하여 상기 대상블록의 부호화에 이용된 필터정보를 수신하여 복원하고, 상기 외삽 예측 필터 후보 중 수신된 상기 필터정보에 대응하는 필터를 선택하는 단계;상기 엔트로피 복원단계에 의해 복원된 정보를 역양자화 및 역변환하는 단계;선택된 상기 필터에 기초하여 상기 대상블록에 대한 외삽 화소값을 예측하는 단계; 및상기 외삽 화소값 예측단계에 의해 예측된 상기 외삽 화소값에 상기 역양자화 및 역변환단계에 의해 출력되는 값을 가산하여 상기 대상블록을 복원하는 단계를 포함하는 것을 특징으로 하는 인트라 예측 복호화 방법.
- 제 18항에 있어서,이전의 복호화가 완료된 블록에서 이용된 필터에 기초하여 상기 대상블록에 대한 상기 복수 개의 외삽 예측 필터 후보를 설계하는 단계를 더 포함하는 것을 특징으로 하는 인트라 예측 복호화 방법.
- 제 18항에 있어서,복호화하고자 하는 대상 프레임에 대한 모드 정보, 상기 대상블록의 화소 값 및 상기 대상블록의 주변의 화소 값에 기초하여 상기 대상블록에 대한 상기 복수 개의 외삽 예측 필터 후보를 설계하는 단계를 더 포함하는 것을 특징으로 하는 인트라 예측 복호화 방법.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/811,603 US9538178B2 (en) | 2010-07-20 | 2011-07-19 | Device and method for competition-based intra prediction encoding/decoding using multiple prediction filters |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020100070009A KR101663762B1 (ko) | 2010-07-20 | 2010-07-20 | 다중 예측 필터를 이용하는 경쟁기반 인트라 예측 부호화/복호화 장치 및 방법 |
KR10-2010-0070009 | 2010-07-20 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2012011714A2 true WO2012011714A2 (ko) | 2012-01-26 |
WO2012011714A3 WO2012011714A3 (ko) | 2012-05-03 |
Family
ID=45497282
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2011/005291 WO2012011714A2 (ko) | 2010-07-20 | 2011-07-19 | 다중 예측 필터를 이용하는 경쟁기반 인트라 예측 부호화/복호화 장치 및 방법 |
Country Status (3)
Country | Link |
---|---|
US (1) | US9538178B2 (ko) |
KR (1) | KR101663762B1 (ko) |
WO (1) | WO2012011714A2 (ko) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017222326A1 (ko) * | 2016-06-24 | 2017-12-28 | 주식회사 케이티 | 비디오 신호 처리 방법 및 장치 |
US11533508B2 (en) | 2018-06-08 | 2022-12-20 | Kt Corporation | Method and apparatus for encoding/decoding residual data based on a plurality of transformations |
RU2792225C2 (ru) * | 2018-06-08 | 2023-03-21 | Кт Корпорейшен | Способ и устройство обработки видеосигнала |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101448162B (zh) | 2001-12-17 | 2013-01-02 | 微软公司 | 处理视频图像的方法 |
US10554985B2 (en) | 2003-07-18 | 2020-02-04 | Microsoft Technology Licensing, Llc | DC coefficient signaling at small quantization step sizes |
CN101690235B (zh) * | 2007-06-29 | 2013-05-01 | 夏普株式会社 | 图像编码装置、图像编码方法、图像译码装置、图像译码方法、程序以及记录介质 |
US11039138B1 (en) | 2012-03-08 | 2021-06-15 | Google Llc | Adaptive coding of prediction modes using probability distributions |
WO2016129980A1 (ko) * | 2015-02-13 | 2016-08-18 | 엘지전자(주) | 변환 도메인 예측을 이용하여 비디오 신호를 인코딩, 디코딩하는 방법 및 장치 |
WO2017204387A1 (ko) * | 2016-05-27 | 2017-11-30 | 엘지전자(주) | 원본 블록과 예측 블록 내 각 주파수 성분의 상관성을 이용하여 비디오 신호를 인코딩, 디코딩하는 방법 및 장치 |
WO2018012660A1 (ko) * | 2016-07-15 | 2018-01-18 | 엘지전자(주) | 예측 유닛 분할을 위한 변환 도메인 예측을 이용하여 비디오 신호를 인코딩, 디코딩하는 방법 및 장치 |
US11647179B2 (en) * | 2018-06-25 | 2023-05-09 | B1 Institute Of Image Technology, Inc. | Method and apparatus for encoding/decoding images |
CN113259669B (zh) * | 2021-03-25 | 2023-07-07 | 浙江大华技术股份有限公司 | 编码方法、装置、电子设备及计算机可读存储介质 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040076333A1 (en) * | 2002-10-22 | 2004-04-22 | Huipin Zhang | Adaptive interpolation filter system for motion compensated predictive video coding |
KR20090095014A (ko) * | 2008-03-04 | 2009-09-09 | 삼성전자주식회사 | 필터링된 예측 블록을 이용한 영상 부호화, 복호화 방법 및장치 |
KR20100045007A (ko) * | 2008-10-23 | 2010-05-03 | 에스케이 텔레콤주식회사 | 동영상 부호화/복호화 장치, 이를 위한 인트라 예측 방향에기반한 디블록킹 필터링 장치 및 필터링 방법, 및 기록 매체 |
US20100128995A1 (en) * | 2008-01-18 | 2010-05-27 | Virginie Drugeon | Image coding method and image decoding method |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7236524B2 (en) * | 2002-05-28 | 2007-06-26 | Sharp Laboratories Of America, Inc. | Methods and systems for image intra-prediction mode communication |
KR101608426B1 (ko) * | 2008-03-28 | 2016-04-04 | 삼성전자주식회사 | 영상의 인트라 예측 부호화/복호화 방법 및 그 장치 |
US20110002386A1 (en) * | 2009-07-06 | 2011-01-06 | Mediatek Singapore Pte. Ltd. | Video encoder and method for performing intra-prediction and video data compression |
-
2010
- 2010-07-20 KR KR1020100070009A patent/KR101663762B1/ko active IP Right Grant
-
2011
- 2011-07-19 US US13/811,603 patent/US9538178B2/en active Active
- 2011-07-19 WO PCT/KR2011/005291 patent/WO2012011714A2/ko active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040076333A1 (en) * | 2002-10-22 | 2004-04-22 | Huipin Zhang | Adaptive interpolation filter system for motion compensated predictive video coding |
US20100128995A1 (en) * | 2008-01-18 | 2010-05-27 | Virginie Drugeon | Image coding method and image decoding method |
KR20090095014A (ko) * | 2008-03-04 | 2009-09-09 | 삼성전자주식회사 | 필터링된 예측 블록을 이용한 영상 부호화, 복호화 방법 및장치 |
KR20100045007A (ko) * | 2008-10-23 | 2010-05-03 | 에스케이 텔레콤주식회사 | 동영상 부호화/복호화 장치, 이를 위한 인트라 예측 방향에기반한 디블록킹 필터링 장치 및 필터링 방법, 및 기록 매체 |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017222326A1 (ko) * | 2016-06-24 | 2017-12-28 | 주식회사 케이티 | 비디오 신호 처리 방법 및 장치 |
US10735720B2 (en) | 2016-06-24 | 2020-08-04 | Kt Corporation | Method and apparatus for processing video signal |
US11350084B2 (en) | 2016-06-24 | 2022-05-31 | Kt Corporation | Method and apparatus for processing video signal |
US11445179B2 (en) | 2016-06-24 | 2022-09-13 | Kt Corporation | Method and apparatus for processing video signal |
US11445177B2 (en) | 2016-06-24 | 2022-09-13 | Kt Corporation | Method and apparatus for processing video signal |
US11445178B2 (en) | 2016-06-24 | 2022-09-13 | Kt Corporation | Method and apparatus for processing video signal |
US11533508B2 (en) | 2018-06-08 | 2022-12-20 | Kt Corporation | Method and apparatus for encoding/decoding residual data based on a plurality of transformations |
RU2792225C2 (ru) * | 2018-06-08 | 2023-03-21 | Кт Корпорейшен | Способ и устройство обработки видеосигнала |
US12003772B2 (en) | 2018-06-08 | 2024-06-04 | Kt Corporation | Method and apparatus for encoding/decoding residual data based on a plurality of transformations |
Also Published As
Publication number | Publication date |
---|---|
US20130215960A1 (en) | 2013-08-22 |
US9538178B2 (en) | 2017-01-03 |
KR20120009693A (ko) | 2012-02-02 |
KR101663762B1 (ko) | 2016-10-07 |
WO2012011714A3 (ko) | 2012-05-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2012011714A2 (ko) | 다중 예측 필터를 이용하는 경쟁기반 인트라 예측 부호화/복호화 장치 및 방법 | |
RU2686626C1 (ru) | Способ и устройство для энтропийного кодирования/декодирования коэффициента преобразования | |
WO2013002549A2 (ko) | 영상 부호화/복호화 방법 및 장치 | |
KR101375668B1 (ko) | 변환 계수의 부호화, 복호화 방법 및 장치 | |
CN104221373B (zh) | 用于采样自适应偏移代码化和/或信号通知的设备和方法 | |
WO2009113791A2 (ko) | 영상 부호화장치 및 영상 복호화장치 | |
WO2013070006A1 (ko) | 스킵모드를 이용한 동영상 부호화 및 복호화 방법 및 장치 | |
WO2011145836A2 (ko) | 인트라 블록 및 인터 블록이 혼합된 코딩블록을 이용하는 영상 부호화/복호화 장치 및 그 방법 | |
WO2011096662A2 (ko) | 율-왜곡 최적화를 위한 영상 부호화/복호화 방법 및 이를 수행하는 장치 | |
WO2011155714A2 (ko) | 엣지-적응 변환을 이용한 영상 부호화/복호화 시스템 및 방법 | |
WO2011021844A2 (ko) | 가변 길이 부호를 이용한 인트라 예측모드 부호화 방법과 장치, 및 이를 위한기록 매체 | |
WO2010095915A2 (ko) | 비디오 부호화에서의 분할 블록 부호화 방법, 비디오 복호화에서의 분할 블록 복호화 방법 및 이를 구현하는 기록매체 | |
US9497461B2 (en) | Method and apparatus for encoding frequency transformed block using frequency mask table, and method and apparatus for encoding/decoding video using same | |
CN105007497A (zh) | 用于编码视频的方法 | |
KR20110017300A (ko) | 큰 크기의 변환 단위를 이용한 영상 부호화, 복호화 방법 및 장치 | |
KR20110083368A (ko) | 큰 크기의 변환 단위를 이용한 영상 부호화, 복호화 방법 및 장치 | |
WO2011037337A2 (ko) | 저주파수 성분을 고려한 영상 부호화/복호화 방법 및 장치 | |
WO2013002550A2 (ko) | 고속 코딩 단위(Coding Unit) 모드 결정을 통한 부호화/복호화 방법 및 장치 | |
WO2012021040A2 (ko) | 필터링모드 생략가능한 영상 부호화/복호화 방법 및 장치 | |
WO2011052990A2 (ko) | 적응적인 해상도 기반의 영상 부호화/복호화 방법 및 장치 | |
WO2012011779A2 (ko) | 전 방위 기반의 인트라 예측 부호화/복호화 장치 및 방법 | |
KR20100004038A (ko) | 비트 위치에 기초한 영상 분리를 이용한 영상 부호화, 복호화 방법 및 장치 | |
GB2308768A (en) | Video encoding based on inter block redundancy | |
WO2010047492A2 (ko) | 동영상 부호화 장치 및 이를 위한 영상 신호의 2차원 정렬 변환 장치 및 방법, 및 이를 위한 기록 매체 | |
WO2012091517A2 (ko) | 적응적 스캔 장치 및 그 스캔 방법 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11809841 Country of ref document: EP Kind code of ref document: A2 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13811603 Country of ref document: US |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 03/05/13) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 11809841 Country of ref document: EP Kind code of ref document: A2 |