WO2009104925A2 - 영상 복구를 이용한 인터 예측 부호화, 복호화 방법 및 장치 - Google Patents
영상 복구를 이용한 인터 예측 부호화, 복호화 방법 및 장치 Download PDFInfo
- Publication number
- WO2009104925A2 WO2009104925A2 PCT/KR2009/000822 KR2009000822W WO2009104925A2 WO 2009104925 A2 WO2009104925 A2 WO 2009104925A2 KR 2009000822 W KR2009000822 W KR 2009000822W WO 2009104925 A2 WO2009104925 A2 WO 2009104925A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- current block
- boundary
- block
- current
- image
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/109—Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Definitions
- the present invention relates to a method and apparatus for inter prediction encoding and decoding, and more particularly, to a method and apparatus for generating a prediction block by performing inter prediction more accurately and encoding and decoding a current block based on the generated prediction block.
- one picture is divided into blocks having a predetermined size to encode an image. Then, each block is encoded using inter prediction or intra prediction. In consideration of the R-D cost, an optimal encoding mode is selected, and a block is encoded according to the selected encoding mode.
- An image encoding method using inter prediction is a method of compressing an image by removing temporal redundancy among pictures
- motion estimation encoding is a typical example.
- Motion estimation encoding is a method of encoding an image by estimating and compensating for the motion of a current picture in units of blocks by using at least one reference picture.
- the reference block most similar to the current block is searched in a given search range of the reference picture using a predetermined evaluation function. If a similar block is found, only the residual block, which is the difference between the current block and the similar block in the reference picture, is encoded.
- the current block may be a block of various sizes such as 16 ⁇ 16, 8 ⁇ 16, 8 ⁇ 8, and 4 ⁇ 4. This will be described in detail with reference to FIG. 1.
- inter prediction in encoding and decoding an image is performed by referring to at least one reference picture.
- the image encoding apparatus searches the reference picture 120 to search for a reference block 122 that is most similar to the current block 112.
- the reference block 122 is a block that can best predict the current block.
- the block having the smallest sum of absolute difference (SAD) with the current block 112 may be the reference block 122.
- the reference block 122 becomes a prediction block of the current block 112 and generates a residual block by subtracting the reference block 122 from the current block 112. Only the generated residual block is encoded and inserted into the bitstream.
- the relative difference between the position of the current block 112 in the current picture 110 and the position of the reference block 122 in the reference picture 120 is called a motion vector 130, and the motion vector 130 is also resent. It is coded like a dual block.
- the compression rate of the image encoding is improved as the current block 112 is more accurately predicted.
- FIG. 2 illustrates an image encoding apparatus using inter prediction according to an embodiment of the present invention.
- FIG 3 illustrates a boundary between a current block and a previously coded region of a current picture according to an embodiment of the present invention.
- FIG. 4A to 4E illustrate an image restoration method according to an embodiment of the present invention in chronological order.
- 5A through 5D illustrate inter prediction of a macro block according to an embodiment of the present invention.
- FIG. 6 is a flowchart illustrating an image encoding method according to an embodiment of the present invention.
- FIG 7 illustrates an image decoding apparatus according to an embodiment of the present invention.
- FIG. 8 is a flowchart illustrating an image decoding method according to an embodiment of the present invention.
- an inter prediction capable of generating a prediction block by inter prediction of the current block more accurately using image recovery, and encoding and decoding the current block based on the generated prediction block.
- a method and apparatus for predictive encoding and decoding are provided, and a computer readable recording medium having recorded thereon a program for executing the method.
- the current block in performing inter prediction, can be predicted more accurately by using image recovery, thereby improving the compression rate of image encoding.
- the inter prediction encoding method according to the present invention for solving the technical problem is to search for at least one reference picture using pixels included in the encoded region adjacent to the boundary between the current block and the previously encoded region of the current picture. Performing image inpainting; Generating a prediction block of the current block based on the recovery result; And encoding the current block based on the prediction block.
- encoding the current block includes encoding the current block in a skip mode.
- the performing of the image recovery comprises using at least one pixel included in the encoded region adjacent to a boundary between the current block and a previously encoded region of the current picture. Searching for a reference picture and performing sample-based image inpainting.
- an inter prediction encoding apparatus searches for at least one reference picture by using pixels included in the encoded region adjacent to a boundary between a current block and a previously encoded region of a current picture.
- An inter prediction decoding method for solving the above technical problem uses at least one reference by using pixels included in the previously decoded region adjacent to a boundary between the current block and a previously decoded region of the current picture. Searching for a picture to perform image inpainting; Generating a prediction block of the current block based on the image recovery result; And reconstructing the current block based on the prediction block.
- the step of restoring comprises the step of restoring the current block to a skip mode.
- the performing of the image recovery comprises using at least one pixel included in the decoded region adjacent to a boundary between the current block and a previously decoded region of the current picture. Searching for a reference picture and performing sample-based image inpainting.
- An inter prediction decoding apparatus for solving the technical problem uses at least one reference by using pixels included in the previously decoded region adjacent to a boundary between the current block and a previously decoded region of the current picture.
- An image recovery unit for retrieving a picture and performing image inpainting;
- a prediction unit generating a prediction block of the current block based on the image recovery result;
- a reconstruction unit reconstructing the current block based on the prediction block.
- the present invention provides a computer-readable recording medium having recorded thereon a program for executing the above-described inter prediction encoding and decoding method.
- FIG. 2 illustrates an image encoding apparatus using inter prediction according to an embodiment of the present invention.
- the image encoding apparatus 200 includes an inter prediction unit 210, an encoding unit 220, and a reconstruction unit 230.
- the inter prediction unit 210 inter-predicts the current block to remove temporal redundancy between pictures to generate a prediction block of the current block.
- the inter prediction unit 210 according to the present invention provides a new inter prediction mode different from the inter prediction method described above with reference to FIG. 1.
- the inter prediction unit 210 includes an image recovery unit 212 and a prediction unit 214. This will be described in detail with reference to FIG. 3.
- FIG 3 illustrates a boundary between a current block and a previously coded region of a current picture according to an embodiment of the present invention.
- the image recovery unit 212 performs image recovery using pixels 340 adjacent to a boundary between the current block 330 and the previously encoded region 310 of the current picture 300. Image retrieval is performed by searching for at least one reference picture based on the pixels 340 adjacent to the boundary.
- the image reconstruction according to the present invention is not 8 ⁇ 8, but blocks of various sizes such as 4 ⁇ 4, 8 ⁇ 16, 16 ⁇ 8, and 16 ⁇ 16. It can be easily seen that it can be used to predict.
- sample-based image inpainting may be performed as a method of image restoration, which will be described in detail with reference to FIGS. 4A to 4E.
- FIG. 4A through 4E illustrate an image restoration method in chronological order.
- pixels 340 included in a previously encoded region among pixels adjacent to a boundary between the current block 330 and a previously encoded region 310 to predict the current block 330. Perform sample-based image recovery based on
- the pixel 410 having the highest recovery priority is selected from the pixels 340 adjacent to the boundary of the current block 330 and the previously encoded region 310 set as the initial boundary of the region to be recovered.
- the recovery priority may be determined based on an angle between the boundary of the recovery area and the edge direction.
- An edge direction in each of the pixels 340 adjacent to the boundary is calculated and a recovery priority is determined based on the angle between the calculated edge direction and the boundary of the recovery region. The larger the angle between the boundary of the region to be recovered and the edge direction, the higher the priority of the recovery.
- a patch 420 including a selected pixel 410 and pixels adjacent to the selected pixel is set as shown in FIG. 4B.
- the patch 420 may perform image restoration using patches of various sizes such as 3 ⁇ 3, 5 ⁇ 5, and 7 ⁇ 7 as units for performing image restoration.
- 3 ⁇ 3 patch a case of using a 3 ⁇ 3 patch will be described as an example.
- At least one reference is made by using the pixels 422 included in a previously encoded region among the pixels included in the patch 420. retrieve the picture. Among the pixels included in the patch 420, the pixels having the smallest sum of absolute difference (SAD) from the pixels 422 included in the previously encoded region are searched for in the at least one reference picture. The patch of the reference picture containing the retrieved pixel is determined as the patch most similar to the patch 420 shown in FIG. 4B.
- SAD sum of absolute difference
- the pixel values of the remaining pixels except for the smallest SAD with the pixels 422 included in the previously encoded region among the similar patches are copied to the remaining pixels 424 of the patch 420. By doing this, part of the current block is recovered.
- the pixel values of the pixels 424 included in the rightmost column among the pixel values included in the patch are the pixel values recovered by the first patch 420.
- the boundary of the region to be recovered is updated based on the recovered pixels 424 as shown in FIG. 5C. Then, the pixel 430 having the highest recovery priority at the updated boundary is selected again.
- the reset patch 440 includes the pixels 442 included in the previously encoded region, the pixels 444 included in the previously recovered region, and the pixels 446 that need to be recovered using the current patch 440. It includes.
- the patch 440 may be searched by using the pixels 442 included in the previously encoded region and the pixels 444 included in the previously recovered region to search for at least one reference picture. Determine the patch that is most similar to According to the search result, the pixel values of the pixels 446 included in the remaining area of the patch 440 are recovered.
- the boundary of the region to be restored is updated again as shown in FIG. 5E.
- the image recovery is repeated until all pixels included in the current block 330 are restored.
- the number of patches to increase the number of pixels that are recovered in a single recovery.
- the number of reference pictures that perform the search using pixels included in the previously encoded region and the previously recovered region of the set patch 420 or 440 may be reduced, or the range of the search within the reference picture may be limited. have.
- the prediction unit 214 predicts the current block based on the recovery result of the image recovery unit 212. do.
- the block recovered by the image recovery unit 212 may be the prediction block of the current block.
- the encoder 220 encodes the current block by using the prediction block generated as a result of the prediction of the inter predictor 210. Discrete cosine transforms the residual block to generate discrete cosine coefficients and quantizes the generated discrete cosine coefficients. The quantized discrete cosine coefficients are entropy coded and inserted into the bitstream.
- the encoder 220 may encode the skip mode.
- the skip mode refers to an encoding mode in which only the information about the encoding mode indicating that the current block 330 is encoded in the skip mode is encoded without encoding the residual block of the current block 330. If the encoder 220 determines that it is desirable to encode the current block in the skip mode as a result of calculating the rate-distortion cost, the encoder 220 encodes the current block in the skip mode.
- the reconstructor 340 reconstructs the quantized discrete cosine coefficients into inverse quantization and inverse discrete cosine transform into residual blocks.
- the reconstructed residual block is added back to the prediction block generated by the prediction unit 314 and reconstructed into the current block 440.
- the reconstructed current block 440 is used for prediction of another block.
- the prediction block generated by the prediction unit 314 is used for prediction of another block as it is.
- 5A through 5D illustrate inter prediction of a macro block according to an embodiment of the present invention.
- 5A to 5D illustrate an initial recovery region boundary used for image recovery of each subblock when image recovery is performed to inter-predict subblocks included in a macroblock.
- a block 510 in the upper left part of the first subblocks included in the macroblock 500 is pixels adjacent to a boundary between the macroblock 500 and a previously encoded region of the current picture.
- Image reconstruction is performed using the pixels 512 included in the previously encoded region.
- the boundary between the macro block 500 and the previously encoded region of the current picture becomes the initial boundary of the recovery region in order to inter predict the block 510 of the upper left.
- the boundary between the encoded region and the unencoded region of the current picture becomes as shown in FIG. 5B. Therefore, the second coded block 520 of the sub-blocks included in the macroblock 500 is a boundary between the first coded block 510 and the second coded block 520 of the macroblock 500. And image reconstruction using pixels 522 adjacent to a boundary between a previously coded region of the current picture and the second coded block 520.
- the boundary between the encoded region and the unencoded region of the current picture is changed as shown in FIGS. 5C and 5D as the subblocks 520, 530, and 540 are sequentially encoded.
- the inter prediction encoding apparatus 200 performs image recovery based on pixels 522, 532, and 542 adjacent to a changed boundary to inter-predict each of the sub blocks 520, 530, and 540. .
- FIG. 6 is a flowchart illustrating an image encoding method according to an embodiment of the present invention.
- the image encoding apparatus 200 searches for at least one reference picture using pixels adjacent to a boundary between a current block and a previously encoded region of the current picture to perform image recovery. Perform.
- the boundary between the current block and the previously encoded region of the current picture is set as the initial boundary of the region to be recovered, and the sample-based image restoration described above with respect to FIGS. 4A to 4E is performed.
- the image encoding apparatus 200 In operation 620, the image encoding apparatus 200 generates a prediction block of the current block based on the image recovery result in operation 610. As a result of performing sample-based image recovery in step 610, a prediction block of the current block is generated based on the restored block.
- the image encoding apparatus 200 encodes a current block based on the prediction block generated in operation 620.
- the prediction block is subtracted from the current block to generate a residual block for the current block.
- the current block may be encoded in a skip mode.
- the current block is encoded in a skip mode in which only the information on the encoding mode indicating that the current block is encoded in the skip mode is encoded without encoding the residual block.
- FIG 7 illustrates an image decoding apparatus according to an embodiment of the present invention.
- the image decoding apparatus 700 includes a decoder 710, an inter prediction unit 720, and a reconstruction unit 730.
- the decoder 710 decodes the bitstream for the current block. Receive a bitstream for the current block and entropy decode the received data. Inverse quantization of the quantized discrete cosine coefficients of the residual block generated as a result of entropy decoding. Then, the inverse quantized discrete cosine coefficients are inverse discrete cosine transformed to decode the residual block.
- the decoder 710 extracts information about an encoding mode indicating that the current block is encoded by the skip mode from the bitstream of the current block.
- the inter prediction unit 720 generates the prediction block of the current block by performing inter prediction according to the inter prediction method using image recovery according to the intra prediction unit 210 of the image encoding apparatus 200.
- a predictive block of the current block is generated by performing image recovery by searching for at least one reference picture using pixels included in the decoded region among pixels adjacent to the boundary between the current block and the previously encoded region of the current picture. .
- the inter prediction unit 720 includes an image recovery unit 722 and a prediction unit 724.
- the image recovery unit 722 searches for at least one reference picture using pixels adjacent to a boundary between the current block and a previously encoded region of the current picture to perform image recovery.
- the image restoration is performed by performing sample-based image inpainting.
- the boundary between the current block and the previously decoded region of the current picture is set as the first boundary of the region to be recovered, and image recovery in a patch unit is repeated to recover all the current blocks. do.
- the prediction unit 724 generates a prediction block of the current block based on the prediction result of the image recovery unit 922.
- the reconstruction unit 730 reconstructs the current block based on the prediction block generated as a result of the inter prediction of the inter prediction unit 720.
- the residual block decoded by the decoder 710 and the prediction block generated by the inter predictor 720 are added to reconstruct the current block. If the current block is a block encoded according to the skip mode, the current block is reconstructed in the skip mode. In this case, the predicted block generated by the inter prediction unit 720 becomes the current block as it is. 720 is used for prediction of another block.
- FIG. 8 is a flowchart illustrating an image decoding method according to an embodiment of the present invention.
- the image decoding apparatus searches for at least one reference picture based on pixels included in a previously decoded region adjacent to a boundary between a current block and a previously decoded region of the current picture. Perform image recovery.
- sample-based image reconstruction is performed based on pixels adjacent to a boundary between the current block and a previously coded region of the current picture.
- the inter prediction method described above with respect to image encoding is also symmetrically applied to image decoding.
- the image decoding apparatus In operation 820, the image decoding apparatus generates a prediction block of the current block based on the image recovery result in operation 810. After the boundary between the current block and the previously encoded region of the current picture is set as the initial boundary of the recovery, a block generated by repeating the image recovery in units of patches becomes a prediction block of the current block.
- the image decoding apparatus restores the current block based on the prediction block generated in operation 820.
- the current block is reconstructed by adding the residual block generated as a result of decoding the bitstream for the current block and the prediction block generated in step 820.
- the prediction block generated in step 820 becomes the current block as it is.
- Examples of the recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and also include a carrier wave (for example, transmission through the Internet).
- the computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims (18)
- 【청구항 1】인터 예측 부호화 방법에 있어서,현재 블록과 현재 픽처의 이전에 부호화된 영역 사이의 경계에 인접한 상기 부호화된 영역에 포함되어 있는 픽셀들을 이용해 적어도 하나의 참조 픽처를 검색하여 영상 복구(image inpainting)를 수행하는 단계;상기 복구 결과에 기초하여 상기 현재 블록의 예측 블록을 생성하는 단계; 및상기 예측 블록에 기초해 상기 현재 블록을 부호화하는 단계를 포함하는 것을 특징으로 하는 인터 예측 부호화 방법.
- 【청구항 2】제 1 항에 있어서, 상기 현재 블록을 부호화하는 단계는상기 현재 블록을 스킵(skip) 모드로 부호화하는 단계를 포함하는 것을 특징으로 하는 인터 예측 부호화 방법.
- 【청구항 3】제 1 항에 있어서, 상기 영상 복구를 수행하는 단계는상기 현재 블록과 현재 픽처의 이전에 부호화된 영역 사이의 경계에 인접한 상기 부호화된 영역에 포함되어 있는 픽셀들을 이용해 적어도 하나의 참조 픽처를 검색하여 표본 기반 영상 복구(exemplar-based image inpainting)을 수행하는 단계를 포함하는 것을 특징으로 하는 인터 예측 부호화 방법.
- 【청구항 4】제 3 항에 있어서, 상기 표본 기반 영상 복구를 수행하는 단계는a) 상기 현재 블록과 현재 픽처의 이전에 부호화된 영역 사이의 경계를 복구될 영역의 경계로 설정하는 단계;b) 상기 복구 경계에 인접한 픽셀들 중 가장 높은 복구 우선 순위를 가지는 픽셀을 선택하는 단계;c) 상기 선택된 픽셀을 포함하는 패치(patch)와 유사한 패치를 상기 적어도 하나의 참조 픽처에서 검색하는 단계;d) 상기 검색 결과에 기초하여 상기 현재 블록의 일부를 복구하는 단계;e) 상기 d) 단계에서의 복구 결과에 기초하여 복구될 영역의 경계를 갱신하는 단계; 및f) 상기 현재 블록이 복구될 때까지 상기 b) 내지 e) 단계를 반복하는 단계를 포함하는 것을 특징으로 하는 인터 예측 부호화 방법.
- 【청구항 5】제 4 항에 있어서,상기 패치는 3×3 또는 5×5 또는 7×7 크기의 패치인 것을 특징으로 하는 인터 예측 부호화 방법.
- 【청구항 6】인터 예측 부호화 장치에 있어서,현재 블록과 현재 픽처의 이전에 부호화된 영역 사이의 경계에 인접한 상기 부호화된 영역에 포함되어 있는 픽셀들을 이용해 적어도 하나의 참조 픽처를 검색하여 영상 복구(image inpainting)를 수행하는 영상복구부;상기 복구 결과에 기초하여 상기 현재 블록의 예측 블록을 생성하는 예측부; 및상기 예측 블록에 기초해 상기 현재 블록을 부호화하는 부호화부를 포함하는 것을 특징으로 하는 인터 예측 부호화 장치.
- 【청구항 7】제 6 항에 있어서, 상기 부호화부는상기 현재 블록을 스킵(skip) 모드로 부호화하는 것을 특징으로 하는 인터 예측 부호화 장치.
- 【청구항 8】제 6 항에 있어서, 상기 영상복구부는상기 현재 블록과 현재 픽처의 이전에 부호화된 영역 사이의 경계에 인접한 이전에 부호화된 영역에 포함된 픽셀들을 이용해 적어도 하나의 참조 픽처를 검색하여 표본 기반 영상 복구(exemplar-based image inpainting)를 수행하는 것을 특징으로 하는 인터 예측 부호화 장치.
- 【청구항 9】인터 예측 복호화 방법에 있어서,상기 현재 블록과 현재 픽처의 이전에 복호화된 영역 사이의 경계에 인접한 상기 이전에 복호화된 영역에 포함되어 있는 픽셀들을 이용해 적어도 하나의 참조 픽처를 검색하여 영상 복구(image inpainting)를 수행하는 단계;상기 영상 복구 결과에 기초하여 상기 현재 블록의 예측 블록을 생성하는 단계; 및상기 예측 블록에 기초하여 상기 현재 블록을 복원하는 단계를 포함하는 것을 특징으로 하는 인터 예측 복호화 방법.
- 【청구항 10】제 9 항에 있어서, 상기 복원하는 단계는상기 현재 블록을 스킵(skip) 모드로 복원하는 것을 특징으로 하는 인터 예측 복호화 방법.
- 【청구항 11】제 9 항에 있어서, 상기 영상 복구를 수행하는 단계는상기 현재 블록과 현재 픽처의 이전에 복호화된 영역 사이의 경계에 인접한 상기 복호화된 영역에 포함되어 있는 픽셀들을 이용해 적어도 하나의 참조 픽처를 검색하여 표본 기반 영상 복구(exemplar-based image inpainting)을 수행하는 단계를 포함하는 것을 특징으로 하는 인터 예측 복호화 방법.
- 【청구항 12】제 11 항에 있어서, 상기 표본 기반 영상 복구를 수행하는 단계는a) 상기 현재 블록과 현재 픽처의 이전에 복호화된 영역 사이의 경계를 복구될 영역의 경계로 설정하는 단계;b) 상기 복구될 영역의 경계에 인접한 픽셀들 중 가장 높은 복구 우선 순위를 가지는 픽셀을 선택하는 단계;c) 상기 선택된 픽셀을 포함하는 패치(patch)와 유사한 패치를 상기 적어도 하나의 참조 픽처에서 검색하는 단계;d) 상기 검색 결과에 기초하여 상기 현재 블록의 일부를 복구하는 단계;e) 상기 d) 단계에서의 복구 결과에 기초하여 복구될 영역의 경계를 갱신하는 단계; 및f) 상기 현재 블록이 복구될 때까지 상기 b) 내지 e) 단계를 반복하는 단계를 포함하는 것을 특징으로 하는 인터 예측 복호화 방법.
- 【청구항 13】제 12 항에 있어서,상기 패치는 3×3 또는 5×5 또는 7×7 크기의 패치인 것을 특징으로 하는 인터 예측 복호화 방법.
- 【청구항 14】인터 예측 복호화 장치에 있어서,상기 현재 블록과 현재 픽처의 이전에 복호화된 영역 사이의 경계에 인접한 상기 이전에 복호화된 영역에 포함되어 있는 픽셀들을 이용해 적어도 하나의 참조 픽처를 검색하여 영상 복구(image inpainting)를 수행하는 영상복구부;상기 영상 복구 결과에 기초하여 상기 현재 블록의 예측 블록을 생성하는 예측부; 및상기 예측 블록에 기초하여 상기 현재 블록을 복원하는 복원부를 포함하는 것을 특징으로 하는 인터 예측 복호화 장치.
- 【청구항 15】제 14 항에 있어서, 상기 복원부는상기 현재 블록을 스킵(skip) 모드로 복원화하는 것을 특징으로 하는 인터 예측 복호화 장치.
- 【청구항 16】제 14 항에 있어서, 상기 영상복구부는상기 현재 블록과 현재 픽처의 이전에 복호화된 영역 사이의 경계에 인접한 이전에 복호화된 영역에 포함된 픽셀들을 이용해 적어도 하나의 참조 픽처를 검색하여 표본 기반 영상 복구(exemplar-based image inpainting)를 수행하는 것을 특징으로 하는 인터 예측 복호화 장치.
- 【청구항 17】제 1 항의 방법을 실행시키기 위한 프로그램을 기록한 컴퓨터로 읽을 수 있는 기록 매체.
- 【청구항 18】제 9 항의 방법을 실행시키기 위한 프로그램을 기록한 컴퓨터로 읽을 수 있는 기록 매체.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2009801058952A CN101946517B (zh) | 2008-02-20 | 2009-02-20 | 利用图像修复的帧间预测编码/解码方法及装置 |
US12/918,688 US20100329336A1 (en) | 2008-02-20 | 2009-02-20 | Method and apparatus for encoding and decoding based on inter prediction using image inpainting |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020080015451A KR101446773B1 (ko) | 2008-02-20 | 2008-02-20 | 영상 복구를 이용한 인터 예측 부호화, 복호화 방법 및장치 |
KR10-2008-0015451 | 2008-02-20 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2009104925A2 true WO2009104925A2 (ko) | 2009-08-27 |
WO2009104925A3 WO2009104925A3 (ko) | 2009-10-22 |
Family
ID=40986065
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2009/000822 WO2009104925A2 (ko) | 2008-02-20 | 2009-02-20 | 영상 복구를 이용한 인터 예측 부호화, 복호화 방법 및 장치 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20100329336A1 (ko) |
KR (1) | KR101446773B1 (ko) |
CN (1) | CN101946517B (ko) |
WO (1) | WO2009104925A2 (ko) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9571851B2 (en) | 2009-09-25 | 2017-02-14 | Sk Telecom Co., Ltd. | Inter prediction method and apparatus using adjacent pixels, and image encoding/decoding method and apparatus using same |
CN107105290B (zh) * | 2010-12-13 | 2020-05-12 | 韩国电子通信研究院 | 基于帧间预测对视频信号进行解码的方法 |
US9451288B2 (en) | 2012-06-08 | 2016-09-20 | Apple Inc. | Inferred key frames for fast initiation of video coding sessions |
US9883137B2 (en) * | 2015-11-03 | 2018-01-30 | Qualcomm Incorporated | Updating regions for display based on video decoding mode |
CN115037949A (zh) * | 2016-05-27 | 2022-09-09 | 松下电器(美国)知识产权公司 | 编码方法、解码方法、及编码和解码方法 |
CN116170585A (zh) * | 2017-01-16 | 2023-05-26 | 世宗大学校产学协力团 | 影像编码/解码方法 |
KR20220047141A (ko) * | 2020-10-08 | 2022-04-15 | 에스케이텔레콤 주식회사 | 영상복원 방법 및 장치 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR960028438A (ko) * | 1994-12-14 | 1996-07-22 | 배순훈 | 대역분할 부호화장치에서의 움직임 추정방법 |
KR19980068227A (ko) * | 1997-02-17 | 1998-10-15 | 김영환 | 영상정보 부호화시 물체경계 블록 합병후 합병된 블록내의 픽셀값을 부호화하는 방법 |
KR19990033496A (ko) * | 1997-10-24 | 1999-05-15 | 윤종용 | 움직임 보상된 형상정보 부호화/복호화 방법및 장치 |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07250328A (ja) * | 1994-01-21 | 1995-09-26 | Mitsubishi Electric Corp | 動きベクトル検出装置 |
TW444507B (en) * | 1998-10-22 | 2001-07-01 | Sony Corp | Detecting method and device for motion vector |
ES2610430T3 (es) * | 2001-12-17 | 2017-04-27 | Microsoft Technology Licensing, Llc | Codificación por omisión de macrobloques |
US6987520B2 (en) * | 2003-02-24 | 2006-01-17 | Microsoft Corporation | Image region filling by exemplar-based inpainting |
US7088870B2 (en) * | 2003-02-24 | 2006-08-08 | Microsoft Corporation | Image region filling by example-based tiling |
JP4534723B2 (ja) * | 2004-11-05 | 2010-09-01 | 株式会社日立製作所 | 画像表示装置、画像処理装置および画像処理方法 |
US20060233454A1 (en) * | 2005-04-15 | 2006-10-19 | Hu Cheng | Method for image intensity correction using extrapolation and adaptive smoothing |
CN100458846C (zh) * | 2005-07-14 | 2009-02-04 | 北京航空航天大学 | 一种图像修复方法 |
KR100727972B1 (ko) * | 2005-09-06 | 2007-06-14 | 삼성전자주식회사 | 영상의 인트라 예측 부호화, 복호화 방법 및 장치 |
US8170102B2 (en) * | 2005-12-19 | 2012-05-01 | Seiko Epson Corporation | Macroblock homogeneity analysis and inter mode prediction |
US8275049B2 (en) * | 2006-06-16 | 2012-09-25 | Via Technologies, Inc. | Systems and methods of improved motion estimation using a graphics processing unit |
-
2008
- 2008-02-20 KR KR1020080015451A patent/KR101446773B1/ko not_active IP Right Cessation
-
2009
- 2009-02-20 CN CN2009801058952A patent/CN101946517B/zh not_active Expired - Fee Related
- 2009-02-20 US US12/918,688 patent/US20100329336A1/en not_active Abandoned
- 2009-02-20 WO PCT/KR2009/000822 patent/WO2009104925A2/ko active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR960028438A (ko) * | 1994-12-14 | 1996-07-22 | 배순훈 | 대역분할 부호화장치에서의 움직임 추정방법 |
KR19980068227A (ko) * | 1997-02-17 | 1998-10-15 | 김영환 | 영상정보 부호화시 물체경계 블록 합병후 합병된 블록내의 픽셀값을 부호화하는 방법 |
KR19990033496A (ko) * | 1997-10-24 | 1999-05-15 | 윤종용 | 움직임 보상된 형상정보 부호화/복호화 방법및 장치 |
Also Published As
Publication number | Publication date |
---|---|
KR20090090151A (ko) | 2009-08-25 |
CN101946517B (zh) | 2013-02-13 |
CN101946517A (zh) | 2011-01-12 |
US20100329336A1 (en) | 2010-12-30 |
KR101446773B1 (ko) | 2014-10-02 |
WO2009104925A3 (ko) | 2009-10-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2009104925A2 (ko) | 영상 복구를 이용한 인터 예측 부호화, 복호화 방법 및 장치 | |
WO2009110754A2 (en) | Method and apparatus for encoding and decoding image | |
WO2011068331A2 (ko) | 비디오 인코딩 장치 및 그 인코딩 방법, 비디오 디코딩 장치 및 그 디코딩 방법, 및 거기에 이용되는 방향적 인트라 예측방법 | |
WO2009110741A2 (en) | Method and apparatus for encoding and decoding image by using filtered prediction block | |
JP3072035B2 (ja) | 2ステージビデオフィルム圧縮方法及びシステム | |
JP4077135B2 (ja) | コンテクストベースでフレーム内コーディングモードとフレーム間コーディングモードとの間の選択を行なうための方法および装置 | |
WO2010050706A2 (ko) | 움직임 벡터 부호화 방법 및 장치와 그를 이용한 영상 부호화/복호화 방법 및 장치 | |
WO2013002549A2 (ko) | 영상 부호화/복호화 방법 및 장치 | |
WO2010002122A2 (en) | Method and apparatus for encoding and decoding image using image separation based on bit location | |
WO2013069996A1 (ko) | 변환을 이용한 주파수 도메인 상의 적응적 루프 필터를 이용한 영상 부호화/복호화 방법 및 장치 | |
KR20050053470A (ko) | 스케일러블 비디오 코딩 및 디코딩 방법, 이를 위한 장치 | |
WO2013062198A1 (ko) | 영상 복호화 장치 | |
WO2011037337A2 (ko) | 저주파수 성분을 고려한 영상 부호화/복호화 방법 및 장치 | |
WO2011108879A2 (ko) | 영상 부호화 장치, 그 영상 부호화 방법, 영상 복호화 장치 및 그 영상 복호화 방법 | |
WO2009104914A2 (ko) | 영상의 부호화, 복호화 방법 및 장치 | |
WO2013062194A1 (ko) | 복원 블록을 생성하는 방법 및 장치 | |
WO2009136692A2 (en) | Method and apparatus for encoding and decoding an image based on plurality of reference pictures | |
KR20050026318A (ko) | 인트라 스킵 모드를 포함하는 비디오 인코딩_디코딩 장치및 방법 | |
WO2011068332A2 (ko) | 공간적 예측장치 및 그 예측방법, 그것을 이용한 영상 부호화 장치 및 방법, 및 영상 복호화 장치 및 방법 | |
WO2010002148A2 (ko) | 영상 부호화 및 복호화 장치 및, 방법 | |
JP3415319B2 (ja) | 動画像符号化装置及び動画像符号化方法 | |
KR100928325B1 (ko) | 영상의 부호화, 복호화 방법 및 장치 | |
WO2011025301A2 (ko) | 동영상 부호화를 위한 움직임 벡터 부호화/복호화 방법 및 장치와 그를 이용한 영상 부호화/복호화 방법 및 장치 | |
JP3262761B2 (ja) | エラー許容モードビデオコデック方法及びその装置 | |
WO2010044566A2 (ko) | 동영상 부호화/복호화 장치 및 그를 위한 하이브리드 블록 움직임 보상/중첩 블록 움직임 보상 방법 및 장치 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200980105895.2 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09711965 Country of ref document: EP Kind code of ref document: A2 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12918688 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 09711965 Country of ref document: EP Kind code of ref document: A2 |