TWI521970B - Video decoding method - Google Patents
Video decoding method Download PDFInfo
- Publication number
- TWI521970B TWI521970B TW101123236A TW101123236A TWI521970B TW I521970 B TWI521970 B TW I521970B TW 101123236 A TW101123236 A TW 101123236A TW 101123236 A TW101123236 A TW 101123236A TW I521970 B TWI521970 B TW I521970B
- Authority
- TW
- Taiwan
- Prior art keywords
- offset
- unit
- coding unit
- block
- pixel
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 35
- 238000005192 partition Methods 0.000 description 158
- 238000006243 chemical reaction Methods 0.000 description 156
- 238000010586 diagram Methods 0.000 description 28
- 241000023320 Luma <angiosperm> Species 0.000 description 17
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 17
- 230000011218 segmentation Effects 0.000 description 17
- 239000000284 extract Substances 0.000 description 7
- 238000001914 filtration Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 238000013500 data storage Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 208000028167 Southeast Asian ovalocytosis Diseases 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 238000013139 quantization Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 230000003362 replicative effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/463—Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
- G06V10/422—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation for representing the structure of the pattern or shape of an object therefor
- G06V10/424—Syntactic representation, e.g. by using alphabets or grammars
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
- G06V10/435—Computation of moments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
- G06V10/7515—Shifting the patterns to accommodate for positional errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/98—Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
- G06V10/993—Evaluation of the quality of the acquired pattern
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/1883—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit relating to sub-band structure, e.g. hierarchical level, directional tree, e.g. low-high [LH], high-low [HL], high-high [HH]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/58—Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/625—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- Discrete Mathematics (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Databases & Information Systems (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Description
本發明是關於經執行以將原始影像與所復原之影像之間的誤差減至最小的視訊編碼方法與裝置以及視訊解碼方法與裝置。 The present invention relates to a video encoding method and apparatus and video decoding method and apparatus that are executed to minimize errors between an original image and a restored image.
隨著用於再生以及儲存高解析度或高品質視訊內容之硬體正被開發以及供應,對用於有效地對高解析度或高品質視訊內容進行編碼或解碼之視訊編解碼器的需要增加。在習知視訊編解碼器中,視訊是基於具有預定大小之巨集區塊根據有限編碼方法(limited encoding method)而編碼。 As hardware for reproducing and storing high-resolution or high-quality video content is being developed and supplied, the need for video codecs for efficiently encoding or decoding high-resolution or high-quality video content is increasing. . In conventional video codecs, video is encoded based on a limited encoding method based on a macroblock having a predetermined size.
藉由使用頻率轉換,將空間域之影像資料轉換為頻域之係數。視訊編解碼器將影像分割為具有預定大小之區塊,對每一區塊執行離散餘弦轉換(discrete cosine transformation;DCT)轉換,且以區塊為單位來對頻率係數進行編碼,以執行頻率轉換之快速算術運算。相比於空間域之影像資料,頻域之係數為易壓縮類型。特定言之,空間域之影像畫素值經由視訊編解碼器之畫面間預測(inter prediction)或畫面內預測(intra prediction)而表達為預測誤差,且因此,若對預測誤差執行頻率轉換,則資料可轉換為0。視訊編解碼器以具有大小較小之資料替代連續並重複出現之資料,藉此減少資料量。 The image data in the spatial domain is converted into coefficients in the frequency domain by using frequency conversion. The video codec divides the image into blocks of a predetermined size, performs discrete cosine transformation (DCT) conversion on each block, and encodes the frequency coefficients in units of blocks to perform frequency conversion. Fast arithmetic operations. Compared with the image data of the spatial domain, the coefficients of the frequency domain are of the easy compression type. Specifically, the image pixel value of the spatial domain is expressed as a prediction error by inter-prediction or intra-prediction of the video codec, and therefore, if frequency conversion is performed on the prediction error, The data can be converted to 0. The video codec reduces the amount of data by replacing successive and repetitive data with smaller data.
本發明提供用於產生相對於原始影像具有最小誤差之復原影像的視訊編碼方法與裝置及視訊解碼方法與裝置。 The present invention provides a video encoding method and apparatus and video decoding method and apparatus for generating a reconstructed image having minimal error with respect to an original image.
根據本發明之一態樣,提供一種視訊解碼方法,包含:自所接收之位元串流解析指示視訊區塊中的當前區塊與至少一個相鄰區塊之偏移參數是否彼此相同的偏移合併資訊;基於所述偏移合併資訊,自當前區塊之偏移參數復原偏移類型與偏移值;基於指示所述偏移類型之當前區塊之邊緣類型或畫素值帶類型,判定當前區塊的所復原之畫素之邊緣類別或畫素值帶;以及自偏移值判定對應於所復原之畫素之邊緣類別或畫素值帶的偏移值,並根據所述偏移值來調整所述所復原之畫素之畫素值。 According to an aspect of the present invention, a video decoding method includes: parsing, from a received bit stream, whether an offset parameter of a current block and at least one adjacent block in a video block is the same as each other Transmitting the merge information; recovering the offset type and the offset value from the offset parameter of the current block based on the offset merge information; based on the edge type or the pixel value band type of the current block indicating the offset type, Determining an edge class or a pixel value band of the restored pixel of the current block; and determining an offset value corresponding to the edge class or the pixel value band of the restored pixel from the offset value, and according to the bias The value is shifted to adjust the pixel value of the restored pixel.
根據本發明之一態樣,所復原之畫素之邊緣類別或畫素值帶的判定可包含:在當前區塊之偏移類型為邊緣類型之狀況下,比較當前復原之畫素與根據邊緣類型及邊緣大小而安置的當前復原之畫素之相鄰畫素的畫素值,且判定指示所述當前復原之畫素是否為邊緣畫素之邊緣類別,其中,根據所述偏移值的所述所復原之畫素之畫素值的調整包含:在所述偏移值包括對應於分配至當前偏移類型之邊緣類別的偏移值的狀況下,自偏移值判定對應於當前復原之畫素之邊緣類別的偏移值。 According to an aspect of the present invention, the edge of the restored pixel or the determination of the pixel value band may include: comparing the currently restored pixel and the edge according to the edge when the offset type of the current block is an edge type a pixel value of a neighboring pixel of the currently restored pixel placed with the type and the edge size, and determining whether the currently restored pixel is an edge class of the edge pixel, wherein, according to the offset value The adjustment of the pixel value of the restored pixel includes: in the case where the offset value includes an offset value corresponding to an edge class assigned to the current offset type, the self-offset value determination corresponds to the current restoration The offset value of the edge category of the pixel.
根據本發明之一態樣,所復原之畫素之邊緣類別或畫素值帶的判定可包含:在當前區塊之偏移類型為畫素值帶 類型的狀況下,自多個帶判定指示當前復原之畫素之畫素值所屬的畫素值範圍的畫素值帶,其中,根據所述偏移值的所復原之畫素之畫素值的調整包含:在所述偏移值包含對應於分配至當前偏移類型之畫素值帶的偏移值的狀況下,自所述偏移值判定對應於當前復原之畫素之畫素值帶的偏移值。 According to an aspect of the present invention, the edge type of the restored pixel or the determination of the pixel value band may include: the offset type in the current block is a pixel value band In the case of a type, a pixel value band indicating a range of pixel values to which the pixel value of the currently restored pixel belongs is determined, and a pixel value of the restored pixel according to the offset value The adjusting comprises: determining, in the condition that the offset value includes an offset value corresponding to a pixel value band assigned to the current offset type, determining a pixel value corresponding to the currently restored pixel from the offset value The offset value of the band.
根據本發明之一態樣,所述偏移類型與所述偏移值的復原可包含:若基於所述偏移合併資訊,當前區塊之左側區塊及上方區塊之至少一個偏移參數與當前區塊之偏移參數相同,則將所述當前區塊之偏移參數復原為與所述當前區塊之所述左側區塊與所述上方區塊之所述至少一個偏移參數相同。 According to an aspect of the present invention, the restoring the offset type and the offset value may include: if based on the offset merge information, at least one offset parameter of a left block and an upper block of a current block And the offset parameter of the current block is restored to be the same as the at least one offset parameter of the left block and the upper block of the current block. .
根據本發明之一態樣,所述偏移類型與所述偏移值之復原可包含:若基於所述偏移合併資訊,當前區塊之左側區塊與上方區塊之至少一個偏移參數與當前區塊之偏移參數不同,則自所接收之位元串流解析並復原所述當前區塊之偏移參數。 According to an aspect of the present invention, the restoring the offset type and the offset value may include: if the merge information is based on the offset, at least one offset parameter of the left block and the upper block of the current block Different from the offset parameter of the current block, the offset parameter of the current block is parsed and restored from the received bit stream.
根據本發明之一態樣,所述偏移類型與所述偏移值的復原可包括:藉由參考偏移參數中彼此之偏移參數,對當前區塊之明度分量及色度分量中的至少一個色彩分量的偏移參數執行預測與復原。根據本發明之一態樣,偏移值為包含於相同邊緣類別或相同畫素值帶中的所復原之畫素與原始畫素之間的差值的平均值。 According to an aspect of the present invention, the restoring of the offset type and the offset value may include: in the luma component and the chroma component of the current block, by referring to offset parameters of each other in the offset parameter The offset parameter of at least one color component performs prediction and restoration. According to one aspect of the invention, the offset value is an average of the difference between the restored pixel and the original pixel contained in the same edge class or the same pixel value band.
根據本發明之另一態樣,提供有一種視訊編碼方法, 包括:根據視訊區塊中的當前區塊之邊緣類型來判定邊緣類別,或根據其畫素值帶類型來判定畫素值帶;藉由使用包含於所述邊緣類別或所述畫素值帶中的所復原之畫素與原始畫素之間的差值來判定對應於邊緣類別或畫素值帶的偏移值;以及當每一區塊之偏移參數包括指示邊緣類型或畫素值帶類型之偏移類型以及對應於邊緣類別或畫素值帶之偏移時,基於當前區塊與至少一個相鄰區塊之偏移參數之間的同一性,對指示是否對所述當前區塊之偏移參數進行編碼的當前區塊之偏移合併資訊進行編碼。 According to another aspect of the present invention, a video encoding method is provided. Including: determining an edge class according to an edge type of a current block in the video block, or determining a pixel value band according to a pixel value band type thereof; by using the edge class or the pixel value band The difference between the restored pixel and the original pixel to determine an offset value corresponding to the edge class or the pixel value band; and when the offset parameter of each block includes an edge type or a pixel value The type of offset type and the offset corresponding to the edge class or the pixel value band, based on the identity between the offset parameter of the current block and the at least one adjacent block, indicating whether the current zone is The offset parameter of the block encodes the offset combination information of the current block to be encoded.
根據本發明之一態樣,所述邊緣類別與所述畫素值帶之判定包括:在根據邊緣類型判定當前區塊之偏移的狀況下,比較當前復原之畫素與根據所述邊緣類型及邊緣大小而安置的當前復原之畫素的相鄰畫素的畫素值,且判定指示當前復原之畫素是否為邊緣畫素之邊緣類別。 According to an aspect of the present invention, the determining of the edge class and the pixel value band includes: comparing the currently restored pixel with the edge type according to the edge type determining the offset of the current block And a pixel value of a neighboring pixel of the currently restored pixel placed with the edge size, and determining whether the currently restored pixel is an edge class of the edge pixel.
根據本發明之一態樣,所述邊緣類別與所述畫素值帶之判定包括:在根據所復原之畫素之畫素值帶類型判定當前區塊之偏移的狀況下,自多個帶判定指示當前復原之畫素之畫素值所屬的畫素值範圍的畫素值帶。 According to an aspect of the present invention, the determining of the edge class and the pixel value band includes: determining a deviation of a current block according to a pixel type of the restored pixel, from a plurality of A pixel value band with a range of pixel values to which the pixel value of the pixel of the currently restored pixel is determined.
根據本發明之一態樣,所述當前區塊之偏移合併資訊之編碼包括:若所述當前區塊之左側區塊及上方區塊之至少一個偏移參數與所述當前區塊之偏移參數相同,則對排除所述當前區塊之偏移參數的偏移合併資訊進行編碼。 According to an aspect of the present invention, the encoding of the offset combination information of the current block includes: if at least one offset parameter of the left block and the upper block of the current block is offset from the current block If the shift parameters are the same, the offset merge information excluding the offset parameter of the current block is encoded.
根據本發明之一態樣,對應於邊緣類別或畫素值帶之偏移值之判定包括:按照包含於相同邊緣類別或相同畫素 值帶中的所復原之畫素與原始畫素之間的差值的平均值來判定所述偏移值。 According to an aspect of the present invention, the determination of the offset value corresponding to the edge class or the pixel value band includes: including the same edge class or the same pixel The offset value is determined by averaging the difference between the restored pixel and the original pixel in the value band.
根據本發明之另一態樣,提供一種視訊解碼裝置,包括:偏移參數解析單元,所述偏移參數解析單元用於自所接收之位元串流解析指示視訊區塊中的當前區塊與至少一個相鄰區塊之偏移參數是否彼此相同的偏移合併資訊,基於所述偏移合併資訊自當前區塊之偏移參數復原偏移類型與偏移值;以及偏移調整單元,所述偏移調整單元用於基於指示所述偏移類型之當前區塊之邊緣類型或畫素值帶類型,判定所復原之畫素之邊緣類別或畫素值帶,且自偏移值判定對應於所述所復原之畫素之邊緣類別或畫素值帶之偏移值,並根據所述偏移值調整所述所復原之畫素之畫素值。 According to another aspect of the present invention, a video decoding apparatus is provided, including: an offset parameter parsing unit, configured to parse a current block in a video block from a received bit stream Offset combining information with whether offset parameters of at least one adjacent block are identical to each other, restoring an offset type and an offset value from an offset parameter of the current block based on the offset merge information; and an offset adjustment unit, The offset adjustment unit is configured to determine an edge class or a pixel value band of the restored pixel based on an edge type or a pixel value band type of the current block indicating the offset type, and determine the self-offset value Corresponding to the edge type of the restored pixel or the offset value of the pixel value band, and adjusting the pixel value of the restored pixel according to the offset value.
根據本發明之另一態樣,提供一種視訊編碼裝置,包括:偏移判定單元,所述偏移判定單元用於根據視訊區塊中的當前區塊之邊緣類型來判定邊緣類別,或根據其畫素值帶類型來判定畫素值帶,且藉由使用包含於邊緣類別或畫素值帶中的所復原之畫素與原始畫素之間的差值來判定對應於邊緣類別或畫素值帶之偏移值;以及偏移參數編碼單元,所述偏移參數編碼單元用於當每一區塊之偏移參數包括指示邊緣類型或畫素值帶類型之偏移類型以及對應於邊緣類別或畫素值帶之偏移時,基於當前區塊與至少一個相鄰區塊之偏移參數之間的同一性,對指示是否對所述當前區塊之偏移參數進行編碼的當前區塊之偏移合併資訊進 行編碼。 According to another aspect of the present invention, a video encoding apparatus is provided, including: an offset determining unit, configured to determine an edge class according to an edge type of a current block in a video block, or according to the edge type The pixel value band is used to determine the pixel value band, and the edge corresponding to the edge class or pixel is determined by using the difference between the restored pixel included in the edge class or the pixel value band and the original pixel. An offset value of the value band; and an offset parameter encoding unit configured to: when the offset parameter of each block includes an offset type indicating an edge type or a pixel value band type and corresponding to the edge When the category or pixel value is offset, the current region indicating whether to encode the offset parameter of the current block is based on the identity between the offset parameter of the current block and the at least one adjacent block Block offset merge information into Line coding.
根據本發明之另一態樣,提供一種電腦可讀記錄媒體,所述電腦可讀記錄媒體上記錄有用於執行視訊解碼方法之程式。 According to another aspect of the present invention, a computer readable recording medium having a program for executing a video decoding method is recorded on the computer readable recording medium.
根據本發明之另一態樣,提供一種電腦可讀記錄媒體,所述電腦可讀記錄媒體上記錄有用於執行視訊編碼方法之程式。 According to another aspect of the present invention, a computer readable recording medium having a program for executing a video encoding method is recorded on the computer readable recording medium.
藉由參考附圖詳細描述例示性實施例,例示性實施例之以上以及其他特徵與優點將變得更加顯而易見。 The above and other features and advantages of the exemplary embodiments will become more apparent from the detailed description of exemplary embodiments.
在下文中將參考附圖更完整地描述本發明,附圖所示為本發明之例示性實施例。 The invention will be described more fully hereinafter with reference to the accompanying drawings in which FIG.
如本文中所使用,術語「及/或」包含相關聯之所列出項目中之一或多者的任何以及所有組合。 The term "and/or" as used herein includes any and all combinations of one or more of the associated listed items.
下文將參照圖1至圖7描述根據畫素分類調整偏移而執行的視訊編碼方法及視訊解碼方法的一實施例。且,下文將參照畫素偏移或畫素帶之類型以及圖20描述基於具有樹狀結構之編碼單位的視訊編碼方法及視訊解碼方法,使用根據畫素分類之偏移調整的實施例。在下文中,「影像」可意謂視訊之靜態影像、其動態影像(亦即,視訊自身)。 An embodiment of a video encoding method and a video decoding method performed according to pixel classification adjustment offsets will be described below with reference to FIGS. 1 through 7. Further, an embodiment in which the offset adjustment based on the pixel classification is used will be described below with reference to the pixel offset or the type of the pixel band and FIG. 20 describing the video encoding method and the video decoding method based on the coding unit having the tree structure. In the following, "image" can mean a still image of a video, and its motion picture (ie, the video itself).
首先,下文現將參照圖1至圖7根據一實施例描述根據畫素分類調整偏移而執行的視訊編碼方法及視訊解碼方法。 First, a video encoding method and a video decoding method performed according to pixel classification adjustment offsets will now be described with reference to FIGS. 1 through 7 according to an embodiment.
圖1為根據本發明之一實施例的視訊編碼裝置10的 方塊圖。 1 is a video encoding apparatus 10 according to an embodiment of the present invention. Block diagram.
根據一實施例的視訊編碼裝置10包含偏移判定單元12以及偏移參數編碼單元14。 The video encoding device 10 according to an embodiment includes an offset determining unit 12 and an offset parameter encoding unit 14.
根據一實施例的視訊編碼裝置10接收視訊之影像,將每一影像分割為區塊,且針對每一區塊對影像進行編碼。區塊類型可為正方形或矩形,且可為任意幾何形狀。區塊類型不限於具有統一大小之資料單位。根據一實施例的區塊可為呈樹狀結構之編碼單位中的最大編碼單位,編碼單位等。稍後,將參照圖8至圖20描述基於呈樹狀結構的編碼單位的視訊編碼與解碼方法。 The video encoding device 10 according to an embodiment receives an image of a video, divides each image into blocks, and encodes the image for each block. The block type can be square or rectangular and can be any geometric shape. The block type is not limited to data units having a uniform size. A block according to an embodiment may be a maximum coding unit, a coding unit, or the like in a coding unit in a tree structure. A video encoding and decoding method based on a coding unit in a tree structure will be described later with reference to FIGS. 8 to 20.
根據一實施例的視訊編碼裝置10可對每一影像區塊執行畫面內預測、畫面間預測、轉換以及量化,產生樣本,對所述樣本執行熵編碼(entropy encoding),並以位元串流方式輸出所述樣本。 The video encoding apparatus 10 according to an embodiment may perform intra-picture prediction, inter-picture prediction, conversion, and quantization for each image block, generate samples, perform entropy encoding on the samples, and perform bit streaming. The sample is output in a manner.
根據一實施例的視訊編碼裝置10可對指示原始影像之畫素(原始畫素)與所復原之影像之畫素(所復原之畫素)之間差值的偏移值進行編碼,以將原始畫素與所復原之畫素之間的誤差減至最小。 The video encoding apparatus 10 according to an embodiment may encode an offset value indicating a difference between a pixel of the original image (the original pixel) and a pixel of the restored image (the restored pixel) to The error between the original pixel and the restored pixel is minimized.
根據一實施例的視訊編碼裝置10可針對諸如圖像、片段、區塊等每一預定資料單位判定偏移值。可針對每一預定資料單位對包含偏移值與偏移類型之偏移參數進行編碼。 The video encoding device 10 according to an embodiment may determine an offset value for each predetermined data unit such as an image, a slice, a tile, and the like. The offset parameter including the offset value and the offset type can be encoded for each predetermined data unit.
根據一實施例的偏移判定單元12判定當前區塊之邊緣類型或畫素值帶類型。偏移判定單元12可判定是否適於 根據當前區塊之畫素特性,基於畫素類型或畫素值帶類型對當前區塊之畫素進行分類。 The offset determination unit 12 according to an embodiment determines the edge type or the pixel value band type of the current block. The offset determining unit 12 can determine whether it is suitable According to the pixel characteristics of the current block, the pixels of the current block are classified based on the pixel type or the pixel value type.
根據一實施例的邊緣類型可指示由所復原之畫素與相鄰畫素形成的邊緣的方向以及大小。且,在當前區塊之畫素值的整個範圍帶分割為預定數目的帶時,根據一實施例的畫素值帶類型可指示畫素值之帶的總數、每一帶之範圍等。 The edge type according to an embodiment may indicate the direction and size of the edge formed by the restored pixel and the adjacent pixel. Moreover, when the entire range of the pixel values of the current block is divided into a predetermined number of bands, the pixel value band type according to an embodiment may indicate the total number of bands of the pixel values, the range of each band, and the like.
在根據邊緣類型判定當前區塊之偏移值的狀況下,根據一實施例的偏移判定單元12可判定屬於每一所復原的畫素之邊緣類別。根據一實施例的邊緣類別指示當前復原之畫素是否為邊緣之畫素。舉例而言,邊緣類別可指示當前復原之畫素是否為邊緣之端點、是否為構成邊緣之邊緣畫素,或是否不是構成邊緣之畫素等。 In the case where the offset value of the current block is determined based on the edge type, the offset determining unit 12 according to an embodiment can determine the edge class belonging to each of the restored pixels. The edge class according to an embodiment indicates whether the currently restored pixel is an edge pixel. For example, the edge category may indicate whether the currently restored pixel is the edge of the edge, whether it is the edge pixel constituting the edge, or whether it is not a pixel constituting the edge.
在根據邊緣類型判定當前區塊之偏移值的狀況下,根據一實施例的偏移判定單元12可比較當前復原之畫素的畫素值與根據邊緣之方向與大小相鄰於當前復原之畫素而安置的相鄰畫素之畫素值,且判定指示當前復原之畫素是否為邊緣畫素之邊緣類別。 In the case where the offset value of the current block is determined according to the edge type, the offset determining unit 12 according to an embodiment can compare the pixel value of the currently restored pixel with the direction and size according to the edge adjacent to the current restoration. A pixel value of a neighboring pixel placed in a pixel, and determining whether the currently restored pixel is an edge class of the edge pixel.
在根據畫素值帶類型判定當前區塊之偏移值的狀況下,根據一實施例的偏移判定單元12可判定屬於每一所復原之畫素的畫素值帶。根據一實施例的畫素值帶指示多個畫素值帶中當前復原之畫素的畫素值所屬之畫素值帶。所述多個畫素值帶可根據相等的畫素值範圍而分割。且,所述多個畫素值帶可根據不等的畫素值範圍而分割。亦即, 偏移判定單元12可所述多個畫素值帶判定指示當前復原之畫素的畫素值所屬之畫素值範圍的畫素值帶。 In the case where the offset value of the current block is determined based on the pixel value band type, the offset determining unit 12 according to an embodiment can determine the pixel value band belonging to each restored pixel. A pixel value band according to an embodiment indicates a pixel value band to which a pixel value of a pixel currently restored in a plurality of pixel value bands belongs. The plurality of pixel value bands may be segmented according to an equal range of pixel values. Moreover, the plurality of pixel value bands may be divided according to ranges of unequal pixel values. that is, The offset determination unit 12 may determine a pixel value band indicating a range of pixel values to which the pixel value of the currently restored pixel belongs to the plurality of pixel value bands.
根據一實施例的偏移判定單元12藉由使用所復原之畫素與包含於與所復原之畫素相同的邊緣類別或畫素值帶中的原始畫素之間的差值,判定對應於所復原之畫素的邊緣類別或畫素值帶之偏移值。 The offset determination unit 12 according to an embodiment determines the correspondence corresponding to the difference between the original pixels included in the same edge class or pixel value band as the restored pixel by using the restored pixel. The edge value of the restored pixel or the offset value of the pixel value.
根據一實施例的偏移判定單元12可判定所復原之畫素與包含於與當前邊緣類別相同的邊緣類別或與當前畫素值帶相同的畫素值帶中的原始畫素之間的差值之平均值(亦即,所復原之畫素之平均誤差),作為對應於當前邊緣類別或當前畫素值帶之偏移值。 The offset determining unit 12 according to an embodiment may determine the difference between the restored pixel and the original pixel included in the same edge class as the current edge class or the same pixel value band as the current pixel value band. The average of the values (ie, the average error of the restored pixels) as an offset value corresponding to the current edge category or current pixel value band.
偏移判定單元12可針對當前區塊中的每一所復原之畫素判定邊緣類別或畫素值帶。因此,偏移判定單元12可判定對應於區塊之每一邊緣類別的每一偏移值。且,偏移判定單元12可判定對應於區塊之每一畫素值帶的每一偏移值。 The offset decision unit 12 may determine an edge class or a pixel value band for each restored pixel in the current block. Therefore, the offset determination unit 12 can determine each offset value corresponding to each edge class of the block. And, the offset determining unit 12 can determine each offset value corresponding to each pixel value band of the block.
根據一實施例的偏移參數編碼單元14可對每一區塊之偏移類型以及偏移值進行編碼。根據一實施例的偏移類型指示每一區塊之邊緣類型或其畫素值帶類型。 The offset parameter encoding unit 14 according to an embodiment may encode the offset type and the offset value of each block. The offset type according to an embodiment indicates the edge type of each block or its pixel value band type.
每一區塊之偏移參數可包含每一區塊之偏移類型以及偏移值。若偏移類型為邊緣類型,則偏移參數可包含對應於每一邊緣類別之偏移值。且,若偏移類型為畫素值帶類型,則偏移參數可包含對應於每一畫素值帶之偏移值。亦即,偏移參數編碼單元14可針對每一區塊對偏移參數進 行編碼。 The offset parameter for each block may include the offset type and offset value for each block. If the offset type is an edge type, the offset parameter may include an offset value corresponding to each edge class. Moreover, if the offset type is a pixel value band type, the offset parameter may include an offset value corresponding to each pixel value band. That is, the offset parameter encoding unit 14 can advance the offset parameter for each block. Line coding.
根據一實施例的偏移參數編碼單元14可基於當前區塊與至少一個相鄰區塊之偏移參數之間的同一性(identities),對指示是否對當前區塊之偏移參數進行編碼的當前區塊之偏移合併資訊進行編碼。 The offset parameter encoding unit 14 according to an embodiment may encode whether to offset the offset parameter of the current block based on the identity between the offset parameter of the current block and the at least one neighboring block. The offset combination information of the current block is encoded.
若當前區塊之左側區塊與右側區塊之偏移參數中的至少一者與當前區塊之偏移參數相同,則根據一實施例的偏移參數編碼單元14可對除當前區塊之偏移參數之外的偏移合併資訊進行編碼。 If at least one of the offset parameters of the left block and the right block of the current block is the same as the offset parameter of the current block, the offset parameter encoding unit 14 according to an embodiment may be used to remove the current block. The offset combining information other than the offset parameter is encoded.
若當前區塊之左側區塊與右側區塊之偏移參數與當前區塊之偏移參數不同,則根據一實施例的偏移參數編碼單元14可對當前區塊之偏移合併資訊以及偏移參數進行編碼。 If the offset parameter of the left block and the right block of the current block is different from the offset parameter of the current block, the offset parameter encoding unit 14 according to an embodiment may combine the offset information and the partial offset of the current block. The shift parameters are encoded.
若相鄰區塊之偏移參數之部分資訊與當前區塊之偏移參數相同,則根據一實施例的偏移參數編碼單元14可對一個位元之偏移合併資訊進行編碼,且僅對除相鄰區塊之偏移參數中與當前區塊之偏移參數相同的部分資訊之外的當前區塊之偏移參數的資訊進行編碼。舉例而言,若當前區塊與相鄰區塊的偏移值相同,則可針對當前區塊對一個位元之偏移合併資訊以及偏移類型進行編碼。 If the partial information of the offset parameter of the adjacent block is the same as the offset parameter of the current block, the offset parameter encoding unit 14 according to an embodiment may encode the offset combining information of one bit, and only The information of the offset parameter of the current block other than the partial information of the offset parameter of the current block in the offset parameter of the adjacent block is encoded. For example, if the current block has the same offset value as the adjacent block, the offset combination information and the offset type of one bit may be encoded for the current block.
根據一實施例的偏移參數編碼單元14可對相鄰區塊之偏移值與當前偏移之間的差分資訊進行編碼。 The offset parameter encoding unit 14 according to an embodiment may encode differential information between an offset value of an adjacent block and a current offset.
若偏移為0,則根據一實施例的偏移參數編碼單元14可對除偏移之外的偏移參數進行編碼。 If the offset is 0, the offset parameter encoding unit 14 according to an embodiment may encode an offset parameter other than the offset.
根據一實施例的偏移參數編碼單元14可藉由參考其他色彩分量之偏移參數對當前區塊之明度分量與色度分量中的至少一個色彩分量進行預測及編碼。舉例而言,藉由共用或互相參考偏移參數,對明度分量與色度分量之偏移參數進行預測及編碼。作為另一實例,藉由共用或互相參考偏移參數,對第一色度分量以及第二色度分量之偏移參數進行預測及編碼。 The offset parameter encoding unit 14 according to an embodiment may predict and encode at least one of the luma component and the chroma component of the current block by referring to the offset parameters of the other color components. For example, the offset parameters of the luma component and the chroma component are predicted and encoded by sharing or mutually referring to the offset parameter. As another example, the offset parameters of the first chrominance component and the second chrominance component are predicted and encoded by sharing or mutually referencing the offset parameters.
根據一實施例的視訊編碼裝置10可包含中央處理器(未圖示),所述中央處理器整體控制偏移判定單元12以及偏移參數編碼單元14。或者,偏移判定單元12以及偏移參數編碼單元14可由其交互操作之各別處理器(未圖示)操作,且因此,視訊編碼裝置10可整體操作。或者,可藉由根據一實施例的視訊編碼裝置10之外部處理器(未圖示)之控制來控制偏移判定單元12及偏移參數編碼單元14。 The video encoding device 10 according to an embodiment may include a central processing unit (not shown) that integrally controls the offset determining unit 12 and the offset parameter encoding unit 14. Alternatively, the offset determination unit 12 and the offset parameter encoding unit 14 may be operated by respective processors (not shown) that interoperate, and thus, the video encoding device 10 may operate as a whole. Alternatively, the offset determination unit 12 and the offset parameter encoding unit 14 may be controlled by the control of an external processor (not shown) of the video encoding device 10 according to an embodiment.
根據一實施例的視訊編碼裝置10可包含至少一個資料儲存單元(未圖示),所述資料儲存單元儲存偏移判定單元12以及偏移參數編碼單元14之輸入以及輸出資料。視訊編碼裝置10可包含記憶體控制單元(未圖示),所述記憶體控制單元控制資料儲存單元(未圖示)之資料輸入與輸出。 The video encoding device 10 according to an embodiment may include at least one data storage unit (not shown) that stores input and output data of the offset determining unit 12 and the offset parameter encoding unit 14. The video encoding device 10 may include a memory control unit (not shown) that controls data input and output of a data storage unit (not shown).
根據一實施例的視訊編碼裝置10可結合安裝於其中之內部視訊編碼處理器或外部視訊編碼處理器操作,以輸出視訊編碼結果,藉此執行包含轉換之視訊編碼操作。根 據一實施例的視訊編碼裝置10之內部視訊編碼處理器可包含單獨的處理器,且視訊編碼裝置10、中央操作裝置或圖形操作裝置可包含視訊編碼處理模組,以實施基礎視訊編碼操作。 The video encoding device 10 according to an embodiment may operate in conjunction with an internal video encoding processor or an external video encoding processor installed therein to output a video encoding result, thereby performing a video encoding operation including conversion. root The internal video encoding processor of the video encoding device 10 according to an embodiment may include a separate processor, and the video encoding device 10, the central operating device or the graphics operating device may include a video encoding processing module to implement a basic video encoding operation.
圖2為根據本發明之一實施例的視訊解碼裝置20的方塊圖。 2 is a block diagram of a video decoding device 20 in accordance with an embodiment of the present invention.
根據一實施例的視訊解碼裝置20包含偏移參數解析單元22以及偏移調整單元24。 The video decoding device 20 according to an embodiment includes an offset parameter parsing unit 22 and an offset adjusting unit 24.
根據一實施例的視訊解碼裝置20接收包含經編碼之視訊資料的位元串流。視訊解碼裝置20可自所接收之位元串流解析經編碼之視訊樣本,對每一影像區塊執行熵編碼、逆量化、逆轉換以及預測與運動補償,產生所復原之畫素且產生最終的所復原之影像。且,根據一實施例的視訊解碼裝置20可接收指示原始畫素與所復原之畫素之間的差值之偏移值,以將原始影像與所復原之影像之間的誤差減至最小。 Video decoding device 20, according to an embodiment, receives a stream of bitstreams containing encoded video material. The video decoding device 20 can parse the encoded video samples from the received bit stream, perform entropy coding, inverse quantization, inverse conversion, and prediction and motion compensation for each image block, generate the restored pixels and generate the final The restored image. Moreover, the video decoding device 20 according to an embodiment may receive an offset value indicating a difference between the original pixel and the restored pixel to minimize an error between the original image and the restored image.
根據一實施例的偏移參數解析單元22可自位元串流解析指示視訊區塊中的當前區塊與至少一個相鄰區塊之偏移參數是否彼此相同的偏移合併資訊。 The offset parameter parsing unit 22 according to an embodiment may parse the offset combining information indicating whether the offset parameters of the current block and the at least one adjacent block in the video block are identical to each other from the bit stream.
根據一實施例的偏移參數解析單元22可基於當前區塊之偏移合併資訊而自當前區塊之偏移參數復原偏移類型以及偏移值。 The offset parameter parsing unit 22 according to an embodiment may restore the offset type and the offset value from the offset parameter of the current block based on the offset merge information of the current block.
舉例而言,若基於當前區塊之偏移合併資訊,當前區塊與至少一個相鄰區塊之偏移參數彼此不同,則偏移參數 解析單元22可自位元串流解析並復原當前區塊之偏移參數。然而,若基於當前區塊之偏移合併資訊,當前區塊與至少一個相鄰區塊之偏移參數彼此相同,則偏移參數解析單元22可藉由使用至少一個相鄰區塊之偏移參數來復原當前區塊之偏移參數,而不自位元串流解析當前區塊之偏移參數。 For example, if the offset information of the current block and the at least one adjacent block are different from each other based on the offset of the current block, the offset parameter is The parsing unit 22 can parse and restore the offset parameters of the current block from the bit stream. However, if the offset parameters of the current block and the at least one adjacent block are identical to each other based on the offset of the current block, the offset parameter parsing unit 22 may use the offset of at least one adjacent block. The parameter is used to restore the offset parameter of the current block, and the offset parameter of the current block is not parsed from the bit stream.
根據一實施例的偏移調整單元24可基於指示當前區塊之偏移類型的當前區塊之邊緣類型或畫素值帶類型來判定所復原之畫素的邊緣類別或畫素值帶。 The offset adjustment unit 24 according to an embodiment may determine the edge class or the pixel value band of the restored pixel based on the edge type or the pixel value band type of the current block indicating the offset type of the current block.
根據一實施例的偏移調整單元24可自當前區塊之偏移值判定對應於所復原之畫素的邊緣類別或畫素值帶之偏移值。偏移調整單元24可按偏移來調整所復原之畫素的畫素值。 The offset adjustment unit 24 according to an embodiment may determine an offset value corresponding to the edge class or the pixel value band of the restored pixel from the offset value of the current block. The offset adjustment unit 24 can adjust the pixel value of the restored pixel by the offset.
根據一實施例的偏移調整單元24可針對當前區塊之每一所復原之畫素來判定邊緣類別或畫素值帶。因此,偏移調整單元24可自所復原之偏移值判定對應於每一所復原之畫素的所判定之邊緣類別或畫素值帶之偏移值,並按偏移來調整每一所復原之畫素。 The offset adjustment unit 24 according to an embodiment may determine an edge class or a pixel value band for each restored pixel of the current block. Therefore, the offset adjustment unit 24 can determine the offset value of the determined edge class or pixel value band corresponding to each restored pixel from the restored offset value, and adjust each by offset. Restored pixels.
若當前區塊之偏移類型為邊緣類型,則根據一實施例的偏移調整單元24可比較當前區塊畫素與根據邊緣方向與邊緣大小而安置的當前復原之畫素之相鄰畫素的畫素值,並判定當前復原之畫素的邊緣類別。因此,偏移調整單元24可自偏移值判定對應於當前復原之畫素之邊緣類別的偏移值。偏移調整單元24可計算包含於與當前邊緣類 別相同之邊緣類別中的所復原之畫素與原始畫素之間的差值之平均值,並將所述平均值判定為對應於當前復原之畫素之偏移。 If the offset type of the current block is an edge type, the offset adjusting unit 24 according to an embodiment may compare the current block pixel with the adjacent pixel of the currently restored pixel placed according to the edge direction and the edge size. The pixel value and determine the edge category of the currently restored pixel. Therefore, the offset adjustment unit 24 can determine the offset value corresponding to the edge class of the currently restored pixel from the offset value. The offset adjustment unit 24 can calculate the inclusion and current edge classes The average of the difference between the restored pixel and the original pixel in the same edge category, and the average value is determined as the offset corresponding to the currently restored pixel.
若當前區塊之偏移類型為畫素值帶類型,根據一實施例的偏移調整單元24可自多個帶判定當前復原之畫素的畫素值所屬之畫素值帶。因此,偏移調整單元24可自所復原之偏移值判定對應於當前復原之畫素之畫素值帶的偏移值。由偏移調整單元24自所復原之偏移值選擇之偏移值可為包含於與當前畫素值帶相同的畫素值帶中的所復原之畫素與原始畫素之間的差值之平均值。 If the offset type of the current block is a pixel value band type, the offset adjusting unit 24 according to an embodiment may determine the pixel value band to which the pixel value of the currently restored pixel belongs from the plurality of bands. Therefore, the offset adjustment unit 24 can determine the offset value of the pixel value band corresponding to the currently restored pixel from the restored offset value. The offset value selected by the offset adjustment unit 24 from the restored offset value may be the difference between the restored pixel and the original pixel included in the same pixel value band as the current pixel value band. The average value.
針對偏移參數調整單元22之更詳細描述,若基於偏移合併資訊,當前區塊之左側區塊及右側區塊之偏移參數中之至少一個與當前區塊之偏移參數相同,則可將當前區塊之偏移參數復原為與當前區塊之左側區塊及右側區塊之偏移參數中的所述至少一個相同。可基於偏移合併資訊自相鄰區塊判定具有待參考之偏移參數之區塊。 For a more detailed description of the offset parameter adjustment unit 22, if at least one of the offset parameters of the left block and the right block of the current block is the same as the offset parameter of the current block based on the offset merge information, The offset parameter of the current block is restored to be the same as the at least one of the offset parameters of the left block and the right block of the current block. A block having an offset parameter to be referenced may be determined from an adjacent block based on the offset merge information.
此外,若基於偏移合併資訊,當前區塊之左側區塊及右側區塊之偏移參數與當前區塊之偏移參數不同,則偏移參數調整單元22可自位元串流解析並復原當前區塊之偏移參數。 In addition, if the offset parameter of the left block and the right block of the current block is different from the offset parameter of the current block based on the offset merge information, the offset parameter adjustment unit 22 can parse and recover from the bit stream. The offset parameter of the current block.
此外,若自位元串流解析之一個位元之偏移合併資訊指示相鄰區塊之偏移參數之部分資訊與當前區塊之偏移參數相同,則偏移參數調整單元22可藉由使用相鄰區塊之偏移參數之部分資訊來復原當前區塊之偏移參數之部分資 訊。可自位元串流解析並復原當前區塊之偏移參數之剩餘資訊。 In addition, if the offset combining information of one bit from the bit stream analysis indicates that the partial information of the offset parameter of the adjacent block is the same as the offset parameter of the current block, the offset parameter adjusting unit 22 may Use part of the information of the offset parameter of the adjacent block to restore part of the offset parameter of the current block. News. The remaining information of the offset parameter of the current block can be parsed and restored from the bit stream.
此外,偏移參數調整單元22可自位元串流解析並復原偏移參數之差分值。在此狀況下,偏移參數調整單元22可組合相鄰區塊之偏移值與當前區塊之偏移值之間的差分資訊,並預測及復原當前區塊之偏移值。 In addition, the offset parameter adjustment unit 22 can parse and restore the difference value of the offset parameter from the bit stream. In this case, the offset parameter adjustment unit 22 may combine the difference information between the offset value of the adjacent block and the offset value of the current block, and predict and restore the offset value of the current block.
此外,若偏移參數不包含至少一個偏移值,則偏移參數調整單元22可將偏移值復原為0。 Furthermore, if the offset parameter does not include at least one offset value, the offset parameter adjustment unit 22 may restore the offset value to zero.
根據一實施例的偏移參數解析單元22可藉由相互參考色彩分量之偏移參數來預測並復原當前區塊之明度分量與色度分量中的至少一個色彩分量之偏移參數。舉例而言,藉由共用或參考偏移參數,可復原明度分量與色度分量之偏移參數。作為另一實例,藉由共用或參考偏移參數,可預測並復原第一色度分量以及第二色度分量之偏移參數。 The offset parameter parsing unit 22 according to an embodiment may predict and restore an offset parameter of at least one of the luma component and the chroma component of the current block by mutually referring to an offset parameter of the color component. For example, the offset parameter of the luma component and the chroma component can be restored by sharing or referring to the offset parameter. As another example, the offset parameters of the first chrominance component and the second chrominance component can be predicted and restored by sharing or referencing the offset parameters.
根據一實施例的視訊解碼裝置20可包含中央處理器(未圖示),所述中央處理器整體控制偏移參數解析單元22以及偏移調整單元24。或者,偏移參數解析單元22以及偏移調整單元24可藉由其交互操作之各別處理器(未圖示)操作,且因此,視訊解碼裝置20可整體操作。或者,可藉由根據一實施例的視訊解碼裝置20之外部處理器(未圖示)之控制來控制偏移參數解析單元22及偏移調整單元24。 The video decoding device 20 according to an embodiment may include a central processing unit (not shown) that integrally controls the offset parameter parsing unit 22 and the offset adjusting unit 24. Alternatively, the offset parameter parsing unit 22 and the offset adjusting unit 24 can be operated by respective processors (not shown) that interact with each other, and thus, the video decoding device 20 can operate as a whole. Alternatively, the offset parameter parsing unit 22 and the offset adjusting unit 24 may be controlled by the control of an external processor (not shown) of the video decoding device 20 according to an embodiment.
根據一實施例的視訊解碼裝置20可包含至少一個資 料儲存單元(未圖示),所述資料儲存單元儲存偏移參數解析單元22以及偏移調整單元24之輸入以及輸出資料。視訊解碼裝置20可包含記憶體控制單元(未圖示),所述記憶體控制單元控制資料儲存單元(未圖示)之資料輸入與輸出。 The video decoding device 20 according to an embodiment may include at least one resource. A material storage unit (not shown) stores the input and output data of the offset parameter analysis unit 22 and the offset adjustment unit 24. The video decoding device 20 may include a memory control unit (not shown) that controls data input and output of a data storage unit (not shown).
根據一實施例的視訊解碼裝置20可結合安裝於其中之內部視訊解碼處理器或外部視訊解碼處理器操作,以經由視訊解碼來復原視訊,藉此執行視訊解碼操作。根據一實施例的視訊解碼裝置20之內部視訊解碼處理器可包含單獨的處理器,且視訊解碼裝置20、中央操作裝置或圖形操作裝置可包含視訊解碼處理模組,以實施基礎視訊解碼操作。 The video decoding device 20 according to an embodiment may operate in conjunction with an internal video decoding processor or an external video decoding processor installed therein to recover video via video decoding, thereby performing a video decoding operation. The internal video decoding processor of the video decoding device 20 according to an embodiment may include a separate processor, and the video decoding device 20, the central operating device, or the graphics operating device may include a video decoding processing module to implement a basic video decoding operation.
根據一實施例的視訊編碼裝置10與視訊解碼裝置20使用樣本適應性偏移(sample adaptive offset;SAO),以便將原始畫素與所復原之畫素之間的誤差減至最小。藉由使用根據一實施例的SAO,視訊編碼裝置10將每一影像區塊之畫素分類為預定畫素群組,將每一畫素分配至對應畫素群組,且對包含於相同畫素群組中用以指示原始畫素與所復原之畫素之間的誤差之平均值的偏移值進行編碼。 The video encoding device 10 and the video decoding device 20 according to an embodiment use a sample adaptive offset (SAO) to minimize the error between the original pixel and the restored pixel. By using the SAO according to an embodiment, the video encoding device 10 classifies the pixels of each image block into a predetermined pixel group, assigns each pixel to the corresponding pixel group, and the pair is included in the same picture. The offset value in the prime group indicating the average of the error between the original pixel and the restored pixel is encoded.
對樣本進行編碼並在視訊編碼裝置10與視訊解碼裝置20之間傳輸。亦即,視訊編碼裝置10可對樣本進行編碼,並以位元串流類型傳輸經編碼之樣本,且視訊解碼裝置20可自所接收之位元串流解析並復原樣本。根據一實施例的視訊編碼裝置10與視訊解碼裝置20根據經由畫素分 類而判定之偏移值調整所復原之畫素值,並對偏移參數進行編碼/解碼,以便將原始畫素與所復原之畫素之間的誤差減至最小。在視訊編碼裝置10與視訊解碼裝置20之間執行發信號(signaling),所述發信號涉及將偏移值作為偏移參數進行編碼、傳輸、接收及解碼。 The samples are encoded and transmitted between the video encoding device 10 and the video decoding device 20. That is, the video encoding device 10 can encode the samples and transmit the encoded samples in a bit stream type, and the video decoding device 20 can parse and restore the samples from the received bit stream. The video encoding device 10 and the video decoding device 20 according to an embodiment are based on The offset value determined by the class adjusts the restored pixel value and encodes/decodes the offset parameter to minimize the error between the original pixel and the restored pixel. Signaling is performed between the video encoding device 10 and the video decoding device 20, which involves encoding, transmitting, receiving, and decoding the offset value as an offset parameter.
因此,藉由使用根據一實施例的SAO,視訊解碼裝置20可對所接收之位元串流進行解碼,針對每一影像區塊而產生所復原之畫素,自位元串流復原偏移值,且按對應偏移來調整所復原之畫素,藉此產生相對於原始影像具有最小誤差之所復原之影像。 Therefore, by using the SAO according to an embodiment, the video decoding device 20 can decode the received bit stream, generate a restored pixel for each image block, and restore the offset from the bit stream. The value, and the restored pixels are adjusted by the corresponding offset, thereby producing a restored image with minimal error with respect to the original image.
在下文中,現將描述針對根據一實施例的SAO將畫素分類為畫素群組之實施例。藉由使用根據一實施例的SAO,可(i)根據構成所復原之畫素之邊緣類型或(ii)根據其畫素值帶類型而對畫素進行分類。根據一實施例,可藉由偏移類型定義根據邊緣類型抑或畫素值帶類型對畫素進行分類。 In the following, an embodiment for classifying pixels into pixel groups for SAOs according to an embodiment will now be described. By using the SAO according to an embodiment, the pixels can be classified (i) according to the edge type constituting the restored pixel or (ii) according to the pixel value band type thereof. According to an embodiment, the pixels may be classified according to the edge type or the pixel value band type by the offset type definition.
現將描述藉由使用根據一實施例的SAO根據邊緣類型對畫素進行分類之實施例。 Embodiments for classifying pixels according to edge types using SAOs according to an embodiment will now be described.
可根據針對當前區塊而判定之當前邊緣類型來判定包含於當前區塊中之每一所復原之畫素的邊緣類別。亦即,可藉由比較當前復原之畫素與相鄰畫素之畫素值來定義當前復原之畫素之邊緣類別。 The edge class of each restored pixel included in the current block may be determined based on the current edge type determined for the current block. That is, the edge class of the currently restored pixel can be defined by comparing the currently restored pixel with the pixel value of the adjacent pixel.
舉例而言,可根據以下<程序1>來判定邊緣類別。 For example, the edge category can be determined according to the following <Program 1>.
<程序1> <Program 1>
Class=0;對於i,j Ω Class =0; for i , j Ω
若Rec(i,j)<Rec(x,y),則Class++ If Rec(i,j)<Rec(x,y), then Class++
若Rec(i,j)<Rec(x,y),則Class-- If Rec(i,j)<Rec(x,y), then Class--
當前復原之畫素Rec(x,y)之x與y分別表示水平座標與垂直座標。相鄰於當前復原之畫素Rec(x,y)之相鄰畫素Rec(i,j)之i與j分別表示水平座標與垂直座標。Ω表示安置了相鄰畫素Rec(i,j)的空間範圍,相鄰畫素為當前復原之畫素Rec(x,y)之比較目標。亦即,根據上文<程序1>,可根據相鄰畫素Rec(i,j)之數目來判定當前復原之畫素Rec(x,y)之邊緣類別Class。在安置於預定空間範圍中的相鄰畫素Rec(i,j)中,邊緣類別Class可根據相比當前復原之畫素Rec(x,y)具有較高畫素值之相鄰畫素Rec(i,j)之數目而增大,且邊緣類別Class可根據相比當前復原之畫素Rec(x,y)具有較低畫素值之相鄰畫素Rec(i,j)之數目而減小。 The x and y of the currently restored pixel Rec(x, y) represent horizontal coordinates and vertical coordinates, respectively. The i and j adjacent to the adjacent pixel Rec(i, j) of the currently restored pixel Rec(x, y) represent a horizontal coordinate and a vertical coordinate, respectively. Ω indicates the spatial extent in which the adjacent pixels Rec(i, j) are placed, and the adjacent pixels are the comparison targets of the currently restored pixels Rec(x, y). That is, according to <Program 1> above, the edge class Class of the currently restored pixel Rec(x, y) can be determined based on the number of adjacent pixels Rec(i, j). In the adjacent pixel Rec(i, j) disposed in the predetermined spatial range, the edge class Class may be adjacent to the pixel having a higher pixel value than the currently restored pixel Rec(x, y). The number of (i, j) increases, and the edge class Class can be based on the number of adjacent pixels Rec(i, j) having a lower pixel value than the currently restored pixel Rec(x, y). Reduced.
可如下文所示定義安置了相鄰畫素Rec(i,j)<相鄰畫素空間範圍Ω>。 The adjacent pixels Rec(i,j) <adjacent pixel space range Ω> can be placed as defined below.
<最大相鄰畫素範圍> <Maximum adjacent pixel range>
(i,j) Ω,但(i,j)≠(x,y) ( i , j ) Ω, but (i,j)≠(x,y)
x-Mix+M,& y-Mjy+M xM i x+M,& yM j y+M
M表示自當前復原之畫素Rec(x,y)至相鄰畫素Rec(i,j)之最大水平及垂直距離。因此,最大相鄰畫素範圍可包含安置於當前復原之畫素Rec(x,y)周圍之相鄰畫素之最大 數目(4M^2+4M)。在此狀況下,邊緣類別Class可處於自最小-(4M^2+4M)至最大(4M^2+4M)之範圍中。邊緣類別Class範圍之中心值可指示當前復原之畫素Rec(x,y)為安置於邊緣周圍之畫素,而非邊緣畫素。處於相鄰畫素空間範圍Ω內之相鄰畫素Rec(i,j)之數目可根據邊緣類型增大或減小。M可為1,以便將操作量減至最小。 M represents the maximum horizontal and vertical distance from the currently restored pixel Rec(x, y) to the adjacent pixel Rec(i, j). Therefore, the largest adjacent pixel range can contain the largest adjacent pixels placed around the currently restored pixel Rec(x, y). Number (4M^2+4M). In this case, the edge class Class can be in the range from the minimum - (4M^2+4M) to the maximum (4M^2+4M). The center value of the edge category Class range indicates that the currently restored pixel Rec(x, y) is the pixel placed around the edge, not the edge pixel. The number of adjacent pixels Rec(i,j) within the adjacent pixel space range Ω may increase or decrease depending on the edge type. M can be 1 to minimize the amount of operation.
舉例而言,在邊緣類型為垂直邊緣的狀況下,可就畫素值而將當前復原之畫素Rec(x,y)與安置在水平方向上的相鄰畫素進行比較。亦即,可如下文所示判定垂直邊緣之相鄰畫素空間範圍Ω。 For example, in the case where the edge type is a vertical edge, the currently restored pixel Rec(x, y) can be compared with the adjacent pixels placed in the horizontal direction with respect to the pixel value. That is, the adjacent pixel space range Ω of the vertical edge can be determined as shown below.
<垂直邊緣之相鄰畫素空間範圍Ω> <The adjacent pixel space range Ω of the vertical edge>
(i,j) Ω,但(i,j)≠(x,y) ( i , j ) Ω, but (i,j)≠(x,y)
x-Mix+M,& j=y xM i x+M,& j=y
可根據由相鄰畫素空間範圍Ω內之畫素形成的邊緣類型(諸如,垂直邊緣、水平邊緣、對角邊緣、嚴格最大值以及嚴格最小值)來判定相鄰畫素空間範圍Ω之類型與大小。邊緣類別值指示畫素是否包含於邊緣中,或是否安置在邊緣周圍。因此,可判定用於根據邊緣類型與邊緣類別之組合校正構成邊緣之畫素值之偏移,且因此可根據邊緣類型與邊緣類別之組合來定義畫素群組。 The type of adjacent pixel space range Ω can be determined according to the edge type formed by the pixels within the adjacent pixel space range Ω (such as vertical edge, horizontal edge, diagonal edge, strict maximum value, and strict minimum value). With size. The edge category value indicates whether the pixel is included in the edge or whether it is placed around the edge. Therefore, it is possible to determine the offset for correcting the pixel values constituting the edge according to the combination of the edge type and the edge class, and thus the pixel group can be defined according to the combination of the edge type and the edge class.
可根據邊緣類型來判定包含於相鄰畫素空間範圍Ω中之相鄰畫素的數目。可在相鄰畫素之數目之範圍內判定邊緣類別值。因此,視訊編碼裝置10與視訊解碼裝置20可針對當前邊緣類型之每一邊緣類別來對對應偏移值進行 編碼、傳輸及接收,並根據偏移值來調整所復原之畫素。在下文中,將根據預定邊緣類型的邊緣類別之係數作為待編碼並傳輸至視訊解碼裝置20之偏移值的長度進行參考。 The number of adjacent pixels included in the adjacent pixel space range Ω can be determined according to the edge type. The edge class value can be determined within the range of the number of adjacent pixels. Therefore, the video encoding device 10 and the video decoding device 20 can perform the corresponding offset value for each edge class of the current edge type. Encode, transmit, and receive, and adjust the restored pixels based on the offset value. Hereinafter, the coefficient according to the edge class of the predetermined edge type is referred to as the length of the offset value to be encoded and transmitted to the video decoding device 20.
在用於邊緣類型與邊緣類別之預定組合之偏移值(亦即,當前邊緣類型之邊緣類別N之偏移值)先前判定為0的狀況下,無需對偏移值進行編碼並將其傳輸至視訊解碼裝置20。在此狀況下,可減小邊緣類型與邊緣類別之預定組合之長度。 In the case where the offset value for the predetermined combination of the edge type and the edge type (that is, the offset value of the edge category N of the current edge type) is previously determined to be 0, it is not necessary to encode and transmit the offset value. To the video decoding device 20. In this case, the length of the predetermined combination of the edge type and the edge category can be reduced.
因此,視訊編碼裝置10與視訊解碼裝置20可根據影像特性(諸如,邊緣類型)而對畫素進行分類,判定與偏移具有相同特性之畫素之間的平均誤差值,並根據所述偏移來調整所復原之畫素,藉此將原始影像與所復原之影像之間的誤差減至最小。 Therefore, the video encoding device 10 and the video decoding device 20 can classify pixels according to image characteristics (such as edge type), determine an average error value between pixels having the same characteristics as the offset, and according to the bias Move to adjust the restored pixels to minimize the error between the original image and the restored image.
圖3為根據本發明之一實施例的用於畫素分類的邊緣類型31、32、33、34、35及36與長度的表格。 3 is a table of edge types 31, 32, 33, 34, 35, and 36 and length for pixel classification, in accordance with an embodiment of the present invention.
索引5、4、0、1、2及3可按順序分配至邊緣類型31、32、33、34、35及36。邊緣類型31、32、33、34、35及36之出現之命中率愈高,可分配至邊緣類型31、32、33、34、35及36的索引5、4、0、1、2及3愈小。關於索引5之邊緣類型31,可藉由比較當前復原之畫素X0與鄰近於當前復原之畫素X0之八個相鄰畫素X1、X2、X3、X4、X5、X6、X7以及X8之畫素值而判定當前復原之畫素X0之邊緣類別。在此狀況下,分配至當前復原之畫素X0之邊緣類別之數目為17,且因此長度可判定為17。 Indexes 5, 4, 0, 1, 2, and 3 can be assigned to edge types 31, 32, 33, 34, 35, and 36 in order. The higher the hit rate of the edge types 31, 32, 33, 34, 35 and 36, the more assignable to the indices 5, 4, 0, 1, 2 and 3 of the edge types 31, 32, 33, 34, 35 and 36 The smaller. Regarding the edge type 31 of the index 5, by comparing the currently restored pixel X0 with eight adjacent pixels X1, X2, X3, X4, X5, X6, X7 and X8 adjacent to the currently restored pixel X0 The pixel value is used to determine the edge category of the currently restored pixel X0. In this case, the number of edge classes assigned to the currently restored pixel X0 is 17, and thus the length can be determined to be 17.
如上所述,關於索引4之邊緣類型32,藉由比較當前復原之畫素X0之當前復原之畫素值與水平且垂直鄰近於當前復原之畫素X0的四個相鄰畫素X1、X2、X3與X4,將邊緣類別之數目判定為9,且因此長度可判定為9。 As described above, with respect to the edge type 32 of the index 4, by comparing the currently restored pixel value of the currently restored pixel X0 with four adjacent pixels X1, X2 horizontally and vertically adjacent to the currently restored pixel X0. , X3 and X4, the number of edge categories is determined to be 9, and thus the length can be determined to be 9.
且,關於索引0之邊緣類型33,藉由比較當前復原之畫素X0之當前復原之畫素值與水平鄰近於當前復原之畫素X0的兩個相鄰畫素X1與X2,將邊緣類別之數目判定為5,且因此長度可判定為5。 And, regarding the edge type 33 of the index 0, the edge class is compared by comparing the currently restored pixel value of the currently restored pixel X0 with two adjacent pixels X1 and X2 horizontally adjacent to the currently restored pixel X0. The number is determined to be 5, and thus the length can be determined to be 5.
且,關於索引1之邊緣類型34,藉由比較當前復原之畫素X0之當前復原之畫素值與水平鄰近於當前復原之畫素X0的兩個相鄰畫素X3與X4,將邊緣類別之數目判定為5,且因此長度可判定為5。 And, with respect to the edge type 34 of the index 1, the edge class is compared by comparing the currently restored pixel value of the currently restored pixel X0 with two adjacent pixels X3 and X4 horizontally adjacent to the currently restored pixel X0. The number is determined to be 5, and thus the length can be determined to be 5.
且,關於索引2之邊緣類型35,藉由比較當前復原之畫素X0之當前復原之畫素值與在135°之對角方向上鄰近於當前復原之畫素X0的兩個相鄰畫素X5與X8,將邊緣類別之數目判定為5,且因此長度可判定為5。 And, with respect to the edge type 35 of the index 2, by comparing the currently restored pixel value of the currently restored pixel X0 with two adjacent pixels adjacent to the currently restored pixel X0 in the diagonal direction of 135° X5 and X8 determine the number of edge categories as 5, and thus the length can be determined to be 5.
且,關於索引3之邊緣類型36,藉由比較當前復原之畫素X0之當前復原之畫素值與在45°之對角方向上當前復原之畫素X0鄰近於兩個相鄰畫素X6與X7,將邊緣類別之數目判定為5,且因此長度可判定為5。 Moreover, with respect to the edge type 36 of the index 3, by comparing the currently restored pixel value of the currently restored pixel X0 with the pixel X0 currently restored in the diagonal direction of 45° adjacent to two adjacent pixels X6 With X7, the number of edge categories is determined to be 5, and thus the length can be determined to be 5.
舉例而言,在邊緣類型為如索引0之邊緣類型33的垂直邊緣且將當前復原之畫素X0與水平鄰近於當前復原之畫素X0之兩個相鄰畫素X1與X2進行比較的狀況下,當前復原之畫素X0之邊緣類別Class可根據下文<程序2> 來判定。 For example, a condition in which the edge type is a vertical edge of the edge type 33 such as index 0 and the currently restored pixel X0 is compared with two adjacent pixels X1 and X2 horizontally adjacent to the currently restored pixel X0. Next, the edge category Class of the currently restored pixel X0 can be determined according to <Program 2> below.
<程序2> <Program 2>
(1)若(X0>X1且X0<X2)則Class=2(2)若(X0>X1且X1==X2)或(X0==X1且X1>X2)則Class=1;(3)若(X0==X1且X1==X2)或(X0==X1且X1==X2)則Class=0;(4)若(X0<X1且X1==X2)或(X0==X1且X1<X2)則Class=-1;(5)若(X0<X1且X0<X2)則Class=-2 (1) If (X0>X1 and X0<X2) then Class=2(2) if (X0>X1 and X1==X2) or (X0==X1 and X1>X2) then Class=1; (3) If (X0==X1 and X1==X2) or (X0==X1 and X1==X2) then Class=0; (4) if (X0<X1 and X1==X2) or (X0==X1 and X1<X2) then Class=-1; (5) If (X0<X1 and X0<X2) then Class=-2
根據上文<程序2>,在當前復原之畫素X0分別為(1)邊緣之局部最大點;(2)區塊邊緣之畫素;(3)除邊緣之外的畫素;(4)凹邊之畫素;以及(5)邊緣之局部最小點的狀況下,可判定對應邊緣類別。在邊緣類別值為0的狀況下,因為偏移值極有可能為0,所以可能無法對所復原之畫素之邊緣類別進行編碼。 According to <Program 2> above, the currently restored pixel X0 is (1) the local maximum point of the edge; (2) the pixel of the edge of the block; (3) the pixel other than the edge; (4) In the case of the concave edge pixel; and (5) the local minimum point of the edge, the corresponding edge category can be determined. In the case where the edge class value is 0, since the offset value is highly likely to be 0, the edge class of the restored pixel may not be encoded.
接著,現將描述藉由使用根據一實施例的SAO根據畫素值帶類型對畫素進行分類之實施例。 Next, an embodiment of classifying pixels according to the pixel value band type by using the SAO according to an embodiment will now be described.
所復原之畫素的畫素值可屬於根據一實施例的畫素值帶之一。舉例而言,根據p位元取樣,畫素值之最小值Min與最大值Max可具有0,…,2^(p-1)之總範圍。畫素值範圍(Min,Max)可分割為K個畫素值帶。在BK表示第k個畫素值帶之最大值的狀況下,第k個畫素值帶可分割為[B0,B1-1]、[B1,B2-1]、[B2,B3-1]、……、[BK-1,BK]。在當 前復原之畫素Rec(x,y)之畫素值屬於[BK-1,BK]的狀況下,當前畫素值帶可定義為k。 The pixel value of the restored pixel may belong to one of the pixel value bands according to an embodiment. For example, according to the p-bit sampling, the minimum value Min and the maximum value Max of the pixel value may have a total range of 0, . . . , 2^(p-1). The range of pixel values (Min, Max) can be divided into K pixel value bands. In the case where B K represents the maximum value of the kth pixel value band, the kth pixel value band can be divided into [B 0 , B 1 -1], [B 1 , B 2 -1], [B 2 , B 3 -1], ..., [B K-1 , B K ]. In the case where the pixel value of the currently restored pixel Rec(x, y) belongs to [B K-1 , B K ], the current pixel value band can be defined as k.
畫素值帶可分割為相等類型或不等類型。可考慮實際最小值Min與實際最大值Max來判定此類畫素值帶類型。在此狀況下,在視訊編碼裝置10與視訊解碼裝置20之間可編碼並傳輸或接收並解碼畫素值帶之分割參考。在根據畫素值之理論範圍{0,……,2p-1}分割畫素值帶的狀況下,可在無需編碼的狀況下判定畫素值帶類型。此畫素值帶類型可定義為偏移類型。 The pixel value band can be divided into equal or unequal types. Such a pixel value band type can be determined by considering the actual minimum value Min and the actual maximum value Max. In this case, the segmentation reference of the pixel value band can be encoded and transmitted or received and decoded between the video encoding device 10 and the video decoding device 20. In the case where the pixel value band is divided according to the theoretical range {0, ..., 2 p-1 } of the pixel value, the pixel value band type can be determined without encoding. This pixel value band type can be defined as an offset type.
可自根據畫素值帶類型分類之多個畫素值帶判定針對每一所復原之畫素每一畫素值所屬之畫素值帶。且,可針對每一畫素值帶來判定指示原始畫素與所復原之畫素之間的誤差之平均值的偏移值。 A pixel value band to which each pixel value belongs to each restored pixel may be determined from a plurality of pixel value bands classified according to the pixel value type. Moreover, an offset value indicating an average value of the error between the original pixel and the restored pixel can be brought for each pixel value.
因此,視訊編碼裝置10與視訊解碼裝置20可針對根據當前畫素值帶類型分類之畫素值帶中之每一者來對對應偏移值進行編碼、傳輸並接收,並根據偏移來調整所復原之畫素。且,偏移值之長度可與畫素值帶之數目相同。視訊編碼裝置10可對長度進行編碼,並將長度傳輸至視訊解碼裝置20。 Therefore, the video encoding device 10 and the video decoding device 20 can encode, transmit, and receive the corresponding offset value for each of the pixel value bands classified according to the current pixel value band type, and adjust according to the offset. The restored pixels. Moreover, the length of the offset value can be the same as the number of pixel values. The video encoding device 10 can encode the length and transmit the length to the video decoding device 20.
在用於邊緣類型與邊緣類別之預定組合之偏移值(亦即,當前畫素值帶類型之第k個畫素值帶之偏移值)先前判定為0的狀況下,無需對偏移值進行編碼並將其傳輸至視訊解碼裝置20。在此狀況下,可減小邊緣類型與邊緣類別之預定組合之長度。 In the case where the offset value for the predetermined combination of the edge type and the edge type (that is, the offset value of the k-th pixel value band of the current pixel value type) is previously determined to be 0, the offset is not required. The value is encoded and transmitted to the video decoding device 20. In this case, the length of the predetermined combination of the edge type and the edge category can be reduced.
舉例而言,在畫素值分類類型為8位元相等帶的狀況下,畫素值可分割為32個畫素值帶。更具體而言,畫素值可分割為畫素值帶[0,7]、[8,15]、……、[240,247]、[248,255]。在此狀況下,長度為32。 For example, in the case where the pixel value classification type is an 8-bit equal band, the pixel value can be divided into 32 pixel value bands. More specifically, the pixel value can be divided into pixel values [0, 7], [8, 15], ..., [240, 247], [248, 255]. In this case, the length is 32.
在畫素值帶之總數(亦即,長度)為2的冪的狀況下,可將根據一實施例用於根據畫素值帶類型來對畫素進行分類之操作量減至最小。 In the case where the total number of pixel values (i.e., the length) is a power of two, the amount of operation for classifying pixels according to the pixel value band type according to an embodiment can be minimized.
因此,視訊編碼裝置10與視訊解碼裝置20可根據影像特性(諸如,畫素值帶類型)而對畫素進行分類,判定與偏移具有相同特性之畫素之間的平均誤差值,並根據偏移來調整所復原之畫素,藉此將原始影像與所復原之影像之間的誤差減至最小。 Therefore, the video encoding device 10 and the video decoding device 20 can classify the pixels according to image characteristics (such as the pixel value band type), determine the average error value between the pixels having the same characteristics as the offset, and The offset adjusts the restored pixels to minimize the error between the original image and the restored image.
根據一實施例的視訊編碼裝置10與視訊解碼裝置20可針對每一預定區域判定偏移類型與偏移值。視訊編碼裝置10可針對包含於預定區域中的每一畫素來判定原始畫素值與所復原之畫素值之間的誤差,並將畫素誤差之平均值判定為偏移值。針對迅速操作,視訊編碼裝置10與視訊解碼裝置20可針對每一區塊來判定並傳輸或接收偏移值。 The video encoding device 10 and the video decoding device 20 according to an embodiment may determine an offset type and an offset value for each predetermined region. The video encoding device 10 can determine an error between the original pixel value and the restored pixel value for each pixel included in the predetermined region, and determine the average of the pixel errors as the offset value. For fast operation, the video encoding device 10 and the video decoding device 20 can determine and transmit or receive an offset value for each block.
偏移類型可根據每一區塊之影像特性來判定。舉例而言,包含垂直邊緣、水平邊緣、對角邊緣等之區塊較適合用於根據邊緣類型來對畫素值進行分類,並針對邊緣值之校正來判定偏移值。在區塊並非邊緣區塊的狀況下,較適合根據帶分類來判定偏移值。因此,視訊編碼裝置10與視訊解碼裝置20可針對每一區塊來傳輸或接收偏移類型。 The offset type can be determined based on the image characteristics of each block. For example, a block containing vertical edges, horizontal edges, diagonal edges, and the like is more suitable for classifying pixel values according to edge types, and determining offset values for correction of edge values. In the case where the block is not an edge block, it is more suitable to determine the offset value according to the band classification. Therefore, the video encoding device 10 and the video decoding device 20 can transmit or receive an offset type for each block.
根據一實施例的偏移參數可包含偏移類型、偏移值、長度以及偏移類別。可根據偏移類型來判定長度。 The offset parameters according to an embodiment may include an offset type, an offset value, a length, and an offset category. The length can be determined according to the type of offset.
根據一實施例的視訊編碼裝置10與視訊解碼裝置20可判定對應於偏移類型之偏移類別。 The video encoding device 10 and the video decoding device 20 according to an embodiment may determine an offset class corresponding to an offset type.
因此,根據一實施例的視訊編碼裝置10可對偏移參數之偏移類型與偏移值進行編碼並將其傳輸至視訊解碼裝置20。視訊解碼裝置20可接收偏移類型與偏移值,並基於偏移類型來判定長度與偏移類別。且,視訊解碼裝置20可自所接收之偏移值選擇對應於長度或偏移類別之偏移值,並根據偏移值來調整所復原之畫素。 Therefore, the video encoding device 10 according to an embodiment can encode the offset type and the offset value of the offset parameter and transmit it to the video decoding device 20. The video decoding device 20 can receive the offset type and the offset value and determine the length and offset class based on the offset type. Moreover, the video decoding device 20 may select an offset value corresponding to the length or offset category from the received offset value, and adjust the restored pixel according to the offset value.
根據一實施例的視訊編碼裝置10可根據偏移類型之出現之命中率來判定偏移類型之索引,以便對偏移類型進行編碼。舉例而言,偏移類型中的索引之偏移類型之出現的命中率愈高,可編碼的索引之碼字愈短。 The video encoding apparatus 10 according to an embodiment may determine an index of an offset type according to a hit ratio of occurrence of an offset type to encode an offset type. For example, the higher the hit rate of the offset type of the index in the offset type, the shorter the codeword of the index that can be encoded.
視訊編碼裝置10與視訊解碼裝置20可具有以下偏移類型之索引之實例,所述偏移類型可選自包含根據邊緣類型與畫素值帶類型之畫素分類之偏移類型:(i)在不使用SAO的狀況下,偏移類型為-1;(ii)在垂直方向上包含三個畫素的邊緣類型的狀況下,偏移類型為0;(iii)在水平方向上包含三個畫素的邊緣類型的狀況下,偏移類型為1;(iv)在135°之對角方向上包含三個畫素的邊緣類型的狀況下,偏移類型為2; (v)在45°之對角方向上包含三個畫素的邊緣類型的狀況下,偏移類型為3;(vi)畫素值帶類型之偏移類型為4。 The video encoding device 10 and the video decoding device 20 may have an example of an index of an offset type, which may be selected from an offset type including a pixel classification according to an edge type and a pixel value band type: (i) In the case where SAO is not used, the offset type is -1; (ii) in the case of an edge type including three pixels in the vertical direction, the offset type is 0; (iii) three in the horizontal direction In the case of the edge type of the pixel, the offset type is 1; (iv) in the case where the edge type of three pixels is included in the diagonal direction of 135°, the offset type is 2; (v) In the case where the edge type of three pixels is included in the diagonal direction of 45°, the offset type is 3; (vi) the offset type of the pixel value type is 4.
在(ii)偏移類型為0的狀況下,邊緣類別可編碼為{-2、-1、1、2},並且可不對邊緣類別0進行編碼,因此長度可為4。在(vi)偏移類型為4且畫素值帶之數目為32的狀況下,長度可為32。 In the case where (ii) the offset type is 0, the edge class may be encoded as {-2, -1, 1, 2}, and the edge class 0 may not be encoded, and thus the length may be 4. In the case where (vi) the offset type is 4 and the number of pixel value bands is 32, the length may be 32.
圖4為說明根據本發明之一實施例的偏移值編碼程序的流程圖。 4 is a flow chart illustrating an offset value encoding procedure in accordance with an embodiment of the present invention.
在根據本發明之一實施例的視訊編碼裝置10與視訊解碼裝置20之間進行傳輸並接收的待編碼與解碼之偏移值極有可能為0。除0之外的偏移值具有正號或負號。因此,根據一實施例的視訊編碼裝置10判定當前偏移值是否為0(操作步驟41),且,若當前偏移值不為0,則判定當前偏移值是否大於0(操作步驟42)。若當前偏移值大於0,則對正負號位元「0」進行編碼(操作步驟44)。若當前偏移值不大於0,則對正負號位元「1」進行編碼(操作步驟43)。在對正負號位元進行編碼後,可進一步對位元率進行編碼,所述位元率是藉由對藉由將偏移值之絕對值減1而獲得的值執行一元二進制編碼而產生(操作步驟45)。若當前偏移值為「0」,視訊編碼裝置10可最終對當前偏移值「0」進行編碼(操作步驟46),並完全對偏移值進行編碼。 The offset value to be encoded and decoded transmitted and received between the video encoding device 10 and the video decoding device 20 according to an embodiment of the present invention is highly likely to be zero. Offset values other than 0 have a positive or negative sign. Therefore, the video encoding device 10 according to an embodiment determines whether the current offset value is 0 (operation 41), and if the current offset value is not 0, determines whether the current offset value is greater than 0 (operation 42) . If the current offset value is greater than 0, the sign bit "0" is encoded (operation 44). If the current offset value is not greater than 0, the sign bit "1" is encoded (operation 43). After encoding the sign bit, the bit rate can be further encoded by performing a binary binary encoding on the value obtained by subtracting the absolute value of the offset value by one ( Operation 45). If the current offset value is "0", the video encoding device 10 may finally encode the current offset value "0" (operation 46) and completely encode the offset value.
視訊解碼裝置20可接收偏移值,判定偏移值是否為 0,且若偏移值不為0,則解析正負號位元以及藉由將偏移值之絕對值減1而獲得的值,並復原當前偏移值。 The video decoding device 20 can receive the offset value and determine whether the offset value is 0, and if the offset value is not 0, the sign bit is parsed and the value obtained by subtracting the absolute value of the offset value by 1, and the current offset value is restored.
根據一實施例,可針對每一區塊判定並傳輸並接收偏移參數。舉例而言,視訊編碼裝置10與視訊解碼裝置20可針對每一圖像或每一片段來判定並傳輸並接收偏移參數。或者,視訊編碼裝置10與視訊解碼裝置20可針對樹狀結構之每一編碼單位或最大編碼單位來判定並傳輸並接收偏移參數。稍後將參照圖8至圖20更詳細描述根據一實施例基於包含樹狀結構之最大編碼單位以及編碼單位的樹狀結構之編碼單位的視訊編碼/解碼操作。 According to an embodiment, the offset parameters may be determined and transmitted and received for each block. For example, video encoding device 10 and video decoding device 20 may determine and transmit and receive offset parameters for each image or each segment. Alternatively, the video encoding device 10 and the video decoding device 20 may determine and transmit and receive an offset parameter for each coding unit or maximum coding unit of the tree structure. The video encoding/decoding operation based on the coding unit of the tree structure including the maximum coding unit of the tree structure and the coding unit according to an embodiment will be described in more detail later with reference to FIGS. 8 through 20.
每一區塊之偏移類型及/或偏移值在鄰近區塊之間極有可能相同。在當前區塊之偏移參數與相鄰區塊之偏移參數進行比較並與之相同的狀況下,根據一實施例的視訊編碼裝置10可將當前區塊與相鄰區塊之偏移參數合並且編碼為一個偏移參數。若先對相鄰區塊之偏移參數進行編碼,則可不對當前區塊之偏移參數進行編碼,但可對當前區塊之偏移合併資訊進行編碼。 The offset type and/or offset value for each block is highly likely to be the same between adjacent blocks. In the case where the offset parameter of the current block is compared with and is the same as the offset parameter of the adjacent block, the video encoding apparatus 10 according to an embodiment may offset the current block from the adjacent block. And encoded as an offset parameter. If the offset parameter of the adjacent block is first encoded, the offset parameter of the current block may not be encoded, but the offset combination information of the current block may be encoded.
根據一實施例的視訊解碼裝置20可首先解析偏移合併資訊,並在自所接收之位元串流解析偏移參數之前判定是否解析了偏移參數。視訊解碼裝置20可基於當前區塊之偏移合併資訊來判定在相鄰區塊之偏移參數中是否存在與當前區塊具有相同偏移參數之區塊。 The video decoding device 20 according to an embodiment may first parse the offset combining information and determine whether the offset parameter is parsed before parsing the offset parameter from the received bit stream. The video decoding device 20 may determine whether there is a block having the same offset parameter as the current block in the offset parameter of the adjacent block based on the offset combining information of the current block.
舉例而言,若基於當前區塊之偏移合併資訊,判定在相鄰區塊之偏移參數中存在與當前區塊具有相同偏移參數 之區塊,則視訊解碼裝置20可不解析當前區塊之偏移參數,而是可將當前區塊之偏移參數復原為與相鄰區塊之所復原之偏移參數相同。且,可基於偏移合併資訊而自相鄰區塊判定具有待參考之偏移參數之相鄰區塊。 For example, if the information is merged based on the offset of the current block, it is determined that the offset parameter in the adjacent block has the same offset parameter as the current block. For the block, the video decoding device 20 may not parse the offset parameter of the current block, but may restore the offset parameter of the current block to be the same as the restored offset parameter of the adjacent block. And, the adjacent block having the offset parameter to be referenced may be determined from the adjacent block based on the offset merge information.
舉例而言,在基於偏移合併資訊,相鄰區塊之偏移參數與當前區塊之偏移參數不同的狀況下,視訊解碼裝置20可自位元串流解析並復原當前區塊之偏移參數。 For example, in the case that the offset parameter of the adjacent block is different from the offset parameter of the current block based on the offset merge information, the video decoding device 20 can parse and restore the current block from the bit stream. Shift the parameters.
圖5為根據本發明之一實施例的用於合併偏移參數之候選參考區塊的圖式。 5 is a diagram of candidate reference blocks for combining offset parameters, in accordance with an embodiment of the present invention.
根據一實施例的視訊編碼裝置10可自於當前區塊之前復原之相鄰區塊判定作為當前區塊50之偏移參數之參考目標的相鄰區塊之候選清單。視訊編碼裝置10可將候選清單之相鄰區塊與當前區塊50之偏移參數進行比較。 The video encoding apparatus 10 according to an embodiment may determine a candidate list of adjacent blocks as a reference target of the offset parameter of the current block 50 from the adjacent blocks restored before the current block. The video encoding device 10 can compare the neighboring blocks of the candidate list with the offset parameters of the current block 50.
根據一實施例的候選清單可包含安置於與當前區塊50相同之當前畫面57中之相鄰區塊。具體而言,左側區塊51、上方區塊52、左上方區塊53以及右上方區塊54可包含於所述候選清單中。 The candidate list according to an embodiment may include adjacent blocks disposed in the same current picture 57 as the current block 50. Specifically, the left block 51, the upper block 52, the upper left block 53, and the upper right block 54 may be included in the candidate list.
根據另一實施例的視訊編碼裝置10可參考在當前畫面57之前復原之相鄰畫面58與59中的區塊55與56之偏移參數。包含於相鄰畫面58與59中之區塊55與56可為時間上安置在當前畫面57的先前畫面58與後續畫面59中且在空間上安置在與當前區塊50相同之區域中之區塊。在此狀況下,候選清單可包含當前畫面57中所包含之相鄰區塊51、52、53、54以及相鄰畫面58與59中所包含 之區塊55與56。 The video encoding device 10 according to another embodiment may refer to the offset parameters of the blocks 55 and 56 in the adjacent pictures 58 and 59 restored before the current picture 57. The blocks 55 and 56 included in the adjacent pictures 58 and 59 may be areas that are temporally placed in the previous picture 58 and the subsequent picture 59 of the current picture 57 and spatially placed in the same area as the current block 50. Piece. In this case, the candidate list may include adjacent blocks 51, 52, 53, 54 included in the current picture 57 and included in adjacent pictures 58 and 59. Blocks 55 and 56.
因此,根據一實施例的視訊編碼裝置10可根據預定參考序列而將包含於候選清單中之相鄰區塊之偏移參數與當前區塊50之偏移參數進行比較。舉例而言,根據左側區塊51、上方區塊52、左上方區塊53、右上方區塊54、先前區塊55以及後續區塊56之參考序列,相鄰區塊之偏移參數可與當前區塊50之偏移參數進行比較。所比較之相鄰區塊中與當前區塊50具有相同偏移參數之相鄰區塊可判定為參考區塊。 Therefore, the video encoding apparatus 10 according to an embodiment can compare the offset parameter of the adjacent block included in the candidate list with the offset parameter of the current block 50 according to the predetermined reference sequence. For example, according to the reference sequence of the left block 51, the upper block 52, the upper left block 53, the upper right block 54, the previous block 55, and the subsequent block 56, the offset parameters of the adjacent blocks may be The offset parameters of the current block 50 are compared. The adjacent blocks in the compared neighboring blocks having the same offset parameter as the current block 50 may be determined as reference blocks.
視訊編碼裝置10與視訊解碼裝置20可基於相同候選清單預測並參考、且編碼並傳輸、或接收並解碼鄰近區塊之間的偏移參數。根據一實施例的視訊解碼裝置20可基於偏移合併資訊自候選清單判定與當前區塊50具有相同偏移參數之相鄰區塊,並參考對應相鄰區塊之偏移參數,以復原與對應相鄰區塊之偏移參數具有相同值之當前區塊50之偏移參數。 The video encoding device 10 and the video decoding device 20 may predict and reference, and encode, and receive, and receive and decode offset parameters between adjacent blocks based on the same candidate list. The video decoding device 20 according to an embodiment may determine adjacent blocks having the same offset parameter from the current block 50 from the candidate list based on the offset merge information, and refer to the offset parameters of the corresponding adjacent blocks to recover The offset parameter corresponding to the adjacent block has the offset parameter of the current block 50 of the same value.
舉例而言,假定使用包含左側區塊51與上方區塊52之候選清單。根據一實施例的偏移參數編碼單元14可將指示左側區塊51之偏移參數是否與當前區塊50之偏移參數相同之左側偏移合併資訊以及指示上方區塊52之偏移參數是否與當前區塊50之偏移參數相同之上方偏移合併資訊編碼為偏移合併資訊。在此狀況下,當前區塊50可與左側區塊51進行比較,以判定其偏移參數是否彼此相同,且接著當前區塊50可與上方區塊52進行比較,以判定其偏 移參數是否彼此相同。可根據比較結果來判定偏移合併資訊。 For example, assume that a candidate list including the left block 51 and the upper block 52 is used. The offset parameter encoding unit 14 according to an embodiment may indicate whether the offset parameter of the left block 51 is the same as the offset parameter of the current block 50 and whether the offset parameter of the upper block 52 is The upper offset merge information, which is the same as the offset parameter of the current block 50, is encoded as offset merge information. In this case, the current block 50 can be compared with the left block 51 to determine whether their offset parameters are identical to each other, and then the current block 50 can be compared with the upper block 52 to determine its bias. Whether the shift parameters are identical to each other. The offset merge information can be determined based on the comparison result.
若左側區塊51與上方區塊52之至少一個偏移參數與當前區塊50之偏移參數相同,則偏移參數編碼單元14可對對應左側偏移合併資訊與上方偏移合併資訊進行編碼,但可不對當前區塊50之偏移參數進行編碼。 If at least one offset parameter of the left block 51 and the upper block 52 is the same as the offset parameter of the current block 50, the offset parameter encoding unit 14 may encode the corresponding left offset merge information and the upper offset merge information. However, the offset parameter of the current block 50 may not be encoded.
若左側區塊51與上方區塊52之偏移參數與當前區塊50之偏移參數不同,則偏移參數編碼單元14可對對應左側偏移合併資訊與上方偏移合併資訊以及當前區塊50之偏移參數進行編碼。 If the offset parameter of the left block 51 and the upper block 52 is different from the offset parameter of the current block 50, the offset parameter encoding unit 14 may merge the corresponding left offset combination information with the upper offset and the current block. The offset parameter of 50 is encoded.
若左側區塊51與上方區塊52之偏移參數與當前區塊50之偏移參數不同,則根據一實施例的偏移參數編碼單元14可對偏移合併資訊與當前區塊50之偏移參數進行編碼。 If the offset parameter of the left block 51 and the upper block 52 is different from the offset parameter of the current block 50, the offset parameter encoding unit 14 according to an embodiment may offset the offset merge information from the current block 50. The shift parameters are encoded.
作為另一實例,若相鄰區塊之偏移參數之部分資訊與當前區塊50之偏移參數相同,則根據一實施例的偏移參數編碼單元14可對一個位元之偏移合併資訊以及當前偏移參數中除相鄰區塊之偏移參數之相同部分資訊之外的剩餘資訊進行編碼。舉例而言,若當前區塊50與相鄰區塊的偏移值彼此相同,則可針對當前區塊50來對一個位元之偏移合併資訊以及偏移類型值進行編碼。 As another example, if part of the information of the offset parameter of the adjacent block is the same as the offset parameter of the current block 50, the offset parameter encoding unit 14 according to an embodiment may combine the offset information of one bit. And the remaining information of the current offset parameter except the same part of the offset parameter of the adjacent block is encoded. For example, if the offset values of the current block 50 and the adjacent blocks are identical to each other, the offset combining information and the offset type value of one bit may be encoded for the current block 50.
根據一實施例的視訊編碼裝置10與視訊解碼裝置20可對當前區塊50與相鄰區塊之間的偏移類型與偏移值進行比較,且,若存在與當前區塊50具有相同偏移類型與偏移值之相鄰區塊,則可傳輸並接收偏移合併資訊。 The video encoding device 10 and the video decoding device 20 according to an embodiment may compare the offset type and the offset value between the current block 50 and the adjacent block, and if there is the same offset as the current block 50. The adjacent block of the type and the offset value can transmit and receive the offset merge information.
作為另一實例,比較當前區塊50與相鄰區塊之偏移參數中的偏移類型,且,若存在與當前區塊50具有相同偏移類型之相鄰區塊,則可傳輸並接收對應相鄰區塊之偏移類型之合併資訊。 As another example, the offset type in the offset parameter of the current block 50 and the adjacent block is compared, and if there is an adjacent block having the same offset type as the current block 50, it can be transmitted and received. The combined information corresponding to the offset type of the adjacent block.
作為另一實例,比較當前區塊50與相鄰區塊之偏移參數中的偏移值,且,若存在與當前區塊50具有相同偏移值之相鄰區塊,則可傳輸並接收對應相鄰區塊之偏移值之合併資訊。 As another example, the offset value in the offset parameter of the current block 50 and the adjacent block is compared, and if there is an adjacent block having the same offset value as the current block 50, it can be transmitted and received. The combined information corresponding to the offset values of the adjacent blocks.
若儘管鄰近區塊之間的偏移類型不同,但鄰近區塊之長度相同,則鄰近區塊之偏移值可相似。舉例而言,鄰近區塊極有可能在影像所指示之物件中構成相同物件區域。因此,儘管當前區塊50之邊緣類型(垂直邊緣)與相鄰區塊之邊緣類型(對角邊緣)不同,但是當前區塊50與相鄰區塊之畫素可構成相同物件區域。因此,當前區塊50之偏移值與相鄰區塊之偏移值可傾向於相似。因此,用於當前區塊50之相鄰區塊之候選清單可包含僅具有邊緣類型之相同長度的相鄰區塊。 If the lengths of adjacent blocks are the same, although the lengths of the adjacent blocks are different, the offset values of the adjacent blocks may be similar. For example, it is highly probable that adjacent blocks will form the same object area in the object indicated by the image. Therefore, although the edge type (vertical edge) of the current block 50 is different from the edge type (diagonal edge) of the adjacent block, the pixels of the current block 50 and the adjacent block may constitute the same object area. Therefore, the offset value of the current block 50 and the offset value of the adjacent block may tend to be similar. Thus, the candidate list for adjacent blocks of the current block 50 may include adjacent blocks of the same length having only edge types.
根據一實施例的視訊編碼裝置10與視訊解碼裝置20可藉由參考具有相同長度之區塊之間的相鄰區塊之偏移參數來預測當前區塊50之偏移參數。 The video encoding apparatus 10 and the video decoding apparatus 20 according to an embodiment may predict an offset parameter of the current block 50 by referring to an offset parameter of an adjacent block between blocks having the same length.
在對偏移參數執行預測編碼的狀況下,視訊編碼裝置10與視訊解碼裝置20可用信號發送包含可參考以便對偏移參數執行預測編碼之相鄰區塊的預測候選清單。或者,始終參考最鄰近於當前區塊50之區塊之偏移參數,且因此 可不傳輸或接收包含於預測候選清單中之最鄰近的區塊。 In the case where predictive coding is performed on the offset parameters, the video encoding device 10 and the video decoding device 20 may signal a list of prediction candidates including neighboring blocks that can be referred to perform predictive coding on the offset parameters. Or, always refer to the offset parameter of the block closest to the current block 50, and thus The nearest neighbors included in the list of predicted candidates may not be transmitted or received.
根據一實施例,包含當前區塊50之最鄰近區塊之預測候選清單可(i)包含配置在參考序列中之候選區塊(ii)處於在當前區塊50之前復原且具有相同長度之候選區塊中,(iii)除具有相同偏移參數之候選區塊之外。預測候選清單之第一等級候選區塊可為最鄰近區塊。舉例而言,若預測候選清單包含安置於距當前區塊50相同距離處之左側區塊51與上方區塊52,則相比上方區塊52具有較小操作量之左側區塊51可為最鄰近區塊,所述操作量為自當前區塊50存取所需。 According to an embodiment, the list of prediction candidates including the nearest neighbor block of the current block 50 may (i) include candidates for the candidate block (ii) configured in the reference sequence to be restored before the current block 50 and having the same length In the block, (iii) except for candidate blocks having the same offset parameter. The first level candidate block of the prediction candidate list may be the nearest neighbor block. For example, if the predicted candidate list includes the left block 51 and the upper block 52 disposed at the same distance from the current block 50, the left block 51 having the smaller operation amount than the upper block 52 may be the most Adjacent blocks, the amount of operation is required for access from the current block 50.
判定預測候選清單後,可藉由參考最鄰近區塊之偏移值來對當前區塊50之偏移值執行預測編碼。可編碼並傳輸或接收當前區塊50之偏移值與最鄰近區塊之偏移值之間的差值。 After determining the prediction candidate list, predictive coding can be performed on the offset value of the current block 50 by referring to the offset value of the nearest neighbor block. The difference between the offset value of the current block 50 and the offset value of the nearest neighbor block can be encoded and transmitted or received.
<偏移預測值> <offset prediction value>
Offset[i]-Offset_prediction[i],OiLength-1 Offset[i]-Offset_prediction[i], O i Length-1
亦即,根據<偏移預測值>,可針對當前區塊50與具有相同長度Length之最鄰近區塊之間的每一邊緣類別i(或每一畫素值帶)編碼並傳輸或接收當前區塊50之偏移值Offset[i]與最鄰近區塊之偏移值Offset_prediction[i]之間的差值Offset[i]-Offset_prediction[i]。只要邊緣類別i(或畫素值帶)改變,便可傳輸或接收關於對應邊緣類別(或對應畫素值帶)之預測差分值。 That is, according to the <offset prediction value>, each edge class i (or each pixel value band) between the current block 50 and the nearest neighbor block having the same length Length can be encoded and transmitted or received. The difference between the offset value Offset[i] of the block 50 and the offset value Offset_prediction[i] of the nearest neighbor block is Offset[i]-Offset_prediction[i]. As long as the edge class i (or pixel value band) changes, the predicted difference value for the corresponding edge class (or corresponding pixel value band) can be transmitted or received.
根據一實施例的視訊編碼裝置10與視訊解碼裝置20 可有限地對偏移參數執行合併編碼或預測編碼。舉例而言,為根據畫素值帶類型來對當前區塊50之偏移參數進行編碼,儘管兩個相鄰區塊具有相同長度,即相同數目之畫素值帶,但是相鄰區塊之最大值與最小值以及當前區塊50之最大值與最小值不同,且因此若畫素值之整個範圍在相鄰畫素與當前區塊50之間不同,則根據畫素值帶類型,相鄰區塊之偏移參數與當前區塊50之偏移參數無關。因此,若相鄰區塊與當前區塊50的偏移類型之特性不同,則視訊編碼裝置10與視訊解碼裝置20較不適於合併鄰近區塊之間的偏移參數並對其執行預測編碼。 Video encoding device 10 and video decoding device 20 according to an embodiment Combining encoding or predictive encoding can be performed on the offset parameters finitely. For example, the offset parameter of the current block 50 is encoded according to the pixel value band type, although two adjacent blocks have the same length, that is, the same number of pixel value bands, but adjacent blocks The maximum value and the minimum value are different from the maximum value and the minimum value of the current block 50, and therefore, if the entire range of the pixel values is different between the adjacent pixels and the current block 50, the phase is based on the pixel value type. The offset parameter of the neighbor block is independent of the offset parameter of the current block 50. Therefore, if the characteristics of the offset type of the adjacent block and the current block 50 are different, the video encoding device 10 and the video decoding device 20 are less suitable for combining the offset parameters between the adjacent blocks and performing predictive coding on them.
根據一實施例的視訊編碼裝置10與視訊解碼裝置20可針對每一色彩分量對偏移參數執行預測編碼。 The video encoding device 10 and the video decoding device 20 according to an embodiment may perform predictive encoding on the offset parameters for each color component.
舉例而言,SAO可應用於YUV色彩格式之明度區塊與色度區塊兩者。Y分量之明度區塊之偏移類型及/或偏移值可與U與V分量之色度區塊之偏移類型及/或偏移值極其相似。 For example, SAO can be applied to both the luma block and the chroma block of the YUV color format. The offset type and/or offset value of the luma block of the Y component can be very similar to the offset type and/or offset value of the chrominance block of the U and V components.
舉例而言,視訊編碼裝置10與視訊解碼裝置20在與當前色度區塊相同的位置處將明度區塊添加至當前色度區塊之候選清單,且因此可藉由參考明度區塊之偏移參數而預測當前色度區塊之偏移參數。最高優先級可分配至候選清單中所包含之區塊之參考清單中的明度區塊。 For example, the video encoding device 10 and the video decoding device 20 add the luma block to the candidate list of the current chroma block at the same position as the current chroma block, and thus can be referenced by the reference block. The parameter is shifted to predict the offset parameter of the current chroma block. The highest priority can be assigned to the luma block in the reference list of the blocks included in the candidate list.
作為另一實例,視訊編碼裝置10與視訊解碼裝置20可基於明度分量與色度分量之偏移參數之間的預定關係來對偏移參數進行編碼。一般而言,色度區塊比明度區塊平 坦,且根據色度區塊之最大值與最小值、邊緣類別以及畫素值帶的偏移值之絕對值小於明度區塊之絕對值。 As another example, video encoding device 10 and video decoding device 20 may encode the offset parameters based on a predetermined relationship between the luminance components and the offset parameters of the chrominance components. In general, the chroma block is flatter than the luma block. Tan, and the absolute value of the offset value according to the maximum and minimum values of the chroma block, the edge class, and the pixel value band is smaller than the absolute value of the luma block.
下文<色度偏移預測方程式>解釋在基於明度區塊之偏移值判定色度區塊之偏移值的狀況下執行色度區塊之偏移值之預測編碼的實施例。 The <Chromaticity Offset Prediction Equation> below explains an embodiment of performing predictive coding of the offset value of the chroma block in the case where the offset value of the chroma block is determined based on the offset value of the luma block.
<色度偏移預測方程式> <Chroma shift prediction equation>
Value_to_be_encoded[i]=Offset[i]-F(Offset_prediction[i]);其中F(x)=A*x+B;就此而言,i表示長度範圍內之當前邊緣類別(畫素值帶),且可在視訊編碼裝置10與視訊解碼裝置20之間傳輸或接收基於色度區塊參考之明度區塊之偏移值Offset_prediction[i]而判定的色度區塊之預測值F(Offset_prediction[i])與偏移值Offset[i]之間的誤差值Value_to_be_encoded[i]。 Value_to_be_encoded[i]=Offset[i]-F(Offset_prediction[i]); where F(x)=A*x+B; in this case, i represents the current edge category (pixel value band) within the length range, And the predicted value F of the chroma block determined by the offset value Offset_prediction[i] of the luma block reference based on the chroma block reference is transmitted or received between the video encoding device 10 and the video decoding device 20 (Offset_prediction[i] ]) The error value Value_to_be_encoded[i] between the offset value Offset[i].
在F(x)中,A與B表示明度區塊與色度區塊之間的相關參數。可針對U分量與Y分量來單獨設定相關參數A與B。或者,U分量與Y分量可共用相關參數A與B。 In F(x), A and B represent related parameters between the luma block and the chroma block. The relevant parameters A and B can be individually set for the U component and the Y component. Alternatively, the U component and the Y component may share the relevant parameters A and B.
根據一實施例的視訊編碼裝置10與視訊解碼裝置20可編碼並傳輸或接收並解碼相關參數A與B,以便基於色彩分量之間的相關性來對明度區塊與色度區塊之間的偏移值執行預測編碼。根據一實施例,相關參數A與B可先前固定為預定值。可針對諸如區塊、圖像、片段、視訊序列等每一預定資料單位而判定根據一實施例的相關參數A與B,且可在針對每一區塊、圖像參數集合(picture parameter set;PPS)、片段標頭以及序列參數集合(sequence parameter set;SPS)包含於參數中後進行傳輸或接收。 The video encoding device 10 and the video decoding device 20 according to an embodiment may encode and transmit or receive and decode related parameters A and B to compare between the luma block and the chroma block based on the correlation between the color components. The offset value performs predictive coding. According to an embodiment, the relevant parameters A and B may be previously fixed to a predetermined value. The relevant parameters A and B according to an embodiment may be determined for each predetermined data unit, such as a block, image, segment, video sequence, etc., and may be for each block, picture parameter set (picture parameter) The set; PPS), the fragment header, and the sequence parameter set (SPS) are included in the parameter for transmission or reception.
圖6為說明根據本發明之一實施例的視訊編碼方法的流程圖。 6 is a flow chart illustrating a video encoding method in accordance with an embodiment of the present invention.
在操作步驟61中,可根據視訊區塊中之當前區塊之邊緣類型判定邊緣類別,或可根據畫素值帶類型判定畫素值帶。 In operation 61, the edge class may be determined according to the edge type of the current block in the video block, or the pixel value band may be determined according to the pixel value band type.
在根據邊緣類型判定當前區塊之偏移的狀況下,可藉由比較當前復原之畫素與相鄰畫素之畫素值來判定指示當前復原之畫素是否為根據邊緣方向與邊緣大小而安置的當前復原之畫素之相鄰畫素中的端點之邊緣類別。 In the case of determining the offset of the current block according to the edge type, it is determined whether the currently restored pixel is based on the edge direction and the edge size by comparing the currently restored pixel with the pixel value of the adjacent pixel. The edge category of the endpoint in the adjacent pixel of the currently restored pixel.
且,在根據所復原之畫素的畫素值帶類型來判定當前區塊之偏移的狀況下,可自多個帶判定指示當前復原之畫素之畫素值所屬之畫素值範圍的畫素值帶。 Further, in a case where the offset of the current block is determined based on the pixel value type of the restored pixel, the pixel value range indicating the pixel value of the currently restored pixel may be determined from the plurality of bands. Pixel value band.
在操作步驟63中,藉由使用包含於邊緣類別或畫素值帶中之所復原之畫素與原始畫素之間的差值來判定對應於當前邊緣類別或畫素值帶之偏移,可將包含於相同邊緣類別或相同畫素值帶中的所復原之畫素與原始畫素之間的差值之平均值判定為偏移值。 In operation 63, the offset corresponding to the current edge class or pixel value band is determined by using the difference between the restored pixel and the original pixel included in the edge class or the pixel value band. The average of the difference between the restored pixel and the original pixel included in the same edge class or the same pixel value band can be determined as an offset value.
在操作步驟65中,對每一區塊之偏移參數進行編碼。偏移參數可包含對應區塊之偏移類型、其偏移值、其長度以及其邊緣類別與其畫素值帶。 In operation 65, the offset parameters for each block are encoded. The offset parameter can include the offset type of the corresponding block, its offset value, its length, and its edge class and its pixel value band.
每一區塊之偏移類型指示對應區塊之邊緣類型或畫素值帶類型。根據每一區塊之邊緣類型將每一區塊之所復 原之畫素分類為多個邊緣類別,且針對每一邊緣類別判定每一偏移值,且因此判定了對應於多個邊緣類別之多個偏移值。或者,根據每一區塊之邊緣類型將每一區塊之所復原之畫素分類為多個畫素值帶,且針對每一畫素值帶判定每一偏移值,且因此判定了對應於多個畫素值帶之多個偏移值。根據每一區塊之邊緣類型或其畫素值帶來判定長度。因此,僅對每一區塊之偏移參數中的偏移類型與偏移值進行編碼。 The offset type of each block indicates the edge type or pixel value band type of the corresponding block. Replicating each block according to the edge type of each block The original pixels are classified into a plurality of edge categories, and each offset value is determined for each edge class, and thus a plurality of offset values corresponding to the plurality of edge categories are determined. Alternatively, the restored pixels of each block are classified into a plurality of pixel value bands according to the edge type of each block, and each offset value is determined for each pixel value band, and thus the correspondence is determined. Multiple offset values for multiple pixel values. The length of the decision is based on the edge type of each block or its pixel value. Therefore, only the offset type and offset value in the offset parameter of each block are encoded.
基於當前區塊與至少一個相鄰區塊之偏移參數之間的同一性,可對當前區塊之偏移合併資訊進行編碼。偏移合併資訊可指示是否對當前區塊之偏移參數進行編碼。亦即,若相鄰區塊包含與當前區塊具有相同偏移參數之區塊,則可僅對當前區塊之偏移合併資訊進行編碼,且不對其偏移參數進行編碼。 The offset combining information of the current block may be encoded based on the identity between the offset parameters of the current block and the at least one adjacent block. The offset merge information may indicate whether the offset parameter of the current block is encoded. That is, if the neighboring block contains a block having the same offset parameter as the current block, only the offset combining information of the current block may be encoded, and the offset parameter is not encoded.
藉由對相鄰區塊之偏移參數與當前區塊之偏移參數執行預測,可對相鄰區塊之偏移參數與當前區塊之偏移參數之間的差分資訊進行編碼。藉由參考彼此之偏移參數,可對當前區塊之明度區塊與色度區塊中的至少一個色彩分量執行預測編碼。 The difference information between the offset parameter of the adjacent block and the offset parameter of the current block may be encoded by performing prediction on the offset parameter of the adjacent block and the offset parameter of the current block. Predictive coding may be performed on at least one color component in the luma block and the chroma block of the current block by referring to the offset parameters of each other.
圖7為說明根據本發明之一實施例的視訊解碼方法的流程圖。 FIG. 7 is a flow chart illustrating a video decoding method according to an embodiment of the present invention.
在操作步驟71中,解析自所接收之位元串流的偏移合併資訊,其中偏移合併資訊指示視訊區塊中之當前區塊與至少一個相鄰區塊之偏移參數是否彼此相同之。 In operation 71, the offset combining information from the received bit stream is parsed, wherein the offset combining information indicates whether the offset parameters of the current block and the at least one adjacent block in the video block are identical to each other. .
在操作步驟73中,基於偏移合併資訊而自當前區塊之偏移參數復原偏移類型與偏移值。 In operation 73, the offset type and the offset value are restored from the offset parameter of the current block based on the offset merge information.
在操作步驟75中,基於指示偏移類型之當前區塊之邊緣類型或其畫素值帶類型來判定所復原之畫素之邊緣類別或其畫素值帶。在操作步驟77中,自偏移值判定對應於所復原之畫素的邊緣類別或其畫素值帶的偏移值,且根據偏移值來調整所復原之畫素的畫素值。 In operation 75, the edge class of the restored pixel or its pixel value band is determined based on the edge type of the current block indicating the offset type or its pixel value band type. In operation 77, the offset value corresponding to the edge type of the restored pixel or its pixel value band is determined from the offset value, and the pixel value of the restored pixel is adjusted according to the offset value.
在操作步驟75中當前區塊之偏移類型為邊緣類型的狀況下,可藉由比較當前復原之畫素與根據邊緣方向與邊緣大小而安置的當前復原之畫素之相鄰畫素的畫素值來判定當前復原之畫素的邊緣類別。在此狀況下,在操作步驟77中,可自所接收之偏移值選擇對應於當前復原之畫素之邊緣類別的偏移。 In the operation step 75, when the offset type of the current block is an edge type, the picture of the adjacent pixel of the currently restored pixel placed according to the edge direction and the edge size may be compared by comparing the currently restored pixel with the currently restored pixel. The prime value determines the edge category of the currently restored pixel. In this case, in operation 77, an offset corresponding to the edge class of the currently restored pixel can be selected from the received offset value.
且,在操作步驟75中當前區塊之偏移類型為畫素值帶類型的狀況下,可判定當前復原之畫素之畫素值帶,且在操作步驟77中,可自偏移值選擇對應於當前復原之畫素之畫素值帶的偏移。 Moreover, in the case that the offset type of the current block is the pixel value band type in operation step 75, the pixel value band of the currently restored pixel may be determined, and in operation 77, the self-offset value may be selected. The offset of the pixel value band corresponding to the currently restored pixel.
若操作步驟71中基於所述偏移合併資訊,當前區塊之左側區塊及上方區塊之至少一個偏移參數與當前區塊之偏移參數相同,則將當前區塊之偏移參數復原為與當前區塊之左側區塊與上方區塊之至少一個偏移參數相同。且,若基於偏移合併資訊,當前區塊之左側區塊及上方區塊之至少一個偏移參數與當前區塊之偏移參數不同,則可自所接收之位元串流解析並復原當前區塊之偏移參數。 If the at least one offset parameter of the left block and the upper block of the current block is the same as the offset parameter of the current block in operation step 71, the offset parameter of the current block is restored. It is the same as at least one offset parameter from the left block and the upper block of the current block. Moreover, if at least one offset parameter of the left block and the upper block of the current block is different from the offset parameter of the current block based on the offset merge information, the bit stream can be parsed and restored from the received bit stream. The offset parameter of the block.
若在操作步驟71中自位元串流解析偏移值之差分值,則藉由組合相鄰區塊之偏移值與偏移資訊之間的差分資訊,可對當前區塊之偏移值執行預測復原。 If the difference value of the offset value is parsed from the bit stream in operation step 71, the offset value of the current block can be obtained by combining the difference information between the offset value of the adjacent block and the offset information. Perform predictive recovery.
藉由操作步驟71中參考彼此之偏移參數,可對當前區塊之明度分量與色度分量中的至少一個色彩分量執行預測復原。 Predictive restoration may be performed on at least one of the luma component and the chroma component of the current block by referring to the offset parameters of each other in operation 71.
因此,使用根據一實施例的SAO的視訊編碼裝置10與視訊解碼裝置20根據影像特性(諸如,影像區塊之邊緣類型或其畫素值帶類型)而對畫素值進行分類,編碼並傳輸或接收並解碼作為具有相同特性的所分類之畫素值之間的平均誤差值的偏移值,並根據偏移值來調整所復原之畫素中未預期之畫素值,藉此將原始影像與所復原之影像之間的誤差減至最小。 Therefore, the video encoding device 10 and the video decoding device 20 using the SAO according to an embodiment classify, encode, and transmit pixel values according to image characteristics such as edge types of image blocks or their pixel value band types. Or receiving and decoding an offset value as an average error value between the classified pixel values having the same characteristics, and adjusting an unintended pixel value in the restored pixel according to the offset value, thereby The error between the image and the reconstructed image is minimized.
根據一實施例的視訊編碼裝置10與視訊解碼裝置20可將自視訊資料分割之區塊分割為樹狀結構之編碼單位,且針對上述每一最大編碼單位或每一編碼單位根據畫素分類來判定偏移集合。下文將參照圖7至圖20描述根據一實施例的基於具有樹狀結構之編碼單位與轉換單位之視訊編碼方法及裝置與視訊解碼方法及裝置。 The video encoding device 10 and the video decoding device 20 according to an embodiment may divide the block divided by the video data into coding units of a tree structure, and according to the pixel classification for each of the maximum coding units or each coding unit. Determine the offset set. A video encoding method and apparatus and video decoding method and apparatus based on a coding unit and a conversion unit having a tree structure according to an embodiment will be described below with reference to FIGS. 7 through 20.
圖8為根據本發明之一實施例的基於具有樹狀結構之編碼單位的視訊編碼裝置100的方塊圖。 FIG. 8 is a block diagram of a video encoding apparatus 100 based on a coding unit having a tree structure, in accordance with an embodiment of the present invention.
根據一實施例的涉及基於具有樹狀結構之編碼單位之視訊預測的視訊編碼裝置100包含最大編碼單位分割器110、編碼單位判定器120以及輸出單元130。為便於描述, 根據一實施例的涉及基於具有樹狀結構之編碼單位之視訊預測的視訊編碼裝置100在下文中將稱為「視訊編碼裝置100」。 A video encoding apparatus 100 relating to video prediction based on a coding unit having a tree structure according to an embodiment includes a maximum coding unit divider 110, a coding unit determiner 120, and an output unit 130. For the convenience of description, A video encoding apparatus 100 relating to video prediction based on a coding unit having a tree structure according to an embodiment will hereinafter be referred to as "video encoding apparatus 100".
最大編碼單位分割器110可基於影像之當前圖像之最大編碼單位來分割當前圖像。若當前圖像大於最大編碼單位,則當前圖像之影像資料可分割為至少一個最大編碼單位。根據本發明之一實施例的最大編碼單位可為大小為32×32、64×64、128×128、256×256等之資料單位,其中資料單位之形狀是寬度以及長度為2的平方之正方形。影像資料可根據至少一個最大編碼單位而輸出至編碼單位判定器120。 The maximum coding unit divider 110 may segment the current image based on the maximum coding unit of the current image of the image. If the current image is larger than the maximum coding unit, the image data of the current image may be divided into at least one maximum coding unit. The maximum coding unit according to an embodiment of the present invention may be a data unit having a size of 32×32, 64×64, 128×128, 256×256, etc., wherein the shape of the data unit is a square of a width and a square of length 2 . The image data may be output to the coding unit determiner 120 according to at least one maximum coding unit.
根據本發明之一實施例的編碼單位可藉由最大大小以及深度來表徵。深度表示編碼單位自最大編碼單位在空間上分割之次數,且隨著深度加深,根據深度之較深編碼單位可自最大編碼單位分割為最小編碼單位。最大編碼單位之深度為最上層深度,且最小編碼單位之深度為最下層深度。由於對應於每一深度之編碼單位的大小隨著最大編碼單位之深度加深而減小,因此對應於較上層深度之編碼單位可包含對應於較下層深度的多個編碼單位。 A coding unit according to an embodiment of the present invention can be characterized by a maximum size and depth. The depth indicates the number of times the coding unit is spatially separated from the maximum coding unit, and as the depth deepens, the deeper coding unit according to the depth can be divided into the smallest coding unit from the maximum coding unit. The depth of the largest coding unit is the uppermost depth, and the depth of the smallest coding unit is the lowest depth. Since the size of the coding unit corresponding to each depth decreases as the depth of the maximum coding unit deepens, the coding unit corresponding to the upper layer depth may include a plurality of coding units corresponding to the lower layer depth.
如上文所述,當前圖像之影像資料根據編碼單位之最大大小分割為最大編碼單位,且最大編碼單位中的每一者可包含根據深度而分割的較深編碼單位。由於根據本發明之一實施例的最大編碼單位是根據深度來分割,因此包含於最大編碼單位中之空間域的影像資料可根據深度而階層 式分類。 As described above, the image material of the current image is divided into maximum coding units according to the maximum size of the coding unit, and each of the largest coding units may include a deeper coding unit that is divided according to the depth. Since the maximum coding unit according to an embodiment of the present invention is segmented according to depth, image data of a spatial domain included in a maximum coding unit may be hierarchical according to depth Classification.
限制最大編碼單位之高度以及寬度階層式分割之總次數的編碼單位之最大深度以及最大大小可為預定的。 The maximum depth and maximum size of the coding unit that limits the height of the maximum coding unit and the total number of times of the hierarchical segmentation may be predetermined.
編碼單位判定器120對藉由根據深度來分割最大編碼單位之區域而獲得的至少一個分割區域進行編碼,並判定深度以根據所述至少一個分割區域輸出最終編碼之影像資料。換言之,編碼單位判定器120藉由根據當前圖像之最大編碼單位來對根據深度之較深編碼單位中之影像資料進行編碼以及選擇具有最小編碼誤差的深度來判定經編碼之深度。因此,最終輸出對應於所判定的經編碼的深度之編碼單位的經編碼之影像資料。且,對應於所述經編碼的深度之編碼單位可視為經編碼之編碼單位。 The coding unit determiner 120 encodes at least one divided region obtained by dividing the region of the maximum coding unit according to the depth, and determines the depth to output the finally encoded image data according to the at least one divided region. In other words, the coding unit determiner 120 determines the encoded depth by encoding the image data in the deeper coding unit according to the depth according to the maximum coding unit of the current image and selecting the depth having the smallest coding error. Therefore, the encoded image data corresponding to the determined coding unit of the encoded depth is finally output. And, the coding unit corresponding to the encoded depth may be regarded as an encoded coding unit.
所判定之經編碼的深度以及根據所判定之經編碼的深度的經編碼之影像資料輸出至輸出單元130。 The determined encoded depth and the encoded image data according to the determined encoded depth are output to output unit 130.
基於對應於等於或低於最大深度之至少一個深度的較深編碼單位,對最大編碼單位中之影像資料進行編碼,且基於較深編碼單位中的每一者比較對影像資料進行編碼之結果。可在比較較深編碼單位之編碼誤差之後選擇具有最小編碼誤差的深度。可針對每一最大編碼單位選擇至少一個經編碼之深度。 The image data in the largest coding unit is encoded based on a deeper coding unit corresponding to at least one depth equal to or lower than the maximum depth, and the result of encoding the image data is compared based on each of the deeper coding units. The depth with the smallest coding error can be selected after comparing the coding errors of the deeper coding units. At least one encoded depth may be selected for each maximum coding unit.
隨著編碼單位根據深度而階層式分割,且隨著編碼單位之數目增大,最大編碼單位的大小被分割。且,即使編碼單位對應於一個最大編碼單位中之同一深度,仍藉由單獨量測每一編碼單位之影像資料的編碼誤差而判定是否將 對應於同一深度之編碼單位中的每一者分割為較下層深度。因此,即使當影像資料包含於一個最大編碼單位中時,影像資料仍根據深度分割為區域,且編碼誤差可根據此一個最大編碼單位中之區域而不同,且因此經編碼之深度可根據影像資料中之區域而不同。因此,可在一個最大編碼單位中判定一或多個經編碼之深度,且可根據至少一個經編碼之深度的編碼單位而劃分最大編碼單位之影像資料。 As the coding unit is hierarchically split according to depth, and as the number of coding units increases, the size of the largest coding unit is split. Moreover, even if the coding unit corresponds to the same depth in one maximum coding unit, it is determined whether the coding error of the image data of each coding unit is separately measured to determine whether Each of the coding units corresponding to the same depth is divided into a lower depth. Therefore, even when the image data is included in one maximum coding unit, the image data is still divided into regions according to the depth, and the coding error may be different according to the region in the one largest coding unit, and thus the encoded depth may be based on the image data. The area is different. Thus, one or more encoded depths may be determined in one maximum coding unit, and the image data of the largest coding unit may be divided according to coding units of at least one encoded depth.
因此,編碼單位判定器120可判定包含於最大編碼單位中之具有樹狀結構的編碼單位。根據本發明之一實施例的「具有樹狀結構的編碼單位」包含最大編碼單位中所包含之所有較深編碼單位中的對應於判定為經編碼之深度的深度的編碼單位。可根據最大編碼單位之同一區域中的深度而階層式判定經編碼之深度的編碼單位,且可在不同區域中獨立地進行判定。類似地,可獨立於另一區域中之經編碼之深度而判定當前區域中之經編碼的深度。 Therefore, the coding unit determiner 120 can determine the coding unit having a tree structure included in the maximum coding unit. The "coding unit having a tree structure" according to an embodiment of the present invention includes a coding unit corresponding to a depth determined to be the coded depth among all the deeper coding units included in the maximum coding unit. The coding unit of the encoded depth may be hierarchically determined according to the depth in the same region of the maximum coding unit, and the determination may be independently performed in different regions. Similarly, the encoded depth in the current region can be determined independently of the encoded depth in another region.
根據本發明之一實施例的最大深度為與自最大編碼單位至最小編碼單位之分割次數相關的索引。根據本發明之一實施例的第一最大深度可表示自最大編碼單位至最小編碼單位之總分割次數。根據本發明之一實施例的第二最大深度可表示自最大編碼單位至最小編碼單位之總深度層級數。舉例而言,當最大編碼單位之深度為0時,最大編碼單位被分割一次之編碼單位的深度可設定為1,且最大編碼單位被分割兩次之編碼單位的深度可設定為2。此處,若最小編碼單位為最大編碼單位被分割四次之編碼單 位,則存在深度0、1、2、3以及4的5個深度層級,且因此第一最大深度可設定為4,且第二最大深度可設定為5。 The maximum depth according to an embodiment of the present invention is an index related to the number of divisions from the maximum coding unit to the minimum coding unit. The first maximum depth according to an embodiment of the present invention may represent the total number of divisions from the maximum coding unit to the minimum coding unit. The second maximum depth in accordance with an embodiment of the present invention may represent the total depth level from the largest coding unit to the smallest coding unit. For example, when the depth of the maximum coding unit is 0, the depth of the coding unit in which the maximum coding unit is divided once may be set to 1, and the depth of the coding unit in which the maximum coding unit is divided twice may be set to 2. Here, if the minimum coding unit is the code list in which the maximum coding unit is divided four times Bits, there are 5 depth levels of depths 0, 1, 2, 3, and 4, and thus the first maximum depth can be set to 4, and the second maximum depth can be set to 5.
可根據最大編碼單位執行預測編碼以及轉換。根據最大編碼單位,亦基於根據等於最大深度之深度或小於最大深度之深度的較深編碼單位來執行預測編碼以及轉換。可根據正交轉換或整數轉換方法來執行轉換。 Predictive coding and conversion can be performed according to the maximum coding unit. The predictive coding and the conversion are also performed based on the deeper coding unit according to the depth equal to the depth of the maximum depth or the depth less than the maximum depth, according to the maximum coding unit. The conversion can be performed according to an orthogonal conversion or an integer conversion method.
由於只要根據深度來分割最大編碼單位,較深編碼單位之數目便增大,因此對隨著深度加深而產生的所有較深編碼單位執行包含預測編碼以及轉換的編碼。為便於描述,在最大編碼單位中,現將基於當前深度之編碼單位來描述預測編碼以及轉換。 Since the number of deeper coding units is increased as long as the maximum coding unit is divided according to the depth, the coding including the prediction coding and the conversion is performed on all the deeper coding units generated as the depth is deepened. For convenience of description, in the maximum coding unit, prediction coding and conversion will now be described based on the coding unit of the current depth.
視訊編碼裝置100可按各種方式選擇用於對影像資料進行編碼之資料單位的大小或形狀。為了對影像資料進行編碼,執行諸如預測編碼、轉換以及熵編碼之操作,且此時,同一資料單位可用於所有操作或不同資料單位可用於每一操作。 The video encoding device 100 can select the size or shape of the data unit used to encode the video material in various ways. In order to encode the image data, operations such as predictive coding, conversion, and entropy coding are performed, and at this time, the same data unit can be used for all operations or different data units can be used for each operation.
舉例而言,視訊編碼裝置100可不僅選擇用於對影像資料進行編碼之編碼單位,而且選擇不同於編碼單位之資料單位,以便對編碼單位中之影像資料執行預測編碼。 For example, the video encoding apparatus 100 may select not only a coding unit for encoding the video data but also a data unit different from the coding unit to perform predictive coding on the image data in the coding unit.
為了在最大編碼單位中執行預測編碼,可基於對應於經編碼之深度的編碼單位(亦即,基於不再對應於較下層深度分割編碼單位編碼單位的編碼單位)來執行預測編碼。下文中,不再分割且變為用於預測編碼的基礎單元之編碼單位現將稱作「預測單位」。藉由分割預測單位而獲得 之分區可包含藉由分割預測單位之高度以及寬度中的至少一者而獲得的預測單位或資料單位。分區為自編碼單位之預測單位分割的資料單位,且預測單位可為與編碼單位具有相同大小的分區。 In order to perform predictive coding in a maximum coding unit, predictive coding may be performed based on a coding unit corresponding to the coded depth (ie, based on a coding unit that no longer corresponds to a lower layer depth division coding unit coding unit). Hereinafter, the coding unit that is no longer split and becomes the base unit for predictive coding will now be referred to as a "prediction unit." Obtained by dividing the prediction unit The partition may include a prediction unit or a data unit obtained by dividing at least one of a height and a width of the prediction unit. The partition is a data unit divided by the prediction unit of the coding unit, and the prediction unit may be a partition having the same size as the coding unit.
舉例而言,當2N×2N(其中N為正整數)之編碼單位不再分割時,編碼單位變為2N×2N之預測單位,分區之大小可為2N×2N、2N×N、N×2N或N×N。分區類型之實例包含藉由對稱地分割預測單位之高度或寬度而獲得的對稱分區、藉由非對稱地分割預測單位之高度或寬度(諸如,1:n或n:1)而獲得的分區、藉由用幾何方式分割預測單位而獲得之分區,以及具有任意形狀的分區。 For example, when the coding unit of 2N×2N (where N is a positive integer) is no longer split, the coding unit becomes a prediction unit of 2N×2N, and the size of the partition may be 2N×2N, 2N×N, N×2N. Or N × N. Examples of partition types include symmetric partitions obtained by symmetrically dividing the height or width of prediction units, partitions obtained by asymmetrically dividing the height or width of prediction units (such as 1:n or n:1), A partition obtained by geometrically dividing a prediction unit, and a partition having an arbitrary shape.
預測單位之預測模式可為畫面內模式、畫面間模式以及跳過模式(skip mode)中之至少一者。舉例而言,可對2N×2N、2N×N、N×2N或N×N之分區執行畫面內模式或畫面間模式。且,可僅對2N×2N之分區執行跳過模式。在編碼單位中對一個預測單位獨立地執行編碼,藉此選擇具有最小編碼誤差的預測模式。 The prediction mode of the prediction unit may be at least one of an intra-picture mode, an inter-picture mode, and a skip mode. For example, an intra-picture mode or an inter-picture mode may be performed on a partition of 2N×2N, 2N×N, N×2N, or N×N. Also, the skip mode can be performed only for the partition of 2N×2N. The encoding is performed independently for one prediction unit in the coding unit, thereby selecting the prediction mode having the smallest coding error.
視訊編碼裝置100亦可不僅基於用於對影像資料進行編碼之編碼單位,而且基於不同於編碼單位之資料單位而對編碼單位中的影像資料執行轉換。 The video encoding device 100 can also perform conversion on the video data in the coding unit based on not only the coding unit for encoding the video data but also the data unit different from the coding unit.
為了在編碼單位中執行轉換,可基於具有小於或等於編碼單位之大小的資料單位來執行轉換。舉例而言,資料單位可包含用於畫面內模式之資料單位以及用於畫面間模式之轉換單位。 In order to perform the conversion in the coding unit, the conversion may be performed based on a data unit having a size smaller than or equal to the coding unit. For example, the data unit can include a data unit for the intra-picture mode and a conversion unit for the inter-picture mode.
亦可在轉換單位中設定轉換深度,其中轉換深度指示藉由分割編碼單位之高度以及寬度而達到轉換單位之分割次數。舉例而言,在2N×2N之當前編碼單位中,當轉換單位之大小亦為2N×2N時,轉換深度可為0;在當前編碼單位之高度與寬度中之每一者分割為兩個相等部分、完全分割為4^1個轉換單位且轉換單位之大小因此為N×N時,轉換深度可為1;且在當前編碼單位之高度與寬度中之每一者分割為四個相等部分、完全分割為4^2個轉換單位且轉換單位之大小因此為N/2×N/2時,轉換深度可為2。舉例而言,可根據階層式樹狀結構來設定轉換單位,其中較上層轉換深度之轉換單位根據轉換深度之階層式特性而分割為較下層轉換深度之四個轉換單位。 The conversion depth can also be set in the conversion unit, wherein the conversion depth indicates the number of divisions of the conversion unit by dividing the height and width of the coding unit. For example, in the current coding unit of 2N×2N, when the size of the conversion unit is also 2N×2N, the conversion depth may be 0; each of the height and the width of the current coding unit is divided into two equals. Partially and completely divided into 4^1 conversion units and the size of the conversion unit is therefore N×N, the conversion depth may be 1; and each of the height and width of the current coding unit is divided into four equal parts, When the size is completely divided into 4^2 conversion units and the conversion unit is N/2×N/2, the conversion depth can be 2. For example, the conversion unit may be set according to the hierarchical tree structure, wherein the conversion unit of the upper layer conversion depth is divided into four conversion units of the lower layer conversion depth according to the hierarchical characteristic of the conversion depth.
類似於編碼單位,編碼單位中之轉換單位可按遞迴方式分割為大小較小的區域,使得可按區域為單位來獨立判定轉換單位。因此,可根據具有根據轉換深度之樹狀結構的轉換單位而劃分編碼單位中之殘餘資料。 Similar to the coding unit, the conversion unit in the coding unit can be divided into smaller-sized areas in a recursive manner, so that the conversion unit can be independently determined in units of regions. Therefore, the residual data in the coding unit can be divided according to the conversion unit having the tree structure according to the conversion depth.
根據對應於經編碼之深度的編碼單位的編碼資訊不僅需要關於經寫碼之深度的資訊,而且需要關於預測編碼以及轉換之資訊。因此,編碼單位判定器120不僅判定具有最小編碼誤差之經編碼的深度,而且判定預測單位中的分區類型、根據預測單位之預測模式以及用於轉換之轉換單位之大小。 The encoded information according to the coding unit corresponding to the encoded depth requires not only information about the depth of the coded code but also information about the predictive coding and conversion. Therefore, the coding unit decider 120 not only determines the coded depth having the smallest coding error, but also determines the partition type in the prediction unit, the prediction mode according to the prediction unit, and the size of the conversion unit for conversion.
稍後將參照圖7至圖19詳細描述在最大編碼單位、預測單位、分區以及轉換單位中根據樹狀結構判定編碼單 位之方法。 Determining the code list according to the tree structure in the maximum coding unit, the prediction unit, the partition, and the conversion unit will be described later in detail with reference to FIGS. 7 to 19. Bit method.
編碼單位判定器120可藉由基於拉格朗日乘數(Lagrangian multiplier)使用位元率-失真最佳化(Rate-Distortion Optimization)來量測根據深度之較深編碼單位之編碼誤差。 The coding unit determiner 120 can measure the coding error of the deeper coding unit according to the depth by using the Rate-Distortion Optimization based on the Lagrangian multiplier.
輸出單元130按照位元串流的形式輸出基於由編碼單位判定器120判定之至少一個經編碼之深度而編碼的最大編碼單位之影像資料,以及根據經編碼之深度關於編碼模式的資訊。 The output unit 130 outputs image data of a maximum coding unit encoded based on at least one encoded depth determined by the coding unit determiner 120 in the form of a bit stream, and information on the coding mode according to the encoded depth.
可藉由對影像之殘餘資料進行編碼來獲得經編碼之影像資料。 The encoded image data can be obtained by encoding the residual data of the image.
根據經編碼之深度關於編碼模式的資訊可包含關於經編碼之深度、關於預測單位中之分區類型、預測模式以及轉換單位之大小的資訊。 The information about the encoding mode according to the encoded depth may include information about the encoded depth, the partition type in the prediction unit, the prediction mode, and the size of the conversion unit.
可藉由使用根據深度之分割資訊來定義關於經編碼之深度的資訊,根據深度之分割資訊指示是否對較下層深度而非當前深度之編碼單位執行編碼。若當前編碼單位之當前深度為經編碼之深度,則當前編碼單位中之影像資料得以編碼且輸出,且因此分割資訊可定義為不將當前編碼單位分割為較下層深度。或者,若當前編碼單位之當前深度並非經編碼之深度,則對較下層深度之編碼單位執行編碼,且因此分割資訊可定義為分割當前編碼單位以獲得較下層深度的編碼單位。 The information about the encoded depth may be defined by using the segmentation information according to the depth, and the segmentation information according to the depth indicates whether encoding is performed on the coding unit of the lower layer depth instead of the current depth. If the current depth of the current coding unit is the encoded depth, the image data in the current coding unit is encoded and output, and thus the segmentation information may be defined as not dividing the current coding unit into a lower depth. Or, if the current depth of the current coding unit is not the coded depth, the coding is performed on the coding unit of the lower layer depth, and thus the segmentation information may be defined as dividing the current coding unit to obtain a coding unit of a lower layer depth.
若當前深度並非經編碼之深度,則對分割為較下層深 度之編碼單位的編碼單位執行編碼。由於較下層深度之至少一個編碼單位存在於當前深度之一個編碼單位中,因此對較下層深度之每一編碼單位重複地執行編碼,且因此可對具有同一深度之編碼單位按遞迴方式執行編碼。 If the current depth is not the encoded depth, the segmentation is deeper than the lower layer. The coding unit of the coding unit of degree performs encoding. Since at least one coding unit of the lower layer depth exists in one coding unit of the current depth, encoding is repeatedly performed for each coding unit of the lower layer depth, and thus coding can be performed in a recursive manner for coding units having the same depth. .
由於針對一個最大編碼單位而判定具有樹狀結構之編碼單位,且針對經編碼之深度的編碼單位而判定關於至少一個編碼模式的資訊,因此可針對一個最大編碼單位而判定關於至少一個編碼模式的資訊。且,最大編碼單位之影像資料的經編碼之深度可根據位置而不同,此是因為根據深度而階層式分割影像資料,且因此可針對影像資料而設定關於經編碼之深度以及編碼模式的資訊。 Since the coding unit having the tree structure is determined for one maximum coding unit, and the information about the at least one coding mode is determined for the coding unit of the coded depth, the information about the at least one coding mode may be determined for one maximum coding unit. News. Moreover, the coded depth of the image data of the largest coding unit may be different depending on the position, because the image data is hierarchically divided according to the depth, and thus information about the coded depth and the coding mode can be set for the image data.
因此,輸出單元130可將關於對應經編碼之深度以及編碼模式之編碼資訊指派給包含於最大編碼單位中之編碼單位、預測單位以及最小單元中的至少一者。 Accordingly, the output unit 130 may assign encoding information regarding the corresponding encoded depth and the encoding mode to at least one of a coding unit, a prediction unit, and a minimum unit included in the maximum coding unit.
根據本發明之一實施例的最小單元為藉由將構成最下層深度的最小編碼單位分割為4份而獲得的矩形資料單位。或者,最小單元可為可包含於最大編碼單位中所包含之所有編碼單位、預測單位、分區單元以及轉換單位中的最大矩形資料單位。 A minimum unit according to an embodiment of the present invention is a rectangular data unit obtained by dividing a minimum coding unit constituting a lowermost layer depth into four copies. Alternatively, the smallest unit may be the largest rectangular data unit that can be included in all coding units, prediction units, partition units, and conversion units included in the maximum coding unit.
舉例而言,經由輸出單元130而輸出之編碼資訊可分類為根據編碼單位之編碼資訊,以及根據預測單位的編碼資訊。根據編碼單位之編碼資訊可包含關於預測模式以及關於分區之大小的資訊。根據預測單位之編碼資訊可包含關於畫面間模式之估計方向、關於畫面間模式之參考影像 索引、關於運動向量、關於畫面內模式之色度分量以及關於畫面內模式之內插方法的資訊。且,關於根據圖像、片段或圖像群組(Group Of Pictures,GOP)所定義之編碼單位之最大大小的資訊以及關於最大深度之資訊可***至位元串流、序列參數集合(Sequence Parameter Set,SPS)或圖像參數集合(Picture Parameter Set)的標頭中。 For example, the encoded information output via the output unit 130 can be classified into encoded information according to the coding unit, and encoded information according to the prediction unit. The encoded information according to the coding unit may contain information about the prediction mode and about the size of the partition. The coding information according to the prediction unit may include an estimation direction regarding the inter-picture mode and a reference image regarding the inter-picture mode. Index, information about motion vectors, chrominance components about intra-picture modes, and interpolation methods for intra-picture modes. Moreover, the information about the maximum size of the coding unit defined by the image, the segment or the group of pictures (GOP) and the information about the maximum depth can be inserted into the bit stream, the sequence parameter set (Sequence Parameter Set, SPS) or the header of the Picture Parameter Set.
且,可經由位元串流、序列參數集合或圖像參數集合之標頭輸出關於可供當前視訊使用的轉換單位之最大大小之資訊以及關於轉換單位之最小大小之資訊。輸出單元130可對參照圖1至圖6所描述的與預測有關的參考資訊、雙向預測資訊、包含第四片段類型的片段類型資訊等進行編碼及輸出。 Moreover, the information about the maximum size of the conversion unit available for the current video and the minimum size information about the conversion unit may be output via the bit stream, the sequence parameter set, or the header of the image parameter set. The output unit 130 may encode and output the prediction related reference information, the bidirectional prediction information, the segment type information including the fourth segment type, and the like described with reference to FIGS. 1 to 6.
在視訊編碼裝置100中,較深編碼單位可為藉由將較上層深度之編碼單位(其為上一層)的高度或寬度劃分為2份而獲得的編碼單位。換言之,在當前深度之編碼單位的大小為2N×2N時,較下層深度之編碼單位的大小為N×N。且,大小為2N×2N之當前深度的編碼單位可包含較下層深度的最大4個編碼單位。 In the video encoding apparatus 100, the deeper coding unit may be a coding unit obtained by dividing the height or width of the coding unit of the upper layer depth (which is the upper layer) into two. In other words, when the size of the coding unit of the current depth is 2N×2N, the size of the coding unit of the lower layer depth is N×N. Moreover, the coding unit of the current depth of 2N×2N may include a maximum of 4 coding units of the lower layer depth.
因此,視訊編碼裝置100可基於考慮當前圖像之特性而判定的最大編碼單位之大小以及最大深度,藉由針對每一最大編碼單位判定具有最佳形狀以及最佳大小的編碼單位而形成具有樹狀結構之編碼單位。且,由於藉由使用各種預測模式以及轉換中之任一者對每一最大編碼單位執行編碼,因此可考慮各種影像大小之編碼單位的特性來判定 最佳編碼模式。 Therefore, the video encoding apparatus 100 can form a tree having the optimal shape and the optimal size of the coding unit for each maximum coding unit based on the size of the maximum coding unit and the maximum depth determined in consideration of the characteristics of the current image. The coding unit of the structure. Moreover, since encoding is performed for each maximum coding unit by using any of various prediction modes and conversions, it is possible to determine the characteristics of coding units of various image sizes. The best coding mode.
因此,若在習知巨集區塊中對具有高解析度或大資料量之影像進行編碼,則每圖像之巨集區塊的數目過度地增大。因此,針對每一巨集區塊產生之壓縮資訊之片段的數目增大,且因此難以傳輸壓縮資訊,且資料壓縮效率降低。然而,藉由使用視訊編碼裝置100,因為在考慮影像之大小而增大編碼單位的最大大小的同時考慮影像之特性而調整編碼單位,所以影像壓縮效率可提高。 Therefore, if an image having a high resolution or a large amount of data is encoded in a conventional macroblock, the number of macroblocks per image is excessively increased. Therefore, the number of segments of compressed information generated for each macroblock is increased, and thus it is difficult to transmit compressed information, and data compression efficiency is lowered. However, by using the video encoding apparatus 100, since the coding unit is adjusted in consideration of the characteristics of the video while increasing the maximum size of the coding unit in consideration of the size of the video, the image compression efficiency can be improved.
圖8之視訊編碼裝置100可執行上文參照圖1所描述之視訊編碼裝置10之操作。 The video encoding apparatus 100 of FIG. 8 can perform the operations of the video encoding apparatus 10 described above with reference to FIG. 1.
編碼單位判定器120可執行視訊編碼裝置10之偏移判定單元12之操作。編碼單位判定器120可藉由根據每一最大編碼單位之邊緣類型來對畫素值進行分類而判定每一邊緣類別之偏移值,或藉由根據畫素值帶類型對畫素值進行分類而判定每一畫素值帶之偏移值。諸如邊緣類別或畫素值帶之每一畫素群組之偏移值可為包含於對應畫素群組中之所復原之畫素與原始畫素之間的平均誤差值。作為另一實例,可針對諸如編碼單位、預測單位以及轉換單位之每一預定資料單位來判定邊緣類別與偏移值或畫素值帶與偏移值。 The coding unit determiner 120 can perform the operation of the offset determination unit 12 of the video encoding device 10. The coding unit determiner 120 may determine the offset value of each edge class by classifying the pixel values according to the edge type of each maximum coding unit, or classify the pixel values according to the pixel value type according to the pixel value type. The offset value of each pixel value is determined. The offset value of each pixel group such as the edge class or the pixel value band may be the average error value between the restored pixel and the original pixel included in the corresponding pixel group. As another example, the edge class and the offset value or the pixel value band and the offset value may be determined for each predetermined data unit such as a coding unit, a prediction unit, and a conversion unit.
輸出單元130可對針對每一最大編碼單位判定之偏移參數中的偏移類型與偏移值進行編碼。在針對諸如編碼單位、預測單位以及轉換單位之每一預定資料單位來判定偏移參數的狀況下,偏移類型與偏移值可編碼為對應資料單 位之參數。 The output unit 130 may encode the offset type and the offset value in the offset parameter determined for each maximum coding unit. In the case where the offset parameter is determined for each predetermined data unit such as a coding unit, a prediction unit, and a conversion unit, the offset type and the offset value may be encoded as corresponding data sheets. Bit parameter.
輸出單元130可藉由參考相鄰最大編碼單位之相鄰偏移參數來對當前最大編碼單位之當前偏移參數執行預測編碼。若相鄰偏移參數中之至少一個與當前偏移參數相同,則輸出單元130可對當前最大編碼單位之偏移合併資訊進行編碼,而不對當前偏移參數進行編碼。若相鄰偏移參數與當前偏移參數彼此不同,則輸出單元130可對當前最大編碼單位之偏移合併資訊與當前偏移參數進行編碼。 The output unit 130 may perform predictive encoding on the current offset parameter of the current maximum coding unit by referring to the adjacent offset parameter of the adjacent maximum coding unit. If at least one of the adjacent offset parameters is the same as the current offset parameter, the output unit 130 may encode the offset combining information of the current maximum coding unit without encoding the current offset parameter. If the adjacent offset parameter and the current offset parameter are different from each other, the output unit 130 may encode the offset combining information of the current maximum coding unit and the current offset parameter.
圖9為根據本發明之一實施例的基於具有樹狀結構之編碼單位的視訊解碼裝置200的方塊圖。 9 is a block diagram of a video decoding device 200 based on a coding unit having a tree structure, in accordance with an embodiment of the present invention.
根據一實施例的涉及基於具有樹狀結構之編碼單位之視訊預測的視訊解碼裝置200包含接收器210、影像資料以及編碼資訊提取器220、影像資料解碼器230。為便於描述,根據一實施例的涉及基於具有樹狀結構之編碼單位之視訊預測的視訊解碼裝置200在下文中將稱為「視訊解碼裝置200」。 A video decoding apparatus 200 for video prediction based on a coding unit having a tree structure according to an embodiment includes a receiver 210, an image data, and an encoding information extractor 220 and a video material decoder 230. For convenience of description, a video decoding apparatus 200 relating to video prediction based on a coding unit having a tree structure according to an embodiment will hereinafter be referred to as "video decoding apparatus 200".
用於視訊解碼裝置200之各種操作的各種術語(諸如,編碼單位、深度、預測單位、轉換單位以及關於各種編碼模式之資訊)的定義與圖7以及視訊編碼裝置100所述的術語相同。 The definitions of various terms (such as coding units, depths, prediction units, conversion units, and information about various coding modes) for various operations of the video decoding apparatus 200 are the same as those described in FIG. 7 and the video encoding apparatus 100.
接收器210接收且解析經編碼之視訊之位元串流。影像資料以及編碼資訊提取器220自所解析之位元串流提取每一編碼單位之經編碼之影像資料,其中編碼單位具有根據每一最大編碼單位之樹狀結構,且將所提取之影像資料 輸出至影像資料解碼器230。影像資料以及編碼資訊提取器220可自關於當前圖像或SPS之標頭提取關於當前圖像之編碼單位之最大大小的資訊。 Receiver 210 receives and parses the bitstream of the encoded video. The image data and coded information extractor 220 extracts the encoded image data of each coding unit from the parsed bit stream, wherein the coding unit has a tree structure according to each maximum coding unit, and the extracted image data is to be extracted. Output to the image data decoder 230. The image data and coded information extractor 220 may extract information about the maximum size of the coding unit of the current image from the header of the current image or SPS.
且,影像資料以及編碼資訊提取器220自所解析之位元串流針對具有根據每一最大編碼單位之樹狀結構之編碼單位提取關於經編碼之深度以及編碼模式的資訊。關於經編碼之深度以及編碼模式之所提取之資訊輸出至影像資料解碼器230。換言之,位元串流中之影像資料分割為最大編碼單位,使得影像資料解碼器230對每一最大編碼單位之影像資料進行解碼。 And, the image data and encoding information extractor 220 extracts information about the encoded depth and the encoding mode from the parsed bit stream for the coding unit having the tree structure according to each maximum coding unit. The extracted information about the encoded depth and the encoding mode is output to the image data decoder 230. In other words, the image data in the bit stream is divided into maximum coding units, so that the image data decoder 230 decodes the image data of each maximum coding unit.
可針對關於對應於經編碼之深度之至少一個編碼單位的資訊而設定根據最大編碼單位關於經編碼之深度以及編碼模式之資訊,且關於編碼模式的資訊可包含關於對應於經編碼之深度之對應編碼單位的分區類型、關於預測模式以及轉換單位之大小的資訊。且,可將根據深度之分割資訊作為關於經編碼之深度的資訊來提取。 Information about the encoded depth and the coding mode according to the maximum coding unit may be set for information about at least one coding unit corresponding to the encoded depth, and the information about the coding mode may include a correspondence with respect to the encoded depth The partition type of the coding unit, information about the prediction mode, and the size of the conversion unit. And, the segmentation information according to the depth can be extracted as information about the encoded depth.
由影像資料以及編碼資訊提取器220提取的根據每一最大編碼單位關於經編碼之深度以及編碼模式的資訊,為關於經判定以在諸如視訊編碼裝置100之編碼器根據每一最大編碼單位對根據深度之每一較深編碼單位重複地執行編碼時,產生最小編碼誤差的經編碼之深度以及編碼模式的資訊。因此,視訊解碼裝置200可藉由根據產生最小編碼誤差的經編碼之深度以及編碼模式來對影像資料進行解碼而復原影像。 The information about the encoded depth and the coding mode according to each maximum coding unit extracted by the image data and the coded information extractor 220 is determined according to the encoder determined by the image coding apparatus 100 according to each maximum coding unit pair. When each of the deeper coding units of the depth repeatedly performs coding, the encoded depth of the minimum coding error and the information of the coding mode are generated. Therefore, the video decoding device 200 can restore the video by decoding the video data according to the encoded depth and the encoding mode that generate the minimum encoding error.
由於關於經編碼之深度以及編碼模式之編碼資訊可指派給對應編碼單位、預測單位以及最小單元中一預定資料單位,因此影像資料以及編碼資訊提取器220可根據預定資料單位提取資料單位關於經編碼之深度以及編碼模式的資訊。被指派關於經編碼之深度以及編碼模式之相同資訊的預定資料單位可推斷為包含於同一最大編碼單位中的資料單位。 Since the encoded information about the encoded depth and the coding mode can be assigned to the corresponding coding unit, the prediction unit, and a predetermined data unit of the minimum unit, the image data and the coded information extractor 220 can extract the data unit according to the predetermined data unit. Depth and information on the encoding mode. The predetermined data unit assigned the same information about the encoded depth and the coding mode can be inferred to be the data unit contained in the same maximum coding unit.
影像資料解碼器230藉由基於根據最大編碼單位關於經編碼之深度以及編碼模式之資訊而對每一最大編碼單位中的影像資料進行解碼來復原當前圖像。換言之,影像資料解碼器230可基於關於每一最大編碼單位中所包含之具有樹狀結構的編碼單位中的每一編碼單位之分區類型、預測模式以及轉換單位的所提取之資訊而對經編碼之影像資料進行解碼。解碼程序可包含:包含畫面內預測以及運動補償之預測;以及逆轉換。可根據逆正交轉換或逆整數轉換之方法執行逆轉換。 The image data decoder 230 restores the current image by decoding the image data in each maximum coding unit based on the information about the encoded depth and the encoding mode according to the maximum coding unit. In other words, the image data decoder 230 may encode the extracted information based on the partition type, the prediction mode, and the conversion unit of each coding unit in the coding unit having the tree structure included in each maximum coding unit. The image data is decoded. The decoding process may include: prediction including intra-picture prediction and motion compensation; and inverse conversion. The inverse conversion can be performed according to the method of inverse orthogonal transform or inverse integer transform.
影像資料解碼器230可基於根據經編碼之深度關於每一編碼單位之預測單位之分區類型以及預測模式的資訊,根據所述編碼單位之分區以及預測模式來執行畫面內預測或運動補償。 The image data decoder 230 may perform intra-picture prediction or motion compensation based on the partitioning of the coding unit and the prediction mode based on information on the partition type and the prediction mode of the prediction unit for each coding unit according to the encoded depth.
且,影像資料解碼器230可根據編碼單位中的每一轉換單位基於關於根據經編碼之深度的編碼單位的轉換單位之大小的資訊來執行逆轉換,以便根據最大編碼單位來執行逆轉換。 Also, the image data decoder 230 may perform inverse conversion based on information on the size of the conversion unit of the coding unit according to the encoded depth according to each conversion unit in the coding unit to perform inverse conversion according to the maximum coding unit.
影像資料解碼器230可藉由使用根據深度之分割資訊而判定當前最大編碼單位之至少一個經編碼之深度。若分割資訊指示影像資料在當前深度中不再分割,則當前深度為經編碼之深度。因此,影像資料解碼器230可藉由使用關於對應於經編碼之深度之每一編碼單位的預測單位之分區類型、預測模式以及轉換單位之大小的資訊來對對應於當前最大編碼單位中之每一經編碼之深度的至少一個編碼單位之經編碼之資料進行解碼,且輸出當前最大編碼單位之影像資料。 The image data decoder 230 may determine at least one encoded depth of the current maximum coding unit by using the segmentation information according to the depth. If the split information indicates that the image data is no longer split in the current depth, the current depth is the encoded depth. Therefore, the image data decoder 230 can correspond to each of the current maximum coding units by using information about the partition type, the prediction mode, and the size of the conversion unit of the prediction unit corresponding to each coding unit of the encoded depth. The encoded data of at least one coding unit of the encoded depth is decoded, and the image data of the current maximum coding unit is output.
換言之,可藉由觀測針對編碼單位、預測單位以及最小單元中的預定資料單位指派的編碼資訊集合,而收集含有包含相同分割資訊之編碼資訊的資料單位,且可將所收集之資料單位視為待由影像資料解碼器230在同一編碼模式中解碼的一個資料單位。可藉由針對如上所述判定之編碼單位獲得關於編碼模式之資訊來執行當前編碼單位之解碼。 In other words, the data unit containing the coded information including the same split information can be collected by observing the coded information set assigned to the predetermined unit of data in the coding unit, the prediction unit, and the minimum unit, and the collected data unit can be regarded as A unit of data to be decoded by the image data decoder 230 in the same encoding mode. The decoding of the current coding unit can be performed by obtaining information about the coding mode for the coding unit determined as described above.
且,圖9之視訊解碼裝置200可執行上文參照圖2所描述之視訊解碼裝置20之操作。 Moreover, the video decoding device 200 of FIG. 9 can perform the operations of the video decoding device 20 described above with reference to FIG. 2.
接收器210以及影像資料以及編碼資訊提取器220可執行視訊解碼裝置20之偏移參數解析單元22之操作。影像資料解碼器230可執行視訊解碼裝置20之偏移調整單元24之操作。 The receiver 210 and the image data and coded information extractor 220 can perform the operations of the offset parameter parsing unit 22 of the video decoding device 20. The image data decoder 230 can perform the operation of the offset adjustment unit 24 of the video decoding device 20.
在僅自位元串流解析偏移合併資訊而無當前最大編碼單位之偏移參數的狀況下,影像資料以及編碼資訊提取 器220可將當前偏移參數復原為與相鄰偏移參數中的至少一個相同。可基於偏移合併資訊來判定相鄰偏移參數中待參考之參數。若基於自位元串流解析之當前最大編碼單位之偏移合併資訊而判定相鄰偏移參數與當前偏移參數彼此不同,則影像資料以及編碼資訊提取器220可自位元串流解析並復原當前最大編碼單位之當前偏移參數。 Image data and encoding information extraction in the case where only the offset combining information is parsed from the bit stream without the offset parameter of the current maximum coding unit The switch 220 may restore the current offset parameter to be the same as at least one of the adjacent offset parameters. The parameters to be referenced in the adjacent offset parameters may be determined based on the offset combining information. If it is determined that the adjacent offset parameter and the current offset parameter are different from each other based on the offset combination information of the current maximum coding unit parsed from the bit stream, the image data and the coded information extractor 220 may be parsed from the bit stream and Restores the current offset parameter of the current maximum coding unit.
影像資料以及編碼資訊提取器220可藉由參考相鄰最大編碼單位之相鄰偏移參數來對當前最大編碼單位中的當前偏移參數執行預測復原。 The image data and encoding information extractor 220 may perform predictive restoration on the current offset parameter in the current maximum coding unit by referring to adjacent offset parameters of adjacent maximum coding units.
影像資料解碼器230可自位元串流解析每一最大編碼單位之偏移參數。可自所復原的偏移參數判定當前最大編碼單位之偏移類型為邊緣類型或畫素值帶類型。若當前最大編碼單位之偏移類型為邊緣類型,則可判定每一所復原之畫素之邊緣類別,且可自偏移參數之偏移值選擇對應於每一所復原之畫素之邊緣類別的偏移值。若當前最大編碼單位之偏移類型為畫素值帶類型,則可判定每一所復原之畫素之每一畫素值帶,且自所解析且包含於偏移參數內之偏移值選擇對應於每一所復原之畫素之畫素值帶的偏移值。 The image data decoder 230 may parse the offset parameter of each maximum coding unit from the bit stream. The offset type of the current maximum coding unit can be determined from the restored offset parameter as an edge type or a pixel value band type. If the offset type of the current maximum coding unit is an edge type, the edge class of each restored pixel may be determined, and the edge value corresponding to each restored pixel may be selected from the offset value of the offset parameter. Offset value. If the offset type of the current maximum coding unit is a pixel value band type, each pixel value band of each restored pixel can be determined, and the offset value selected from the offset parameter is selected. The offset value corresponding to the pixel value band of each restored pixel.
影像資料解碼器230可藉由按對應於每一所復原之畫素之偏移值調整對應的所復原之畫素值而產生相對於原始畫素具有最小誤差的所復原之畫素。作為另一實例,在針對諸如編碼單位、預測單位以及轉換單位之每一預定資料單位解析偏移參數的狀況下,可針對每一對應資料單位復 原對應於每一邊緣類別之偏移值,或可復原對應於每一畫素值帶之偏移值。 The image data decoder 230 may generate the restored pixels having the smallest error with respect to the original pixels by adjusting the corresponding restored pixel values in accordance with the offset values corresponding to each of the restored pixels. As another example, in the case of parsing the offset parameter for each predetermined data unit such as a coding unit, a prediction unit, and a conversion unit, the corresponding data unit may be complexed for each corresponding data unit. The offset value originally corresponding to each edge class, or the offset value corresponding to each pixel value band can be restored.
總而言之,視訊解碼裝置200可獲得關於當對每一最大編碼單位按遞迴方式執行編碼時產生最小編碼誤差之至少一個編碼單位之資訊,且可使用所述資訊來對當前圖像進行解碼。換言之,可對判定為每一最大編碼單位中的最佳編碼單位的具有樹狀結構之編碼單位進行解碼。且,考慮到解析度與影像資料量而判定編碼單位之最大大小。 In summary, the video decoding apparatus 200 can obtain information on at least one coding unit that generates a minimum coding error when encoding is performed in a recursive manner for each maximum coding unit, and can use the information to decode the current image. In other words, the coding unit having the tree structure determined to be the optimum coding unit in each maximum coding unit can be decoded. Moreover, the maximum size of the coding unit is determined in consideration of the resolution and the amount of image data.
因此,即使影像資料具有高解析度及大量資料,仍可藉由使用自編碼器接收之關於最佳編碼模式之資訊,藉由使用根據影像資料之特性適應性地判定之編碼單位之大小及編碼模式而有效地對影像資料進行解碼及復原 Therefore, even if the image data has high resolution and a large amount of data, the information about the optimal coding mode received by the self-encoder can be used, and the size and coding of the coding unit adaptively determined according to the characteristics of the image data can be used. Mode and effective decoding and restoration of image data
圖10為用於描述根據本發明之一實施例的編碼單位之概念的圖式。 FIG. 10 is a diagram for describing a concept of a coding unit according to an embodiment of the present invention.
編碼單位之大小可用寬度×高度來表達,且可為64×64、32×32、16×16以及8×8。64×64之編碼單位可分割為64×64、64×32、32×64或32×32之分區,且32×32之編碼單位可分割為32×32、32×16、16×32或16×16的分區,16×16之編碼單位可分割為16×16、16×8、8×16或8×8之分區,且8×8之編碼單位可分割為8×8、S×4、4×8或4×4的分區。 The size of the coding unit can be expressed by width x height, and can be 64×64, 32×32, 16×16, and 8×8. The coding unit of 64×64 can be divided into 64×64, 64×32, and 32×64. Or a 32×32 partition, and the 32×32 coding unit can be divided into 32×32, 32×16, 16×32 or 16×16 partitions, and the 16×16 coding unit can be divided into 16×16, 16×. 8, 8 × 16 or 8 × 8 partitions, and 8 × 8 coding units can be divided into 8 × 8, S × 4, 4 × 8, or 4 × 4 partitions.
在視訊資料310中,解析度為1920×1080,編碼單位之最大大小為64,且最大深度為2。在視訊資料320中,解析度為1920×1080,編碼單位之最大大小為64,且最大 深度為3。在視訊資料330中,解析度為352×288,編碼單位之最大大小為16,且最大深度為1。圖10所示之最大深度表示自最大編碼單位至最小編碼單位之總分割次數。 In the video material 310, the resolution is 1920×1080, the maximum size of the coding unit is 64, and the maximum depth is 2. In the video material 320, the resolution is 1920×1080, and the maximum size of the coding unit is 64, and the maximum The depth is 3. In the video material 330, the resolution is 352×288, the maximum size of the coding unit is 16, and the maximum depth is 1. The maximum depth shown in Fig. 10 indicates the total number of divisions from the maximum coding unit to the minimum coding unit.
若解析度高或資料量大,則編碼單位之最大大小可為大的,以便提高編碼效率外而且更準確地反映影像之特性。因此,具有高於視訊資料330之解析度的視訊資料310以及320之編碼單位的最大大小可為64。 If the resolution is high or the amount of data is large, the maximum size of the coding unit can be large, so as to improve the coding efficiency and more accurately reflect the characteristics of the image. Therefore, the maximum size of the coding units of the video material 310 and 320 having a resolution higher than that of the video material 330 may be 64.
由於視訊資料310之最大深度為2,因此視訊資料310之編碼單位315可包含長軸大小為64的最大編碼單位,以及長軸大小為32以及16的編碼單位,此是因為深度藉由分割最大編碼單位兩次而加深為兩層。同時,由於視訊資料330之最大深度為1,因此視訊資料330之編碼單位335可包含長軸大小為16的最大編碼單位,以及長軸大小為8之編碼單位,此是因為深度藉由分割最大編碼單位一次而加深為一層。 Since the maximum depth of the video material 310 is 2, the coding unit 315 of the video material 310 can include a maximum coding unit with a long axis size of 64 and a coding unit with a long axis size of 32 and 16, because the depth is maximized by segmentation. The coding unit is twice and deepened into two layers. Meanwhile, since the maximum depth of the video material 330 is 1, the coding unit 335 of the video material 330 may include a maximum coding unit having a long axis size of 16 and a coding unit having a long axis size of 8, because the depth is maximized by division. The coding unit is deepened to one level at a time.
由於視訊資料320之最大深度為3,因此視訊資料320之編碼單位325可包含長軸大小為64的最大編碼單位,以及長軸大小為32、16以及8的編碼單位,此是因為深度藉由分割最大編碼單位三次而加深為三層。隨著深度加深,可精確地表達詳細資訊。 Since the maximum depth of the video material 320 is 3, the coding unit 325 of the video data 320 can include a maximum coding unit having a long axis size of 64 and a coding unit having a long axis size of 32, 16, and 8, because the depth is due to the depth. Split the maximum coding unit three times and deepen it to three layers. As the depth deepens, detailed information can be accurately expressed.
圖11為根據本發明之一實施例的基於編碼單位之影像編碼器400的方塊圖。 11 is a block diagram of a video encoder 400 based on coding units, in accordance with an embodiment of the present invention.
影像編碼器400執行視訊編碼裝置100之編碼單位判定器120的操作以對影像資料進行編碼。換言之,畫面內 預測器410對當前畫面405中的處於畫面內模式中之編碼單位執行畫面內預測,且運動估計器420以及運動補償器425藉由使用當前畫面405以及參考畫面495而對當前畫面405中處於畫面間模式中的編碼單位執行畫面間估計以及運動補償。 The video encoder 400 performs an operation of the coding unit determiner 120 of the video encoding device 100 to encode the video material. In other words, within the picture The predictor 410 performs intra-picture prediction on the coding unit in the intra-picture mode in the current picture 405, and the motion estimator 420 and the motion compensator 425 are in the current picture 405 by using the current picture 405 and the reference picture 495. The coding unit in the inter mode performs inter-picture estimation and motion compensation.
自畫面內預測器410、運動估計器420以及運動補償器425輸出之資料經由轉換器430以及量化器440作為經量化之轉換係數而輸出。經量化之轉換係數經由逆量化器460以及逆轉換器470復原為空間域中之資料,且空間域中之所復原之資料在經由解區塊單元480以及迴路濾波單元490後處理之後作為參考畫面495輸出。經量化之轉換係數可經由熵編碼器450作為位元串流455輸出。 The data output from the intra-screen predictor 410, the motion estimator 420, and the motion compensator 425 is output as a quantized conversion coefficient via the converter 430 and the quantizer 440. The quantized transform coefficients are restored to data in the spatial domain via inverse quantizer 460 and inverse transformer 470, and the recovered data in the spatial domain is processed as a reference picture after being processed by deblocking unit 480 and loop filtering unit 490. 495 output. The quantized conversion coefficients may be output as a bit stream 455 via the entropy encoder 450.
為了使影像編碼器400應用於視訊編碼裝置100中,影像編碼器400之所有元件(亦即,畫面內預測器410、運動估計器420、運動補償器425、轉換器430、量化器440、熵編碼器450、逆量化器460、逆轉換器470、解區塊單元480以及迴路濾波單元490)在考慮每一最大編碼單位之最大深度的同時基於具有樹狀結構之編碼單位中的每一編碼單位來執行操作。 In order to apply the image encoder 400 to the video encoding device 100, all components of the image encoder 400 (ie, the intra-screen predictor 410, the motion estimator 420, the motion compensator 425, the converter 430, the quantizer 440, and the entropy) The encoder 450, the inverse quantizer 460, the inverse transformer 470, the deblocking unit 480, and the loop filtering unit 490) are based on each of the coding units having a tree structure while considering the maximum depth of each maximum coding unit. Unit to perform the operation.
具體言之,畫面內預測器410、運動估計器420以及運動補償器425在考慮當前最大編碼單位之最大大小以及最大深度的同時判定具有樹狀結構之編碼單位中的每一編碼單位之分區以及預測模式,且轉換器430判定具有樹狀結構之編碼單位中的每一編碼單位中之轉換單位的大小。 Specifically, the intra-screen predictor 410, the motion estimator 420, and the motion compensator 425 determine the partition of each coding unit in the coding unit having the tree structure while considering the maximum size and the maximum depth of the current maximum coding unit, and The mode is predicted, and the converter 430 determines the size of the conversion unit in each coding unit in the coding unit having the tree structure.
影像編碼器400可根據參考畫面495之每一最大編碼單位的邊緣類型(或畫素值帶)來對畫素進行分類,針對每一所復原之畫素判定邊緣類別(或畫素值帶),並判定屬於每一邊緣類別(或每一畫素值帶)之所復原之畫素的平均誤差值。可編碼並傳輸或接收並解碼每一最大編碼單位之偏移類型與偏移值。 The image encoder 400 may classify pixels according to an edge type (or a pixel value band) of each maximum coding unit of the reference picture 495, and determine an edge class (or a pixel value band) for each restored pixel. And determine the average error value of the restored pixels belonging to each edge class (or each pixel value band). The offset type and offset value for each maximum coding unit can be encoded and transmitted or received and decoded.
圖12為根據本發明之一實施例的基於編碼單位之影像解碼器500的方塊圖。 Figure 12 is a block diagram of a video decoder 500 based on coding units, in accordance with an embodiment of the present invention.
解析器510自位元串流505解析待解碼之經編碼之影像資料以及解碼所需之關於編碼的資訊。經編碼之影像資料經由熵解碼器520以及逆量化器530作為經逆量化之資料而輸出,且經逆量化之資料經由逆轉換器540而復原為空間域中的影像資料。 The parser 510 parses the encoded image data to be decoded from the bit stream 505 and the information about the encoding required for decoding. The encoded image data is output as inverse quantized data via the entropy decoder 520 and the inverse quantizer 530, and the inverse quantized data is restored to the image data in the spatial domain via the inverse transformer 540.
畫面內預測器550關於空間域中之影像資料對處於畫面內模式中之編碼單位執行畫面內預測,且運動補償器560藉由使用參考畫面585對處於畫面間模式中的編碼單位執行運動補償。 The intra-screen predictor 550 performs intra-picture prediction on the coding unit in the intra-picture mode with respect to the video material in the spatial domain, and the motion compensator 560 performs motion compensation on the coding unit in the inter-picture mode by using the reference picture 585.
通過畫面內預測器550以及運動補償器560之空間域中的影像資料可在經由解區塊單元570以及迴路濾波單元580後處理之後作為所復原之畫面595輸出。且,經由解區塊單元570以及迴路濾波單元580後處理之影像資料可作為參考畫面585輸出。 The image data in the spatial domain by the intra-screen predictor 550 and the motion compensator 560 can be output as the restored picture 595 after being processed by the deblocking unit 570 and the loop filtering unit 580. Moreover, the image data post-processed by the deblocking unit 570 and the loop filtering unit 580 can be output as the reference picture 585.
為了在視訊解碼裝置200之影像資料解碼器230中對影像資料進行解碼,影像解碼器500可執行在解析器510 之後執行的操作。 In order to decode the image data in the image data decoder 230 of the video decoding device 200, the image decoder 500 may be executed in the parser 510. The operation that is performed afterwards.
為了使影像解碼器500應用於視訊解碼裝置200中,影像解碼器500之所有元件(亦即,解析器510、熵解碼器520、逆量化器530、逆轉換器540、畫面內預測器550、運動補償器560、解區塊單元570以及迴路濾波單元580)針對每一最大編碼單位基於具有樹狀結構之編碼單位來執行操作。 In order to apply the video decoder 500 to the video decoding device 200, all components of the video decoder 500 (ie, the parser 510, the entropy decoder 520, the inverse quantizer 530, the inverse converter 540, the intra-screen predictor 550, The motion compensator 560, the deblocking unit 570, and the loop filtering unit 580) perform operations based on coding units having a tree structure for each maximum coding unit.
具體言之,畫面內預測550與運動補償器560基於具有樹狀結構之編碼單位中之每一者的分區與預測模式來執行操作,且逆轉換器540基於每一編碼單位之轉換單位之大小來執行操作。 In particular, intra-picture prediction 550 and motion compensator 560 perform operations based on partition and prediction modes of each of the coding units having a tree structure, and inverse converter 540 is based on the size of the conversion unit of each coding unit. To perform the operation.
影像解碼器500可自位元串流提取最大編碼單位之偏移參數,且藉由使用包含於偏移參數中之偏移類型與偏移值按對應於對應邊緣類別或畫素值帶之偏移值來調整所復原之畫面595之每一最大編碼單位的每一所復原之畫素。 The image decoder 500 may extract the offset parameter of the maximum coding unit from the bit stream, and use the offset type and the offset value included in the offset parameter to correspond to the corresponding edge class or the pixel value band. The value is shifted to adjust each restored pixel of each of the largest coding units of the restored picture 595.
圖13為說明根據本發明之一實施例的根據深度之較深編碼單位以及分區的圖式。 13 is a diagram illustrating deeper coding units and partitions according to depths, in accordance with an embodiment of the present invention.
視訊編碼裝置100以及視訊解碼裝置200使用階層式編碼單位以便考慮影像之特性。可根據影像之特性來適應性地判定編碼單位之最大高度、最大寬度以及最大深度,或可由使用者不同地進行設定。可根據編碼單位之預定最大大小判定根據深度之較深編碼單位的大小。 The video encoding device 100 and the video decoding device 200 use hierarchical coding units to consider the characteristics of the video. The maximum height, the maximum width, and the maximum depth of the coding unit can be adaptively determined according to the characteristics of the image, or can be set differently by the user. The size of the deeper coding unit according to the depth may be determined according to the predetermined maximum size of the coding unit.
在根據本發明之一實施例的編碼單位之階層式結構600中,編碼單位之最大高度以及最大寬度各為64,且最 大深度為4。由於深度沿著階層式結構600之垂直軸加深,因此將較深編碼單位之高度以及寬度各自分割。且,沿著階層式結構600之水平軸展示作為用於每一較深編碼單位之預測編碼之基礎的預測單位以及分區。 In the hierarchical structure 600 of the coding unit according to an embodiment of the present invention, the maximum height and the maximum width of the coding unit are 64, and the most The maximum depth is 4. Since the depth is deepened along the vertical axis of the hierarchical structure 600, the height and width of the deeper coding units are each divided. And, along the horizontal axis of the hierarchical structure 600, prediction units and partitions that are the basis for predictive coding for each deeper coding unit are shown.
換言之,編碼單位610為階層式結構600中之最大編碼單位,其中深度為0且大小(亦即,高度乘寬度)為64×64。深度沿著垂直軸而加深,且存在大小為32×32且深度為1之編碼單位620、大小為16×16且深度為2之編碼單位630、大小為8×8且深度為3之編碼單位640,以及大小為4×4且深度為4的編碼單位650。大小為4×4且深度為4之編碼單位650為最小編碼單位。 In other words, the coding unit 610 is the largest coding unit in the hierarchical structure 600, where the depth is 0 and the size (ie, height multiplied by width) is 64×64. The depth is deepened along the vertical axis, and there is a coding unit 620 having a size of 32×32 and a depth of 1, a coding unit 630 having a size of 16×16 and a depth of 2, a coding unit having a size of 8×8 and a depth of 3 640, and a coding unit 650 having a size of 4×4 and a depth of 4. A coding unit 650 having a size of 4×4 and a depth of 4 is the smallest coding unit.
編碼單位之預測單位以及分區根據每一深度沿著水平軸而配置。換言之,若大小為64×64且深度為0之編碼單位610為預測單位,則預測單位可分割為包含於編碼單位610中的分區,亦即,大小為64×64之分區610、大小為64×32之分區612、大小為32×64之分區614或大小為32×32的分區616。 The prediction unit of the coding unit and the partition are configured along the horizontal axis according to each depth. In other words, if the coding unit 610 having a size of 64×64 and a depth of 0 is a prediction unit, the prediction unit can be divided into partitions included in the coding unit 610, that is, a partition 610 having a size of 64×64 and a size of 64. A partition 612 of ×32, a partition 614 of size 32x64, or a partition 616 of size 32x32.
類似地,大小為32×32且深度為1之編碼單位620的預測單位可分割為包含於編碼單位620中的分區,亦即,大小為32×32之分區620、大小為32×16之分區622、大小為16×32之分區624以及大小為16×16的分區626。 Similarly, a prediction unit of a coding unit 620 having a size of 32×32 and a depth of 1 may be divided into partitions included in the coding unit 620, that is, a partition 620 having a size of 32×32 and a partition having a size of 32×16. 622, a partition 624 having a size of 16 x 32 and a partition 626 having a size of 16 x 16.
類似地,大小為16×16且深度為2之編碼單位630的預測單位可分割為包含於編碼單位630中的分區,亦即,包含於編碼單位中的大小為16×16之分區630、大小為 16×8之分區632、大小為8×16之分區634以及大小為8×8的分區636。 Similarly, a prediction unit of a coding unit 630 having a size of 16×16 and a depth of 2 may be divided into partitions included in the coding unit 630, that is, a partition 630 of size 16×16 included in the coding unit, and a size. for A 16x8 partition 632, a size 8x16 partition 634, and a size 8x8 partition 636.
類似地,大小為8×8且深度為3之編碼單位640的預測單位可分割為包含於編碼單位640中的分區,亦即,包含於編碼單位中的大小為8×8之分區640、大小為8×4之分區642、大小為4×8之分區644以及大小為4×4的分區646。 Similarly, a prediction unit of a coding unit 640 having a size of 8×8 and a depth of 3 may be divided into partitions included in the coding unit 640, that is, a partition 640 having a size of 8×8 included in the coding unit, and a size. It is an 8x4 partition 642, a 4x8 partition 644, and a 4x4 partition 646.
大小為4×4且深度為4之編碼單位650為最小編碼單位以及最下層深度之編碼單位。編碼單位650之預測單位僅指派給大小為4×4之分區。 A coding unit 650 having a size of 4×4 and a depth of 4 is a coding unit of a minimum coding unit and a lowest depth. The prediction unit of coding unit 650 is only assigned to a partition of size 4x4.
為了判定構成最大編碼單位610之編碼單位的至少一個經編碼之深度,視訊編碼裝置100之編碼單位判定器120對包含於最大編碼單位610中之對應於每一深度的編碼單位執行編碼。 In order to determine at least one encoded depth of the coding unit constituting the maximum coding unit 610, the coding unit decider 120 of the video encoding apparatus 100 performs encoding on the coding unit corresponding to each depth included in the maximum coding unit 610.
隨著深度加深,包含相同範圍中之資料以及相同大小的根據深度之較深編碼單位的數目增大。舉例而言,需要對應於深度2之四個編碼單位來涵蓋包含於對應於深度1之一個編碼單位中的資料。因此,為了比較根據深度之相同資料的編碼結果,將對應於深度1之編碼單位以及對應於深度2之四個編碼單位各自編碼。 As the depth deepens, the number of deeper coding units according to depth in the data in the same range and the same size increases. For example, four coding units corresponding to depth 2 are required to cover the data contained in one coding unit corresponding to depth 1. Therefore, in order to compare the encoding results of the same material according to the depth, the coding unit corresponding to depth 1 and the four coding units corresponding to depth 2 are each encoded.
為了針對深度中之當前深度執行編碼,可藉由沿著階層式結構600之水平軸對對應於當前深度之編碼單位中的每一預測單位執行編碼而針對當前深度選擇最小編碼誤差。或者,可藉由比較根據深度之最小編碼誤差、藉由隨 著深度沿著階層式結構600之垂直軸加深而針對每一深度執行編碼來搜尋最小編碼誤差。可選擇編碼單位610中具有最小編碼誤差之深度以及分區作為編碼單位610之經編碼之深度以及分區類型。 To perform encoding for the current depth in depth, a minimum encoding error may be selected for the current depth by performing encoding on each of the prediction units corresponding to the current depth along the horizontal axis of the hierarchical structure 600. Alternatively, by comparing the minimum coding error according to depth, by The depth is deepened along the vertical axis of the hierarchical structure 600 and encoding is performed for each depth to search for a minimum coding error. The depth with the smallest coding error in the coding unit 610 and the encoded depth as the coding unit 610 and the partition type may be selected.
圖14為用於描述根據本發明之一實施例的編碼單位710與轉換單位720之間的關係的圖式。 FIG. 14 is a diagram for describing a relationship between a coding unit 710 and a conversion unit 720 according to an embodiment of the present invention.
視訊編碼裝置100或200針對每一最大編碼單位根據具有小於或等於最大編碼單位之大小的編碼單位來對影像進行編碼或解碼。可基於不大於對應編碼單位之資料單位而選擇在編碼期間用於轉換之轉換單位的大小。 The video encoding device 100 or 200 encodes or decodes an image according to a coding unit having a size smaller than or equal to a maximum coding unit for each maximum coding unit. The size of the conversion unit used for conversion during encoding may be selected based on a data unit not greater than the corresponding coding unit.
舉例而言,在視訊編碼裝置100或200中,若編碼單位710之大小為64×64,則可藉由使用大小為32×32之轉換單位720來執行轉換。 For example, in the video encoding apparatus 100 or 200, if the size of the coding unit 710 is 64×64, the conversion can be performed by using the conversion unit 720 having a size of 32×32.
且,可藉由對大小為小於64×64之32×32、16×16、8×8以及4×4之轉換單位中的每一者執行轉換而對大小為64×64之編碼單位710的資料進行編碼,且接著可選擇具有最小編碼誤差的轉換單位。 Moreover, the coding unit 710 having a size of 64×64 can be performed by performing conversion on each of 32×32, 16×16, 8×8, and 4×4 conversion units of size smaller than 64×64. The data is encoded and then the conversion unit with the smallest coding error can be selected.
圖15為用於描述根據本發明之一實施例的對應於經編碼之深度的編碼單位之編碼資訊的圖式。 15 is a diagram for describing encoding information corresponding to a coding unit of an encoded depth according to an embodiment of the present invention.
視訊編碼裝置100之輸出單元130可對關於分區類型之資訊800、關於預測模式之資訊810,以及關於對應於經編碼之深度的每一編碼單位的轉換單位之大小的資訊820進行編碼且作為關於編碼模式之資訊而傳輸。 The output unit 130 of the video encoding apparatus 100 may encode the information about the partition type 800, the information 810 regarding the prediction mode, and the information 820 regarding the size of the conversion unit corresponding to each coding unit of the encoded depth and as Transmission of information in the encoding mode.
資訊800指示關於藉由分割當前編碼單位之預測單位 而獲得的分區之形狀的資訊,其中分區為用於當前編碼單位之預測編碼的資料單位。舉例而言,大小為2N×2N之當前編碼單位CU_0可分割為大小為2N×2N之分區802、大小為2N×N之分區804、大小為N×2N之分區806以及大小為N×N的分區808中之任一者。此處,關於分區類型的資訊800設定為指示大小為2N×N之分區804、大小為N×2N之分區806以及大小為N×N的分區808中之一者。 Information 800 indicates the prediction unit by dividing the current coding unit And the information of the shape of the obtained partition, wherein the partition is a data unit for predictive encoding of the current coding unit. For example, the current coding unit CU_0 of size 2N×2N can be divided into a partition 802 of size 2N×2N, a partition 804 of size 2N×N, a partition 806 of size N×2N, and a size of N×N. Any of the partitions 808. Here, the information 800 regarding the partition type is set to indicate one of the partition 804 having a size of 2N×N, the partition 806 having a size of N×2N, and the partition 808 having a size of N×N.
資訊810指示每一分區之預測模式。舉例而言,資訊810可指示對由資訊800指示之分區執行的預測編碼之模式,亦即,畫面內模式812、畫面間模式814或跳過模式816。 Information 810 indicates the prediction mode for each partition. For example, the information 810 can indicate a mode of predictive coding performed on the partition indicated by the information 800, that is, an intra-picture mode 812, an inter-picture mode 814, or a skip mode 816.
資訊820指示待基於何時對當前編碼單位執行轉換之轉換單位。舉例而言,轉換單位可為第一畫面內轉換單位822、第二畫面內轉換單位824、第一畫面間轉換單位826或第二畫面間轉換單位828。 The information 820 indicates a conversion unit to be based on when the conversion is performed on the current coding unit. For example, the conversion unit may be the first intra-picture conversion unit 822, the second intra-picture conversion unit 824, the first inter-picture conversion unit 826, or the second inter-picture conversion unit 828.
根據每一較深編碼單位,視訊解碼裝置200之影像資料以及編碼資訊提取器220可提取且使用資訊800、810以及820以用於解碼。 Based on each deeper coding unit, the video material of the video decoding device 200 and the coded information extractor 220 can extract and use the information 800, 810, and 820 for decoding.
圖16為根據本發明之一實施例的根據深度之較深編碼單位的圖式。 16 is a diagram of darker coding units according to depth, in accordance with an embodiment of the present invention.
分割資訊可用以指示深度之改變。分割資訊指示當前深度之編碼單位是否分割為較下層深度之編碼單位。 Split information can be used to indicate a change in depth. The split information indicates whether the coding unit of the current depth is divided into coding units of a lower depth.
用於深度為0且大小為2N_0×2N_0之編碼單位900之預測編碼的預測單位910可包含大小為2N_0×2N_0之分 區類型912、大小為2N_0×N_0之分區類型914、大小為N_0×2N_0之分區類型916以及大小為N_0×N_0的分區類型918之分區。圖16僅說明藉由對稱地分割預測單位910而獲得之分區類型912至918,但分區類型不限於此,且預測單位910之分區可包含非對稱分區、具有預定形狀之分區以及具有幾何形狀的分區。 The prediction unit 910 for predictive coding of a coding unit 900 having a depth of 0 and a size of 2N_0×2N_0 may include a size of 2N_0×2N_0 A partition type 914, a partition type 914 having a size of 2N_0×N_0, a partition type 916 having a size of N_0×2N_0, and a partition type 918 having a size of N_0×N_0. 16 illustrates only the partition types 912 to 918 obtained by symmetrically dividing the prediction unit 910, but the partition type is not limited thereto, and the partition of the prediction unit 910 may include an asymmetric partition, a partition having a predetermined shape, and a geometric shape. Partition.
根據每一分區類型,對大小為2N_0×2N_0之一個分區、大小為2N_0×N_0之兩個分區、大小為N_0×2N_0之兩個分區以及大小為N_0×N_0的四個分區重複地執行預測編碼。可對大小為2N_0×2N_0、N_0×2N_0、2N_0×N_0以及N_0×N_0之分區執行在畫面內模式以及畫面間模式中之預測編碼。僅對大小為2N_0×2N_0之分區執行在跳過模式中之預測編碼。 According to each partition type, predictive coding is repeatedly performed on one partition of size 2N_0×2N_0, two partitions of size 2N_0×N_0, two partitions of size N_0×2N_0, and four partitions of size N_0×N_0. . The predictive coding in the intra mode and the inter mode can be performed on the partitions of sizes 2N_0×2N_0, N_0×2N_0, 2N_0×N_0, and N_0×N_0. Predictive coding in skip mode is performed only for partitions of size 2N_0x2N_0.
比較包含分區類型912至918中之預測編碼之編碼的誤差,且判定分區類型中的最小編碼誤差。若編碼誤差在分區類型912至916中之一者中最小,則預測單位910可能不分割為較下層深度。 The error of the encoding including the prediction codes in the partition types 912 to 918 is compared, and the minimum coding error in the partition type is determined. If the coding error is the smallest of one of the partition types 912 to 916, the prediction unit 910 may not be split into a lower layer depth.
若編碼誤差在分區類型918中最小,則深度自0改變為1以在操作920中分割分區類型918,且對深度為2且大小為N_0×N_0之編碼單位930重複地執行編碼以搜尋最小編碼誤差。 If the coding error is the smallest in partition type 918, the depth is changed from 0 to 1 to partition partition type 918 in operation 920, and encoding is repeatedly performed on coding unit 930 having a depth of 2 and size N_0×N_0 to search for minimum coding. error.
用於深度為1且大小為2N_1×2N_1(=N_0×N_0)之編碼單位930之預測編碼的預測單位940可包含大小為2N_1×2N_1之分區類型942、大小為2N_1×N_1之分區類 型944、大小為N_1×2N_1之分區類型946以及大小為N_1×N_1的分區類型948之分區。 The prediction unit 940 for the prediction coding of the coding unit 930 having a depth of 1 and a size of 2N_1×2N_1 (=N_0×N_0) may include a partition type 942 having a size of 2N_1×2N_1 and a partition class having a size of 2N_1×N_1. A type 944, a partition type 946 having a size of N_1 × 2N_1, and a partition type 948 having a size of N_1 × N_1.
若編碼誤差在分區類型948中最小,則深度自1改變為2以在操作950中分割分區類型948,且對深度為2且大小為N_2×N_2之編碼單位960重複地執行編碼以搜尋最小編碼誤差。 If the coding error is the smallest in partition type 948, the depth is changed from 1 to 2 to partition partition type 948 in operation 950, and encoding is repeatedly performed on coding unit 960 having a depth of 2 and size N_2×N_2 to search for minimum coding. error.
當最大深度為d時,可執行根據每一深度之分割操作直至深度變為d-1時,且可對分割資訊進行編碼直至深度變為0至d-2中之一者時。換言之,當執行編碼直至在對應於深度d-2之編碼單位在操作970中分割之後深度為d-1時,用於深度為d-1且大小為2N_(d-1)×2N_(d-1)之編碼單位980之預測編碼的預測單位990可包含大小為2N_(d-1)×2N_(d-1)之分區類型992、大小為2N_(d-1)×N_(d-1)之分區類型994、大小為N_(d-1)×2N_(d-1)之分區類型996以及大小為N_(d-1)×N_(d-1)的分區類型998之分區。 When the maximum depth is d, the division operation according to each depth may be performed until the depth becomes d-1, and the division information may be encoded until the depth becomes one of 0 to d-2. In other words, when encoding is performed until the depth is d-1 after the coding unit corresponding to the depth d-2 is divided in operation 970, the depth is d-1 and the size is 2N_(d-1)×2N_(d- 1) The prediction unit 990 of the prediction coding of the coding unit 980 may include a partition type 992 having a size of 2N_(d-1)×2N_(d-1) and a size of 2N_(d-1)×N_(d-1) The partition type 994, the partition type 996 of size N_(d-1)×2N_(d-1), and the partition type 998 of size N_(d-1)×N_(d-1).
可對分區類型992至998中的大小為2N_(d-1)×2N_(d-1)之一個分區、大小為2N_(d-1)×N_(d-1)之兩個分區、大小為N_(d-1)×2N_(d-1)之兩個分區、大小為N_(d-1)×N_(d-1)的四個分區重複地執行預測編碼以搜尋具有最小編碼誤差的分區類型。 One partition of size 2N_(d-1)×2N_(d-1) in partition type 992 to 998, two partitions of size 2N_(d-1)×N_(d-1), and size Four partitions of N_(d-1)×2N_(d-1), four partitions of size N_(d-1)×N_(d-1) repeatedly perform predictive coding to search for partitions with the smallest coding error Types of.
即使當分區類型998具有最小編碼誤差時,由於最大深度為d,因此深度為d-1之編碼單位CU_(d-1)不再分割為較下層深度,且將構成當前最大編碼單位900之編碼單 位的經編碼之深度判定為d-1,且可將當前最大編碼單位900的分區類型判定為N_(d-1)×N_(d-1)。且,由於最大深度為d且具有最下層深度d-1之最小編碼單位980不再分割為較下層深度,因此不設定最小編碼單位980之分割資訊。 Even when the partition type 998 has the smallest encoding error, since the maximum depth is d, the coding unit CU_(d-1) having the depth of d-1 is no longer split into the lower layer depth, and will constitute the encoding of the current maximum coding unit 900. single The coded depth of the bit is determined to be d-1, and the partition type of the current maximum coding unit 900 can be determined as N_(d-1)×N_(d-1). Moreover, since the minimum coding unit 980 having the maximum depth d and having the lowest layer depth d-1 is no longer divided into the lower layer depth, the segmentation information of the minimum coding unit 980 is not set.
資料單位999可為當前最大編碼單位之「最小單元」。根據本發明之一實施例的最小單元可為藉由將最小編碼單位980分割為4份而獲得的矩形資料單位。藉由重複地執行編碼,視訊編碼裝置100可藉由根據編碼單位900之深度比較編碼誤差而選擇具有最小編碼誤差的深度以判定經編碼之深度,且將對應分區類型以及預測模式設定為經編碼之深度的編碼模式。 The data unit 999 can be the "minimum unit" of the current maximum coding unit. The minimum unit according to an embodiment of the present invention may be a rectangular data unit obtained by dividing the minimum coding unit 980 into 4 shares. By repeatedly performing encoding, the video encoding apparatus 100 can select the depth having the smallest encoding error to determine the encoded depth by comparing the encoding errors according to the depth of the encoding unit 900, and set the corresponding partition type and the prediction mode to be encoded. The depth of the encoding mode.
因而,在所有深度1至d中比較根據深度之最小編碼誤差,且可將具有最小編碼誤差之深度判定為經編碼之深度。可對經編碼之深度、預測單位之分區類型以及預測模式進行編碼且作為關於編碼模式之資訊而傳輸。且,由於編碼單位自深度0分割為經編碼之深度,因此僅經編碼之深度的分割資訊設定為0,且排除經編碼之深度的深度的分割資訊設定為1。 Thus, the minimum encoding error according to depth is compared in all depths 1 to d, and the depth with the smallest encoding error can be determined as the encoded depth. The encoded depth, the partition type of the prediction unit, and the prediction mode may be encoded and transmitted as information about the coding mode. Moreover, since the coding unit is divided into the coded depth from the depth 0, only the segmentation information of the coded depth is set to 0, and the segmentation information excluding the depth of the coded depth is set to 1.
視訊解碼裝置200之影像資料以及編碼資訊提取器220可提取且使用關於編碼單位900之經編碼之深度以及預測單位的資訊以對分區912進行解碼。視訊解碼裝置200可藉由使用根據深度之分割資訊而將分割資訊為0之深度判定為經編碼之深度,且使用關於對應深度之編碼模式的 資訊以用於解碼。 The video material and encoding information extractor 220 of the video decoding device 200 can extract and use the encoded depths of the coding unit 900 and the prediction unit information to decode the partition 912. The video decoding device 200 can determine the depth at which the segmentation information is 0 as the coded depth by using the segmentation information according to the depth, and use the coding mode for the corresponding depth. Information for decoding.
圖17至圖19為用於描述根據本發明之一實施例的編碼單位1010、預測單位1060與轉換單位1070之間的關係的圖式。 17 to 19 are diagrams for describing a relationship between a coding unit 1010, a prediction unit 1060, and a conversion unit 1070, according to an embodiment of the present invention.
編碼單位1010為最大編碼單位中的對應於由視訊編碼裝置100判定之經編碼之深度的具有樹狀結構之編碼單位。預測單位1060為編碼單位1010中之每一者之預測單位的分區,且轉換單位1070為編碼單位1010中之每一者的轉換單位。 The coding unit 1010 is a coding unit having a tree structure corresponding to the coded depth determined by the video encoding device 100 in the maximum coding unit. The prediction unit 1060 is a partition of the prediction unit of each of the coding units 1010, and the conversion unit 1070 is a conversion unit of each of the coding units 1010.
當最大編碼單位之深度在編碼單位1010中為0時,編碼單位1012以及1054之深度為1,編碼單位1014、1016、1018、1028、1050以及1052之深度為2,編碼單位1020、1022、1024、1026、1030、1032以及1048之深度為3,且編碼單位1040、1042、1044以及1046的深度為4。 When the depth of the maximum coding unit is 0 in the coding unit 1010, the depth of the coding units 1012 and 1054 is 1, the depth of the coding units 1014, 1016, 1018, 1028, 1050, and 1052 is 2, and the coding units are 1020, 1022, 1024. The depths of 1026, 1030, 1032, and 1048 are 3, and the depths of coding units 1040, 1042, 1044, and 1046 are 4.
在預測單位1060中,藉由分割編碼單位1010中之編碼單位來獲得一些編碼單位1014、1016、1022、1032、1048、1050、1052及1054。換言之,編碼單位1014、1022、1050以及1054中之分區類型的大小為2N×N,編碼單位1016、1048以及1052中之分區類型的大小為N×2N,且編碼單位1032之分區類型的大小為N×N。預測單位以及編碼單位1010之分區小於或等於每一編碼單位。 In the prediction unit 1060, some coding units 1014, 1016, 1022, 1032, 1048, 1050, 1052, and 1054 are obtained by dividing the coding units in the coding unit 1010. In other words, the size of the partition type in the coding units 1014, 1022, 1050, and 1054 is 2N×N, the size of the partition type in the coding units 1016, 1048, and 1052 is N×2N, and the size of the partition type of the coding unit 1032 is N × N. The prediction unit and the partition of the coding unit 1010 are less than or equal to each coding unit.
對小於編碼單位1052之資料單位中之轉換單位1070中的編碼單位1052之影像資料執行轉換或逆轉換。且,轉換單位1070中之編碼單位1014、1016、1022、1032、1048、 1050以及1052的大小以及形狀不同於預測單位1060中的編碼單位。換言之,視訊編碼裝置100以及視訊解碼裝置200可對同一編碼單位中之資料單位個別地執行畫面內預測、運動估計、運動補償、轉換以及逆轉換。 The conversion or inverse conversion is performed on the image data of the coding unit 1052 in the conversion unit 1070 in the data unit of the coding unit 1052. And, the coding unit 1014, 1016, 1022, 1032, 1048 in the conversion unit 1070, The sizes and shapes of 1050 and 1052 are different from the coding units in the prediction unit 1060. In other words, the video encoding device 100 and the video decoding device 200 can individually perform intra-picture prediction, motion estimation, motion compensation, conversion, and inverse conversion on data units in the same coding unit.
因此,對在最大編碼單位之每一區域中具有階層式結構之編碼單位中的每一者以遞迴方式執行編碼以判定最佳編碼單位,且因此可獲得具有遞迴樹狀結構之編碼單位。編碼資訊可包含關於編碼單位之分割資訊、關於分區類型之資訊、關於預測模式之資訊,以及關於轉換單位之大小的資訊。表1展示可由視訊編碼裝置100以及視訊解碼裝置200設定之編碼資訊。 Therefore, encoding is performed in a recursive manner for each of the coding units having a hierarchical structure in each of the largest coding units to determine the optimal coding unit, and thus a coding unit having a recursive tree structure can be obtained. . The encoded information may include segmentation information about the coding unit, information about the type of partition, information about the prediction mode, and information about the size of the conversion unit. Table 1 shows the encoded information that can be set by the video encoding device 100 and the video decoding device 200.
視訊編碼裝置100之輸出單元130可輸出關於具有樹狀結構之編碼單位的編碼資訊,且視訊解碼裝置200之影像資料以及編碼資訊提取器220可自所接收之位元串流提 取關於具有樹狀結構之編碼單位的編碼資訊。 The output unit 130 of the video encoding device 100 can output the encoded information about the coding unit having the tree structure, and the image data of the video decoding device 200 and the encoded information extractor 220 can be streamed from the received bit string. The coding information about the coding unit having the tree structure is taken.
分割資訊指示當前編碼單位是否分割為較下層深度之編碼單位。若當前深度d之分割資訊為0,則當前編碼單位不再分割為較下層深度之深度為經編碼之深度,且因此可針對經編碼之深度而定義關於分區類型、預測模式以及轉換單位之大小的資訊。若根據分割資訊進一步分割當前編碼單位,則對較下層深度之四個分割編碼單位獨立地執行編碼。 The split information indicates whether the current coding unit is split into coding units of a lower depth. If the segmentation information of the current depth d is 0, the current coding unit is no longer split into the depth of the lower layer depth as the coded depth, and thus the partition type, the prediction mode, and the conversion unit size may be defined for the coded depth. Information. If the current coding unit is further divided according to the split information, the coding is performed independently for the four divided coding units of the lower layer depth.
預測模式可為畫面內模式、畫面間模式以及跳過模式中之一者。可在所有分區類型中定義畫面內模式以及畫面間模式,且僅在大小為2N×2N之分區類型中定義跳過模式。 The prediction mode may be one of an intra mode, an inter mode, and a skip mode. The intra mode and the inter mode can be defined in all partition types, and the skip mode is defined only in the partition type of size 2N×2N.
關於分區類型之資訊可指示:大小為2N×2N、2N×N、N×2N以及N×N之對稱分區類型,其是藉由對稱地分割預測單位之高度或寬度而獲得;以及大小為2N×nU、2N×nD、nL×2N以及nR×2N之非對稱分區類型,其是藉由非對稱地分割預測單位之高度或寬度而獲得。可藉由以1:3以及3:1分割預測單位之高度而分別獲得大小為2N×nU以及2N×nD之非對稱分區類型,且可藉由以1:3以及3:1分割預測單位的寬度而分別獲得大小為nL×2N以及nR×2N之非對稱分區類型。 Information about the partition type may indicate: a symmetric partition type of size 2N×2N, 2N×N, N×2N, and N×N, which is obtained by symmetrically dividing the height or width of the prediction unit; and the size is 2N An asymmetrical partition type of ×nU, 2N×nD, nL×2N, and nR×2N, which is obtained by asymmetrically dividing the height or width of the prediction unit. An asymmetric partition type of 2N×nU and 2N×nD can be obtained by dividing the height of the prediction unit by 1:3 and 3:1, respectively, and the prediction unit can be divided by 1:3 and 3:1. An asymmetric partition type of size nL x 2N and nR x 2N is obtained for the width.
轉換單位之大小可在畫面內模式中設定為兩種類型且在畫面間模式中設定為兩種類型。換言之,若轉換單位之分割資訊為0,則轉換單位之大小可為2N×2N,此為當 前編碼單位之大小。若轉換單位之分割資訊為1,則可藉由分割當前編碼單位而獲得轉換單位。且,若大小為2N×2N之當前編碼單位的分區類型為對稱分區類型,則轉換單位之大小可為N×N,且若當前編碼單位之分區類型為非對稱分區類型,則轉換單位的大小可為N/2×N/2。 The size of the conversion unit can be set to two types in the intra mode and to two types in the inter mode. In other words, if the split information of the conversion unit is 0, the size of the conversion unit can be 2N×2N, which is when The size of the pre-coding unit. If the split information of the conversion unit is 1, the conversion unit can be obtained by dividing the current coding unit. Moreover, if the partition type of the current coding unit of size 2N×2N is a symmetric partition type, the size of the conversion unit may be N×N, and if the partition type of the current coding unit is an asymmetric partition type, the size of the conversion unit is It can be N/2×N/2.
關於具有樹狀結構之編碼單位的編碼資訊可包含對應於經編碼之深度的編碼單位、預測單位以及最小單元中的至少一者。對應於經編碼之深度的編碼單位可包含預測單位以及含有相同編碼資訊之最小單元中的至少一者。 The encoded information about the coding unit having the tree structure may include at least one of a coding unit, a prediction unit, and a minimum unit corresponding to the encoded depth. The coding unit corresponding to the encoded depth may include at least one of a prediction unit and a minimum unit containing the same coding information.
因此,藉由比較鄰近資料單位之編碼資訊而判定鄰近資料單位是否包含於對應於經編碼之深度的同一編碼單位中。且,藉由使用資料單位之編碼資訊而判定對應於經編碼之深度的對應編碼單位,且因此可判定最大編碼單位中之經編碼之深度的分佈。 Therefore, it is determined whether the neighboring data units are included in the same coding unit corresponding to the encoded depth by comparing the encoded information of the adjacent data units. And, by using the coding information of the data unit, the corresponding coding unit corresponding to the coded depth is determined, and thus the distribution of the coded depth in the maximum coding unit can be determined.
因此,若基於鄰近資料單位之編碼資訊而預測當前編碼單位,則可直接參考且使用鄰近於當前編碼單位的較深編碼單位中之資料單位的編碼資訊。 Therefore, if the current coding unit is predicted based on the coding information of the neighboring data unit, the coding information of the data unit in the deeper coding unit adjacent to the current coding unit can be directly referred to and used.
或者,若基於鄰近資料單位之編碼資訊而預測當前編碼單位,則使用資料單位之經編碼之資訊而搜尋鄰近於當前編碼單位之資料單位,且可參考所搜尋之鄰近編碼單位以用於預測當前編碼單位。 Alternatively, if the current coding unit is predicted based on the coded information of the neighboring data unit, the coded information of the data unit is used to search for the data unit adjacent to the current coding unit, and the searched neighboring coding unit can be referred to for predicting the current Coding unit.
圖20為用於描述根據表1之編碼模式資訊的編碼單位、預測單位或分區與轉換單位之間的關係的圖式。 20 is a diagram for describing a relationship between a coding unit, a prediction unit, or a partition and a conversion unit according to the coding mode information of Table 1.
最大編碼單位1300包含經編碼之深度的編碼單位 1302、1304、1306、1312、1314、1316以及1318。此處,由於編碼單位1318為經編碼之深度的編碼單位,因此分割資訊可設定為0。關於大小為2N×2N之編碼單位1318之分區類型的資訊可設定為大小為2N×2N之分區類型1322、大小為2N×N之分區類型1324、大小為N×2N之分區類型1326、大小為N×N之分區類型1328、大小為2N×nU之分區類型1332、大小為2N×nD之分區類型1334、大小為nL×2N之分區類型1336以及大小為nR×2N之分區類型1338中的一者。 Maximum coding unit 1300 contains the coding unit of the encoded depth 1302, 1304, 1306, 1312, 1314, 1316, and 1318. Here, since the coding unit 1318 is a coding unit of the coded depth, the split information can be set to zero. The information about the partition type of the coding unit 1318 having a size of 2N×2N can be set to a partition type 1322 having a size of 2N×2N, a partition type 1324 having a size of 2N×N, a partition type 1326 having a size of N×2N, and a size of N×N partition type 1328, partition type 1332 of size 2N×nU, partition type 1334 of size 2N×nD, partition type 1336 of size nL×2N, and one of partition type 1338 of size nR×2N By.
轉換單位之分割資訊(TU大小旗標)為一種轉換索引。對應於轉換索引之轉換單位大小可根據編碼單位之預測單位類型或分區類型而變化。 The split unit information (TU size flag) of the conversion unit is a conversion index. The size of the conversion unit corresponding to the conversion index may vary depending on the prediction unit type or the partition type of the coding unit.
當分區類型設定為對稱(亦即,分區類型1322、1324、1326或1328)時,若轉換單位之分割資訊(TU大小旗標)為0,則設定大小為2N×2N之轉換單位1342,且若TU大小旗標為1,則設定大小為N×N之轉換單位1344。 When the partition type is set to be symmetric (that is, the partition type 1322, 1324, 1326, or 1328), if the split information (TU size flag) of the conversion unit is 0, the conversion unit 1342 having a size of 2N×2N is set, and If the TU size flag is 1, the conversion unit 1344 of size N×N is set.
當分區類型設定為非對稱(亦即,分區類型1332、1334、1336或1338)時,若TU大小旗標為0,則設定大小為2N×2N之轉換單位1352,且若TU大小旗標為1,則設定大小為N/2×N/2之轉換單位1354。 When the partition type is set to be asymmetric (that is, partition type 1332, 1334, 1336 or 1338), if the TU size flag is 0, the conversion unit 1352 of size 2N×2N is set, and if the TU size flag is 1, set the conversion unit 1354 of size N/2 × N/2.
參考圖20,TU大小旗標為具有值0或1之旗標,但TU大小旗標不限於1個位元,且轉換單位可在TU大小旗標自0增大時階層式分割為具有樹狀結構。轉換單位之分割資訊(TU大小旗標)可用作轉換索引之實施例。 Referring to FIG. 20, the TU size flag is a flag having a value of 0 or 1, but the TU size flag is not limited to one bit, and the conversion unit can be hierarchically divided into trees when the TU size flag is increased from 0. Structure. The split information of the conversion unit (TU size flag) can be used as an embodiment of the conversion index.
在此狀況下,可藉由使用根據本發明之一實施例的轉換單位之TU大小旗標與轉換單位之最大大小以及最小大小來表達已實際使用之轉換單位的大小。根據本發明之一實施例,視訊編碼裝置100能夠對最大轉換單位大小資訊、最小轉換單位大小資訊以及最大TU大小旗標進行編碼。對最大轉換單位大小資訊、最小轉換單位大小資訊以及最大TU大小旗標進行編碼之結果可***至SPS中。根據本發明之一實施例,視訊解碼裝置200可藉由使用最大轉換單位大小資訊、最小轉換單位大小資訊以及最大TU大小旗標而對視訊進行解碼。 In this case, the size of the conversion unit that has actually been used can be expressed by using the maximum size and the minimum size of the TU size flag and the conversion unit of the conversion unit according to an embodiment of the present invention. According to an embodiment of the present invention, the video encoding apparatus 100 is capable of encoding the maximum conversion unit size information, the minimum conversion unit size information, and the maximum TU size flag. The result of encoding the maximum conversion unit size information, the minimum conversion unit size information, and the maximum TU size flag can be inserted into the SPS. According to an embodiment of the present invention, the video decoding apparatus 200 can decode the video by using the maximum conversion unit size information, the minimum conversion unit size information, and the maximum TU size flag.
舉例而言,若當前編碼單位之大小為64×64且最大轉換單位大小為32×32,則在TU大小旗標為0時,轉換單位之大小可為32×32,在TU大小旗標為1時,轉換單位之大小可為16×16,且在TU大小旗標為2時,轉換單位之大小可為8×8。 For example, if the current coding unit size is 64×64 and the maximum conversion unit size is 32×32, when the TU size flag is 0, the conversion unit size may be 32×32, and the TU size flag is At 1 o'clock, the size of the conversion unit can be 16×16, and when the TU size flag is 2, the size of the conversion unit can be 8×8.
作為另一實例,若當前編碼單位之大小為32×32且最小轉換單位大小為32×32,則在TU大小旗標為0時,轉換單位之大小可為32×32。此處,TU大小旗標不可設定為除0以外之值,此是因為轉換單位之大小不可小於32×32。 As another example, if the current coding unit size is 32×32 and the minimum conversion unit size is 32×32, when the TU size flag is 0, the conversion unit may have a size of 32×32. Here, the TU size flag cannot be set to a value other than 0, because the size of the conversion unit cannot be less than 32×32.
作為另一實例,若當前編碼單位之大小為64×64且最大TU大小旗標為1,則TU大小旗標可為0或1。此處,TU大小旗標不可設定為除0或1以外之值。 As another example, if the current coding unit size is 64×64 and the maximum TU size flag is 1, the TU size flag may be 0 or 1. Here, the TU size flag cannot be set to a value other than 0 or 1.
因此,若定義最大TU大小旗標為「MaxTransformSizeIndex」,最小轉換單位大小為 「MinTransformSize」,且在TU大小旗標為0時轉換單位大小為「RootTuSize」,則可在當前編碼單位中判定之當前最小轉換單位大小「CurrMinTuSize」可由方程式(1)定義:CurrMinTuSize=max(MinTransformSize,RootTuSize/(2^MaxTransformSizeIndex))…....(1) Therefore, if the maximum TU size flag is defined as "MaxTransformSizeIndex", the minimum conversion unit size is "MinTransformSize", and when the unit size is "RootTuSize" when the TU size flag is 0, the current minimum conversion unit size "CurrMinTuSize" which can be determined in the current coding unit can be defined by equation (1): CurrMinTuSize=max(MinTransformSize ,RootTuSize/(2^MaxTransformSizeIndex)).......(1)
與可在當前編碼單位中判定之當前最小轉換單位大小「CurrMinTuSize」比較,在TU大小旗標為0時之轉換單位大小「RootTuSize」可表示可在系統中選擇的最大轉換單位大小。在方程式(1)中,「RootTuSize/(2^MaxTransformSizeIndex)」表示在轉換單位大小「RootTuSize」在TU大小旗標為0時分割對應於最大TU大小旗標之次數時的轉換單位大小,且「MinTransformSize」表示最小轉換大小。因此,「RootTuSize/(2^MaxTransformSizeIndex)」以及「MinTransformSize」中的較小值可為可在當前編碼單位中判定的當前最小轉換單位大小「CurrMinTuSize」。 Compared with the current minimum conversion unit size "CurrMinTuSize" which can be determined in the current coding unit, the conversion unit size "RootTuSize" when the TU size flag is 0 can indicate the maximum conversion unit size that can be selected in the system. In Equation (1), "RootTuSize/(2^MaxTransformSizeIndex)" indicates the conversion unit size when the conversion unit size "RootTuSize" is divided by the number of times corresponding to the maximum TU size flag when the TU size flag is 0, and " MinTransformSize" represents the minimum conversion size. Therefore, the smaller value in "RootTuSize/(2^MaxTransformSizeIndex)" and "MinTransformSize" may be the current minimum conversion unit size "CurrMinTuSize" which can be determined in the current coding unit.
根據本發明之一實施例,最大轉換單位大小RootTuSize可根據預測模式之類型而變化。 According to an embodiment of the invention, the maximum conversion unit size RootTuSize may vary depending on the type of prediction mode.
舉例而言,若當前預測模式為畫面間模式,則可藉由使用下文之方程式(2)來判定「RootTuSize」。在方程式(2)中,「MaxTransformSize」表示最大轉換單位大小,且「PUSize」表示當前預測單位大小。 For example, if the current prediction mode is the inter-picture mode, "RootTuSize" can be determined by using Equation (2) below. In equation (2), "MaxTransformSize" represents the maximum conversion unit size, and "PUSize" represents the current prediction unit size.
RootTuSize=min(MaxTransformSize,PUSize).........(2) RootTuSize=min(MaxTransformSize, PUSize).........(2)
亦即,若當前預測模式為畫面間模式,則在TU大小旗標為0時之轉換單位大小「RootTuSize」可為最大轉換單位大小以及當前預測單位之大小中的較小值。 That is, if the current prediction mode is the inter-picture mode, the conversion unit size "RootTuSize" when the TU size flag is 0 may be the smaller of the maximum conversion unit size and the current prediction unit size.
若當前分區單元之預測模式為畫面內模式,則可藉由使用下文之方程式(3)來判定「RootTuSize」。在方程式(3)中,「PartitionSize」表示當前分區單元之大小。 If the prediction mode of the current partition unit is the intra mode, the "RootTuSize" can be determined by using Equation (3) below. In equation (3), "PartitionSize" indicates the size of the current partition unit.
RootTuSize=min(MaxTranaformSiZe,PartitionSize)...........(3) RootTuSize=min(MaxTranaformSiZe,PartitionSize)...........(3)
亦即,若當前預測模式為畫面內模式,則在TU大小旗標為0時之轉換單位大小「RootTuSize」可為最大轉換單位大小以及當前分區單元之大小中的較小值。 That is, if the current prediction mode is the intra-picture mode, the conversion unit size "RootTuSize" when the TU size flag is 0 may be the smaller of the maximum conversion unit size and the size of the current partition unit.
然而,根據分區單元中之預測模式之類型而變化的當前最大轉換單位大小「RootTuSize」僅為實例,且本發明並不限於此。 However, the current maximum conversion unit size "RootTuSize" that varies according to the type of prediction mode in the partition unit is only an example, and the present invention is not limited thereto.
根據上文參考圖8至圖20而描述的基於樹狀結構之編碼單位之視訊編碼方法,可針對樹狀結構之每一編碼單位來對空間域之影像資料進行編碼,且當根據基於樹狀結構之編碼單位之視訊解碼方法針對每一最大編碼單位執行解碼時,可復原空間域之影像資料,且因此可復原包含圖像與圖像序列之視訊。所復原之視訊可由再生裝置再生, 儲存在儲存媒體中,或經網路傳輸。 According to the video coding method based on the coding unit of the tree structure described above with reference to FIG. 8 to FIG. 20, the image data of the spatial domain may be encoded for each coding unit of the tree structure, and according to the tree-based When the video decoding method of the coding unit of the structure performs decoding for each maximum coding unit, the image data of the spatial domain can be restored, and thus the video including the image and the image sequence can be restored. The recovered video can be reproduced by the reproducing device. Stored in storage media or transmitted over the network.
且,可針對每一圖像、每一片段或每一最大編碼單位,或針對樹狀結構之每一編碼單位、或編碼單位之預測單位、或編碼單位之轉換單位來編碼與傳輸或接收與解碼偏移參數。舉例而言,可基於針對每一最大編碼單位接收之偏移參數藉由使用所復原之偏移值來調整最大編碼單位之所復原之畫素值,且因此可復原相對於原始區塊具有最小誤差之所復原之區塊。 And, encoding and transmitting or receiving may be performed for each image, each segment or each maximum coding unit, or for each coding unit of the tree structure, or a prediction unit of the coding unit, or a conversion unit of the coding unit. Decode the offset parameters. For example, the restored pixel value of the maximum coding unit can be adjusted based on the offset parameter received for each maximum coding unit by using the restored offset value, and thus the recoverable minimum with respect to the original block The block of the error recovered.
本發明之一實施例可寫為電腦程式,且可在使用電腦可讀記錄媒體執行程式的通用數位電腦中實施。電腦可讀記錄媒體之實例包含磁性儲存媒體(例如,ROM、軟碟、硬碟等)以及光學記錄媒體(例如,CD-ROM或DVD)。 An embodiment of the present invention can be written as a computer program and can be implemented in a general-purpose digital computer that executes a program using a computer readable recording medium. Examples of the computer readable recording medium include a magnetic storage medium (for example, a ROM, a floppy disk, a hard disk, etc.) and an optical recording medium (for example, a CD-ROM or a DVD).
儘管已參考本發明之較佳實施例特定地展示且描述了本發明,但一般熟習此項技術者將理解,在不脫離如由所附申請專利範圍界定的本發明之精神以及範疇的情況下,可對本發明進行形式以及細節上的各種改變。較佳實施例應僅在描述性意義上考慮且並非用於限制目的。因此,本發明之範疇並非由本發明之詳細描述界定而是由所附申請專利範圍界定,且在此範疇內之所有差異將解釋為包含於本發明中。 Although the present invention has been particularly shown and described with respect to the preferred embodiments of the present invention, it will be understood by those skilled in the art Various changes in form and detail may be made to the invention. The preferred embodiments should be considered in a descriptive sense only and not for purposes of limitation. Therefore, the scope of the invention is not to be construed as being limited by the description of the invention but the scope of the appended claims.
10‧‧‧視訊編碼裝置 10‧‧‧Video coding device
12‧‧‧偏移判定單元 12‧‧‧Offset determination unit
14‧‧‧偏移參數編碼單元 14‧‧‧ Offset parameter coding unit
20‧‧‧視訊解碼裝置 20‧‧‧Video Decoding Device
22‧‧‧偏移參數解析單元/偏移參數調整單元 22‧‧‧Offset parameter analysis unit/offset parameter adjustment unit
24‧‧‧偏移調整單元 24‧‧‧Offset adjustment unit
31~36‧‧‧邊緣類型 31~36‧‧‧Edge type
41~47、61~65、71~77‧‧‧操作步驟 41~47, 61~65, 71~77‧‧‧ steps
50‧‧‧當前區塊 50‧‧‧ current block
51‧‧‧左側區塊 51‧‧‧left block
52‧‧‧上方區塊 52‧‧‧Upper block
53‧‧‧左上方區塊 53‧‧‧ upper left block
54‧‧‧右上方區塊 54‧‧‧ upper right block
55、56‧‧‧參考區塊 55, 56‧‧‧ reference block
57‧‧‧當前畫面 57‧‧‧ current picture
58‧‧‧先前畫面/相鄰畫面 58‧‧‧Previous screen/adjacent screen
59‧‧‧後續畫面/相鄰畫面 59‧‧‧Next screen/adjacent screen
100‧‧‧視訊編碼裝置 100‧‧‧Video coding device
110‧‧‧最大編碼單位分割器 110‧‧‧Maximum coding unit splitter
120‧‧‧編碼單位判定器 120‧‧‧ coding unit determinator
130‧‧‧輸出單元 130‧‧‧Output unit
200‧‧‧視訊解碼裝置 200‧‧‧Video Decoder
210‧‧‧接收器 210‧‧‧ Receiver
220‧‧‧影像資料以及編碼資訊提取器 220‧‧‧Image data and coded information extractor
230‧‧‧影像資料解碼器 230‧‧‧Image Data Decoder
310‧‧‧視訊資料 310‧‧‧Video Information
315、325、335‧‧‧編碼單位 315, 325, 335‧ ‧ coding units
320、330‧‧‧視訊資料 320, 330‧‧‧ video information
400‧‧‧影像編碼器 400‧‧‧Image Encoder
405‧‧‧當前畫面 405‧‧‧ current picture
410‧‧‧畫面內預測器 410‧‧‧Intra-screen predictor
420‧‧‧運動估計器 420‧‧ sport estimator
425‧‧‧運動補償器 425‧‧‧Motion compensator
430‧‧‧轉換器 430‧‧‧ converter
440‧‧‧量化器 440‧‧‧Quantifier
450‧‧‧熵編碼器 450‧‧‧Entropy encoder
455‧‧‧位元串流 455‧‧‧ bit stream
460‧‧‧逆量化器 460‧‧‧ inverse quantizer
470‧‧‧逆轉換器 470‧‧‧ inverse converter
480‧‧‧解區塊單元 480‧‧‧Solution block unit
490‧‧‧迴路濾波單元 490‧‧‧Circuit Filter Unit
495‧‧‧參考畫面 495‧‧‧ reference picture
500‧‧‧影像解碼器 500‧‧‧Image Decoder
505‧‧‧位元串流 505‧‧‧ bit stream
510‧‧‧解析器 510‧‧‧ parser
520‧‧‧熵解碼器 520‧‧‧ Entropy decoder
530‧‧‧逆量化器 530‧‧‧ inverse quantizer
540‧‧‧逆轉換器 540‧‧‧ inverse converter
550‧‧‧畫面內預測器 550‧‧‧Intra-screen predictor
560‧‧‧運動補償器 560‧‧‧Motion compensator
570‧‧‧解區塊單元 570‧‧‧Solution block unit
580‧‧‧迴路濾波單元 580‧‧‧Circuit Filter Unit
585‧‧‧參考畫面 585‧‧‧ reference picture
595‧‧‧所復原之畫面 595‧‧‧Recovered picture
600‧‧‧階層式結構 600‧‧‧ Hierarchical structure
610‧‧‧編碼單位/分區/最大編碼單位 610‧‧‧ coding unit/partition/maximum coding unit
612、614、616、622、624、626、632、634、636、642、644、646‧‧‧分區 612, 614, 616, 622, 624, 626, 632, 634, 636, 642, 644, 646 ‧ ‧ partition
620、630、640‧‧‧編碼單位/分區 620, 630, 640‧ ‧ coding units/partitions
710‧‧‧編碼單位 710‧‧‧ coding unit
720‧‧‧轉換單位 720‧‧‧Transfer unit
800、810、820‧‧‧資訊 800, 810, 820‧ ‧ information
802、804、806、808、810‧‧‧分區 802, 804, 806, 808, 810‧‧‧ partition
812‧‧‧畫面內模式 812‧‧‧ In-screen mode
814‧‧‧畫面間模式 814‧‧‧Inter-picture mode
816‧‧‧跳過模式 816‧‧‧ skip mode
822‧‧‧第一畫面內轉換單位 822‧‧‧The first intra-picture conversion unit
824‧‧‧第二畫面內轉換單位 824‧‧‧Second screen conversion unit
826‧‧‧第一畫面間轉換單位 826‧‧‧ First inter-picture conversion unit
828‧‧‧第二畫面間轉換單位 828‧‧‧Second inter-picture conversion unit
900‧‧‧編碼單位/當前最大編碼單位 900‧‧‧ coding unit / current maximum coding unit
910‧‧‧預測單位 910‧‧‧ Forecasting unit
912‧‧‧分區類型/分區 912‧‧‧Partition Type/Partition
914、916、918‧‧‧分區類型 914, 916, 918‧‧‧ partition type
920、950、970‧‧‧操作 920, 950, 970‧‧ operations
930、960‧‧‧編碼單位 930, 960‧‧ ‧ coding unit
940、990‧‧‧預測單位 940, 990‧‧‧ forecast units
942、944、946、948‧‧‧分區類型 942, 944, 946, 948‧‧‧ partition type
980‧‧‧編碼單位/最小編碼單位 980‧‧‧ coding unit/minimum coding unit
992、994、996、998‧‧‧分區類型 992, 994, 996, 998‧‧‧ partition types
999‧‧‧資料單位 999‧‧‧data unit
1010、1012、1014、1016、1018、1020、1022、1024、1026、1028、1030、1032、1040、1042、1044、1046、1048、1050、1052、1054‧‧‧編碼單位 1010, 1012, 1014, 1016, 1018, 1020, 1022, 1024, 1026, 1028, 1030, 1032, 1040, 1042, 1044, 1046, 1048, 1050, 1052, 1054 ‧ ‧ coding units
1060‧‧‧預測單位 1060‧‧‧ Forecasting unit
1070‧‧‧轉換單位 1070‧‧‧Transfer unit
1300‧‧‧最大編碼單位 1300‧‧‧Maximum coding unit
1302、1304、1306、1312、1314、1316、1318‧‧‧編碼單位 1302, 1304, 1306, 1312, 1314, 1316, 1318‧‧ ‧ coding units
1322、1324、1326、1328、1332、1334、1336、1338‧‧‧分區類型 1132, 1324, 1326, 1328, 1332, 1334, 1336, 1338‧‧‧ partition type
1342、1344、1352、1354‧‧‧轉換單位 1342, 1344, 1352, 1354‧‧‧ conversion units
CU_0‧‧‧當前編碼單位 CU_0‧‧‧ current coding unit
CU_1‧‧‧編碼單位 CU_1‧‧‧ coding unit
CU_(d-1)‧‧‧編碼單位 CU_(d-1)‧‧‧ coding unit
圖1為根據本發明之一實施例的視訊編碼裝置的方塊圖。 1 is a block diagram of a video encoding apparatus in accordance with an embodiment of the present invention.
圖2為根據本發明之一實施例的視訊解碼裝置的方塊 圖。 2 is a block diagram of a video decoding apparatus according to an embodiment of the present invention. Figure.
圖3為根據本發明之一實施例的用於畫素分類的邊緣類型與長度的表格。 3 is a table of edge types and lengths for pixel classification, in accordance with an embodiment of the present invention.
圖4為說明根據本發明之一實施例的偏移值編碼程序的流程圖。 4 is a flow chart illustrating an offset value encoding procedure in accordance with an embodiment of the present invention.
圖5為根據本發明之一實施例的用於合併偏移參數之候選參考區塊的圖式。 5 is a diagram of candidate reference blocks for combining offset parameters, in accordance with an embodiment of the present invention.
圖6為說明根據本發明之一實施例的視訊編碼方法的流程圖。 6 is a flow chart illustrating a video encoding method in accordance with an embodiment of the present invention.
圖7為說明根據本發明之一實施例的視訊解碼方法的流程圖。 FIG. 7 is a flow chart illustrating a video decoding method according to an embodiment of the present invention.
圖8為根據本發明之一實施例的基於具有樹狀結構之編碼單位的視訊編碼裝置的方塊圖。 8 is a block diagram of a video encoding device based on a coding unit having a tree structure, in accordance with an embodiment of the present invention.
圖9為根據本發明之一實施例的基於具有樹狀結構之編碼單位的視訊解碼裝置的方塊圖。 9 is a block diagram of a video decoding device based on a coding unit having a tree structure, in accordance with an embodiment of the present invention.
圖10為用於描述根據本發明之一實施例的編碼單位之概念的圖式。 FIG. 10 is a diagram for describing a concept of a coding unit according to an embodiment of the present invention.
圖11為根據本發明之一實施例的基於編碼單位的影像編碼器的方塊圖。 11 is a block diagram of a video encoder based on coding units, in accordance with an embodiment of the present invention.
圖12為根據本發明之一實施例的基於編碼單位的影像解碼器的方塊圖。 12 is a block diagram of a video decoder based on coding units, in accordance with an embodiment of the present invention.
圖13為說明根據本發明之一實施例的根據深度之較深編碼單位及分區的圖式。 13 is a diagram illustrating deeper coding units and partitions according to depths, in accordance with an embodiment of the present invention.
圖14為用於描述根據本發明之一實施例的編碼單位 與轉換單位之間的關係的圖式。 FIG. 14 is a diagram for describing a coding unit according to an embodiment of the present invention. A schema of the relationship with the conversion unit.
圖15為用於描述根據本發明之一實施例的對應於經編碼之深度的編碼單位之編碼資訊的圖式。 15 is a diagram for describing encoding information corresponding to a coding unit of an encoded depth according to an embodiment of the present invention.
圖16為根據本發明之一實施例的根據深度之較深編碼單位的圖式。 16 is a diagram of darker coding units according to depth, in accordance with an embodiment of the present invention.
圖17至圖19為用於描述根據本發明之一實施例的編碼單位、預測單位與轉換單位之間的關係的圖示。 17 to 19 are diagrams for describing a relationship between a coding unit, a prediction unit, and a conversion unit, according to an embodiment of the present invention.
圖20為用於描述根據表1之編碼模式資訊的編碼單位、預測單位或分區與轉換單位之間的關係的圖示。 20 is a diagram for describing a relationship between a coding unit, a prediction unit, or a partition and a conversion unit according to the coding mode information of Table 1.
20‧‧‧視訊解碼裝置 20‧‧‧Video Decoding Device
22‧‧‧偏移參數解析單元 22‧‧‧Offset parameter analysis unit
24‧‧‧偏移調整單元 24‧‧‧Offset adjustment unit
Claims (3)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201161502018P | 2011-06-28 | 2011-06-28 |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201309030A TW201309030A (en) | 2013-02-16 |
TWI521970B true TWI521970B (en) | 2016-02-11 |
Family
ID=47424664
Family Applications (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW106128692A TWI615022B (en) | 2011-06-28 | 2012-06-28 | Video decoding method |
TW101123236A TWI521970B (en) | 2011-06-28 | 2012-06-28 | Video decoding method |
TW106146392A TWI669955B (en) | 2011-06-28 | 2012-06-28 | Video decoding/encoding apparatus and method, storage medium for storing bitstream |
TW105123827A TWI601418B (en) | 2011-06-28 | 2012-06-28 | Video decoding method |
TW104119675A TWI549492B (en) | 2011-06-28 | 2012-06-28 | Video decoding apparatus |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW106128692A TWI615022B (en) | 2011-06-28 | 2012-06-28 | Video decoding method |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW106146392A TWI669955B (en) | 2011-06-28 | 2012-06-28 | Video decoding/encoding apparatus and method, storage medium for storing bitstream |
TW105123827A TWI601418B (en) | 2011-06-28 | 2012-06-28 | Video decoding method |
TW104119675A TWI549492B (en) | 2011-06-28 | 2012-06-28 | Video decoding apparatus |
Country Status (16)
Country | Link |
---|---|
US (7) | US9426482B2 (en) |
EP (3) | EP2887669A1 (en) |
JP (6) | JP5964422B2 (en) |
KR (6) | KR101457398B1 (en) |
CN (6) | CN103959776A (en) |
AU (3) | AU2012276452B2 (en) |
BR (5) | BR122021004575B1 (en) |
CA (2) | CA2840583C (en) |
MX (4) | MX2014000046A (en) |
MY (3) | MY193771A (en) |
PH (4) | PH12017501634A1 (en) |
RU (3) | RU2581553C2 (en) |
SG (4) | SG10201408720TA (en) |
TW (5) | TWI615022B (en) |
WO (1) | WO2013002554A2 (en) |
ZA (1) | ZA201400649B (en) |
Families Citing this family (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9378560B2 (en) | 2011-06-17 | 2016-06-28 | Advanced Micro Devices, Inc. | Real time on-chip texture decompression using shader processors |
AU2012277160B2 (en) | 2011-06-27 | 2016-12-15 | Sun Patent Trust | Image encoding method, image decoding method, image encoding device, image decoding device, and image encoding/decoding device |
JP5907367B2 (en) | 2011-06-28 | 2016-04-26 | ソニー株式会社 | Image processing apparatus and method, program, and recording medium |
MX2014000046A (en) | 2011-06-28 | 2014-02-17 | Samsung Electronics Co Ltd | Video encoding method using offset adjustments according to pixel classification and apparatus therefor, video decoding method and apparatus therefor. |
MX2014000159A (en) | 2011-07-02 | 2014-02-19 | Samsung Electronics Co Ltd | Sas-based semiconductor storage device memory disk unit. |
GB201119206D0 (en) * | 2011-11-07 | 2011-12-21 | Canon Kk | Method and device for providing compensation offsets for a set of reconstructed samples of an image |
US9277194B2 (en) | 2011-11-08 | 2016-03-01 | Texas Instruments Incorporated | Method and apparatus for image and video coding using hierarchical sample adaptive band offset |
US9253482B2 (en) * | 2011-11-08 | 2016-02-02 | Texas Insturments Incorporated | Method and apparatus for sample adaptive offset without sign coding |
WO2013095047A1 (en) | 2011-12-22 | 2013-06-27 | 삼성전자 주식회사 | Video encoding method using offset adjustment according to classification of pixels by maximum encoding units and apparatus thereof, and video decoding method and apparatus thereof |
KR102113985B1 (en) * | 2012-01-19 | 2020-05-22 | 미쓰비시덴키 가부시키가이샤 | Image decoding device, image coding device, image decoding method, image coding method and storage medium |
ES2746824T3 (en) | 2012-06-11 | 2020-03-09 | Samsung Electronics Co Ltd | Video encoding and decoding sharing ODS parameters according to a color component |
US9635360B2 (en) * | 2012-08-01 | 2017-04-25 | Mediatek Inc. | Method and apparatus for video processing incorporating deblocking and sample adaptive offset |
CN104769950B (en) | 2012-09-28 | 2018-11-13 | Vid拓展公司 | Crossing plane filtering for the carrier chrominance signal enhancing in Video coding |
EP2905961A4 (en) * | 2012-10-05 | 2016-07-06 | Lg Electronics Inc | Method and device for processing video signal |
IN2013MU01146A (en) * | 2013-03-26 | 2015-04-24 | Tektronix Inc | |
WO2014163209A1 (en) * | 2013-04-05 | 2014-10-09 | シャープ株式会社 | Image decoding apparatus |
CN104717506B (en) * | 2013-12-13 | 2019-07-05 | 北京三星通信技术研究有限公司 | The method and apparatus of processes pixel in coding and decoding video |
JP6253406B2 (en) * | 2013-12-27 | 2017-12-27 | キヤノン株式会社 | Image encoding apparatus, imaging apparatus, image encoding method, and program |
US9756340B2 (en) | 2014-02-03 | 2017-09-05 | Mitsubishi Electric Corporation | Video encoding device and video encoding method |
WO2016119746A1 (en) * | 2015-01-29 | 2016-08-04 | 同济大学 | Image coding method and apparatus, and image decoding method and apparatus |
EP3276957A4 (en) * | 2015-05-12 | 2018-02-28 | Samsung Electronics Co., Ltd. | Image encoding method and device for sample value compensation and image decoding method and device for sample value compensation |
EP4404572A2 (en) * | 2015-07-08 | 2024-07-24 | InterDigital Madison Patent Holdings, SAS | Enhanced chroma coding using cross plane filtering |
JP6094838B2 (en) * | 2015-08-31 | 2017-03-15 | ソニー株式会社 | Image processing apparatus and method, program, and recording medium |
KR102423880B1 (en) | 2015-10-06 | 2022-07-21 | 삼성전자주식회사 | Method for operating of encoder, and method for operating system on chip including encoder |
US10477247B2 (en) | 2015-11-18 | 2019-11-12 | Electronics And Telecommunications Research Institute | Method for decoding video using in-loop filter, and device therefor |
JPWO2017191749A1 (en) | 2016-05-02 | 2019-03-07 | ソニー株式会社 | Image processing apparatus and image processing method |
KR101981687B1 (en) * | 2016-05-04 | 2019-05-24 | 한국항공대학교산학협력단 | Method and apparatus for coding offset information and decoding using the same |
CN106130562B (en) * | 2016-06-15 | 2019-09-06 | 中国石油集团渤海钻探工程有限公司 | Logging-while-drilling data real-time compression method and decompression method |
JP6229030B2 (en) * | 2016-10-06 | 2017-11-08 | 株式会社三共 | Game machine |
CA3048382A1 (en) | 2017-01-12 | 2018-07-19 | Sony Corporation | Image processing apparatus and image processing method |
JP6341304B2 (en) * | 2017-02-14 | 2018-06-13 | ソニー株式会社 | Image processing apparatus and method, program, and recording medium |
EP3471413A1 (en) * | 2017-10-10 | 2019-04-17 | Thomson Licensing | Encoding and decoding methods and corresponding devices |
KR102356262B1 (en) | 2018-03-27 | 2022-02-08 | 주식회사 윌러스표준기술연구소 | Video signal processing method and apparatus using motion compensation |
TWI678107B (en) | 2018-05-16 | 2019-11-21 | 香港商京鷹科技股份有限公司 | Image transmission method and system thereof and image transmission apparatus |
US11317099B2 (en) | 2018-10-05 | 2022-04-26 | Tencent America LLC | Method and apparatus for signaling an offset in video coding for intra block copy and/or inter prediction |
CN113709484B (en) * | 2020-03-26 | 2022-12-23 | 杭州海康威视数字技术股份有限公司 | Decoding method, encoding method, device, equipment and machine readable storage medium |
EP3959878A4 (en) * | 2020-06-03 | 2022-07-27 | Beijing Dajia Internet Information Technology Co., Ltd. | Chroma coding enhancement in cross-component correlation |
Family Cites Families (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4661862A (en) * | 1984-04-27 | 1987-04-28 | Rca Corporation | Differential PCM video transmission system employing horizontally offset five pixel groups and delta signals having plural non-linear encoding functions |
US4971407A (en) | 1989-08-09 | 1990-11-20 | Unisys Corp. | Two stage run and string data compressor providing doubly compressed output |
US6043838A (en) * | 1997-11-07 | 2000-03-28 | General Instrument Corporation | View offset estimation for stereoscopic video coding |
US6418166B1 (en) * | 1998-11-30 | 2002-07-09 | Microsoft Corporation | Motion estimation and block matching pattern |
US20020122595A1 (en) | 1999-06-04 | 2002-09-05 | Rikk Crill | Apparatus and method for radial and angular or rotational analysis of images for shape content and matching |
FI116819B (en) | 2000-01-21 | 2006-02-28 | Nokia Corp | Procedure for transferring images and an image encoder |
JP2004521583A (en) * | 2001-07-10 | 2004-07-15 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Method and apparatus for generating a scalable encoded video signal from a non-scalable encoded video signal |
JP2003230147A (en) | 2002-02-01 | 2003-08-15 | Matsushita Electric Ind Co Ltd | Apparatus and method for coding image signal |
CN101631247B (en) * | 2002-04-18 | 2011-07-27 | 株式会社东芝 | Moving picture coding/decoding method and device |
US8406301B2 (en) * | 2002-07-15 | 2013-03-26 | Thomson Licensing | Adaptive weighting of reference pictures in video encoding |
KR20060109247A (en) | 2005-04-13 | 2006-10-19 | 엘지전자 주식회사 | Method and apparatus for encoding/decoding a video signal using pictures of base layer |
US7680342B2 (en) * | 2004-08-16 | 2010-03-16 | Fotonation Vision Limited | Indoor/outdoor classification in digital images |
US20050047504A1 (en) | 2003-09-03 | 2005-03-03 | Sung Chih-Ta Star | Data stream encoding method and apparatus for digital video compression |
US7400681B2 (en) | 2003-11-28 | 2008-07-15 | Scientific-Atlanta, Inc. | Low-complexity motion vector prediction for video codec with two lists of reference pictures |
NO319629B1 (en) | 2003-11-28 | 2005-09-05 | Tandberg Telecom As | Procedure for correcting interpolated pixel values |
US7233164B2 (en) * | 2003-12-17 | 2007-06-19 | Rambus Inc. | Offset cancellation in a multi-level signaling system |
US20050232497A1 (en) * | 2004-04-15 | 2005-10-20 | Microsoft Corporation | High-fidelity transcoding |
JP2006032999A (en) * | 2004-07-12 | 2006-02-02 | Sharp Corp | Image decoding device and image decoding method |
RU2402811C2 (en) * | 2004-07-29 | 2010-10-27 | Майкрософт Корпорейшн | Image processing using linear parametres of lighting apparatus and other image processng enhancements |
US8472699B2 (en) * | 2006-11-22 | 2013-06-25 | Board Of Trustees Of The Leland Stanford Junior University | Arrangement and method for three-dimensional depth image construction |
US8068673B2 (en) | 2006-12-01 | 2011-11-29 | Beihang University | Rapid and high precision centroiding method and system for spots image |
EP2130374A4 (en) | 2007-03-23 | 2011-03-02 | Lg Electronics Inc | A method and an apparatus for decoding/encoding a video signal |
US7983496B2 (en) | 2007-06-26 | 2011-07-19 | Mitsubishi Electric Research Laboratories, Inc. | Inverse tone mapping for bit-depth scalable image coding adapted to variable block sizes |
MX2010009194A (en) | 2008-03-07 | 2010-09-10 | Toshiba Kk | Dynamic image encoding/decoding method and device. |
US9078007B2 (en) * | 2008-10-03 | 2015-07-07 | Qualcomm Incorporated | Digital video coding with interpolation filters and offsets |
TWI386068B (en) | 2008-10-22 | 2013-02-11 | Nippon Telegraph & Telephone | Deblocking processing method, deblocking processing device, deblocking processing program and computer readable storage medium in which the program is stored |
KR101700358B1 (en) | 2009-12-09 | 2017-01-26 | 삼성전자주식회사 | Method and apparatus for encoding video, and method and apparatus for decoding video |
US9094658B2 (en) * | 2010-05-10 | 2015-07-28 | Mediatek Inc. | Method and apparatus of adaptive loop filtering |
US9055305B2 (en) * | 2011-01-09 | 2015-06-09 | Mediatek Inc. | Apparatus and method of sample adaptive offset for video coding |
US8861617B2 (en) | 2010-10-05 | 2014-10-14 | Mediatek Inc | Method and apparatus of region-based adaptive loop filtering |
WO2012092841A1 (en) * | 2011-01-03 | 2012-07-12 | Mediatek Inc. | Method of filter-unit based in-loop filtering |
EP2661887A4 (en) * | 2011-01-09 | 2016-06-15 | Mediatek Inc | Apparatus and method of efficient sample adaptive offset |
US9161041B2 (en) * | 2011-01-09 | 2015-10-13 | Mediatek Inc. | Apparatus and method of efficient sample adaptive offset |
ES2715782T3 (en) | 2011-04-21 | 2019-06-06 | Hfi Innovation Inc | Procedure and apparatus for improved loop filtering |
US9008170B2 (en) * | 2011-05-10 | 2015-04-14 | Qualcomm Incorporated | Offset type and coefficients signaling method for sample adaptive offset |
CN106028050B (en) * | 2011-05-16 | 2019-04-26 | 寰发股份有限公司 | The method and apparatus that sample for brightness and chromatic component adaptively deviates |
US20120294353A1 (en) * | 2011-05-16 | 2012-11-22 | Mediatek Inc. | Apparatus and Method of Sample Adaptive Offset for Luma and Chroma Components |
CN103621081B (en) | 2011-06-10 | 2016-12-21 | 寰发股份有限公司 | Scalable video coding method and device |
AU2012267006B8 (en) | 2011-06-10 | 2015-10-29 | Hfi Innovation Inc. | Method and apparatus of scalable video coding |
DK2725797T3 (en) * | 2011-06-23 | 2019-01-02 | Huawei Tech Co Ltd | OFFSET DECODER DEVICE, OFFSET ENTERPRISE DEVICE, PICTURE FILTER DEVICE AND DATA STRUCTURE |
MX2014000046A (en) | 2011-06-28 | 2014-02-17 | Samsung Electronics Co Ltd | Video encoding method using offset adjustments according to pixel classification and apparatus therefor, video decoding method and apparatus therefor. |
-
2012
- 2012-06-27 MX MX2014000046A patent/MX2014000046A/en active IP Right Grant
- 2012-06-27 CN CN201280042637.6A patent/CN103959776A/en active Pending
- 2012-06-27 WO PCT/KR2012/005086 patent/WO2013002554A2/en active Application Filing
- 2012-06-27 CN CN201510217348.0A patent/CN104980756A/en active Pending
- 2012-06-27 MY MYPI2017001764A patent/MY193771A/en unknown
- 2012-06-27 BR BR122021004575-5A patent/BR122021004575B1/en active IP Right Grant
- 2012-06-27 CN CN201510218779.9A patent/CN104980757A/en active Pending
- 2012-06-27 MY MYPI2017001763A patent/MY193778A/en unknown
- 2012-06-27 EP EP15153359.3A patent/EP2887669A1/en not_active Ceased
- 2012-06-27 RU RU2014102576/08A patent/RU2581553C2/en active
- 2012-06-27 SG SG10201408720TA patent/SG10201408720TA/en unknown
- 2012-06-27 MX MX2015002715A patent/MX338670B/en unknown
- 2012-06-27 BR BR112013033701-0A patent/BR112013033701B1/en active IP Right Grant
- 2012-06-27 EP EP12803907.0A patent/EP2728865A4/en not_active Withdrawn
- 2012-06-27 MX MX2015002713A patent/MX337235B/en unknown
- 2012-06-27 CN CN201510220064.7A patent/CN104980758A/en active Pending
- 2012-06-27 RU RU2016108975A patent/RU2632139C1/en active
- 2012-06-27 CN CN201510218544.XA patent/CN104994393A/en active Pending
- 2012-06-27 SG SG10201408715UA patent/SG10201408715UA/en unknown
- 2012-06-27 BR BR122021004578-0A patent/BR122021004578B1/en active IP Right Grant
- 2012-06-27 KR KR1020120069480A patent/KR101457398B1/en active IP Right Grant
- 2012-06-27 SG SG10201408726QA patent/SG10201408726QA/en unknown
- 2012-06-27 EP EP14192822.6A patent/EP2849444A3/en not_active Ceased
- 2012-06-27 US US14/130,011 patent/US9426482B2/en active Active
- 2012-06-27 JP JP2014518795A patent/JP5964422B2/en active Active
- 2012-06-27 MX MX2015002714A patent/MX338669B/en unknown
- 2012-06-27 CN CN201510218541.6A patent/CN105049864A/en active Pending
- 2012-06-27 BR BR122021004574-7A patent/BR122021004574B1/en active IP Right Grant
- 2012-06-27 MY MYPI2017001762A patent/MY192854A/en unknown
- 2012-06-27 SG SG10201408716TA patent/SG10201408716TA/en unknown
- 2012-06-27 AU AU2012276452A patent/AU2012276452B2/en active Active
- 2012-06-27 CA CA2840583A patent/CA2840583C/en active Active
- 2012-06-27 BR BR122021004576-3A patent/BR122021004576B1/en active IP Right Grant
- 2012-06-27 CA CA3016913A patent/CA3016913C/en active Active
- 2012-06-28 TW TW106128692A patent/TWI615022B/en active
- 2012-06-28 TW TW101123236A patent/TWI521970B/en active
- 2012-06-28 TW TW106146392A patent/TWI669955B/en active
- 2012-06-28 TW TW105123827A patent/TWI601418B/en active
- 2012-06-28 TW TW104119675A patent/TWI549492B/en active
-
2014
- 2014-01-27 ZA ZA2014/00649A patent/ZA201400649B/en unknown
- 2014-05-07 KR KR1020140054355A patent/KR101603678B1/en active IP Right Grant
- 2014-10-29 KR KR1020140148729A patent/KR101603685B1/en active IP Right Grant
-
2015
- 2015-01-22 US US14/603,020 patent/US9438921B2/en active Active
- 2015-01-22 US US14/603,097 patent/US9462288B2/en active Active
- 2015-02-12 US US14/620,413 patent/US9438922B2/en active Active
- 2015-02-12 US US14/620,432 patent/US9426483B2/en active Active
- 2015-02-17 KR KR1020150024015A patent/KR101603688B1/en active IP Right Grant
- 2015-02-17 KR KR1020150024016A patent/KR101603690B1/en active IP Right Grant
- 2015-03-12 KR KR1020150034541A patent/KR101906506B1/en active IP Right Grant
- 2015-04-09 JP JP2015080410A patent/JP5965021B2/en active Active
- 2015-04-09 JP JP2015080411A patent/JP5965022B2/en active Active
- 2015-04-09 JP JP2015080408A patent/JP5964479B2/en active Active
- 2015-04-09 JP JP2015080409A patent/JP5964480B2/en active Active
-
2016
- 2016-06-15 AU AU2016204005A patent/AU2016204005B2/en active Active
- 2016-06-30 JP JP2016130959A patent/JP6181246B2/en active Active
- 2016-07-28 US US15/221,979 patent/US10038911B2/en active Active
-
2017
- 2017-09-08 PH PH12017501634A patent/PH12017501634A1/en unknown
- 2017-09-08 PH PH12017501635A patent/PH12017501635B1/en unknown
- 2017-09-08 PH PH12017501636A patent/PH12017501636A1/en unknown
- 2017-09-08 PH PH12017501633A patent/PH12017501633A1/en unknown
- 2017-09-22 RU RU2017133113A patent/RU2663331C1/en active
-
2018
- 2018-04-13 AU AU2018202603A patent/AU2018202603B2/en active Active
- 2018-07-03 US US16/027,017 patent/US10542273B2/en active Active
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
TWI521970B (en) | Video decoding method | |
CA2840481C (en) | Method and apparatus for coding video and method and apparatus for decoding video accompanied with arithmetic coding | |
TWI594618B (en) | Apparatus for video decoding | |
TWI519142B (en) | Method and apparatus for video encoding with bit depth control for fixed point transformation, method and apparatus for video decoding with bit depth control for fixed point transform | |
KR20150022941A (en) | Method for image decoding | |
KR20150022939A (en) | Method for image decoding | |
KR20150053877A (en) | Method and apparatus for video encoding considering hierarchical coded block pattern, and method and apparatus for video decoding considering hierarchical coded block pattern | |
KR20150052822A (en) | Method and apparatus for video encoding considering hierarchical coded block pattern, and method and apparatus for video decoding considering hierarchical coded block pattern | |
KR20140142195A (en) | Method and apparatus for image encoding, and method and apparatus for image decoding | |
KR20150022940A (en) | Method for image decoding | |
KR20140067996A (en) | Method and apparatus for image encoding, and method and apparatus for image decoding |