TWI830012B - Apparatus and method of coding of pictures - Google Patents
Apparatus and method of coding of pictures Download PDFInfo
- Publication number
- TWI830012B TWI830012B TW110109990A TW110109990A TWI830012B TW I830012 B TWI830012 B TW I830012B TW 110109990 A TW110109990 A TW 110109990A TW 110109990 A TW110109990 A TW 110109990A TW I830012 B TWI830012 B TW I830012B
- Authority
- TW
- Taiwan
- Prior art keywords
- block
- split
- sub
- blocks
- picture
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 99
- 238000000638 solvent extraction Methods 0.000 claims abstract description 322
- 238000005192 partition Methods 0.000 claims abstract description 255
- 230000011218 segmentation Effects 0.000 claims description 195
- 230000002829 reductive effect Effects 0.000 claims description 167
- 230000009977 dual effect Effects 0.000 claims description 35
- 238000004590 computer program Methods 0.000 claims description 29
- 238000003066 decision tree Methods 0.000 claims description 29
- 230000003595 spectral effect Effects 0.000 claims description 18
- 230000009466 transformation Effects 0.000 claims description 18
- 238000009795 derivation Methods 0.000 claims description 8
- 230000001419 dependent effect Effects 0.000 abstract description 4
- 230000033001 locomotion Effects 0.000 description 55
- 230000011664 signaling Effects 0.000 description 46
- 241000023320 Luma <angiosperm> Species 0.000 description 32
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 32
- 239000013598 vector Substances 0.000 description 23
- 230000003044 adaptive effect Effects 0.000 description 17
- 230000009467 reduction Effects 0.000 description 17
- 230000006978 adaptation Effects 0.000 description 16
- 235000019580 granularity Nutrition 0.000 description 13
- 238000004422 calculation algorithm Methods 0.000 description 10
- 230000036961 partial effect Effects 0.000 description 10
- 238000013139 quantization Methods 0.000 description 8
- 238000013459 approach Methods 0.000 description 6
- 239000011159 matrix material Substances 0.000 description 6
- 108091026890 Coding region Proteins 0.000 description 5
- 230000000295 complement effect Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000003860 storage Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 239000012634 fragment Substances 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000005457 optimization Methods 0.000 description 4
- 238000013138 pruning Methods 0.000 description 4
- 238000006073 displacement reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000002123 temporal effect Effects 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 101000822806 Naja atra Cytotoxin 7 Proteins 0.000 description 2
- 108010076504 Protein Sorting Signals Proteins 0.000 description 2
- 244000141353 Prunus domestica Species 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000002457 bidirectional effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 230000007717 exclusion Effects 0.000 description 2
- 230000000670 limiting effect Effects 0.000 description 2
- 238000012886 linear function Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 238000000844 transformation Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000013213 extrapolation Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 239000010410 layer Substances 0.000 description 1
- 238000011946 reduction process Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000002356 single layer Substances 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/96—Tree coding, e.g. quad-tree coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
本揭露的實施例涉及一種解碼器和用於解碼的一種方法以及一種編碼器和用於編碼圖片的該相應方法。該解碼和該編碼係使用分割(partitioning)來執行。Embodiments of the present disclosure relate to a decoder and a method for decoding and an encoder and the corresponding method for encoding a picture. The decoding and encoding are performed using partitioning.
根據一第一觀點,應用一所謂的雙分割以將一區塊分割為子區塊。根據一第二觀點,一分割信息係用於對子區塊執行該雙分割。根據一第三觀點,基於經由上下文自適應熵編碼的解碼語法元素來執行子區塊的該分割。根據一第四觀點,藉由支持至少兩種模式的一裝置或方法來執行該分割。根據一第五觀點,基於分割比的一縮減列表來執行該分割,其中該第五觀點尤其涉及該縮減處理。According to a first perspective, a so-called double partition is applied to divide a block into sub-blocks. According to a second aspect, a partitioning information is used to perform the dual partitioning of sub-blocks. According to a third aspect, the partitioning of sub-blocks is performed based on decoding syntax elements via context-adaptive entropy coding. According to a fourth aspect, the segmentation is performed by a device or method supporting at least two modes. According to a fifth aspect, the segmentation is performed based on a reduction list of segmentation ratios, wherein the fifth aspect relates in particular to the reduction process.
在最先進的視頻編碼中,例如ITU-T H.265|MPEG H HEVC視頻編碼標準(參考文獻[1]),一視頻序列的該圖片以一某種順序被編碼,其被稱為編碼順序。圖片的該編碼順序可以與該擷取和顯示順序不同。In state-of-the-art video coding, such as the ITU-T H.265 | MPEG H HEVC video coding standard (Reference [1]), the pictures of a video sequence are coded in a certain order, which is called the coding order. . The encoding order of pictures can be different from the capture and display order.
對於該實際編碼,每個視頻圖片被分割為區塊。一區塊包括一特定顏色分量的一矩形區域的該樣本。對應於該相同矩形圖片區域的所有顏色分量的該區塊的該實體以及該相關聯的語法一起通常被稱為單元。取決於該區塊分割的目的,在ITU-T H.265|MPEG H HEVC中,它在編碼樹單元(CTU、Coding Tree Units)、編碼單元(CU、Coding Units)、預測單元(PU、Prediction Units)和變換單元(TU、Transform Units)之間進行區分。該相關聯的樣本區塊分別稱為編碼樹區塊(CTB、Coding Tree Blocks)、編碼區塊(CB、Coding Blocks)、預測區塊(PB、Prediction Blocks)和變換區塊(TB、Transform Blocks)。For this actual encoding, each video picture is divided into blocks. A region includes a rectangular area of the sample of a particular color component. The entity of the block corresponding to all color components of the same rectangular picture area, together with the associated syntax, is generally referred to as a unit. Depends on the purpose of partitioning the block, in ITU-T H.265 | MPEG H HEVC, it is divided into coding tree units (CTU, Coding Tree Units), coding units (CU, Coding Units), prediction units (PU, Prediction Distinguish between Units) and transformation units (TU, Transform Units). The associated sample blocks are respectively called coding tree blocks (CTB, Coding Tree Blocks), coding blocks (CB, Coding Blocks), prediction blocks (PB, Prediction Blocks) and transform blocks (TB, Transform Blocks). ).
通常,一視頻圖片最初被分割為固定大小的單元(即,對於所有顏色分量的對齊的固定大小的區塊)。在ITU-T H.265|MPEG H HEVC中,這些單元被稱為編碼樹單元(CTU)。它們的大小(在亮度樣本中)在該序列參數集(SPS、Sequence Parameter Set)中被傳輸,該序列參數集包含對一整個編碼視頻序列(包括一瞬時解碼刷新(IDR、Instantaneous Decoding Refresh)圖片和所有後續圖片(但不包括)下一個IDR圖片)的有效的高級別語法元素。在ITU-T H.265|MPEG H HEVC中,該CTU大小可在64x64、32x32和16x16亮度樣本之間選擇。請注意,一個CTU的該寬度和高度兩者均表示為2的一整數冪。包含在一個CTU中的樣本的該亮度和色度區塊稱為編碼樹區塊(CTB、Coding Tree Blocks)。為了進行編碼模式選擇、預測和該預測殘差的變換編碼的目的,可以將該固定大小的CTU自適應地分成較小的單元和區塊。Typically, a video picture is initially segmented into fixed-size units (ie, aligned fixed-size blocks for all color components). In ITU-T H.265|MPEG H HEVC, these units are called coding tree units (CTU). Their size (in luma samples) is transmitted in the Sequence Parameter Set (SPS), which contains the entire coded video sequence (including an Instantaneous Decoding Refresh (IDR) picture). and all subsequent pictures (but not including the next IDR picture) are valid high-level syntax elements. In ITU-T H.265|MPEG H HEVC, this CTU size can be selected between 64x64, 32x32 and 16x16 luma samples. Note that both the width and height of a CTU are expressed as integer powers of 2. The luma and chroma blocks of samples contained in a CTU are called Coding Tree Blocks (CTB, Coding Tree Blocks). The fixed size CTU can be adaptively divided into smaller units and blocks for the purpose of coding mode selection, prediction and transform coding of the prediction residual.
一圖片可以由一個或多個切片組成。一個切片表示CTU的一集合。一個切片與一個切片類型(例如,I、P或B切片)相關聯,該切片類型決定所支持的編碼模式的該集合。此外,諸如運動向量預測和圖片內預測的幾種類型的預測僅在一切片內的區塊之間被支持。A picture can be composed of one or more slices. A slice represents a collection of CTUs. A slice is associated with a slice type (eg, I, P, or B slice), which determines the set of supported encoding modes. Furthermore, several types of prediction such as motion vector prediction and intra-picture prediction are only supported between blocks within a slice.
可以以多種方式執行對編碼單元和變換單元的該分割。例如,在現有技術中有以下分割方法。This splitting of coding units and transformation units can be performed in various ways. For example, there are the following segmentation methods in the prior art.
在該最先進的視頻編碼標準ITU-T H.265|MPEG H HEVC(參考文獻[1])中,編碼單元和變換單元/變換區塊的該分割遵循一簡單的四叉樹(QT、Quadtree)概念。一正方形區塊可以分成該相同大小的四個正方形區塊,得到的區塊可以進一步分成該相同大小的四個正方形區塊等。對於預測單元,該標準還支持將一正方形區塊分成兩個非正方形區塊(相同大小或不同大小)。但是,該分割得到的非正方形方塊不能被進一步分割。在ITU-T H.264|MPEG-4 AVC (參考文獻[2])中已經支持將一正方形區塊分成兩個非正方形區塊的類似的一單層分割。In the state-of-the-art video coding standard ITU-T H.265|MPEG H HEVC (Reference [1]), this partitioning of coding units and transform units/transform blocks follows a simple quadtree (QT, Quadtree )concept. A square block can be divided into four square blocks of the same size, and the resulting block can be further divided into four square blocks of the same size, and so on. For prediction units, the standard also supports splitting a square block into two non-square blocks (same size or different sizes). However, the resulting non-square block cannot be further divided. A similar single-layer partitioning of a square block into two non-square blocks is already supported in ITU-T H.264|MPEG-4 AVC (Reference [2]).
雖然該四叉樹分割非常簡單,但它的缺點是通常只能藉由將一大區塊分成許多較小的區塊來合理地近似一物體或運動邊界。這潛在地增加了用於發信號通知該預測參數(例如運動參數)的該位元率以及用於該預測誤差信號的該變換編碼的該位元率。為了提高該編碼效率的該目標,該聯合勘探測試模型(Joint Exploration Test Model)(參考文獻[3])指定了一種組合的四叉樹/二叉樹(QTBT、Quadtree/Binary tree)方法。在該方法中,預測單元(PU)和變換單元(TU)總是與編碼單元(CU)對齊;因此,基本上只有一種區塊類型。首先使用傳統的該四叉樹方法分割一個CTU。然後,可以藉由一二叉樹(BT)結構進一步分割該四叉樹葉節點。對於二進制分割,支持兩種分割類型:一水平分割,其將NxM區塊水平分割為兩個Nx(M/2)區塊,以及一垂直分割,其將NxN區塊垂直分割為兩個(N/2)xM區塊。可以繼續二進制分割,直到達到一最小區塊寬度/區塊高度或一執行最大數量的(二進制)分割。該所得到的區塊用於編碼模式信令、幀內圖片預測、幀間圖片預測和變換編碼。Although this quadtree partitioning is very simple, its disadvantage is that an object or motion boundary can usually only be reasonably approximated by dividing a large block into many smaller blocks. This potentially increases the bit rate used for signaling the prediction parameters (eg, motion parameters) and the bit rate used for the transform encoding of the prediction error signal. In order to improve the coding efficiency, the Joint Exploration Test Model (Reference [3]) specifies a combined quadtree/binary tree (QTBT, Quadtree/Binary tree) method. In this approach, prediction units (PU) and transformation units (TU) are always aligned with coding units (CU); therefore, there is basically only one block type. First, use the traditional quadtree method to segment a CTU. Then, the quad leaf node can be further divided by a binary tree (BT) structure. For binary partitioning, two partition types are supported: a horizontal partition, which splits an NxM block horizontally into two Nx(M/2) blocks, and a vertical partition, which splits an NxN block vertically into two (N /2)xM block. Binary splitting can continue until a minimum block width/block height is reached or a maximum number of (binary) splits are performed. The resulting blocks are used for coding mode signaling, intra picture prediction, inter picture prediction and transform coding.
參考文獻[4]中建議進一步擴展QTBT概念,其中為該二叉樹部分引入了兩種進一步的分割模式:一水平三重分割和一垂直三重分割。在該水平三重分割中,一個NxM區塊被分成三個區塊:一個Nx(M/4)、一個Nx(M/2)和一個Nx(M/4)區塊(從上到下)。該垂直三重分割將一個NxM區塊垂直分割成一個(N/4)xM、一個(N/2)xM和一個(N/4)xM區塊(從左到右/從第一到第二)。A further extension of the QTBT concept is proposed in Reference [4], where two further splitting modes are introduced for this binary tree part: a horizontal triple split and a vertical triple split. In this horizontal triple split, an NxM block is divided into three blocks: an Nx(M/4), an Nx(M/2), and an Nx(M/4) block (from top to bottom). This vertical triple split vertically splits an NxM block into one (N/4)xM, one (N/2)xM and one (N/4)xM block (from left to right/from first to second) .
在參考文獻[5]中提出了QTBT的另一個增強。在該提議中,除了該對稱的二進制分割,引入了將一個NxM區塊分成大小為Nx(M/4)和Nx(3M/4)以及(N/4)xM和(3N/4)xM的兩個子區塊的非對稱二進制分割。Another enhancement of QTBT is proposed in reference [5]. In this proposal, in addition to this symmetric binary partitioning, the partitioning of an NxM block into blocks of size Nx(M/4) and Nx(3M/4) and (N/4)xM and (3N/4)xM is introduced Asymmetric binary partitioning of two subblocks.
本揭露的較佳實施例係隨後參照附圖描述。Preferred embodiments of the present disclosure are described below with reference to the accompanying drawings.
從現有技術出發,本發明的一個目的是在效率方面改進該分割,特別是考慮到隨後的編碼。Starting from the prior art, it is an object of the present invention to improve this segmentation in terms of efficiency, especially with regard to subsequent encoding.
該目的藉由獨立請求項的主題解決。這裡,將討論藉由使用一動態方法共同提高該效率的五個觀點。This purpose is solved by the subject of independent requests. Here, five perspectives that jointly improve this efficiency by using a dynamic approach will be discussed.
第一個觀點first point of view
根據本申請的一第一個觀點,藉由使用多級別二進制分割分區並以一某種方式發信號通知該多級別分割分區,在從編碼器到解碼器的信令開銷方面,使圖片分割成區塊更有效率,使得一某個當前區塊的一某個分割級別的一個二進制分割的一分割方向以依賴於用於該前一分割級別的該父親區塊的該分割方向的一方式被設置,當前區塊已經藉由該前面的分割級別的一個二進制分割所導出。該設置可以取決於該分割信息和該父親區塊的分割方向。換句話說,該分割信息可以相對於該父親區塊的分割方向發信號通知該分割方向,反之,該父親區塊的分割方向也可能已由該分割信息發出信號-其係相對於該祖父區塊的該分割方向或絕對(獨立於此)。According to a first aspect of the present application, by using multi-level binary partitioning and signaling the multi-level partitioning in some way, in terms of signaling overhead from the encoder to the decoder, the picture is partitioned into Blocks are more efficient such that a partition direction of a binary partition of a certain partition level of a current block is determined in a manner that depends on the partition direction of the parent block for the previous partition level. Sets that the current block has been derived by a binary split of this previous split level. The setting may depend on the splitting information and the splitting direction of the parent block. In other words, the partition information may signal the partition direction relative to the partition direction of the parent block, and conversely, the partition direction of the parent block may also have been signaled by the partition information - which is relative to the grandparent area. This splitting direction of the block or absolute (independent of this).
該觀點的實施例提供了一基於區塊的解碼器10,用於以編碼區塊16為單位從一資料流14解碼一圖片12,其被配置為: 藉由遞歸雙分割將該圖片12的一圖片區塊18劃分為該編碼區塊16,並根據該資料流14中的分割信息控制該遞歸雙分割;以及 設置一第一分割線(例如,圖1的左上四分之一中的編碼單元1和編碼單元2之間的線)的一第一分割線方向,藉由該遞歸雙分割沿著該第一分割線將該圖片區塊16的一預定分割級別(級別2,級別0分配給區塊16)的一預定子區塊(圖1中的左上四分之一)分割成一對具有一後續分割級別(級別3)的兒子子區塊(編碼單元1和編碼單元2),取決於一第二分割線(圖1的左上和左下四分之一的線)的一第二分割線方向,沿著該第二分割線將該圖片區塊16的一個前一分割級別(級別1)的一祖父子區塊(圖1的左半部分;注意,該術語「祖父子區塊」應被理解為足夠寬廣以覆蓋該圖片區塊18本身)分割成該預定子區塊(左上四分之一)和另一個子區塊(左下四分之一)。An embodiment of this concept provides a block-based decoder 10 for decoding a picture 12 from a data stream 14 in units of encoding blocks 16, which is configured as: Divide a picture block 18 of the picture 12 into the encoding block 16 by recursive double partitioning, and control the recursive double partitioning according to the partitioning information in the data stream 14; and Set a first dividing line direction of a first dividing line (for example, the line between coding unit 1 and coding unit 2 in the upper left quarter of Figure 1), and the recursive double dividing is along the first dividing line direction. The dividing line divides a predetermined sub-block (the upper left quarter in FIG. 1 ) of a predetermined division level (level 2, level 0 is assigned to the block 16) of the picture block 16 into a pair with a subsequent division level. The son sub-blocks (coding unit 1 and coding unit 2) of (Level 3) depend on the direction of a second dividing line (the upper left and lower left quarter lines of Figure 1) along the direction of a second dividing line. The second partition line connects a grandparent subblock (left half of FIG. 1 ) of a previous partition level (level 1) of the picture block 16; note that the term "grandfather subblock" should be understood as sufficient (wide enough to cover the picture block 18 itself) is divided into the predetermined sub-block (upper left quarter) and another sub-block (lower left quarter).
根據一實施例,該基於區塊的解碼器可以被配置為支持多種編碼模式(例如,幀間(例如,時間)或幀內(例如,空間)預測),並且以該編碼區塊為單位從該資料流導出一編碼模式,其用於解碼來自該資料流的該圖片(比較圖15中的模式選擇器)。According to an embodiment, the block-based decoder may be configured to support multiple coding modes (eg, inter-frame (eg, temporal) or intra-frame (eg, spatial) prediction), and the coding block is used as a unit from The data stream derives a coding mode that is used to decode the picture from the data stream (compare the mode selector in Figure 15).
根據一實施例,該基於區塊的解碼器可以被配置為支持多種編碼模式,其中每種編碼模式具有與其相關聯的一個或多個編碼參數(例如,運動向量,並且也可以是用於幀間預測和幀內預測模式的參考圖片索引,例如,用於幀內預測的定向外推、DC和/或類似物)的一編碼模式特定集合,其使用該相應的編碼模式控制該圖片的一解碼,並且該基於區塊的解碼器被配置為以該編碼區塊為單位從該資料流導出用於從該資料流解碼該圖片的一個或多個編碼參數的該編碼模式特定集合,藉由從每個解碼單元的該數據流導出與該編碼模式相關聯的一個或多個編碼參數的該編碼模式特定集合,該編碼模式用信號通知用於該數據流中的相應編碼區塊16(比較圖15中的預測器)。According to an embodiment, the block-based decoder may be configured to support multiple encoding modes, where each encoding mode has associated therewith one or more encoding parameters (eg, motion vectors, and may also be used for frames). A coding mode specific set of reference picture indexes for inter- and intra-prediction modes (e.g., directional extrapolation for intra-prediction, DC and/or the like) that controls a coding mode of the picture using the corresponding coding mode decoding, and the block-based decoder is configured to derive from the data stream the encoding mode-specific set of one or more encoding parameters for decoding the picture from the data stream in units of the encoding block, by The coding mode-specific set of one or more coding parameters associated with the coding mode signaled for the corresponding coding block 16 in the data stream is derived from the data stream for each decoding unit (cf. predictor in Figure 15).
根據一個實施例,該基於區塊的解碼器可以是一預測解碼器,並且被配置為以頻譜變換的形式從該資料流導出一頻譜域中的該圖片的一預測殘差(參見圖15中的變換區塊),所述頻譜變換表示係以該編碼區塊16為單位的該預測殘差的一分段頻譜變換(例如,對於每個編碼區塊16,該預測殘差將在編碼器側被單獨地進行頻譜分解,以便為一個編碼單元獲得一個變換(例如DCT),並且逆變換將用於校正對應於該編碼區塊的該區域的該預測信號)。According to one embodiment, the block-based decoder may be a predictive decoder and configured to derive a prediction residual of the picture in a spectral domain from the data stream in the form of a spectral transform (see Figure 15 transform block), the spectral transform representation is a piecewise spectral transform of the prediction residual in units of the coding block 16 (for example, for each coding block 16, the prediction residual will be in the encoder The sides are spectrally decomposed individually to obtain one transform (e.g. DCT) for one coding unit, and the inverse transform will be used to correct the prediction signal corresponding to that region of the coding block).
根據一個實施例,該基於區塊的解碼器可以被配置為將該圖片12預分割成樹根區塊18的一陣列,並相對於樹根區塊18的該陣列的每個陣列執行該圖片區塊18的分割(如示例性地在圖14中描繪),或者將該圖片12預分割成樹根區塊18的一陣列,根據該分割信息,使該樹根區塊經歷一單獨的分割(例如,對於每個樹根區塊18可單獨發信號的四分割,其可能但不僅是遞歸地),以便將樹根區塊的該陣列細分為預分割樹葉區塊(在同一樹根區塊18中可能大小不同)並相對於每個預分割樹葉區塊執行該圖片區塊的該分割(該替代方案未在圖14中示出;於此,圖14中的每個區塊18可以單獨地預先細分為預分割樹葉區塊,然後從區塊18進行遞歸雙分割;作為一個從旁註解,應當注意,甚至該編碼區塊16也可以藉由一些其他類型的分割從遞該歸雙分割的該樹葉區塊中而被導出)。According to one embodiment, the block-based decoder may be configured to pre-partition the picture 12 into an array of root blocks 18 and perform the picture region with respect to each array of the array of root blocks 18 Partitioning of blocks 18 (as illustratively depicted in Figure 14), or pre-partitioning the picture 12 into an array of root blocks 18, subjecting the root blocks to a separate partition based on the partition information (e.g. , for each root block 18 a quarter split can be signaled individually, possibly but not only recursively), in order to subdivide the array of root blocks into pre-split leaf blocks (on the same root block 18 may be of different sizes) and perform this segmentation of the picture block with respect to each pre-segmented leaf block (this alternative is not shown in Figure 14; here, each block 18 in Figure 14 can be individually Pre-subdivided into pre-split leaf blocks and then recursively bi-split from block 18; as a side note, it should be noted that even the encoding block 16 can be recursively bi-split from block 18 by some other type of split exported from the leaf block).
根據一實施例,該基於區塊的解碼器可以被配置為藉由根據該分割信息修改(例如,在採用相同或採用垂直之間進行選擇)該第一分割線方向以取決於該第二分割線方向和該分割信息(例如,perpend_split_flag或parallel_split_flag)來設置該第一分割線方向,以獲得一修改的分割線方向並將該第二分割線方向設置為等於該修改後的分割線方向。According to an embodiment, the block-based decoder may be configured to depend on the second partition by modifying (eg, selecting between using the same or using vertical) the first partition line direction based on the partition information. Line direction and the split information (for example, perpend_split_flag or parallel_split_flag) to set the first split line direction to obtain a modified split line direction and set the second split line direction equal to the modified split line direction.
根據一個實施例,該基於區塊的解碼器可以被配置為根據由該分割信息(例如,perpend_split_flag或parallel_split_flag和split_ratio _...旗標)發信號通知的一個二元決策樹(例如,圖13中的20;於此,該樹20的每個節點示例性地不僅僅包括分割的一決定或者沒有分割(no-split),但也指示分割線方向加分割比)來控制該遞歸雙分割,該分割信息指示(不一定明確地為每個節點單獨進行,因為一些決策可能經由一般規則發出信號,例如在該適應集中列出的那些......)該圖片區塊的一分割或不分割(或者比剛才說的更多),該父親區塊藉由該遞歸雙分割被分割成該父親區塊的所有中間子區塊,並且所有樹葉區塊不被該遞歸雙分割所分割。According to one embodiment, the block-based decoder may be configured to depend on a binary decision tree (eg, Figure 13 20 in; here, each node of the tree 20 exemplarily includes not only a decision of split or no split (no-split), but also indicates the split line direction plus the split ratio) to control the recursive double split, The split information indicates (not necessarily explicitly for each node individually, as some decisions may be signaled via general rules, such as those listed in the adaptation set...) a split of the picture block or Without splitting (or more than just said), the parent block is split into all intermediate sub-blocks of the parent block by the recursive double split, and all leaf blocks are not split by the recursive double split.
根據一個實施例,該基於區塊的解碼器可以被配置為控制屬於分割級別(例如,可能是所有分割級別,或者可能只是其子集)的一第一預定集合的該圖片區塊的每個子區塊的該遞歸雙分割,該第一預定集合取決於該分割信息(例如,藉由split_ratio _...)而相對於一分割線的一位置,該相應的子區塊藉由該遞歸雙分割沿著該分割線橫向於該分割線的一分割線方向被分割(換句話說,相對於橫向於該分割線方向測量的分割比)。According to one embodiment, the block-based decoder may be configured to control each sub-section of the picture block belonging to a first predetermined set of partition levels (eg, possibly all partition levels, or possibly only a subset thereof). The recursive double splitting of blocks, the first predetermined set depending on the splitting information (e.g., by split_ratio_...) and a position relative to a split line, the corresponding sub-block by the recursive double splitting Segments are divided along a dividing line direction transverse to the dividing line (in other words, relative to a dividing ratio measured transverse to the dividing line direction).
根據一個實施例,該基於區塊的解碼器可以被配置為控制屬於分割級別(例如,可能是所有分割級別,或者可能只是其子集)的一第一預定集合的該圖片區塊的每個子區塊的該遞歸雙分割,該第一預定集合取決於該分割信息(例如perpend_split_flag或parallel_split_flag和split_ratio _...旗標)而相對於一分割線的一分割線方向,藉由該遞歸雙分割沿著該分割線來分割相應的子區塊,其取決於該分割信息及一分割線的一分割線方向,沿其該相應中間區塊的父親區塊被分割。According to one embodiment, the block-based decoder may be configured to control each sub-section of the picture block belonging to a first predetermined set of partition levels (eg, possibly all partition levels, or possibly only a subset thereof). The recursive double splitting of blocks, the first predetermined set depends on the splitting information (such as perpend_split_flag or parallel_split_flag and split_ratio_... flag) with respect to a splitting line direction of a splitting line, by the recursive double splitting The corresponding sub-block is divided along the dividing line, which depends on the dividing information and a dividing line direction of a dividing line, along which the parent block of the corresponding middle block is divided.
根據該基於區塊的解碼器的一實施例,該第二分割線方向是水平的或垂直的,並且該基於區塊的解碼器被配置為根據該分割信息將該第一分割線方向設置為垂直於或平行於該第二分割線方向。According to an embodiment of the block-based decoder, the second dividing line direction is horizontal or vertical, and the block-based decoder is configured to set the first dividing line direction according to the dividing information. Perpendicular or parallel to the direction of the second dividing line.
根據一個實施例,該基於區塊的解碼器可以被配置為在分割該圖片區塊時,根據該分割信息,決定將該圖片區塊分割為一對第一分割級別子區塊,或讓該圖片區塊未被分割,和如果該圖片的該圖片區塊被分割為該對第一分割級別子區塊,則根據該分割信息,將該對第一分割級別子區塊的一第一個第一分割級別子區塊分割成一對第二分割級別子區塊,或者讓該第一個第一分割級別子區塊未被分割,並且沿著具有一第三分割線方向的一第三分割線執行該圖片區塊的該分割,並且設置一第四分割線的一第四分割線方向,沿此該第一個第一分割級別子區塊取決於該第三分割線方向被分割。According to one embodiment, the block-based decoder may be configured to, when partitioning the picture block, decide to divide the picture block into a pair of first partition level sub-blocks according to the partition information, or let the The picture block is not divided, and if the picture block of the picture is divided into the pair of first division level sub-blocks, then according to the division information, a first one of the pair of first division level sub-blocks is The first partitioning level sub-block is divided into a pair of second partitioning level sub-blocks, or the first first partitioning level sub-block is not divided and is divided along a third partitioning direction with a third dividing line. The line performs the segmentation of the picture block and sets a fourth segmentation line direction of a fourth segmentation line along which the first first segmentation level sub-block is segmented depending on the third segmentation line direction.
根據一個實施例,該基於區塊的解碼器可以被配置為:如果該圖片的該圖片區塊被分割為該對第一分割級別子區塊,則根據該分割信息(即對於第一次分割,該方向是信號通知的)設置該第三個分割方向,從該資料流導出由該分割信息獲得的一第一分割旗標,和如果該第一分割旗標具有一第一旗標狀態,則將該第二分割方向設置為垂直於該第一個分割方向、並沿著該第二分割線將該第一個第一分割級別子區塊分割成該對第二分割級別子區塊,和如果該第一分割旗標具有一第二個旗標狀態,則使該第一個第一分割級別子區塊保持未分割(例如,對於後續級別的該分割,該方向僅僅垂直於先前的分割級別父親區塊)。這裡,如果該圖片的該圖片區塊被分割為該對第一分割級別子區塊,該基於區塊的解碼器可以從該資料流導出該分割信息包含的一第一分割旗標(例如 perpend_split_flag),和如果該第一分割旗標具有一第一旗標狀態,則將該第四分割方向設置為垂直於該第三個分割方向、並沿著該第四分割線將該第一個第一分割級別子區塊分割成該對第二分割級別子區塊,和如果該第一分割旗標具有一第二個旗標狀態,從該資料流導出由該分割信息包含的一第二分割旗標(例如parallel_split_flag),和如果該第二分割旗標具有一第一旗標狀態,則將該第四分割方向設置為平行於該第三個分割方向、並沿著該第四分割線將該第一個第一分割級別子區塊分割成該對第二分割級別子區塊,和如果該第二分割旗標具有一第二個旗標狀態,則使該第一個第一分割級別子區塊保持未分割。According to one embodiment, the block-based decoder may be configured to: if the picture block of the picture is partitioned into the pair of first partitioning level sub-blocks, then according to the partitioning information (i.e. for the first partitioning , the direction is signaled) sets the third split direction, derives from the data stream a first split flag obtained from the split information, and if the first split flag has a first flag state, Then the second dividing direction is set to be perpendicular to the first dividing direction, and the first first dividing level sub-block is divided into the pair of second dividing level sub-blocks along the second dividing line, and if the first split flag has a second flag state, leaving the first first split level sub-block unsplit (e.g., for subsequent levels of the split, the direction is only perpendicular to the previous split level parent block). Here, if the picture block of the picture is divided into the pair of first split level sub-blocks, the block-based decoder can derive a first split flag (such as perpend_split_flag) contained in the split information from the data stream. ), and if the first segmentation flag has a first flag state, the fourth segmentation direction is set perpendicular to the third segmentation direction, and the first segmentation direction is set along the fourth segmentation line. partitioning a partition-level sub-block into the pair of second partition-level sub-blocks, and if the first partition flag has a second flag state, deriving from the data stream a second partition contained in the partition information flag (such as parallel_split_flag), and if the second split flag has a first flag state, the fourth split direction is set to be parallel to the third split direction and along the fourth split line. The first first partition level sub-block is partitioned into the pair of second partition level sub-blocks, and if the second partition flag has a second flag state, the first first partition level Subblocks remain undivided.
根據一個實施例,該基於區塊的解碼器可以被配置為在分割該圖片區塊時,根據該分割信息,決定將該祖父子區塊分割成包括該預定子區塊的一對子區塊,或者讓該祖父子區塊未被分割,和如果該祖父子區塊被分割為該對子區塊,則根據該分割信息,將該對子區塊的該預定子區塊分割成一對兒子子區塊,或者讓該預定子區塊未被分割,並且沿著具有該第二分割線方向的該第二分割線執行分割該祖父子區塊,並且設置該第一分割線的該第一分割線方向,沿著該第一分割線分割該預定子區塊,取決於該第二個分割線方向。According to one embodiment, the block-based decoder may be configured to, when dividing the picture block, decide to divide the grandparent sub-block into a pair of sub-blocks including the predetermined sub-block according to the division information. , or let the grandparent sub-block not be divided, and if the grandparent sub-block is divided into the pair of sub-blocks, then divide the predetermined sub-block of the pair of sub-blocks into a pair of sub-blocks according to the division information sub-block, or let the predetermined sub-block not be divided, and perform dividing the grandparent sub-block along the second dividing line having the direction of the second dividing line, and set the first of the first dividing line The direction of the dividing line, dividing the predetermined sub-block along the first dividing line, depends on the direction of the second dividing line.
根據一個實施例,該基於區塊的解碼器可以被配置為從該資料流導出該分割信息包含的一第一分割旗標(例如perpend_split_flag),和如果該第一分割旗標具有一第一旗標狀態,則將該第一分割線方向設置為垂直於該第二個分割線方向(在圖18中分離左上和左下四分之一)、並沿著該第一分割線將該預定子區塊(圖1左上角)分割成該對兒子子區塊(編碼單元1和編碼單元2),和如果該第一分割旗標具有一第二個旗標狀態,從該資料流導出由該分割信息包含的一第二分割旗標(例如parallel_split_flag),和如果該第二分割旗標具有一第一旗標狀態,則將該第一分割線方向設置為平行於該第二個分割線方向、並沿著該第一分割線將該預定子區塊分割成該對兒子子區塊(編碼單元1, 編碼單元2)和如果該第二分割旗標具有一第二個旗標狀態,則使該預定子區塊保持未分割(例如,以便成為編碼單位之一)。此處,該基於區塊的解碼器可以從該資料流導出由該分割信息包含的一第三分割旗標(例如perpend_split_flag),和如果該第三分割旗標具有該第一旗標狀態,則將該第五分割線的一第五分割線方向設置為垂直於該第二個分割線方向、並沿著一第五分割線(圖1中未顯示)將該對子區塊的另一子區塊(圖1左下角)分割成一另一對兒子子區塊,和如果該第三分割旗標具有該第二個旗標狀態,從該資料流導出該分割信息包含的一第四分割旗標(例如parallel_split_flag),和如果該第四分割旗標具有該第一旗標狀態,則將該第五分割線方向設置為平行於該第二個分割線方向、並沿著該第五分割線將該另一個子區塊分割成該另一對兒子子區塊,和如果該第二分割旗標具有該第二個旗標狀態,則使該另一個子區塊保持未分割。According to one embodiment, the block-based decoder may be configured to derive a first split flag (eg perpend_split_flag) included in the split information from the data stream, and if the first split flag has a first flag If the target state is selected, the first dividing line direction is set perpendicular to the second dividing line direction (separating the upper left and lower left quarters in Figure 18), and the predetermined sub-area is divided along the first dividing line. The block (upper left corner of Figure 1) is partitioned into the pair of sub-blocks (Coding Unit 1 and Coding Unit 2), and if the first partition flag has a second flag state, the partition is derived from the data stream. The information includes a second split flag (such as parallel_split_flag), and if the second split flag has a first flag state, the first split line direction is set to be parallel to the second split line direction, And divide the predetermined sub-block into the pair of son sub-blocks (encoding unit 1, encoding unit 2) along the first division line and if the second division flag has a second flag state, then make The predetermined sub-block remains undivided (eg, to become one of the coding units). Here, the block-based decoder may derive a third split flag (eg perpend_split_flag) contained in the split information from the data stream, and if the third split flag has the first flag status, then A fifth dividing line direction of the fifth dividing line is set perpendicular to the direction of the second dividing line, and the other sub-block of the pair of sub-blocks is arranged along a fifth dividing line (not shown in Figure 1). The block (lower left corner of Figure 1) is split into another pair of sub-blocks, and if the third split flag has the second flag state, a fourth split flag contained in the split information is derived from the data stream flag (such as parallel_split_flag), and if the fourth split flag has the first flag state, the fifth split line direction is set to be parallel to the second split line direction and along the fifth split line Split the other sub-block into the other pair of son sub-blocks, and if the second split flag has the second flag state, leave the other sub-block unsplit.
可選地或另外地,該基於區塊的解碼器可以被配置為,如果該預定的子區塊被分成該對兒子子區塊,從該資料流導出由該分割信息包含的一第六分割旗標(例如perpend_split_flag),和如果該第六分割旗標具有該第一旗標狀態,則將該第七分割線的一第七分割線方向設置為垂直於該第一個分割線方向、並沿著一第七分割線將該對兒子子區塊的一第一兒子子區塊(編碼單元1)分割成一對孫子子區塊(未在圖1中描繪),和如果該第六分割旗標具有該第二旗標狀態,從該資料流導出由該分割信息包含的一第七分割旗標(例如parallel_split_flag),和如果該第七分割旗標具有該第一旗標狀態,則將該第七分割線方向設置為平行於該第一個分割線方向、並沿著該第七分割線將該第一兒子子區塊分割成該對孫子子區塊,和如果該第七分割旗標具有該第二個旗標狀態,則使該第一兒子子區塊保持未分割。Alternatively or additionally, the block-based decoder may be configured to derive from the data stream a sixth partition contained by the partition information if the predetermined sub-block is divided into the pair of sub-sub-blocks. flag (such as perpend_split_flag), and if the sixth split flag has the first flag state, a seventh split line direction of the seventh split line is set to be perpendicular to the first split line direction, and A first son sub-block (coding unit 1) of the pair of son sub-blocks is divided into a pair of grandson sub-blocks (not depicted in Figure 1) along a seventh division line, and if the sixth division flag If the flag has the second flag state, derive a seventh split flag (such as parallel_split_flag) contained by the split information from the data stream, and if the seventh split flag has the first flag state, then the The direction of the seventh dividing line is set to be parallel to the direction of the first dividing line, and the first son sub-block is divided into the pair of grandson sub-blocks along the seventh dividing line, and if the seventh dividing flag With the second flag state, the first child subblock is left unsplit.
可選地或另外地,該基於區塊的解碼器被配置為,如果該預定的子區塊被分割成該對兒子子區塊(與第二分割線方向垂直或平行),從該分割信息導出一分割比(split_ratio_...),指示垂直於該第一分割線方向的該預定子區塊的寬度被分割的比率。Alternatively or additionally, the block-based decoder is configured to, if the predetermined sub-block is split into the pair of sub-sub-blocks (perpendicular or parallel to the second split line direction), from the split information A split ratio (split_ratio_...) is derived, indicating a ratio at which the width of the predetermined sub-block perpendicular to the first split line direction is split.
根據一個實施例,該基於區塊的解碼器可以支持一支持分割比的集合(例如集合A),用於沿著與該第二分割線方向垂直的該第一分割線分割該預定的子區塊,並且被配置為根據一個或多個規則從支持分割比的該集合中排除支持的分割比,獲得支持分割比的一縮減集合,並推斷該第一分割旗標具有該第二旗標狀態,並且如果該縮減集合的一基數為零則跳過其推導(換句話說,縮減的集合A是空的,或者,換句話說,集合A的所有成員都不可用)。According to one embodiment, the block-based decoder may support a set of supported splitting ratios (eg set A) for splitting the predetermined sub-region along the first splitting line perpendicular to the second splitting line direction. block, and configured to exclude supported split ratios from the set of supported split ratios according to one or more rules, obtain a reduced set of supported split ratios, and infer that the first split flag has the second flag state , and its derivation is skipped if the cardinality of the reduced set is zero (in other words, the reduced set A is empty, or, in other words, all members of set A are unavailable).
根據一個實施例,該基於區塊的解碼器可以支持一支持分割比的另一集合,用於沿著與該第二分割線方向平行的該第一分割線分割該預定的子區塊,並且被配置為根據一個或多個規則從支持分割比的該另一集合中排除支持的分割比,獲得支持分割比的一另一縮減集合,並推斷該第二分割旗標具有該第二旗標狀態,並且如果該另一縮減集合的一基數為零則跳過其推導。According to one embodiment, the block-based decoder may support another set of supported split ratios for splitting the predetermined sub-block along the first split line parallel to the second split line direction, and configured to exclude supported split ratios from the other set of supported split ratios according to one or more rules, obtain a further reduced set of supported split ratios, and infer that the second split flag has the second flag state, and skip its derivation if the cardinality of this other reduced set is zero.
這裡,該一個或多個規則中的一個可以取決於垂直於該第一分割線的該預定子區塊的該寬度,來排除所支持的分割比。可選地或另外地,該一個或多個規則中的一個規則根據垂直於該第一分割線的該預定子區塊的該寬度來排除所支持的分割比,以這樣的一方式排除支持的分割比,其將該寬度分成兩個兒子子區塊的寬度,以(測量的)樣本為單位,不是一預定整數(其可能是4,8或任何其他整數)的一整數倍。可選地或另外地,該一個或多個規則中的一個可以取決於垂直於該第一分割線的該預定子區塊的該寬度來排除支持的分割比,以這樣的一方式排除支持的分割比,其將該預定的子區塊分成兩個兒子子區塊,其中至少一個太小而不能完全封閉(不同地說,在沒有穿過該兒子子區塊的邊界的情況下係無法形容,而將允許寬鬆的記載文字(loose inscription))至少一個預定的最小尺寸區塊(例如,兩個,例如8x4和4x8)中的一集合的至少一個。可選地或另外地,該一個或多個規則中的一個可以取決於垂直於該第一分割線的該預定子區塊的該寬度,來排除所支持的分割比,以這樣的一方式排除支持的分割比,其將該預定的子區塊分割成兩個兒子子區塊,其中至少一個具有一寬高比(例如,水平寬度至垂直寬度、較短至較長寬度、垂直至水平寬度)在一可允許的寬高比範圍之外(例如寬高比被排除,其自身或其自身之倒數值超過某個閥值外)。可替代地或另外地,該一個或多個規則中的一個可以取決於垂直於該第一分割線的該預定子區塊的該寬度以排除支持的分割比,以這樣的一方式排除支持分割比的一預定子集合,其取決於該預定子區塊所屬的該遞歸雙分割的該分割級別(換句話說,可以根據當前子區塊的分割級別預先縮減集合A)。替代地或另外地,該一個或多個規則中的一個規則根據該圖片區塊的一個或多個其他子區塊(例如,對應於圖7a和7b和7c中的節點A的區塊)的一另一分割線的一另一分割方向以及一另一分割比來排除所支持的分割比,從其經由該遞歸雙分割獲得該預定子區塊(例如,對應於圖7a和7b中的節點B的區塊和對應於圖7c中的節點C的塊),其係藉由沿著該另一分割線和/或該圖片區塊的一個或多個甚至另一子區塊(例如,在圖7c對應於節點B的區塊)的一另一分割線的一甚至另一分割方向以及一甚至另一分割比,來分割該一個或多個另一子區塊,該圖片區塊藉由從一個或多個其他子區塊中的任何一個進行該遞歸雙分割而被獲得,從其該預定子區塊也藉由該遞歸雙分割被獲得。Here, one of the one or more rules may exclude supported split ratios depending on the width of the predetermined sub-block perpendicular to the first split line. Alternatively or additionally, one of the one or more rules excludes supported split ratios based on the width of the predetermined sub-block perpendicular to the first split line, in such a manner that supported split ratios are excluded The split ratio, which divides the width into two sub-blocks, in (measured) samples, is not an integral multiple of a predetermined integer (which may be 4, 8 or any other integer). Alternatively or additionally, one of the one or more rules may exclude supported split ratios depending on the width of the predetermined sub-block perpendicular to the first split line, in such a way that supported split ratios are excluded. A split ratio that divides the predetermined sub-block into two son sub-blocks, at least one of which is too small to be fully enclosed (differently said to be indescribable without crossing the boundary of the son sub-block) , and will allow loose inscription) at least one of a set of at least one predetermined minimum size block (for example, two, such as 8x4 and 4x8). Alternatively or additionally, one of the one or more rules may exclude supported split ratios depending on the width of the predetermined sub-block perpendicular to the first split line, in such a way that Supported split ratios that split the predetermined sub-block into two sub-sub-blocks, at least one of which has an aspect ratio (e.g., horizontal width to vertical width, shorter to longer width, vertical to horizontal width ) is outside an allowable aspect ratio range (for example, the aspect ratio is excluded, itself or its reciprocal value exceeds a certain threshold). Alternatively or additionally, one of the one or more rules may depend on the width of the predetermined sub-block perpendicular to the first dividing line to exclude supported splitting ratios in such a way that supported splitting is excluded A predetermined subset of ratios, which depends on the split level of the recursive dual split to which the predetermined sub-block belongs (in other words, the set A can be pre-reduced according to the split level of the current sub-block). Alternatively or additionally, one of the one or more rules is based on one or more other sub-blocks of the picture block (e.g., the block corresponding to node A in Figures 7a and 7b and 7c) a further splitting direction of another splitting line and a further splitting ratio excluding the supported splitting ratios from which the predetermined sub-block is obtained via the recursive double splitting (for example, corresponding to the nodes in Figures 7a and 7b B's block and the block corresponding to node C in Figure 7c) by one or more or even another sub-block along the other dividing line and/or the picture block (e.g., in Figure 7c corresponds to one or even another dividing direction of another dividing line and one or even another dividing ratio of the block of node B) to divide the one or more other sub-blocks by The predetermined sub-block is obtained by the recursive double-split from any of one or more other sub-blocks from which the predetermined sub-block is also obtained by the recursive double-split.
另一實施例提供了一種用於以編碼區塊16為單位從一資料流14解碼一圖片12的方法,包括: - 藉由遞歸雙分割將該圖片12的一圖片區塊18分割為該編碼區塊16,並根據該資料流14中的分割信息控制該遞歸雙分割;以及 - 設置一第一分割線(例如,圖1左上角的編碼單元1和編碼單元2之間的線)的一第一分割線方向,藉由該遞歸雙分割沿著該第一分割線將該圖片區塊16的一預定分割級別(級別2,級別0分配給區塊16)的一預定子區塊(圖1左上角)分割成一後續分割級別(級別3)的一對兒子子區塊(編碼單元1,編碼單元2),取決於一第二分割線(分隔圖1的左上和左下四分之一的線)的一第二分割線方向,沿著該第二分割線將該圖片區塊16的一個先前分割級別(級別1)的一祖父子區塊(圖1的左半部分;注意術語「祖父子區塊」應被理解為足夠寬以覆蓋圖片區塊18本身)分割為該預定的子區塊(左上角)和另一個子區塊(左下角)。該方法可以是計算機實現的。因此,實施例提供了相應的計算機程式。Another embodiment provides a method for decoding a picture 12 from a data stream 14 in units of encoding blocks 16, including: - Divide a picture block 18 of the picture 12 into the encoding block 16 by recursive double splitting, and control the recursive double splitting according to the splitting information in the data stream 14; and - Set a first dividing line direction (for example, the line between coding unit 1 and coding unit 2 in the upper left corner of Figure 1), and divide the first dividing line along the first dividing line through the recursive double division. A predetermined sub-block (upper left corner of FIG. 1 ) of a predetermined partitioning level (level 2, level 0 is assigned to the block 16) of the picture block 16 is partitioned into a pair of son sub-blocks (level 3) of a subsequent partitioning level (level 3). Encoding unit 1, encoding unit 2), depending on the direction of a second dividing line (the line that separates the upper left and lower left quarters of Figure 1), divides the picture area along the second dividing line A grandparent subblock of a previous partitioning level (Level 1) of block 16 (left half of Figure 1; note that the term "grandparent subblock" should be understood as being wide enough to cover picture block 18 itself) is partitioned as A predetermined subblock (upper left corner) and another subblock (lower left corner). The method may be computer implemented. Therefore, embodiments provide corresponding computer programs.
另一實施例提供了一種基於區塊的編碼器,用於以編碼區塊16為單位將一圖片12編碼為一資料流14,其被配置為:藉由遞歸雙分割將該圖片12的一圖片區塊18分割為該編碼區塊16,並根據分割信息控制(例如,以考慮速率/失真優化的一方式選擇分割信息)該遞歸雙分割並將該分割信息***該資料流14;設置一第一分割線(例如,圖1左上角的編碼單元1和編碼單元2之間的線)的一第一分割線方向,藉由該遞歸雙分割沿著該第一分割線將該圖片區塊16的一預定分割級別(級別2,級別0分配給區塊16)的一預定子區塊(圖1左上角)分割成一後續分割級別(級別3)的一對兒子子區塊(編碼單元1,編碼單元2),取決於一第二分割線(分隔圖1的左上和左下四分之一的線)的一第二分割線方向,沿著該第二分割線將該圖片區塊16的一個先前分割級別(級別1)的一祖父子區塊(圖1的左半部分;注意術語「祖父子區塊」應被理解為足夠寬以覆蓋圖片區塊18本身)分成該預定的子區塊(左上角)和另一個子區塊(左下角)。Another embodiment provides a block-based encoder for encoding a picture 12 into a data stream 14 in units of encoding blocks 16, which is configured to: divide a portion of the picture 12 by recursive double partitioning. The picture block 18 is partitioned into the encoding block 16, and the partition information is controlled according to the partition information (for example, the partition information is selected in a manner that takes into account rate/distortion optimization) the recursive double partition and the partition information is inserted into the data stream 14; set a A first dividing line direction of the first dividing line (for example, the line between coding unit 1 and coding unit 2 in the upper left corner of Figure 1), the picture block is divided along the first dividing line through the recursive double dividing A predetermined sub-block (upper left corner of Figure 1) of a predetermined partition level (level 2, level 0 is assigned to block 16) of 16 is partitioned into a pair of sub-blocks (coding unit 1) of a subsequent partition level (level 3) , encoding unit 2), depending on the direction of a second dividing line (the line separating the upper left and lower left quarters of FIG. 1 ), divide the picture block 16 along the second dividing line. A grandparent block (left half of Figure 1; note that the term "grandfather block" should be understood as being wide enough to cover the picture block 18 itself) of a previous partitioning level (Level 1) is divided into the predetermined subregions block (upper left corner) and another subblock (lower left corner).
另一實施例提供了一種用於以編碼區塊16為單位將一圖片12編碼成一資料流14的該相應方法,包括: - 藉由遞歸雙分割將該圖片12的一圖片區塊18分割為該編碼區塊16,並根據分割信息控制(例如,以考慮速率/失真優化的一方式選擇分割信息)該遞歸雙分割並將該分割信息***該資料流14;以及 - 設置一第一分割線(例如,圖1左上角的編碼單元1和編碼單元2之間的線)的一第一分割線方向,藉由該遞歸雙分割沿著該第一分割線將該圖片區塊16的一預定分割級別(級別2,級別0分配給區塊16)的一預定子區塊(圖1左上角)分割成一後續分割級別(級別3)的一對兒子子區塊(編碼單元1,編碼單元2),取決於一第二分割線(分隔圖1的左上和左下四分之一的線)的一第二分割線方向,沿著該第二分割線將該圖片區塊16的一個先前分割級別(級別1)的一祖父子區塊(圖1的左半部分;注意術語「祖父子區塊」應被理解為足夠寬以覆蓋圖片區塊18本身)分成該預定的子區塊(左上角)和另一個子區塊(左下角)。該方法也可以是計算機實現的。Another embodiment provides a corresponding method for encoding a picture 12 into a data stream 14 in units of encoding blocks 16, including: - Divide a picture block 18 of the picture 12 into the encoding block 16 by recursive double partitioning, and control the partitioning information according to the partitioning information (for example, select the partitioning information in a manner that considers rate/distortion optimization). Insert the segmentation information into the data stream 14; and - Set a first dividing line direction (for example, the line between coding unit 1 and coding unit 2 in the upper left corner of Figure 1), and divide the first dividing line along the first dividing line through the recursive double division. A predetermined sub-block (upper left corner of FIG. 1 ) of a predetermined partitioning level (level 2, level 0 is assigned to the block 16) of the picture block 16 is partitioned into a pair of son sub-blocks (level 3) of a subsequent partitioning level (level 3). Encoding unit 1, encoding unit 2), depending on the direction of a second dividing line (the line that separates the upper left and lower left quarters of Figure 1), divides the picture area along the second dividing line A grandparent subblock of a previous partition level (Level 1) of block 16 (left half of Figure 1; note that the term "grandparent subblock" should be understood as being wide enough to cover picture block 18 itself) is divided into the predetermined subblock of (upper left corner) and another subblock (lower left corner). The method may also be computer implemented.
第二個觀點second view
根據本申請的一第二觀點,藉由允許從支持分割比的一集合中的一選擇,使圖片分割成區塊更有效率。可以根據一個或多個規則將該支持集合簡化為一縮減集合,以便根據想法去除不允許或不合理的支持的分割比,從而減少必要的分割信息的該數量。According to a second aspect of the present application, partitioning the picture into blocks is made more efficient by allowing a selection from a set of supported partition ratios. The support set may be reduced to a reduced set according to one or more rules in order to ideally remove disallowed or unreasonable supported split ratios, thereby reducing the amount of necessary split information.
該觀點2的實施例提供了一基於區塊的解碼器10,用於以編碼區塊16為單位從一資料流14解碼一圖片12,其被配置為藉由遞歸雙分割將該圖片12的一圖片區塊18分割為該編碼區塊16,並根據該資料流14中的分割信息控制該遞歸雙分割,其中該遞歸雙分割的該控制包括控制相對於該圖片區塊18的一預定子區塊(例如,圖1中的任何區塊對應於圖2中的任何節點,因此包括區塊18本身,但也包括藉由分割獲得的部分)的該雙分割,並依據 - 是否該預定子區塊要被分割或者將其保留為不分割, - 一分割線的一分割線方向(例如水平或垂直),在其中該圖片區塊的該預定子區塊將藉由該遞歸雙分割來分割,和/或 - 一分割比,在其中垂直於該分割線的該圖片區塊的該預定子區塊的一寬度被該分割線穿過; 其中,該基於區塊的解碼器支持一支持分割比的集合(例如集合A),用於分割該預定的子區塊,並且被配置為用於沿著具有一預定分割線方向的一分割線的該預定子區塊的一分割,而根據一個或多個規則從支持分割比的該集合中排除支持的分割比,以獲得支持分割比的一縮減集合,其中,該基於區塊的解碼器被配置為根據支持分割比的該縮減集合,來控制相對於該圖片區塊的該預定子區塊的該雙分割。The embodiment of this aspect 2 provides a block-based decoder 10 for decoding a picture 12 from a data stream 14 in units of encoding blocks 16, which is configured to divide the picture 12 by recursive double partitioning. A picture block 18 is divided into the encoding block 16, and the recursive double partitioning is controlled according to the partitioning information in the data stream 14, wherein the control of the recursive double partitioning includes controlling a predetermined subdivision relative to the picture block 18. This double partitioning of blocks (e.g., any block in Figure 1 corresponds to any node in Figure 2, thus including block 18 itself, but also the portion obtained by partitioning), and in accordance with - Whether the scheduled sub-block is to be split or left unsplit, - a dividing line direction (e.g. horizontal or vertical) of a dividing line in which the predetermined sub-blocks of the picture block are to be divided by the recursive double-splitting, and/or - a dividing ratio in which a width of the predetermined sub-block of the picture block perpendicular to the dividing line is crossed by the dividing line; Wherein, the block-based decoder supports a set that supports splitting ratios (for example, set A) for splitting the predetermined sub-blocks, and is configured to be used along a split line having a predetermined split line direction. a partition of the predetermined sub-block, and exclude supported partition ratios from the set of supported partition ratios according to one or more rules to obtain a reduced set of supported partition ratios, wherein the block-based decoder Configured to control the dual partitioning with respect to the predetermined sub-block of the picture block according to the reduced set of supported partitioning ratios.
根據一實施例,該解碼器可以被配置為根據該縮減集合(例如,就該各個子區塊的該分割信息所包含的語法元素的數量而言,即從其中讀取的語法元素的數量,或者就位元流域中的平均位元數而言,例如在熵編碼之後;另見下一段的例子)的一基數,減少用於控制相對於該圖片區塊的該預定子區塊的該遞歸雙分割的該分割信息的一片段。According to an embodiment, the decoder may be configured to, based on the reduced set (for example, in terms of the number of syntax elements contained in the segmentation information of the respective sub-blocks, ie the number of syntax elements read therefrom, or in terms of the average number of bits in the bit basin, such as after entropy coding; see also the example in the next paragraph), reducing the recursion for controlling the predetermined sub-block with respect to the picture block A fragment of the split message that is double split.
根據一實施例,該解碼器可以被配置為在解析該分割信息的該片段時,跳過指示該預定子區塊是要分割還是不要分割的一旗標(例如perpend_split_flag或parallel_split_flag或ver_split_flag或hor_split_flag),或者如果該縮減集合是空的則指示該分割線的該分割方向的一旗標(例如perpend_split_flag或parallel_split_flag或ver_split_flag或hor_split_flag),和/或在解析該分割信息的該片段時,如果該縮減集合的該基數為1,則跳過指示該分割線的該分割比的一索引(例如旗標的一集合,例如split_ratio _...),和/或在對該索引進行熵解碼時,改變該索引的可能值的一域以專門地參考該縮減集合,或者針對所支持的該縮減集合的支持分割比與所支持分割比的該集合相比,花費更短的字碼長度。According to an embodiment, the decoder may be configured to skip a flag indicating whether the predetermined sub-block is to be split or not to be split (such as perpend_split_flag or parallel_split_flag or ver_split_flag or hor_split_flag) when parsing the segment of the split information. , or a flag indicating the split direction of the split line if the reduction set is empty (such as perpend_split_flag or parallel_split_flag or ver_split_flag or hor_split_flag), and/or when parsing the fragment of the split information, if the reduction set The base is 1, then skip an index indicating the split ratio of the split line (such as a set of flags, such as split_ratio_...), and/or change the index when entropy decoding the index A range of possible values to refer specifically to that reduced set, or to a shorter word length than the set of supported split ratios for the reduced set.
根據一實施例,該一個或多個規則中的該一個可以取決於垂直於該預定分割方向的該預定子區塊的該寬度,來排除所支持的分割比(例如,在圖1的區塊18的情況下寬度垂直測量為128,或者在對應於節點F的區塊的情況下寬度水平測量為24,該節點F是分割為編碼單元3和編碼單元4)。According to an embodiment, the one of the one or more rules may exclude supported split ratios depending on the width of the predetermined sub-block perpendicular to the predetermined split direction (e.g., in the block of FIG. 1 The width measures 128 vertically in the case of 18, or 24 horizontally in the case of the block corresponding to node F, which is split into coding unit 3 and coding unit 4).
根據一個實施例,該一個或多個規則中的該一個可以取決於垂直於該預定分割方向的該預定子區塊的該寬度來排除支持的分割比,以這樣的一方式排除支持的分割比,其將該寬度分成兩個兒子子區塊的寬度,在樣本中不是一預定整數的一整數倍(比較上述)。According to one embodiment, the one of the one or more rules may exclude supported split ratios depending on the width of the predetermined sub-block perpendicular to the predetermined split direction, in such a way that supported split ratios are excluded , which divides the width into two sub-blocks whose width is not an integral multiple of a predetermined integer in the sample (compare above).
根據一個實施例,該一個或多個規則中的該一個可以取決於垂直於該預定分割方向的該預定子區塊的該寬度以排除支持的分割比,以這樣的一方式排除支持的分割比,其將該寬度分成兩個兒子子區塊的寬度在樣本中彼此是一整數倍。According to one embodiment, the one of the one or more rules may depend on the width of the predetermined sub-block perpendicular to the predetermined split direction to exclude supported split ratios in such a way that supported split ratios are excluded , which divides the width into two sub-blocks whose widths are integer multiples of each other in the sample.
根據一個實施例,該一個或多個規則中的該一個可以取決於垂直於該預定分割方向的該預定子區塊的該寬度來排除支持的分割比,以這樣的一方式排除支持的分割比,其將該預定的子區塊分成兩個兒子子區塊,其中至少一個太小而不能完全包圍至少一個預定的最小尺寸區塊中的至少一個的一集合(比較上述)。According to one embodiment, the one of the one or more rules may exclude supported split ratios depending on the width of the predetermined sub-block perpendicular to the predetermined split direction, in such a way that supported split ratios are excluded , which divides the predetermined sub-block into a set of two son sub-blocks, at least one of which is too small to completely surround at least one of at least one predetermined minimum size block (compare above).
根據一個實施例,該一個或多個規則中的該一個規則根據垂直於該預定分割方向的該預定子區塊的該寬度來排除支持的分割比,以這樣的一方式排除支持的分割比,其將該預定的子區塊分成兩個兒子子區塊,其中至少一個超過一預定寬高比(比較上述)。According to one embodiment, the one rule of the one or more rules excludes supported split ratios based on the width of the predetermined sub-block perpendicular to the predetermined split direction, in such a manner that the supported split ratios are excluded, It divides the predetermined sub-block into two sub-blocks, at least one of which exceeds a predetermined aspect ratio (compare above).
根據一個實施例,該一個或多個規則中的該一個規則可以根據於垂直於該預定分割方向的該預定子區塊的該寬度來排除支持的分割比,以這樣的一方式排除支持分割比的一預定子集合,其取決於該預定子區塊所屬的該遞歸雙分割的該分割級別(比較上述)。According to one embodiment, the one of the one or more rules may exclude supported split ratios based on the width of the predetermined sub-block perpendicular to the predetermined split direction, in such a manner that supported split ratios are excluded A predetermined subset of , which depends on the partition level of the recursive dual partition to which the predetermined sub-block belongs (compare above).
根據一實施例,該一個或多個規則中的該一個規則可以根據該圖片區塊的一個或多個其他子區塊的一另一分割線的一另一分割方向以及一另一分割比來排除所支持的分割比,從其經由該遞歸雙分割獲得該預定子區塊,其係藉由沿著該另一分割線分割一個或多個另外的子區塊(比較上述)。According to an embodiment, the one of the one or more rules may be based on another dividing direction and another dividing ratio of another dividing line of one or more other sub-blocks of the picture block. Excluding the supported split ratios, the predetermined sub-block is obtained via the recursive double split by splitting one or more further sub-blocks along the further split line (compare above).
根據一個實施例,該解碼器可以被配置為取決於支持分割比的該縮減集合,其係藉由該分割信息向該縮減集合發送信號以限制支持分割比,俾來控制相對於該圖片區塊的該預定子區塊的該雙分割,並且該一個或多個規則中的一個排除支持的分割比,以便減少該分割信息的多個冗餘設置的一數量(例如,導致該圖片區塊的該相同分割的設置的該數量,例如,如圖13中所示一個)。According to one embodiment, the decoder may be configured to depend on the reduced set of supported partitioning ratios by signaling the reduced set with the partitioning information to limit the supported partitioning ratios in order to control relative to the picture block. the dual partitioning of the predetermined sub-blocks, and one of the one or more rules excludes supported partitioning ratios in order to reduce a number of redundant settings of the partitioning information (e.g., resulting in The number of identically divided settings is, for example, as shown in Figure 13A).
根據一個實施例,支持分割比的該集合可以是不可約分分數的一集合:, 其中,使得每對分割比和,與表示互補的非對稱分割,並且其中,如果對於,,則和,並且其中每個支持的分割比表示一寬度的一比率,其係 一左和右兒子子區塊中的一個是由沿著具有該預定分割方向的一分割線以相對於(例如除以)該預定子區塊的該寬度的該分割比來分割該預定子區塊所產生的,如果該預定的分割方向是垂直的,兩者測量都垂直於該分割方向,以及 一上和下兒子子區塊中的一個是由於沿著具有該預定分割方向的一分割線以相對於該預定子區塊的該寬度的該分割比來分割該預定子區塊所產生的,如果該預定的分割方向是水平的,兩者測量都垂直於該分割方向。According to one embodiment, the set supporting division ratios may be a set of irreducible fractions: , in , making each pair of split ratios and ,and represents a complementary asymmetric partition, and where, if for , , then and , and wherein each supported split ratio represents a ratio of a width of one of the left and right sub-blocks divided by (e.g., divided by) a split line along a split line having the predetermined split direction. The dividing ratio of the width of the predetermined sub-block resulting from dividing the predetermined sub-block, if the predetermined dividing direction is vertical, both measurements are perpendicular to the dividing direction, and an upper and a lower sub-block One of the blocks is generated by dividing the predetermined sub-block along a dividing line having the predetermined dividing direction at the dividing ratio relative to the width of the predetermined sub-block, if the predetermined dividing direction is horizontal, both measured perpendicular to the direction of the division.
根據一個實施例,該一個或多個規則中的該一個可以排除,如果該預定的分割方向平行於一分割線的該分割方向,沿此該預定子區塊的該父親子區塊被分割,並且如果該預定子區塊的一寬度是該父親子區塊的寬度的倍,則是該父塊的分割比例(例如,該預定子區塊是該分子所涉及的子區塊),支持分割比,其中該父親區塊(例如該子區塊其實際上寬度將是該父親子區塊的寬度的(1-)倍)被分割成該另一個區塊的一分割比,並且在該支持分割比(這樣該預定的子區塊的寬度將是父親子區塊的寬度的倍,而該另一個子區塊的寬度將是該父親子區塊的寬度的(1-)倍)的該集合中該父親子區塊的一分割比,和,和/或如果該預定的分割方向平行於一分割線的該分割方向,沿此該預定子區塊的該父親子區塊被分割,並且如果該預定的子區塊具有一寬度該父親子區塊寬度的倍,是該父親區塊的分割比例,支持分割比,其中該父親區塊被分割成該另一個區塊的一分割比,並且在支持分割比的該集合中該父親子區塊的一分割比,其中和。According to one embodiment, the one of the one or more rules may exclude, if the predetermined dividing direction is parallel to the dividing direction of a dividing line along which the parent sub-block of the predetermined sub-block is divided, And if a width of the predetermined sub-block is the width of the parent sub-block times, then Is the split ratio of the parent block (for example, the predetermined sub-block is the sub-block involved in the molecule), supports the split ratio , where the parent block (for example, the actual width of the child block will be (1- ) times) is divided into a division ratio of the other block , and in the supported split ratio (such that the width of the predetermined sub-block will be the width of the parent sub-block times, and the width of the other sub-block will be (1- ) times) a division ratio of the parent child block in the set , and , and/or if the predetermined dividing direction is parallel to the dividing direction of a dividing line along which the parent sub-block of the predetermined sub-block is divided, and if the predetermined sub-block has a width The width of the parent and child blocks times, Is the split ratio of the parent block, supports split ratio , where the parent block is split into a split ratio of the other block , and a split ratio of the parent child block in the set that supports split ratios ,in and .
根據一實施例,該一個或多個規則中的該一個排除一支持的分割比,如果該預定的分割方向垂直於一分割線的該分割方向,沿此該預定子區塊的該父親子區塊被分割,並且與該另一個子區塊平行,其係該父親子區塊分割成的,即的一個,其中是該另一個區塊的該分割比。According to an embodiment, the one of the one or more rules excludes a supported split ratio if the predetermined split direction is perpendicular to the split direction of a split line along which the parent sub-region of the predetermined sub-block The block is divided parallel to the other sub-block into which the parent sub-block is divided, i.e. one of ,in is the split ratio of the other block.
根據一個實施例,根據該觀點的該解碼器還可以根據觀點一進行該分割,即 藉由遞歸雙分割將該圖片12的一圖片區塊18分割為該編碼區塊16,並根據該資料流14中的分割信息控制該遞歸雙分割,以及 設置一第一分割線(例如,圖1左上角的編碼單元1和編碼單元2之間的線)的一第一分割線方向,藉由該遞歸雙分割沿著該第一分割線將該圖片區塊16的一預定分割級別(級別2,級別0分配給區塊16)的一預定子區塊(圖1左上角)分割成一後續分割級別(級別3)的一對兒子子區塊(編碼單元1,編碼單元2),取決於一第二分割線(分隔圖1的左上和左下四分之一的線)的一第二分割線方向,沿著該第二分割線將該圖片區塊16的一個先前分割級別(級別1)的一祖父子區塊(圖1的左半部分;注意術語「祖父子區塊」應被理解為足夠寬以覆蓋圖片區塊18本身)分成該預定的子區塊(左上角)和另一個子區塊(左下角)。According to one embodiment, the decoder according to this viewpoint can also perform the segmentation according to viewpoint one, that is, Split a picture block 18 of the picture 12 into the encoding block 16 by recursive double splitting, and control the recursive double splitting according to the splitting information in the data stream 14, and Set a first dividing line direction of a first dividing line (for example, the line between coding unit 1 and coding unit 2 in the upper left corner of Figure 1), and divide the picture along the first dividing line through the recursive double dividing. A predetermined sub-block (upper left corner of Figure 1) of a predetermined partition level (level 2, level 0 is assigned to block 16) of block 16 is partitioned into a pair of sub-sub-blocks (coded) of a subsequent partition level (level 3) Unit 1, encoding unit 2), depending on the direction of a second dividing line (the line separating the upper left and lower left quarters of Figure 1), divide the picture block along the second dividing line A grandparent block of a previous partitioning level (Level 1) of 16 (left half of Figure 1; note that the term "grandfather block" should be understood as being wide enough to cover the picture block 18 itself) is divided into the predetermined subblock (top left) and another subblock (bottom left).
一個實施例提供了一種用於以編碼區塊16為單位從一資料流14解碼一圖片12的方法,包括: - 藉由遞歸雙分割將該圖片12的一圖片區塊18分割為該編碼區塊16,並根據該資料流14中的分割信息控制該遞歸雙分割,其中該遞歸雙分割的該控制包括根據該圖片區塊18的一預定子區塊(例如,圖1中對應於圖2中的任何節點的任何區塊,因此包括區塊18本身,但也包括藉由分割獲得的其中的一部分)控制該雙分割,並依據: 是否該預定子區塊要被分割或者將其保留為不分割, 一分割線的一分割線方向(例如水平或垂直),在其中該圖片區塊的該預定子區塊將藉由該遞歸雙分割來分割,和/或 一分割比,在其中垂直於該分割線的該圖片區塊的該預定子區塊的一寬度被該分割線穿過; - 支持一支持分割比的集合(集合A),用於分割該預定的子區塊,並且被配置為針對沿著具有一預定分割線方向的一分割線的該預定子區塊的一分割,而根據一個或多個規則從支持分割比的該集合中排除支持的分割比,獲得支持分割比的一縮減集合, - 根據支持分割比的該縮減集合,來控制相對於該圖片區塊的該預定子區塊的該雙分割。One embodiment provides a method for decoding a picture 12 from a data stream 14 in units of encoding blocks 16, including: - Divide a picture block 18 of the picture 12 into the encoding block 16 by recursive double splitting, and control the recursive double splitting according to the splitting information in the data stream 14, wherein the control of the recursive double splitting includes based on A predetermined sub-block of the picture block 18 (e.g., any block in Figure 1 corresponding to any node in Figure 2, thus including block 18 itself, but also a portion thereof obtained by partitioning) controls The double division is based on: whether the predetermined sub-block is to be split or left unsplit, a dividing line direction (e.g., horizontal or vertical) of a dividing line in which the predetermined sub-block of the picture block is to be divided by the recursive double dividing, and/or a dividing ratio in which a width of the predetermined sub-block of the picture block perpendicular to the dividing line is crossed by the dividing line; - Supports a set (set A) that supports split ratios for splitting the predetermined sub-block, and is configured for a split of the predetermined sub-block along a split line having a predetermined split line direction, and excluding supported split ratios from the set of supported split ratios according to one or more rules to obtain a reduced set of supported split ratios, - Control the dual partitioning of the predetermined sub-block relative to the picture block according to the reduced set of supported partition ratios.
根據一個實施例,該方法可以使用一計算機或CPU來執行。因此,一實施例提供了相應的計算機程式。According to one embodiment, the method may be performed using a computer or CPU. Therefore, an embodiment provides a corresponding computer program.
一實施例提供了一種基於區塊的編碼器,用於以編碼區塊16為單位將一圖片12編碼為一資料流14,被配置為藉由遞歸雙分割將該圖片12的一圖片區塊18分割為該編碼區塊16,並根據分割信息控制該遞歸雙分割並將該分割信息***該資料流14,其中該遞歸雙分割的該控制包括控制相對於該圖片區塊18的一預定子區塊(例如,圖1中對應於圖2中任何節點的任何區塊,因此包括區塊18本身,但也包括藉由分割獲得的部分)的該雙分割,並依據是否該預定子區塊要被分割或者將其保留為不分割;一分割線的一分割線方向(例如水平或垂直),在其中該圖片區塊的該預定子區塊將藉由該遞歸雙分割來分割;以及一分割比,在其中垂直於該分割線的該圖片區塊的該預定子區塊的一寬度被該分割線穿過。此處,該基於區塊的編碼器支持一支持分割比的集合(例如集合A),用於分割該預定的子區塊,並且被配置為針對沿著具有一預定分割線方向的一分割線的該預定子區塊的一分割,而根據一個或多個規則從支持分割比的該集合中排除支持的分割比,獲得支持分割比的一縮減集合。另外,該基於區塊的邊碼器被配置為根據支持分割比的該縮減集合,來控制相對於該圖片區塊的該預定子區塊的該雙分割。One embodiment provides a block-based encoder for encoding a picture 12 into a data stream 14 in units of encoding blocks 16, configured to divide a picture block of the picture 12 by recursive double partitioning. 18 is divided into the encoding block 16, and the recursive double splitting is controlled according to the splitting information and the splitting information is inserted into the data stream 14, wherein the control of the recursive double splitting includes controlling a predetermined subdivision relative to the picture block 18. This double split of a block (e.g., any block in Figure 1 corresponding to any node in Figure 2, thus including block 18 itself, but also the portion obtained by splitting), and depending on whether the predetermined sub-block to be split or left unsplit; a split line direction (e.g., horizontal or vertical) of a split line in which the predetermined sub-blocks of the picture block are to be split by the recursive double split; and a A split ratio in which a width of the predetermined sub-block of the picture block perpendicular to the split line is crossed by the split line. Here, the block-based encoder supports a set of supported split ratios (eg, set A) for splitting the predetermined sub-blocks, and is configured to target a split line along a predetermined split line direction. A partitioning of the predetermined sub-block is performed, and the supported partitioning ratios are excluded from the set of supported partitioning ratios according to one or more rules to obtain a reduced set of supported partitioning ratios. Additionally, the block-based edge encoder is configured to control the dual partitioning with respect to the predetermined sub-block of the picture block based on the reduced set of supported partitioning ratios.
該基於區塊的編碼器可以被配置為以一種方式控制相對於該圖片區塊的該預定子區塊的該雙分割,這取決於所支持的分割比的該縮減集合,使得在該資料流中的該分割信息取決於支持的分割比的該縮減集合。The block-based encoder may be configured to control the dual partitioning relative to the predetermined sub-block of the picture block in a manner that depends on the reduced set of supported partitioning ratios such that in the data stream The split information in depends on the reduced set of supported split ratios.
另一實施例提供了一種用於以編碼區塊16為單位將一圖片12編碼成一資料流14的方法,其被配置為 - 藉由遞歸雙分割將該圖片12的一圖片區塊18分割為該編碼區塊16,並根據分割信息控制該遞歸雙分割並將該分割信息***該資料流14,其中該遞歸雙分割的該控制包括控制相對於該圖片區塊18的一預定子區塊(例如,圖1中的任何區塊對應於圖2中的任何節點,因此包括區塊18本身,但也包括藉由分割獲得的部分)的該雙分割,並依據是否該預定子區塊要被分割或者將其保留為不分割,一分割線的一分割線方向(例如水平或垂直),在其中該圖片區塊的該預定子區塊將藉由該遞歸雙分割來分割,以及一分割比,在其中垂直於該分割線的該圖片區塊的該預定子區塊的一寬度被該分割線穿過; - 支持一支持分割比的集合(集合A),係用於分割該預定的子區塊,並且被配置為針對沿著具有一預定分割線方向的一分割線的該預定子區塊的一分割,而根據一個或多個規則從支持分割比的該集合中排除支持的分割比,獲得支持分割比的一縮減集合, - 根據支持分割比的該縮減集合,來控制相對於該圖片區塊的該預定子區塊的該雙分割。Another embodiment provides a method for encoding a picture 12 into a data stream 14 in units of encoding blocks 16, which is configured as - Divide a picture block 18 of the picture 12 into the encoding block 16 by recursive double splitting, control the recursive double splitting according to the splitting information and insert the splitting information into the data stream 14, wherein the recursive double splitting The control includes controlling a predetermined sub-block relative to the picture block 18 (e.g., any block in Figure 1 corresponds to any node in Figure 2, thus including block 18 itself, but also includes obtaining by partitioning of the part), and depending on whether the predetermined sub-block is to be divided or left undivided, a dividing line direction (e.g., horizontal or vertical) of a dividing line in which the The predetermined sub-block is to be split by the recursive double split, and a split ratio in which a width of the predetermined sub-block of the picture block perpendicular to the split line is crossed by the split line; - supports a set (set A) that supports split ratios for splitting the predetermined sub-block and is configured for a split of the predetermined sub-block along a split line having a predetermined split line direction , and exclude supported split ratios from the set of supported split ratios according to one or more rules to obtain a reduced set of supported split ratios, - Control the dual partitioning of the predetermined sub-block relative to the picture block according to the reduced set of supported partition ratios.
根據一個實施例,該方法可以使用一計算機或CPU來執行。因此,一實施例提供了相應的計算機程式。According to one embodiment, the method may be performed using a computer or CPU. Therefore, an embodiment provides a corresponding computer program.
注意,只要該雙分割的基於分割信息之控制保持不變,可以在編碼器一側完成一些「排除規則」,這些規則在解碼器一側不被檢查或模擬,其使用該相同的排除規則集合。Note that as long as the segmentation information-based control of the dual segmentation remains unchanged, some "exclusion rules" can be done on the encoder side that are not checked or simulated on the decoder side, which uses the same set of exclusion rules .
第三個觀點third view
根據本申請的一第三觀點,圖片劃分成區塊-可以是遞歸雙分割或任何其他遞歸多分割-會經由以下方式更有效地呈現:上下文自適應地熵解碼使用依賴於一個或多個相鄰編碼區塊的一大小的一上下文來控制一預定圖片區塊的一預定子區塊的一分割的一個或多個語法元素,其中在該預定子區塊的一鄰域中,以該編碼順序將該圖片分割為該預定子區塊的一個或多個相鄰編碼區塊。According to a third aspect of the present application, the partitioning of the picture into blocks - which can be recursive dual-partitioning or any other recursive multi-partitioning - is more efficiently rendered via context-adaptive entropy decoding using one or more phase-dependent A context of a size adjacent to a coding block controls one or more syntax elements of a partition of a predetermined sub-block of a predetermined picture block, wherein in a neighborhood of the predetermined sub-block, with the coding The picture is sequentially divided into one or more adjacent coding blocks of the predetermined sub-block.
該第三觀點的一實施例提供了一基於區塊的解碼器10,用於以編碼區塊16為單位從一資料流14解碼一圖片12,其被配置為經由遞歸分割沿著一編碼次序將該圖片12的一個或多個圖片區塊18分割為該編碼區塊16,並根據該資料流中的分割信息控制該遞歸分割,並且來自該分割信息的上下文自適應地熵解碼使用依賴於一個或多個相鄰編碼區塊(例如A1、A2、B1和B2)的一大小(比較「面積」)的一上下文來控制一預定圖片區塊的一預定子區塊的一分割的一個或多個語法元素(例如split_ratio _...),其中在該預定子區塊的一鄰域中,以該編碼順序將該圖片分割為該預定子區塊的一個或多個相鄰編碼區塊。An embodiment of the third aspect provides a block-based decoder 10 for decoding a picture 12 from a data stream 14 in units of coding blocks 16, which is configured to follow a coding order via recursive partitioning. One or more picture blocks 18 of the picture 12 are partitioned into the encoding blocks 16, and the recursive partitioning is controlled based on partitioning information in the data stream, and context-adaptive entropy decoding from the partitioning information uses A context of a size (compare "area") of one or more adjacent coding blocks (e.g., A1, A2, B1, and B2) to control a partition of a predetermined sub-block of a predetermined picture block or A plurality of syntax elements (such as split_ratio_...), wherein the picture is split into one or more adjacent coding blocks of the predetermined sub-block in the coding order in a neighborhood of the predetermined sub-block .
根據一個實施例,該基於區塊的解碼器可以被配置為將該圖片預分割成圖片區塊的一陣列,並且其中該編碼順序以一光柵掃描順序(raster scan order)遍歷該圖片區塊。According to one embodiment, the block-based decoder may be configured to pre-partition the picture into an array of picture blocks, and wherein the encoding sequence traverses the picture blocks in a raster scan order.
根據一個實施例,在每個圖片區塊內,該編碼順序遵循一深度優先或廣度優先的遍歷順序。According to one embodiment, within each picture block, the coding order follows a depth-first or breadth-first traversal order.
根據一個實施例,其中該一個或多個語法元素控制關於一預定子區塊的該遞歸雙分割,並根據: 是否該預定子區塊要被分割或者將其保留為不分割, 一分割線的一分割方向,在其中該圖片區塊的該預定子區塊將藉由該遞歸雙分割來分割,和 一分割比,在其中該圖片區塊的該預定子區塊的一寬度,垂直於該寬度,其被該分割線穿過。According to one embodiment, wherein the one or more syntax elements control the recursive double splitting with respect to a predetermined sub-block, and according to: whether the predetermined sub-block is to be split or left unsplit, a split direction of a split line in which the predetermined sub-block of the picture block is to be split by the recursive double split, and A split ratio in which a width of the predetermined sub-block of the picture block is perpendicular to the width crossed by the split line.
根據一實施例,該一個或多個語法元素中的該一個在一分割比方面控制相對於一預定子區塊的該遞歸雙分割,在該分割比下,該圖片區塊的該預定子區塊的一寬度,垂直於該寬度,其被一分割線穿過,在該分割線處,該圖片區塊的該預定子區塊將藉由該遞歸雙分割來分割,並且其中該一個語法元素的該上下文取決於相鄰編碼區塊的該大小,在該預定子區塊的一鄰域中,以該編碼順序將該圖片分割為該預定子區塊的該相鄰編碼區塊。According to an embodiment, the one of the one or more syntax elements controls the recursive dual partitioning with respect to a predetermined sub-block in terms of a partitioning ratio at which the predetermined sub-region of the picture block a width of a block, perpendicular to the width, crossed by a dividing line at which the predetermined sub-block of the picture block is to be divided by the recursive double split, and in which the one syntax element The context depends on the size of adjacent coding blocks of the predetermined sub-block in which the picture is partitioned in the coding order in a neighborhood of the predetermined sub-block.
根據一實施例,該解碼器可以另外包括根據觀點1和/或觀點2的一解碼器。According to an embodiment, the decoder may additionally include a decoder according to viewpoint 1 and/or viewpoint 2.
另一實施例提供了一種用於以編碼區塊16為單位從一資料流14解碼一圖片12的方法,包括: - 經由遞歸分割沿著一編碼次序將該圖片12的一個或多個圖片區塊18分割為該編碼區塊16,並根據該資料流中的分割信息控制該遞歸分割, - 來自該分割信息的上下文自適應地熵解碼使用依賴於一個或多個相鄰編碼區塊(例如A1、A2、B1和B2)的一大小(比較「面積」)的一上下文來控制一預定圖片區塊的一預定子區塊的一分割的一個或多個語法元素(例如split_ratio _...),其中在該預定子區塊的一鄰域中,以該編碼順序將該圖片分割為該預定子區塊的一個或多個相鄰編碼區塊。Another embodiment provides a method for decoding a picture 12 from a data stream 14 in units of encoding blocks 16, including: - Divide one or more picture blocks 18 of the picture 12 into the encoding blocks 16 along a coding sequence through recursive splitting, and control the recursive splitting according to the splitting information in the data stream, - Context-adaptive entropy decoding from the segmentation information uses a context that depends on a size (compare "area") of one or more adjacent coding blocks (e.g. A1, A2, B1 and B2) to control a predetermined One or more syntax elements (e.g., split_ratio_...) of a split of a predetermined sub-block of a picture block, wherein the picture is split in the coding order into One or more adjacent coding blocks of the predetermined sub-block.
可以使用具有用於執行方法的一程式代碼的一計算機程式來執行該方法。The method may be performed using a computer program having a program code for performing the method.
另一實施例提供了一種用於以編碼區塊16為單位從一資料流14編碼一圖片12的方法,其被配置為經由遞歸分割沿著一編碼次序將該圖片12的一個或多個圖片區塊18分割為該編碼區塊16,並根據分割信息控制該遞歸分割並將該分割信息***該資料流,並且上下文自適應熵編碼將一個或多個語法元素(例如split_ratio _...)編碼成該分割信息,該語法元素使用取決於一個或多個相鄰編碼區塊(例如A1、A2、B1和B2)的一大小(比較「面積」)的一上下文來控制一預定圖片區塊的一預定子區塊的一分割,其中在該預定子區塊的一鄰域中,以該編碼順序將該圖片分割為該預定子區塊的一個或多個相鄰編碼區塊。Another embodiment provides a method for encoding a picture 12 from a data stream 14 in units of encoding blocks 16, which is configured to divide one or more pictures of the picture 12 along an encoding order via recursive partitioning. Block 18 is split into encoding blocks 16, and the recursive splitting is controlled and inserted into the data stream according to the splitting information, and the context-adaptive entropy encoding encodes one or more syntax elements (e.g. split_ratio_...) Encoded into the segmentation information, the syntax element controls a predetermined picture block using a context that depends on a size (compare "area") of one or more adjacent coded blocks (e.g., A1, A2, B1, and B2) A partitioning of a predetermined sub-block, wherein the picture is partitioned into one or more adjacent coding blocks of the predetermined sub-block in the coding order in a neighborhood of the predetermined sub-block.
另一實施例提供了一種用於以編碼區塊16為單位從一資料流14編碼一圖片12的相應方法,包括: - 經由遞歸分割沿著一編碼次序將該圖片12的一個或多個圖片區塊18分割為該編碼區塊16,並根據分割信息控制該遞歸分割並將該分割信息***該資料流,並且 - 上下文自適應熵編碼將一個或多個語法元素(例如split_ratio _...)編碼成該分割信息,該語法元素使用取決於一個或多個相鄰編碼區塊(例如A1、A2、B1和B2)的一大小(比較「面積」)的一上下文來控制一預定圖片區塊的一預定子區塊的一分割,其中在該預定子區塊的一鄰域中,以該編碼順序將該圖片分割為該預定子區塊的一個或多個相鄰編碼區塊。Another embodiment provides a corresponding method for encoding a picture 12 from a data stream 14 in units of encoding blocks 16, including: - Divide one or more picture blocks 18 of the picture 12 into the coded blocks 16 via recursive partitioning along a coding sequence, control the recursive splitting according to the splitting information and insert the splitting information into the data stream, and - Context-adaptive entropy coding encodes one or more syntax elements (e.g. split_ratio_...) into the split information, the usage of which syntax elements depends on one or more adjacent coding blocks (e.g. A1, A2, B1 and B2) a context of a size (compare "area") to control a partitioning of a predetermined sub-block of a predetermined picture block, wherein in a neighborhood of the predetermined sub-block, the coding order The picture is divided into one or more adjacent coding blocks of the predetermined sub-block.
根據一個實施例,該方法可以使用一計算機或CPU來執行。因此,一實施例提供了相應的計算機程式。According to one embodiment, the method may be performed using a computer or CPU. Therefore, an embodiment provides a corresponding computer program.
第四個觀點The fourth point of view
根據本申請的一第四個觀點,經由支持至少兩種模式,在這兩種模式之間一切換是可行的,並且在執行該分割的自由度方面不同,圖片劃分成區塊-可以是遞歸雙分割或任何其他遞歸多分割-將更有效地呈現。檔次和級別可以與不同的模式相關聯,反之,不同的模式又可以由上述「適應集合」來定義。可以以整個視頻、圖片序列、圖片、切片為單位或甚至以單個圖片區塊為單位來選擇「適應集合」。可以經由收集大資料來「學習」該(或一些)適應集合,並將其分發給該解碼器和編碼器。According to a fourth aspect of the application, the picture is divided into blocks - possibly recursively - by supporting at least two modes between which a switch is possible and differing in the degree of freedom in performing the partitioning. Double split or any other recursive multi-split - will render more efficiently. Grades and levels can be associated with different modes, and in turn, different modes can be defined by the above-mentioned "adaptation sets". Adaptation sets can be selected on an entire video, image sequence, image, slice basis, or even on a single image block basis. The adaptation set (or sets) can be "learned" by collecting large data and distributing it to the decoder and encoder.
根據該觀點4的一實施例,其提供了一種基於區塊的解碼器,用於以編碼區塊為單位對來自一資料流的一圖片進行解碼,該解碼器被配置為經由遞歸分割沿著一編碼次序將該圖片的一個或多個圖片區塊分割為該編碼區塊,並根據該資料流中的分割信息控制該遞歸分割。該基於區塊的解碼器支持至少兩種模式,在這兩種模式之間該基於區塊的解碼器是可切換的,並且在執行該分割的自由度方面不同。According to an embodiment of the aspect 4, a block-based decoder is provided for decoding a picture from a data stream in units of coding blocks, the decoder being configured to perform recursive partitioning along the An encoding sequence divides one or more picture blocks of the picture into the encoding blocks, and controls the recursive division according to the division information in the data stream. The block-based decoder supports at least two modes between which the block-based decoder is switchable and differs in the degree of freedom to perform the segmentation.
根據一實施例,該基於區塊的解碼器被配置為使得該至少兩種模式在以下一個或多個方面不同: 一最小區塊大小,其必須適合每個編碼區塊, 一最大分割樹深度, 在一當前圖片區塊的一當前子區塊的一分割之後的一最大分割樹深度,其中該分割沿著一分割線,其係垂直於一父親區塊的一分割線,該當前子區塊是該父親區塊的子區塊, 一當前圖片的子區塊的一最大區塊大小,其中允許非對稱分割, 由一當前圖片區塊的一當前子區塊的一分割所產生的兒子子區塊的一最大寬高比, 由一當前圖片區塊的一當前子區塊的一分割所產生的兒子子區塊的一最小寬高比, 一當前圖片區塊(例如超出一某個圖片邊界的那些)的預設分割,其根據該分割信息以從該遞歸雙分割的一開始, 用於分割一當前圖片區塊的一當前子區塊的支持分割比的一集合(例如集合A組); 沿著具有一預定分割方向的一分割線的一當前子區塊的一分割,而根據一個或多個規則從支持分割比的該集合中排除支持的分割比。According to an embodiment, the block-based decoder is configured such that the at least two modes differ in one or more of the following aspects: a minimum block size that must fit into each encoding block, - maximum split tree depth, A maximum partition tree depth after a partition of a current sub-block of a current picture block, where the partition is along a partition line perpendicular to a partition line of a parent block, the current sub-block is a child block of the parent block, a maximum block size of a sub-block of the current picture in which asymmetric partitioning is allowed, a maximum aspect ratio of a child sub-block resulting from a partition of a current sub-block of a current picture block, a minimum aspect ratio of a child sub-block resulting from a partition of a current sub-block of a current picture block, A default partition of the current picture block (e.g., those beyond a certain picture boundary) based on the partition information, starting from one of the recursive double partitions, A set of supported partitioning ratios for partitioning a current sub-block of a current picture block (such as set A); A partitioning of a current sub-block along a partitioning line having a predetermined partitioning direction while excluding supported partitioning ratios from the set of supported partitioning ratios according to one or more rules.
根據一實施例,該基於區塊的解碼器可以被配置為根據以下中的一個或多個在該至少兩個模式之間切換: 該資料流中的信令, 到目前為止使用的模式的一歷史(例如,在解碼期間形成使用模式的一統計資料), 一空間預測器(例如,編碼模式、預測參數和/或用於相鄰編碼/預測區塊的分割信息), 一當前圖片區塊超出一外部或內部圖片邊界的一擴展程度。According to an embodiment, the block-based decoder may be configured to switch between the at least two modes according to one or more of the following: signaling in this data stream, a history of patterns used so far (e.g., a statistics forming usage patterns during decoding), a spatial predictor (e.g., coding mode, prediction parameters, and/or partitioning information for adjacent coding/prediction blocks), The extent to which a current picture block extends beyond an outer or inner picture boundary.
根據一實施例,該基於區塊的解碼器可以被配置為以下列單元為單位,而在至少兩個模式之間切換: 一個圖片序列, 一圖片的樹根區塊, 圖片區塊(可能是樹根區塊)。According to an embodiment, the block-based decoder may be configured to switch between at least two modes in units of the following units: a sequence of images, The tree root block of an image, Image block (possibly tree root block).
根據實施例,該觀點4的該解碼器可以另外包括根據觀點1、2和/或3的一解碼器。According to an embodiment, the decoder of aspect 4 may additionally comprise a decoder according to aspects 1, 2 and/or 3.
另一實施例提供了一種用於以編碼區塊為單位從一資料流解碼一圖片的方法,包括:藉由遞歸分割將該圖片的一個或多個圖片區塊沿一編碼順序分割為該編碼區塊,並根據在該資料流中的分割信息控制該遞歸分割,並且支持至少兩種模式或在至少兩種模式之間切換(在執行該分割的自由度方面不同)。Another embodiment provides a method for decoding a picture from a data stream in coded block units, including: dividing one or more picture blocks of the picture along a coding sequence by recursively dividing into the coded blocks, and controls the recursive segmentation based on segmentation information in the data stream, and supports at least two modes or switching between at least two modes (different in degrees of freedom to perform the segmentation).
根據一個實施例,該方法可以使用一計算機或CPU來執行。因此,一實施例提供了相應的計算機程式。According to one embodiment, the method may be performed using a computer or CPU. Therefore, an embodiment provides a corresponding computer program.
另一實施例提供了基於區塊的編碼器,用於以編碼區塊為單位對來自一資料流的一圖片進行編碼,被配置為藉由遞歸分割將該圖片的一個或多個圖片區塊沿著一編碼順序分割為該編碼區塊,同時根據分割信息控制該遞歸分割並將該分割信息***到該資料流中,其中該基於區塊的編碼器支持至少兩種模式,在這兩種模式之間該基於區塊的編碼器是可切換的,並且在執行該分割的自由度方面不同。Another embodiment provides a block-based encoder for encoding a picture from a data stream in coding block units, configured to divide one or more picture blocks of the picture by recursive partitioning. Split the coding block along a coding sequence, control the recursive splitting according to the splitting information and insert the splitting information into the data stream, wherein the block-based encoder supports at least two modes, in these two The block-based encoder is switchable between modes and differs in the degree of freedom to perform the segmentation.
另一實施例提供了用於以編碼區塊為單位對來自一資料流的一圖片進行編碼的方法,包括:藉由遞歸分割將該圖片的一個或多個圖片區塊沿一編碼順序分割為該編碼區塊,並根據分割信息控制該遞歸分割,並且將分割信息***該資料流中,並支持至少兩種在執行該分割的自由度方面不同的模式。Another embodiment provides a method for encoding a picture from a data stream in coding block units, including: dividing one or more picture blocks of the picture along a coding sequence into The encoding block controls the recursive segmentation based on the segmentation information and inserts the segmentation information into the data stream, and supports at least two modes that differ in degrees of freedom in performing the segmentation.
根據一個實施例,該方法可以使用一計算機或CPU來執行。According to one embodiment, the method may be performed using a computer or CPU.
第五個觀點The fifth point of view
根據本申請的一第五個觀點,經由使用分割比的一集合使一分割比的該編碼顯現更有效率,所述分割比的集合包括例如相等分割和不對稱分割對(相互為倒數的比率),減少該集合並且使用一相應縮減的(或修剪的)二叉樹作為二值化方案,以用於二值化/和去二值化一索引到該縮減列表中。According to a fifth aspect of the application, the encoding of a partition ratio is rendered more efficient by using a set of partition ratios, including for example pairs of equal partitions and asymmetric partitions (ratios that are reciprocal of each other). ), reduce the set and use a corresponding reduced (or pruned) binary tree as the binarization scheme for binarizing/and debinarizing an index into the reduced list.
觀點5的一實施例提供了一解碼器(例如,可能在圖15的該提取器內的一模塊),用於解碼指向來自一資料流的一分割比的一索引,該解碼器被配置為藉由根據一個或多個規則去除分割比來減少分割比的一基本列表30,以便獲得分割比的一縮減列表32,其中該基本列表30對應於一個二叉樹34的樹葉42、37,其與該基本列表30的相應分割比相關聯,並且該縮減列表32對應於由該二叉樹34產生的一個縮減二叉樹50,其係經由從樹葉42、37到主根節點44,移除該二叉樹34中其該子節點不屬於該縮減列表32的每個節點40、38,並且代替具有僅一個未移除的子節點的該二叉樹34的每個節點,將該未移除的子節點直接附加到該二叉樹34的該節點,其相應中間節點係該節點的子節點,其中,該縮減二叉樹50的左邊(第一個)分支(在圖5和6中示例性地分配為“0”)與一第一個二元決策(bin)值相關聯,而該縮減二叉樹50的右邊(第二個)分支(在圖5和6中示例性地分配為“1”)與一第二個二元決策(bin)值相關聯,並且該縮減列表32的每個分割比與一個二元決策值序列相關聯的,其對應於與該分支相關聯的二元決策(bin)值的一個序列,該分支在該縮減二叉樹50中從該縮減二叉樹50的一主根節點52導向與相應的分割比相關聯的該縮減二叉樹50的一樹葉54,針對對應於一個或多個二元決策(例如,由各個split_ratio _...旗標形成)的一序列的一個二元決策字串(例如,由split_ratio _...旗標形成)進行熵解碼,從該縮減二叉樹50的該主根節點52開始,遍歷該縮減二叉樹50到該縮減二叉樹的樹葉54之一,該二元決策(bin)字串的每個二元決策(bin)對應於由一個或多個二元決策(bin)的該序列所遍歷的該縮減二叉樹50的該節點的一個;使用該縮減二叉樹作為一個二值化方案,對該二元決策(bin)字串進行去二值化,以便獲得該索引。An embodiment of aspect 5 provides a decoder (eg, possibly a module within the extractor of Figure 15) for decoding an index pointing to a partitioning ratio from a data stream, the decoder being configured to A base list 30 of split ratios is reduced by removing the split ratios according to one or more rules, so as to obtain a reduced list 32 of split ratios, wherein the base list 30 corresponds to the leaves 42, 37 of a binary tree 34, which are related to the The corresponding split ratios of the base list 30 are associated, and the reduced list 32 corresponds to a reduced binary tree 50 generated from the binary tree 34 by removing the children of the binary tree 34 from the leaves 42, 37 to the main root node 44. Each node 40 , 38 of the reduced list 32 has a node that does not belong to it, and instead of each node of the binary tree 34 having only one unremoved child node, the unremoved child node is appended directly to the binary tree 34 This node, whose corresponding intermediate node is a child node of this node, wherein the left (first) branch of the reduced binary tree 50 (exemplarily assigned to "0" in Figures 5 and 6) is connected to a first binary tree 50 A binary decision (bin) value is associated with a second binary decision (bin) value, and the right (second) branch of the reduced binary tree 50 (exemplarily assigned "1" in Figures 5 and 6) is associated with a second binary decision (bin) value is associated, and each split ratio of the reduced list 32 is associated with a sequence of binary decision values, which corresponds to a sequence of binary decision (bin) values associated with the branch in the reduced binary tree 50 leads from a primary root node 52 of the reduced binary tree 50 to a leaf 54 of the reduced binary tree 50 associated with a corresponding split ratio, for one or more binary decisions (e.g., represented by each split_ratio_... A sequence of binary decision strings (for example, formed by the split_ratio_... flag) is entropy decoded, starting from the primary root node 52 of the reduced binary tree 50, traversing the reduced binary tree 50 to the One of the leaves 54 of the reduced binary tree, each binary decision (bin) of the binary decision (bin) string corresponding to the reduced binary decision (bin) traversed by the sequence of one or more binary decisions (bins). one of the node; using the reduced binary tree as a binarization scheme, debinarize the binary decision (bin) string to obtain the index.
根據一實施例,該基本列表30是不可約分分數一的列表, 其中,使得每對分割比和,與和>表示互補的非對稱分割,並且其中,如果對於,,則和,並且該二叉樹34由具有2n個樹葉37的一個部分樹36組成,所有樹葉37藉由該部分樹36的n-1個中間節點40連接到該部分樹36的一樹根38,該部分樹36並且從左到右對應於該基本列表30的第二到第(2n+1)個成員,一個分離樹葉42對應於分割比1/2,該分離樹葉42藉由一第一分支46連接到一主根節點44,該部分樹的該根節點藉由一另一個分支48連接到該主根節點。According to an embodiment, the base list 30 is a list of irreducible fractions one , in , making each pair of split ratios and ,and and > represents a complementary asymmetric partition, and where, if for , , then and , and the binary tree 34 is composed of a partial tree 36 with 2n leaves 37. All leaves 37 are connected to a root 38 of the partial tree 36 through n-1 intermediate nodes 40 of the partial tree 36. The partial tree 36 And corresponding to the second to (2n+1)th members of the basic list 30 from left to right, a separation leaf 42 corresponds to a split ratio of 1/2, and the separation leaf 42 is connected to a through a first branch 46 A primary root node 44 to which the root node of the partial tree is connected by a further branch 48 .
根據一實施例,該解碼器可以被配置為針對一個或多個二元決策(bin)的該序列的至少一個二元決策(bin)子集合執行該上下文自適應熵解碼,以及以一種方式決定該熵解碼的一個上下文,使得該上下文的該決定不同於該二元決策(bin)子集合的該二元決策(bin)。According to an embodiment, the decoder may be configured to perform the context-adaptive entropy decoding for at least a subset of the sequence of one or more binary decisions (bins), and to decide in a manner The entropy decodes a context such that the decision for the context is different from the bin for the subset of bins.
根據一實施例,該解碼器可以被配置為針對該二元決策(bin)字串的至少一個預定二元決策(bin)執行執行該上下文自適應熵解碼,並且被配置為,根據該二叉樹34中的一位置(例如,分割級別)決定用於對該預定二元決策(bin)進行該熵解碼的一上下文,其中對應於該預定二元決策(bin)的該縮減二叉樹52的該節點源於該二叉樹34的該縮減(坦率地說,例如它在二叉樹34中的先前分割級別計數,而不是在該縮減樹50中的該分割級別)。According to an embodiment, the decoder may be configured to perform the context-adaptive entropy decoding for at least one predetermined binary decision (bin) execution of the binary decision (bin) string, and configured to perform the context-adaptive entropy decoding according to the binary tree 34 A location (e.g., split level) in determines a context for the entropy decoding of the predetermined binary decision (bin), wherein the node source of the reduced binary tree 52 corresponding to the predetermined binary decision (bin) at the reduction of the binary tree 34 (frankly speaking, for example it counts at the previous split level in the binary tree 34 rather than at the split level in the reduction tree 50).
根據一個實施例,該索引指向的該分割比用於一遞歸雙分割的分割。此處,該解碼器被配置為針對一個或多個二元決策(bin)的該序列的至少一個二元決策(bin)子集合執行該上下文自適應熵解碼,並且針對該二元決策(bin)子集合的每一個二元決策(bin),決定該熵解碼的一個上下文,其根據與一區塊(18)的一空間鄰域相關聯的編碼參數(例如,編碼模式、預測參數和/或用於編區碼/解碼區塊中的區塊的分割信息),從上下文的一集合中選擇相應二元決策(bin)的該上下文,該區塊(18)係該遞歸雙分割的分割所涉及的。According to one embodiment, the split ratio pointed to by the index is used for the split of a recursive double split. Here, the decoder is configured to perform the context-adaptive entropy decoding for at least a subset of the sequence of one or more binary decisions (bins), and for the binary decisions (bins) ) sub-set determines a context for the entropy decoding based on coding parameters associated with a spatial neighborhood of a block (18) (e.g., coding mode, prediction parameters, and/or or partitioning information for a block in an encoding/decoding block), selecting the context corresponding to the binary decision (bin) from a set of contexts that the block (18) is the partition of the recursive dual partitioning related.
根據一個實施例,該選擇發生的上下文的該集合係對於該二元決策(bin)子集合的至少兩個二元決策(bin)次子集合而言是不同的(例如,上下文的相互不同集合被用於該二元決策)。According to one embodiment, the set of contexts in which the selection occurs is different for at least two sub-subsets of binary decision (bin) sub-sets of the binary decision (bin) sub-set (e.g. mutually different sets of contexts be used for this binary decision).
根據一實施例,該解碼器可以被配置為對於至少一個該二元決策(bin)子集合,藉由根據該區塊的該空間鄰域中的雙分割樹葉區塊的一大小(例如面積),從上下文該集合中選擇該至少一個二元決策(bin)的該上下文,來決定用於該熵解碼的該上下文,該區塊係該遞歸雙分割的分割所涉及的。According to an embodiment, the decoder may be configured to, for at least one of the binary decision (bin) subsets, by splitting a leaf block according to a size (eg area) of a bipartite in the spatial neighborhood of the block , selecting the context of the at least one binary decision (bin) from the set of contexts to determine the context for the entropy decoding of the block involved in the partitioning of the recursive dual partitioning.
根據一個實施例,該解碼器可以被配置為在該遞歸雙分割的分割所涉及的該區塊的該空間鄰域中定位雙分割樹葉區塊,取決於該遞歸雙分割的分割以一種方式涉及的區塊的一分割線方向,使得在該空間鄰域中的該區塊沿著該分割線方向而鄰近於該遞歸雙分割的分割所涉及的該區塊,並且關於該分割線方向彼此橫向相鄰(例如,在垂直分割的情況下為A1和A2,以及水平分割的情況下為B1和B2)。According to one embodiment, the decoder may be configured to locate a bi-partitioned leaf block in the spatial neighborhood of the block involved in the partitioning of the recursive bi-partitioning in a manner dependent on the partitioning of the recursive dual-partitioning being involved a dividing line direction of a block such that the blocks in the spatial neighborhood are adjacent to the block involved in the recursive bi-partitioning along the dividing line direction, and are transverse to each other with respect to the dividing line direction Adjacent (for example, A1 and A2 in the case of vertical splitting, and B1 and B2 in the case of horizontal splitting).
根據實施例,該解碼器可以另外是根據觀點1、2、3和/或4的一解碼器。According to an embodiment, the decoder may additionally be a decoder according to aspects 1, 2, 3 and/or 4.
一實施例提供了一種用於解碼指向來自一資料流的一分割比的一索引的方法,包括: - 藉由根據一個或多個規則去除分割比來減少分割比的一基本列表30,以便獲得分割比的一縮減列表32,其中該基本列表30對應於一個二叉樹34的樹葉42、37,其與該基本列表30的相應分割比相關聯,並且該縮減列表32對應於由該二叉樹34產生的一個縮減二叉樹50, - 其經由從樹葉42、37到主根節點44,移除該二叉樹34中其該子節點不屬於該縮減列表32的每個節點40、38,並且 - 代替具有僅一個未移除的子節點的該二叉樹34的每個節點,將該未移除的子節點直接附加到該二叉樹34的該節點,其相應中間節點係該節點的子節點, - 其中,該縮減二叉樹50的左邊分支(在圖5和6中示例性地分配為“0”)與一第一個二元決策(bin)值相關聯,而該縮減二叉樹50的右邊分支(在圖5和6中示例性地分配為“1”)與一第二個二元決策(bin)值相關聯,並且該縮減列表32的每個分割比與一個bin值序列相關聯的,其對應於與該分支相關聯的二元決策(bin)值的一個序列,該分支在該縮減二叉樹50中從該縮減二叉樹50的一主根節點52導向與相應的分割比相關聯的一樹葉54, - 針對對應於一個或多個二元決策(例如,由各個split_ratio _...旗標形成)的一序列的一個二元決策字串(例如,由split_ratio _...旗標形成)進行熵解碼,從該縮減二叉樹50的該主根節點52開始,遍歷該縮減二叉樹50到該縮減二叉樹的樹葉54之一,該二元決策(bin)字串的每個二元決策(bin)對應於由一個或多個二元決策(bin)的該序列所遍歷的該縮減二叉樹50的該節點的一個; - 使用該縮減二叉樹作為一個二值化方案,對該二元決策(bin)字串進行去二值化,以便獲得該索引。One embodiment provides a method for decoding an index pointing to a partitioning ratio from a data stream, comprising: - Reducing a basic list 30 of split ratios by removing split ratios according to one or more rules, so as to obtain a reduced list 32 of split ratios, wherein the basic list 30 corresponds to the leaves 42, 37 of a binary tree 34, which are The corresponding split ratios of the base list 30 are associated, and the reduced list 32 corresponds to a reduced binary tree 50 generated from the binary tree 34, - It removes each node 40, 38 in the binary tree 34 whose child node does not belong to the reduced list 32 via the leaves 42, 37 to the main root node 44, and - Instead of each node of the binary tree 34 having only one unremoved child node, append the unremoved child node directly to the node of the binary tree 34, the corresponding intermediate node being a child node of the node, - where the left branch of the reduced binary tree 50 (exemplarily assigned "0" in Figures 5 and 6) is associated with a first binary decision (bin) value, and the right branch of the reduced binary tree 50 ( 5 and 6) is associated with a second binary decision (bin) value, and each split ratio of the reduction list 32 is associated with a sequence of bin values, which corresponding to a sequence of binary decision (bin) values associated with the branch leading from a primary root node 52 of the reduced binary tree 50 to a leaf 54 associated with a corresponding split ratio in the reduced binary tree 50, - Entropy over a sequence of binary decision strings (e.g., formed by split_ratio_... flags) corresponding to one or more binary decisions (e.g., formed by individual split_ratio_... flags) Decoding, starting from the main root node 52 of the reduced binary tree 50, traversing the reduced binary tree 50 to one of the leaves 54 of the reduced binary tree, each binary decision (bin) of the binary decision (bin) string corresponds to One of the nodes of the reduced binary tree 50 traversed by the sequence of one or more binary decisions (bins); - Use the reduced binary tree as a binarization scheme to debinarize the binary decision (bin) string to obtain the index.
根據一個實施例,該方法可以使用一計算機或CPU來執行。According to one embodiment, the method may be performed using a computer or CPU.
另一個實施例提供了一種編碼器,用於將指向一分割比的一索引編碼一成資料流,其被配置為藉由根據一個或多個規則去除分割比來減少分割比的一基本列表30,以便獲得分割比的一縮減列表32,其中該基本列表30對應於一個二叉樹34的樹葉42、37,其與該基本列表30的相應分割比相關聯,並且該縮減列表32對應於由該二叉樹34產生的一個縮減二叉樹50,經由從樹葉42、37到主根節點44,移除該二叉樹34中其該子節點都被移除的每個節點40、38,並且代替具有僅一個未移除的子節點的該二叉樹34的每個節點,將該未移除的子節點直接附加到該二叉樹34的該節點,其相應中間節點係該節點的子節點。此處,該縮減二叉樹50的左邊分支(在圖5和6中示例性地分配為“0”)與一第一個二元決策(bin)值相關聯,並且該縮減二叉樹50的右邊分支(在圖5和6中示例性地分配為“1”)與一第二個二元決策(bin)值相關聯,並且該縮減列表32的每個分割比與一個二元決策值序列相關聯的,其對應於與該分支相關聯的二元決策(bin)值的一個序列,該分支在該縮減二叉樹50中從該縮減二叉樹50的一主根節點52導向與相應的分割比相關聯的一樹葉54。此外,該解碼器被配置為使用該縮減二叉樹作為一個二值化方案將該索引二值化為一個二元決策(bin)字串,該二元決策(bin)字串對應於一個或多個二元決策(bin)(例如,由各個split_ratio _...旗標形成)的一序列,從該主樹根開始,遍歷該縮減二叉樹50到該縮減二叉樹樹葉54中的一個,其中該二元決策(bin)字串的每個二元決策(bin)對應於由一個或多個二元決策(bin)的該序列所遍歷的該縮減二叉樹50的該節點的一個;並且對該二元決策(bin)字串進行熵編碼(例如,由split_ratio _...旗標形成)。Another embodiment provides an encoder for encoding an index pointing to a partitioning ratio into a data stream configured to reduce a base list 30 of partitioning ratios by removing partitioning ratios according to one or more rules. , in order to obtain a reduced list 32 of splitting ratios, wherein the basic list 30 corresponds to the leaves 42, 37 of a binary tree 34, which are associated with the corresponding splitting ratios of the basic list 30, and the reduced list 32 corresponds to the leaves 42, 37 of the binary tree 34. 34 produces a reduced binary tree 50 by removing each node 40 , 38 in the binary tree 34 that has its children removed, via going from the leaves 42 , 37 to the primary root node 44 , and instead having only one unremoved For each node of the binary tree 34 of a child node, the unremoved child node is directly attached to the node of the binary tree 34, and its corresponding intermediate node is a child node of the node. Here, the left branch of the reduced binary tree 50 (exemplarily assigned "0" in Figures 5 and 6) is associated with a first binary decision (bin) value, and the right branch of the reduced binary tree 50 ( 5 and 6) is associated with a second binary decision (bin) value, and each split ratio of the reduction list 32 is associated with a sequence of binary decision values. , which corresponds to a sequence of binary decision (bin) values associated with the branch leading from a primary root node 52 of the reduced binary tree 50 to a leaf associated with a corresponding split ratio in the reduced binary tree 50 54. Additionally, the decoder is configured to binarize the index into a binary decision (bin) string using the reduced binary tree as a binarization scheme, the binary decision (bin) string corresponding to one or more A sequence of binary decisions (bins) (e.g., formed by split_ratio_... flags) starting from the main tree root and traversing the reduced binary tree 50 to one of the reduced binary tree leaves 54, where the binary Each binary decision (bin) of the decision (bin) string corresponds to one of the nodes of the reduced binary tree 50 traversed by the sequence of one or more binary decisions (bins); and for the binary decision The (bin) string is entropy encoded (for example, formed by the split_ratio_... flag).
另一實施例提供了一種用於將指向一分割比的一索引編碼為一資料流的方法,包括: - 藉由根據一個或多個規則去除分割比來減少分割比的一基本列表30,以便獲得分割比的一縮減列表32,其中該基本列表30對應於一個二叉樹34的樹葉42、37,其與該基本列表30的相應分割比相關聯,並且該縮減列表32對應於由該二叉樹34產生的一個縮減二叉樹50, o 其經由從樹葉42、37到主根節點44,移除該二叉樹34中其該子節點都被移除的每個節點40、38,並且 o 代替具有僅一個未移除的子節點的該二叉樹34的每個節點,將該未移除的子節點直接附加到該二叉樹34的該節點,其相應中間節點係該節點的子節點, 該縮減二叉樹50的左邊分支(在圖5和6中示例性地分配為“0”)與一第一個二元決策(bin)值相關聯,並且該縮減二叉樹50的右邊分支(在圖5和6中示例性地分配為“1”)與一第二個二元決策(bin)值相關聯,並且該縮減列表32的每個分割比與一個bin值序列相關聯的,其對應於與該分支相關聯的二元決策(bin)值的一個序列,該分支在該縮減二叉樹50中從該縮減二叉樹50的一主根節點52導向與相應的分割比相關聯的一樹葉54, - 使用該縮減二叉樹作為一個二值化方案將該索引二值化為一個二元決策(bin)字串,該二元決策(bin)字串對應於一個或多個二元決策(bin)(例如,由各個split_ratio _...旗標形成)的一序列,從該主樹根開始,遍歷該縮減二叉樹50到該縮減二叉樹樹葉54中的一個,其中該二元決策(bin)字串的每個二元決策(bin)對應於由一個或多個二元決策(bin)的該序列所遍歷的該縮減二叉樹50的該節點的一個; - 對該二元決策(bin)字串進行熵編碼(例如,由split_ratio _...旗標形成)。Another embodiment provides a method for encoding an index pointing to a partitioning ratio into a data stream, including: - Reducing a basic list 30 of split ratios by removing split ratios according to one or more rules, so as to obtain a reduced list 32 of split ratios, wherein the basic list 30 corresponds to the leaves 42, 37 of a binary tree 34, which are The corresponding split ratios of the base list 30 are associated, and the reduced list 32 corresponds to a reduced binary tree 50 generated from the binary tree 34, o It removes each node 40, 38 in the binary tree 34 whose child nodes have been removed, via from the leaves 42, 37 to the main root node 44, and o instead of each node of the binary tree 34 having only one unremoved child node, append the unremoved child node directly to the node of the binary tree 34 whose corresponding intermediate node is a child node of the node, The left branch of the reduced binary tree 50 (exemplarily assigned "0" in FIGS. 5 and 6 ) is associated with a first binary decision (bin) value, and the right branch of the reduced binary tree 50 (exemplarily assigned in FIG. 5 and 6) is associated with a second binary decision (bin) value, and each split ratio of the reduction list 32 is associated with a sequence of bin values corresponding to a sequence of binary decision (bin) values associated with the branch leading from a primary root node 52 of the reduced binary tree 50 to a leaf 54 associated with a corresponding split ratio in the reduced binary tree 50, - Use the reduced binary tree as a binarization scheme to binarize the index into a binary decision (bin) string corresponding to one or more binary decisions (bin) ( For example, a sequence formed by each split_ratio_... flag, starting from the main tree root, traversing the reduced binary tree 50 to one of the reduced binary tree leaves 54, where the binary decision (bin) string Each binary decision (bin) corresponds to one of the nodes of the reduced binary tree 50 traversed by the sequence of one or more binary decisions (bins); - Entropy encoding of the binary decision (bin) string (for example, formed by the split_ratio_... flag).
根據一個實施例,該方法可以使用一計算機或CPU來執行。因此,一實施例提供了相應的計算機程式。According to one embodiment, the method may be performed using a computer or CPU. Therefore, an embodiment provides a corresponding computer program.
本發明的有利方面是附屬請求項的主題。以下參考附圖來描述較佳實施例,而非限制的方式顯示,其中相同的參考標號表示相似的元件。Advantageous aspects of the invention are the subject of the dependent claims. Preferred embodiments are described below, without limitation, with reference to the accompanying drawings, in which like reference numerals designate similar elements.
在討論本揭露的實施例之前,將討論本揭露的一些技術背景:Before discussing embodiments of the present disclosure, some technical background of the present disclosure will be discussed:
一個編碼樹單元(Coding Tree Unit、CTU)可以分成多個編碼單元(Coding Unit、CU)。一編碼單元是選擇一編碼模式(例如,幀內或幀間編碼)的該實體。將一個CTU分解為一個或多個CU由一四叉樹(Quadtree 、QT)指定並作為該位元流的一部分發送。在該CTU語法中,稱為split_cu_flag的一第一二元決策(binary decision、bin)係被發送,其發信號通知該整個CTU是否形成一單個CU(即,該CTU未被分解成多個CU)或者該CTU是否被分割為四個相等大小的正方形單位。如果該CTU被分割,則對於每個得到的單元,一另一個split_cu_flag被發送,其指示相應的單元是否被進一步分割為四個相等大小的正方形單元。該多級別分割將繼續,直到對於每個單元被發信號通知該單元未被進一步分割或達到一最小CU尺寸。如果一單元具有該最小CU大小,則split_cu_flag不被發送,但是其被推斷為該單元不被進一步分割。在ITU-T H.265|MPEG H HEVC中,在該序列參數集(SPS、Sequence Parameter Set)中用信號通知該最小允許CU大小;它的範圍可以從CTU的該大小到8x8亮度樣本(並且對於寬度和高度,總是呈現一個2的整數冪的正方形)。該描述的分割的該結果單元是該編碼單元(CU),為此一編碼模式和相關參數被選擇和發送。請注意,該分割表示一四叉樹(QT)結構。A coding tree unit (Coding Tree Unit, CTU) can be divided into multiple coding units (Coding Unit, CU). A coding unit is the entity that selects a coding mode (eg, intra or inter coding). The decomposition of a CTU into one or more CUs is specified by a Quadtree (QT) and sent as part of the bit stream. In the CTU syntax, a first binary decision (bin) called split_cu_flag is sent, which signals whether the entire CTU forms a single CU (i.e., the CTU is not split into multiple CUs ) or whether the CTU is divided into four equal-sized square units. If the CTU is split, then for each resulting unit, another split_cu_flag is sent, which indicates whether the corresponding unit is further split into four equal-sized square units. The multi-level partitioning will continue until for each unit it is signaled that the unit is not further partitioned or a minimum CU size is reached. If a unit has this minimum CU size, split_cu_flag is not sent, but it is inferred that the unit is not split further. In ITU-T H.265|MPEG H HEVC, the minimum allowed CU size is signaled in the Sequence Parameter Set (SPS); it can range from this size of the CTU to 8x8 luma samples (and For width and height, always renders a square that is an integer power of 2). The resulting unit of the described partitioning is the Coding Unit (CU), for which a coding mode and associated parameters are selected and sent. Note that this partition represents a Quadtree (QT) structure.
每個得到的CU與一編碼模式相關聯,該編碼模式在該編碼器側被選擇並作為該位元流的一部分而被發送。在ITU-T H.265|MPEG H HEVC中,該二元決策split_cu_flag指定將一個CTU分割成一個或多個CU,其使用基於上下文的自適應二元算術編碼(CABAC、Context-based Adaptive Binary Arithmetic Coding)進行編碼。一個CTU的CU以該所謂的z掃描順序處理。這意味著,一個分割所產生的該四個區塊以光柵掃描順序處理;如果任何區塊被進一步分割,則在處理較高分割級別的下一個區塊之前處理相應的四個區塊(包括所被包括的較小區塊)。Each resulting CU is associated with a coding mode that is selected at the encoder side and sent as part of the bitstream. In ITU-T H.265|MPEG H HEVC, the binary decision split_cu_flag specifies splitting a CTU into one or more CUs using Context-based Adaptive Binary Arithmetic Coding (CABAC, Context-based Adaptive Binary Arithmetic Coding). The CUs of a CTU are processed in this so-called z-scan order. This means that the four blocks resulting from one partition are processed in raster scan order; if any block is further partitioned, the corresponding four blocks (including the smaller block included).
如果一個CU以一幀內編碼模式被編碼,則一幀內預測模式用於該亮度信號,並且如果該視頻信號包括色度分量,則用於該色度信號的另一幀內預測模式被發送。在ITU-T H.265|MPEG H HEVC中,如果該CU大小等於該最小CU大小(如在該序列參數集中用信號通知),則該亮度編碼區塊也可以被分割成四個大小相等的區塊,在這種情況下,針對這些區塊中的每一個,一個個別的亮度幀內預測模式被發送。該分割由一個二元語法元素part_mode指示。該實際的幀內預測和編碼是基於變換區塊所完成的。If a CU is encoded in an intra coding mode, an intra prediction mode is used for the luma signal, and if the video signal includes a chroma component, another intra prediction mode for the chroma signal is transmitted . In ITU-T H.265|MPEG H HEVC, the luma coded block may also be split into four equally sized blocks if the CU size is equal to the minimum CU size (as signaled in the sequence parameter set). blocks, in which case an individual luma intra prediction mode is sent for each of these blocks. The split is indicated by a bigram element part_mode. The actual intra prediction and coding is done based on transform blocks.
出於變換編碼的目的,一個CU可以被分割為多個變換區塊。類似於將一個CTU分割成CU,到變換區塊的該細分使用一四叉樹語法而被傳輸。該四叉樹的該根由該編碼單元形成。該編碼單元的該語法包括一個稱為split_transform_flag的二元決策,其指定該編碼單元CU的該亮度分量是否由單個亮度變換區塊組成或者其是否被分割成四個大小相等的方塊。在後一種情況下,對於每個該得到的亮度區塊,另一個split_transform_flag被發送,以指定是否進一步分割相應的區塊。繼續該四叉樹分割,直到對於每個得到的亮度區塊,其被發信號通知該區塊未被進一步分割或者該區塊達到一最小變換區塊大小(在該序列參數集中指示)。對於編碼四個亮度幀內預測模式的幀內編碼的編碼單元CU,該第一split_transform_flag(在CU級別)不被發送,但是其被推斷該亮度編碼區塊被分割成四個亮度區塊。該色度區塊的該分割基本上遵循該共同定位的亮度區塊的該分割,即,對於每個亮度區塊,該相關聯的色度區塊覆蓋該相同的圖片區域。該亮度區塊和覆蓋該相同圖片區域的該相關色度區塊形成一變換單元。然而,在ITU-T H.265|MPEG H HEVC標準中有一個例外:如果得到的色度區塊小於該最小變換塊大小(如該序列參數集中所指定的),則僅該亮度區塊被分割。在ITU-T H.265|MPEG H HEVC中,該二進制語法元素split_transform_flag使用CABAC而被編碼。一變換區塊(TB)是應用一單個二維(2d)變換以對該預測殘差信號進行編碼的該實體。注意ITU-T H.265|MPEG H HEVC中的所有變換區塊是正方形區塊,該區塊的該寬度和該高度係以2的整數冪來表示。For transform coding purposes, a CU can be partitioned into multiple transform blocks. Similar to partitioning a CTU into CUs, the subdivision into transform blocks is transmitted using a quadtree syntax. The root of the quadtree is formed by the coding unit. The syntax of the coding unit includes a binary decision called split_transform_flag, which specifies whether the luma component of the coding unit CU consists of a single luma transform block or whether it is split into four equal-sized blocks. In the latter case, for each resulting luma block, another split_transform_flag is sent to specify whether to further split the corresponding block. The quadtree partitioning continues until for each resulting luma block it is signaled that the block is not further partitioned or that the block reaches a minimum transform block size (indicated in the sequence parameter set). For an intra-coded coding unit CU encoding four luma intra prediction modes, the first split_transform_flag (at the CU level) is not sent, but it is inferred that the luma coded block is split into four luma blocks. The segmentation of the chroma blocks substantially follows the segmentation of the co-located luma blocks, ie, for each luma block, the associated chroma block covers the same picture area. The luma block and the associated chroma block covering the same picture area form a transformation unit. However, there is an exception in the ITU-T H.265 | MPEG H HEVC standard: if the resulting chroma block is smaller than the minimum transform block size (as specified in the sequence parameter set), only the luma block is segmentation. In ITU-T H.265|MPEG H HEVC, the binary syntax element split_transform_flag is encoded using CABAC. A transform block (TB) is the entity that applies a single two-dimensional (2d) transform to encode the prediction residual signal. Note that all transform blocks in ITU-T H.265|MPEG H HEVC are square blocks, and the width and height of the block are expressed as integer powers of 2.
以z掃描順序處理一幀內編碼的編碼單元CU的該變換單元(Transform Unit、TU)(參見上文)。對於每個變換區塊(亮度或色度),首先使用相同顏色分量的已重建的相鄰樣本來生成一預測信號。用於生成預測信號的該演算法由該幀內預測模式所決定。使用變換編碼發送該所得到的預測誤差/殘差信號。一個二維變換將被應用於該相應的殘差樣本區塊,對該所得到的變換係數進行量化(通常使用均勻重建量化器),並且對該所得到的量化索引(也稱為變換係數級別)進行熵編碼。在ITU-T H.265|MPEG H HEVC中的該熵編碼係使用基於上下文的自適應二進制算術編碼(CABAC、Context-based Adaptive Binary Arithmetic Coding)的該概念。The Transform Unit (TU) of an intra-coded coding unit CU is processed in z-scan order (see above). For each transform block (luma or chroma), a prediction signal is first generated using reconstructed adjacent samples of the same color component. The algorithm used to generate the prediction signal is determined by the intra prediction mode. The resulting prediction error/residual signal is sent using transform coding. A 2D transform is applied to the corresponding block of residual samples, the resulting transform coefficients are quantized (usually using a uniform reconstruction quantizer), and the resulting quantization index (also called transform coefficient level ) performs entropy encoding. The entropy coding system in ITU-T H.265 | MPEG H HEVC uses the concept of Context-based Adaptive Binary Arithmetic Coding (CABAC, Context-based Adaptive Binary Arithmetic Coding).
幀間編碼的編碼單元CU可以被分割成多個預測單元(PU、Prediction Units)。一預測單元PU是一亮度的該實體,並且對於彩色視頻,是兩個相關聯的色度區塊(覆蓋該相同的圖片區域),其中使用一單組預測參數。一編碼單元CU可以被編碼為一單個預測單元PU,或者它可以被分割成兩個非正方形或四個正方形的預測單元PU。僅當該編碼單元CU具有在該序列參數集中被指定的該最小編碼單元CU大小時,才支持後者(四個正方形預測單元PU)。該所選擇的分割由該語法元素part_mode所指示。在ITU-T H.265|MPEG H HEVC支持總共8種模式,用於將一編碼單元CU分割為預測單元PU。一個NxN編碼單元CU可以分割為: • 一單個NxN預測單元PU; • 兩個(N/2)xN預測單元PU; • 兩個Nx(N/2)預測單元PU; • 一單個(3N/4)xN預測單元PU(左)和一單個(N/4)xN預測單元PU(右); • 一單個(N/4)xN預測單元PU(左)和一單個(3N/4)xN預測單元PU(右); • 一單個Nx(3N/4)預測單元PU(上)和一單個Nx(N/4)預測單元PU(下); • 一單個Nx(N/4)預測單元PU(上)和一單個Nx(3N/4)預測單元PU(下); • 四個(N/2)x(N/2)預測單元PU。The inter-coded coding unit CU can be divided into multiple prediction units (PU, Prediction Units). A prediction unit PU is the entity of a luma, and for color video, two associated chroma blocks (covering the same picture area) where a single set of prediction parameters is used. A coding unit CU may be coded as a single prediction unit PU, or it may be split into two non-square or four square prediction units PU. The latter (four square prediction units PU) is supported only if the coding unit CU has the minimum coding unit CU size specified in the sequence parameter set. The selected partition is indicated by the syntax element part_mode. In ITU-T H.265|MPEG H HEVC supports a total of 8 modes for dividing a coding unit CU into prediction units PU. An NxN coding unit CU can be divided into: • A single NxN prediction unit PU; • Two (N/2)xN prediction units PU; • Two Nx(N/2) prediction units PU; • A single (3N/4)xN prediction unit PU (left) and a single (N/4)xN prediction unit PU (right); • A single (N/4)xN prediction unit PU (left) and a single (3N/4)xN prediction unit PU (right); • A single Nx(3N/4) prediction unit PU (top) and a single Nx(N/4) prediction unit PU (bottom); • A single Nx(N/4) prediction unit PU (top) and a single Nx(3N/4) prediction unit PU (bottom); • Four (N/2)x(N/2) prediction units PU.
該不對稱分割僅支持大於或等於16x16亮度樣本的編碼單元CU。在ITU-T H.265|MPEG H HEVC中支持的該最小預測單元PU尺寸是8x4和4x8。This asymmetric partitioning only supports coding units CU greater than or equal to 16x16 luma samples. The minimum prediction unit PU sizes supported in ITU-T H.265|MPEG H HEVC are 8x4 and 4x8.
對於每個預測單元PU,一組單獨的運動參數被發送。每組運動參數包括運動假設的該數量(在ITU-T H.265|MPEG H HEVC中的一個或兩個),並且對於每個運動假設,包括該參考圖片(經由一參考圖片索引以指示到參考圖片的一列表中)和該相關的運動向量。首先,一個merge_flag被發送,其指示該運動參數是否基於已編碼的運動參數而被完全導出、或者該運動參數是否被發送。如果該merge_flag等於1,則運動參數集合候選的一列表被導出,其通常包括已經編碼的空間相鄰區塊的運動參數集合、以及從時間上共同定位的區塊所導出的一個或多個運動參數集合。該所使用的運動參數集合係由語法元素merge_idx所指示,其指定運動參數集合的該候選列表的一索引。如果merge_flag等於0,則將該運動參數作為該位元流的一部分發送。第一語法元素(ITU-T H.265|MPEG H HEVC中的inter_pred_idc)指定運動假設的該數量。在ITU-T H.265|MPEG H HEVC中,支持一個或兩個運動假設。對於每個運動假設,該所使用的參考圖片係經由一參考圖片索引所指示,該參考圖片索引係表示一索引至一參考圖片列表。在ITU-T H.265|MPEG H HEVC中,P型切片有一個參考圖片列表,B型切片有兩個參考圖片列表,其被稱為列表0(list 0)和列表1(list 1)。對於每個切片,該參考圖片列表係基於切片標頭語法元素而被構造。每個參考圖片列表以一指定順序包含一個或多個已編碼圖片(其存儲在解碼圖片緩衝器中)。在B型切片中,該語法元素inter_pred_idc不僅指示單一假設預測或雙向預測,而且對於單一假設預測,其另外指示列表0還是列表1被使用。對於雙向預測,該第一運動假設係參考列表0,該第二運動假設係參考列表1。對於每個運動假設,除了該參考圖片索引之外,一相關聯的運動向量作為位元流的一部分被發送。該運動向量是差分編碼的。給定該已編碼的參考圖片索引,運動向量預測候選者的一列表被導出。它可以包括(可能縮放的)相鄰預測單元PU的運動向量、以及時間上在前(依據在編碼順序方面)、空間上共同定位的區塊的縮放運動向量。該實際選擇的運動向量預測器經由一索引而用信號通知該運動向量預測器列表。最後,該預測單元PU的該實際運動向量與該所選擇的運動向量預測值之間的該差異被發送。在單個假設預測中,一個預測單元PU的該預測信號由該所選擇的重建參考圖片中的一移位區塊所形成,其中相對於當前預測單元PU的該位移係由該運動向量指定。注意,該位移通常以子樣本精度而被指定(在ITU-T H.265|MPEG H HEVC中,該運動向量具有一個四分之一亮度樣本的一精度)。對於非整數運動向量,該預測信號係經由內插重建的參考圖片(通常使用可分離的有限脈衝響應濾波器FIR)而被生成。具有多假設預測的預測單元PU的該最終預測信號,係由用於該個別運動假設的該預測信號的加權和所形成。注意,一預測單元PU的亮度和色度區塊共享相同的運動參數集。For each prediction unit PU, a separate set of motion parameters is sent. Each set of motion parameters includes the number of motion hypotheses (one or two in ITU-T H.265 | MPEG H HEVC), and for each motion hypothesis, the reference picture (indicated via a reference picture index to (a list of reference pictures) and the associated motion vectors. First, a merge_flag is sent, which indicates whether the motion parameters are fully derived based on the encoded motion parameters, or whether the motion parameters are sent. If the merge_flag is equal to 1, a list of motion parameter set candidates is derived, which typically includes motion parameter sets for spatially adjacent blocks that have been encoded, and one or more motions derived from temporally co-located blocks. Parameter collection. The used motion parameter set is indicated by the syntax element merge_idx, which specifies an index into the candidate list of motion parameter sets. If merge_flag is equal to 0, the motion parameters are sent as part of the bit stream. The first syntax element (inter_pred_idc in ITU-T H.265|MPEG H HEVC) specifies this number of motion hypotheses. In ITU-T H.265|MPEG H HEVC, one or two motion assumptions are supported. For each motion hypothesis, the reference picture used is indicated via a reference picture index, which represents an index into a reference picture list. In ITU-T H.265|MPEG H HEVC, type P slices have one reference picture list, and type B slices have two reference picture lists, which are called list 0 (list 0) and list 1 (list 1). For each slice, the reference picture list is constructed based on the slice header syntax elements. Each reference picture list contains one or more coded pictures (which are stored in the decoded picture buffer) in a specified order. In type B slices, this syntax element inter_pred_idc not only indicates single hypothesis prediction or bidirectional prediction, but for single hypothesis prediction it additionally indicates whether list 0 or list 1 is used. For bidirectional prediction, the first motion hypothesis is referenced to list 0 and the second motion hypothesis is referenced to list 1. For each motion hypothesis, in addition to the reference picture index, an associated motion vector is sent as part of the bit stream. The motion vector is differentially encoded. Given the encoded reference picture index, a list of motion vector prediction candidates is derived. It may include motion vectors of (possibly scaled) neighboring prediction units PU, as well as scaled motion vectors of temporally preceding (in terms of coding order), spatially co-located blocks. The actual selected motion vector predictor is signaled to the motion vector predictor list via an index. Finally, the difference between the actual motion vector and the selected motion vector predictor of the prediction unit PU is sent. In a single hypothesis prediction, the prediction signal of a prediction unit PU is formed from a shifted block in the selected reconstructed reference picture, where the displacement relative to the current prediction unit PU is specified by the motion vector. Note that the displacement is usually specified in subsample precision (in ITU-T H.265 | MPEG H HEVC, the motion vector has a precision of one quarter luminance sample). For non-integer motion vectors, the prediction signal is generated via interpolation of the reconstructed reference picture (usually using a separable finite impulse response filter FIR). The final prediction signal of a prediction unit PU with multi-hypothesis prediction is formed from the weighted sum of the prediction signals for the individual motion hypotheses. Note that the luma and chroma blocks of a prediction unit PU share the same set of motion parameters.
用於一圖片間編碼的編碼單元CU的該預測信號係由其包含的預測單元PU的該預測信號所組成。用於一編碼單元的亮度和色度區塊的該預測誤差信號(也稱為殘差信號)藉由變換編碼而被發送。為此目的,一編碼單元CU的亮度殘差樣本的該區塊以及色度殘差樣本的該區塊(如果存在)被分割為變換區塊。分割成變換區塊與上述的圖片內編碼的編碼單元CU相同。經由一四叉樹語法指示一編碼單元CU劃分為變換區塊的該分割,其也稱為殘餘四叉樹(RQT、Residual Quadtree)。使用變換編碼對該得到的變換區塊進行編碼:將一個二維(2d)變換應用於該殘差樣本區塊,對該得到的變換係數進行量化,並且對該得到的變換係數級別(量化索引)進行熵編碼。在P型切片和B型切片中,在該編碼單元CU語法的該開始處,一個skip_flag被發送。如果該旗標等於1,則表示該對應的編碼單元CU由以合併模式編碼的一單個預測單元組成(即,推斷merge_flag等於1)並且所有變換係數等於零(即,該重建信號等於該預測信號)。在這種情況下,除了該skip_flag之外,僅該merge_idx被發送。如果skip_flag等於0,則用信號通知該預測模式(幀間或幀內),接著是上述的語法特徵。The prediction signal for an inter-picture coding coding unit CU is composed of the prediction signal of the prediction unit PU contained therein. The prediction error signal (also called the residual signal) for the luma and chroma blocks of a coding unit is sent by transform coding. For this purpose, the block of luma residual samples and, if present, the block of chroma residual samples of a coding unit CU are partitioned into transform blocks. The partitioning into transform blocks is the same as the above-mentioned coding unit CU for intra-picture coding. The partitioning of a coding unit CU into transform blocks is indicated via a quadtree syntax, which is also called a residual quadtree (RQT, Residual Quadtree). The resulting transform block is encoded using transform coding: a two-dimensional (2d) transform is applied to the residual sample block, the resulting transform coefficients are quantized, and the resulting transform coefficient level (quantization index ) performs entropy encoding. In P-type slices and B-type slices, at the beginning of the coding unit CU syntax, a skip_flag is sent. If the flag is equal to 1, it means that the corresponding coding unit CU consists of a single prediction unit encoded in merge mode (ie, it is inferred that merge_flag is equal to 1) and all transform coefficients are equal to zero (ie, the reconstructed signal is equal to the prediction signal) . In this case, only the merge_idx is sent in addition to the skip_flag. If skip_flag is equal to 0, then the prediction mode (inter or intra) is signaled, followed by the syntax features described above.
在ITU-T H.265|MPEG H HEVC中,所有低級別語法元素係使用基於上下文的自適應二進制算術編碼(CABAC)進行編碼。非二進制語法元素首先被二進制化,即,它們被映射到一系列二元決策,其也被稱為二元決策(bin)。然後,使用二進制算術編碼器對每個二元決策(bin)(包括二進制語法元素)進行編碼。該算術編碼引擎有兩種模式。在一種模式中,即所謂的旁路模式(bypass mode),使用具有的一非自適應二進制機率模型對該二元決策(bin)進行編碼。在另一種模式中,即該所謂的常規模式,針對每個二元決策(bin)選擇一個自適應二進制機率模型;在對相應的二元決策(bin)進行編碼之後,使用該二元決策(bin)的該實際值來更新該二進制機率模型。該熵編碼器維持一定數量的二進制機率模型。該所選擇的機率模型取決於該語法元素和該二元決策(bin)的數量(對於非二進制語法元素)。它還可以取決於已經編碼的語法元素或二元決策(bin)。二元機率模型的該選擇也稱為上下文建模。In ITU-T H.265|MPEG H HEVC, all low-level syntax elements are encoded using Context-Based Adaptive Binary Arithmetic Coding (CABAC). Non-binary syntax elements are first binarized, i.e. they are mapped to a series of binary decisions, also known as binary decisions (bins). Then, each binary decision (bin) (including binary syntax elements) is encoded using a binary arithmetic encoder. The arithmetic coding engine has two modes. In one mode, the so-called bypass mode, use a A non-adaptive binary probabilistic model encodes this binary decision (bin). In the other mode, the so-called regular mode, an adaptive binary probabilistic model is selected for each binary decision (bin); after encoding the corresponding binary decision (bin), the binary decision (bin) is used bin) to update the binary probability model. This entropy encoder maintains a certain number of binary probability models. The chosen probabilistic model depends on the syntax element and the number of bins (for non-binary syntax elements). It can also depend on already encoded syntax elements or binary decisions (bins). This choice of binary probabilistic models is also called contextual modeling.
ITU-T H.265|MPEG H HEVC的該語法為編碼一樣本區塊(例如一編碼樹單元)提供了多種可能性。該編碼器必須選擇該分割(分割為CU、PU和TU)、該編碼模式和相關參數(諸如幀內預測模式和運動參數)、以及變換係數級別(量化索引)。該所選擇的編碼參數決定該重建品質以及在該位元流內的表示該編碼參數所需的該位元數量。現代編碼演算法通常基於拉格朗日(Lagrangian)位元分配。The syntax of ITU-T H.265|MPEG H HEVC provides multiple possibilities for encoding a sample block (eg a coding tree unit). The encoder must select the partition (partitioned into CUs, PUs and TUs), the coding mode and related parameters (such as intra prediction mode and motion parameters), and transform coefficient levels (quantization index). The selected coding parameters determine the reconstruction quality and the number of bits required to represent the coding parameters within the bitstream. Modern coding algorithms are usually based on Lagrangian bit allocation.
雖然該所採用的編碼演算法決定該生成的位元流的該速率-失真效率,但一編解碼器的該最大可實現編碼效率由該支持的語法特徵所決定,例如該編碼模式集合、該分割選項、該支持的幀內預測模式等等。Although the encoding algorithm used determines the rate-distortion efficiency of the generated bitstream, the maximum achievable encoding efficiency of a codec is determined by the supported syntax features, such as the encoding mode set, the Segmentation options, supported intra prediction modes, and more.
該最重要的語法功能之一是該支持的分割選項。一方面,一靈活分割允許將用於預測和變換編碼的該區塊大小適配到該視頻信號。但另一方面,該分割作為該位元流的一部分必須被傳輸。因此,用於提供附加分割選項的預測和變換編碼的該增益必須超過該額外的信令開銷。由於這個原因,最先進的視頻編碼標準僅支持非常簡單的分割概念,例如四叉樹分割。One of the most important syntax features is the splitting options that are supported. On the one hand, a flexible partitioning allows adapting the block size used for prediction and transform coding to the video signal. But on the other hand, the segmentation must be transmitted as part of the bitstream. Therefore, the gain of prediction and transform coding to provide additional partitioning options must outweigh the additional signaling overhead. For this reason, state-of-the-art video coding standards only support very simple segmentation concepts, such as quadtree segmentation.
在本揭露中,基於廣義二叉樹的一分割概念被描述。它提供了比傳統分割概念(例如該四叉樹方法)更靈活的方法,用於使用於預測和變換編碼的該區塊係適應於要被編碼的該視頻信號。並且由於用於發送該所選分割的該語法仍然非常簡單,因此預測和變換編碼中的該增益通常超過該額外的信令開銷。因此,該通用分割概念能夠提高一視頻編解碼器的該可實現編碼效率。In this disclosure, a partitioning concept based on generalized binary trees is described. It provides a more flexible method than traditional partitioning concepts (such as the quadtree method) for adapting the blocks used for prediction and transform coding to the video signal to be encoded. And since the syntax for sending the selected partition is still very simple, the gain in prediction and transform coding usually outweighs the additional signaling overhead. Therefore, the universal partitioning concept can improve the achievable coding efficiency of a video codec.
該所描述的分割概念可以被用於分割關於編碼模式信令、圖片內預測、圖片間預測、變換編碼或其任何組合的一區塊。它可以完全取代傳統的分割概念,也可以與其他分割概念結合使用,例如一四叉樹分割。The described partitioning concept can be used to partition a block with respect to coding mode signaling, intra-picture prediction, inter-picture prediction, transform coding or any combination thereof. It can completely replace the traditional partitioning concept, or can be used in combination with other partitioning concepts, such as a quadtree partitioning.
本揭露中呈現的該廣義二進制分割代表所有提到的分割方法QT(四叉樹)、QTBT(四叉樹/二叉樹)、具有附加三重分割的QTBT、以及具有額外的不對稱分割成大小為1/4和3/4的子區塊的QTBT的一超集合。它的特點是語法簡單,能夠更好地適配該區塊大小到對象和運動邊界,從而提高一編碼效率。This generalized binary partitioning presented in this disclosure represents all mentioned partitioning methods QT (quadtree), QTBT (quadtree/binary tree), QTBT with additional triple partitioning, and with additional asymmetric partitioning into size 1 A superset of QTBTs for subblocks /4 and 3/4. It features a simple syntax and can better adapt the block size to object and motion boundaries, thereby improving coding efficiency.
可與本揭露結合使用的實體,特別是對於該編碼(編碼和解碼)將參考圖16至20進行討論。下面,保持作為本揭露所有觀點的焦點的該分割/二進制分割將被討論。Entities that may be used in conjunction with the present disclosure, particularly for the encoding (encoding and decoding), will be discussed with reference to Figures 16-20. Below, this segmentation/binary segmentation that remains the focus of all aspects of this disclosure will be discussed.
廣義二元分割Generalized binary segmentation
下面描述使用廣義二叉樹的視頻編碼方法。一種使用廣義二進制分割的一視頻編碼方法被提出。該所呈現的廣義二進制分割可以應用於視頻編碼中所需的所有區塊分割。特別地,它可以應用於將區塊分割為編碼單元CU(用於發信號通知該編碼模式)、預測單元PU(用於發信號通知諸如運動參數的預測參數)、或變換單元TU(用於該殘差信號的變換編碼)。在本揭露的一較佳實施例中,該編碼模式的該信令、預測參數的該信令和該變換編碼被應用於該相同的區塊(即,這樣的一區塊表示一CU、PU和TU),以及該廣義二進制分割用於指定一固定大小的區塊的對應分割為編碼單元(也代表PU和TU)。然而,也可以使用該廣義二進制分割來指定該分割成編碼單元CU,而該得到的編碼單元CU可以進一步分割成預測單元PU和/或變換單元TU(使用該廣義二進制分割或任何其他分割概念)。A video encoding method using a generalized binary tree is described below. A video coding method using generalized binary partitioning is proposed. The presented generalized binary partitioning can be applied to all block partitioning required in video coding. In particular, it can be applied to partition blocks into coding units CU (used for signaling the coding mode), prediction units PU (used for signaling prediction parameters such as motion parameters), or transform units TU (used for signaling the coding mode). transform coding of the residual signal). In a preferred embodiment of the present disclosure, the signaling of the coding mode, the signaling of prediction parameters and the transform coding are applied to the same block (ie, such a block represents a CU, PU and TU), and the generalized binary partitioning is used to specify the corresponding partitioning of a fixed-size block into coding units (also stands for PU and TU). However, the partitioning into coding units CU can also be specified using the generalized binary partitioning, and the resulting coding units CU can be further partitioned into prediction units PU and/or transform units TU (using the generalized binary partitioning or any other partitioning concept) .
在另一觀點,該廣義二進制分割可以分別應用於顏色分量和輔助分量,例如α通道或深度遮罩。或者,可以將通用二進制分割應用於那些分量的群組。例如,結合在諸如YUV420或YUV422的常見幀格式中所使用的次採樣色度分量,可以使用兩個不同的分割樹:一個用於分割該亮度分量,另一個用於分割該色度分量。在另一範例中,將不同的分割(不同於亮度和色度分量的分割)應用於輔助分量(諸如α混合資料或深度圖)可能是有用的。In another point of view, the generalized binary segmentation can be applied separately to color components and auxiliary components, such as alpha channels or depth masks. Alternatively, a universal binary partitioning can be applied to groups of those components. For example, in conjunction with subsampled chroma components used in common frame formats such as YUV420 or YUV422, two different splitting trees can be used: one for splitting the luma component and another for splitting the chroma component. In another example, it may be useful to apply a different split (different from that of the luma and chrominance components) to the auxiliary components (such as alpha blends or depth maps).
此外,該廣義二進制分割可以與任何其他分割組合。例如,可以在一第一級別上使用該四叉樹分割(或任何其他分割概念),並且該所得到的區塊可以使用該廣義二進制分割來進一步分割。或者,經由該廣義二進制分割獲得的區塊可以使用任何其他分割概念進一步分割。Furthermore, this generalized binary partition can be combined with any other partition. For example, the quadtree partitioning (or any other partitioning concept) can be used at a first level, and the resulting blocks can be further partitioned using the generalized binary partitioning. Alternatively, the blocks obtained via this generalized binary partitioning can be further partitioned using any other partitioning concept.
在不失一般性的情況下,對於以下描述,我們假設使用廣義二進制分割的該概念來分割固定大小的區塊(諸如CTU)。該分割結構可以被表示為一個二進制分割樹(以下也稱為「分割樹」)。每個節點表示具有一分割方向(水平或垂直)和一分割比(這是該第一個產生的區塊的該寬度(或高度)與該原始區塊的該寬度(或高度)的該比率)的一個二進制分割。Without loss of generality, for the following description we assume that fixed-size blocks (such as CTUs) are partitioned using this concept of generalized binary partitioning. The partitioning structure can be represented as a binary partitioning tree (hereinafter also referred to as "partitioning tree"). Each node represents a split direction (horizontal or vertical) and a split ratio (which is the ratio of the width (or height) of the first generated block to the width (or height) of the original block). ) is a binary split.
在本揭露的一個較佳實施例中(比較A1),相對於該先前的分割方向(即,該下一個較高(先前)級別上的該相應分割)對該分割方向進行編碼(比較A6)。這意味著一分割被編碼為「平行」或「垂直」分割,它總是轉換為一個「垂直」(分割寬度)或「一個水平」分割(分割高度)。如果我們假設當前區塊是藉由一水平分割(在最後(前一個)分割級別)獲得的,那麼,如果發信號通知一個「並行分割」,則該當前區塊再次水平分割成兩個子區塊,並且如果發出一個「垂直分割」信號,將該當前區塊垂直分割成兩個子區塊(比較A7)。如果該最後一級別分割是一垂直分割,則該「平行分割」指定一垂直分割,該「垂直分割」指定一水平分割。由於在該最高級別(即,對於根級區塊)沒有發信號通知先前的分割,因此必須藉由約定來定義該最後的分割級別是否被推斷為表示一水平分割或一垂直分割。In a preferred embodiment of the present disclosure (compare A1), the segmentation direction is encoded relative to the previous segmentation direction (ie, the corresponding segmentation at the next higher (previous) level) (compare A6) . This means that a split encoded as a "parallel" or "vertical" split is always converted to a "vertical" (split width) or a "horizontal" split (split height). If we assume that the current block was obtained by a horizontal split (at the last (previous) split level), then if a "parallel split" is signaled, the current block is split horizontally into two sub-regions again block, and if a "vertical split" signal is sent, vertically split the current block into two sub-blocks (compare A7). If the last level split is a vertical split, then the "parallel split" specifies a vertical split and the "vertical split" specifies a horizontal split. Since no previous partitioning is signaled at the highest level (i.e., for root-level blocks), whether the last partitioning level is inferred to represent a horizontal partitioning or a vertical partitioning must be defined by convention.
除了該分割方向之外,一個二元分割的特徵在於該分割比(比較A8)。該分割比指定該第一個得到的子區塊(從頂部/左側)的該大小(樣本數)和該被分割的區塊的該比率。注意,由於一區塊總是被分割成兩個子區塊,因此該分割比還指定該區塊寬度的比率(對於垂直分割)或該區塊高度的比率(對於水平區塊)。該分割樹的該樹葉節點表示正被編碼的該實際單元(由一亮度樣本區塊以及,對於非單色視頻,由共同定位的色度樣本區塊組成)。這些單元在下面將被稱為編碼單元,其特徵在於它們的位置和大小,這可以從該分割樹推斷出來。可以在該分割結構的該樹葉級別應用編碼(比較A2)、預測(比較A3)和變換編碼(比較A4)。還可以將該廣義二進制分割應用於一單個顏色分量或顏色分量的一子集合(例如,兩個色度分量)。分割比為1/2的一垂直分割是可以在大多數配置中使用該最小位數(或二元決策(bin))發信號的該分割,並且在下文中將稱為「默認分割」。In addition to the segmentation direction, a binary segmentation is characterized by the segmentation ratio (compare A8). The split ratio specifies the size (number of samples) of the first resulting sub-block (from top/left) and the ratio of the partitioned blocks. Note that since a block is always split into two sub-blocks, the split ratio also specifies the ratio of the block's width (for vertical splits) or the ratio of the block's height (for horizontal blocks). The leaf node of the segmentation tree represents the actual unit being encoded (consisting of a block of luma samples and, for non-monochrome video, of co-located blocks of chroma samples). These units, which will be referred to as coding units below, are characterized by their position and size, which can be inferred from this segmentation tree. Coding (compare A2), prediction (compare A3) and transform coding (compare A4) can be applied at the leaf level of the partitioning structure. The generalized binary partitioning can also be applied to a single color component or a subset of color components (eg, two chrominance components). A vertical split with a split ratio of 1/2 is the split that can be signaled using the minimum number of bits (or bins) in most configurations, and will be referred to as the "default split" below.
在本揭露的一特定實施例中,從該分割樹的該根區塊(可以是CTU)開始,如下用信號通知該分割。在不失一般性的情況下,我們定義該根區塊的該最後一個分割(不是由實際分割產生)被認為是垂直分割。但請注意,它也可以定義為水平分割。首先一個二元決策perpend_split_flag被編碼,其指示一個垂直分割是否被應用。如果perpend_split_flag等於1並且最後一次分割(即,產生當前區塊的該分割)是水平分割,則將一個垂直分割應用於該當前區塊。果perpend_split_flag等於1並且最後一個分割是垂直分割(使用我們上面定義的約定,這包括我們當前區塊是該根區塊的情況),這表示應用了一個水平分割。In a specific embodiment of the present disclosure, starting from the root block of the partition tree (which may be a CTU), the partition is signaled as follows. Without loss of generality, we define that the last split of the root block (not resulting from an actual split) is considered a vertical split. But note that it can also be defined as a horizontal split. First a binary decision perpend_split_flag is encoded, which indicates whether a vertical split is applied. If perpend_split_flag is equal to 1 and the last split (i.e., the split that produced the current chunk) was a horizontal split, then a vertical split is applied to the current chunk. If perpend_split_flag is equal to 1 and the last split was a vertical split (using the convention we defined above, this includes the case where our current block is the root block), this means that a horizontal split was applied.
如果perpend_split_flag等於0,另一個二元決策parallel_split_flag則被發送。如果parallel_split_flag等於1且該最後一個分割是水平分割,該當前區塊則再次水平分割。如果parallel_split_flag等於1並且該最後一個分割是一個垂直分割(或者藉由我們的約定推斷為垂直分割),則垂直分割該當前區塊。如果parallel_split_flag等於0,則該當前區塊不被進一步分割,即它未被分割,而是表示一個樹葉區塊(相當於「無分割」信令)並且變為一個編碼區塊。如果高級別語法限制(例如,對該最小區塊寬度或區塊高度的限制或對該最大分割級別的限制)阻止一個水平或垂直分割,則不發送該相應的二元決策,但可以在該解碼器側推斷。例如,如果該最後分割是一個垂直分割並且該當前區塊的該寬度等於該最小支持的區塊寬度,則不傳輸該二元決策parallel_split_flag(其指示該當前區塊是否再次垂直分割),而是推斷為等於0。If perpend_split_flag is equal to 0, another binary decision parallel_split_flag is sent. If parallel_split_flag is equal to 1 and the last split was a horizontal split, the current block is split horizontally again. If parallel_split_flag is equal to 1 and the last split was a vertical split (or was inferred to be a vertical split by our convention), then split the current block vertically. If parallel_split_flag is equal to 0, then the current block is not further split, that is, it is not split, but represents a leaf block (equivalent to "no split" signaling) and becomes a coded block. If a high-level syntax restriction (e.g., a limit on the minimum block width or block height or a limit on the maximum split level) prevents a horizontal or vertical split, the corresponding binary decision is not sent, but the Decoder side inference. For example, if the last split was a vertical split and the width of the current block is equal to the minimum supported block width, then the binary decision parallel_split_flag (which indicates whether the current block is vertically split again) is not transmitted, but Inferred to be equal to 0.
如果由高級別參數指示,則可以推斷出二元決策perpend_split_flag和parallel_split_flag中的任一個或兩者,其可以在PPS(圖片參數集)、SPS(序列參數集)或切片標頭(比較A19和A20)中用信號通知。用於發信號通知該分割方向的一個二元決策樹如圖4所示。如果要應用一個水平分割,則該分割尺寸M被定義為該要分割的區塊的該垂直邊緣的該長度(因為該分割將引入一個新的水平邊緣)。對於一個垂直分割,該分割尺寸M是該要分割的區塊的該水平邊緣的該長度。If indicated by a high-level parameter, a binary decision can be inferred either or both perpend_split_flag and parallel_split_flag, which can be specified in the PPS (Picture Parameter Set), SPS (Sequence Parameter Set) or slice header (compare A19 and A20 ) is used for signal notification. A binary decision tree used to signal the splitting direction is shown in Figure 4. If a horizontal split is to be applied, the split size M is defined as the length of the vertical edge of the block to be split (because the split will introduce a new horizontal edge). For a vertical split, the split size M is the length of the horizontal edge of the block to be split.
在本揭露的一特定實施例中,僅編碼該perpend_split_flag。因此,該分割樣型由交替的水平和垂直分割組成。給定一個特定的區塊,該區塊不是不進一步分割,就是使用垂直於該先前分割方向(在較高級別)的一分割方向進行分割。可以對該根區塊進一個行例外處理(不存在先前的分割);對於該根區塊,可以明確地指示是應用一個水平分割還是一個垂直分割(或者該區塊是否完全不分割)(比較A12 + A5)。In a specific embodiment of the present disclosure, only the perpend_split_flag is encoded. Therefore, this split pattern consists of alternating horizontal and vertical splits. Given a particular block, the block is either not split further, or is split using a split direction perpendicular to the previous split direction (at a higher level). An exception can be made for this root block (no previous split exists); for this root block it can be explicitly indicated whether a horizontal or a vertical split is applied (or whether the block is not split at all) (cf. A12 + A5).
在本揭露的另一個實施例中,使用二元決策hor_split_flag(指示該區塊是否被水平分割)和ver_split_flag(指示該區塊是否被垂直分割)來編碼該分割方向。這些旗標可以按任何順序編碼;僅當該第一旗標指示在該相應方向上沒有分割時才發送該第二旗標。在本揭露的一另一實施例中,使用一個split_flag和一個split_direction_flag對該分割和該分割方向進行編碼,其中該split_flag指示該當前區塊是否被分割,該split_direction_flag指示該分割是否被應用在水平或垂直方向上。在一個變型中,該split_direction_flag指示該分割是否被應用在與該最後一次分割垂直的方向上或在與該最後一次分割相同的方向上。In another embodiment of the present disclosure, the split direction is encoded using binary decisions hor_split_flag (indicating whether the block is split horizontally) and ver_split_flag (indicating whether the block is split vertically). These flags may be encoded in any order; the second flag is only sent if the first flag indicates no segmentation in the corresponding direction. In another embodiment of the present disclosure, the split and the split direction are encoded using a split_flag and a split_direction_flag, where the split_flag indicates whether the current block is split and the split_direction_flag indicates whether the split is applied horizontally or horizontally. vertically. In a variant, the split_direction_flag indicates whether the split is applied in a direction perpendicular to the last split or in the same direction as the last split.
注意,該以下描述(關於該分割比的信令)聚焦於使用該perpend_split_flag和parallel_split_flag的該較佳實施例,但是它也可以與該分割方向的任何其他信令一起使用,例如,(hor_split_flag和ver_split_flag)或者(split_flag和split_direction_flag)。Note that the following description (about the signaling of the split ratio) focuses on the preferred embodiment using the perpend_split_flag and parallel_split_flag, but it can also be used with any other signaling of the split direction, for example, (hor_split_flag and ver_split_flag ) or (split_flag and split_direction_flag).
在本揭露的一較佳實施例中,使用基於上下文的自適應算術編碼(如H.265|MPEG-H HEVC中的CABAC)對該分割旗標進行編碼。In a preferred embodiment of the present disclosure, the segmentation flag is encoded using context-based adaptive arithmetic coding (such as CABAC in H.265|MPEG-H HEVC).
如果該分割方向的該信令(使用任何該上述方法)指示該當前區塊被分割(對於該較佳實施例,這意味著perpend_split_flag或parallel_split_flag等於1或被推斷為等於1),除了該分割方向之外,一分割比還被編碼(比較18a)。如果可以使用該視頻編碼框架對該所得到的子區塊進行編碼(例如,必須具有一適當的變換大小),則針對每個區塊大小可以任意選擇可能的分割比的該集合。該分割比可以被編碼為一集合的一元素以及經由該分子和該分母的二值化(在前一種情況下,該集合必須被預定義)。在本揭露的一較佳實施例中,基於一個二元決策樹(根據該可用的分割比進行自適應樹修剪)對該分割比進行編碼,如下面將更詳細地描述的。在本揭露的另一個實施例中,該分割比可以被編碼為可用分割比的一有序列表的一索引。可以使用任何二值化方案將該索引映射到一系列二元決策。If the signaling of the split direction (using any of the above methods) indicates that the current block is split (for the preferred embodiment, this means that perpend_split_flag or parallel_split_flag is equal to 1 or is inferred to be equal to 1), in addition to the split direction In addition, a division ratio is also encoded (compare 18a). If the resulting sub-blocks can be encoded using the video coding framework (eg, must have an appropriate transform size), then the set of possible partitioning ratios can be chosen arbitrarily for each block size. The split ratio can be encoded as an element of a set and via binarization of the numerator and the denominator (in the former case, the set must be predefined). In a preferred embodiment of the present disclosure, the split ratio is encoded based on a binary decision tree (adaptive tree pruning based on the available split ratio), as will be described in more detail below. In another embodiment of the present disclosure, the split ratio may be encoded as an index into an ordered list of available split ratios. This index can be mapped to a sequence of binary decisions using any binarization scheme.
在本揭露的一較佳實施例中,該總體分割比集合定義為:{1/2, 1/4, 3/4, 3/8, 5/8, 1/3, 2/3, 1/5, 2/5, 3/5, 4/5}。對於每個實際分割,分割比的該可用集合代表該總體集合的一個子集合。針對一特定區塊和一特定分割方向的該子集合可以由該當前區塊的該大小和/或先前分割的該序列而決定。如果某些該比率對一於特定分割大小為不可用(例如,因為對變換或預測大小的限制、或最小區塊大小阻止這些分割比、或因為該分割將導致冗餘分割),為了降低位元率,則相應的信令旗標不發送。特別地,如果只有一個分割比可用,則可以推斷出該比率信令的所有二元決策(bin)並且不發送(例如,對於該區塊大小大於該最大區塊大小的一非默認分割,)。對於一分割方向,如果不能應用任何分割比(例如,由於高級別參數強制執行的禁令),則可以將該分割方向的該信令推斷為假。In a preferred embodiment of the present disclosure, the overall split ratio set is defined as: {1/2, 1/4, 3/4, 3/8, 5/8, 1/3, 2/3, 1/ 5, 2/5, 3/5, 4/5}. For each actual split, the available set of split ratios represents a subset of the overall set. The subset for a specific block and a specific partitioning direction may be determined by the size of the current block and/or the sequence of previous partitions. If some of the ratios are not available for a particular partition size (e.g., because limitations on transform or prediction size, or the minimum block size prevent these partition ratios, or because the partition would result in redundant partitions), in order to reduce the bit rate, the corresponding signaling flag is not sent. In particular, if only one split ratio is available, all bins signaled by that ratio can be inferred and not sent (e.g., for a non-default split where the block size is greater than the maximum block size,) . If no splitting ratio can be applied for a splitting direction (eg due to prohibitions enforced by high-level parameters), then this signaling for that splitting direction may be inferred as false.
該二進制分割將被遞歸地應用,直到沒有進一步的分割被推斷或被發信號通知。亦即,如果一區塊被分成兩個子區塊,則對於每個所得的子區塊,對由一分割方向和一分割比所組成的另一個分割進行編碼(其中可以基於語法約束推斷出一些或所有相應的二元決策)。該程序將繼續,直到信號通知(或推斷)沒有區塊被進一步分割為止。This binary split will be applied recursively until no further splits are inferred or signaled. That is, if a block is divided into two sub-blocks, then for each resulting sub-block, another partition consisting of a partition direction and a partition ratio is encoded (which can be inferred based on the syntax constraints some or all corresponding binary decisions). The procedure continues until it is signaled (or inferred) that no blocks are further split.
在本揭露的一較佳實施例中,該廣義二進制分割概念用於將固定大小的區塊(例如CTU)分割成編碼單元,其也表示預測單元和變換單元。對於每個得到的區塊,一編碼模式和相關的預測參數(例如幀內預測模式或運動參數)被發送,並且該等區塊也用於該殘差信號的變換編碼。在另一實施例中,該所得到的區塊被用作編碼區塊(即,針對用信號通知該編碼模式),但是該編碼區塊可以進一步分割為預測和/或變換區塊(使用該廣義二進制分割概念或任何其他分割方法)。In a preferred embodiment of the present disclosure, the generalized binary partitioning concept is used to partition fixed-size blocks (eg, CTUs) into coding units, which also represent prediction units and transformation units. For each resulting block, a coding mode and associated prediction parameters (such as intra prediction mode or motion parameters) are sent, and the blocks are also used for transform coding of the residual signal. In another embodiment, the resulting blocks are used as coding blocks (ie, for signaling the coding mode), but the coding blocks can be further partitioned into prediction and/or transform blocks (using the generalized binary partitioning concept or any other partitioning method).
控制廣義二進制分割的該行為的該高級別參數可以包括一最小區塊大小(例如,由一最小塊寬度和一最小塊高度來指定,或由一最小數量的樣本來指定)、一最大分割樹深度、一第一個非默認分割後的一最大分割樹深度、一非默認分割的一最大區塊大小、該結果區塊的最大和最小允許寬高比、以及有關該適用分割比的約束。可以在一圖片參數集(PPS、Picture Parameter Set)、一序列參數集(SPS、Sequence Parameter Set)、切片標頭或任何其他高級別語法結構中用信號通知該高級別參數。為了減少發送該高級別參數所需的該位元數,可以為該高級別參數定義邊界和特定域。例如,該最大寬高比可以被定義為大於4的2的冪次,因此顯著減少了可能的選項的該數量。或者可以將該最小寬高比定義為該最大寬高比的倒數,反之亦然,在這種情況下,僅需要發送該最小或最大寬高比。The high-level parameters that control the behavior of generalized binary partitioning may include a minimum block size (e.g., specified by a minimum block width and a minimum block height, or a minimum number of samples), a maximum split tree depth, a maximum split tree depth after the first non-default split, a maximum block size for a non-default split, the maximum and minimum allowed aspect ratios of the resulting block, and constraints on the applicable split ratio. The high-level parameters may be signaled in a Picture Parameter Set (PPS), a Sequence Parameter Set (SPS), a slice header, or any other high-level syntax structure. To reduce the number of bits required to send the high-level parameter, boundaries and specific fields can be defined for the high-level parameter. For example, the maximum aspect ratio may be defined to be greater than 4 to a power of 2, thus significantly reducing the number of possible options. Or the minimum aspect ratio can be defined as the reciprocal of the maximum aspect ratio, or vice versa, in which case only the minimum or maximum aspect ratio needs to be sent.
在本揭露的一較佳實施例中,使用基於上下文的自適應算術編碼(CABAC)對該分割方向和該分割比進行編碼。亦即,這些參數被編碼為具有自適應二進制機率模型的一系列二元決策(該二元決策的一子集合也可以用非自適應機率模型編碼)。可以基於相鄰區塊的大小來選擇用於該分割決策的該所使用的二進制機率模型。該基本假設是小區塊經常出現在其他小區塊的鄰域中(即,在一視頻圖片的精細分割區域中)。這個或一類似的假設也可以用於對該分割比編碼的該上下文進行建模。注意,非對稱分割導致一較小和一較大的區塊,並且較小的區塊可能傾向於位於其他小區塊的鄰域中。In a preferred embodiment of the present disclosure, context-based adaptive arithmetic coding (CABAC) is used to encode the segmentation direction and the segmentation ratio. That is, these parameters are encoded as a series of binary decisions with an adaptive binary probabilistic model (a subset of this binary decision can also be encoded with a non-adaptive probabilistic model). The binary probabilistic model used for the splitting decision can be selected based on the size of neighboring blocks. The basic assumption is that small patches often appear in the neighborhood of other small patches (i.e., in finely segmented regions of a video picture). This or a similar assumption can also be used to model the context of the split ratio encoding. Note that asymmetric partitioning results in one smaller and one larger block, and smaller blocks may tend to be in the neighborhood of other small blocks.
由於使用一通用二進制分割框架可以生成該複雜樣型,因此可以使用多個分割樹以生成一些最終分割樣型。為了減少這種現象(並且最小化用信號通知一特定區塊分割所需的位元數量),在本揭露的一較佳實施例中,該語法禁止某些分割組合。這可以藉由禁止將一些樹樣型引入該分割樹來實現。使用該實際的「垂直」/「水平」或該方向「平行」/「垂直」分割方向語義來定義一個樹樣型,其可能是混合的。一個樹樣型還包括分割比。如果一分割方向、分割比或分割方向和分割比的一組合將導致一個禁止樣型發生,則將其推斷為假並且不發送該相應的二元決策,而是在該解碼器側推斷。注意,該編碼器和解碼器兩者都必須知道該禁止的樹樣型(或禁止的分割組合)。Since this complex pattern can be generated using a general binary segmentation framework, multiple segmentation trees can be used to generate some final segmentation patterns. To reduce this phenomenon (and minimize the number of bits required to signal a particular block partition), in a preferred embodiment of the present disclosure, the syntax prohibits certain partition combinations. This can be achieved by disabling the introduction of some tree patterns into the split tree. Define a tree pattern using the actual "vertical"/"horizontal" or the direction "parallel"/"vertical" split direction semantics, which may be mixed. A tree pattern also includes split ratios. If a segmentation direction, segmentation ratio or a combination of segmentation direction and segmentation ratio would lead to the occurrence of a forbidden pattern, this is inferred as false and the corresponding binary decision is not sent but is inferred on the decoder side. Note that both the encoder and decoder must know the forbidden tree patterns (or forbidden combinations of partitions).
為了防止冗餘的分割表示,可以使用簡單的規則來識別這樣的分割,如下面將示例性地描述的。To prevent redundant segmentation representations, simple rules can be used to identify such segmentations, as will be exemplarily described below.
對可用分割比的約束Constraints on available split ratios
下面呈現用於防止冗餘分割表示和約束允許分割方向和分割比的本揭露的一較佳實施例。它應該說明所討論的揭露的可能實施方式,並且應以示例性而非限制性的方式理解。A preferred embodiment of the present disclosure for preventing redundant segmentation representations and constraining allowed segmentation directions and segmentation ratios is presented below. It should illustrate possible ways in which the disclosure in question may be implemented, and should be understood in an illustrative and not a restrictive manner.
如圖1所示,使用本實施例中描述的該裝置對一個128x128區塊(例如,尺寸為128x128的一個CTU)進行一特定的部分分割。描述該所示拓撲的該分割樹如圖2所示。圖3說明了在特定節點使用哪些分割方向和比率。As shown in FIG. 1 , the device described in this embodiment is used to perform a specific partial partition on a 128x128 block (for example, a CTU with a size of 128x128). The split tree describing the topology shown is shown in Figure 2. Figure 3 illustrates which split directions and ratios are used at specific nodes.
在以下描述中,我們聚焦(不失一般性)在限制在一給定分割方向的分割比的該集合。原則上,對於一給定的區塊大小(寬度和高度)以及導致該當前區塊的一給定系列的分割,藉由從可用分割比的一總體集合中移除禁止的分割,以導出分割比的一允許集合。在該得到的分割比集合為空的情況下,該相應的分割方向係完全禁止,並且相應的該分割方向旗標(即,perpend_split_flag或parallel_split_flag或任何其他對應的二元決策不被編碼,但推斷為等於0)。In the following description, we focus (without loss of generality) on this set of segmentation ratios restricted to a given segmentation direction. In principle, for a given block size (width and height) and a given series of partitions leading to the current block, the partitions are derived by removing forbidden partitions from a total set of available partition ratios Than one allowed set. In the case where the resulting set of split ratios is empty, the corresponding split direction is completely prohibited and the corresponding split direction flag (i.e., perpend_split_flag or parallel_split_flag or any other corresponding binary decision is not encoded, but is inferred is equal to 0).
作為一個範例,在本揭露的一較佳實施例中,分割比的該總體集合由下式給出:。 (1)As an example, in a preferred embodiment of the present disclosure, the overall set of split ratios is given by: . (1)
對於一般情況,我們可以假設所有分割比a/b都是不可約的分數(分子和分母是互質的)。除了具有分割比1/2的對稱分割之外,在分割比的該總體集合中還包括幾個非對稱分割比。在本揭露的一較佳實施例中,如果包括具有分割比a/b的一非對稱分割,則還包括該分割比(b-a)/b。兩個分割產生相同的子區塊大小,但是對於其中一個分割,該較大的子區塊表示該左/頂部分,而對於另一個分割,較大的子區塊表示該要分割的區塊的該右/底部分。For the general case, we can assume that all division ratios a/b are irreducible fractions (numerator and denominator are relatively prime). In addition to the symmetrical division with a division ratio of 1/2, this overall set of division ratios also includes several asymmetric division ratios. In a preferred embodiment of the present disclosure, if an asymmetric division with a division ratio a/b is included, the division ratio (b-a)/b is also included. Both splits result in the same sub-chunk size, but for one of the splits, the larger sub-chunk represents the left/top portion, while for the other split, the larger sub-chunk represents the chunk to be split of the right/bottom part.
非對稱分割的該集合可以表示為:, (2) 具有該約束。The set of asymmetric partitions It can be expressed as: , (2) has this constraint .
每對分割比和,其中,表示兩個互補的非對稱分割,這導致兩個相同大小但不同順序的子區塊。注意,對於,可以有,只要和(參見公式(1)中的集合,其中我們有)。如果不支持對稱分割(比率為1/2),則分割比的該總體集合等於非對稱分割的該總體集合,。在本揭露的一個較佳實施例中,該對稱分割包括在分割比的該總體集合中,在這種情況下我們具有。 (3)Split ratio of each pair and ,in , represents two complementary asymmetric partitions, which result in two sub-blocks of the same size but different order. Note that for ,You may have ,if only and (See the set in equation (1), where we have ). If symmetric partitioning is not supported (ratio is 1/2), then the overall set of partition ratios is equal to the overall set of asymmetric partitions, . In a preferred embodiment of the present disclosure, the symmetric partition is included in the overall set of partition ratios, in which case we have . (3)
標準standard 11 :區塊大小的粒度: granularity of block size (granularity)(granularity)
用於減小潛在分割比的該集合的一第一標準與該得到的區塊寬度或高度有關。很明顯,該區塊寬度(和區塊高度)必須是整數,因為不能用具有分數個樣本的區塊來編碼區塊。通常,有利的是每個子區塊的該寬度/高度表示一某個粒度的一整數倍,其中表示自然數的該集合。在本揭露的一個較佳實施方案中,我們設定。儘管對於區塊寬度和區塊高度具有該相同的粒度是合理的,但也可以對水平和垂直區塊尺寸使用不同的粒度。A first criterion for reducing the set of potential partition ratios is related to the resulting block width or height. Obviously, the block width (and block height) must be an integer, since blocks cannot be encoded with blocks with fractional samples. Often it is advantageous that the width/height of each sub-block represents a certain granularity an integral multiple of , where represents the set of natural numbers. In a preferred implementation of this disclosure, we set . Although it is reasonable to have this same granularity for tile width and tile height, it is also possible to use different granularity for horizontal and vertical tile sizes.
因此,僅當該分割尺寸M(即,該要被分割的區塊的該寬度(對於垂直分割)或高度(對於水平分割))滿足以下等式時,才支持具有分割比a/b的一分割:, (4)。 (5)Therefore, a split ratio a/b is supported only when the split size M (ie, the width (for vertical split) or height (for horizontal split) of the block to be split) satisfies the following equation: segmentation: , (4) . (5)
作為一個例子,我們考慮公式(1)中給出的分割比的該總體集合,並假設的一粒度。對於的該分割大小,可用分割的該集合減少到該集合。對於的一分割大小,可用分割的該集合減少到該集合。並且,作為最後一個示例,對於的分割大小,可用分割的該集合被減少到該集合。As an example, we consider this population set of split ratios given in equation (1) and assume of granularity. for of the partition size, the set of available partitions is reduced to the set . for a partition size of , the set of available partitions is reduced to the set . And, as a final example, for the split size to which the set of available splits is reduced .
標準standard 22 :區塊尺寸,分割深度和寬高比:Block size, split depth and aspect ratio
除了該粒度之外,可用分割的該集合可以經由一最小區塊大小來約束。這意味著,如果一分割會導致一區塊大小小於一最小區塊大小,則禁止並將其從可用分割的該列表中刪除。該最小區塊大小可以經由一最小區塊寬度和一最小區塊高度來指定,或者可以經由一最小數量的樣本來指定。例如,在一粒度為且一最小區塊大小為32個樣本的情況下,該支持的最小區塊大小將為8x4和4x8,這樣的一配置無法藉由單獨指定一最小區塊寬度和一最小區塊高度來實現。In addition to the granularity, the set of available partitions may be constrained via a minimum block size. This means that if a partition would result in a block size smaller than a minimum block size, it is prohibited and removed from the list of available partitions. The minimum block size may be specified via a minimum block width and a minimum block height, or may be specified via a minimum number of samples. For example, at a granularity of With a minimum block size of 32 samples, the supported minimum block sizes will be 8x4 and 4x8. Such a configuration cannot be achieved by separately specifying a minimum block width and a minimum block height.
另一個可能的約束是該最小和最大寬高比。如果一分割將導致具有大於最大寬高比或小於最小寬高比的一寬高比(區塊寬度)/(區塊高度)的任何子區塊,則從該可用分割集合中移除該相應的分割。如前所述,該最小寬高比可以設置為等於該最大寬高比的該倒數。舉一個例子,該最大寬高比可以設置為8。Another possible constraint is the minimum and maximum aspect ratio. If a split would result in any sub-block with an aspect ratio (block width)/(block height) greater than the maximum aspect ratio or less than the minimum aspect ratio, then the corresponding partition is removed from the set of available partitions of division. As mentioned before, the minimum aspect ratio may be set equal to the reciprocal of the maximum aspect ratio. As an example, the maximum aspect ratio can be set to 8.
一個進一步的約束可以限制該最大分割深度。該分割深度表示該二元分割樹結構的該深度。或者換句話說,對於一特定區塊,該分割深度表示從該根區塊到達該當前區塊所需的該分割數目。如果一當前區塊的分割深度已經等於該最大分割深度,則不允許進一步分割。舉一個例子,該最大分割深度可以設置為3。A further constraint can limit the maximum segmentation depth. The split depth represents the depth of the binary split tree structure. Or in other words, for a particular block, the split depth represents the number of splits required to reach the current block from the root block. If the split depth of a current block is already equal to the maximum split depth, no further splits are allowed. As an example, the maximum segmentation depth can be set to 3.
還可以引入約束,使得對於該第一分割級別(直到一某個深度),或者對於大於一特定值的所有分割級別,僅能被對稱分割。在這種情況下,對於相應的分割,分割比沒有被傳輸(但是該比率被推斷為等於1/2)。It is also possible to introduce constraints such that only symmetrical segmentation is possible for the first segmentation level (up to a certain depth), or for all segmentation levels greater than a certain value. In this case, the split ratio is not transmitted for the corresponding split (but the ratio is inferred to be equal to 1/2).
控制該最小區塊大小、該最小和最大寬高比、該最大分割深度和/或限制使用非對稱分割的值的參數較佳地以一高級別語法結構發送,類似於該序列參數集、該圖片參數集、或H.265|MPEG H HEVC的切片標頭。Parameters controlling the minimum block size, the minimum and maximum aspect ratio, the maximum split depth and/or limiting the use of asymmetric split values are preferably sent in a high-level syntax structure, similar to the sequence parameter set, the Picture parameter set, or slice header for H.265|MPEG H HEVC.
標準standard 33 :冗餘並行分割: redundant parallel partitioning
沒有進一步的限制,該廣義二進制分割通常導致某些分割的冗餘表示。為了避免這種冗餘,需要引入額外的限制。請注意,該語法中的冗餘會使指定該分割的該代碼效率降低,應該避免。另外,如果在該編碼演算法中測試冗餘分割,則會不必要地增加該複雜性。Without further restrictions, this generalized binary partitioning generally leads to redundant representations of certain partitions. To avoid this redundancy, additional constraints need to be introduced. Note that redundancy in this syntax makes the code that specifies this split less efficient and should be avoided. Additionally, if redundant partitioning is tested within the encoding algorithm, the complexity is unnecessarily increased.
針對在公式(1)中給出的分割比的該總體集合的限制的一示例性集合係總結在表1中。每個限制對應於三個佈局(a, b, c)之一,即一個二進制分割樹的子集合;這些佈局如圖7所示。An exemplary set of limitations for this overall set of split ratios given in equation (1) is summarized in Table 1. Each limit corresponds to one of three layouts (a, b, c), a subset of a binary split tree; these layouts are shown in Figure 7.
作為一第一個觀點,我們專注於連續並行分割中的冗餘。作為一範例,我們考慮一個16x16區塊,如圖11所示。如果首先使用水平方向上3/4的分割比對該區塊進行分割,則在該相同方向上以1/3的分割比進一步分割該所得到的子區塊中的第一個(參見圖11中的「樹A」),我們獲得一個16x4、一個16x8和一個16x4區塊(按此順序)。如果該第一次分割在水平方向上使用1/4的一分割比並且所得到的區塊中的該第二個區塊(在相同方向上)的一分割比為2/3,則獲得完全相同的分割(參見在圖11中「樹B」)。As a first perspective, we focus on redundancy in consecutive parallel partitions. As an example, let's consider a 16x16 block, as shown in Figure 11. If the block is first divided using a dividing ratio of 3/4 in the horizontal direction, the first of the resulting sub-blocks is further divided in the same direction with a dividing ratio of 1/3 (see Figure 11 "Tree A" in ), we get a 16x4, a 16x8 and a 16x4 block (in that order). If the first split uses a split ratio of 1/4 in the horizontal direction and the second one of the resulting blocks (in the same direction) has a split ratio of 2/3, then complete The same split (see "Tree B" in Figure 11).
考慮將一第一個分割應用於一區塊然後將一分割應用於第一個子區塊的該情況。因此,我們得到三個區塊,區塊大小為、、,其中是該分割大小,即該區原始區塊的區塊尺寸。現在,如果我們應用一第一次分割然後將該第二個子區塊用該同一方向上的一分割分割,我們產生三個具有尺寸的區塊、、。只要有可能產生該相同的區塊尺寸、、並且,並且有兩個平行的分割和應用於第一個子區塊)以及兩個平行的分割和應用於第二個子區塊),其中一個該組合或應該被禁止。每當和時,情況總是如此。決定哪種組合被禁止可以(例如)取決於哪個冗餘組合需要一較少數量的二元決策來用信號通知該分割。Consider dividing a first Apply to a block and then split a This case applies to the first subblock. Therefore, we get three blocks with block size , , ,in is the split size, which is the block size of the original block in this area. Now, if we apply a first split Then divide the second sub-block by a value in the same direction Split, we produce three blocks with size , , . Whenever possible to generate the same block size , , and , and there are two parallel divisions and applied to the first sub-block) and two parallel splits and applied to the second sub-block), one of which combines or should be banned. whenever and This is always the case. Determining which combinations are prohibited may, for example, depend on which redundant combinations require a smaller number of binary decisions to signal the split.
對於公式(1)中給出分割比的該總體集合,表1的該第一部分指定了禁止並行分割的一範例。對該第一子區塊禁止的該並行分割由「佈局a)」標記,並且對該第二子區塊禁止的該並行分割由「佈局b)」標記。注意,也可以經由僅禁止針對該第一子區塊的分割、或者僅禁止針對該第二子區塊的分割,或者經由使用針對該第一子區塊和第二子區塊的禁止分割的另一組合來去除連續並行分割的該冗餘。For the overall set of split ratios given in equation (1), the first part of Table 1 specifies an example in which parallel splits are prohibited. The parallel partitioning prohibited for the first sub-block is marked by "layout a)" and the parallel partitioning prohibited for the second sub-block is marked by "layout b)". Note that it is also possible to prohibit partitioning only for the first sub-block, or to prohibit partitioning only for the second sub-block, or by using a method that prohibits partitioning for the first sub-block and the second sub-block. Another combination to remove this redundancy of consecutive parallel partitions.
標準standard 44 :冗餘垂直分割: redundant vertical split
除冗餘並行分割外,還有冗餘垂直分割。假設我們具有首先在水平方向上使用分割比分割的一區塊,然後使用分割比在垂直方向上分割所得到的兩個子區塊(參見圖12a)。如果首先使用分割比在垂直方向上分割該原始區塊,然後使用分割比在水平方向上分割所得到的兩個子區塊,則獲得該相同的分割(參見圖12b)。In addition to redundant parallel partitioning, there is also redundant vertical partitioning. Suppose we have first use the split ratio in the horizontal direction Split a block and then use the split ratio The resulting two sub-blocks are divided vertically (see Figure 12a). If you first use the split ratio Split the original block vertically and then use the split ratio The same partitioning is obtained by dividing the resulting two sub-blocks in the horizontal direction (see Figure 12b).
然而,請注意,儘管兩個討論選項的該結果分割相同,但該相應的編碼選項可能不同。該原因是該子區塊的該編碼順序不同。通常,該編碼順序以如下方式定義:對於每個分割,對該第一子區塊(頂部或左側子區塊)或該第一子區塊中包含的所有區塊係在該第二子區塊(底部或右側子區塊)或該第二子區塊中包含的所有區塊之前進行編碼。因此,如果我們首先對每個子區塊應用一垂直分割然後一水平分割,則將按該以下順序傳輸該四個結果區塊:左上角、左下角、右上角、右下角(參見圖12b)。與此相反,如果我們首先應用該水平分割然後將該垂直分割應用於兩個子區塊,我們獲得該編碼順序:左上角、右上角、左下角、右下角(見圖12a)。由於該所得子區塊的該不同編碼順序,用於圖片內預測、運動向量預測、合併候選者的推導等的該方法可能產生不同的結果,因此,該不同的分割可能導致該原始區塊的不同表示。Note, however, that although this resulting split is the same for both discussion options, the corresponding coding options may be different. The reason is that the encoding order of the sub-block is different. Typically, the encoding order is defined in the following way: for each partition, the first sub-block (top or left sub-block) or all blocks contained in the first sub-block are assigned to the second sub-block. block (bottom or right subblock) or all blocks contained in this second subblock. Therefore, if we first apply a vertical split and then a horizontal split to each sub-block, the four resulting blocks will be transmitted in the following order: top left, bottom left, top right, bottom right (see Figure 12b). In contrast, if we first apply the horizontal split and then the vertical split to the two sub-blocks, we obtain the encoding order: top left, top right, bottom left, bottom right (see Figure 12a). Due to the different coding order of the resulting sub-blocks, the methods for intra-picture prediction, motion vector prediction, derivation of merge candidates, etc. may produce different results, and therefore the different partitioning may result in Different expressions.
儘管如此,所描述的該冗餘垂直分割通常仍然非常相似,因此禁止這些分割實際上可以提高編碼效率。取決於該實際編解碼器和該所採用的編碼演算法,由於不考慮兩個該所描述的編碼選項而導致的編碼效率的損失,可能被經由使用較短的字碼用於用信號通知分割而獲得的位元率節省所抵消。此外,如果該編碼器評估兩個選項,則只能經由考慮兩種分割方式來獲得一潛在的增益,這會增加該編碼複雜度。因此,總結的說,它取決於該實際的編碼選項和該應用程序是否較佳的在該語法中允許兩個選項。在本揭露的一較佳實施例中,禁止所描述的該冗餘垂直分割。在本揭露的另一個實施例中,在該語法中支持該潛在的冗餘。並且在另一實施例中,該位元流包含一語法元素,其指示該語法是允許還是禁止冗餘垂直分割。在該後一種情況下,該實際使用的分割比語法係取決於一相應語法元素的該值。指示是允許還是禁止冗餘垂直分割的該語法元素可以作為任何高級別語法結構的一部分而被發送,例如SPS、PPS或切片標頭。該語法元素也可以作為該低級別語法的一部分而被傳輸,例如該CTU語法或該CU語法。Nonetheless, the redundant vertical partitions described are often still very similar, so disabling these partitions can actually improve coding efficiency. Depending on the actual codec and the encoding algorithm used, the loss in coding efficiency caused by not taking into account both of the described encoding options may be eliminated by using shorter code words for signaling segmentation. offset by the bitrate savings gained. Furthermore, if the encoder evaluates two options, a potential gain can only be obtained by considering both splits, which increases the encoding complexity. So, in summary, it depends on the actual encoding options and whether the application is optimal to allow both options in the syntax. In a preferred embodiment of the present disclosure, the redundant vertical partitioning described is prohibited. In another embodiment of the present disclosure, this potential redundancy is supported in the syntax. And in another embodiment, the bit stream includes a syntax element indicating whether the syntax allows or disables redundant vertical splitting. In the latter case, the actual segmentation ratio syntax used depends on the value of a corresponding syntax element. This syntax element indicating whether redundant vertical splitting is allowed or prohibited can be sent as part of any high-level syntax structure, such as an SPS, PPS, or slice header. The syntax element may also be transmitted as part of the low-level syntax, such as the CTU syntax or the CU syntax.
如果禁止冗餘垂直分割(按照慣例或由一高級別語法元素指示),則必須定義禁止該兩種變體中的哪一種以及支持該變體中的哪一種。該決定可能取決於哪種變體需要較少的二元決策以用於編碼、或哪種變體最可能提供更好的幀內預測信號或運動向量預測器等。對於公式(1)中給出分割比的該總體集合的該例子,表1給出了指定禁止冗餘分割的一範例。該禁止的垂直分割標有「佈局c)」。它們必須以下列方式解釋。如果一給定的區塊在一特定方向上以分割比A(該表中的「A比率」)被分割,並且該所得到的子區塊中的該第一個在垂直方向上以分割比B(該表中的「B比率」)被分割,然後,該第二子區塊(即該原始區塊的該第二子區塊)不能在垂直方向(垂直於該原始區塊的分割)上以分割比C(該表中的「C比率」)分割。注意,該分割比B總是與該分割比C相同。因此,換句話說,如果一區塊在方向上以分割比分割並且該第一個所得子區塊在垂直方向(垂直於)上以分割比分割,如果在該表中指示,則該垂直分割(垂直於)具有分割比從該第二子區塊(具有方向和比率的該分割)的該可用分割的集合中移除。如上所述,表1中規定的該慣例必須被視為一個特定的例子。還有其他可能性來實現非常類似的冗餘分割的禁止。If redundant vertical splitting is prohibited (either by convention or indicated by a high-level syntax element), then it must be defined which of the two variants is prohibited and which of the two variants is supported. The decision may depend on which variant requires fewer binary decisions for encoding, or which variant is most likely to provide a better intra prediction signal or motion vector predictor, etc. For this example of the overall set of split ratios given in equation (1), Table 1 gives an example of specifying prohibition of redundant splits. This prohibited vertical division is marked "Layout c)". They must be interpreted in the following manner. If a given block is divided in a specific direction with a partition ratio A (the "A ratio" in this table), and the first of the resulting sub-blocks is divided in a vertical direction with a partition ratio B (the "B ratio" in this table) is split, then the second sub-block (i.e. the second sub-block of the original block) cannot be split in the vertical direction (perpendicular to the split of the original block) The above is divided by the division ratio C ("C ratio" in this table). Note that the division ratio B is always the same as the division ratio C. So, in other words, if a block is in the direction above divided ratio split and the first resulting sub-block is in the vertical direction (perpendicular to ) above the division ratio division, if indicated in this table, the vertical division (vertical to ) has a split ratio From this second sub-block (with direction and ratio removed from the set of available partitions. As stated above, the convention specified in Table 1 must be regarded as a specific example. There are other possibilities to implement very similar prohibitions on redundant partitioning.
圖7係顯示三個不同的分割樹模式,如果滿足該節點A、B和C的特定分割方向和比率,則禁止這三種分割樹模式。在表1中,列出了在所述實施例中禁止的所有配置。可以使用一不同的分割樹樣型精確複製由這些樣型生成的該本地拓撲。注意,該禁止是根據該最不浪費分割來選擇的。在這種特殊情況下,A比率3/4和B比率2/3的佈局a)產生與A比率1/2和B比率1/2的佈局b)該相同的樣型。然而,該前者是被禁止的,而該後者是允許的,因為1/2在信令中較不浪費(當使用下面描述的該信令方案時)。表 1- 禁止分割的範例
潛在的額外限制Potential additional restrictions
可以進一步約束一當前區塊的該可用分割,以便防止額外的冗餘或者為了獲得一更受限制的分割概念。下面列出了一些重要的例子:The available partitions of a current block can be further constrained in order to prevent additional redundancy or to obtain a more restricted concept of partitions. Some important examples are listed below:
1.1. 高階冗餘higher order redundancy
除了上述連續平行和連續垂直分割中的冗餘之外,當考慮更多分割順序時可能存在更多冗餘。例如一範例,考慮位置(0,0)處的一個16x16區塊以及該以下兩種分割方式(根據表1中的該規則,這兩種方式都不被禁止)。 方法A: (1)具有比例1/4的垂直分割應用於位置(0,0)的16×16區塊 (2)具有比率1/2的水平分割應用於位置(0,0)的4×16區塊 (3)具有比例2/3的垂直分割應用於位置(4,0)的12×16區塊 (4)具有比率1/2的水平分割應用於位置(4,0)的8×16區塊 方法B: (1)具有比例3/4的垂直分割應用於位置(0,0)的16x16塊 (2)具有比率1/2的水平分割應用於位置(0,0)的12x16塊 (3)具有比例1/3的垂直分割應用於位置(0,0)的12x8塊 (4)具有比例1/3的垂直分割應用於位置(0,8)的12x8塊In addition to the above-mentioned redundancies in consecutive parallel and consecutive vertical divisions, more redundancies may exist when more division orders are considered. As an example, consider a 16x16 block at position (0,0) and the following two partitioning methods (neither of which are prohibited according to the rule in Table 1). Method A: (1) A vertical split with scale 1/4 is applied to the 16×16 block at position (0,0) (2) Horizontal splitting with ratio 1/2 is applied to the 4×16 block at position (0,0) (3) A vertical split with a ratio of 2/3 is applied to the 12×16 block at position (4,0) (4) Horizontal splitting with ratio 1/2 is applied to the 8×16 block at position (4,0) Method B: (1) Vertical split with scale 3/4 applied to 16x16 block at position (0,0) (2) Horizontal split with ratio 1/2 applied to 12x16 block at position (0,0) (3) Vertical split with scale 1/3 applied to 12x8 block at position (0,0) (4) Vertical split with scale 1/3 applied to 12x8 block at position (0,8)
如圖13所示,兩種方法產生以下分割為5個子區塊:位置(0,0)處的4×8區塊、位置(4,0)處的8×8區塊、位置(0,8)處的4×8區塊、位置(4,8)處的8×8區塊、和位置(12,0)處的4×16區塊。與上面討論的該冗餘垂直分割類似,兩種方法的該編碼順序通常是不同的(在圖13中,該編碼順序由該結果區塊內的該數字表示),因此兩種分割方式實際上代表不同的編碼模式。這種更高階的冗餘可以被禁止,或者可以藉由語法而允許它們。As shown in Figure 13, the two methods produce the following partitioning into 5 sub-blocks: 4×8 block at position (0,0), 8×8 block at position (4,0), position (0, The 4×8 block at 8), the 8×8 block at position (4,8), and the 4×16 block at position (12,0). Similar to the redundant vertical partitioning discussed above, the encoding order of the two methods is usually different (in Figure 13, the encoding order is represented by the number within the result block), so the two partitioning methods actually Represents different encoding modes. Such higher-order redundancies can be disabled, or the syntax can allow them.
2.2. 分割鏈的限制Split chain restrictions
為了將該分割限制為選定的分割樣型,限制一系列分割可能是有益的。舉一個簡單的例子,考慮分割的該總體集合。限制分割系列的一範例如下:只要不違反其他條件(例如,一最小區塊大小),則始終允許對稱分割1/2。但是只有在該第一個子區塊的該相同方向上跟隨一個1/3分割時,才允許該3/4分割。如果當前區塊表示在該相同方向上一先前3/4分割的該第一個子區塊,才允許該1/3分割。這樣的一配置/語法實際上將導致與QTBT相同的分割方案以及額外的三重分割(三重分割是將一區塊分成三個子區塊的分割,大小為1/4、1/2、1/4,參見最先進的技術(文獻[4]))。In order to restrict the segmentation to a selected segmentation pattern, it may be useful to restrict a series of segmentations. As a simple example, consider splitting of the overall collection. An example of a restricted split series is as follows: symmetric splits of 1/2 are always allowed as long as other conditions are not violated (for example, a minimum block size). But the 3/4 split is only allowed if it is followed by a 1/3 split in the same direction of the first sub-block. The 1/3 split is only allowed if the current block represents the first sub-block of a previous 3/4 split in the same direction. Such a configuration/syntax will actually result in the same splitting scheme as QTBT with the additional triple split (a triple split is a split that divides a block into three sub-blocks of size 1/4, 1/2, 1/4 , see state-of-the-art technology (document [4])).
然而,為了實現對該可用分割的一某個限制,引入約束的可能性更多。However, there are more possibilities to introduce constraints in order to achieve a certain limit on the available partitions.
在本揭露的一個特定實施例中,僅允許這樣的分割鏈,這導致所有得到的區塊具有一寬度和一高度的分割,其表示2的整數冪(即,,n∈N和,)。為了保持該信令有效率,相應的約束可以直接被包括在該語法中。其可以使用表格或任何其他方式指定它們。In a specific embodiment of the present disclosure, only such split chains are allowed, which results in all resulting blocks having a width and a height division of , which represents an integer power of 2 (i.e., , n∈N and , ). To keep the signaling efficient, the corresponding constraints can be included directly in the syntax. It can specify them using a table or any other way.
3.3. 平衡限制balance limit
在分割限制的該設計中,可以有益的一個觀點是禁止分割的該幾何平衡。在本揭露的一個較佳實施例中,該分割的集合由給出。例如,如果該分割的限制旨在設計高度和寬度為2的整數冪的區塊,那麼可以從該分割集合中移除1/4或者3/4,並且順序地將2/3或1/3移除,因為一強制序列1/4後跟著2/3給出與3/4然後是1/3該相同的分割。假設3/4和1/3被移除,2/3必須跟隨在一個1/4分割之後(如上一節所示),然後為了保持一幾何平衡3/8被移除而不是5/8。此外,由於1/3被移除,第二部分必須被分成2/3,導致在7/8位置的分割,這是僅僅使用無法表示的。另一方面,如果移除1/4和2/3,則接下來移除5/8。請注意,3/8將在該第一部分上使用1/3分割,這導致在1/8位置的分割,僅使用無法表示。這種限制的該平衡減少了分割模式的該數量,但保持了分割的該多樣化。不對稱分割的該集合的該減少之目的是使得之前不對稱分割的該區域不應該再次不對稱地分分割。該原理可以用其他用語來解釋,作為避免一維/點狀的冗餘的概念。語法中禁止使用此分割選項。該結果可以是該可能的分割集合包括以交替方式(例如,左和右)「定位」的分割,使得該第二分割近似於先前分割的該鏡像版本。In the design of segmentation restrictions, one perspective that can be beneficial is the geometric balance that prohibits segmentation. In a preferred embodiment of the present disclosure, the divided set is composed of given. For example, if the constraints of the split are to design blocks with heights and widths that are powers of 2, then 1/4 or 3/4 can be removed from the set of splits, and 2/3 or 1/3 sequentially Removed because a forced sequence of 1/4 followed by 2/3 gives the same division as 3/4 then 1/3. Assuming that 3/4 and 1/3 are removed, 2/3 must be followed by a 1/4 split (as shown in the previous section), and then 3/8 is removed instead of 5/8 to maintain a geometric balance. Furthermore, since 1/3 is removed, the second part must be divided into 2/3, resulting in a split at the 7/8 position, which is simply using inexpressible. On the other hand, if 1/4 and 2/3 are removed, 5/8 is removed next. Note that 3/8 will use a 1/3 split on that first part, which results in a split at the 1/8 position, using only Unable to express. This balance of restrictions reduces the number of segmentation modes but maintains the diversity of segmentations. The purpose of this reduction of the set of asymmetric partitions is that the area that was previously asymmetrically partitioned should not be asymmetrically partitioned again. This principle can be explained in other terms, as the concept of avoiding one-dimensional/point-like redundancy. This splitting option is prohibited in the grammar. The result may be that the set of possible segmentations includes segmentations "positioned" in an alternating manner (eg, left and right) such that the second segmentation approximates the mirrored version of the previous segmentation.
4.4. 樹適應集tree adaptation set
除了由於冗餘分支的該消除以及寬高比限制引入的約束而導致的該樹修改之外,對該默認的通用二進制分割樹的進行進一步修改可以在一樹自適應集合中被總結,該樹自適應集合可以藉由發送相應的語法元素來隱式或顯式地被活化。一樹自適應集合可以定義樹葉節點或分支的一特定集合、或一規則的集合以選擇從該默認樹添加和/或移除的樹葉節點或分支。一明確地用信號通知樹自適應集合的該觀點可以包括一樹自適應集合的該使用的該信令和/或一索引的該信令、從樹自適應集合的一預定記錄中選擇一樹自適應集合、使用嵌入在任何高級別語法結構中的可變或固定長度代碼。隱式信令的範圍可以從導出附加樹自適應集合的該使用、以及藉由評估在任何高級別語法結構中和/或在CTU級別或以下的編碼語法元素來從一記錄中選擇一樹自適應合。一個觀點可以將特定的檔次和級別語法元素鏈接到特定的樹自適應集合,以便限制複雜性或消除不支持的區塊寬度、區塊高度或區塊長寬比,這可能與某些檔次-級別組合不兼容。此外,可以根據假設的本地要求,從該時間或空間鄰域的語法元素導出一樹自適應集合,限制或擴展該默認樹。In addition to the tree modifications due to the elimination of redundant branches and the constraints introduced by aspect ratio restrictions, further modifications to the default universal binary split tree can be summarized in a tree adaptation set, which automatically Adaptation sets can be activated implicitly or explicitly by sending corresponding syntax elements. A tree adaptation set may define a specific set of leaf nodes or branches, or a set of rules for selecting leaf nodes or branches to add and/or remove from the default tree. The idea of an explicit signaling of a tree adaptation set may include the signaling of the use of a tree adaptation set and/or the signaling of an index, selecting a tree adaptation from a predetermined record of the tree adaptation set Collections, using variable or fixed-length codes embedded in any high-level syntactic structure. Implicit signaling can range from the use of deriving additional tree adaptation sets to selecting a tree adaptation from a record by evaluating coding syntax elements in any high-level syntax structure and/or at the CTU level or below. combine. A view can link specific grades and level syntax elements to specific tree adaptation sets in order to limit complexity or eliminate unsupported block widths, block heights, or block aspect ratios, which may be associated with certain grades - Level combinations are incompatible. Furthermore, an adaptive set of trees can be derived from the syntactic elements of the temporal or spatial neighborhood, limiting or extending the default tree based on assumed local requirements.
在本揭露的一較佳實施例中,一隱式樹自適應集合可以由一圖片、圖塊或形狀邊界處的一區塊的異常形狀而被活化。這可能還包括一般應用限制的該覆寫,如寬高比限制。注意,在圖片或圖塊邊界處,一編碼樹單元通常具有一不同的區塊大小。例如,假設一高清圖片為1920x1080亮度樣本,一個CTU大小為128x128亮度樣本。然後,該圖片底部的該CTU僅具有128x56亮度樣本的大小。這裡,儘管該CTU最初仍被認為由128x128亮度樣本組成,但可以推斷出一隱式分割。作為一範例,可以推斷出具有分割比1/2的一水平分割和該第一子區塊的分割比7/8的一隨後水平分割,這導致一個128x56區塊;該剩餘區塊僅包含該圖片外部樣本的,其係未編碼。除了推斷隱式分割之外,用於發送該分割比的該二元決策樹還可以在一圖片或圖塊邊界上調整。例如,對於一邊界處的該區塊,分割引入的在圖片外的一區塊邊界可以被消除。這個概念也可以與隱式分割結合使用。例如,當一區塊不完全位於該圖片/圖塊區域內,但可以推斷出該區塊是垂直的(在右邊界處)或水平的(在底部邊界處)分割,但是為了傳輸該分割比,在該圖片/區塊區域外引入一區塊邊界的所有分割都會從該相應的二元決策樹中消除(即,用於發信號通知該分割比的該樹中的該相應二元決策被推斷為等於0或1)。In a preferred embodiment of the present disclosure, an implicit tree adaptation set may be activated by an abnormal shape of a picture, tile, or a region at a shape boundary. This may also include overrides of general application restrictions, such as aspect ratio restrictions. Note that a coding tree unit usually has a different block size at picture or tile boundaries. For example, assume an HD image is 1920x1080 luma samples and a CTU size is 128x128 luma samples. Then this CTU at the bottom of the picture only has the size of 128x56 luma samples. Here, although the CTU is still initially considered to consist of 128x128 luma samples, an implicit partitioning can be inferred. As an example, one can deduce a horizontal split with a split ratio of 1/2 and a subsequent horizontal split with a split ratio of 7/8 for the first sub-block, which results in a 128x56 block; the remaining block contains only the Picture external samples, which are not encoded. In addition to inferring implicit segmentations, the binary decision tree used to signal the segmentation ratio can also be adjusted on a picture or tile boundary. For example, for the block at a boundary, a block boundary outside the picture introduced by the segmentation can be eliminated. This concept can also be used in conjunction with implicit segmentation. For example, when a block does not lie completely within the picture/tile area, but it can be inferred that the block is divided vertically (at the right border) or horizontally (at the bottom border), but in order to transmit the division ratio , all splits that introduce a block boundary outside the picture/block area are eliminated from the corresponding binary decision tree (i.e., the corresponding binary decision in the tree used to signal the split ratio is Inferred to be equal to 0 or 1).
限制該二進制分割語法的高級別語法元素High-level syntax elements that restrict this binary splitting syntax
在本揭露的一較佳實施例中,高級別語法包括語法元素,該編碼器藉由該語法元素告知該解碼器該二進制分割樹的該實際配置。在某些應用中,該編碼器複雜性僅允許評估該語法支持的該分割選項的一子集合。為了不發送始終具有相同值的二元決策,該編碼器向該解碼器發信號通知該分割選項的哪個子集合被使用。該高級別語法元素在一個或多個高級別語法結構中被傳輸,例如該序列參數集(SPS:對一編碼視頻序列內的所有圖片有效)、該圖片參數集(PPS:對一個或多個圖片有效)、該切片標頭(對切片有效)等。In a preferred embodiment of the present disclosure, the high-level syntax includes syntax elements through which the encoder informs the decoder of the actual configuration of the binary split tree. In some applications, the encoder complexity only allows evaluation of a subset of the segmentation options supported by the grammar. In order not to send a binary decision that always has the same value, the encoder signals to the decoder which subset of the splitting options is used. The high-level syntax elements are transmitted in one or more high-level syntax structures, such as the sequence parameter set (SPS: valid for all pictures in a coded video sequence), the picture parameter set (PPS: valid for one or more The image is valid), the slice header (valid for the slice), etc.
限制該可用的分割選項的該高級別語法元素可以包含以下一個或多個參數: • 一最小區塊大小(例如,由一最小區塊寬度和一最小區塊高度指定,或由一最小樣本數量指定); • 一最大分割樹深度; • 一第一次非默認分割後的一最大分割樹深度(即,該分割比不等於1/2的該第一次分割後的該樹深度受限); • 一非默認分割的一最大區塊大小(即,如果該區塊大小大於或等於一給定大小,則僅支持一比率不等於1/2的分割); • 一非默認分割的一最小區塊大小(即,如果該區塊大小小於或等於一給定大小,則僅支持一比率不等於1/2的分割); • 允許的最大和最小寬高比; • 指示該分割比的一子集合的一參數(即,僅支持包括在該指定子集合中的分割比); • 一個參數,表示只支持垂直分割,可能針對區塊大小的一限制集合(即,該第一個分割或該前N個分割除外); • 約束一系列分割的一參數(見上文); • 一個參數,指定是否允許冗餘垂直分割(或通常,導致相同的分區的分割,但對所得區子區塊具有不同的編碼順序)。The high-level syntax element that limits the available splitting options can contain one or more of the following parameters: • a minimum block size (e.g., specified by a minimum block width and a minimum block height, or by a minimum number of samples); • a maximum split tree depth; • A maximum split tree depth after the first non-default split (i.e., the tree depth after the first split if the split ratio is not equal to 1/2 is limited); • a maximum block size for a non-default partition (i.e. if the block size is greater than or equal to a given size, only partitions with a ratio not equal to 1/2 are supported); • a minimum block size for a non-default partition (i.e. if the block size is less than or equal to a given size, only a partition with a ratio not equal to 1/2 is supported); • Maximum and minimum allowed aspect ratios; • a parameter indicating a subset of the split ratios (i.e., only split ratios included in the specified subset are supported); • A parameter indicating that only vertical splits are supported, possibly for a restricted set of block sizes (i.e., except for the first split or the first N splits); • a parameter constraining a series of partitions (see above); • A parameter specifying whether redundant vertical splits are allowed (or, generally, splits that result in the same partition, but with a different encoding order for the resulting zone subblocks).
該參數可以被包含在多個高級別語法結構中。例如,在該SPS中指定的全局參數可以被該PPS中指定的參數所覆蓋。This parameter can be included in several high-level syntax constructs. For example, global parameters specified in the SPS may be overridden by parameters specified in the PPS.
分割比的編碼Coding of split ratio
圖5係顯示一示例性分割大小為64的信令圖(假設沒有進一步的限制)。為了避免過時二元決策的傳輸,可以採用用於修剪該二元決策樹的一特殊演算法。本揭露的一特定實施例使用一特殊演算法來修剪該信令樹(圖5中示出了一完整決策樹的範例)。該概念基本上使用該相同的二元決策樹來用信號通知所有分割比,但是在實際編碼任何二元決策(bin)之前,基於該分割比的該可用性來修剪該樹。或者換句話說,基於該分割比的該可用性所推斷為等於0或1的二元決策不被發送,而是在該解碼器側推斷。Figure 5 shows a signaling diagram for an exemplary partition size of 64 (assuming no further restrictions). In order to avoid the transmission of outdated binary decisions, a special algorithm for pruning the binary decision tree can be used. A specific embodiment of the present disclosure uses a special algorithm to prune the signaling tree (an example of a complete decision tree is shown in Figure 5). The concept basically uses the same binary decision tree to signal all split ratios, but prunes the tree based on the availability of the split ratio before actually encoding any binary decisions (bins). Or in other words, the binary decision inferred to be equal to 0 or 1 based on the availability of the split ratio is not sent, but inferred on the decoder side.
因此,從該完整二元決策樹開始,該信令樹的輸出(該樹的樹葉節點)根據它們的可用性進行標記,其中可以根據上述該規則的任何組合導出該可用性(包括最小區塊大小、區塊粒度、最小和最大寬高比、冗餘並行分割、冗餘垂直分割等)。每個節點都包含有關該上下文模型的一信息,該信息用於使用CABAC引擎對該特定二元決策(bin)進行編碼。Therefore, starting from the full binary decision tree, the outputs of the signaling tree (leaf nodes of the tree) are labeled according to their availability, where the availability can be derived according to any combination of the rules above (including minimum block size, Block granularity, minimum and maximum aspect ratios, redundant parallel splits, redundant vertical splits, etc.). Each node contains information about the context model that is used to encode that specific binary decision (bin) using the CABAC engine.
該減少(或修剪)演算法如下減少決策樹。最初,假設用於發信號通知該分割比的該二元決策樹的所有節點都是可用的。然後,根據該相應分割比的該可用性將該樹的該樹葉節點標記為可用或不可用(其根據任何規則導出,例如,規則或上面指定的規則的一子集合)。然後,根據以該下兩個規則從該底部到該頂部修剪該決策樹: (1)如果一節點沒有可用的子節點(即,兩個子節點都被標記為不可用),則該節點被標記為不可用(即,它最終從該決策樹中移除)。(2)如果一個節點只有一個可用子節點,則該節點將被替換為該子節點(該子節點在決策樹中向上移動一級)。作為該所描述的樹修剪演算法的結果,獲得一新的二元決策樹。該樹的每個非樹葉節點具有兩個可用子節點,並且每個樹葉節點表示一個可用的分割比。注意,該獲得的二叉樹可以表示該原始的完整決策樹或一較小的二元決策樹。The reduction (or pruning) algorithm reduces the decision tree as follows. Initially, it is assumed that all nodes of the binary decision tree used to signal the split ratio are available. The leaf node of the tree is then marked as available or unavailable according to the availability of the corresponding split ratio (which is derived according to any rule, eg, a rule or a subset of the rules specified above). Then, the decision tree is pruned from the bottom to the top according to the following two rules: (1) If a node has no available child nodes (ie, both child nodes are marked as unavailable), then the node is Marked as unavailable (i.e., it is eventually removed from this decision tree). (2) If a node has only one available child node, the node will be replaced by that child node (the child node moves up one level in the decision tree). As a result of the described tree pruning algorithm, a new binary decision tree is obtained. Each non-leaf node of the tree has two available child nodes, and each leaf node represents an available split ratio. Note that the obtained binary tree can represent the original complete decision tree or a smaller binary decision tree.
在圖6中,其係顯示縮減的信令決策樹的三個範例(對於圖5的該完整決策樹)。在圖中 6a),呈現了沒有可能結果{3/8, 5/8}的一簡化樹的一個範例。在圖6b)中,該結果{1/4}不可用。在圖6c)中,比率{1/2, 3/8, 1/4}不可用。藉由比較在圖6中的該樹與在圖5中該完整樹,可以觀察到哪些節點被消除以及哪些節點被保留(該節點由一上下文模型id標記,其可以用於編碼該特定決策)。In Figure 6, three examples of reduced signaling decision trees are shown (for the complete decision tree of Figure 5). In Figure 6a), an example of a simplified tree with no possible outcomes {3/8, 5/8} is presented. In Figure 6b), this result {1/4} is not available. In Figure 6c), the ratios {1/2, 3/8, 1/4} are not available. By comparing the tree in Figure 6 to the full tree in Figure 5, one can observe which nodes were eliminated and which nodes were retained (the node is marked by a context model id, which can be used to encode this specific decision) .
在圖5、圖8和圖9中,其呈現用於對不同分割尺寸的該分割比進行編碼的二元決策樹。在本揭露的一較佳實施例中,使用自適應二進制機率模型對該二元決策進行算術編碼。該機率模型的該選擇可取決於該以下任何一種(或其組合): • 決策樹中的節點; • 二進制分割樹的當前深度; • 分割方向; • 空間相鄰區塊中的分割方向; • 空間相鄰區塊中的區塊大小; • 時間相鄰區塊中分割方向; • 時間相鄰區塊中的區塊大小。In Figures 5, 8 and 9, binary decision trees for encoding this split ratio for different split sizes are presented. In a preferred embodiment of the present disclosure, the binary decision is arithmetic encoded using an adaptive binary probabilistic model. The choice of the probabilistic model may depend on any of the following (or a combination thereof): • Nodes in the decision tree; • The current depth of the binary split tree; • Split direction; • Segmentation direction in spatially adjacent blocks; • Size of blocks in spatially adjacent blocks; • Split direction in temporally adjacent blocks; • Block size in temporally adjacent blocks.
在本揭露的一較佳實施例中,機率模型集合(也稱為上下文模型集合)到二元決策節點的分配不針對縮減決策樹進行修改。這意味著,對於每個二元決策,使用該相同的上下文模型集合(其中基於附加參數選擇一機率模型),而不管該二元決策是否被編碼為該完整決策樹的一部分或任何形式的縮減決策樹。In a preferred embodiment of the present disclosure, the assignment of probabilistic model sets (also called context model sets) to binary decision nodes is not modified for reducing the decision tree. This means that for every binary decision, the same set of context models is used (where a probabilistic model is chosen based on additional parameters), regardless of whether the binary decision is encoded as part of the full decision tree or any form of reduction Decision tree.
在一特定實施例中,一非默認分割之後的一樹的該深度被限制。因此,一第一個非默認分割意味著完成稀缺分割,並且該最後幾個可用深度將用於微調該區塊邊緣。將該推理轉換為本揭露,用“ctx0”和“ctx1”(在圖5和6中)標記的二元決策的機率模型的選擇係基於該分割樹的該當前深度,但是機率模型的不同集合是用於“ctx0”和“ctx1”。用“ctx2”、“ctx3”、“ctx5”、“ctx7”以及“ctx8”(圖5、圖8、圖9)標記的該二元決策都使用相同的機率模型進行編碼;對於每個決策樹,基於該分割樹的該當前深度和該相鄰區塊的該大小來選擇該機率模型。如果一細分區塊在一端具有小的相鄰區塊而在另一端具有大的相鄰區塊,則假設由當前細分產生的該區塊的該較小者將被放置在與其他小區塊相鄰的該側。標記為“ctx6”的該二元決策的該機率模型是基於相鄰區塊的大小有多大變化來選擇的(如果它們變化很大,則假設1/5或4/5比率可能較有可能,因為它們導致區域差異較大的細分)。一特定實施例可以如下定義該上下文模型。一分割區域如圖10所示。鄰居訪問的該錨點名為A1、A2、B1和B2。該區域假定是具有一特定深度的一分割樹中的一特定節點的一特殊表示。在該節點的路徑上,首先分割是默認分割,因此模擬深度為的一四叉樹。對於決策“ctx0”和“ctx1”的編碼,機率和被選擇。對於決策ctx2”、“ctx3”、“ctx5”、“ctx6”、“ctx7”以及“ctx8”的編碼,該鄰居被檢查(該鄰居被定義為根據圖10錨定在該分割塊處的該單元)。如果該分割方向是水平的,則是錨B1處的該鄰居,是錨B2處的該鄰居。如果該分割方向是垂直的,則是錨A1處的該鄰居,是錨A2處的該鄰居。該相鄰區塊具有一特定區域和。如果等於,則將該上下文偏移定義為1。如果大於,則定義為0。在所有其他情況下,它被定義為2。上下文“ctx6”的機率被定義為。還定義了。對於該其他上下文,機率定義如下:。In a particular embodiment, the depth of a tree after a non-default split is limited. Therefore, a first non-default split means that the scarcity split is completed, and the last few available depths will be used to fine-tune the block edges. Translating this reasoning into the present disclosure, the selection of probabilistic models for binary decisions labeled "ctx0" and "ctx1" (in Figures 5 and 6) is based on the current depth of the split tree, but a different set of probabilistic models is for "ctx0" and "ctx1". The binary decisions labeled "ctx2", "ctx3", "ctx5", "ctx7", and "ctx8" (Figure 5, Figure 8, Figure 9) are all encoded using the same probabilistic model; for each decision tree , the probabilistic model is selected based on the current depth of the split tree and the size of the adjacent block. If a subdivided block has a small neighbor at one end and a large neighbor at the other end, it is assumed that the smaller of the block resulting from the current subdivision will be placed next to the other small blocks. adjacent side. This probabilistic model for this binary decision labeled "ctx6" is chosen based on how much the sizes of adjacent blocks vary (if they vary a lot, assuming a 1/5 or 4/5 ratio might be more likely, because they result in subdivisions with large regional differences). A specific embodiment may define the context model as follows. A divided area is shown in Figure 10. The anchor points visited by neighbors are named A1, A2, B1, and B2. This area is assumed to have a specific depth A special representation of a specific node in a split tree. On the path of the node, first The split is the default split, so the simulation depth is A quadtree. For the encoding of decisions "ctx0" and "ctx1", the probability and be chosen. For the encoding of decisions ctx2", "ctx3", "ctx5", "ctx6", "ctx7" and "ctx8", the neighbor is checked (the neighbor is defined as the unit anchored at the partition according to Figure 10 ). If the splitting direction is horizontal, then is the neighbor at anchor B1, is the neighbor at anchor B2. If the splitting direction is vertical, then is the neighbor at anchor A1, is the neighbor at anchor A2. The adjacent block has a specific area and . if equal to , then offset the context Defined as 1. if greater than , then Defined as 0. In all other cases it is defined as 2. The probability of context "ctx6" is defined as . also defined . For this other context, probability is defined as follows: .
在另一實施例中,用於對該二元決策進行編碼的該二進制機率模型的該選擇係基於以下該假設:與在一已解碼的圖片的所謂並置CTU的一對應分割樹相比,在一圖片中的一特定CTU的一分割樹是相似的結構化的。在不失一般性的情況下,一並置CTU可以被定義為當使用從該當前CTU的位置和大小(例如CTU的中心位置)所導出的該坐標來存取一給定參考圖片中的一CTU時獲得的CTU。從該所獲得的並置CTU,可以使用分割深度或CTU維度或兩者,或者該並置CU的任何其他語法元素來選擇用於發信號通知分割決策的機率模型(在圖4中)。獨立地,來自該所獲得的並置CTU、分割深度或CTU維度或兩者的語法元素、或來自該所獲得的並置CU的任何其他語法元素可用於選擇用於發信號分割比決策的機率模型(在圖5至圖9中)。In another embodiment, the choice of the binary probabilistic model for encoding the binary decision is based on the assumption that compared to a corresponding partition tree of a so-called collocated CTU in a decoded picture, A partition tree for a specific CTU in an image is similarly structured. Without loss of generality, a collocated CTU may be defined as when a CTU in a given reference picture is accessed using the coordinates derived from the position and size of the current CTU (eg, the center position of the CTU). CTU obtained at the time. From the obtained collocated CTU, the probabilistic model for signaling the partitioning decision can be selected using the partitioning depth or CTU dimension or both, or any other syntax element of the collocated CU (in Figure 4). Independently, syntax elements from the obtained collocated CTU, split depth or CTU dimension, or both, or any other syntax elements from the obtained collocated CU can be used to select a probabilistic model for signaling split ratio decisions ( in Figures 5 to 9).
在另一實施例中,來自該所獲得的並置CTU、分割深度或CTU維度或兩者的語法元素或任何其他語法元素可用於在沒有附加信令的情況下推斷一個或所有二進制分割決策(在圖4中)。獨立地,來自該所獲得的並置CTU、分割深度或CTU維度或兩者的語法元素、或來自該所獲得的並置CU的任何其他語法元素可用於推斷一個、任何或所有分割比決策(在圖5至圖9中)。In another embodiment, syntax elements or any other syntax elements from the obtained collocated CTUs, split depth or CTU dimensions, or both, can be used to infer one or all binary split decisions without additional signaling (in Figure 4). Independently, syntax elements from the obtained collocated CTU, split depth or CTU dimension, or both, or any other syntax elements from the obtained collocated CU can be used to infer one, any, or all split ratio decisions (in FIG. 5 to Figure 9).
通常,該分割決策取決於分割的該可用性。由於若干狀態相關原因,一分割可能無法使用。例如,在(1)中定義的該特定實施例中,對於寬度和高度小於32的所有區塊,對於該尺寸,可以使用一垂直3/8分割。
對於該相同的特定實施例的另一個分割範例是該表
諸如SplitRatioDiv4Available、SplitRatioDiv8Available、IsSplitRatioDiv4OffsetCoded、IsSplitRatioDiv8OffsetCoded之類的該分割決策變量的該值受制於之前舉例說明的該可用性限制,特別是該其他高級別語法元素,例如最小區塊大小和最大樹深度,在本文提出的描述中給出。The values of the split decision variables such as SplitRatioDiv4Available, SplitRatioDiv8Available, IsSplitRatioDiv4OffsetCoded, IsSplitRatioDiv8OffsetCoded are subject to the availability constraints exemplified previously, in particular the other high-level syntax elements, such as minimum block size and maximum tree depth, proposed in this paper given in the description.
編碼器操作Encoder operation
在一典型的現代視頻編碼器中,多種編碼模式之間的該決定係基於一拉格朗日函數J=D+λ⋅R的一最小化,其中對於一給定模式,D是該原始區塊和重構區塊之間的一失真度量(例如,該平方和差異(SSD、Sum of Squared Differences)),R表示在該給定模式(包括用於分割的位元、諸如幀內預測模式或運動參數的輔助信息、以及該變換係數的量化索引)下發送區塊所需的位元數(或其估計值)。這種拉格朗日方法也可用於決定不同的分割模式。為了獲得最佳決策,使用一深度優先方法進行編碼是很重要。這意味著為了計算一某個分割模式的該速率-失真成本J,必須考慮每個子區塊(包括進一步分割)的該最佳速率失真成本。這可以藉由使用一深度優先方法來確保。針對一某種分割模式的該成本計算如下。首先決定該第一子區塊的該成本。此時,決定包括所有可能的分割模式的該第一子區塊的該最佳編碼模式(在速率-失真意義上)。給定該第一子區塊的該最佳編碼模式,決定該第二子區塊的該最佳編碼模式(同樣,必須考慮潛在的分割)。一分割模式的該速率-失真成本J是子區塊的該速率-失真成本的該總和。這個概念可以使用一遞歸函數實現,類似於以下(簡化)虛擬代碼:
請注意,一編碼器不需要評估語法中支持的所有編碼選項。為了降低編碼器複雜度,僅測試該最可能的分割模式並跳過對分割不太可能的模式的評估通常是有益的。最值得注意的是,該第一次非默認分割後一樹的該最大深度是一個非常重要的參數,用於平衡該預期的rd性能和運行時間。一允許非默認分割的該最大區塊大小可用於限制對具有大區塊的分割的該測試,此時更小的區塊更可能(例如,對於內部切片)。此外,在一編碼器中測試的該最大寬高比可以小於語法支持的最大寬高比(相應地,測試的該最小寬高比可以大於語法支持的該最小寬高比)。Note that an encoder does not need to evaluate all encoding options supported in the grammar. To reduce encoder complexity, it is often beneficial to test only that most likely segmentation mode and skip the evaluation of modes that are less likely to segment. Most notably, the maximum depth of the tree after the first non-default split is a very important parameter to balance the expected rd performance and run time. A maximum block size that allows non-default partitions can be used to limit the test to partitions with large blocks, when smaller blocks are more likely (eg, for internal slices). Furthermore, the maximum aspect ratio tested in an encoder may be smaller than the maximum aspect ratio supported by the syntax (correspondingly, the minimum aspect ratio tested may be larger than the minimum aspect ratio supported by the syntax).
除了冗餘的該縮減之外,可以結合不改變信令的其他啟發式規則以加速分割決策過程。例如,在該rd搜索期間,可以排除沿一個方向的一完整分割集合,如果該相應的對稱分割與垂直方向上的該對稱分割相比沒有改善。這尤其意味著在嘗試兩個對稱分割之後一區塊不會進一步分割,並且不會導致一個rd成本小於用於編碼區塊而沒有任何分割的rd成本。該語法越支持不對稱的分割,啟發式規則越多,加速編碼過程。可以對所得到的分割方案的寬高比設置另一個約束(如果將其實現為僅編碼器優化,則這將對信令沒有影響)。In addition to this reduction of redundancy, other heuristic rules that do not change the signaling can be combined to speed up the partitioning decision process. For example, during the rd search, a complete set of segmentations along one direction may be excluded if the corresponding symmetric segmentation does not improve compared to the symmetric segmentation in the vertical direction. This means in particular that a block will not be split further after trying two symmetric splits, and will not result in an rd cost less than the rd cost for encoding the block without any splits. The more the grammar supports asymmetric segmentation, the more heuristic rules it has, speeding up the encoding process. Another constraint can be placed on the aspect ratio of the resulting segmentation scheme (this will have no impact on signaling if it is implemented as an encoder-only optimization).
主要觀點Main point
從該上述原理開始,本揭露有五個主要觀點。Starting from this above principle, there are five main points of this disclosure.
根據一第一觀點,該解碼器10(參見圖14)被配置為將該資料流14的該圖片12分割為區塊18。這裡,執行一遞歸雙分割。使用分割信息控制該分割。對於該分割,設置一第一分割線16s的一第一分割線方向。沿著該第一分割線16s1,一預定子區塊16a,這裡是該圖片區塊16的左上四分之一,藉由該遞歸雙分割分成一對兒子子區塊編碼單元1和編碼單元2。這些子區塊編碼單元1和編碼單元2形成後續的分割級別3,而該子區塊16a由分割級別1和2形成,假設級別0被分配給區塊16/18。According to a first aspect, the decoder 10 (see Figure 14) is configured to partition the picture 12 of the data stream 14 into blocks 18. Here, a recursive double split is performed. Use segmentation information to control this segmentation. For this division, a first dividing line direction of a first dividing line 16s is set. Along the first division line 16s1, a predetermined sub-block 16a, here the upper left quarter of the picture block 16, is divided into a pair of sub-sub-block coding unit 1 and coding unit 2 by the recursive double division. . These sub-block coding unit 1 and coding unit 2 form the subsequent partitioning level 3, and the sub-block 16a is formed by partitioning levels 1 and 2, assuming that level 0 is assigned to the block 16/18.
該分割線16s的該設置是根據一第二分割線16s2的一第二分割線方向來執行的,沿著該第二分割線16s2將該圖片區塊16的該先前分割等級1的一祖父子區塊分割成該預定的子區塊並且在另一個子區塊中。The setting of the dividing line 16s is performed according to a second dividing line direction of a second dividing line 16s2 along which a grandchild of the previous dividing level 1 of the picture block 16 is The block is divided into the predetermined sub-block and within another sub-block.
這裡,該祖父子區塊指的是圖片區塊16/18的一左半部分。然而,在該級別0的不同地設置情況下,該祖父子區塊也可以被理解為該整個圖片區塊16或18本身,因為必須考慮與前一個或後一個分割級別(參見圖2)的該關係。Here, the grandparent block refers to the left half of picture block 16/18. However, in the case of a different setting of level 0, the grandparent sub-block can also be understood as the entire picture block 16 or 18 itself, since the relationship with the previous or subsequent segmentation level (see Figure 2) must be taken into account the relationship.
根據一第二觀點的另一實施例,其提供了一種用於從該資料流14解碼該圖片12的一解碼器,該解碼器被配置為藉由該遞歸雙分割在解碼區塊16中執行圖片12的圖片區塊18(參見圖1)的該分割。這藉由使用該資料流14中的一分割信息來控制,使得一預定子區塊,例如,16a或對應於圖2中的任何節點的另一區塊(即,區塊18本身或其部分)被分割,考慮到: - 是否要分割該預定子區塊(例如,16a)或者使其保持未分割,和/或 - 一分割線的一分割線方向(例如,一水平或垂直分割線方向)和/或 - 一分流比率。According to another embodiment of a second aspect, there is provided a decoder for decoding the picture 12 from the data stream 14, the decoder being configured to perform in the decoding block 16 by the recursive double partitioning This partitioning of picture blocks 18 (see Figure 1) of picture 12. This is controlled by using a segmentation information in the data stream 14 such that a predetermined sub-block, e.g., 16a or another block corresponding to any node in Figure 2 (i.e., block 18 itself or a portion thereof ) is split, taking into account: - Whether the predetermined sub-block (e.g., 16a) is to be split or left unsplit, and/or - a dividing line direction of a dividing line (e.g. a horizontal or vertical dividing line direction) and/or - One diversion ratio.
根據一第三觀點,該解碼器10藉由該控制分割的一個或多個語法元素的上下文自適應熵解碼來執行圖片分割。這裡,該資料流14的一上下文被使用。應注意,該上下文可以例如取決於一個或多個相鄰編碼區塊的一大小。According to a third aspect, the decoder 10 performs picture segmentation by context-adaptive entropy decoding of one or more syntax elements that control segmentation. Here, a context of the data stream 14 is used. It should be noted that the context may, for example, depend on a size of one or more adjacent coding blocks.
根據一第四觀點,該解碼器10可以被配置為以該解碼器10可以切換的至少兩種不同模式執行該分割。這兩種模式彼此不同,例如,可能有以下目的: - 必須適合每個編碼區塊的最小區塊大小, - 最大分割樹深度, - 在一當前圖片區塊的一當前子區塊的一分割之後的最大分割樹深度,其中該分割沿著一分割線,其係垂直於一父親區塊的一分割線, - 允許非對稱分割的一當前圖片的一子區塊的一最大區塊大小, - 由一當前圖片區塊的一當前子區塊的一分割產生的一兒子子區塊的最大/最小寬高比, - 等等。According to a fourth perspective, the decoder 10 can be configured to perform the segmentation in at least two different modes that the decoder 10 can switch. The two modes differ from each other and may, for example, serve the following purposes: - The minimum block size that must fit into each encoded block, - Maximum split tree depth, - the maximum split tree depth after a split of a current sub-block of a current picture block, where the split is along a split line that is perpendicular to a split line of a parent block, - a maximum block size of a sub-block of a current picture that allows asymmetric partitioning, - the maximum/minimum aspect ratio of a sub-block resulting from a division of a current sub-block of a current picture block, - etc.
根據一第五觀點,該解碼器10可以執行該分割。這裡,該解碼器10被配置為藉由根據一個或多個規則去除分割比來減少分割比的一基本列表(參見圖5和6的附圖標記30),以便獲得分割比的一縮減列表32。According to a fifth perspective, the decoder 10 can perform the segmentation. Here, the decoder 10 is configured to reduce a basic list of split ratios (see reference numeral 30 in Figures 5 and 6) by removing split ratios according to one or more rules, in order to obtain a reduced list of split ratios 32 .
該基本列表30對應於橋型的一個二叉樹34樹葉42、37,其與該基本列表30的該分割比之一相關聯。該縮減列表32對應於藉由從樹葉42、37到主根節點44的移除而由該二叉樹34所得的一縮減二叉樹50。該二叉樹34的每個節點40、38具有屬於該縮減列表32的子節點。之後,以代替僅具有一個未移除的子節點的該二叉樹34的每個節點,使得該未移除的子節點直接附加到該二叉樹34的該節點,其相應中間節點係該節點的子節點。The base list 30 corresponds to the leaves 42 , 37 of a binary tree 34 of the bridge type, which are associated with one of the split ratios of the base list 30 . The reduced list 32 corresponds to a reduced binary tree 50 obtained from the binary tree 34 by removing leaves 42, 37 to the primary root node 44. Each node 40 , 38 of the binary tree 34 has a child node belonging to the reduced list 32 . Then, instead of each node of the binary tree 34 having only one unremoved child node, the unremoved child node is directly attached to the node of the binary tree 34 and its corresponding intermediate node is a child node of the node. .
該縮減二叉樹50的該左邊(例如,該第一個)分支(在圖5和6中示例性地分配為“0”)與一第一個二元決策(bin)值相關聯,而該右邊(該第二個)分支(在圖5和6中示例性地分配為“1”)與一第二個二元決策(bin)值相關聯。該縮減列表32的每個分割比與一個bin值序列相關聯的,其對應於與該分支相關聯的一個二元決策(bin)值的序列,該分支在該縮減二叉樹50中從該縮減二叉樹50的一主根節點52導向與相應的分割比相關聯的一樹葉54。之後,執行與一個或多個bin值的一序列對應的一個bin字串的一個熵編碼。The left (eg, the first) branch of the reduced binary tree 50 (exemplarily assigned "0" in Figures 5 and 6) is associated with a first binary decision (bin) value, while the right The (second) branch (exemplarily assigned "1" in Figures 5 and 6) is associated with a second binary decision (bin) value. Each split ratio of the reduced list 32 is associated with a sequence of bin values, which corresponds to a sequence of binary decision (bin) values associated with the branch in the reduced binary tree 50 from the reduced binary tree. A primary root node 52 of 50 leads to a leaf 54 associated with a corresponding split ratio. Afterwards, an entropy encoding of a bin string corresponding to a sequence of one or more bin values is performed.
儘管在上述觀點內,該方法主要在一解碼器或一解碼方法的上下文中討論,但應注意,該原理對於一編碼器和一編碼方法也是有效的。Although within the above point of view the method is mainly discussed in the context of a decoder or a decoding method, it should be noted that the principle is also valid for an encoder and an encoding method.
其他觀點other views
用於將區塊劃分為編碼單元、預測單元、變換單元等的該通用二進制分割框架可以影響一視頻編解碼器的其他部分。以下描述了這些觀點中的一些。The general binary partitioning framework for partitioning blocks into coding units, prediction units, transform units, etc. can affect other parts of a video codec. Some of these perspectives are described below.
1.1. 變換編碼的適應性Transform coding adaptability
所描述的具有廣義二進制分割的分區通常導致區塊寬度和區塊高度表示不是為2的整數冪。在最先進的視頻編解碼器(HEVC (文獻[1])或JEM (文獻[3]))中,這樣的變換大小是不支持。因此,需要對該變換編碼進行一些修改。需要修改/擴展該變換係數級別(量化索引)的變換以及熵編碼。The described partitioning with generalized binary partitioning often results in block width and block height representations that are not integer powers of two. In state-of-the-art video codecs (HEVC (Reference [1]) or JEM (Reference [3])), such transform sizes are not supported. Therefore, some modifications to this transform coding are required. The transform at the transform coefficient level (quantization index) and the entropy coding need to be modified/extended.
雖然最先進的視頻編解碼器通常僅指定2的次冪的變換大小,但是該通用框架要求指定額外的變換大小。While state-of-the-art video codecs typically specify only power-of-2 transform sizes, this general framework requires that additional transform sizes be specified.
另一觀點涉及在一變換區塊中的該最後非零變換係數的一編碼。在HEVC中,藉由發送該最後的非零變換係數的該x坐標和該y坐標來指示該最後的非零變換係數的該位置。該相應的熵代碼被設計,以針對對於寬度和高度均表示2的整數冪的區塊。該下表係摘自ITU-T H.265|ISO / IEC 23008-2建議書;粗體標記部分指定語法元素last_sig_coeff_x_prefix、last_sig_coeff_y_prefix、last_sig_coeff_x_suffix、last_sig_coeff_y_suffix的二值化處理,其指定在一變換區塊中的該最後非零變換係數的該位置。
在本揭露的一特定實施例中,語法元素last_sig_coeff_x_prefix、last_sig_coeff_y_prefix、last_sig_coeff_x_suffix、last_sig_coeff_y_suffix的該二值化被修改如下:
版本1。
TrafoSize的該二值化代碼等於一個2的整數冪不會改變。請注意,版本1包括冗餘(某些代碼的不必要的二元決策(bin)),而版本2的該代字碼表不包括冗餘的二元決策(bin)。The binarization code of TrafoSize is equal to an integer power of 2 and does not change. Note that version 1 includes redundancy (unnecessary binary decisions (bins) for some codes), while version 2 of this code table does not include redundant binary decisions (bins).
2.2. 變換用於幀內預測模式的運動搜索Transform motion search for intra prediction mode // 評估evaluate
與前一節一致,該新的分割結構需要各種新的變換,其中Hadamard變換矩陣用於預測殘差。通常,該Hadamard變換被用作一DCT的非常簡單的一近似。在典型的編碼演算法中,絕對Hadamard係數之該和例如用作該子樣本運動搜索中的速率-失真度量或幀內預測模式的該預選擇。Consistent with the previous section, this new segmentation structure requires various new transformations, among which the Hadamard transformation matrix is used to predict the residuals. Typically, the Hadamard transform is used as a very simple approximation of a DCT. In typical coding algorithms, the sum of absolute Hadamard coefficients is used, for example, as a rate-distortion metric in the subsample motion search or the preselection of intra prediction modes.
對於具有可用分割比{1/2, 1/4, 3/4, 3/8, 5/8, 1/3, 2/3, 1/5, 4/5, 2/5, 3/5 }的該特定實施例,如果該最大CTU大小為128,則出現該新的亮度區塊尺寸96、80、48、40、24、20和12。該相應的Hadamard矩陣並非都是明確構造的。事實上,使用Paley的有限場域構造,構造大小為20和12的Hadamard矩陣就足夠了。其他尺寸由Kronecker產品構建,因為Hadamard矩陣的Kronecker產品會再次是Hadamard矩陣。藉由Kronecker產品構造其他矩陣的該優點在於,不必完整構造一完全的大尺寸Hadamard矩陣。例如,代替應用一個80x80的Hadamard矩陣,對於各個子區塊使用一個已知的4x4 Hadamard矩陣就足夠了。對於該最後一部分,子區塊的該總和是相對於該20x20 Hadamard矩陣中給出的正確符號完成的。所有其他尺寸都可以使用該新的20x20或12x12 Hadamard變換以一相同的方式構建。For those with available split ratios {1/2, 1/4, 3/4, 3/8, 5/8, 1/3, 2/3, 1/5, 4/5, 2/5, 3/5} For this particular example, if the maximum CTU size is 128, the new luma block sizes 96, 80, 48, 40, 24, 20, and 12 appear. The corresponding Hadamard matrix is not always explicitly constructed. In fact, using Paley's finite field construction, it is sufficient to construct Hadamard matrices of sizes 20 and 12. Other sizes are constructed from Kronecker products, as the Kronecker products for Hadamard matrices will again be Hadamard matrices. The advantage of constructing other matrices with Kronecker products is that it is not necessary to completely construct a complete large-size Hadamard matrix. For example, instead of applying an 80x80 Hadamard matrix, it is sufficient to use a known 4x4 Hadamard matrix for each sub-block. For this last part, the summation of the sub-blocks is done with respect to the correct sign given in the 20x20 Hadamard matrix. All other sizes can be constructed in the same way using the new 20x20 or 12x12 Hadamard transform.
3.3. 合併候選者的推導Derivation of merge candidates
由於更複雜的區塊分割(與現有技術的分割方法相比),一特定區塊(分割樹的樹葉)的鄰居的該數量和拓撲可以不同。相鄰區塊的編碼參數例如被用於導出合併候選者、運動向量預測候選者或最可能的幀內預測模式。結合該廣義分割框架,對針對在該相鄰區塊中選擇候選者的該現有技術策略的一調整(參見HEVC)可以導致一改進的編碼效率。該最先進的策略通常隱含地假設區塊具有一正方形形狀。但是藉由該廣義分割概念,該區塊寬度可以比該區塊高度大得多,反之亦然。在那種情況下,沿著該長區塊邊緣而不是沿著該短區塊邊緣考慮更多候選區塊可能是較佳的。這可以包括但不限於:沿著一區塊的該邊緣掃描所有鄰居(例如,找到從該相鄰曲塊導出的一度量的一極值或一均值);定義附加的相鄰錨點(例如,在掃描合併候選者的該情況下,在一區塊的該左邊邊緣和上邊邊緣的該中間添加錨點)。Due to the more complex block partitioning (compared to prior art partitioning methods), the number and topology of the neighbors of a particular block (the leaves of the partitioning tree) can differ. Coding parameters of neighboring blocks are used, for example, to derive merging candidates, motion vector prediction candidates, or most likely intra prediction modes. Combined with the generalized partitioning framework, an adjustment to the prior art strategy for selecting candidates in the adjacent blocks (see HEVC) can lead to an improved coding efficiency. This state-of-the-art strategy usually implicitly assumes that blocks have a square shape. But with this generalized partitioning concept, the block width can be much larger than the block height, and vice versa. In that case, it may be better to consider more candidate blocks along the long block edge rather than along the short block edge. This may include, but is not limited to: scanning all neighbors along the edge of a patch (e.g., finding an extremum or a mean of a metric derived from the adjacent patch); defining additional neighbor anchors (e.g., finding an extremum or a mean of a metric derived from the adjacent patch); , in the case of scanning merge candidates, add an anchor point in the middle of the left edge and the upper edge of a block).
圖16係顯示用於將由一圖片序列120組成的一視頻110預測編碼成一資料流140的一裝置。為此,使用逐塊預測編碼。此外,示例性地使用基於變換的殘差編碼。使用參考標記100指示該裝置或編碼器。圖16係顯示一相應的解碼器200,即,被配置為預測性地解碼由來自該資料流140的圖片區塊中的圖片120’所組成的該視頻110’的一裝置200,這裡也是示例性地使用基於變換的殘差解碼,其中撇號已被用於指示分別由解碼器200重建的圖片120’和視頻110’,在由該預測殘差信號的一量化引入的編碼損失方面,其偏離最初由裝置100編碼的圖片120。圖16和圖17示例性地使用基於變換的預測殘差編碼,但是本申請的實施例不限於這種預測殘差編碼。對於關於圖16和17描述的其他細節也是如此,這將在下文中概述。Figure 16 shows an apparatus for predictively encoding a video 110 consisting of a sequence of pictures 120 into a data stream 140. For this purpose, block-by-block predictive coding is used. Furthermore, transform-based residual coding is exemplarily used. This device or encoder is indicated using reference numeral 100 . Figure 16 shows a corresponding decoder 200, ie, a device 200 configured to predictively decode the video 110' consisting of pictures 120' in picture blocks from the data stream 140, again as an example. transform-based residual decoding, where apostrophes have been used to indicate the picture 120' and video 110' respectively reconstructed by the decoder 200, in terms of the coding loss introduced by a quantization of the prediction residual signal, which Deviating from the picture 120 originally encoded by the device 100. 16 and 17 exemplarily use transform-based prediction residual coding, but embodiments of the present application are not limited to such prediction residual coding. The same is true for other details described with respect to Figures 16 and 17, which will be outlined below.
該編碼器100被配置為對該預測殘差信號進行空間到頻譜變換,並將如此獲得的該預測殘差信號編碼到該資料流140中。同樣地,該解碼器200被配置為對來自該資料流14的該預測殘差信號進行解碼,並對如此獲得的該預測殘差信號進行頻譜-空間變換。The encoder 100 is configured to perform a spatial to spectral transformation on the prediction residual signal, and encode the prediction residual signal thus obtained into the data stream 140 . Likewise, the decoder 200 is configured to decode the prediction residual signal from the data stream 14 and to perform spectral-spatial transformation on the prediction residual signal so obtained.
在內部,該編碼器100可以包括一預測殘差信號形成器220,其產生一預測殘差240,以便測量一預測信號260與該原始信號(即視頻110或一當前圖片120)的一偏差。該預測殘差信號形成器220例如可以是一減法器,其從該原始信號(即當前圖片120)中減去該預測信號。該編碼器100然後更包括一變換器280,其使該預測殘差信號240經歷一空間到頻譜變換,以獲得一頻譜域預測殘差信號240’,其然後由一量化器320進行量化,該編碼器100也包括該量化器320。如此該量化的預測殘差信號240’’被編碼到位元流140中。至此,編碼器100可以可選地包括一熵編碼器340,其對經過變換和量化的該預測殘差信號進行熵編碼而至資料流140。該預測殘差260由編碼器100的一預測級360基於被解碼至資料流140並且可從資料流140解碼的預測殘差信號240’’來生成。為此,如圖16所示,該預測級360可以在其內部包括一去量化器380,去量化器380對預測殘差信號240’’進行去量化,以便獲得對應於信號240’的頻譜域預測殘差信號240’’’,該頻譜域預測殘差信號240’’’除了量化損失之外,接著是一逆變換器400,其使後面的預測殘差信號240’’’經歷一逆變換,即一頻譜到空間變換,以獲得預測殘差信號240’’’’,其中,除了量化損失之外,其對應於該原始預測殘差信號240。然後,該預測級360的一組合器420重新組合,例如藉由相加該預測信號260和該預測殘差信號240’’’’,以便獲得一重建信號460,即該原始信號120的一重建。重建信號46可以對應於信號120’。Internally, the encoder 100 may include a prediction residual signal former 220 that generates a prediction residual 240 to measure a deviation of a prediction signal 260 from the original signal (ie, video 110 or a current picture 120). The prediction residual signal former 220 may be, for example, a subtractor that subtracts the prediction signal from the original signal (ie, the current picture 120). The encoder 100 then further includes a transformer 280 that subjects the prediction residual signal 240 to a spatial to spectral transformation to obtain a spectral domain prediction residual signal 240', which is then quantized by a quantizer 320. Encoder 100 also includes this quantizer 320. The quantized prediction residual signal 240 ″ is thus encoded in the bit stream 140 . At this point, the encoder 100 may optionally include an entropy encoder 340 that performs entropy encoding on the transformed and quantized prediction residual signal to the data stream 140 . The prediction residual 260 is generated by a prediction stage 360 of the encoder 100 based on the prediction residual signal 240 ″ that is decoded to and decodable from the data stream 140 . To this end, as shown in FIG. 16 , the prediction stage 360 may include a dequantizer 380 inside it. The dequantizer 380 dequantizes the prediction residual signal 240 ″ to obtain the spectral domain corresponding to the signal 240 ′. Prediction residual signal 240'''', which in addition to quantization loss is followed by an inverse transformer 400, which subjects the subsequent prediction residual signal 240'''' to an inverse transform , that is, a spectral to spatial transformation to obtain the prediction residual signal 240'''', which corresponds to the original prediction residual signal 240 except for the quantization loss. A combiner 420 of the prediction stage 360 then recombines, such as by adding the prediction signal 260 and the prediction residual signal 240 '''', to obtain a reconstructed signal 460 , ie, a reconstruction of the original signal 120 . Reconstructed signal 46 may correspond to signal 120'.
然後,預測級360的一預測模塊440藉由使用例如空間預測,即幀內預測和/或時間預測(即幀間預測),基於信號460生成該預測信號260。以下描述這方面的細節。A prediction module 440 of the prediction stage 360 then generates the prediction signal 260 based on the signal 460 using, for example, spatial prediction, ie, intra prediction, and/or temporal prediction, ie, inter prediction. Details in this regard are described below.
同樣地,解碼器200可以在其內部由對應於預測級360並且以對應於預測級360的一方式互連的組件組成。具體地,解碼器200的熵解碼器500可以對來自資料流的該量化的頻譜域預測殘差信號240’’進行熵解碼,因此,去量化器520、逆變換器540、組合器560和預測模塊580以上述關於預測級360的模塊的方式互連和協作,基於預測殘差信號240’’以恢復該重建信號,使得,如圖17所示,組合器560的該輸出產生該重建信號,即該視頻110’或其一當前圖片120’。Likewise, decoder 200 may be composed internally of components that correspond to prediction level 360 and are interconnected in a manner corresponding to prediction level 360 . Specifically, the entropy decoder 500 of the decoder 200 may perform entropy decoding on the quantized spectral domain prediction residual signal 240'' from the data stream. Therefore, the dequantizer 520, the inverse transformer 540, the combiner 560 and the prediction Module 580 is interconnected and cooperates in the manner described above with respect to the modules of prediction stage 360 to recover the reconstructed signal based on prediction residual signal 240 ″ such that, as shown in FIG. 17 , the output of combiner 560 produces the reconstructed signal, That is, the video 110' or one of the current pictures 120'.
雖然上面沒有具體描述,但是很容易清楚的是,該編碼器100可以根據一些優化方案設置一些編碼參數,包括例如預測模式、運動參數等,該優化方案例如以優化某些速率和失真的一方式之相關準則,即編碼成本,和/或使用一些速率控制。如下面更詳細描述的,編碼器100和解碼器200以及相應的模塊440、580分別支持不同的預測模式,例如幀內編碼模式和幀間編碼模式,其形成一種原始預測模式的集合或池,基於該原始預測模式,圖片區塊的預測以下面更詳細描述的方式組成。編碼器和解碼器在這些預測合成之間切換的該粒度可以分別對應於將圖片120和120’分為區塊的一細分。注意,這些區塊中的一些可以是僅被幀內編碼的區塊,並且一些區塊可以是僅被幀間編碼的區塊,並且可選地,甚至另外的區塊可以是使用幀內編碼和幀間編碼兩者獲得的區塊,但是細節被設置在下文中。根據幀內編碼模式,基於該相應區塊的一空間已編碼/解碼鄰域以獲得一區塊的一預測信號。可以存在多個幀內編碼子模式,在其中,類似於,表示一種幀內預測參數。可以存在定向或角度幀內編碼子模式,根據該幀內編碼子模式,藉由特定於該對應定向幀內編碼子模式的一特定方向推斷該鄰域的該樣本值,將該相應區塊的該預測信號被填充到該相應區塊中。例如,該幀內編碼子模式還可以包括一個或多個其他子模式,一例如DC編碼模式,根據該子模式,該相應區塊的該預測信號將一DC值分配給該相應區塊內的所有樣本,和/或一平面幀內編碼模式,根據該平面幀內編碼模式,該相應區塊的該預測信號被近似或決定為由該相應區塊的該樣本位置上的一個二維線性函數描述的一樣本值的空間分佈,其具有在該相鄰樣本的基礎上導出由該二維線性函數定義的該平面的傾斜和偏移。與此相比,根據幀間預測模式,可以例如藉由在時間上預測該區塊內部來獲得一區塊的一預測信號。對於一幀間預測模式的參數化,可以在該資料流內用信號通知運動向量,該運動向量指示該視頻110的一先前編碼圖片的該部分的該空間位移,在該部分處該對先前編碼/解碼的圖片進行採樣,以便獲得該相應區塊的該預測信號。這意味著,除了由資料流140包括的該殘留信號編碼之外,諸如表示該量化的頻譜域預測殘差信號240’’的該熵編碼的變換係數級別,資料流140可以在其中編碼用於分配區塊預測模式的預測相關參數、該分配的預測模式的預測參數(例如幀間預測模式的運動參數)、並且可選地使用該所分配的預測模式和預測參數來控制用於該區塊的該最終預測信號的一合成的其他參數,將在下面更詳細地概述。另外,該資料流可以包括分別控制和發信號通知圖片120和120’細分成區塊的參數。該解碼器200使用這些參數以與該編碼器相同的方式細分該圖片,以將相同的預測模式和參數分配給區塊,並執行該相同的預測以產生該相同的預測信號。Although not described in detail above, it is easily clear that the encoder 100 can set some encoding parameters, including, for example, prediction modes, motion parameters, etc. according to some optimization schemes, such as in a way to optimize certain rates and distortions. related criteria, i.e. encoding cost, and/or use some rate control. As described in more detail below, the encoder 100 and decoder 200 and corresponding modules 440, 580 respectively support different prediction modes, such as intra-coding modes and inter-coding modes, which form a kind of set or pool of original prediction modes, Based on this original prediction mode, predictions for picture blocks are composed in a manner described in more detail below. The granularity at which the encoder and decoder switch between these predictive synthesis may correspond to a subdivision of pictures 120 and 120' respectively into blocks. Note that some of these blocks may be intra-coded blocks only, and some blocks may be inter-coded blocks only, and optionally even additional blocks may be intra-coded using and inter-coding both obtained blocks, but details are set below. According to the intra coding mode, a prediction signal of a block is obtained based on a spatial coded/decoded neighborhood of the corresponding block. There may be multiple intra coding sub-modes, in which like , represents an intra prediction parameter. There may be a directional or angular intra-coding sub-mode, according to which the sample value of the neighborhood is inferred by a specific direction specific to the corresponding directional intra-coding sub-mode, and the corresponding block's The prediction signal is filled into the corresponding block. For example, the intra coding sub-mode may also include one or more other sub-modes, such as a DC coding mode. According to the sub-mode, the prediction signal of the corresponding block assigns a DC value to the corresponding block. All samples, and/or a plane intra coding mode, according to the plane intra coding mode, the prediction signal of the corresponding block is approximated or determined as a two-dimensional linear function on the sample position of the corresponding block Describes the spatial distribution of sample values with the tilt and offset of the plane defined by the two-dimensional linear function derived on the basis of the adjacent samples. In contrast, according to the inter prediction mode, a prediction signal of a block can be obtained, for example, by temporally predicting the interior of the block. For parameterization of an inter prediction mode, a motion vector may be signaled within the data stream that indicates the spatial displacement of the portion of a previously encoded picture of the video 110 where the pair of previously encoded /The decoded picture is sampled in order to obtain the prediction signal of the corresponding block. This means that, in addition to the residual signal encoding included by the data stream 140 , the data stream 140 may encode therein, such as the entropy-coded transform coefficient level representing the quantized spectral domain prediction residual signal 240 ″, for Allocating prediction-related parameters for a block prediction mode, prediction parameters for the assigned prediction mode (eg, motion parameters for inter prediction mode), and optionally using the assigned prediction mode and prediction parameters to control the block for the block Other parameters of a synthesis of the final prediction signal will be outlined in more detail below. Additionally, the data stream may include parameters that control and signal the subdivision of pictures 120 and 120' into blocks, respectively. The decoder 200 uses these parameters to subdivide the picture in the same way as the encoder, to assign the same prediction modes and parameters to the blocks, and to perform the same prediction to produce the same prediction signal.
圖18係顯示在一方面的重建信號(即重建圖片120’)與在另一方面的該資料流中用信號通知的該預測殘差信號240’’’’和該預測信號260的該組合之間的關係。如上所述,該組合可以是一加法。該預測信號260在圖18中係顯示為該圖片區域的一細分為不同大小的區塊800,儘管這僅是一範例。該細分可以是任何細分,例如將該圖片區域規則的細分為區塊的列和行,或者將圖片120的一多樹細分俾成為不同大小的樹葉區塊,例如一四叉樹細分等,其中一混合在圖18中被顯示,其中該圖片區域首先被細分為樹根區塊的列和行,然後根據一遞歸的多樹細分進一步細分,以產生區塊800。Figure 18 shows the combination of the reconstructed signal (ie reconstructed picture 120') on the one hand and the prediction residual signal 240'''' and the prediction signal 260 signaled in the data stream on the other hand. relationship between. As mentioned above, the combination can be an addition. The prediction signal 260 is shown in FIG. 18 as a subdivision of the picture area into blocks 800 of different sizes, although this is only an example. The subdivision can be any subdivision, such as a regular subdivision of the picture area into columns and rows of blocks, or a multi-tree subdivision of the picture 120 into leaf blocks of different sizes, such as a quadtree subdivision, etc., where A blend is shown in Figure 18, where the picture area is first subdivided into columns and rows of tree root blocks and then further subdivided according to a recursive multi-tree subdivision to produce block 800.
圖18中的該預測殘差信號240’’’’也被顯示為該圖片區域細分為區塊840。這些區塊可以被稱為變換區塊,以便將其與該編碼區塊800區分開。實際上,圖18示出了編碼器100和解碼器200可以分別使用圖片120和圖片120’的兩個不同細分,以分成區塊,即,一個細分為編碼區塊800,另一個細分為區塊840。兩個細分可以是相同的,即每個區塊80可以同時形成變換區塊840,反之亦然,但是圖18係顯示例如細分的情況,一細分為變換區塊840形成該細分到區塊800的一擴展,使得兩個區塊800之間的任何邊界覆蓋兩個區塊840之間的一邊界,或者可另外地說,每個區塊800或者與變換區塊840中的一個重合或者與變換區塊840的一個集群重合。然而,也可以彼此獨立地決定或選擇細分,使得變換區塊840可以替代地跨越區塊800之間的塊邊界。就該細分為變換區塊840而言,類似的陳述因此與關於該細分為區塊800的那些相似,即該區塊840可以是將圖片區域規則細分為區塊的該結果,以列和行排列,該圖片區域的遞歸多樹細分的該結果、或其組合或任何其他種類的分割。另外,應注意,區塊800和840不限於正方形、矩形或任何其他形狀。此外,將一當前圖片120細分為形成該預測信號的區塊800,以及將一當前圖片120細分為該編碼預測殘差的區塊840,可能不是用於編碼/解碼的唯一細分。這些細分來自執行預測信號決定和殘差編碼的一粒度,但是首先,該殘差編碼可以替代地在沒有細分的情況下完成,其次,在除了這些細分之外的其他粒度,編碼器和解碼器可以設置某些編碼參數,其中可能包括一些上述參數,例如預測參數、預測信號組成控制信號等。The prediction residual signal 240'''' in FIG. 18 is also shown as subdividing the picture area into blocks 840. These blocks may be referred to as transform blocks to distinguish them from the encoding block 800. In fact, Figure 18 shows that the encoder 100 and the decoder 200 can use two different subdivisions of the picture 120 and the picture 120', respectively, into blocks, i.e. one subdivision into encoded blocks 800 and the other into regions. Block 840. The two subdivisions may be identical, i.e. each block 80 may simultaneously form a transform block 840 and vice versa, but Figure 18 shows for example the case where one subdivision into transform block 840 forms the subdivision into block 800 An extension of such that any boundary between two blocks 800 covers a boundary between two blocks 840, or alternatively, each block 800 either coincides with one of the transform blocks 840 or with One cluster of transform blocks 840 coincides. However, the subdivisions may also be determined or selected independently of each other, such that transform block 840 may instead span block boundaries between blocks 800. With respect to the subdivision into transform blocks 840, similar statements are thus made to those with respect to the subdivision into blocks 800, namely that the block 840 may be the result of a regular subdivision of the picture area into blocks, in columns and rows. permutation, the result of a recursive multi-tree subdivision of the image region, or a combination thereof or any other kind of segmentation. Additionally, it should be noted that blocks 800 and 840 are not limited to squares, rectangles, or any other shape. Furthermore, subdividing a current picture 120 into blocks 800 that form the prediction signal, and subdividing a current picture 120 into blocks 840 that encode the prediction residual, may not be the only subdivisions used for encoding/decoding. These subdivisions come from one granularity where prediction signal decisions and residual coding are performed, but first, this residual encoding can alternatively be done without subdivisions, and secondly, at other granularities besides these subdivisions, the encoder and decoder Certain encoding parameters can be set, which may include some of the above-mentioned parameters, such as prediction parameters, prediction signal composition control signals, etc.
圖18係顯示該預測信號260和該預測殘差信號240’’’’的該組合而直接產生該重建信號120’。然而,應該注意,根據諸如從其他視圖或從其他編碼層獲得的預測信號的替代實施例,可以將多於一個預測信號260與該預測殘差信號240’’’’組合以產生圖片120’,例如,在具有單獨DPB的一單獨預測循環中對其進行編碼/解碼。FIG. 18 shows that the combination of the prediction signal 260 and the prediction residual signal 240'''' directly generates the reconstructed signal 120'. However, it should be noted that more than one prediction signal 260 may be combined with the prediction residual signal 240'''' to produce picture 120', according to alternative embodiments, such as prediction signals obtained from other views or from other coding layers, For example, it is encoded/decoded in a separate prediction cycle with a separate DPB.
在圖4中,該變換區塊840應具有以下含義。變換器280和逆變換器540以這些變換區塊840為單位執行它們的變換。例如,許多編解碼器對所有變換區塊840使用某種DST或DCT。一些編解碼器允許跳過該變換,以便對於一些變換區塊840,該預測殘差信號直接在該空間域中被編碼。然而,根據下面描述的實施例,編碼器100和解碼器200以支持多個變換這樣的一方式配置。例如,編碼器100和解碼器200支持的變換可以包括: ○ DCT-II(或DCT-III),其中DCT代表離散餘弦變換 ○ DST-IV,其中DST代表離散正弦變換 ○ DCT-IV ○ DST-VII ○ 身份轉換(IT)In Figure 4, the transformation block 840 should have the following meaning. The transformer 280 and the inverse transformer 540 perform their transforms in units of these transform blocks 840 . For example, many codecs use some kind of DST or DCT for all transform blocks 840. Some codecs allow the transform to be skipped, so that for some transform blocks 840 the prediction residual signal is encoded directly in the spatial domain. However, according to the embodiment described below, the encoder 100 and the decoder 200 are configured in such a manner that they support multiple transformations. For example, transforms supported by the encoder 100 and the decoder 200 may include: ○ DCT-II (or DCT-III), where DCT stands for discrete cosine transform ○ DST-IV, where DST stands for Discrete Sine Transform ○DCT-IV ○DST-VII ○ Identity Transformation (IT)
當然,雖然變換器280將支持這些變換的所有該正向變換版本,但是該解碼器200或逆變換器540將支持其相應的反向或反向版本: ○ 逆DCT-II(或逆DCT-III) ○ 逆DST-IV ○ DCT-IV ○ 逆DST-VII ○ 身份轉換(IT)Of course, while the transformer 280 will support all forward transformed versions of these transforms, the decoder 200 or inverse transformer 540 will support their corresponding reverse or inverse versions: ○ Inverse DCT-II (or inverse DCT-III) ○ Inverse DST-IV ○DCT-IV ○ Inverse DST-VII ○ Identity Transformation (IT)
在任何情況下,應該注意,所支持的變換集合可以僅包括一個變換,例如一個頻譜到空間或空間到頻譜變換。In any case, it should be noted that the set of supported transforms may include only one transform, such as a spectral-to-space or space-to-spectral transform.
如上所述,已經呈現了圖16-18以作為一範例,其中可以實現下面進一步描述的該合成預測概念,以便形成根據本申請的視頻編碼器和解碼器的特定示例。就此而言,圖16和18的該視頻編碼器和解碼器分別表示下面描述的該視頻編碼器和解碼器的可能實現。如下面將更詳細地概述的,當具有該隨後解釋的根據本申請的用於圖16和圖17的該視頻編碼器和解碼器的組合預測的實施例時,圖16的該視頻編碼器和圖17的該視頻解碼器,至少作為一個選項,支持以下面更詳細描述的該方式以處理區塊800,或甚至構成一當前圖片120的所有區塊。因此,下文中描述的該實施例尤其涉及一視頻編碼器,其等於圖16的該編碼器100,其以下面更詳細描述的方式處理區塊800,並且該相同方式適用於圖18的該解碼器,因此,表示根據一實施例的一視頻解碼器的一範例,其中以下面更詳細描述的方式處理區塊800。然而,圖16和17僅是具體範例。然而,根據本申請的實施例的一視頻編碼器可以使用下面更詳細描述的概念來執行基於區塊的編碼,並且與圖16的該編碼器不同,例如,其中該細分為區塊800係與圖18中示例的方式不相同的方式被執行,或者該編碼器不使用變換預測殘差編碼來編碼該預測殘差,例如直接在空間域中。同樣地,根據本申請的實施例的視頻解碼器可以使用下面進一步概述的該合成預測編碼概念從資料流140執行解碼,但是例如可以與圖17的解碼器200不相同,的區別在於細分圖片120’為區塊係與關於圖180描述的方式不同的方式,和/或該方式不從變換域中的該資料流140導出預測殘差,但是例如在空間域中導出預測殘差。As noted above, Figures 16-18 have been presented as an example in which the synthetic prediction concepts described further below may be implemented to form specific examples of video encoders and decoders in accordance with the present application. In this regard, the video encoder and decoder of Figures 16 and 18 respectively represent possible implementations of the video encoder and decoder described below. As will be outlined in more detail below, when having the subsequently explained embodiment of combined prediction for the video encoder and decoder of FIGS. 16 and 17 according to the present application, the video encoder of FIG. 16 and The video decoder of Figure 17 supports, at least as an option, processing a block 800, or even all blocks making up a current picture 120, in the manner described in more detail below. Therefore, the embodiment described below relates in particular to a video encoder equivalent to the encoder 100 of FIG. 16 , which processes block 800 in a manner described in more detail below, and the same manner applies to the decoding of FIG. 18 The decoder, therefore, represents an example of a video decoder according to an embodiment, in which block 800 is processed in a manner described in greater detail below. However, Figures 16 and 17 are only specific examples. However, a video encoder according to embodiments of the present application may perform block-based encoding using concepts described in greater detail below, and differs from the encoder of FIG. 16 , for example, where the subdivision into blocks 800 is The manner illustrated in Figure 18 is not performed in the same way, or the encoder does not use transform prediction residual coding to encode the prediction residual, for example directly in the spatial domain. Likewise, a video decoder in accordance with embodiments of the present application may perform decoding from the data stream 140 using the synthetic predictive coding concept outlined further below, but may differ, for example, from the decoder 200 of FIG. 17 in that the subdivision picture 120 ' is a block system in a different manner than that described with respect to figure 180, and/or in a manner that does not derive prediction residuals from the data stream 140 in the transform domain, but rather derives prediction residuals in the spatial domain, for example.
特別地,關於該區塊細分為區塊800,應注意,其可以以關於圖18概述的方式或以不同的方式完成相同的操作。如果存在的話,一細分為變換區塊也可以如關於圖18所描述的那樣或以不同的方式進行。具體地,一方面該細分為區塊而另一方面細分為其他區塊,例如變換區塊,可以藉由分別將圖片120細分為這些區塊,其可以彼此獨立地完成,或以一相關的方式完成。例如,一個細分(例如細分為變換區塊)可以形成如上所述的該另一個細分的一擴展,或者兩個細分可以形成一共同主細分的個別擴展,例如,將該圖片細分為如關於圖18所描述的樹根區塊的一陣列。並且這種可能性也適用於下面將提到的其他子圖片粒度,例如關於某些預測參數的定義、預測模式、貢獻權重等。不同的細分可以用於這些實體中的不同實體,並且可以彼此獨立地定義,部分獨立或作為彼此的擴展。In particular, with respect to the subdivision of the blocks into blocks 800, it should be noted that the same operations may be accomplished in the manner outlined with respect to Figure 18 or in a different manner. If present, subdivision into transform blocks may also be performed as described with respect to Figure 18 or in a different manner. Specifically, the subdivision into blocks on the one hand and into other blocks on the other hand, such as transformation blocks, can be achieved by subdividing the picture 120 into these blocks respectively, which can be done independently of each other, or in an associated way completed. For example, one subdivision (e.g., into transform blocks) may form an extension of the other subdivision as described above, or two subdivisions may form individual extensions of a common main subdivision, e.g., subdividing the picture into as with respect to Fig. An array of tree root blocks as described in 18. And this possibility also applies to other sub-picture granularities mentioned below, such as regarding the definition of certain prediction parameters, prediction modes, contribution weights, etc. Different segments can be used for different of these entities and can be defined independently of each other, partially independent of each other or as an extension of each other.
話雖如此,以下描述集中於編碼器和解碼器處的預測區塊800。該目的是使用具有有限記憶體存取頻寬的多假設來提高視頻的該編碼效率。Having said that, the following description focuses on prediction blocks 800 at the encoder and decoder. The goal is to improve the coding efficiency of video using multiple hypotheses with limited memory access bandwidth.
在一特定實施例中,在一給定區域上的預測假設的該平均數量是有限的。該區域可以是例如一固定數量的(相鄰)區塊、一切片、一圖片、一圖片組或一整個視頻序列。例如,如果該限制將等於3並且該區域將是一圖片,則圖片的一半可能使用四個預測假設,而另一半使用兩個預測假設。也就是說,如圖19所示,對於該預測區塊800,即該視頻的一預定部分內的幀間預測區塊,使用四個區塊840,即四個預測假設被使用。然後,為了保持預測假設的該決定的平均數量為三,需要對其他預測區塊使用兩個預測假設。在這種情況下,還可以給出預測假設的該數量的一最大值,例如,四個預測假設是該最大值。In a particular embodiment, the average number of prediction hypotheses over a given region is limited. The region may be, for example, a fixed number of (adjacent) blocks, a slice, a picture, a group of pictures or an entire video sequence. For example, if the limit would be equal to 3 and the region would be a picture, half of the picture might use four prediction hypotheses and the other half use two prediction hypotheses. That is, as shown in FIG. 19 , for the prediction block 800 , that is, the inter prediction block within a predetermined portion of the video, four blocks 840 are used, that is, four prediction hypotheses are used. Then, to keep this decided average number of prediction hypotheses at three, two prediction hypotheses need to be used for other prediction blocks. In this case, a maximum value of the number of prediction hypotheses can also be given, for example, four prediction hypotheses is the maximum value.
每個幀間預測區塊的預測假設的該數量,即該平均數量,可以根據在該預定部分內的先前處理的幀間預測區塊的多個預測假設以及該預定標準,其被***到該資料流信息中或者一當前處理的幀間預測區塊的預測假設的數量上。The number of prediction hypotheses for each inter prediction block, ie the average number, may be inserted into the The number of prediction hypotheses in the data stream information or a currently processed inter prediction block.
基於該預定部分內的該先前處理的幀間預測區塊的預測假設的該數量以及該預定標準,將該信息編碼到該資料流中,決定一允許的數量間隔,並且使用該允許的數量間隔的一個二值化,將該信息編碼到該資料流中。此外,該允許數量間隔的一最大值越低,該預定部分內的該先前處理的幀間預測區塊的預測假設的該數量越大,並且該允許的數量間隔的該二值化具有更低的一平均字碼長度,該允許的數量間隔的該最大值越低。藉由如上所述的方式進行,可以提高該解碼效率。based on the number of prediction hypotheses of the previously processed inter prediction block within the predetermined portion and the predetermined criterion, encoding the information into the data stream, determining an allowed number interval, and using the allowed number interval A binarization of , encoding the information into the data stream. Furthermore, the lower a maximum value of the allowed number interval, the greater the number of prediction hypotheses of the previously processed inter prediction block within the predetermined portion, and the binarization of the allowed number interval has a lower An average word length, the lower the maximum value of the allowed number of intervals. By performing it in the above manner, the decoding efficiency can be improved.
在一另一特定實施例中,預測假設的該數量取決於該區塊大小或幾何形狀而受到限制。眾所周知,對於較小的區塊,每個預測假設的該相對預測記憶體存取開銷較高。因此,經由允許一較小數量的假設用於較小的區塊,並且一較大數量的假設用於較大的區塊,因此該總體最壞情況的記憶體存取頻寬可以保持恆定。也就是說,假設的該數量是經由根據該預定的幀間預測區塊的該大小或幾何比較針對假設的該數量N的一上限來決定。作為一範例,如圖20所示,僅考慮一單個顏色通道(例如,亮度),在一個(k+1)抽頭插值濾波器的情況下,相對預測記憶體存取開銷m的一期望最大,一區塊寬度w和高度h,假設的該數量N必須滿足以下公式: N ≤(m*w*h)/((w+kx)*(h+ky))。In another specific embodiment, the number of prediction hypotheses is limited depending on the block size or geometry. It is known that this relative prediction memory access cost per prediction hypothesis is higher for smaller blocks. Therefore, by allowing a smaller number of hypotheses for smaller blocks, and a larger number of hypotheses for larger blocks, the overall worst-case memory access bandwidth can remain constant. That is, the number of assumptions is determined by comparing an upper limit of the number N of assumptions based on the size or geometry of the predetermined inter prediction block. As an example, as shown in Figure 20, considering only a single color channel (e.g., luminance), in the case of a (k+1) tap interpolation filter, an expected maximum relative to the prediction memory access cost m, A block width w and height h, the assumed number N must satisfy the following formula: N ≤ (m*w*h)/((w+kx)*(h+ky)).
藉由使用上述公式決定的該數量N指示針對在該預定部分內的該預定幀間預測區塊的預測假設的一最大數量,即,該數量係相對於該預定幀間預測區塊的可信號通知之假設數量的一上限。The number N, determined by using the above formula, indicates a maximum number of prediction hypotheses for the predetermined inter prediction block within the predetermined portion, i.e., the number is relative to the signal available for the predetermined inter prediction block An upper limit on the hypothetical number of notifications.
針對每個幀間預測區塊的預測假設的該數量可以被***到該資料流信息中,或者基於該預定幀間預測區塊的該大小或該幾何形狀,決定一允許的數量間隔,以及使用該允許的數量間隔的二值化,將信息編碼到該資料流中。關於該預測假設的該數量的該信息可以指示該允許的數量間隔的一最大值越低,該預定的幀間預測區塊的該大小越小,並且該允許的數量間隔的該二值化具有一平均字碼長度,其係越低,該允許的數量間隔的該最大值越低。另外,該信息可以指示假設的該數量越大,該預定的幀間預測的區塊越大。藉由如上所述的方式進行,改善了在解碼器的解碼效率。The number of prediction hypotheses for each inter prediction block can be inserted into the data stream information, or an allowed number interval is determined based on the size or the geometry of the predetermined inter prediction block, and using Binarization of the allowed number of intervals encodes information into the data stream. The information about the number of prediction hypotheses may indicate that the lower a maximum value of the allowed number interval, the smaller the size of the predetermined inter prediction block, and the binarization of the allowed number interval has An average character length, the lower it is, the lower the maximum value of the allowed number of intervals. In addition, the information may indicate that the larger the number of assumptions, the larger the predetermined inter-predicted block. By proceeding in the above manner, the decoding efficiency of the decoder is improved.
在一另一特定實施例中,不同的內插濾波器用於該預測假設的不同子集合。例如,對於該第一和第二(單/雙預測)預測假設,可以使用比該後續假設一更長的插值濾波器。經由這樣做,該後續假設的該相對預測記憶體存取開銷將減少。在一較長插值濾波器用於一較少數量的該預測假設的情況下,則一較短插值濾波器用於一較大數量的該預測假設。換句話說,該預測假設的該數量與該插值濾波器的該大小之間的依賴性是單調的。In another specific embodiment, different interpolation filters are used for different subsets of the prediction hypotheses. For example, for the first and second (mono/bi-predictive) prediction hypotheses, longer interpolation filters may be used than for the subsequent hypothesis. By doing so, the relative prediction memory access overhead of the subsequent hypothesis will be reduced. Where a longer interpolation filter is used for a smaller number of the prediction hypotheses, then a shorter interpolation filter is used for a larger number of the prediction hypotheses. In other words, the dependence between the number of prediction hypotheses and the size of the interpolation filter is monotonic.
在一另一特定實施例中,不同的運動向量精度用於該預測假設的不同子集合。例如,該第一和第二(單/雙預測)預測假設可以使用四分之一像素運動向量精度,而該隨後的假設使用全像素精度。因此,該後續假設的該相對預測存記憶體存取開銷將等於每個假設一個。在這種情況下,該預測假設的數量越大,使用的該運動向量精度越粗,即該預測假設的該數量與該運動向量精度之間的該關係是單調的。In another specific embodiment, different motion vector precisions are used for different subsets of the prediction hypotheses. For example, the first and second (mono/dual prediction) prediction hypotheses may use quarter-pixel motion vector accuracy, while the subsequent hypotheses use full-pixel accuracy. Therefore, the relative prediction memory access cost for the subsequent hypotheses will be equal to one per hypothesis. In this case, the greater the number of prediction hypotheses, the coarser the motion vector accuracy used, that is, the relationship between the number of prediction hypotheses and the motion vector accuracy is monotonic.
儘管已經在一裝置的該上下文中描述了一些觀點,但是顯然這些觀點也表示該對應方法的一描述,其中一區塊或設備對應於一方法步驟或一方法步驟的一特徵。類似地,在一方法步驟的該上下文中描述的觀點還表示一對應裝置的一對應區塊或項目或特徵的一描述。一些或所有該方法步驟可以由(或使用)一硬體設備執行,例如一微處理器、一可編程計算機或一電子電路。在一些實施例中,一些或多個該最重要的方法步驟可以由這樣的一裝置執行。Although some aspects have been described in the context of an apparatus, it is clear that these aspects also represent a description of the corresponding method, where a block or device corresponds to a method step or a feature of a method step. Similarly, a concept described in the context of a method step also represents a description of a corresponding block or item or feature of a corresponding apparatus. Some or all of the method steps may be performed by (or using) a hardware device, such as a microprocessor, a programmable computer, or an electronic circuit. In some embodiments, some or more of the most important method steps may be performed by such an apparatus.
本揭露的編碼信號可以存儲在一數位存儲媒體上,或者可以在諸如一無線傳輸媒體的一傳輸媒體或諸如網際網路的一有線傳輸媒體上傳輸。The encoded signal of the present disclosure may be stored on a digital storage medium, or may be transmitted over a transmission medium such as a wireless transmission medium or a wired transmission medium such as the Internet.
根據某些實現要求,本揭露的實施例可以用硬體或軟體實現。該實現可以使用一數位存儲媒體來執行,例如一軟性磁碟、一DVD、一藍光、一CD、一ROM、一PROM、一EPROM、一EEPROM或一FLASH記憶體,其上存儲有電子可讀取控制信號,它們配合(或者能夠與)一可編程計算機系統協作,以便執行該相應的方法。因此該數位存儲媒體可以是計算機可讀的。Depending on certain implementation requirements, embodiments of the present disclosure may be implemented in hardware or software. The implementation may be executed using a digital storage medium, such as a floppy disk, a DVD, a Blu-ray, a CD, a ROM, a PROM, an EPROM, an EEPROM or a FLASH memory, on which electronically readable Control signals are obtained, and they cooperate with (or can cooperate with) a programmable computer system in order to execute the corresponding method. The digital storage medium may therefore be computer readable.
根據本揭露的一些實施例,其包括具有一電子可讀取控制信號的一資料載體,其能夠與一可編程計算機系統協作,從而執行本文所述的該方法之一。According to some embodiments of the present disclosure, it includes a data carrier having an electronically readable control signal capable of cooperating with a programmable computer system to perform one of the methods described herein.
通常,本揭露的實施例可以實現為具有一程式編碼的一計算機程式產品,該程式編碼可操作用於在該計算機程式產品在一計算機上運行時執行這些方法之一。該程式編碼可以例如存儲在一機器可讀載體上。Generally, embodiments of the present disclosure may be implemented as a computer program product having a program code operable to perform one of the methods when the computer program product runs on a computer. The program code may, for example, be stored on a machine-readable carrier.
其他實施例包括用於執行存儲在一機器可讀載體上的本文所述方法之一的該計算機程式。Other embodiments include the computer program for executing one of the methods described herein stored on a machine-readable carrier.
換句話說,本揭露方法的一實施例因此是具有一程式編碼的一計算機程式,當該計算機程式在一計算機上運行時,該程式編碼用於執行本文所述的該方法之一。In other words, an embodiment of the disclosed method is therefore a computer program having a program code for performing one of the methods described herein when the computer program is run on a computer.
因此,本揭露方法的一另一實施例是一資料載體(或一數位存儲媒體、或一計算機可讀媒體),其包括記錄在其上的用於執行本文所述方法之一的該計算機程式。該資料載體、該數位存儲媒體或該記錄媒體通常是有形的和/或非過渡的。Therefore, another embodiment of the disclosed method is a data carrier (or a digital storage medium, or a computer-readable medium) including recorded thereon the computer program for performing one of the methods described herein. . The data carrier, the digital storage medium or the recording medium are usually tangible and/or non-transitory.
因此,本揭露方法的一另一實施例是表示用於執行本文所述方法之一的計算機程式的一資料串流或一信號序列。該資料串流或該信號序列可以例如被配置為經由一資料通信連接傳輸,例如經由該網際網路。Therefore, another embodiment of the disclosed method represents a data stream or a signal sequence of a computer program for performing one of the methods described herein. The data stream or the signal sequence may, for example, be configured to be transmitted via a data communication connection, such as via the Internet.
一另一實施例包括一處理裝置,例如一計算機或一可編程邏輯設備,其被配置為或適於執行本文所述的該方法之一。A further embodiment includes a processing device, such as a computer or a programmable logic device, configured or adapted to perform one of the methods described herein.
一另一實施例包括一計算機,其上安裝有用於執行本文所述方法之一的該計算機程式。A further embodiment includes a computer having installed thereon the computer program for performing one of the methods described herein.
根據本揭露的一另一實施例包括一種裝置或一系統,其被配置為將用於執行本文所述方法之一的一計算機程式傳送(例如,電子地或光學地)到一接收器。該接收器可以是例如一計算機、一移動設備、一記憶體設備等。該裝置或系統可以例如包括用於將計算機程式傳送到該接收器的一檔案伺服器。Another embodiment in accordance with the present disclosure includes a device or a system configured to transmit (eg, electronically or optically) a computer program for performing one of the methods described herein to a receiver. The receiver may be, for example, a computer, a mobile device, a memory device, etc. The device or system may, for example, include a file server for transmitting computer programs to the receiver.
在一些實施例中,一可編輯邏輯器件(例如一現場可編輯閘陣列)可用於執行本文所述方法的一些或全部該功能。在一些實施例中一該現場可編輯閘陣列可以與一微處理器協作,以便執行本文描述的方法之一。通常,該方法較佳地由任何硬體設備執行。In some embodiments, an editable logic device (eg, a field-editable gate array) may be used to perform some or all of the functionality of the methods described herein. In some embodiments a field-editable gate array may cooperate with a microprocessor to perform one of the methods described herein. Generally, this method is preferably performed by any hardware device.
在一些實施例中揭示一種基於區塊的解碼器,用於以編碼區塊為單位從一資料流解碼一圖片,其被配置為:藉由遞歸雙分割將該圖片的一圖片區塊分割為該編碼區塊,並根據該資料流中的分割信息控制該遞歸雙分割﹔以及設置一第一分割線的一第一分割線方向,藉由該遞歸雙分割沿著該第一分割線將該圖片區塊的一預定分割級別的一預定子區塊分割成一後續分割級別的一對兒子子區塊(child sub-blocks),取決於一第二分割線的一第二分割線方向,沿著該第二分割線將該圖片區塊的一個先前分割級別的一祖父子區塊(grandfather sub-block)分成該預定的子區塊和另一個子區塊。In some embodiments, a block-based decoder is disclosed for decoding a picture from a data stream in coding block units, and is configured to: divide a picture block of the picture into The encoding block controls the recursive double splitting according to the splitting information in the data stream; and sets a first splitting line direction of a first splitting line, and divides the recursive double splitting along the first splitting line by the recursive double splitting. A predetermined sub-block of a predetermined division level of the picture block is divided into a pair of child sub-blocks (child sub-blocks) of a subsequent division level, depending on a second dividing line direction of a second dividing line, along The second dividing line divides a grandfather sub-block of a previous division level of the picture block into the predetermined sub-block and another sub-block.
在一些實施例中揭示一種基於區塊的解碼器,其進一步被配置為支持多種編碼模式,並以該編碼區塊為單位從該資料流導出一編碼模式,其用於從該資料流解碼該圖片。In some embodiments, a block-based decoder is disclosed, which is further configured to support multiple encoding modes, and derive an encoding mode from the data stream in units of the encoding block, which is used to decode the data stream from the data stream. pictures.
在一些實施例中揭示一種基於區塊的解碼器,其進一步被配置為支持多種編碼模式,其中每種編碼模式具有與其相關聯的一個或多個編碼參數的一編碼模式特定集合,其使用該相應的編碼模式控制該圖片的一解碼,並且該基於區塊的解碼器被配置為以該編碼區塊為單位從該資料流導出用於解碼該圖片的一個或多個編碼參數的該編碼模式特定集合,藉由從每個解碼單元的該資料流導出與編碼模式相關聯的一個或多個編碼參數的該編碼模式特定集合,信號發送的該編碼模式用於該資料流中的該相應編碼區塊。In some embodiments, a block-based decoder is disclosed that is further configured to support multiple encoding modes, wherein each encoding mode has associated therewith a encoding mode-specific set of one or more encoding parameters that uses the The corresponding encoding mode controls a decoding of the picture, and the block-based decoder is configured to derive the encoding mode for decoding one or more encoding parameters of the picture from the data stream in units of the encoding block. a specific set of coding modes signaling the coding mode for the corresponding coding in the data stream by deriving the coding mode specific set of one or more coding parameters associated with the coding mode from the data stream for each decoding unit block.
在一些實施例中揭示一種基於區塊的解碼器,其作為一預測解碼器並且被配置為以頻譜變換的形式從該資料流導出一頻譜域中的該圖片的一預測殘差,所述頻譜變換表示以該編碼區塊為單位的該預測殘差的一分段頻譜變換。In some embodiments a block-based decoder is disclosed that acts as a predictive decoder and is configured to derive a prediction residual of the picture in a spectral domain from the data stream in the form of a spectral transform, the spectrum Transform represents a piecewise spectral transformation of the prediction residual in units of the coding block.
在一些實施例中揭示一種基於區塊的解碼器,其被配置為:將該圖片預分割成樹根區塊的一陣列,並相對於樹根區塊的該陣列的每個陣列執行該圖片區塊的分割。In some embodiments, a block-based decoder is disclosed that is configured to: pre-partition the picture into an array of root blocks and execute the picture region with respect to each array of the array of root blocks. Block division.
在一些實施例中揭示一種基於區塊的解碼器,其被配置為:將該圖片預分割成樹根區塊的一陣列,根據該分割信息,使該樹根區塊經歷一單獨的分割,以便將樹根區塊的該陣列細分為預分割樹葉區塊並相對於每個預分割樹葉區塊執行該圖片區塊的該分割。In some embodiments, a block-based decoder is disclosed, which is configured to: pre-partition the picture into an array of root blocks, and subject the root block to a separate partition based on the partition information, so that The array of tree root blocks is subdivided into pre-partitioned leaf blocks and the partitioning of the picture block is performed with respect to each pre-partitioned leaf block.
在一些實施例中揭示一種基於區塊的解碼器,其被配置為取決於該第二分割線方向和該分割信息來設置該第一分割線方向,其係藉由根據該分割信息修改該第一分割線方向,以獲得一修改的分割線方向並將該第二分割線方向設置為等於該修改後的分割線方向。In some embodiments, a block-based decoder is disclosed that is configured to set the first dividing line direction depending on the second dividing line direction and the dividing information by modifying the third dividing line direction according to the dividing information. A dividing line direction to obtain a modified dividing line direction and set the second dividing line direction equal to the modified dividing line direction.
在一些實施例中揭示一種基於區塊的解碼器,被配置為根據由該分割信息發信號通知的一個二元決策樹來控制該遞歸雙分割,該分割信息指示該圖片區塊的一分割或不分割,該父親區塊藉由該遞歸雙分割被分割成該父親區塊的所有中間子區塊,並且所有樹葉區塊不被該遞歸雙分割所分割。In some embodiments a block-based decoder is disclosed, configured to control the recursive dual partitioning based on a binary decision tree signaled by the partition information indicating a partition of the picture block or Without splitting, the parent block is split into all intermediate sub-blocks of the parent block by the recursive double split, and all leaf blocks are not split by the recursive double split.
在一些實施例中揭示一種基於區塊的解碼器,其被配置為控制屬於分割級別的一第一預定集合的該圖片區塊的每個子區塊的該遞歸雙分割,該第一預定集合相對於一分割線的一位置,該相應的子區塊藉由該遞歸雙分割沿著該分割線橫向於該分割線的一分割線方向被分割。In some embodiments a block-based decoder is disclosed that is configured to control the recursive dual partitioning of each sub-block of the picture block belonging to a first predetermined set of partition levels, the first predetermined set being relative to At a location on a dividing line, the corresponding sub-block is divided along the dividing line transversely to a dividing line direction of the dividing line by the recursive double partitioning.
在一些實施例中揭示一種基於區塊的解碼器,其被被配置為控制屬於分割級別的一第一預定集合的該圖片區塊的每個子區塊的該遞歸雙分割,該第一預定集合取決於該分割信息而相對於一分割線的一分割線方向,藉由該遞歸雙分割沿著該分割線來分割該相應的子區塊,其取決於該分割信息及一分割線的一分割線方向,沿其該相應中間區塊的一父親區塊被分割。In some embodiments a block-based decoder is disclosed that is configured to control the recursive dual partitioning of each sub-block of the picture block belonging to a first predetermined set of partition levels, the first predetermined set Split the corresponding sub-block along the split line by the recursive double split depending on the split information and a split line direction relative to the split line, which depends on the split information and a split of a split line line direction along which a parent block of the corresponding middle block is divided.
在一些實施例中揭示一種基於區塊的解碼器,其中,該第二分割線方向是水平的或垂直的,並且該基於區塊的解碼器被配置為根據該分割信息將該第一分割線方向設置為垂直於或平行於該第二分割線方向。In some embodiments, a block-based decoder is disclosed, wherein the second dividing line direction is horizontal or vertical, and the block-based decoder is configured to divide the first dividing line according to the dividing information. The direction is set perpendicular or parallel to the second dividing line direction.
在一些實施例中揭示一種基於區塊的解碼器,被配置為在分割該圖片區塊時,根據該分割信息,決定將該圖片區塊分割成一對第一分割級別子區塊,或者讓該圖片區塊未被分割,和如果該圖片的該圖片區塊被分割為該對第一分割級別子區塊,則根據該分割信息,將該對第一分割級別子區塊的一第一個第一分割級別子區塊分割成一對第二分割級別子區塊,或者讓該第一個第一分割級別子區塊未被分割,沿著具有一第三分割線方向的一第三分割線執行該圖片區塊的該分割,並且設置一第四分割線的一第四分割線方向,沿著該第四分割線分割該第一個第一分割級別子區塊,其取決於該第三個分割線方向。In some embodiments, a block-based decoder is disclosed, which is configured to, when dividing the picture block, decide to divide the picture block into a pair of first division level sub-blocks according to the division information, or let the The picture block is not divided, and if the picture block of the picture is divided into the pair of first division level sub-blocks, then according to the division information, a first one of the pair of first division level sub-blocks is The first division level sub-block is divided into a pair of second division level sub-blocks, or the first first division level sub-block is left undivided along a third division line having a third division line direction. Perform the segmentation of the picture block, and set a fourth segmentation line direction of a fourth segmentation line to segment the first first segmentation level sub-block along the fourth segmentation line, which depends on the third segmentation line. direction of the dividing line.
在一些實施例中揭示一種基於區塊的解碼器,其被配置為,如果該圖片的該圖片區塊被分割成該對第一分割級別子區塊,根據該分割信息設置該第三個分割方向,以及從該資料流導出由該分割信息獲得的一第一分割旗標,和如果該第一分割旗標具有一第一旗標狀態,則將該第二分割方向設置為垂直於該第一個分割方向、並沿著該第二分割線將該第一個第一分割級別子區塊分割成該對第二分割級別子區塊,和如果該第一分割旗標具有一第二個旗標狀態,則使該第一個第一分割級別子區塊保持未分割。In some embodiments, a block-based decoder is disclosed, which is configured to set the third partition according to the partition information if the picture block of the picture is partitioned into the pair of first partition level sub-blocks. direction, and deriving a first splitting flag obtained from the splitting information from the data stream, and if the first splitting flag has a first flag state, setting the second splitting direction to be perpendicular to the third A dividing direction and dividing the first first dividing level sub-block into the pair of second dividing level sub-blocks along the second dividing line, and if the first dividing flag has a second flag state, the first first division level sub-block remains undivided.
在一些實施例中揭示一種基於區塊的解碼器,其被配置為,如果該圖片的該圖片區塊被分割成該對第一分割級別子區塊,從該資料流導出該分割信息包含的一第一分割旗標,和如果該第一分割旗標具有一第一旗標狀態,則將該第四分割方向設置為垂直於該第三個分割方向、並沿著該第四分割線將該第一個第一分割級別子區塊分割成該對第二分割級別子區塊,和如果該第一分割旗標具有一第二個旗標狀態,從該資料流導出由該分割信息包含的一第二分割旗標,和如果該第二分割旗標具有一第一旗標狀態,則將該第四分割方向設置為平行於該第三個分割方向、並沿著該第四分割線將該第一個第一分割級別子區塊分割成該對第二分割級別子區塊,和如果該第二分割旗標具有一第二個旗標狀態,則使該第一個第一分割級別子區塊保持未分割。In some embodiments, a block-based decoder is disclosed, which is configured to, if the picture block of the picture is divided into the pair of first partition level sub-blocks, derive the partition information contained in the data stream from the data stream. a first segmentation flag, and if the first segmentation flag has a first flag state, the fourth segmentation direction is set perpendicular to the third segmentation direction, and the fourth segmentation direction is set along the fourth segmentation line. The first first partition level sub-block is partitioned into the pair of second partition level sub-blocks, and if the first partition flag has a second flag state, derived from the data stream is contained in the partition information a second dividing flag, and if the second dividing flag has a first flag state, the fourth dividing direction is set to be parallel to the third dividing direction and along the fourth dividing line partition the first first partition level sub-block into the pair of second partition level sub-blocks, and if the second partition flag has a second flag state, causing the first first partition Level sub-blocks remain undivided.
在一些實施例中揭示一種基於區塊的解碼器,被配置為在分割該圖片區塊時根據該分割信息,決定將該祖父子區塊分割成包括該預定子區塊的一對子區塊,或者讓該祖父子區塊未被分割,和如果該祖父子區塊被分割為該對子區塊,則根據該分割信息,將該對子區塊的該預定子區塊分割成一對兒子子區塊,或者讓該預定子區塊未被分割,沿著具有該第二分割線方向的該第二分割線執行該祖父子區塊的該分割,並且設置該第一分割線的該第一分割線方向,沿著該第一分割線分割該預定子區塊,其取決於該第二個分割線方向。In some embodiments, a block-based decoder is disclosed, configured to decide to divide the grandparent sub-block into a pair of sub-blocks including the predetermined sub-block according to the division information when dividing the picture block. , or let the grandparent sub-block not be divided, and if the grandparent sub-block is divided into the pair of sub-blocks, then divide the predetermined sub-block of the pair of sub-blocks into a pair of sub-blocks according to the division information sub-block, or let the predetermined sub-block not be divided, perform the division of the grandparent sub-block along the second division line having the direction of the second division line, and set the first division line of the first division line. A dividing line direction, dividing the predetermined sub-block along the first dividing line, which depends on the second dividing line direction.
在一些實施例中揭示一種基於區塊的解碼器,被配置為:從該資料流導出該分割信息包含的一第一分割旗標,和如果該第一分割旗標具有一第一旗標狀態,則將該第一分割方向設置為垂直於該第二個分割方向、並沿著該第一分割線將該預定子區塊分割成該對兒子子區塊,和如果該第一分割旗標具有一第二個旗標狀態,從該資料流導出由該分割信息包含的一第二分割旗標,和如果該第二分割旗標具有一第一旗標狀態,則將該第一分割線方向設置為平行於該第二個分割線方向、並沿著該第一分割線將該預定子區塊分割成該對兒子子區塊,和如果該第二分割旗標具有一第二個旗標狀態,則使該預定子區塊保持未分割。In some embodiments, a block-based decoder is disclosed, configured to: derive a first partition flag included in the partition information from the data stream, and if the first partition flag has a first flag state , then the first division direction is set perpendicular to the second division direction and the predetermined sub-block is divided into the pair of son sub-blocks along the first division line, and if the first division flag having a second flag state, deriving a second split flag contained in the split information from the data stream, and if the second split flag has a first flag state, converting the first split line The direction is set to be parallel to the direction of the second dividing line and the predetermined sub-block is divided into the pair of son sub-blocks along the first dividing line, and if the second dividing flag has a second flag If the target state is reached, the predetermined sub-block remains undivided.
在一些實施例中揭示一種基於區塊的解碼器,被配置為:從該資料流導出由該分割信息包含的一第三分割旗標,和如果該第三分割旗標具有該第一旗標狀態,則將該第五分割線的一第五分割線方向設置為垂直於該第二個分割線方向、並沿著一第五分割線將該對子區塊的另一子區塊分割成一另一對兒子子區塊,和如果該第三分割旗標具有該第二個旗標狀態,從該資料流導出該分割信息包含的一第四分割旗標,和如果該第四分割旗標具有該第一旗標狀態,則將該第五分割線方向設置為平行於該第二個分割線方向、並沿著該第五分割線將該另一個子區塊分割成該另一對兒子子區塊,和如果該第二分割旗標具有該第二個旗標狀態,則使該另一個子區塊保持未分割。In some embodiments, a block-based decoder is disclosed, configured to: derive from the data stream a third partition flag included in the partition information, and if the third partition flag has the first flag state, then set a fifth dividing line direction of the fifth dividing line to be perpendicular to the second dividing line direction, and divide the other sub-block of the pair of sub-blocks into one along a fifth dividing line. Another pair of sub-blocks, and if the third split flag has the second flag state, derive a fourth split flag contained in the split information from the data stream, and if the fourth split flag With the first flag state, the fifth dividing line direction is set to be parallel to the second dividing line direction, and the other sub-block is divided into the other pair of children along the fifth dividing line. sub-block, and if the second split flag has the second flag state, the other sub-block remains unsplit.
在一些實施例中揭示一種基於區塊的解碼器,被配置為:如果該預定的子區塊被分成該對兒子子區塊,從該資料流導出由該分割信息包含的一第六分割旗標,和如果該第六分割旗標具有該第一旗標狀態,則將該第七分割線的一第七分割線方向設置為垂直於該第一個分割線方向、並沿著一第七分割線將該對兒子子區塊的一第一兒子子區塊分割成一對孫子子區塊(grandchild sub-blocks),和如果該第六分割旗標具有該第二旗標狀態,從該資料流導出由該分割信息包含的一第七分割旗標,和如果該第七分割旗標具有該第一旗標狀態,則將該第七分割線方向設置為平行於該第一個分割線方向、並沿著該第七分割線將該第一兒子子區塊分割成該對孫子子區塊,和如果該第七分割旗標具有該第二個旗標狀態,則使該第一兒子子區塊保持未分割。In some embodiments, a block-based decoder is disclosed, configured to: if the predetermined sub-block is divided into the pair of child sub-blocks, derive a sixth partition flag contained in the partition information from the data stream. mark, and if the sixth dividing flag has the first flag state, then a seventh dividing line direction of the seventh dividing line is set perpendicular to the first dividing line direction and along a seventh dividing line direction. The dividing line divides a first son sub-block of the pair of grandchild sub-blocks into a pair of grandchild sub-blocks, and if the sixth division flag has the second flag state, from the data Streaming exports a seventh split flag included in the split information, and if the seventh split flag has the first flag state, then setting the seventh split line direction to be parallel to the first split line direction , and divide the first son sub-block into the pair of grandson sub-blocks along the seventh division line, and if the seventh division flag has the second flag state, make the first son sub-block Blocks remain undivided.
在一些實施例中揭示一種基於區塊的解碼器,被配置為:如果該預定的子區塊被分割成該對兒子子區塊,從該分割信息導出一分割比,指示垂直於該第一分割線方向的該預定子區塊的寬度被分割的比率。In some embodiments, a block-based decoder is disclosed, configured to: if the predetermined sub-block is divided into the pair of son sub-blocks, derive a partition ratio from the partition information, indicating perpendicular to the first The ratio at which the width of the predetermined sub-block is divided in the direction of the dividing line.
在一些實施例中揭示一種基於區塊的解碼器,其中,該基於區塊的解碼器支持一支持分割比的集合,用於沿著與該第二分割線方向垂直的該第一分割線分割該預定的子區塊,並且被配置為根據一個或多個規則從支持分割比的該集合中排除支持的分割比,獲得支持分割比的一縮減集合,並推斷該第一分割旗標具有該第二旗標狀態,並且如果該縮減集合的一基數為零則跳過其推導。In some embodiments, a block-based decoder is disclosed, wherein the block-based decoder supports a set of supported split ratios for splitting along the first split line perpendicular to the second split line direction. the predetermined sub-block, and is configured to exclude supported split ratios from the set of supported split ratios according to one or more rules, obtain a reduced set of supported split ratios, and infer that the first split flag has the Second flag state, and skipping the derivation of the reduced set if its cardinality is zero.
在一些實施例中揭示一種基於區塊的解碼器,其中,該基於區塊的解碼器支持一支持分割比的另一集合,用於沿著與該第二分割線方向平行的該第一分割線分割該預定的子區塊,並且被配置為根據一個或多個規則從支持分割比的該另一集合中排除支持的分割比,以獲得支持分割比的一另一縮減集合,並推斷該第二分割旗標具有該第二旗標狀態,並且如果該另一縮減集合的一基數為零則跳過其推導。In some embodiments, a block-based decoder is disclosed, wherein the block-based decoder supports another set of supported partition ratios for the first partition along a direction parallel to the second partition line. line-splitting the predetermined sub-block, and being configured to exclude supported split ratios from the other set of supported split ratios according to one or more rules to obtain another reduced set of supported split ratios, and to infer the The second split flag has the second flag state, and its derivation is skipped if a cardinality of the other reduced set is zero.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則中的一個取決於垂直於該第一分割線的該預定子區塊的該寬度,來排除支持的分割比。In some embodiments, a block-based decoder is disclosed, wherein one of the one or more rules excludes supported split ratios depending on the width of the predetermined sub-block perpendicular to the first split line. .
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則中的一個規則根據垂直於該第一分割線的該預定子區塊的該寬度排除所支持的分割比,以這樣的一方式排除支持的分割比,其將該寬度分成兩個兒子子區塊的寬度,在樣本中不是一預定整數的一整數倍。In some embodiments, a block-based decoder is disclosed, wherein one of the one or more rules excludes supported split ratios based on the width of the predetermined sub-block perpendicular to the first split line, Support is excluded in such a way that a split ratio that divides the width into two sub-blocks is not an integral multiple of a predetermined integer in the sample.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則中的一個規則根據垂直於該第一分割線的該預定子區塊的該寬度排除所支持的分割比,以這樣的一方式排除支持的分割比,其將該預定的子區塊分成兩個兒子子區塊,其中至少一個太小而不能完全包圍至少一個預定的最小尺寸區塊中的一集合的至少一個。In some embodiments, a block-based decoder is disclosed, wherein one of the one or more rules excludes supported split ratios based on the width of the predetermined sub-block perpendicular to the first split line, Exclude supported splitting ratios in such a way that divides the predetermined sub-block into two sub-blocks, at least one of which is too small to completely encompass at least one of a set of at least one predetermined minimum size block a.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則中的一個可以取決於垂直於該第一分割線的該預定子區塊的該寬度,來排除所支持的分割比,以這樣的一方式排除支持的分割比,其將該預定的子區塊分割成兩個兒子子區塊,其中至少一個具有在一可允許的寬高比範圍之外的一寬高比。In some embodiments, a block-based decoder is disclosed, wherein one of the one or more rules may exclude supported blocks depending on the width of the predetermined sub-block perpendicular to the first dividing line. A split ratio that excludes supported split ratios in such a way that splits the predetermined sub-block into two sub-blocks, at least one of which has an aspect ratio outside an allowable aspect ratio range Compare.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則中的一個取決於垂直於該第一分割線的該預定子區塊的該寬度以排除支持的分割比,以這樣的一方式排除支持分割比的一預定子集合,其取決於該預定子區塊所屬的該遞歸雙分割的該分割級別。In some embodiments a block-based decoder is disclosed, wherein one of the one or more rules depends on the width of the predetermined sub-block perpendicular to the first split line to exclude supported split ratios, In such a way, a predetermined subset of supported partitioning ratios is excluded, which depends on the partitioning level of the recursive dual partitioning to which the predetermined sub-block belongs.
在一些實施例中揭示一種基於區塊解碼器,其中,該一個或多個規則中的一個規則根據該圖片區塊的一個或多個其他子區塊的一另一分割線的一另一分割方向以及一另一分割比來排除所支持的分割比,從其經由該遞歸雙分獲得該預定子區塊,其係藉由沿著該另一分割線和/或該圖片區塊的一個或多個甚至另一子區塊的一另一分割線的一甚至另一分割方向以及一甚至另一分割比,來分割該一個或多個另一子區塊,其係藉由從一個或多個其他子區塊中的任何一個進行該遞歸雙分割而被獲得的,從其該預定子區塊也藉由該遞歸雙分割而被獲得。In some embodiments, a block-based decoder is disclosed, wherein one of the one or more rules is based on another partitioning of another partitioning line of one or more other sub-blocks of the picture block. direction and an additional partitioning ratio to exclude supported partitioning ratios from which the predetermined sub-block is obtained via the recursive bisection by one or more along the other partitioning line and/or the picture block One or more other sub-blocks are divided by one or more dividing directions and one or more dividing ratios of another dividing line of one or more other sub-blocks by dividing the one or more other sub-blocks from one or more Any one of the other sub-blocks is obtained by performing the recursive double split, from which the predetermined sub-block is also obtained by the recursive double split.
一種用於以編碼區塊為單位從一資料流解碼一圖片的方法,包括:藉由遞歸雙分割將該圖片的一圖片區塊分割為該編碼區塊,並根據該資料流中的分割信息控制該遞歸雙分割﹔以及設置一第一分割線的一第一分割線方向,藉由該遞歸雙分割沿著該第一分割線將該圖片區塊的一預定分割級別的一預定子區塊分割成一後續分割級別的一對兒子子區塊,取決於一第二分割線的一第二分割線方向,沿著該第二分割線將該圖片區塊的一個先前分割級別的一祖父子區塊分割成該預定的子區塊和另一個子區塊。A method for decoding a picture from a data stream in coded block units, including: dividing a picture block of the picture into the coded block by recursive double partitioning, and dividing the picture into coded blocks according to the segmentation information in the data stream. Control the recursive double split; and set a first split line direction of a first split line, and divide a predetermined sub-block of a predetermined split level of the picture block along the first split line by the recursive double split Split into a pair of son sub-blocks of a subsequent split level, depending on the direction of a second split line along which a grandparent sub-region of a previous split level of the picture block is The block is divided into the predetermined sub-block and another sub-block.
一種計算機程式,具有用於在一計算機上運行時執行根據前述之方法的一程式代碼。A computer program has a program code for executing the method according to the foregoing when running on a computer.
一種基於區塊的編碼器,用於以編碼以區塊為單位將一圖片編碼為一資料流,其被配置為:藉由遞歸雙分割將該圖片的一圖片區塊分割為該編碼區塊,並根據分割信息控制該遞歸雙分割並將該分割信息***該資料流;設置一第一分割線的一第一分割線方向,藉由該遞歸雙分割沿著該第一分割線將該圖片區塊的一預定分割級別的一預定子區塊分割成一後續分割級別的一對兒子子區塊,取決於一第二分割線的一第二分割線方向,沿著該第二分割線將該圖片區塊的一個先前分割級別的一祖父子區塊分成該預定的子區塊和另一個子區塊。A block-based encoder is used to encode a picture into a data stream in units of blocks, and is configured to: divide a picture block of the picture into the encoding block by recursive double partitioning. , and control the recursive double segmentation according to the segmentation information and insert the segmentation information into the data stream; set a first segmentation line direction of a first segmentation line, and use the recursive double segmentation to divide the picture along the first segmentation line. A predetermined sub-block of a predetermined division level of the block is divided into a pair of sub-sub-blocks of a subsequent division level, depending on a second dividing line direction of a second dividing line, and the second dividing line is divided along the second dividing line. A grandparent sub-block of a previous partition level of the picture block is divided into the predetermined sub-block and another sub-block.
一種用於以編碼區塊為單位將一圖片編碼成一資料流的方法,包括:藉由遞歸雙分割將該圖片的一圖片區塊分割為該編碼區塊,並根據分割信息控制該遞歸雙分割並將該分割信息***該資料流;設置一第一分割線的一第一分割線方向,藉由該遞歸雙分割沿著該第一分割線將該圖片區塊的一預定分割級別的一預定子區塊分割成一後續分割級別的一對兒子子區塊,取決於一第二分割線的一第二分割線方向,沿著該第二分割線將該圖片區塊的一個先前分割級別的一祖父子區塊分成該預定的子區塊和另一個子區塊。A method for encoding a picture into a data stream in units of encoding blocks, including: dividing a picture block of the picture into the encoding block by recursive double partitioning, and controlling the recursive double partitioning according to the partitioning information And insert the segmentation information into the data stream; set a first segmentation line direction of a first segmentation line, and use the recursive double segmentation to divide a predetermined segmentation level of the picture block along the first segmentation line. The sub-block is divided into a pair of sub-sub-blocks of a subsequent partition level, depending on a second partition line direction of a second partition line along which a pair of sub-blocks of a previous partition level of the picture block are divided. The grandparent subblock is divided into the predetermined subblock and another subblock.
一種計算機程式,具有用於在計算機上運行時執行前述之方法的程式代碼。A computer program having program code for executing the aforementioned method when running on a computer.
一種基於區塊的解碼器,用於以編碼區塊為單位從一資料流解碼一圖片,被配置為:藉由遞歸雙分割將該圖片的一圖片區塊分割為該編碼區塊,並根據該資料流中的分割信息控制該遞歸雙分割,其中該遞歸雙分割的該控制包括控制相對於該圖片區塊的一預定子區塊的該雙分割,並依據是否該預定子區塊要被分割或者將其保留為不分割,一分割線的一分割線方向,在其中該圖片區塊的該預定子區塊將藉由該遞歸雙分割來分割,和/或一分割比,在其中垂直於該分割線的該圖片區塊的該預定子區塊的一寬度被該分割線穿過;其中,該基於區塊的解碼器支持一支持分割比的集合,用於分割該預定的子區塊,並且被配置為針對沿著具有一預定分割線方向的一分割線的該預定子區塊的一分割,而根據一個或多個規則從支持分割比的該集合中排除支持的分割比,以獲得支持分割比的一縮減集合, 其中,該基於區塊的解碼器被配置為根據支持分割比的該縮減集合,來控制相對於該圖片區塊的該預定子區塊的該雙分割。在一些實施例中揭示一種基於區塊的解碼器,被配置為根據該縮減集合的一基數,減少用於控制相對於該圖片區塊的該預定子區塊的該遞歸雙分割的該分割信息的一片段。A block-based decoder is used to decode a picture from a data stream in units of encoding blocks, and is configured to: divide a picture block of the picture into the encoding block by recursive double partitioning, and according to Split information in the data stream controls the recursive double splitting, wherein the control of the recursive double splitting includes controlling the double splitting relative to a predetermined sub-block of the picture block and based on whether the predetermined sub-block is to be Split, or leave it unsplit, a split line direction in which the predetermined sub-block of the picture block will be split by the recursive double split, and/or a split ratio in which vertical A width of the predetermined sub-block of the picture block at the dividing line is crossed by the dividing line; wherein the block-based decoder supports a set of supported dividing ratios for dividing the predetermined sub-region block, and configured to exclude a supported split ratio from the set of supported split ratios according to one or more rules for a split of the predetermined sub-block along a split line having a predetermined split line direction, A reduced set of supported partitioning ratios is obtained, wherein the block-based decoder is configured to control the dual partitioning relative to the predetermined sub-block of the picture block according to the reduced set of supported partitioning ratios. In some embodiments, a block-based decoder is disclosed, configured to reduce the partitioning information for controlling the recursive dual partitioning with respect to the predetermined sub-block of the picture block according to a base of the reduction set. a fragment of.
在一些實施例中揭示一種基於區塊的解碼器,其被配置為在解析該分割信息的該片段時,跳過指示該預定子區塊是要分割還是不要分割的一旗標、或者如果該縮減集合是空的話則指示該分割線的該分割方向的一旗標,和/或在解析該分割信息的該片段時,如果該縮減集合的該基數為1,則跳過指示該分割線的該分割比的一索引,和/或在對該索引進行熵解碼時,改變該索引的可能值的一域以專門地參考該縮減集合,或者針對該縮減集合的支持的分割比與所支持的分割比的該集合相比,花費更短的字碼長度。In some embodiments, a block-based decoder is disclosed, which is configured to, when parsing the segment of the segmentation information, skip a flag indicating whether the predetermined sub-block is to be split or not to be split, or if the A flag indicating the dividing direction of the dividing line if the reduction set is empty, and/or when parsing the fragment of the dividing information, if the cardinality of the reduction set is 1, skipping the flag indicating the dividing line an index to the split ratio, and/or when entropy decoding the index, changing a field of possible values of the index to specifically reference the reduced set, or the supported split ratios for the reduced set to be the same as the supported split ratio The segmentation takes a shorter word length than the collection.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則中的一個取決於垂直於該預定分割方向的該預定子區塊的該寬度,以排除支持的分割比。In some embodiments a block-based decoder is disclosed, wherein one of the one or more rules depends on the width of the predetermined sub-block perpendicular to the predetermined split direction to exclude supported split ratios.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則中的一個規則根據垂直於該預定分割方向的該預定子區塊的該寬度以排除支持的分割比,以這樣的一方式排除支持的分割比,其將該寬度分成兩個兒子子區塊的寬度,在樣本中不是一預定整數的一整數倍。In some embodiments, a block-based decoder is disclosed, wherein one of the one or more rules excludes supported split ratios based on the width of the predetermined sub-block perpendicular to the predetermined split direction, to Such an approach excludes support for split ratios that divide the width into two sub-blocks whose widths are not multiples of a predetermined integer in the sample.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則中的一個規則根據垂直於該預定分割方向的該預定子區塊的該寬度來排除支持的分割比,以這樣的一方式排除支持的分割比,其將該寬度分成兩個兒子子區塊的寬度,在樣本中彼此是一整數倍。In some embodiments a block-based decoder is disclosed, wherein one of the one or more rules excludes supported split ratios based on the width of the predetermined sub-block perpendicular to the predetermined split direction, to Such an approach excludes support for a split ratio that divides the width into two sub-blocks whose widths are integer multiples of each other in the sample.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則中的一個規則根據垂直於該預定分割方向的該預定子區塊的該寬度來排除支持的分割比,以這樣的一方式排除支持的分割比,其將該預定的子區塊分成兩個兒子子區塊,其中至少一個太小而不能完全包圍至少一個預定的最小尺寸區塊中的至少一個的一集合。In some embodiments a block-based decoder is disclosed, wherein one of the one or more rules excludes supported split ratios based on the width of the predetermined sub-block perpendicular to the predetermined split direction, to Such a manner excludes supporting a split ratio that divides the predetermined sub-block into a set of two sub-blocks, at least one of which is too small to completely encompass at least one of the at least one predetermined minimum size block .
在一些實施例中揭示一種基於區塊的解碼器(10), 其中,該一個或多個規則中的一個規則根據垂直於該預定分割方向的該預定子區塊的該寬度來排除支持的分割比,以這樣的一方式排除支持的分割比,其將該預定的子區塊分成兩個兒子子區塊,其中至少一個超過一預定寬高比。In some embodiments a block-based decoder (10) is disclosed, wherein one of the one or more rules excludes supported partitions based on the width of the predetermined sub-block perpendicular to the predetermined partition direction. ratio, in such a way that supported split ratios are excluded, which divide the predetermined sub-block into two child sub-blocks, at least one of which exceeds a predetermined aspect ratio.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則中的一個規則根據垂直於該預定分割方向的該預定子區塊的該寬度來排除所支持的分割比,以這樣的一方式排除支持分割比的一預定子集合,其取決於該預定子區塊所屬的該遞歸雙分割的該分割級別。In some embodiments a block-based decoder is disclosed, wherein one of the one or more rules excludes supported split ratios based on the width of the predetermined sub-block perpendicular to the predetermined split direction, In such a way, a predetermined subset of supported partitioning ratios is excluded, which depends on the partitioning level of the recursive dual partitioning to which the predetermined sub-block belongs.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則之一根據該圖片區塊的一個或多個其他子區塊的一另一分割線的一另一分割方向以及一另一分割比來排除所支持的分割比,從其經由該遞歸雙分割獲得該預定子區塊,其係藉由沿著該另一分割線分割一個或多個另外的子區塊。In some embodiments, a block-based decoder is disclosed, wherein one of the one or more rules is based on another dividing direction of another dividing line of one or more other sub-blocks of the picture block. and a further partitioning ratio excluding the supported partitioning ratios from which the predetermined sub-block is obtained via the recursive double partitioning by partitioning one or more further sub-blocks along the further partitioning line.
在一些實施例中揭示一種基於區塊的解碼器,其被配置為取決於支持分割比的該縮減集合,其係藉由該分割信息向該縮減集合發送信號以限制支持分割比,俾來控制相對於該圖片區塊的該預定子區塊的該雙分割,並且該一個或多個規則的一個排除支持的分割比,以便減少該分割信息的多個冗餘設置的一數量。In some embodiments, a block-based decoder is disclosed that is configured to control the reduced set depending on the supported partitioning ratio by signaling the reduced set with the partitioning information to limit the supported partitioning ratio. The dual partitioning with respect to the predetermined sub-block of the picture block, and one of the one or more rules excludes a supported partitioning ratio in order to reduce a number of redundant settings of the partitioning information.
在一些實施例中揭示一種基於區塊的解碼器,其中,支持分割比的該集合是不可約分分數的一集合, 其中,使得每對分割比和與表示互補的非對稱分割,並且其中,如果對於,,則和,並且其中每個支持的分割比表示一寬度的一比率一第一和第二兒子子區塊中的一個是由沿著具有該預定分割方向的一分割線以相對於該預定子區塊的該寬度的該分割比來分割該預定子區塊所產生的,如果該預定的分割方向是垂直的,兩者測量都垂直於該分割方向,以及一上和下兒子子區塊中的一個是由於沿著具有該預定分割方向的一分割線以相對於該預定子區塊的該寬度的該分割比來分割該預定子區塊所產生的,如果該預定的分割方向是水平的,兩者測量都垂直於該分割方向。In some embodiments a block-based decoder is disclosed, wherein the set of supported partitioning ratios is a set of irreducible fractions , in , making each pair of split ratios and and represents a complementary asymmetric partition, and where, if for , , then and , and wherein each supported split ratio represents a ratio of a width of one of the first and second sub-blocks formed by a split line along a split line having the predetermined split direction with respect to the predetermined sub-block. The width of the dividing ratio resulting from dividing the predetermined sub-block, if the predetermined dividing direction is vertical, both measurements are perpendicular to the dividing direction, and one of the upper and lower sub-blocks is Resulting from dividing the predetermined sub-block along a dividing line having the predetermined dividing direction with the dividing ratio relative to the width of the predetermined sub-block, if the predetermined dividing direction is horizontal, both Measurements are perpendicular to the division direction.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則中的一個排除如果該預定的分割方向平行於一分割線的該分割方向,沿此該預定子區塊的該父親子區塊(parent sub-block)被分割,並且如果該預定的子區塊具有一寬度為該父親子區塊寬度的倍,是該父親子區塊的分割比例,支持分割比,其中該父親區塊被分割成該另一個區塊的一分割比,並且在支持分割比的該集合中該父親子區塊的一分割比,和,和/或如果該預定的分割方向平行於一分割線的該分割方向,沿此該預定子區塊的該父親子區塊被分割,並且如果該預定的子區塊具有一寬度該父親子區塊寬度的倍,是該父親區塊的分割比例,支持分割比,其中該父親區塊被分割成該另一個區塊的一分割比,並且在支持分割比的該集合中該父親子區塊的一分割比,和。In some embodiments, a block-based decoder is disclosed, wherein one of the one or more rules excludes the predetermined sub-block along which the predetermined split direction is parallel to the split direction of a split line. The parent sub-block is divided, and if the predetermined sub-block has a width that is the width of the parent sub-block times, Is the split ratio of the parent and sub-blocks, supports the split ratio , where the parent block is split into a split ratio of the other block , and a split ratio of the parent child block in the set that supports split ratios , and , and/or if the predetermined dividing direction is parallel to the dividing direction of a dividing line along which the parent sub-block of the predetermined sub-block is divided, and if the predetermined sub-block has a width The width of the parent and child blocks times, Is the split ratio of the parent block, supports split ratio , where the parent block is split into a split ratio of the other block , and a split ratio of the parent child block in the set that supports split ratios , and .
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個規則中的一個排除一支持的分割比如果該預定的分割方向垂直於一分割線的該分割方向,沿此該預定子區塊的該父親子區塊被分割,並且與該另一個子區塊平行,其係該父親子區塊分割成的,即的一個,其中是該另一個區塊的該分割比。In some embodiments, a block-based decoder is disclosed, wherein one of the one or more rules excludes a supported split ratio if the predetermined split direction is perpendicular to the split direction of a split line along which the The parent sub-block of the predetermined sub-block is divided parallel to the other sub-block into which the parent sub-block is divided, i.e. one of ,in is the split ratio of the other block.
在一些實施例中揭示一種基於區塊的解碼器,其中,該解碼器如前述。In some embodiments, a block-based decoder is disclosed, wherein the decoder is as described above.
在一些實施例中揭示一種用於以編碼區塊為單位從一資料流解碼一圖片的方法,包括:藉由遞歸雙分割將該圖片的一圖片區塊分割為該編碼區塊,並根據該資料流中的分割信息控制該遞歸雙分割,其中該遞歸雙分割的該控制包括根據該圖片區塊的一預定子區塊控制該雙分割,並依據是否該預定子區塊要被分割或者將其保留為不分割,一分割線的一分割線方向,在其中該圖片區塊的該預定子區塊將藉由該遞歸雙分割來分割,和/或一分割比,在其中垂直於該分割線的該圖片區塊的該預定子區塊的一寬度被該分割線穿過;支持一支持分割比的集合,用於分割該預定的子區塊,並且被配置為針對沿著具有一預定分割線方向的一分割線的該預定子區塊的一分割,而根據一個或多個規則從支持分割比的該集合中排除支持的分割比,獲得支持分割比的一縮減集合,根據支持分割比的該縮減集合,來控制相對於該圖片區塊的該預定子區塊的該雙分割。In some embodiments, a method for decoding a picture from a data stream in coding block units is disclosed, including: dividing a picture block of the picture into coding blocks by recursive double partitioning, and dividing the picture into coding blocks according to the The splitting information in the data stream controls the recursive double splitting, wherein the control of the recursive double splitting includes controlling the double splitting according to a predetermined sub-block of the picture block, and based on whether the predetermined sub-block is to be divided or will be It remains unsplit, a split line direction in which the predetermined sub-block of the picture block will be split by the recursive double split, and/or a split ratio in which it is perpendicular to the split A width of the predetermined sub-block of the picture block of the line is crossed by the dividing line; supports a set of supported division ratios for dividing the predetermined sub-block, and is configured to have a predetermined sub-block along the A partition of the predetermined sub-block of a partition line in the direction of the partition line, and a supported partition ratio is excluded from the set of supported partition ratios according to one or more rules to obtain a reduced set of supported partition ratios, according to the supported partition The reduced set of ratios is used to control the dual partitioning with respect to the predetermined sub-block of the picture block.
在一些實施例中揭示一種計算機程式,具有用於在一計算機上運行時執行前述之一方法的一程式代碼。In some embodiments, a computer program is disclosed, having a program code for executing one of the foregoing methods when running on a computer.
在一些實施例中揭示一種基於區塊的編碼器,用於以編碼區塊為單位將一圖片編碼成一資料流,其被配置為:藉由遞歸雙分割將該圖片的一圖片區塊分割為該編碼區塊,並根據分割信息控制該遞歸雙分割並將該分割信息***該資料流,其中該遞歸雙分割的該控制包括根據該圖片區塊的一預定子區塊控制該雙分割,並依據是否該預定子區塊要被分割或者將其保留為不分割,一分割線的一分割線方向,在其中該圖片區塊的該預定子區塊將藉由該遞歸雙分割來分割,以及一分割比,在其中垂直於該分割線的該圖片區塊的該預定子區塊的一寬度被該分割線穿過;其中,該基於區塊的編碼器支持一支持分割比的集合,用於分割該預定的子區塊,並且被配置為針對沿著具有一預定分割線方向的一分割線的該預定子區塊的一分割,而根據一個或多個規則從支持分割比的該集合中排除支持的分割比,以獲得支持分割比的一縮減集合,其中,該基於區塊的編碼器被配置為根據支持分割比的該縮減集合,來控制相對於該圖片區塊的該預定子區塊的該雙分割。In some embodiments, a block-based encoder is disclosed for encoding a picture into a data stream in coding block units, and is configured to: divide a picture block of the picture into the encoding block, and controlling the recursive dual partitioning according to partitioning information and inserting the partitioning information into the data stream, wherein the control of the recursive dual partitioning includes controlling the dual partitioning according to a predetermined sub-block of the picture block, and a split line direction of a split line in which the predetermined sub-block of the picture block will be split by the recursive double split, depending on whether the predetermined sub-block is to be split or left unsplit, and a split ratio in which a width of the predetermined sub-block of the picture block perpendicular to the split line is crossed by the split line; wherein the block-based encoder supports a set of supported split ratios, with for splitting the predetermined sub-block and being configured to target a split of the predetermined sub-block along a split line having a predetermined split line direction from the set of supported split ratios according to one or more rules Exclude supported partitioning ratios from the list to obtain a reduced set of supported partitioning ratios, wherein the block-based encoder is configured to control the predetermined subdivision relative to the picture block according to the reduced set of supported partitioning ratios. This double split of blocks.
在一些實施例中揭示一種基於區塊的編碼器,其中,該基於區塊的編碼器被配置為以一種方式根據支持分割比的該縮減集合來控制關於該圖片區塊的該預定子區塊的該雙分割,以便該資料流中的該分割信息取決於支持分割比的該縮減集合。In some embodiments a block-based encoder is disclosed, wherein the block-based encoder is configured to control the predetermined sub-blocks with respect to the picture block in a manner based on the reduced set of supported partition ratios of the double split, so that the split information in the data stream depends on the reduced set of supported split ratios.
在一些實施例中揭示一種用於以編碼區塊為單位將一圖片編碼成一資料流的方法,被配置為藉由遞歸雙分割將該圖片的一圖片區塊分割為該編碼區塊,並根據分割信息控制該遞歸雙分割並將該分割信息***該資料流,其中該遞歸雙分割的該控制包括控制相對於該圖片區塊的一預定子區塊的該雙分割,並依據是否該預定子區塊要被分割或者將其保留為不分割,一分割線的一分割線方向,在其中該圖片區塊的該預定子區塊將藉由該遞歸雙分割來分割,和一分割比,在其中垂直於該分割線的該圖片區塊的該預定子區塊的一寬度被該分割線穿過;支持一支持分割比的集合,用於分割該預定的子區塊,並且被配置為針對沿著具有一預定分割線方向的一分割線的該預定子區塊的一分割,而根據一個或多個規則從支持分割比的該集合中排除支持的分割比,獲得支持分割比的一縮減集合,根據支持分割比的該縮減集合,來控制相對於該圖片區塊的該預定子區塊的該雙分割。In some embodiments, a method for encoding a picture into a data stream in coding block units is disclosed, which is configured to divide a picture block of the picture into the coding block by recursive double partitioning, and according to Split information controls the recursive double splitting and inserts the splitting information into the data stream, wherein the control of the recursive double splitting includes controlling the double splitting relative to a predetermined sub-block of the picture block, and depending on whether the predetermined sub-block A block is to be split or left unsplit, a split line direction in which the predetermined sub-blocks of the picture block will be split by the recursive double split, and a split ratio, in Wherein a width of the predetermined sub-block of the picture block perpendicular to the dividing line is crossed by the dividing line; a set of supporting division ratios is supported for dividing the predetermined sub-block, and is configured for A partitioning of the predetermined sub-block along a partitioning line having a predetermined partitioning line direction, and excluding the supported partitioning ratios from the set of supported partitioning ratios according to one or more rules, obtains a reduction of the supported partitioning ratios A set to control the dual partitioning with respect to the predetermined sub-block of the picture block according to the reduced set of supported partition ratios.
在一些實施例中揭示一種計算機程式,具有一程式代碼,用於在一計算機上運行時執行前述之一方法。In some embodiments, a computer program is disclosed, having a program code for executing one of the foregoing methods when running on a computer.
在一些實施例中揭示一種基於區塊的解碼器,用於以編碼區塊為單位從一資料流解碼一圖片,被配置為經由遞歸分割沿著一編碼次序將該圖片的一個或多個圖片區塊分割為該編碼區塊,並根據該資料流中的分割信息控制該遞歸分割,從來自該分割信息的上下文自適應地熵解碼使用依賴於一個或多個相鄰編碼區塊的一大小的一上下文來控制一預定圖片區塊的一預定子區塊的一分割的一個或多個語法元素,其中在該預定子區塊的一鄰域中,以該編碼順序將該圖片分割為該預定子區塊的一個或多個相鄰編碼區塊。In some embodiments, a block-based decoder is disclosed for decoding a picture from a data stream in coding block units, configured to divide one or more pictures of the picture along a coding order via recursive partitioning. The block is partitioned into the coded blocks, and the recursive partitioning is controlled based on the partition information in the data stream, and the entropy decoding is adaptively decoded from the context from the partition information using a size that depends on one or more adjacent coded blocks. One or more syntax elements for controlling a partitioning of a predetermined sub-block of a predetermined picture block, wherein in a neighborhood of the predetermined sub-block, the picture is partitioned in the encoding order as One or more adjacent coding blocks of the predetermined sub-block.
在一些實施例中揭示一種基於區塊的解碼器,被配置為:將該圖片預分割成圖片區塊的一陣列,和其中該編碼順序以一光柵掃描順序(raster scan order)遍歷該圖片區塊。In some embodiments, a block-based decoder is disclosed, configured to pre-partition the picture into an array of picture blocks, and wherein the encoding sequence traverses the picture areas in a raster scan order. block.
在一些實施例中揭示一種該基於區塊的解碼器,其中,在每個圖片區塊內,該編碼順序遵循一深度優先或廣度優先的遍歷順序。In some embodiments, the block-based decoder is disclosed, wherein within each picture block, the encoding order follows a depth-first or breadth-first traversal order.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個語法元素控制關於一預定子區塊的該遞歸雙分割,並根據是否該預定子區塊要被分割或者將其保留為不分割,一分割線的一分割方向,在其中該圖片區塊的該預定子區塊將藉由該遞歸雙分割來分割,和一分割比,在其中該圖片區塊的該預定子區塊的一寬度,垂直於該寬度,其被該分割線穿過。In some embodiments, a block-based decoder is disclosed, wherein the one or more syntax elements control the recursive dual splitting with respect to a predetermined sub-block, and based on whether the predetermined sub-block is to be split or divided into Left unsplit, a split direction along a split line in which the predetermined sub-block of the picture block will be split by the recursive double split, and a split ratio in which the predetermined sub-block of the picture block will be split A width of the block, perpendicular to the width, which is crossed by the dividing line.
在一些實施例中揭示一種基於區塊的解碼器,其中,該一個或多個語法元素中的一個在一分割比方面控制相對於一預定子區塊的該遞歸雙分割,在該分割比下,該圖片區塊的該預定子區塊的一寬度,垂直於該寬度,且其被一分割線穿過,在該分割線處,該圖片區塊的該預定子區塊將藉由該遞歸雙分割來分割,並且其中該一個語法元素的該上下文取決於相鄰編碼區塊的該大小,在該預定子區塊的一鄰域中,以該編碼順序將該圖片分割為該預定子區塊的該相鄰編碼區塊。In some embodiments a block-based decoder is disclosed, wherein one of the one or more syntax elements controls the recursive dual partitioning with respect to a predetermined sub-block in terms of a partitioning ratio at which , a width of the predetermined sub-block of the picture block is perpendicular to the width and is crossed by a dividing line. At the dividing line, the predetermined sub-block of the picture block will be passed through the recursion split by double splitting, and wherein the context of the one syntax element depends on the size of adjacent coding blocks, splitting the picture into the predetermined sub-regions in the coding order in a neighborhood of the predetermined sub-blocks The adjacent coding block of the block.
在一些實施例中揭示一種基於區塊的解碼器,其中,該解碼器如前述。In some embodiments, a block-based decoder is disclosed, wherein the decoder is as described above.
在一些實施例中揭示一種基於區塊的解碼器,其中,該解碼器如前述。In some embodiments, a block-based decoder is disclosed, wherein the decoder is as described above.
在一些實施例中揭示一種用於以編碼區塊為單位從一資料流解碼一圖片的方法,包括:經由遞歸分割沿著一編碼次序將該圖片的一個或多個圖片區塊分割為該編碼區塊,並根據該資料流中的分割信息控制該遞歸分割,和從來自該分割信息的上下文自適應地熵解碼使用依賴於一個或多個相鄰編碼區塊的一大小的一上下文來控制一預定圖片區塊的一預定子區塊的一分割的一個或多個語法元素,其中在該預定子區塊的一鄰域中,以該編碼順序將該圖片分割為該預定子區塊的一個或多個相鄰編碼區塊。In some embodiments, a method for decoding a picture from a data stream in coded block units is disclosed, comprising: dividing one or more picture blocks of the picture along a coding order via recursive partitioning for the coded blocks, and the recursive partitioning is controlled based on the partitioning information in the data stream, and the adaptive entropy decoding is controlled from the context from the partitioning information using a context that depends on a size of one or more adjacent coding blocks. One or more syntax elements of a partition of a predetermined sub-block of a predetermined picture block, wherein the picture is partitioned in the encoding order in a neighborhood of the predetermined sub-block One or more adjacent coding blocks.
在一些實施例中揭示一種計算機程式,具有用於在一計算機上運行時執行前述之一方法的一程式代碼。In some embodiments, a computer program is disclosed, having a program code for executing one of the foregoing methods when running on a computer.
在一些實施例中揭示一種基於區塊的編碼器,用於以編碼區塊為單位從一資料流編碼一圖片,被配置為:經由遞歸分割沿著一編碼次序將該圖片的一個或多個圖片區塊分割為該編碼區塊,並根據分割信息控制該遞歸分割並將該分割信息***該資料流,上下文自適應熵編碼將一個或多個語法元素編碼成該分割信息,該語法元素使用取決於一個或多個相鄰編碼區塊的一大小的一上下文來控制一預定圖片區塊的一預定子區塊的一分割,其中在該預定子區塊的一鄰域中,以該編碼順序將該圖片分割為該預定子區塊的一個或多個相鄰編碼區塊。In some embodiments, a block-based encoder is disclosed for encoding a picture from a data stream in encoding block units, and is configured to: divide one or more of the picture along an encoding order via recursive partitioning. The picture block is divided into the coding block, and the recursive division is controlled according to the division information and the division information is inserted into the data stream. The context adaptive entropy coding encodes one or more syntax elements into the division information. The syntax element uses Controlling a partitioning of a predetermined sub-block of a predetermined picture block depending on a context of a size of one or more adjacent coding blocks, wherein in a neighborhood of the predetermined sub-block, with the coding The picture is sequentially divided into one or more adjacent coding blocks of the predetermined sub-block.
在一些實施例中揭示一種用於以編碼區塊為單位從一資料流編碼一圖片的方法,包括:經由遞歸分割沿著一編碼次序將該圖片的一個或多個圖片區塊分割為該編碼區塊,並根據分割信息控制該遞歸分割並將該分割信息***該資料流,上下文自適應熵編碼將一個或多個語法元素編碼成該分割信息,該語法元素使用取決於一個或多個相鄰編碼區塊的一大小的一上下文來控制一預定圖片區塊的一預定子區塊的一分割,其中在該預定子區塊的一鄰域中,以該編碼順序將該圖片分割為該預定子區塊的一個或多個相鄰編碼區塊。In some embodiments, a method for encoding a picture from a data stream in code block units is disclosed, comprising: dividing one or more picture blocks of the picture along a coding order via recursive partitioning. block, and controls the recursive segmentation according to the segmentation information and inserts the segmentation information into the data stream. Context adaptive entropy coding encodes one or more syntax elements into the segmentation information. The use of the syntax element depends on one or more phases. A context of a size adjacent to the coding block controls a partitioning of a predetermined sub-block of a predetermined picture block, wherein in a neighborhood of the predetermined sub-block, the picture is partitioned in the coding order as One or more adjacent coding blocks of the predetermined sub-block.
在一些實施例中揭示一種計算機程式,具有用於在一計算機上運行時執行前述之一方法的一程式代碼。In some embodiments, a computer program is disclosed, having a program code for executing one of the foregoing methods when running on a computer.
在一些實施例中揭示一種基於區塊的解碼器,用於以編碼區塊為單位從一資料流解碼一圖片,被配置為:經由遞歸分割沿著一編碼次序將該圖片的一個或多個圖片區塊分割為該編碼區塊,並根據該資料流中的分割信息控制該遞歸分割,其中該基於區塊的解碼器支持至少兩種模式,在這兩種模式之間,該基於區塊的解碼器是可切換的,並且在執行該分割的自由度方面不同。In some embodiments, a block-based decoder is disclosed for decoding a picture from a data stream in coding block units, and is configured to: divide one or more of the picture along a coding order via recursive partitioning. The picture block is divided into the coding block, and the recursive division is controlled according to the division information in the data stream, wherein the block-based decoder supports at least two modes, and between the two modes, the block-based decoder The decoders are switchable and differ in the degrees of freedom they have to perform this segmentation.
在一些實施例中揭示一種基於區塊的解碼器,其中,該基於區塊的解碼器)被配置為使得該至少兩種模式在以下有一個或多個中不同:一最小區塊大小,其必須適合每個編碼區塊,一最大分割樹深度,在一當前圖片區塊的一當前子區塊的一分割之後的一最大分割樹深度,其中該分割沿著一分割線,其係垂直於一父親區塊的一分割線的,該當前子子區塊(sub-subblock)是該父親區塊的子區塊,一當前圖片的子區塊的一最大區塊大小,其中允許非對稱分割,由一當前圖片區塊的一當前子區塊的一分割所產生的兒子子區塊的一最大寬高比,由一當前圖片區塊的一當前子區塊的一分割所產生的兒子子區塊的一最小寬高比,一當前圖片區塊的預設分割,其根據該分割信息以從該遞歸雙分割的一開始,用於分割一當前圖片區塊的一當前子區塊的支持分割比的一集合;沿著具有一預定分割方向的一分割線的一當前子區塊的一分割,而根據一個或多個規則從支持分割比的該集合中排除支持的分割比。In some embodiments, a block-based decoder is disclosed, wherein the block-based decoder is configured such that the at least two modes differ in one or more of: a minimum block size, Must fit for each coding block, a maximum partition tree depth, a maximum partition tree depth after a partition of a current sub-block of a current picture block, where the partition is along a partition line, which is perpendicular to a dividing line of a parent block, the current sub-subblock (sub-subblock) is a sub-block of the parent block, and a maximum block size of a sub-block of the current picture, in which asymmetric partitioning is allowed , a maximum aspect ratio of a child sub-block resulting from a partition of a current sub-block of a current picture block, a maximum aspect ratio of a child sub-block produced by a partition of a current sub-block of a current picture block A minimum aspect ratio of the block, a default partition of the current picture block, based on the partition information to start from the first of the recursive double partition, support for splitting a current sub-block of the current picture block A set of split ratios; a split of a current sub-block along a split line with a predetermined split direction, and supported split ratios are excluded from the set of supported split ratios according to one or more rules.
在一些實施例中揭示一種基於區塊的解碼器,其中,該基於區塊的解碼器被配置為在該至少兩個模式之間切換,其根據一個或多個該資料流中的信令,到目前為止使用的模式的一歷史,一空間預測器,一當前圖片區塊超出一外部或內部圖片邊界的一擴展程度。In some embodiments, a block-based decoder is disclosed, wherein the block-based decoder is configured to switch between the at least two modes based on signaling in one or more of the data streams, A history of the modes used so far, a spatial predictor, and an extent to which the current picture block extends beyond an outer or inner picture boundary.
在一些實施例中揭示一種基於區塊的解碼器,其中,該基於區塊的解碼器被配置為以下列單元為單位,而在至少兩個模式之間切換,一個圖片序列,一圖片的樹根區塊,圖片區塊。In some embodiments, a block-based decoder is disclosed, wherein the block-based decoder is configured to switch between at least two modes in units of the following units, a picture sequence and a picture tree. Root block, picture block.
在一些實施例中揭示一種基於區塊的解碼器,其中,該基於區塊的解碼器如前述。In some embodiments, a block-based decoder is disclosed, wherein the block-based decoder is as described above.
在一些實施例中揭示一種基於區塊的解碼器,另外根據前述。In some embodiments a block-based decoder is disclosed, further in accordance with the foregoing.
在一些實施例中揭示一種基於區塊的解碼器,另外根據前述。In some embodiments a block-based decoder is disclosed, further in accordance with the foregoing.
在一些實施例中揭示一種用於以編碼區塊為單位從一資料流解碼一圖片的方法,被配置為經由遞歸分割沿著一編碼次序將該圖片的一個或多個圖片區塊分割為該編碼區塊,並根據該資料流中的分割信息控制該遞歸分割,其中該基於區塊的解碼器支持至少兩種模式,在這兩種模式之間,該基於區塊的解碼器是可切換的,並且在執行該分割的自由度方面不同。In some embodiments, a method for decoding a picture from a data stream in coding block units is disclosed, configured to partition one or more picture blocks of the picture along a coding order via recursive partitioning as Encoding blocks, and controlling the recursive segmentation according to the segmentation information in the data stream, wherein the block-based decoder supports at least two modes, and the block-based decoder is switchable between the two modes. , and differ in the degrees of freedom to perform this segmentation.
在一些實施例中揭示一種計算機程式,具有用於在一計算機上運行時執行前述之一方法的一程式代碼。In some embodiments, a computer program is disclosed, having a program code for executing one of the foregoing methods when running on a computer.
在一些實施例中揭示一種基於區塊的編碼器,用於以編碼區塊為單位從一資料流編碼一圖片,被配置為:經由遞歸分割沿著一編碼次序將該圖片的一個或多個圖片區塊分割為該編碼區塊,並根據分割信息控制該遞歸分割並將該分割信息***該資料流,其中該基於區塊的編碼器支持至少兩種模式,在這兩種模式之間,該基於區塊的編碼器是可切換的,並且在執行該分割的自由度方面不同。In some embodiments, a block-based encoder is disclosed for encoding a picture from a data stream in encoding block units, and is configured to: divide one or more of the picture along an encoding order via recursive partitioning. The picture block is divided into the coding block, and the recursive division is controlled according to the division information and the division information is inserted into the data stream, wherein the block-based encoder supports at least two modes, between the two modes, The block-based encoders are switchable and differ in the degrees of freedom in performing the segmentation.
在一些實施例中揭示一種用於以編碼區塊為單位從一資料流編碼一圖片的方法,包括:經由遞歸分割沿著一編碼次序將該圖片的一個或多個圖片區塊分割為該編碼區塊,並根據分割信息控制該遞歸分割並將該分割信息***該資料流,支持在執行該分割的自由度方面不同的至少兩種模式。In some embodiments, a method for encoding a picture from a data stream in code block units is disclosed, comprising: dividing one or more picture blocks of the picture along a coding order via recursive partitioning. blocks, and controls the recursive segmentation based on segmentation information and inserts the segmentation information into the data stream, supporting at least two modes that differ in degrees of freedom in performing the segmentation.
在一些實施例中揭示一種計算機程式,具有用於在一計算機上運行時執行前述之一方法的一程式代碼。In some embodiments, a computer program is disclosed, having a program code for executing one of the foregoing methods when running on a computer.
在一些實施例中揭示一種用於解碼指向來自一資料流的一分割比的一索引的解碼器,其被配置為藉由根據一個或多個規則去除分割比來減少分割比的一基本列表,以便獲得分割比的一縮減列表,其中該基本列表對應於一個二叉樹樹葉,其與該基本列表的相應分割比相關聯,並且該縮減列表對應於由該二叉樹產生的一個縮減二叉樹,其經由從樹葉到主根節點,移除該二叉樹中其該子節點不屬於該縮減列表的每個節點,並且為代替具有僅一個未移除的子節點的該二叉樹的每個節點,將該未移除的子節點直接附加到該二叉樹的該節點,相應中間節點係該節點的子節點,其中,該縮減二叉樹的第一分支與一第一個二元決策(bin)值相關聯,並且該縮減二叉樹的第二分支與一第二個二元決策值相關聯,並且該縮減列表的每個分割比與一個bin值序列相關聯的,其對應於與該分支相關聯的一個二元決策值的序列,該分支在該縮減二叉樹中從該縮減二叉樹的一主根節點導向與該相應的分割比相關聯的該縮減二叉樹的一樹葉,針對對應於一個或多個二元決策的一序列的一個二元決策字串進行熵解碼,從該縮減二叉樹的該主根節點開始,遍歷該縮減二叉樹到該縮減二叉樹的樹葉之一,該二元決策字串的每個二元決策對應於由一個或多個二元決策的該序列所遍歷的該縮減二叉樹的該節點的一個;使用該縮減二叉樹作為一個二值化方案,對該二元決策字串進行去二值化,以便獲得該索引。In some embodiments, a decoder is disclosed for decoding an index pointing to a partitioning ratio from a data stream configured to reduce a base list of partitioning ratios by removing partitioning ratios according to one or more rules, to obtain a reduced list of splitting ratios, where the base list corresponds to a binary tree leaf associated with the corresponding splitting ratio of the base list, and the reduced list corresponds to a reduced binary tree generated by the binary tree via the leaves from the to the primary root node, remove each node in the binary tree whose child node does not belong to the reduced list, and to replace each node of the binary tree that has only one child node that has not been removed, replace the child node that has not been removed. A node is directly attached to the node of the binary tree, and the corresponding intermediate node is a child node of the node, wherein the first branch of the reduced binary tree is associated with a first binary decision (bin) value, and the first branch of the reduced binary tree is associated with a first binary decision (bin) value. The binary branch is associated with a second binary decision value, and each split ratio of the reduced list is associated with a sequence of bin values that corresponds to a sequence of binary decision values associated with the branch, the Branches in the reduced binary tree lead from a primary root node of the reduced binary tree to a leaf of the reduced binary tree associated with the corresponding split ratio, for a binary decision word corresponding to a sequence of one or more binary decisions The string is entropy decoded, starting from the main root node of the reduced binary tree, and traversing the reduced binary tree to one of the leaves of the reduced binary tree. Each binary decision of the binary decision string corresponds to one or more binary decisions. One of the nodes of the reduced binary tree traversed by the sequence; using the reduced binary tree as a binarization scheme, debinarize the binary decision string to obtain the index.
在一些實施例中揭示一種解碼器,其中,該基本列表是不可縮減分數的一列表, 其中,使得每對分割比和,與和>表示互補的非對稱分割,並且其中,如果對於,,則和,並且該二叉樹由具有2n個樹葉的一個部分樹組成,所有樹葉藉由n-1個中間節點連接到該部分樹的一樹根,該部分樹並且從第一到第二對應於該基本列表的第二到第(2n+1)個成員,一個分離樹葉對應於分割比1/2,該分離樹葉藉由一第一分支連接到一主根節點,該部分樹的該根節點藉由一另一個分支連接到該主根節點。In some embodiments a decoder is disclosed, wherein the base list is a list of irreducible fractions , in , making each pair of split ratios and ,and and > represents a complementary asymmetric partition, and where, if for , , then and , and the binary tree consists of a partial tree with 2n leaves, all leaves are connected to a root of the partial tree by n-1 intermediate nodes, and the partial tree corresponds to the basic list from the first to the second The second to (2n+1)th member, a detached leaf corresponding to the split ratio 1/2, the detached leaf is connected to a main root node by a first branch, and the root node of the partial tree is connected by another Branches are connected to this master root node.
在一些實施例中揭示一種解碼器,其被配置為針對一個或多個二元決策的該序列的至少一個二元決策子集合執行該上下文自適應熵解碼,以及以一種方式決定該熵解碼的一個上下文,使得該上下文的該決定不同於該二元決策子集合的該二元決策中。In some embodiments, a decoder is disclosed that is configured to perform the context-adaptive entropy decoding for at least a binary decision subset of the sequence of one or more binary decisions, and to determine the entropy decoding in a manner A context such that the decision in the context is different from the binary decision in the binary decision subset.
在一些實施例中揭示一種解碼器,其被配置為針對該二元決策字串的至少一個預定二元決策執行執行該上下文自適應熵解碼,並且被配置為:根據該二叉樹中的一位置決定用於對該預定二元決策進行該熵解碼的一上下文,其中對應於該預定二元決策的該縮減二叉樹的該節點源於該二叉樹的該縮減。In some embodiments, a decoder is disclosed that is configured to perform context-adaptive entropy decoding for at least one predetermined binary decision execution of the binary decision string, and is configured to: determine based on a position in the binary tree A context for the entropy decoding of the predetermined binary decision, wherein the node of the reduced binary tree corresponding to the predetermined binary decision originates from the reduction of the binary tree.
在一些實施例中揭示一種解碼器,其中,該索引指向的該分割比用於一遞歸雙分割的分割,並且該解碼器被配置為針對一個或多個二元決策的該序列的至少一個二元決策子集合執行該上下文自適應熵解碼,並且藉由根據與一區塊的一空間鄰域相關聯的編碼參數,從上下文的一集合中選擇相應二元決策的該上下文,為該二元決策子集合的每個二元決策決定用於熵解碼的一上下文,該區塊係該歸雙分割的分割所涉及的。In some embodiments a decoder is disclosed, wherein the split ratio pointed to by the index is for a split of a recursive binary split, and the decoder is configured for at least one binary of the sequence of one or more binary decisions. A subset of meta-decisions performs context-adaptive entropy decoding and selects the context for a corresponding binary decision from a set of contexts based on encoding parameters associated with a spatial neighborhood of a block, for that binary Each binary decision of the decision subset determines a context for entropy decoding of the block involved in the partitioning of the dual partition.
在一些實施例中揭示一種解碼器,其中,該選擇發生的上下文的該集合係對於該二元決策子集合的至少兩個二元決策次子集合(sub-subsets)而言是不同的。In some embodiments a decoder is disclosed, wherein the set of contexts in which the selection occurs is different for at least two binary decision sub-subsets of the binary decision subset.
在一些實施例中揭示一種解碼器,其被配置為:對於至少一個該二元決策子集合,藉由根據該區塊的該空間鄰域中的雙分割樹葉區塊的一大小,從上下文該集合中選擇該至少一個二元決策的該上下文,來決定用於該熵解碼的該上下文,該區塊係該遞歸雙分割的分割所涉及的。In some embodiments a decoder is disclosed that is configured to: for at least one of the binary decision subsets, from the context the The context of the at least one binary decision is selected from the set to determine the context for the entropy decoding of the block involved in the partitioning of the recursive dual partitioning.
在一些實施例中揭示一種解碼器,其被配置為在該遞歸雙分割的分割所涉及的該區塊的該空間鄰域中定位雙分割樹葉區塊,取決於該遞歸雙分割的分割以一種方式涉及的區塊的一分割線方向,使得在該空間鄰域中的該區塊沿著分割線方向而鄰近於該遞歸雙分割的分割涉及的該區塊,並且相對於該分割線方向彼此橫向相鄰。In some embodiments a decoder is disclosed that is configured to locate a bi-partitioned leaf block in the spatial neighborhood of the block involved in the recursive bi-partitioned partitioning, depending on the recursive bi-partitioned partitioning in a A dividing line direction of the block involved in such a way that the block in the spatial neighborhood is adjacent to the block involved in the splitting of the recursive bi-partition along the dividing line direction, and is relative to each other relative to the dividing line direction. Laterally adjacent.
在一些實施例中揭示一種解碼器,其中,該解碼器另外根據前述。In some embodiments a decoder is disclosed, wherein the decoder is additionally in accordance with the foregoing.
在一些實施例中揭示一種解碼器,其中,該解碼器另外根據前述。In some embodiments a decoder is disclosed, wherein the decoder is additionally in accordance with the foregoing.
在一些實施例中揭示一種解碼器,其中,該解碼器另外根據前述。In some embodiments a decoder is disclosed, wherein the decoder is additionally in accordance with the foregoing.
在一些實施例中揭示一種解碼器,其中,該解碼器另外根據前述。In some embodiments a decoder is disclosed, wherein the decoder is additionally in accordance with the foregoing.
在一些實施例中揭示一種用於一從資料流解碼指向一分割比的一索引的方法,被配置為:藉由根據一個或多個規則去除分割比來減少分割比的一基本列表,以便獲得分割比的一縮減列表,其中該基本列表對應於一個二叉樹樹葉,其與該基本列表的相應分割比相關聯,並且該縮減列表對應於由該二叉樹產生的一個縮減二叉樹,其經由從樹葉主根節點,移除該二叉樹中其該子節點不屬於該縮減列表的每個節點,並且為代替具有僅一個未移除的子節點的該二叉樹的每個節點,將該未移除的子節點直接附加到該二叉樹的該節點,相應中間節點係該節點的子節點,其中,該縮減二叉樹的第一分支與一第一個二元決策值相關聯,並且該縮減二叉樹的第二分支與一第二個二元決策值相關聯,並且該縮減列表的每個分割比與一個二元決策值序列係相關聯的,其對應於與該分支相關聯的一個二元決策值的序列,該分支在該縮減二叉樹中從該縮減二叉樹的一主根節點導向與相應的分割比相關聯的該縮減二叉樹的一樹葉,針對對應於一個或多個二元決策的一序列的一個二元決策字串進行熵解碼,從該縮減二叉樹的該主根節點開始,遍歷該縮減二叉樹到該縮減二叉樹的樹葉之一,該二元決策字串的每個二元決策對應於由一個或多個二元決策的該序列所遍歷的該縮減二叉樹的該節點的一個;使用該縮減二叉樹作為一個二值化方案,對該二元決策字串進行去二值化,以便獲得該索引。In some embodiments a method for decoding an index pointing to a partitioning ratio from a data stream is disclosed, configured to reduce a base list of partitioning ratios by removing partitioning ratios according to one or more rules to obtain a reduced list of split ratios, wherein the base list corresponds to a binary tree leaf that is associated with the corresponding split ratio of the base list, and the reduced list corresponds to a reduced binary tree generated by the binary tree via a slave leaf primary root node , remove each node in the binary tree whose child node does not belong to the reduced list, and in place of each node of the binary tree that has only one unremoved child node, append the unremoved child node directly To the node of the binary tree, the corresponding intermediate node is a child node of the node, wherein the first branch of the reduced binary tree is associated with a first binary decision value, and the second branch of the reduced binary tree is associated with a second binary decision values are associated, and each split ratio of the reduced list is associated with a sequence of binary decision values that corresponds to a sequence of binary decision values associated with the branch at which entropy decoding a binary decision string corresponding to a sequence of one or more binary decisions from a primary root node of the reduced binary tree to a leaf of the reduced binary tree associated with a corresponding split ratio , starting from the primary root node of the reduced binary tree, traverse the reduced binary tree to one of the leaves of the reduced binary tree, each binary decision of the binary decision string corresponds to the sequence of one or more binary decisions. One of the nodes of the reduced binary tree traversed; using the reduced binary tree as a binarization scheme, debinarizes the binary decision string to obtain the index.
在一些實施例中揭示一種計算機程式,具有一程式代碼,用於在一計算機上運行時執行前述之一方法。In some embodiments, a computer program is disclosed, having a program code for executing one of the foregoing methods when running on a computer.
在一些實施例中揭示一種用於將指向一分割比的一索引編碼成一資料流的編碼器,被配置為:藉由根據一個或多個規則去除分割比來減少分割比的一基本列表,以便獲得分割比的一縮減列表,其中該基本列表對應於一個二叉樹樹葉,其與該基本列表的相應分割比相關聯,並且該縮減列表對應於由該二叉樹產生的一個縮減二叉樹,其經由從樹葉到主根節點,移除該二叉樹中其該子節點都被移除的每個節點,並且為代替具有僅一個未移除的子節點的該二叉樹的每個節點,將該未移除的子節點直接附加到該二叉樹的該節點,相應中間節點係該節點的子節點,其中,該縮減二叉樹的第一分支與一第一個二元決策值相關聯,並且該縮減二叉樹的第二分支與一第二個二元決策值相關聯,並且該縮減列表的每個分割比與一個二元決策值序列相關聯的,其對應於與該分支相關聯的一個二元決策值的序列,該分支在該縮減二叉樹中從該縮減二叉樹的一主根節點導向與相應的分割比相關聯的該縮減二叉樹的一樹葉,使用該縮減二叉樹作為一個二值化方案將該索引二值化為一個二元決策字串,該二元決策字串對應於一個或多個二元決策的一序列,從該主樹根開始,遍歷該縮減二叉樹到該縮減二叉樹樹葉中的一個,其中該二元決策字串的每個二元決策對應於由一個或多個二元決策的該序列所遍歷的該縮減二叉樹的該節點的一個;對該二元決策字串進行熵編碼。In some embodiments, an encoder for encoding an index pointing to a partitioning ratio into a data stream is disclosed, configured to reduce a base list of partitioning ratios by removing partitioning ratios according to one or more rules, such that Obtain a reduced list of split ratios, wherein the base list corresponds to a binary tree leaf associated with the corresponding split ratio of the base list, and the reduced list corresponds to a reduced binary tree generated by the binary tree via from leaves to The primary root node, removes each node in the binary tree that has that child node removed, and to replace each node of the binary tree that has only one child node that has not been removed, replace the child node that has not been removed directly. Attached to the node of the binary tree, the corresponding intermediate node is a child node of the node, wherein the first branch of the reduced binary tree is associated with a first binary decision value, and the second branch of the reduced binary tree is associated with a first binary decision value. Two binary decision values are associated, and each split ratio of the reduced list is associated with a sequence of binary decision values, which corresponds to a sequence of binary decision values associated with the branch at which Leading from a primary root node of the reduced binary tree to a leaf of the reduced binary tree associated with the corresponding split ratio, using the reduced binary tree as a binarization scheme to binarize the index into a binary decision string , the binary decision string corresponds to a sequence of one or more binary decisions, starting from the main tree root, traversing the reduced binary tree to one of the leaves of the reduced binary tree, wherein each of the binary decision string The binary decision corresponds to one of the nodes of the reduced binary tree traversed by the sequence of one or more binary decisions; the binary decision string is entropy encoded.
在一些實施例中揭示一種用於將指向一分割比的一索引編碼成一資料流的方法,包括:藉由根據一個或多個規則去除分割比來減少分割比的一基本列表,以便獲得分割比的一縮減列表,其中該基本列表對應於一個二叉樹樹葉,其與該基本列表的相應分割比相關聯,並且該縮減列表對應於由該二叉樹產生的一個縮減二叉樹,其經由從樹葉到主根節點,移除該二叉樹中其該子節點都被移除的每個節點,並且為代替具有僅一個未移除的子節點的該二叉樹的每個節點,將該未移除的子節點直接附加到該二叉樹的該節點,相應中間節點係該節點的子節點,其中,該縮減二叉樹的第一分支與一第一個二元決策值相關聯,並且該縮減二叉樹的第二分支與一第二個二元決策值相關聯,並且該縮減列表的每個分割比與一個二元決策值序列相關聯,其對應於與該分支相關聯的一個二元決策值的序列,該分支在該縮減二叉樹中從該縮減二叉樹的一主根節點導向與相應的分割比相關聯的該縮減二叉樹的一樹葉,使用該縮減二叉樹作為一個二值化方案將該索引二值化為一個二元決策字串,該二元決策字串對應於一個或多個二元決策的一序列,從該主樹根開始,遍歷該縮減二叉樹到該縮減二叉樹樹葉中的一個,其中該二元決策字串的每個二元決策對應於由一個或多個二元決策的該序列所遍歷的該縮減二叉樹的該節點的一個;對該二元決策字串進行熵編碼。In some embodiments, a method for encoding an index pointing to a partitioning ratio into a data stream is disclosed, including reducing a base list of partitioning ratios by removing partitioning ratios according to one or more rules to obtain a partitioning ratio. a reduced list of , where the base list corresponds to a binary tree leaf associated with a corresponding split ratio of the base list, and the reduced list corresponds to a reduced binary tree generated by the binary tree via a leaf to a primary root node, Remove each node in the binary tree that has that child node removed, and to replace each node of the binary tree that has only one non-removed child node, append the non-removed child node directly to the The node of the binary tree and the corresponding intermediate node are child nodes of the node, wherein the first branch of the reduced binary tree is associated with a first binary decision value, and the second branch of the reduced binary tree is associated with a second binary decision value. meta-decision values are associated, and each split ratio of the reduced list is associated with a sequence of binary decision values, which corresponds to a sequence of binary decision values associated with the branch in the reduced binary tree from A primary root node of the reduced binary tree leads to a leaf of the reduced binary tree associated with the corresponding split ratio. The index is binarized into a binary decision string using the reduced binary tree as a binarization scheme. The decision string corresponds to a sequence of one or more binary decisions, starting from the root of the main tree and traversing the reduced binary tree to one of the leaves of the reduced binary tree, where each binary decision of the binary decision string corresponds to Perform entropy encoding on the binary decision string at one of the nodes of the reduced binary tree traversed by the sequence of one or more binary decisions.
在一些實施例中揭示一種計算機程式,具有一程式代碼,用於在一計算機上運行時執行根據前述之一方法。In some embodiments, a computer program is disclosed, having a program code for executing one of the foregoing methods when running on a computer.
上述實施例僅代表了本揭露該原理的一說明。應理解,本領域其他技術人員將理解本文所述的佈置和細節的任何修改和變化。上述實施例僅係為了方便說明而舉例而已,本揭露所主張之權利範圍自應以申請專利範圍該為準,而非僅限於上述實施例。The above-described embodiments only represent an illustration of the principles of the present disclosure. It is understood that any modifications and variations in the arrangements and details described herein will be understood by others skilled in the art. The above-mentioned embodiments are only examples for convenience of explanation. The scope of rights claimed in the present disclosure should be subject to the scope of the patent application and is not limited to the above-mentioned embodiments.
參考文獻 [1] ITU-T and ISO/IEC. High efficiency video coding. ITU-T Recommendation H.265 | ISO/IEC 23008‑10 (HEVC), edition 1, 2013; edition 2, 2014. [2] ITU-T and ISO/IEC. Advanced video coding for audiovisual services. ITU-T Recommendation H.264 | ISO/IEC 14406-10 (AVC), edition 1, 2003. [3] J. Chen, E. Alshina, G.J. Sullivan, J.-R. Ohm, J. Boyce, Algorithm Description of Joint Exploration Test Model 6 (JEM 6), JVET, doc. JVET-F1001, April 2017. [4] X. Li, H.-C. Chuang, J. Chen, M. Karczewicz, L. Zhang, X. Zhao, A. Said, Multi-Type-Tree, JVET, doc. JVET-D0117, Oct. 2016. [5] F. Le Léannec, T. Poirier, F. Urban, Asymmetric Coding Units in QTBT, JVET, doc. JVET-D0064, Oct. 2016.References [1] ITU-T and ISO/IEC. High efficiency video coding. ITU-T Recommendation H.265 | ISO/IEC 23008‑10 (HEVC), edition 1, 2013; edition 2, 2014. [2] ITU-T and ISO/IEC. Advanced video coding for audiovisual services. ITU-T Recommendation H.264 | ISO/IEC 14406-10 (AVC), edition 1, 2003. [3] J. Chen, E. Alshina, G.J. Sullivan, J.-R. Ohm, J. Boyce, Algorithm Description of Joint Exploration Test Model 6 (JEM 6), JVET, doc. JVET-F1001, April 2017. [4] X. Li, H.-C. Chuang, J. Chen, M. Karczewicz, L. Zhang, X. Zhao, A. Said, Multi-Type-Tree, JVET, doc. JVET-D0117, Oct. 2016. [5] F. Le Léannec, T. Poirier, F. Urban, Asymmetric Coding Units in QTBT, JVET, doc. JVET-D0064, Oct. 2016.
14:資料流 10:基於區塊的解碼器 12:圖片 18:圖片區塊 16:編碼區塊 16a:預定子區塊 16s1:第一分割線 16s2:第二分割線 44:主根節點 34:二叉樹 42、37:樹葉 30:基本列表 32:縮減列表 50:縮減二叉樹 46:第一分支 48:另一個分支 36:部分樹 38:樹根 40、38:節點 54:樹葉 20:二元決策樹 100:編碼器 110:視頻 120:圖片 140:資料流 220:預測殘差信號形成器 240:預測殘差信號 240’:頻譜域預測殘差信號 280:變換器 320:量化器 240’’:量化的預測殘差信號 340:熵編碼器 360:預測級 380:去量化器 240’’’:頻譜域預測殘差信號 240’’’’:預測殘差信號 400:逆變換器 420:組合器 460:重建信號 440:預測模塊 260:預測信號 200:解碼器 500:熵解碼器 520:去量化器 540:逆變換器 560:組合器 580:預測模塊 110’:視頻 120’:圖片 800、840、840a、860:區塊14:Data flow 10: Block-based decoder 12:Pictures 18: Picture block 16: Encoding block 16a: Predetermined sub-block 16s1: first dividing line 16s2: The second dividing line 44: Main root node 34:Binary tree 42, 37: leaves 30:Basic list 32: Reduce the list 50: Reduce binary tree 46:First branch 48: Another branch 36:Part of the tree 38:Tree roots 40, 38: node 54:Leaves 20:Binary decision tree 100:Encoder 110:Video 120:Pictures 140:Data flow 220: Prediction residual signal former 240: Prediction residual signal 240’: Spectral domain prediction residual signal 280:Converter 320:Quantizer 240’’: Quantized prediction residual signal 340:Entropy encoder 360: Prediction level 380:Dequantizer 240’’: Spectral domain prediction residual signal 240’’’’: Prediction residual signal 400:Inverse converter 420:Combiner 460:Reconstruct signal 440: Prediction module 260: Prediction signal 200:Decoder 500:Entropy decoder 520:Dequantizer 540:Inverse converter 560:Combiner 580: Prediction module 110’:Video 120’:Picture 800, 840, 840a, 860: block
圖1係顯示根據本申請的實施例的128x128 CTU的一示例性分割。 圖2係顯示根據實施例在圖1中描述該拓撲的該分割樹。 圖3係顯示根據實施例在圖2(包括區塊大小和用於細分由該分割方向和該分割比描述的一特定節點的該分割)中的該分割樹的非樹葉節點的一描述。 圖4係顯示根據實施例的分割方向的信令。 圖5係顯示根據實施例的一特定區塊大小的該分割比的示例性信令。 圖6係顯示根據實施例的來自圖5(對於不是所有分割比都可用的情況)的減少的信令。 圖7係顯示根據實施例的用於定義禁止的分割樹模式的三個模板佈局。 圖8係顯示根據實施例的用於發信號通知該分割比的一簡單二元決策樹的示例性上下文建模。 圖9係顯示根據實施例的用於發信號通知該分割比的另一二元決策樹的示例性上下文建模。 圖10係顯示根據實施例的相鄰區塊的位置。 圖11係顯示根據實施例的冗餘並行分割的一範例。 圖12係顯示根據實施例的冗餘垂直分割的一範例。 圖13係顯示根據實施例的高階冗餘的一範例。 圖14係顯示根據一基本實施例的示例性的一解碼器。 圖15係顯示根據一增強實施例的示例性的一解碼器。 圖16係顯示用於預測編碼一視頻的一裝置的一方塊圖,作為一視頻解碼器的一範例,其中一組合的預測概念。 圖17係顯示用於預測解碼一視頻的一裝置的一方塊圖,作為一視頻解碼器的一範例。 圖18係顯示圖示說明一預測殘差信號、一預測信號和一重構信號之間的一關係的一範例的一示意圖。 圖19係顯示用於限制在一給定區域上的預測假設的該平均數量的一範例的一示意圖。 圖20係顯示用於根據該區塊大小或幾何形狀來定義預測假設的該數量的一示意性範例。Figure 1 shows an exemplary partitioning of a 128x128 CTU according to an embodiment of the present application. Figure 2 shows the split tree of the topology described in Figure 1, according to an embodiment. Figure 3 shows a description of the non-leaf nodes of the split tree in Figure 2 (including block size and the split used to subdivide a specific node described by the split direction and the split ratio) according to an embodiment. Figure 4 shows signaling of the splitting direction according to an embodiment. Figure 5 shows exemplary signaling of the partitioning ratio for a specific block size, according to an embodiment. Figure 6 shows reduced signaling from Figure 5 (for cases where not all split ratios are available) according to an embodiment. Figure 7 shows three template layouts for defining prohibited split-tree modes, according to an embodiment. Figure 8 shows an exemplary context modeling of a simple binary decision tree for signaling the split ratio, according to an embodiment. Figure 9 shows an exemplary context modeling of another binary decision tree for signaling the split ratio, according to an embodiment. Figure 10 shows the locations of adjacent blocks according to an embodiment. FIG. 11 shows an example of redundant parallel partitioning according to an embodiment. FIG. 12 shows an example of redundant vertical partitioning according to an embodiment. FIG. 13 shows an example of high-level redundancy according to an embodiment. Figure 14 shows an exemplary decoder according to a basic embodiment. Figure 15 shows an exemplary decoder according to an enhanced embodiment. Figure 16 is a block diagram showing an apparatus for predictively encoding a video, as an example of a video decoder, in which a combined prediction concept is used. Figure 17 is a block diagram showing an apparatus for predictively decoding a video as an example of a video decoder. FIG. 18 is a schematic diagram illustrating an example of a relationship between a prediction residual signal, a prediction signal and a reconstructed signal. Figure 19 is a schematic diagram showing an example of the average number of prediction hypotheses used to constrain a given region. Figure 20 shows an illustrative example for defining the number of prediction hypotheses based on the block size or geometry.
14:資料流 14:Data flow
10:基於區塊的解碼器 10: Block-based decoder
12:圖片 12:Pictures
18:圖片區塊 18: Picture block
Claims (32)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EPEP17182209.1 | 2017-07-19 | ||
EP17182209 | 2017-07-19 |
Publications (2)
Publication Number | Publication Date |
---|---|
TW202127872A TW202127872A (en) | 2021-07-16 |
TWI830012B true TWI830012B (en) | 2024-01-21 |
Family
ID=59631540
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW107125006A TWI725328B (en) | 2017-07-19 | 2018-07-19 | Apparatus and method of coding of pictures |
TW110109990A TWI830012B (en) | 2017-07-19 | 2018-07-19 | Apparatus and method of coding of pictures |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW107125006A TWI725328B (en) | 2017-07-19 | 2018-07-19 | Apparatus and method of coding of pictures |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP3656127A1 (en) |
TW (2) | TWI725328B (en) |
WO (1) | WO2019016287A1 (en) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020156574A1 (en) * | 2019-02-03 | 2020-08-06 | Beijing Bytedance Network Technology Co., Ltd. | Signaling for video block partition mode |
KR20210135314A (en) * | 2019-03-12 | 2021-11-12 | 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. | Implementation of an efficient partition-based intra-coding concept |
GB2585017A (en) * | 2019-06-24 | 2020-12-30 | Canon Kk | Video coding and decoding |
EP4044592A3 (en) * | 2019-08-23 | 2022-12-21 | HFI Innovation Inc. | Method and apparatus of partitioning small size coding units with partition constraints |
CN111757108B (en) * | 2020-07-01 | 2023-03-24 | 格兰菲智能科技有限公司 | Integrated circuit and method for recursively dividing decoding blocks |
CN114979655A (en) * | 2021-02-21 | 2022-08-30 | 腾讯科技(深圳)有限公司 | Video encoding and decoding method and device, computer readable medium and electronic equipment |
CN114885164B (en) * | 2022-07-12 | 2022-09-30 | 深圳比特微电子科技有限公司 | Method and device for determining intra-frame prediction mode, electronic equipment and storage medium |
-
2018
- 2018-07-18 EP EP18739569.4A patent/EP3656127A1/en active Pending
- 2018-07-18 WO PCT/EP2018/069556 patent/WO2019016287A1/en active Search and Examination
- 2018-07-19 TW TW107125006A patent/TWI725328B/en active
- 2018-07-19 TW TW110109990A patent/TWI830012B/en active
Non-Patent Citations (1)
Title |
---|
網路文獻 Jianle Chen, Elena Alshina, Gary J. Sullivan, Jens-Rainer Ohm, Jill Boyce "Algorithm Description of Joint Exploration Test Model 3" Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 3rd Meeting: Geneva, CH, 26 May – 1 June 2016 http://phenix.int-evry.fr/jvet/doc_end_user/documents/3_Geneva/wg11/JVET-C1001-v3.zip |
Also Published As
Publication number | Publication date |
---|---|
TW202127872A (en) | 2021-07-16 |
TWI725328B (en) | 2021-04-21 |
EP3656127A1 (en) | 2020-05-27 |
WO2019016287A1 (en) | 2019-01-24 |
TW201919397A (en) | 2019-05-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
TWI830012B (en) | Apparatus and method of coding of pictures | |
CN111149359B (en) | Method and apparatus for encoding/decoding image and recording medium storing bit stream | |
CN110719481B (en) | Cross-component encoded information derivation | |
CN110393011B (en) | Method and apparatus for implicit intra codec tool setting with intra directional prediction mode in video coding | |
JP2023179552A (en) | Picture coding supporting block partitioning and block merging | |
CN118301340A (en) | Image encoding/decoding method and recording medium storing bit stream | |
CN116366843A (en) | Image encoding/decoding method and apparatus using sample filtering | |
CN110839161B (en) | Boundary processing for extended quadtree partitioning | |
US11843774B2 (en) | Apparatus and method for encoding and decoding a picture using picture boundary handling | |
US20220217409A1 (en) | Image decoding device using tool set and image decoding method thereby, and image coding device and image coding method thereby | |
US11770527B2 (en) | Encoding and decoding a picture | |
CN113366838A (en) | Encoder and decoder, encoding method and decoding method for complexity handling for flexible size picture partitioning | |
TW202042555A (en) | Implementation efficient partition-based intra coding concept | |
JP2024050875A (en) | Coding concepts for transformed representation of sample block |