TW201924330A - Encoding device, decoding device, encoding method, and decoding method - Google Patents

Encoding device, decoding device, encoding method, and decoding method Download PDF

Info

Publication number
TW201924330A
TW201924330A TW107135272A TW107135272A TW201924330A TW 201924330 A TW201924330 A TW 201924330A TW 107135272 A TW107135272 A TW 107135272A TW 107135272 A TW107135272 A TW 107135272A TW 201924330 A TW201924330 A TW 201924330A
Authority
TW
Taiwan
Prior art keywords
picture
pictures
temporary
decoding
information
Prior art date
Application number
TW107135272A
Other languages
Chinese (zh)
Inventor
西孝啓
遠間正真
安倍清史
加納龍一
Original Assignee
美商松下電器(美國)知識產權公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 美商松下電器(美國)知識產權公司 filed Critical 美商松下電器(美國)知識產權公司
Publication of TW201924330A publication Critical patent/TW201924330A/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/31Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/423Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

An encoding device that comprises a circuit and memory. The circuit performs: a step in which the memory is used to reference second filter information that has been associated with a second picture and thereby determine first filter information that is for applying an adaptive loop filter to a first picture; and a step in which the determined first filter information is used to apply the adaptive loop filter to the first picture. When the NAL unit type of the first picture is a prescribed NAL unit type, the circuit prohibits referencing, as the second filter information, third filter information that has been associated with a third picture that has the same temporal ID as the first picture.

Description

編碼裝置、解碼裝置、編碼方法及解碼方法Encoding device, decoding device, encoding method and decoding method

發明領域
本揭示是有關於將含有複數張圖片的動態圖像編碼的編碼裝置等。
FIELD OF THE INVENTION The present disclosure relates to an encoding apparatus or the like that encodes a moving image including a plurality of pictures.

發明背景
迄今,作為用來編碼動態圖像之規格存在H.265,H.265也被稱為HEVC(High Efficiency Video Coding/高效率視訊編碼)(非專利文獻1)。
Background of the Invention Heretofore, H.265 exists as a specification for encoding a moving image, and H.265 is also called HEVC (High Efficiency Video Coding) (Non-Patent Document 1).

先行技術文獻
非專利文獻
非專利文獻1:H.265(ISO/IEC 23008-2 HEVC)/HEVC (High Efficiency Video Coding)
Advance Technical Literature Non-Patent Literature Non-Patent Document 1: H.265 (ISO/IEC 23008-2 HEVC) / HEVC (High Efficiency Video Coding)

發明概要
發明欲解決之課題
惟,若不適當地設定與動態圖像之編碼有關聯的資訊時,就不能適當地進行動態圖像的編碼。
SUMMARY OF THE INVENTION Problems to be Solved by the Invention However, if information related to encoding of a moving image is inappropriately set, encoding of a moving image cannot be performed appropriately.

因此,本揭示提供編碼裝置等,可適當地設定與動態圖像之編碼有關聯的資訊。
用以解決課題的手段
Accordingly, the present disclosure provides an encoding apparatus or the like that can appropriately set information associated with encoding of a moving image.
Means to solve the problem

本揭示一態樣的編碼裝置是一種在包含有複數張圖片之動態圖像的編碼中適用自適應迴路濾波(Adaptive Loop Filter)的裝置,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述編碼裝置包含有:電路;及記憶體;前述電路使用前述記憶體進行以下步驟:參考第2濾波資訊來決定第1濾波資訊的步驟,其中前述第1濾波資訊是用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波,前述第2濾波資訊有關聯於前述複數張圖片之中在編碼順序上較前述第1圖片更前面的第2圖片;及,使用已被決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟;在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL (Network Abstraction Layer,網路抽象層)單元類型為規定NAL單元類型時,前述電路禁止參考關聯於第3圖片的第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中在編碼順序上較前述第1圖片更前面的圖片,且為暫時ID與前述第1圖片相同的圖片。An apparatus for encoding an aspect of the present disclosure is an apparatus for applying an adaptive loop filter in encoding of a moving image including a plurality of pictures, wherein the pictures are respectively assigned and displayed with respect to time adjustability. The temporary ID of the hierarchy, the encoding device includes: a circuit; and a memory; the circuit uses the memory to perform the following steps: determining the first filtering information by referring to the second filtering information, wherein the first filtering information is used Adaptive loop filtering is applied to the first picture among the plurality of pictures, wherein the second filter information is associated with a second picture in the coding order that is earlier than the first picture in the plurality of pictures; and The first filter information that has been determined applies a step of adaptive loop filtering to the first picture; and in the step of determining the first filter information, the NAL (Network Abstraction Layer) of the first picture When the unit type is a specified NAL unit type, the foregoing circuit prohibits reference to the third filtering information associated with the third picture as the second filtering. News, wherein the third image is compared with the plurality of images in the first image further previous picture in coding order, and the temporary ID to the first image and the same image.

另,該等概括性或者是具體性的態樣可以透過系統、裝置、方法、積體電路、電腦程式,或者電腦可讀取之CD-ROM等之非暫時性記錄媒體來實現,也可以透過系統、裝置、方法、積體電路、電腦程式及記錄媒體的任意組合來實現。
發明效果
In addition, the general or specific aspects can be implemented through systems, devices, methods, integrated circuits, computer programs, or non-transitory recording media such as computer-readable CD-ROMs. Any combination of systems, devices, methods, integrated circuits, computer programs, and recording media can be implemented.
Effect of the invention

發明效果
本揭示一態樣之編碼裝置等可適當地設定與動態圖像之編碼有關聯的資訊。
Advantageous Effects of Invention An encoding apparatus or the like according to an aspect of the present invention can appropriately set information associated with encoding of a moving image.

用以實施發明之形態
(成為本揭示之基礎的見解)
例如,將含有複數張圖片的動態圖像編碼的編碼裝置也可參考複數張圖片之中的編碼完畢圖片,將複數張圖片之中的編碼對象圖片編碼。同樣,將含有複數張圖片的動態圖像解碼的解碼裝置也可參考複數張圖片之中的解碼完畢圖片,將複數張圖片之中的解碼對象圖片解碼。
Form for implementing the invention
(Seeing the basis of this disclosure)
For example, an encoding apparatus that encodes a moving picture including a plurality of pictures may also encode an encoding target picture among a plurality of pictures by referring to the encoded picture among the plurality of pictures. Similarly, the decoding device that decodes the moving image including the plurality of pictures may also decode the decoded target picture among the plurality of pictures by referring to the decoded picture among the plurality of pictures.

有對複數張圖片分別分配暫時ID的情形,且前述暫時ID顯示有關於時間可調性(scalability)的階層。暫時ID是對應於0以上的整數值。例如,在編碼對象圖片的編碼中,禁止參考暫時ID較編碼對象圖片更大的編碼完畢圖片。藉此,適當地限制在編碼對象圖片之編碼中被參考的編碼完畢圖片,在編碼對象圖片的編碼中抑制處理的複雜化。There are cases where a temporary ID is assigned to each of a plurality of pictures, and the aforementioned temporary ID shows a hierarchy regarding time scalability. The temporary ID is an integer value corresponding to 0 or more. For example, in the encoding of the encoding target picture, it is prohibited to refer to the encoded picture whose temporary ID is larger than the encoding target picture. Thereby, the encoded picture that is referred to in the encoding of the encoding target picture is appropriately limited, and the processing is suppressed in the encoding of the encoding target picture.

同樣,在解碼對象圖片的解碼中,禁止參考暫時ID較解碼對象圖片更大的解碼完畢圖片。藉此,適當地限制在解碼對象圖片之解碼中被參考的解碼完畢圖片,抑制在解碼對象圖片的解碼中處理的複雜化。又,解碼裝置藉由只將全部的圖片之中暫時ID為規定值以下的一部分圖片解碼,可在動態圖像的解碼中進行疏化,能減少處理量。Similarly, in the decoding of the decoding target picture, it is prohibited to refer to the decoded picture whose temporary ID is larger than the decoding target picture. Thereby, the decoded picture that is referred to in the decoding of the decoding target picture is appropriately limited, and the processing in the decoding of the decoding target picture is suppressed from being complicated. Further, the decoding apparatus can perform thinning in decoding of a moving image by decoding only a part of the pictures whose temporary IDs are equal to or less than a predetermined value among all the pictures, and can reduce the amount of processing.

又,有於動態圖像的編碼及解碼中,使用複數張圖片所含的圖片,作為TSA(Temporal Sub-layer Access,時間子層存取)圖片的情況。例如在編碼順序上位於TSA圖片之後的圖片的編碼中,禁止對圖片的參考,其中前述圖片為編碼順序上較TSA圖片更前面的複數張圖片之中,暫時ID與TSA圖片相同,或者是比TSA圖片大的圖片。Further, in the encoding and decoding of a moving image, a picture included in a plurality of pictures is used as a TSA (Temporal Sub-layer Access) picture. For example, in the encoding of the picture located after the TSA picture in the coding order, the reference to the picture is prohibited, wherein the foregoing picture is in the multiple pictures in the coding order which is more front than the TSA picture, and the temporary ID is the same as the TSA picture, or is TSA picture big picture.

在TSA圖片被解碼時,能從暫時ID比TSA圖片小的各圖片被解碼的狀態,轉移至暫時ID與TSA圖片相同或者是大於TSA圖片之各圖片被解碼的狀態。像這樣轉移至暫時ID較大的圖片被解碼的狀態乃被稱為向上切換(upswitch)。When the TSA picture is decoded, it is possible to shift from the state in which each picture whose temporary ID is smaller than the TSA picture is decoded to the state in which the temporary ID is the same as the TSA picture or the picture in which the TSA picture is larger than the TSA picture. A state in which a picture shifted to a temporary ID is decoded as described above is referred to as an upswitch.

暫時ID大的圖片有經由交插而不能被解碼的可能性。然後,在不使用如同TSA圖片的限制的狀態下進行向上切換時,會有參考未被解碼的圖片的可能性。為此,在不使用如同TSA圖片的限制時,難以進行適當的向上切換。A picture with a large temporary ID has the possibility of being decoded without being interleaved. Then, when the upward switching is performed without using the restriction like the TSA picture, there is a possibility of referring to the picture that is not decoded. For this reason, it is difficult to perform an appropriate upward switching without using a limitation like a TSA picture.

又,在動態圖像的編碼及解碼中,複數張圖片所含的圖片有被使用作為STSA(Step-wise Temporal Sub-layer Access,逐步時間子層存取)圖片的情形。例如,在編碼順序上位於STSA圖片之後且暫時ID與STSA圖片相同之圖片的編碼中,禁止對編碼順序上較STSA圖片更前面且暫時ID與STSA圖片相同的圖片之參考。Further, in the encoding and decoding of a moving picture, a picture included in a plurality of pictures is used as a STSA (Step-wise Temporal Sub-layer Access) picture. For example, in the encoding of the picture whose encoding order is after the STSA picture and the temporary ID is the same as the STSA picture, the reference to the picture whose encoding order is earlier than the STSA picture and the temporary ID is the same as the STSA picture is prohibited.

藉此,能從暫時ID小於STSA圖片之各圖片被解碼的狀態,適當地轉移至暫時ID與STSA圖片相同之各圖片被解碼的狀態。Thereby, it is possible to appropriately shift from the state in which the temporary ID is smaller than the picture in which the STSA picture is decoded, to the state in which the pictures in which the temporary ID and the STSA picture are the same are decoded.

即,在TSA圖片中能保證向上切換,前述向上切換是指從暫時ID比起TSA圖片還小的各圖片被解碼的狀態,轉移至暫時ID與TSA圖片相同或者是比TSA圖片大的各圖片被解碼的狀態。在STSA圖片中能保證向上切換,前述向上切換是指從暫時ID比起STSA圖片還小的各圖片被解碼的狀態,轉移至暫時ID與STSA圖片為相同的各圖片被解碼的狀態。That is, the upward switching can be ensured in the TSA picture, and the upward switching refers to a state in which each picture whose decoding is smaller than the TSA picture is decoded, and the picture is transferred to the picture whose temporary ID is the same as the TSA picture or larger than the TSA picture. The state being decoded. The upward switching can be ensured in the STSA picture. The above-mentioned upward switching means that the pictures in which the temporary ID is smaller than the STSA picture are decoded, and the pictures in which the temporary ID and the STSA picture are the same are decoded.

又,在動態圖像的編碼及解碼中,會使用各式各樣的資訊。自適應迴路濾波的濾波資訊是動態圖像的編碼及解碼中所使用的資訊一例。自適應迴路濾波是用於使動態圖像的編碼或者解碼中所產生的再構成圖像接近原圖像的濾波,且是用於對再構成圖像進行平滑化或者銳化等之圖像處理的濾波。In addition, various types of information are used in encoding and decoding of moving images. The filtering information of the adaptive loop filtering is an example of information used in encoding and decoding of a moving image. Adaptive loop filtering is a filter for making a reconstructed image generated in encoding or decoding of a moving image close to an original image, and is an image processing for smoothing or sharpening a reconstructed image. Filtering.

藉適當地設定濾波資訊,可使用濾波資訊,使自適應迴路濾波適當地適用在再構成圖像,且適當地進行動態圖像的編碼及解碼。另一方面,若不適當地設定濾波資訊,就不能適當地進行動態圖像的編碼及解碼。即,若不適當地設定在動態圖像的編碼及解碼中所使用的資訊時,就不能適當地進行動態圖像之編碼及解碼。By appropriately setting the filtering information, the filtering information can be used to appropriately apply the adaptive loop filtering to the reconstructed image, and appropriately encode and decode the moving image. On the other hand, if the filtering information is improperly set, the encoding and decoding of the moving image cannot be performed properly. That is, if information used for encoding and decoding of a moving image is improperly set, encoding and decoding of a moving image cannot be performed properly.

因此,例如也可為:本揭示一態樣之編碼裝置在包含有複數張圖片之動態圖像的編碼中適用自適應迴路濾波,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述編碼裝置包含有電路;及記憶體;前述電路使用前述記憶體,進行以下步驟:參考有關聯於第2圖片之第2濾波資訊,決定用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊的步驟,其中前述第2圖片為前述複數張圖片之中編碼順序上較前述第1圖片更前面的圖片;及,使用已被決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟;在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL(Network Abstraction Layer)單元類型為規定NAL單元類型時,前述電路禁止參考有關聯於第3圖片的第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中編碼順序上較前述第1圖片更前面的圖片,且為暫時ID與前述第1圖片相同的圖片。Therefore, for example, the encoding apparatus of the present disclosure may be adapted to adaptive loop filtering in encoding of a moving image including a plurality of pictures, wherein the pictures are respectively assigned to display a level with respect to time adjustability. a temporary ID, the encoding device includes a circuit; and a memory; the circuit uses the memory to perform a step of: determining, by referring to the second filtering information associated with the second picture, the first of the plurality of pictures The first picture is a step of applying the first filter information of the adaptive loop filter, wherein the second picture is a picture in which the coding order is earlier than the first picture in the plurality of pictures; and the first 1 that has been determined is used. Filtering information, the step of applying adaptive loop filtering to the first picture; and in the step of determining the first filtering information, when the NAL (Network Abstraction Layer) unit type of the first picture is a predetermined NAL unit type, the foregoing circuit It is prohibited to refer to the third filtering information associated with the third picture as the second filtering information, wherein the third picture is the plurality of pictures. A picture in which the coding order is earlier than the first picture, and the picture in which the temporary ID is the same as the first picture.

依此,編碼裝置可參考第2圖片的第2濾波資訊,來決定第1圖片的第1濾波資訊。此時,編碼裝置可禁止參考與規定NAL單元類型的第1圖片相同階層的第3圖片之第3濾波資訊來作為第2濾波資訊。Accordingly, the encoding device can determine the first filter information of the first picture by referring to the second filter information of the second picture. At this time, the encoding apparatus can prohibit the reference to the third filter information of the third picture of the same level as the first picture of the predetermined NAL unit type as the second filter information.

即,和可對於與規定NAL單元類型的第1圖片相同階層的圖片所進行的參考限制一樣,編碼裝置能對與規定NAL單元類型的第1圖片相同階層的圖片之濾波資訊進行參考限制。因此,編碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。That is, the encoding apparatus can refer to the filtering information of the picture of the same level as the first picture of the predetermined NAL unit type, similarly to the reference restriction of the picture of the same level as the first picture of the predetermined NAL unit type. Therefore, the encoding device can appropriately manage the filtering information in association with the picture, and can appropriately limit the setting of the filtering information to be referred to. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如在決定前述第1濾波資訊的步驟中,前述電路也可禁止參考有關聯於第4圖片之第4濾波資訊來作為前述第2濾波資訊,前述第4圖片是前述複數張圖片之中編碼順序上較前述第1圖片還前面的圖片,且是暫時ID大於前述第1圖片的圖片。Further, for example, in the step of determining the first filter information, the circuit may prohibit reference to the fourth filter information associated with the fourth picture as the second filter information, wherein the fourth picture is among the plurality of pictures The picture in the coding order is higher than the picture in front of the first picture, and is a picture in which the temporary ID is larger than the first picture.

依此,在參考第2圖片的第2濾波資訊來決定第1圖片的第1濾波資訊之際,得禁止參考暫時ID較第1圖片大之第4圖片的第4濾波資訊來作為第2濾波資訊。因此,編碼裝置在時間可調性之中,和對圖片所進行的參考限制一樣,可對有關聯於圖片的濾波資訊進行參考限制。藉此,編碼裝置可適當地限制來設定要參考的濾波資訊。Accordingly, when the first filter information of the first picture is determined by referring to the second filter information of the second picture, the fourth filter information of the fourth picture whose reference temporary ID is larger than the first picture is prohibited from being used as the second filter. News. Therefore, the encoding device can make reference restrictions on the filtering information associated with the picture, as in the time adjustment of the picture. Thereby, the encoding device can be appropriately limited to set the filter information to be referred to.

又,例如也可為:前述電路更進行以下步驟:參考有關聯於第6圖片之第6濾波資訊,決定用來對第5圖片適用自適應迴路濾波之第5濾波資訊的步驟,其中前述第5圖片是前述複數張圖片之中編碼順序上較前述第1圖片還後面的圖片,前述第6圖片是前述複數張圖片之中編碼順序上較前述第5圖片還前面的圖片;及,使用已決定的前述第5濾波資訊,對前述第5圖片適用自適應迴路濾波的步驟;在決定前述第5濾波資訊的步驟中,當前述第1圖片的NAL單元類型為前述規定NAL單元類型時,前述電路禁止參考有關聯於前述第3圖片之前述第3濾波資訊來作為前述第6濾波資訊。Further, for example, the circuit may further perform the step of: determining, by referring to the sixth filtering information associated with the sixth picture, a fifth filtering information for applying adaptive loop filtering to the fifth picture, wherein the foregoing 5 is a picture in which the coding order is later than the first picture in the plurality of pictures, and the sixth picture is a picture in which the coding order is earlier than the fifth picture in the plurality of pictures; and The determined fifth filtering information applies a step of adaptive loop filtering to the fifth picture; and in the step of determining the fifth filtering information, when the NAL unit type of the first picture is the predetermined NAL unit type, the foregoing The circuit prohibits the reference to the third filter information associated with the third picture as the sixth filter information.

依此,編碼裝置可參考第6圖片的第6濾波資訊,來決定編碼順序上較第1圖片還後面的第5圖片的第5濾波資訊。此時,編碼裝置可禁止參考與規定NAL單元類型的第1圖片相同階層的第3圖片之第3濾波資訊來作為第6濾波資訊。Accordingly, the encoding device can refer to the sixth filtering information of the sixth picture to determine the fifth filtering information of the fifth picture that is later than the first picture in the encoding order. At this time, the encoding apparatus can prohibit the reference to the third filter information of the third picture of the same level as the first picture of the predetermined NAL unit type as the sixth filter information.

即,編碼裝置在較規定NAL單元類型的第1圖片還後面之中,和可對與第1圖片相同階層的圖片進行的參考限制一樣,能對與第1圖片相同階層的圖片的濾波資訊進行參考限制。因此,編碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。In other words, the encoding apparatus can perform filtering information on the pictures of the same level as the first picture, even after the first picture of the predetermined NAL unit type, and the reference restriction of the picture of the same level as the first picture. Reference limit. Therefore, the encoding device can appropriately manage the filtering information in association with the picture, and can appropriately limit the setting of the filtering information to be referred to. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如也可為:在決定前述第5濾波資訊的步驟中,當前述第1圖片的NAL單元類型為前述規定NAL單元類型時,前述電路禁止參考有關聯於第4圖片之第4濾波資訊來作為前述第6濾波資訊,其中前述第4圖片是前述複數張圖片之中編碼順序上較前述第1圖片還前面的圖片,且是暫時ID大於前述第1圖片的圖片。Furthermore, for example, in the step of determining the fifth filtering information, when the NAL unit type of the first picture is the predetermined NAL unit type, the circuit prohibits reference to the fourth filtering information associated with the fourth picture. In the sixth filtering information, the fourth picture is a picture in which the coding order is earlier than the first picture in the plurality of pictures, and the picture whose temporary ID is larger than the first picture.

依此,在參考第6圖片的第6濾波資訊來決定第5圖片的第5濾波資訊之際,得禁止參考暫時ID較第1圖片還大的第4圖片之第4濾波資訊來作為第5濾波資訊。Accordingly, when the fifth filter information of the fifth picture is determined with reference to the sixth filter information of the sixth picture, the fourth filter information of the fourth picture whose reference temporary ID is larger than the first picture is prohibited from being used as the fifth. Filter information.

即,編碼裝置在較規定NAL單元類型的第1圖片還後面之中,和可對暫時ID大於第1圖片的圖片進行的參考限制一樣,能對濾波資訊進行參考限制。因此,編碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。That is, the encoding apparatus can refer to the filtering information in the same manner as the first picture of the predetermined NAL unit type, and the reference restriction that can be performed on the picture whose temporary ID is larger than the first picture. Therefore, the encoding device can appropriately manage the filtering information in association with the picture, and can appropriately limit the setting of the filtering information to be referred to. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如也可為:在決定前述第1濾波資訊的步驟中,當前述第1圖片與第7圖片之間存在有第8圖片,且前述第8圖片的NAL單元類型為前述規定NAL單元類型時,前述電路禁止參考有關聯於前述第7圖片之第7濾波資訊來作為前述第2濾波資訊,其中前述第7圖片是前述複數張圖片之中編碼順序上較前述第1圖片還前面的圖片,且是暫時ID大於0的圖片,前述第8圖片是暫時ID與前述第7圖片相同或者暫時ID小於前述第7圖片的圖片。Further, for example, in the step of determining the first filter information, the eighth picture may exist between the first picture and the seventh picture, and the NAL unit type of the eighth picture is the predetermined NAL unit type. When the circuit prohibits the reference to the seventh filter information associated with the seventh picture as the second filter information, wherein the seventh picture is a picture in front of the first picture in the coding order. And a picture in which the temporary ID is greater than 0, and the eighth picture is a picture in which the temporary ID is the same as the seventh picture or the temporary ID is smaller than the seventh picture.

依此,編碼裝置可禁止參考第7圖片的第7濾波資訊來作為第2濾波資訊,其中前述第7圖片為較規定NAL單元類型的第8圖片還後面之中暫時ID等於或者大於第8圖片的圖片。Accordingly, the encoding apparatus may prohibit the reference to the seventh filtering information of the seventh picture as the second filtering information, wherein the seventh picture is the eighth picture of the predetermined NAL unit type, and the temporary ID is equal to or larger than the eighth picture. picture of.

即,編碼裝置能在較規定NAL單元類型的第8圖片還後面之中,和可對第7圖片進行的參考限制一樣,對第7圖片的第7濾波資訊進行參考限制。因此,編碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。That is, the encoding apparatus can refer to the seventh filtering information of the seventh picture in the same manner as the reference picture of the seventh picture, even after the eighth picture of the predetermined NAL unit type. Therefore, the encoding device can appropriately manage the filtering information in association with the picture, and can appropriately limit the setting of the filtering information to be referred to. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如也可為:前述規定NAL單元類型為TSA(Temporal Sub-layer Access)圖片的NAL單元類型。Further, for example, the NAL unit type in which the predetermined NAL unit type is a TSA (Temporal Sub-layer Access) picture may be used.

依此,和可對與TSA圖片相同階層的圖片進行的參考限制一樣,編碼裝置可對與TSA圖片相同階層的圖片的濾波資訊進行參考限制。因此,編碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device can refer to the filtering information of the picture of the same level as the TSA picture as the reference limit of the picture of the same level as the TSA picture. Therefore, the encoding device can appropriately manage the filtering information in association with the picture, and can appropriately limit the setting of the filtering information to be referred to. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如也可為:前述電路更進行以下步驟:參考有關聯於第6圖片之第6濾波資訊,決定用來對第5圖片適用自適應迴路濾波之第5濾波資訊的步驟,其中前述第5圖片是前述複數張圖片之中編碼順序上較前述第1圖片還後面的圖片,前述第6圖片是前述複數張圖片之中編碼順序上較前述第5圖片還前面的圖片;及,使用已決定的前述第5濾波資訊,對前述第5圖片適用自適應迴路濾波的步驟;在決定前述第5濾波資訊的步驟中,當前述第1圖片的NAL單元類型為前述規定NAL單元類型,且前述第5圖片的暫時ID與前述第1圖片的暫時ID相同時,前述電路禁止參考有關聯於前述第3圖片之前述第3濾波資訊來作為前述第6濾波資訊。Further, for example, the circuit may further perform the step of: determining, by referring to the sixth filtering information associated with the sixth picture, a fifth filtering information for applying adaptive loop filtering to the fifth picture, wherein the foregoing 5 is a picture in which the coding order is later than the first picture in the plurality of pictures, and the sixth picture is a picture in which the coding order is earlier than the fifth picture in the plurality of pictures; and The determined fifth filtering information applies a step of adaptive loop filtering to the fifth picture; and in the step of determining the fifth filtering information, the NAL unit type of the first picture is the predetermined NAL unit type, and the foregoing When the temporary ID of the fifth picture is the same as the temporary ID of the first picture, the circuit prohibits the reference to the third filter information associated with the third picture as the sixth filter information.

依此,編碼裝置可參考第6圖片的第6濾波資訊,來決定第5圖片的第5濾波資訊,前述第5圖片為編碼順序上較第1圖片還後面之中與第1圖片相同階層的圖片。此時,編碼裝置可禁止參考第3圖片的第3濾波資訊來作為第6濾波資訊,其中前述第3圖片是與規定NAL單元類型的第1圖片相同階層。Accordingly, the encoding apparatus can refer to the sixth filtering information of the sixth picture to determine the fifth filtering information of the fifth picture, and the fifth picture is the same level as the first picture in the coding order compared with the first picture. image. At this time, the encoding apparatus can prohibit the third filtering information of the reference third picture as the sixth filtering information, wherein the third picture is the same level as the first picture of the predetermined NAL unit type.

即,編碼裝置在較規定NAL單元類型的第1圖片還後面,且與第1圖片相同的階層之中,和可對較第1圖片還前面的圖片所進行的參考限制一樣,能對濾波資訊進行參考限制。因此,編碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。That is, the encoding apparatus can filter the information in the same level as the first picture of the predetermined NAL unit type and in the same level as the first picture, and the reference restriction on the picture preceding the first picture. Make reference restrictions. Therefore, the encoding device can appropriately manage the filtering information in association with the picture, and can appropriately limit the setting of the filtering information to be referred to. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如前述規定NAL單元類型也可為STSA(Step-wise Temporal Sub-layer Access)圖片的NAL單元類型。Further, for example, the predetermined NAL unit type may be an NAL unit type of a STSA (Step-wise Temporal Sub-layer Access) picture.

依此,和可對與STSA圖片相同階層的圖片進行的參考限制一樣,編碼裝置可對與STSA圖片相同階層的圖片的濾波資訊進行參考限制。因此,編碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device can refer to the filtering information of the picture of the same level as the STSA picture as the reference limit of the picture of the same level as the STSA picture. Therefore, the encoding device can appropriately manage the filtering information in association with the picture, and can appropriately limit the setting of the filtering information to be referred to. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如也可為:本揭示一態樣之解碼裝置在含有複數張圖片之動態圖像的解碼中適用自適應迴路濾波,且前述複數張圖片被分配顯示有關於時間可調性的階層之暫時ID,前述解碼裝置包含有:電路;及記憶體;前述電路使用前述記憶體,進行以下步驟:參考有關聯於第2圖片之第2濾波資訊,決定用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊的步驟,其中前述第2圖片是在前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片;及,使用已決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟;在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL (Network Abstraction Layer)單元類型為規定NAL單元類型時,前述電路禁止參考有關聯於第3圖片之第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片,且為暫時ID與前述第1圖片相同的圖片。In addition, for example, the decoding apparatus of the present disclosure may apply adaptive loop filtering in decoding of a moving image including a plurality of pictures, and the plurality of pictures are allocated to display a hierarchy with respect to time adjustability. a temporary ID, wherein the decoding device includes: a circuit; and a memory; wherein the circuit uses the memory to perform a step of: determining, by reference to the second filter information associated with the second picture, among the plurality of pictures The first picture is applied to the first filter information of the adaptive loop filter, wherein the second picture is a picture in front of the first picture in a decoding order among the plurality of pictures; and the determined first 1 filtering information, wherein the step of adaptive loop filtering is applied to the first picture; and in the step of determining the first filter information, when the NAL (Network Abstraction Layer) unit type of the first picture is a predetermined NAL unit type, the foregoing The circuit prohibits reference to the third filtering information associated with the third picture as the second filtering information, wherein the third picture is the plurality of pictures Further than the front of the first picture in decoding order among pictures and the temporary ID to the first image and the same image.

依此,解碼裝置可參考第2圖片的第2濾波資訊,來決定第1圖片的第1濾波資訊。此時,解碼裝置可禁止參考與規定NAL單元類型的第1圖片相同階層的第3圖片之第3濾波資訊來作為第2濾波資訊。Accordingly, the decoding device can determine the first filter information of the first picture by referring to the second filter information of the second picture. At this time, the decoding apparatus can prohibit the reference to the third filter information of the third picture of the same level as the first picture of the predetermined NAL unit type as the second filter information.

即,和可對與規定NAL單元類型的第1圖片相同階層的圖片所進行的參考限制一樣,解碼裝置能對與規定NAL單元類型的第1圖片相同階層的圖片之濾波資訊進行參考限制。因此,解碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。That is, the decoding apparatus can refer to the filtering information of the picture of the same level as the first picture of the predetermined NAL unit type, similarly to the reference restriction of the picture of the same level as the first picture of the predetermined NAL unit type. Therefore, the decoding device can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如也可為:在決定前述第1濾波資訊的步驟中,前述電路禁止參考有關聯於第4圖片之第4濾波資訊來作為前述第2濾波資訊,其中前述第4圖片是前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片,且是暫時ID大於前述第1圖片的圖片。Further, for example, in the step of determining the first filter information, the circuit may prohibit the reference to the fourth filter information associated with the fourth picture as the second filter information, wherein the fourth picture is the plurality of pictures Among the pictures, the picture in the decoding order is earlier than the first picture, and the picture whose temporary ID is larger than the first picture.

依此,在參考第2圖片的第2濾波資訊,來決定第1圖片的第1濾波資訊之際,得禁止參考暫時ID較第1圖片大的第4圖片之第4濾波資訊來作為第2濾波資訊。因此,解碼裝置在時間可調性之中,和對圖片所進行的參考限制一樣,可對關聯於圖片的濾波資訊進行參考限制。藉此,解碼裝置可適當地限制來設定要參考的濾波資訊。According to this, when the first filter information of the first picture is determined with reference to the second filter information of the second picture, the fourth filter information of the fourth picture whose reference temporary ID is larger than the first picture is prohibited from being used as the second Filter information. Therefore, the decoding device can limit the filtering information associated with the picture in the same time adjustment as the reference restriction on the picture. Thereby, the decoding device can be appropriately limited to set the filter information to be referred to.

又,例如也可為:前述電路更進行以下步驟:參考有關聯於第6圖片之第6濾波資訊,決定用來對第5圖片適用自適應迴路濾波之第5濾波資訊的步驟,其中前述第5圖片是前述複數張圖片之中解碼順序上較前述第1圖片還後面的圖片,前述第6圖片是前述複數張圖片之中解碼順序上較前述第5圖片還前面的圖片;及,使用已決定的前述第5濾波資訊,對前述第5圖片適用自適應迴路濾波的步驟;在決定前述第5濾波資訊的步驟中,當前述第1圖片的NAL單元類型為前述規定NAL單元類型時,前述電路禁止參考有關聯於前述第3圖片之前述第3濾波資訊來作為前述第6濾波資訊。Further, for example, the circuit may further perform the step of: determining, by referring to the sixth filtering information associated with the sixth picture, a fifth filtering information for applying adaptive loop filtering to the fifth picture, wherein the foregoing 5 is a picture in which the decoding order is later than the first picture in the plurality of pictures, and the sixth picture is a picture in front of the fifth picture in a decoding order among the plurality of pictures; and The determined fifth filtering information applies a step of adaptive loop filtering to the fifth picture; and in the step of determining the fifth filtering information, when the NAL unit type of the first picture is the predetermined NAL unit type, the foregoing The circuit prohibits the reference to the third filter information associated with the third picture as the sixth filter information.

依此,解碼裝置可參考第6圖片的第6濾波資訊,來決定解碼順序上較第1圖片還後面的第5圖片的第5濾波資訊。此時,解碼裝置可禁止參考與規定NAL單元類型的第1圖片相同階層的第3圖片之第3濾波資訊來作為第6濾波資訊。Accordingly, the decoding apparatus can refer to the sixth filtering information of the sixth picture to determine the fifth filtering information of the fifth picture that is later than the first picture in the decoding order. At this time, the decoding apparatus can prohibit the reference to the third filter information of the third picture having the same level as the first picture of the predetermined NAL unit type as the sixth filter information.

即,解碼裝置在較規定NAL單元類型的第1圖片還後面之中,和可對與第1圖片相同階層的圖片進行的參考限制一樣,能對與第1圖片相同階層的圖片的濾波資訊進行參考限制。因此,解碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。In other words, the decoding apparatus can perform filtering information on the picture of the same level as the first picture, even after the first picture of the predetermined NAL unit type, and the reference restriction of the picture of the same level as the first picture. Reference limit. Therefore, the decoding device can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如也可為:在決定前述第5濾波資訊的步驟中,當前述第1圖片的NAL單元類型為前述規定NAL單元類型時,前述電路禁止參考有關聯於第4圖片之第4濾波資訊來作為前述第6濾波資訊,其中前述第4圖片是前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片,且是暫時ID大於前述第1圖片的圖片。Furthermore, for example, in the step of determining the fifth filtering information, when the NAL unit type of the first picture is the predetermined NAL unit type, the circuit prohibits reference to the fourth filtering information associated with the fourth picture. In the sixth filtering information, the fourth picture is a picture in which the decoding order is higher than the first picture in the decoding order, and the picture in which the temporary ID is larger than the first picture.

依此,在參考第6圖片的第6濾波資訊來決定第5圖片的第5濾波資訊之際,得禁止參考暫時ID較第1圖片還大的第4圖片之第4濾波資訊來作為第5濾波資訊。Accordingly, when the fifth filter information of the fifth picture is determined with reference to the sixth filter information of the sixth picture, the fourth filter information of the fourth picture whose reference temporary ID is larger than the first picture is prohibited from being used as the fifth. Filter information.

即,解碼裝置在較規定NAL單元類型的第1圖片還後面之中,和可對暫時ID大於第1圖片的圖片進行的參考限制一樣,能對濾波資訊進行參考限制。因此,解碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。That is, the decoding apparatus can refer to the filtering information in the same manner as the reference restriction of the picture having the temporary ID larger than the first picture, even after the first picture of the predetermined NAL unit type. Therefore, the decoding device can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如也可為:在決定前述第1濾波資訊的步驟中,當前述第1圖片與第7圖片之間存在有第8圖片,且前述第8圖片的NAL單元類型為前述規定NAL單元類型時,前述電路禁止參考有關聯於前述第7圖片之第7濾波資訊來作為前述第2濾波資訊,其中前述第7圖片是前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片,且是暫時ID大於0的圖片,前述第8圖片是暫時ID與前述第7圖片相同或者暫時ID小於前述第7圖片的圖片。Further, for example, in the step of determining the first filter information, the eighth picture may exist between the first picture and the seventh picture, and the NAL unit type of the eighth picture is the predetermined NAL unit type. In the above, the circuit prohibits the reference to the seventh filtering information associated with the seventh picture as the second filtering information, wherein the seventh picture is a picture in front of the first picture in the decoding order of the plurality of pictures. And a picture in which the temporary ID is greater than 0, and the eighth picture is a picture in which the temporary ID is the same as the seventh picture or the temporary ID is smaller than the seventh picture.

依此,解碼裝置可禁止參考第7圖片之第7濾波資訊來作為第2濾波資訊,其中前述第7圖片是在較規定NAL單元類型的第8圖片還後面之中暫時ID等於或者大於第8圖片的圖片。Accordingly, the decoding apparatus may prohibit the reference to the seventh filtering information of the seventh picture as the second filtering information, wherein the seventh picture is after the eighth picture of the predetermined NAL unit type, and the temporary ID is equal to or greater than the eighth picture. Picture of the picture.

即,解碼裝置在較規定NAL單元類型的第8圖片還後面之中,和可對第7圖片進行的參考限制一樣,能對第7圖片的第7濾波資訊進行參考限制。因此,解碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。That is, the decoding apparatus can perform reference restriction on the seventh filtering information of the seventh picture, even after the eighth picture of the predetermined NAL unit type, as well as the reference restriction that can be performed on the seventh picture. Therefore, the decoding device can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如前述規定NAL單元類型也可為TSA (Temporal Sub-layer Access)圖片的NAL單元類型。Further, for example, the predetermined NAL unit type may be a NAL unit type of a TSA (Temporal Sub-layer Access) picture.

依此,和可對與TSA圖片相同階層的圖片進行的參考限制一樣,解碼裝置可對與TSA圖片相同階層的圖片的濾波資訊進行參考限制。因此,解碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device can refer to the filtering information of the picture of the same level as the TSA picture as the reference limit of the picture of the same level as the TSA picture. Therefore, the decoding device can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如也可為:前述電路更進行以下步驟:參考有關聯於第6圖片之第6濾波資訊,決定用來對第5圖片適用自適應迴路濾波之第5濾波資訊的步驟,其中前述第5圖片是前述複數張圖片之中解碼順序上較前述第1圖片還後面的圖片,前述第6圖片是前述複數張圖片之中解碼順序上較前述第5圖片還前面的圖片;及,使用已決定的前述第5濾波資訊,對前述第5圖片適用自適應迴路濾波的步驟;在決定前述第5濾波資訊的步驟中,當前述第1圖片的NAL單元類型為前述規定NAL單元類型,且前述第5圖片的暫時ID與前述第1圖片的暫時ID相同時,前述電路禁止參考有關聯於前述第3圖片之前述第3濾波資訊來作為前述第6濾波資訊。Further, for example, the circuit may further perform the step of: determining, by referring to the sixth filtering information associated with the sixth picture, a fifth filtering information for applying adaptive loop filtering to the fifth picture, wherein the foregoing 5 is a picture in which the decoding order is later than the first picture in the plurality of pictures, and the sixth picture is a picture in front of the fifth picture in a decoding order among the plurality of pictures; and The determined fifth filtering information applies a step of adaptive loop filtering to the fifth picture; and in the step of determining the fifth filtering information, the NAL unit type of the first picture is the predetermined NAL unit type, and the foregoing When the temporary ID of the fifth picture is the same as the temporary ID of the first picture, the circuit prohibits the reference to the third filter information associated with the third picture as the sixth filter information.

依此,解碼裝置可參考第6圖片的第6濾波資訊,來決定第5圖片的第5濾波資訊,其中前述第5圖片為解碼順序上較第1圖片還後面之中與第1圖片相同階層的圖片。此時,解碼裝置可禁止參考與規定NAL單元類型的第1圖片相同階層的第3圖片之第3濾波資訊來作為第6濾波資訊。Accordingly, the decoding apparatus can determine the fifth filtering information of the fifth picture by referring to the sixth filtering information of the sixth picture, wherein the fifth picture is the same level as the first picture after the first picture in the decoding order. picture of. At this time, the decoding apparatus can prohibit the reference to the third filter information of the third picture having the same level as the first picture of the predetermined NAL unit type as the sixth filter information.

即,解碼裝置在較規定NAL單元類型的第1圖片還後面,且與第1圖片相同的階層之中,和可對較第1圖片還前面的圖片所進行的參考限制一樣,能對濾波資訊進行參考限制。因此,解碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。That is, the decoding apparatus can filter the information in the same level as the first picture of the predetermined NAL unit type and in the same level as the first picture, and the reference restriction on the picture preceding the first picture. Make reference restrictions. Therefore, the decoding device can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如前述規定NAL單元類型也可為STSA(Step-wise Temporal Sub-layer Access)圖片的NAL單元類型。Further, for example, the predetermined NAL unit type may be an NAL unit type of a STSA (Step-wise Temporal Sub-layer Access) picture.

依此,和可對與STSA圖片相同階層的圖片進行的參考限制一樣,解碼裝置可對與STSA圖片相同階層的圖片的濾波資訊進行參考限制。因此,解碼裝置可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device can refer to the filtering information of the picture of the same level as the STSA picture as the reference limit of the picture of the same level as the STSA picture. Therefore, the decoding device can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如也可為:本揭示一態樣之編碼方法在含有複數張圖片的動態圖像之編碼中適用自適應迴路濾波,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述編碼方法包含有以下步驟:參考有關聯於第2圖片之第2濾波資訊,決定用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊的步驟,其中前述第2圖片是在前述複數張圖片之中編碼順序上較前述第1圖片還前面的圖片;及,使用已決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟;在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL(Network Abstraction Layer)單元類型為規定NAL單元類型時,禁止參考有關聯於第3圖片之第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中編碼順序上較前述第1圖片還前面的圖片,且為暫時ID與前述第1圖片相同的圖片。In addition, for example, the encoding method of the present disclosure may be applied to adaptive loop filtering in encoding of a moving image including a plurality of pictures, wherein the pictures are respectively assigned to display a temporary level of temporal adjustability. ID, the encoding method includes the steps of: determining, by referring to the second filtering information associated with the second picture, a first filtering information for applying adaptive loop filtering to the first picture of the plurality of pictures; The second picture is a picture in which the coding order is earlier than the first picture in the plurality of pictures; and the step of applying adaptive loop filtering to the first picture using the determined first filter information In the step of determining the first filter information, when the NAL (Network Abstraction Layer) unit type of the first picture is a predetermined NAL unit type, it is prohibited to refer to the third filter information associated with the third picture as the foregoing 2 filtering information, wherein the third picture is a picture in front of the first picture in a coding order among the plurality of pictures, and is a temporary ID and a front The same picture as the first picture.

藉此,能參考第2圖片的第2濾波資訊,來決定第1圖片的第1濾波資訊。此時,能禁止參考與規定NAL單元類型的第1圖片相同階層的第3圖片之第3濾波資訊來作為第2濾波資訊。Thereby, the first filter information of the first picture can be determined by referring to the second filter information of the second picture. At this time, it is possible to prohibit the reference to the third filter information of the third picture having the same level as the first picture of the predetermined NAL unit type as the second filter information.

即,和可對於與規定NAL單元類型的第1圖片相同階層的圖片所進行的參考限制一樣,能對與規定NAL單元類型的第1圖片相同階層的圖片之濾波資訊進行參考限制。因此,可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,可適當地設定與動態圖像之編碼有關聯之資訊。That is, as with the reference restriction for the picture of the same level as the first picture of the predetermined NAL unit type, it is possible to refer to the filtering information of the picture of the same level as the first picture of the predetermined NAL unit type. Therefore, the filter information can be appropriately managed in association with the picture, and the filter information to be referred to can be appropriately limited. Thereby, information related to the encoding of the moving image can be appropriately set.

又,例如也可為:本揭示一態樣之解碼方法在含有複數張圖片的動態圖像之解碼中適用自適應迴路濾波,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述解碼方法包含有以下步驟:參考有關聯於第2圖片之第2濾波資訊,決定用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊的步驟,其中前述第2圖片是在前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片;及,使用已決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟;在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL(Network Abstraction Layer)單元類型為規定NAL單元類型時,禁止參考有關聯於第3圖片之第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片,且為暫時ID與前述第1圖片相同的圖片。In addition, for example, the decoding method of the present disclosure may be applied to adaptive loop filtering in decoding of a moving image including a plurality of pictures, wherein the pictures are respectively assigned to display a temporary level of time adjustability. ID, the decoding method includes the steps of: determining, by referring to the second filter information associated with the second picture, a first filtering information for applying adaptive loop filtering to the first picture of the plurality of pictures; The second picture is a picture in which the decoding order is earlier than the first picture in the plurality of pictures; and the step of applying adaptive loop filtering to the first picture using the determined first filtering information In the step of determining the first filter information, when the NAL (Network Abstraction Layer) unit type of the first picture is a predetermined NAL unit type, it is prohibited to refer to the third filter information associated with the third picture as the foregoing 2 filtering information, wherein the third picture is a picture in front of the first picture in a decoding order among the plurality of pictures, and is a temporary ID and a front The same picture as the first picture.

藉此,能參考第2圖片的第2濾波資訊,來決定第1圖片的第1濾波資訊。此時,能禁止參考與規定NAL單元類型的第1圖片相同階層的第3圖片之第3濾波資訊來作為第2濾波資訊。Thereby, the first filter information of the first picture can be determined by referring to the second filter information of the second picture. At this time, it is possible to prohibit the reference to the third filter information of the third picture having the same level as the first picture of the predetermined NAL unit type as the second filter information.

即,和可對於與規定NAL單元類型的第1圖片相同階層的圖片所進行的參考限制一樣,能對與規定NAL單元類型的第1圖片相同階層的圖片之濾波資訊進行參考限制。因此,可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,可適當地設定與動態圖像之解碼有關聯的資訊。That is, as with the reference restriction for the picture of the same level as the first picture of the predetermined NAL unit type, it is possible to refer to the filtering information of the picture of the same level as the first picture of the predetermined NAL unit type. Therefore, the filter information can be appropriately managed in association with the picture, and the filter information to be referred to can be appropriately limited. Thereby, information related to the decoding of the moving image can be appropriately set.

又,例如也可為:本揭示一態樣之編碼裝置將含有複數張圖片之動態圖像編碼,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述編碼裝置包含有:電路;及記憶體;前述電路使用前述記憶體,進行以下步驟:將複數個參數組合(parameter set)編碼的步驟,前述參數組合分別被分配0來作為顯示有關於前述時間可調性的階層之暫時ID;及,在前述複數個參數組合之編碼之後,將前述複數張圖片之中編碼順序上為最初的圖片編碼的步驟;前述複數個參數組合分別對應於由被分配於前述複數張圖片之複數個暫時ID所顯示的複數個階層,前述複數個參數組合的每個是相對於1張以上的圖片之參數組合,前述1張以上的圖片為前述複數張圖片之中被分配顯示該參數組合對應的階層之暫時ID的圖片。In addition, for example, the encoding device of the present disclosure may include moving image encoding of a plurality of pictures, wherein the pictures are respectively assigned temporary IDs indicating levels of time adjustability, and the encoding device includes a circuit; and a memory; the foregoing circuit uses the foregoing memory to perform the following steps: a step of encoding a plurality of parameter sets, wherein the parameter combinations are respectively assigned 0 as a hierarchy showing the aforementioned time adjustability. a temporary ID; and, after the encoding of the plurality of parameter combinations, the step of encoding the first image in the plurality of pictures; the plurality of parameter combinations respectively corresponding to being assigned to the plurality of pictures a plurality of levels displayed by a plurality of temporary IDs, each of the plurality of parameter combinations being a parameter combination with respect to one or more pictures, wherein the one or more pictures are assigned to display the parameter among the plurality of pictures A picture of the temporary ID of the corresponding level is combined.

依此,編碼裝置可以在一開始匯集對應於複數個階層的每個階層的複數個參數組合後再編碼。又,對複數個參數組合的每個分配0來作為暫時ID。因此,可在不廢棄的狀態下適當地處理複數個參數組合。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device may combine a plurality of parameter combinations corresponding to each of the plurality of levels at the beginning to be encoded. Further, 0 is assigned to each of a plurality of parameter combinations as a temporary ID. Therefore, a plurality of parameter combinations can be appropriately handled in a state of not being discarded. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如也可為:前述複數張圖片構成第1圖片群,前述複數個參數組合構成第1參數組合群,前述動態圖像更含有構成第2圖片群的複數張圖片,前述電路更進行以下步驟:在構成前述第1圖片群的圖片之編碼之後,將構成第2參數組合群之複數個參數組合編碼的步驟,其中前述參數組合分別被分配0來作為顯示有關於前述時間可調性的階層之暫時ID;及,在構成前述第2參數組合群之前述複數個參數組合之編碼之後,將構成前述第2圖片群之前述複數張圖片之中編碼順序上為最初的圖片編碼的步驟;並且,構成前述第2參數組合群的前述複數個參數組合分別對應於由複數個暫時ID所顯示的複數個階層,前述暫時ID被分配於構成前述第2圖片群的前述複數張圖片;構成前述第2參數組合群的前述複數個參數組合的每個是相對於1張以上的圖片的參數組合,前述1張以上的圖片為構成前述第2圖片群的前述複數張圖片之中被分配暫時ID的圖片,前述暫時ID顯示構成前述第2參數組合群的該參數組合對應的階層。Further, for example, the plurality of pictures may constitute a first picture group, and the plurality of parameters may be combined to form a first parameter combination group, and the moving picture further includes a plurality of pictures constituting the second picture group, and the circuit further performs the following Step: after encoding the picture constituting the first picture group, combining the plurality of parameters constituting the second parameter combination group, wherein the parameter combinations are respectively assigned 0 as the display with respect to the aforementioned time adjustability a temporary ID of the hierarchy; and, after encoding the plurality of parameter combinations constituting the second parameter combination group, a step of encoding the first picture in the coding order among the plurality of pictures constituting the second picture group; Further, the plurality of parameter combinations constituting the second parameter combination group respectively correspond to a plurality of levels displayed by a plurality of temporary IDs, and the temporary ID is allocated to the plurality of pictures constituting the second picture group; Each of the plurality of parameter combinations of the second parameter combination group is a parameter combination with respect to one or more pictures, and the aforementioned one is The upper picture is a picture in which the temporary ID is assigned to the plurality of pictures constituting the second picture group, and the temporary ID displays the level corresponding to the parameter combination constituting the second parameter combination group.

依此,編碼裝置可對每圖片群,在一開始匯集對應於複數個階層的每個階層之複數個參數組合後再編碼。藉此,編碼裝置可對每圖片群,適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device can encode each of the plurality of parameters corresponding to each of the plurality of levels at the beginning for each group of pictures. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image for each group of pictures.

又,例如也可為:本揭示一態樣之解碼裝置將含有複數張圖片之動態圖像解碼,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述解碼裝置包含有:電路;及記憶體;前述電路使用前述記憶體,進行以下步驟:將複數個參數組合解碼的步驟,前述參數組合分別被分配0來作為顯示有關於前述時間可調性的階層之暫時ID;及,在前述複數個參數組合之解碼之後,將前述複數張圖片之中解碼順序上為最初的圖片解碼的步驟;前述複數個參數組合分別對應於由被分配於前述複數張圖片之複數個暫時ID所顯示的複數個階層,前述複數個參數組合的每個是相對於1張以上的圖片之參數組合,前述1張以上的圖片為前述複數張圖片之中被分配顯示該參數組合對應的階層之暫時ID的圖片。In addition, for example, the decoding device of the present disclosure may decode a moving image including a plurality of pictures, wherein the pictures are respectively assigned a temporary ID indicating a level adjustable time, and the decoding device includes The circuit uses the memory to perform the following steps: a step of decoding a plurality of parameters in combination, wherein the parameter combinations are respectively assigned 0 as a temporary ID indicating a hierarchy of the time adjustability; And after the decoding of the plurality of parameter combinations, the decoding sequence of the plurality of pictures is a step of decoding the first picture; and the plurality of parameter combinations respectively correspond to a plurality of temporary bits allocated to the plurality of pictures a plurality of levels displayed by the ID, each of the plurality of parameter combinations being a parameter combination with respect to one or more pictures, and the one or more pictures are assigned to display the level corresponding to the parameter combination among the plurality of pictures The picture of the temporary ID.

依此,解碼裝置可以在一開始匯集對應於複數個階層的每個階層的複數個參數組合後再解碼。又,對複數個參數組合的每個分配0來作為暫時ID。因此,可在不廢棄的狀態下適當地處理複數個參數組合。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding apparatus may combine a plurality of parameter combinations corresponding to each of the plurality of levels at the beginning to decode. Further, 0 is assigned to each of a plurality of parameter combinations as a temporary ID. Therefore, a plurality of parameter combinations can be appropriately handled in a state of not being discarded. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如也可為:前述複數張圖片構成第1圖片群,前述複數個參數組合構成第1參數組合群,前述動態圖像更含有構成第2圖片群的複數張圖片,前述電路更進行以下步驟:在構成前述第1圖片群的圖片之解碼之後,將構成第2參數組合群之複數個參數組合解碼的步驟,前述參數組合分別被分配0來作為顯示有關於前述時間可調性的階層之暫時ID;及,在構成前述第2參數組合群之前述複數個參數組合之解碼之後,將構成前述第2圖片群之前述複數張圖片之中解碼順序上為最初的圖片解碼的步驟;構成前述第2參數組合群的前述複數個參數組合分別對應於由複數個暫時ID所顯示的複數個階層,前述暫時ID被分配於構成前述第2圖片群的前述複數張圖片;構成前述第2參數組合群的前述複數個參數組合的每個是相對於1張以上的圖片的參數組合,前述1張以上的圖片為構成前述第2圖片群的前述複數張圖片之中被分配顯示暫時ID的圖片,前述暫時ID顯示構成前述第2參數組合群的該參數組合對應的階層。Further, for example, the plurality of pictures may constitute a first picture group, and the plurality of parameters may be combined to form a first parameter combination group, and the moving picture further includes a plurality of pictures constituting the second picture group, and the circuit further performs the following a step of decoding a plurality of parameters constituting the second parameter combination group after decoding the picture constituting the first picture group, wherein the parameter combination is assigned 0 as a hierarchy for displaying the time adjustability a temporary ID; and, after decoding the plurality of parameter combinations constituting the second parameter combination group, a step of decoding the first picture in the decoding order among the plurality of pictures constituting the second picture group; The plurality of parameter combinations of the second parameter combination group respectively correspond to a plurality of levels displayed by a plurality of temporary IDs, wherein the temporary ID is allocated to the plurality of pictures constituting the second picture group; and the second parameter is configured Each of the plurality of parameter combinations of the combined group is a parameter combination with respect to one or more pictures, and the one or more pictures are Among the plurality of pictures constituting the second picture group, a picture in which a temporary ID is displayed is displayed, and the temporary ID displays a level corresponding to the parameter combination of the second parameter combination group.

依此,解碼裝置可對每圖片群,在一開始匯集對應於複數個階層的每個階層之複數個參數組合後再解碼。藉此,解碼裝置可對每圖片群,適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding apparatus can decode each of the plurality of parameters corresponding to each of the plurality of levels at the beginning of each picture group. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image for each picture group.

又,例如也可為:本揭示一態樣之編碼方法將含有複數張圖片之動態圖像編碼,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述編碼方法包含有以下步驟:將複數個參數組合編碼的步驟,前述參數組合分別被分配0來作為顯示有關於前述時間可調性的階層之暫時ID;及,在前述複數個參數組合的編碼之後,將前述複數張圖片之中編碼順序上為最初的圖片編碼的步驟;前述複數個參數組合分別對應於由被分配於前述複數張圖片的複數個暫時ID所顯示的複數個階層;前述複數個參數組合的每個為相對於1張以上的圖片的參數組合,前述1張以上的圖片為前述複數張圖片之中被分配顯示該參數組合對應的階層之暫時ID的圖片。In addition, for example, the encoding method of the present disclosure may include moving image encoding of a plurality of pictures, wherein the pictures are respectively assigned temporary IDs indicating levels of time adjustability, and the foregoing encoding method includes a step of encoding a plurality of parameters in combination, wherein the parameter combinations are respectively assigned 0 as a temporary ID indicating a hierarchy with respect to the time adjustability; and, after the encoding of the plurality of parameter combinations, the foregoing plural a step of encoding the first picture in the coding order; the plurality of parameter combinations respectively corresponding to a plurality of levels displayed by a plurality of temporary IDs allocated to the plurality of pictures; each of the plurality of parameter combinations The one or more pictures are combined with one or more pictures, and the one or more pictures are pictures in which the temporary ID of the hierarchy corresponding to the parameter combination is assigned among the plurality of pictures.

依此,可以在一開始匯集對應於複數個階層的每個階層之複數個參數組合後再編碼。又,對複數個參數組合的每個分配0來作為暫時ID。因此,可在不廢棄的狀態下適當地處理複數個參數組合。藉此,可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, a plurality of parameter combinations corresponding to each of the plurality of levels can be combined at the beginning to be encoded. Further, 0 is assigned to each of a plurality of parameter combinations as a temporary ID. Therefore, a plurality of parameter combinations can be appropriately handled in a state of not being discarded. Thereby, information related to the encoding of the moving image can be appropriately set.

又,例如也可為:本揭示一態樣之解碼方法將含有複數張圖片之動態圖像解碼,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述解碼方法包含有以下步驟:將複數個參數組合解碼的步驟,前述參數組合分別被分配0來作為顯示有關於前述時間可調性的階層之暫時ID;及,在前述複數個參數組合之解碼之後,將前述複數張圖片之中解碼順序上為最初的圖片解碼的步驟;前述複數個參數組合分別對應於由被分配於前述複數張圖片之複數個暫時ID所顯示的複數個階層,前述複數個參數組合的每個是相對於1張以上的圖片之參數組合,前述1張以上的圖片為前述複數張圖片之中被分配顯示該參數組合對應的階層之暫時ID的圖片。In addition, for example, the decoding method of the present disclosure may decode a dynamic image including a plurality of pictures, wherein the pictures are respectively assigned a temporary ID indicating a level adjustability, and the decoding method includes a step of decoding a plurality of parameters in combination, wherein the parameter combinations are respectively assigned 0 as a temporary ID indicating a hierarchy with respect to the time adjustability; and, after decoding of the plurality of parameter combinations, the foregoing plural a step of decoding the first picture in the decoding order; the plurality of parameter combinations respectively correspond to a plurality of levels displayed by a plurality of temporary IDs allocated to the plurality of pictures, each of the plurality of parameter combinations One is a parameter combination with respect to one or more pictures, and the one or more pictures are pictures in which the temporary ID of the hierarchy corresponding to the parameter combination is assigned among the plurality of pictures.

依此,可以在一開始匯集對應於複數個階層的每個階層之複數個參數組合後再解碼。又,對複數個參數組合的每個分配0來作為暫時ID。因此,可在不廢棄的狀態下適當地處理複數個參數組合。藉此,可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, a plurality of parameter combinations corresponding to each of the plurality of levels can be combined at the beginning to be decoded. Further, 0 is assigned to each of a plurality of parameter combinations as a temporary ID. Therefore, a plurality of parameter combinations can be appropriately handled in a state of not being discarded. Thereby, information related to the decoding of the moving image can be appropriately set.

又,例如也可為:本揭示一態樣之編碼裝置將含有複數張圖片之動態圖像編碼,前述編碼裝置包含有:電路;及記憶體;前述電路使用前述記憶體,進行以下步驟:將前述複數張圖片之中的第1圖片編碼的步驟;及,進行(i)第1動作、或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片之編碼之後,將對於第2圖片的參數組合編碼,且在前述參數組合之編碼之後,將前述第2圖片編碼的動作,前述第2圖片是前述複數張圖片之中編碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之編碼之後,在不將前述參數組合編碼的狀態下,將前述第2圖片編碼的動作;在進行前述第1動作或者前述第2動作的步驟中,當前述第2圖片為規定圖片時,前述電路進行前述第1動作。Furthermore, for example, the encoding device according to the present disclosure may include moving image encoding including a plurality of pictures, the encoding device including: a circuit; and a memory; and the circuit using the memory to perform the following steps: a step of encoding the first picture among the plurality of pictures; and performing the steps of (i) the first operation or (ii) the second operation, wherein the first operation is after the coding of the first picture The parameter combination encoding of the second picture, and after the encoding of the parameter combination, the second picture encoding operation, wherein the second picture is a picture in the coding order that is later than the first picture in the coding order The second operation is an operation of encoding the second picture in a state in which the parameter is not encoded after the encoding of the first picture, and in the step of performing the first operation or the second operation, When the second picture is a predetermined picture, the circuit performs the first operation.

依此,編碼裝置能在規定圖片之前,將相對於規定圖片的參數組合編碼。因此,在相對於規定圖片的向上切換等之中,能適當地處理相對於規定圖片的參數組合。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device can encode the parameters of the specified picture in combination before the picture is specified. Therefore, among the upward switching with respect to the predetermined picture or the like, the parameter combination with respect to the predetermined picture can be appropriately processed. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如前述規定圖片也可為TSA (Temporal Sub-layer Access)圖片。Further, for example, the predetermined picture may be a TSA (Temporal Sub-layer Access) picture.

依此,編碼裝置可在TSA圖片之前,將對於TSA圖片之參數組合編碼。因此,在對於TSA圖片之向上切換等之中,能適當地處理對於TSA圖片之參數組合。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device can encode the parameters for the TSA picture in combination before the TSA picture. Therefore, among the upward switching or the like for the TSA picture, the parameter combination for the TSA picture can be appropriately processed. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如也可為:前述複數張圖片的每張為被分配顯示有關於時間可調性的階層之暫時ID的圖片;前述電路在前述第1動作中,在前述第1圖片的編碼之後,將作為複數個參數組合之複數個關聯參數組合編碼,前述參數組合含有對於前述第2圖片的前述參數組合;在前述複數個關聯參數組合之編碼之後,將前述第2圖片編碼;前述複數個關聯參數組合分別對應於由複數個暫時ID所顯示的複數個階層,前述暫時ID為被分配前述第2圖片的暫時ID以上;前述複數個關聯參數組合的每個為相對於1張以上的圖片之參數組合,前述1張以上的圖片為前述複數張圖片之中被分配顯示該關聯參數組合對應的階層之暫時ID的圖片。Further, for example, each of the plurality of pictures may be a picture to which a temporary ID of a hierarchy indicating temporal adjustability is assigned, and in the first operation, after the encoding of the first picture, Combining a plurality of correlation parameters as a plurality of parameter combinations, wherein the parameter combination includes the parameter combination for the second picture; after encoding the plurality of associated parameter combinations, encoding the second picture; the plurality of associations The parameter combinations respectively correspond to a plurality of levels displayed by a plurality of temporary IDs, wherein the temporary ID is equal to or greater than a temporary ID to which the second picture is assigned; and each of the plurality of associated parameter combinations is for one or more pictures. In the parameter combination, the one or more pictures are pictures in which the temporary ID of the hierarchy corresponding to the associated parameter combination is assigned among the plurality of pictures.

依此,編碼裝置能在規定圖片之前,將相對於複數張圖片的複數個參數組合編碼,前述複數張圖片之每張的暫時ID與規定圖片相同,或者暫時ID大於規定圖片。因此,在相對於暫時ID大於規定圖片的圖片之向上切換等之中,能適當地處理參數組合。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device can combine and encode a plurality of parameters with respect to the plurality of pictures before the predetermined picture, and the temporary ID of each of the plurality of pictures is the same as the predetermined picture, or the temporary ID is larger than the predetermined picture. Therefore, the parameter combination can be appropriately handled in the upward switching with respect to the picture whose temporary ID is larger than the predetermined picture. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如前述規定圖片也可為STSA (Step-wise Temporal Sub-layer Access)圖片。Further, for example, the predetermined picture may be an STSA (Step-wise Temporal Sub-layer Access) picture.

依此,編碼裝置可在STSA圖片之前,將相對於STSA圖片之參數組合編碼。因此,在相對於STSA圖片之向上切換等之中,能適當地處理相對於STSA圖片之參數組合。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device can encode the parameters of the STSA picture in combination before the STSA picture. Therefore, the parameter combination with respect to the STSA picture can be appropriately handled among the upward switching with respect to the STSA picture or the like. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如前述第2圖片也可為前述複數張圖片之中在前述第1圖片的下一張被編碼的圖片。Further, for example, the second picture may be a picture encoded in the next picture of the first picture among the plurality of pictures.

依此,編碼裝置可在剛要將規定圖片編碼之前,將相對於規定圖片的參數組合適當地編碼。因此,能適當地處理相對於規定圖片之參數組合。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device can appropriately encode the parameter combination with respect to the prescribed picture just before encoding the prescribed picture. Therefore, the parameter combination with respect to the prescribed picture can be handled appropriately. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如也可為:前述複數張圖片的每張為被分配顯示有關於時間可調性的階層之暫時ID的圖片;前述電路進而在將前述複數張圖片之中編碼順序上為最初的圖片編碼之前,將複數個概括參數組合編碼,其中前述概括參數組合為含有對於第2圖片之參數組合的複數個參數組合;前述複數個概括參數組合分別對應於由複數個暫時ID所顯示的複數個階層,前述暫時ID被分配於前述複數張圖片;前述複數個概括參數組合的每個為相對於1張以上的圖片之參數組合,前述1張以上的圖片為前述複數張圖片之中被分配暫時ID的圖片,前述暫時ID顯示該概括參數組合對應的階層。Further, for example, each of the plurality of pictures may be a picture to which a temporary ID of a hierarchy indicating temporal adjustability is assigned, and the circuit further includes the first picture in the coding order among the plurality of pictures. Prior to encoding, the plurality of summary parameters are combined and encoded, wherein the summary parameters are combined into a plurality of parameter combinations including parameter combinations for the second picture; the plurality of summary parameter combinations respectively correspond to a plurality of plural numbers displayed by the plurality of temporary IDs a hierarchy in which the temporary ID is allocated to the plurality of pictures; each of the plurality of summary parameter combinations is a parameter combination with respect to one or more pictures, and the one or more pictures are temporarily allocated among the plurality of pictures The picture of the ID, the aforementioned temporary ID shows the level corresponding to the summary parameter combination.

依此,就算含有相對於規定圖片的參數組合之複數個參數組合一開始已被編碼時,編碼裝置也可在規定圖片之前,再度將相對於規定圖片之參數組合編碼。因此,能適當地處理相對於規定圖片之參數組合。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, even if a plurality of parameter combinations including a combination of parameters with respect to a predetermined picture are initially encoded, the encoding apparatus can again encode the parameters of the predetermined picture in combination before the specified picture. Therefore, the parameter combination with respect to the prescribed picture can be handled appropriately. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如也可為:本揭示一態樣之解碼裝置將含有複數張圖片之動態圖像解碼,前述解碼裝置包含有:電路;及記憶體;前述電路使用前述記憶體,進行以下步驟:將前述複數張圖片之中的第1圖片解碼的步驟;及,進行(i)第1動作、或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片之解碼之後,將相對於第2圖片的參數組合解碼,且在前述參數組合之解碼之後,將前述第2圖片解碼,前述第2圖片是前述複數張圖片之中解碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之解碼之後,在不將前述參數組合解碼的狀態下,將前述第2圖片解碼;在進行前述第1動作或者前述第2動作的步驟中,當前述第2圖片為規定圖片時,前述電路進行前述第1動作。Furthermore, for example, the decoding apparatus according to the present disclosure may decode a moving picture including a plurality of pictures, the decoding apparatus includes: a circuit; and a memory; and the circuit uses the memory to perform the following steps: a step of decoding the first picture among the plurality of pictures; and performing (i) the first operation or (ii) the second operation, wherein the first operation is after decoding the first picture Decoding with respect to the parameter of the second picture, and decoding the second picture after decoding of the parameter combination, wherein the second picture is a picture in which the decoding order is later than the first picture in the plurality of pictures. In the second operation, after the decoding of the first picture, the second picture is decoded without decoding the parameter combination; and in the step of performing the first operation or the second operation, the foregoing When the picture 2 is a predetermined picture, the aforementioned circuit performs the first operation.

依此,解碼裝置能在規定圖片之前,將相對於規定圖片的參數組合解碼。因此,在相對於規定圖片的向上切換等之中,能適當地處理相對於規定圖片的參數組合。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device can combine the parameters of the predetermined picture before decoding the specified picture. Therefore, among the upward switching with respect to the predetermined picture or the like, the parameter combination with respect to the predetermined picture can be appropriately processed. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如前述規定圖片也可為TSA (Temporal Sub-layer Access)圖片。Further, for example, the predetermined picture may be a TSA (Temporal Sub-layer Access) picture.

依此,解碼裝置可在TSA圖片之前,將相對於TSA圖片之參數組合解碼。因此,在相對於TSA圖片之向上切換等之中,能適當地處理相對於TSA圖片之參數組合。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device can combine the parameters of the TSA picture in combination before the TSA picture. Therefore, among the upward switching with respect to the TSA picture or the like, the parameter combination with respect to the TSA picture can be appropriately processed. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如也可為:前述複數張圖片的每張為被分配顯示有關於時間可調性的階層之暫時ID的圖片;前述電路在前述第1動作中,在前述第1圖片的解碼之後,將複數個關聯參數組合解碼,前述關聯參數組合為含有相對於前述第2圖片的前述參數組合之複數個參數組合;在前述複數個關聯參數組合之解碼之後,將前述第2圖片解碼;前述複數個關聯參數組合分別對應於由複數個暫時ID所顯示的複數個階層,前述暫時ID為被分配前述第2圖片的暫時ID以上;前述複數個關聯參數組合的每個為相對於1張以上的圖片之參數組合,前述1張以上的圖片為前述複數張圖片之中被分配顯示該關聯參數組合對應的階層之暫時ID的圖片。Further, for example, each of the plurality of pictures may be a picture to which a temporary ID of a hierarchy indicating temporal adjustability is assigned, and in the first operation, after the decoding of the first picture, Decoding a plurality of correlation parameters, wherein the correlation parameter combination is a combination of a plurality of parameters including the parameter combination with respect to the second picture; after decoding the plurality of associated parameter combinations, decoding the second picture; Each of the associated parameter combinations corresponds to a plurality of levels displayed by a plurality of temporary IDs, wherein the temporary ID is equal to or greater than a temporary ID to which the second picture is assigned; and each of the plurality of associated parameter combinations is one or more In the parameter combination of the pictures, the one or more pictures are pictures in which the temporary ID of the hierarchy corresponding to the associated parameter combination is assigned among the plurality of pictures.

依此,解碼裝置能在規定圖片之前,將相對於複數張圖片的複數個參數組合解碼,前述圖片的每張的暫時ID與規定圖片相同,或者暫時ID大於規定圖片。因此,在相對於暫時ID大於規定圖片的圖片之向上切換等之中,能適當地處理參數組合。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device can combine the plurality of parameters of the plurality of pictures in combination before the predetermined picture, the temporary ID of each picture of the picture is the same as the predetermined picture, or the temporary ID is larger than the predetermined picture. Therefore, the parameter combination can be appropriately handled in the upward switching with respect to the picture whose temporary ID is larger than the predetermined picture. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如前述規定圖片也可為STSA (Step-wise Temporal Sub-layer Access)圖片。Further, for example, the predetermined picture may be an STSA (Step-wise Temporal Sub-layer Access) picture.

依此,解碼裝置可在STSA圖片之前,將相對於STSA圖片之參數組合解碼。因此,在相對於STSA圖片之向上切換等之中,能適當地處理相對於STSA圖片之參數組合。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device can combine the parameters of the STSA picture in combination before the STSA picture. Therefore, the parameter combination with respect to the STSA picture can be appropriately handled among the upward switching with respect to the STSA picture or the like. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如前述第2圖片也可為前述複數張圖片之中在前述第1圖片的下一張被解碼的圖片。Further, for example, the second picture may be a picture decoded in the next picture of the first picture among the plurality of pictures.

依此,解碼裝置可在剛要將規定圖片解碼之前,將相對於規定圖片的參數組合適當地解碼。因此,能適當地處理相對於規定圖片之參數組合。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device can appropriately decode the parameter combination with respect to the predetermined picture just before decoding the predetermined picture. Therefore, the parameter combination with respect to the prescribed picture can be handled appropriately. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如也可為:前述複數張圖片的每張為被分配顯示有關於時間可調性的階層之暫時ID的圖片;前述電路進而在將前述複數張圖片之中解碼順序上為最初的圖片解碼之前,將複數個概括參數組合解碼,前述概括參數組合為含有相對於前述第2圖片之前述參數組合的複數個參數組合;前述複數個概括參數組合分別對應於由複數個暫時ID所顯示的複數個階層,前述暫時ID被分配於前述複數張圖片;前述複數個概括參數組合的每個為相對於1張以上的圖片之參數組合,前述1張以上的圖片為前述複數張圖片之中被分配暫時ID的圖片,前述暫時ID顯示該概括參數組合對應的階層。Further, for example, each of the plurality of pictures may be a picture to which a temporary ID of a hierarchy indicating temporal adjustability is assigned, and the circuit further decodes the plurality of pictures into an initial picture. Before decoding, the plurality of summary parameters are combined and decoded, and the summary parameters are combined into a plurality of parameter combinations including the foregoing parameter combinations with respect to the second picture; the plurality of summary parameter combinations respectively correspond to the plurality of temporary IDs displayed. a plurality of levels, wherein the temporary ID is allocated to the plurality of pictures; each of the plurality of summary parameter combinations is a parameter combination with respect to one or more pictures, and the one or more pictures are among the plurality of pictures A picture of the temporary ID is assigned, and the temporary ID indicates the level corresponding to the summary parameter combination.

依此,就算含有相對於規定圖片的參數組合之複數個參數組合一開始已被解碼時,解碼裝置也可在規定圖片之前,再度將相對於規定圖片之參數組合解碼。因此,能適當地處理相對於規定圖片之參數組合。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, even if a plurality of parameter combinations including a combination of parameters with respect to a predetermined picture are initially decoded, the decoding apparatus can again decode the parameters of the predetermined picture in combination before the specified picture. Therefore, the parameter combination with respect to the prescribed picture can be handled appropriately. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如也可為:本揭示一態樣之編碼方法將含有複數張圖片之動態圖像編碼,前述編碼方法包含有以下步驟:將前述複數張圖片之中的第1圖片編碼的步驟;及,進行(i)第1動作、或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片之編碼之後,將相對於第2圖片的參數組合編碼,且在前述參數組合之編碼之後,將前述第2圖片編碼,前述第2圖片是前述複數張圖片之中編碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之編碼之後,在不將前述參數組合編碼的狀態下,將前述第2圖片編碼;在進行前述第1動作或者前述第2動作的步驟中,當前述第2圖片為規定圖片時,進行前述第1動作。Moreover, for example, the encoding method of the present disclosure may include moving image encoding of a plurality of pictures, wherein the encoding method includes the steps of: encoding the first picture among the plurality of pictures; and And performing the steps of (i) the first operation or (ii) the second operation, wherein the first operation is to combine the parameters of the second picture after the coding of the first picture, and combine the parameters in the foregoing After encoding, the second picture is encoded, wherein the second picture is a picture in which the coding order is later than the first picture, and the second operation is after coding of the first picture. The second picture is encoded in a state in which the parameters are combined and encoded, and in the step of performing the first operation or the second operation, when the second picture is a predetermined picture, the first operation is performed.

依此,能在規定圖片之前,將相對於規定圖片的參數組合編碼。因此,在相對於規定圖片的向上切換等之中,能適當地處理相對於規定圖片的參數組合。藉此,可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the parameters of the specified picture can be combined and encoded before the picture is specified. Therefore, among the upward switching with respect to the predetermined picture or the like, the parameter combination with respect to the predetermined picture can be appropriately processed. Thereby, information related to the encoding of the moving image can be appropriately set.

又,例如也可為:本揭示一態樣之解碼方法將含有複數張圖片之動態圖像解碼,前述解碼方法包含有以下步驟:將前述複數張圖片之中的第1圖片解碼的步驟;及,進行(i)第1動作、或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片之解碼之後,將相對於第2圖片的參數組合解碼,且在前述參數組合之解碼之後,將前述第2圖片解碼,前述第2圖片是前述複數張圖片之中解碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之解碼之後,在不將前述參數組合解碼的狀態下,將前述第2圖片解碼;在進行前述第1動作或者前述第2動作的步驟中,當前述第2圖片為規定圖片時,進行前述第1動作。Furthermore, for example, the decoding method according to the present disclosure may decode a moving picture including a plurality of pictures, and the decoding method includes the steps of: decoding a first picture among the plurality of pictures; and And performing (i) the first operation or (ii) the second operation, wherein the first operation is to decode the parameter combination with the second picture after the decoding of the first picture, and combine the foregoing parameters After decoding, the second picture is decoded, wherein the second picture is a picture in the decoding order that is later than the first picture, and the second operation is after decoding the first picture. The second picture is decoded without decoding the combination of the parameters. In the step of performing the first operation or the second operation, when the second picture is a predetermined picture, the first operation is performed.

依此,能在規定圖片之前,將相對於規定圖片的參數組合解碼。因此,在相對於規定圖片的向上切換等之中,能適當地處理相對於規定圖片的參數組合。藉此,可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the parameter combination with respect to the specified picture can be decoded before the picture is specified. Therefore, among the upward switching with respect to the predetermined picture or the like, the parameter combination with respect to the predetermined picture can be appropriately processed. Thereby, information related to the decoding of the moving image can be appropriately set.

又,例如也可為:本揭示一態樣之編碼裝置將含有複數張圖片之動態圖像編碼,前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述編碼裝置包含有:電路;及記憶體;前述電路使用前述記憶體,進行以下步驟:將前述複數張圖片之中的第1圖片編碼的步驟;及,進行(i)第1動作、或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片之編碼之後,將相對於第2圖片的參數組合編碼,且在前述參數組合之編碼之後,將前述第2圖片編碼,前述第2圖片是前述複數張圖片之中編碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之編碼之後,在不將前述參數組合編碼的狀態下,將前述第2圖片編碼;在進行前述第1動作或者前述第2動作的步驟中,當被分配於前述第2圖片的暫時ID較被分配於前述複數張圖片的複數個暫時ID之中的最小的暫時ID還大,且較前述複數個暫時ID之中的最大的暫時ID還小時,前述電路進行前述第1動作。Moreover, for example, the encoding apparatus according to the present disclosure may include moving image encoding of a plurality of pictures, wherein the pictures are respectively assigned a temporary ID indicating a level adjustability, and the encoding apparatus includes: a circuit; and a memory; wherein the circuit uses the memory to perform the steps of: encoding a first picture of the plurality of pictures; and performing (i) the first operation or the (ii) the second operation In the first operation, after the encoding of the first picture, the parameters of the second picture are combined and encoded, and after the coding of the parameter combination, the second picture is encoded, and the second picture is the foregoing a picture in which a coding sequence is later than the first picture in the plurality of pictures, and the second operation is to encode the second picture without coding the parameter after the coding of the first picture; In the step of performing the first operation or the second operation, the temporary ID assigned to the second picture is the highest among the plurality of temporary IDs assigned to the plurality of pictures. The small temporary ID is also large, and is smaller than the largest temporary ID among the plurality of temporary IDs, and the circuit performs the first operation.

藉此,編碼裝置在中間層之圖片之前,可將相對於中間層之圖片的參數組合編碼。因此,在相對於中間層之圖片的向上切換等之中,能適當地處理相對於中間層之圖片的參數組合。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。Thereby, the encoding device can encode the parameters of the picture relative to the intermediate layer before the picture of the intermediate layer. Therefore, among the upward switching or the like with respect to the picture of the intermediate layer, the parameter combination with respect to the picture of the intermediate layer can be appropriately processed. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如,也可在進行前述第1動作或者前述第2動作的步驟中,就算被分配於前述第2圖片的暫時ID為前述最大的暫時ID時,前述電路仍進行前述第1動作。Further, for example, in the step of performing the first operation or the second operation, even if the temporary ID assigned to the second picture is the largest temporary ID, the circuit performs the first operation.

依此,編碼裝置可在最上位層之圖片之前,將相對於最上位層之圖片的參數組合編碼。因此,在相對於最上位層之圖片的向上切換等之中,能適當地處理相對於最上位層的圖片之參數組合。藉此,編碼裝置可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device can encode the parameters of the picture with respect to the uppermost layer before the picture of the uppermost layer. Therefore, among the upward switching or the like with respect to the picture of the uppermost layer, the parameter combination with respect to the picture of the uppermost layer can be appropriately processed. Thereby, the encoding device can appropriately set the information associated with the encoding of the moving image.

又,例如也可為:在被分配於前述第2圖片的暫時ID為前述複數個暫時ID之中第2大的暫時ID時所進行的前述第1動作之中,前述電路在前述第1圖片之編碼之後,將前述參數組合及最上位參數組合編碼,且在前述參數組合及前述最上位參數組合之編碼之後,將前述第2圖片編碼,前述最上位參數組合為相對於1張以上的圖片之參數組合,前述1張以上的圖片被分配前述最大的暫時ID。Further, for example, in the first operation performed when the temporary ID assigned to the second picture is the second largest temporary ID among the plurality of temporary IDs, the circuit may be in the first picture. After the encoding, the parameter combination and the highest parameter are combined and encoded, and after the parameter combination and the encoding of the highest parameter combination, the second picture is encoded, and the top parameter is combined with one or more pictures. In combination with the parameters, the largest temporary ID is assigned to the one or more pictures.

依此,編碼裝置能有效率地將含有相對於最上位層的圖片之參數組合的2個參數組合編碼。Accordingly, the encoding apparatus can efficiently encode the two parameters including the combination of the parameters of the picture with respect to the highest layer.

又,例如也可在進行前述第1動作或者前述第2動作的步驟中,當被分配於前述第2圖片的暫時ID為前述最大的暫時ID時,前述電路進行前述第2動作。Further, for example, in the step of performing the first operation or the second operation, when the temporary ID assigned to the second picture is the largest temporary ID, the circuit performs the second operation.

依此,編碼裝置可在最上位層的圖片之前,省略將相對於最上位層的圖片之參數組合編碼。Accordingly, the encoding device can omitting the combination of the parameters of the picture with respect to the uppermost layer before the picture of the uppermost layer.

又,例如也可在進行前述第1動作或者前述第2動作的步驟中,在相對於前述複數張圖片之序列參數組合所含的規定旗標為規定值這樣的條件下,被分配於前述第2圖片的暫時ID大於前述最小的暫時ID,且小於前述最大的暫時ID時,前述電路進行前述第1動作。Further, for example, in the step of performing the first operation or the second operation, the predetermined flag included in the sequence parameter combination of the plurality of pictures may be assigned to the predetermined value. When the temporary ID of the 2 picture is larger than the minimum temporary ID and smaller than the maximum temporary ID, the circuit performs the first operation.

依此,編碼裝置在規定的序列中,可在中間層之圖片之前,適當地將相對於中間層之圖片的參數組合編碼。Accordingly, in the predetermined sequence, the encoding device can appropriately encode the parameters of the picture with respect to the intermediate layer before the picture of the intermediate layer.

又,例如也可為:在前述規定旗標為前述規定值這樣的條件下,前述複數張圖片的每張是當被分配於該圖片的暫時ID不是前述最小的暫時ID時,為TSA(Temporal Sub-layer Access)圖片。Further, for example, in a case where the predetermined flag is the predetermined value, each of the plurality of pictures may be TSA (Temporal) when the temporary ID assigned to the picture is not the smallest temporary ID. Sub-layer Access) picture.

依此,編碼裝置在除最下層外皆由TSA圖片所構成的規定的序列中,在中間層之圖片之前,可適當地將相對於中間層之圖片的參數組合編碼。Accordingly, in the predetermined sequence in which the coding apparatus is composed of TSA pictures except the lowermost layer, the parameters of the picture with respect to the intermediate layer can be combined and encoded before the picture of the intermediate layer.

又,例如也可為:本揭示一態樣之解碼裝置將含有複數張圖片之動態圖像解碼,前述圖片分別被分配暫時ID,前述暫時ID顯示有關於時間可調性的階層,前述解碼裝置包含有:電路;及記憶體;前述電路使用前述記憶體,進行以下步驟:將前述複數張圖片之中的第1圖片解碼的步驟;及,進行(i)第1動作、或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片之解碼之後,將相對於第2圖片的參數組合解碼,且在前述參數組合之解碼之後,將前述第2圖片解碼,前述第2圖片是前述複數張圖片之中解碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之解碼之後,在不將前述參數組合解碼的狀態下,將前述第2圖片解碼;在進行前述第1動作或者前述第2動作的步驟中,當被分配於前述第2圖片的暫時ID較被分配於前述複數張圖片的複數個暫時ID之中的最小的暫時ID還大,且較前述複數個暫時ID之中的最大的暫時ID還小時,前述電路進行前述第1動作。Furthermore, for example, the decoding apparatus according to the present disclosure may decode a moving picture including a plurality of pictures, each of which is assigned a temporary ID, and the temporary ID displays a level with respect to time adjustability, and the decoding apparatus The circuit includes: a circuit; and the memory; the circuit uses the memory to perform the steps of: decoding a first picture of the plurality of pictures; and performing (i) the first action or (ii) In the second operation step, after the decoding of the first picture, the parameter is combined and decoded with respect to the second picture, and after the decoding of the parameter combination, the second picture is decoded, and the second picture is decoded. The picture is a picture in which the decoding order is later than the first picture in the plurality of pictures, and the second operation is the second operation in the state in which the parameter is not decoded after the decoding of the first picture. Picture decoding; in the step of performing the first operation or the second operation, the temporary ID assigned to the second picture is more than the temporary number assigned to the plurality of pictures The smallest temporary ID among the IDs is also large, and is smaller than the largest temporary ID among the plurality of temporary IDs, and the circuit performs the first operation.

依此,解碼裝置可在中間層之圖片之前,將相對於中間層之圖片的參數組合解碼。因此,在相對於中間層之圖片的向上切換等之中,得適當地處理相對於中間層之圖片的參數組合。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device can decode the parameter combination of the picture with respect to the intermediate layer before the picture of the intermediate layer. Therefore, among the upward switching or the like with respect to the picture of the intermediate layer, the parameter combination with respect to the picture of the intermediate layer is appropriately processed. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如也可在進行前述第1動作或者前述第2動作的步驟中,就算被分配於前述第2圖片的暫時ID為前述最大的暫時ID時,前述電路仍進行前述第1動作。Further, for example, in the step of performing the first operation or the second operation, even if the temporary ID assigned to the second picture is the largest temporary ID, the circuit performs the first operation.

依此,解碼裝置可在最上位層之圖片之前,將相對於最上位層之圖片的參數組合解碼。因此,在相對於最上位層之圖片的向上切換等之中,能適當地處理相對於最上位層的圖片之參數組合。藉此,解碼裝置可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device can decode the parameter combination of the picture with respect to the uppermost layer before the picture of the uppermost layer. Therefore, among the upward switching or the like with respect to the picture of the uppermost layer, the parameter combination with respect to the picture of the uppermost layer can be appropriately processed. Thereby, the decoding device can appropriately set the information associated with the decoding of the moving image.

又,例如也可為:在被分配於前述第2圖片的暫時ID為前述複數個暫時ID之中第2大的暫時ID時所進行的前述第1動作之中,前述電路在前述第1圖片之解碼之後,將前述參數組合及最上位參數組合解碼,且在前述參數組合及前述最上位參數組合之解碼之後,將前述第2圖片解碼,前述最上位參數組合為相對於1張以上的圖片之參數組合,前述1張以上的圖片被分配前述最大的暫時ID。Further, for example, in the first operation performed when the temporary ID assigned to the second picture is the second largest temporary ID among the plurality of temporary IDs, the circuit may be in the first picture. After decoding, the parameter combination and the highest parameter are combined and decoded, and after the parameter combination and the decoding of the highest parameter combination, the second picture is decoded, and the top parameter is combined with one or more pictures. In combination with the parameters, the largest temporary ID is assigned to the one or more pictures.

依此,解碼裝置能有效率地將含有相對於最上位層的圖片之參數組合的2個參數組合解碼。Accordingly, the decoding apparatus can efficiently decode the combination of two parameters including the parameters of the picture with respect to the uppermost layer.

又,例如也可在進行前述第1動作或者前述第2動作的步驟中,當被分配於前述第2圖片的暫時ID為前述最大的暫時ID時,前述電路進行前述第2動作。Further, for example, in the step of performing the first operation or the second operation, when the temporary ID assigned to the second picture is the largest temporary ID, the circuit performs the second operation.

依此,解碼裝置可在最上位層的圖片之前,省略將相對於最上位層的圖片之參數組合解碼。Accordingly, the decoding device can omitting the combination of the parameters of the picture with respect to the uppermost layer before the picture of the uppermost layer.

又,例如也可為:在進行前述第1動作或者前述第2動作的步驟中,在相對於前述複數張圖片之序列參數組合所含的規定旗標為規定值這樣的條件下,當被分配於前述第2圖片的暫時ID大於前述最小的暫時ID,且小於前述最大的暫時ID時,前述電路進行前述第1動作。Further, for example, in the step of performing the first operation or the second operation, the predetermined flag included in the sequence parameter combination of the plurality of pictures may be assigned a predetermined value. When the temporary ID of the second picture is larger than the minimum temporary ID and smaller than the maximum temporary ID, the circuit performs the first operation.

依此,解碼裝置在規定的序列中,可在中間層之圖片之前,適當地將對於中間層之圖片的參數組合解碼。Accordingly, in the predetermined sequence, the decoding device can appropriately decode the parameter combination of the picture of the intermediate layer before the picture of the intermediate layer.

又,例如也可為:在前述規定旗標為前述規定值這樣的條件下,前述複數張圖片的每張是當被分配於該圖片的暫時ID不是前述最小的暫時ID時,為TSA(Temporal Sub-layer Access)圖片。Further, for example, in a case where the predetermined flag is the predetermined value, each of the plurality of pictures may be TSA (Temporal) when the temporary ID assigned to the picture is not the smallest temporary ID. Sub-layer Access) picture.

依此,解碼裝置在除最下層外皆由TSA圖片所構成的規定的序列中,在中間層之圖片之前,可適當地將相對於中間層之圖片的參數組合解碼。Accordingly, in the predetermined sequence in which the decoding apparatus is composed of TSA pictures except the lowest layer, the parameters of the picture with respect to the intermediate layer can be appropriately decoded before the picture of the intermediate layer.

又,例如也可為:本揭示一態樣之編碼方法將含有複數張圖片之動態圖像編碼,前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述編碼方法包含有以下步驟:將前述複數張圖片之中的第1圖片編碼的步驟;及,進行(i)第1動作、或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片之編碼之後,將相對於第2圖片的參數組合編碼,且在前述參數組合之編碼之後,將前述第2圖片編碼,前述第2圖片是前述複數張圖片之中編碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之編碼之後,在不將前述參數組合編碼的狀態下,將前述第2圖片編碼;在進行前述第1動作或者前述第2動作的步驟中,當被分配於前述第2圖片的暫時ID較被分配於前述複數張圖片的複數個暫時ID之中的最小的暫時ID還大,且較前述複數個暫時ID之中的最大的暫時ID還小時,進行前述第1動作。Moreover, for example, the encoding method according to the present disclosure may include moving image encoding including a plurality of pictures, wherein the pictures are respectively assigned a temporary ID indicating a time adjustable property, and the encoding method includes the following a step of encoding a first picture among the plurality of pictures; and performing (i) a first operation or (ii) a second operation, wherein the first operation is coding of the first picture Thereafter, the parameters of the second picture are combined and encoded, and after the encoding of the parameter combination, the second picture is encoded, and the second picture is that the coding order in the plurality of pictures is later than the first picture. In the second picture, after the encoding of the first picture, the second picture is encoded without combining the parameters, and in the step of performing the first operation or the second operation, The temporary ID assigned to the second picture is larger than the smallest temporary ID among the plurality of temporary IDs assigned to the plurality of pictures, and is the largest among the plurality of temporary IDs Buyer ID further hour, the first operation.

依此,可在中間層之圖片之前,將相對於中間層之圖片的參數組合編碼。因此,在相對於中間層之圖片的向上切換等之中,能適當地處理相對於中間層之圖片的參數組合。藉此,可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the parameters of the picture relative to the middle layer can be combined and encoded before the picture of the middle layer. Therefore, among the upward switching or the like with respect to the picture of the intermediate layer, the parameter combination with respect to the picture of the intermediate layer can be appropriately processed. Thereby, information related to the encoding of the moving image can be appropriately set.

又,例如也可為:本揭示一態樣之解碼方法將含有複數張圖片之動態圖像解碼,前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述解碼方法包含有以下步驟:將前述複數張圖片之中的第1圖片解碼的步驟;及,進行(i)第1動作、或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片之解碼之後,將相對於第2圖片的參數組合解碼,且在前述參數組合之解碼之後,將前述第2圖片解碼,前述第2圖片是前述複數張圖片之中解碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之解碼之後,在不將前述參數組合解碼的狀態下,將前述第2圖片解碼;在進行前述第1動作或者前述第2動作的步驟中,當被分配於前述第2圖片的暫時ID較被分配於前述複數張圖片的複數個暫時ID之中的最小的暫時ID還大,且較前述複數個暫時ID之中的最大的暫時ID還小時,進行前述第1動作。Furthermore, for example, the decoding method according to one aspect of the present disclosure may decode a moving picture including a plurality of pictures, and the pictures are respectively assigned a temporary ID of a hierarchy indicating time adjustability, and the decoding method includes the following: a step of decoding a first picture among the plurality of pictures; and performing (i) a first operation or (ii) a second operation, wherein the first operation is decoding of the first picture Thereafter, the parameter combination is decoded with respect to the second picture, and after decoding the parameter combination, the second picture is decoded, and the second picture is that the decoding order in the plurality of pictures is later than the first picture In the second operation, after the decoding of the first picture, the second picture is decoded without decoding the parameter combination; and in the step of performing the first operation or the second operation, The temporary ID assigned to the second picture is larger than the smallest temporary ID among the plurality of temporary IDs assigned to the plurality of pictures, and is the largest among the plurality of temporary IDs Buyer ID further hour, the first operation.

依此,能在中間層之圖片之前,將相對於中間層之圖片的參數組合解碼。因此,在相對於中間層之圖片的向上切換等之中,能適當地處理相對於中間層之圖片的參數組合。藉此,可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the parameter combinations of the pictures of the intermediate layer can be decoded before the picture of the middle layer. Therefore, among the upward switching or the like with respect to the picture of the intermediate layer, the parameter combination with respect to the picture of the intermediate layer can be appropriately processed. Thereby, information related to the decoding of the moving image can be appropriately set.

又,例如本揭示一態樣之編碼裝置也可包含有:分割部、內預測部、間預測部、轉換部、量化部、熵編碼部及濾波部。Further, for example, the encoding apparatus according to the present disclosure may include a division unit, an intra prediction unit, an inter prediction unit, a conversion unit, a quantization unit, an entropy coding unit, and a filter unit.

前述分割部也可將圖片分割成複數個區塊。前述內預測部也可對前述複數個區塊所含的區塊進行內預測。前述間預測部也可對前述區塊進行間預測。前述轉換部也可轉換藉前述內預測或者前述間預測所得到的預測圖像與原圖像之預測誤差,產生轉換係數。前述量化部也可將前述轉換係數量化,產生量化係數。前述熵編碼部也可將前述量化係數編碼,產生編碼位元流。前述濾波部也可對使用前述預測圖像所產生的再構成圖像適用濾波。The dividing unit may also divide the picture into a plurality of blocks. The intra prediction unit may perform intra prediction on the blocks included in the plurality of blocks. The inter-prediction unit may also perform inter-prediction on the block. The conversion unit may also convert the prediction error of the predicted image obtained by the intra prediction or the inter prediction described above with the original image to generate a conversion coefficient. The quantization unit may quantize the conversion coefficients to generate quantized coefficients. The entropy encoding unit may also encode the quantized coefficients to generate a coded bit stream. The filter unit may apply filtering to the reconstructed image generated using the predicted image.

又,例如前述編碼裝置也可為在含有複數張圖片之動態圖像之編碼中適用自適應迴路濾波的編碼裝置,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID。Further, for example, the encoding device may be an encoding device that applies adaptive loop filtering to encoding of a moving image including a plurality of pictures, wherein the pictures are assigned a temporary ID of a hierarchy indicating temporal adjustability.

接著,前述濾波部也可進行以下步驟:參考有關聯於第2圖片之第2濾波資訊,決定用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊的步驟,其中前述第2圖片為前述複數張圖片之中在編碼順序上較前述第1圖片更前面的圖片;及,使用已決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟。Next, the filter unit may perform the step of: determining, by referring to the second filter information associated with the second picture, a first filter information for applying adaptive loop filtering to the first picture of the plurality of pictures. The second picture is a picture that is earlier than the first picture in the coding order among the plurality of pictures; and adaptive loop filtering is applied to the first picture by using the determined first filter information. step.

接著,前述濾波部也可在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL(Network Abstraction Layer)單元類型為規定NAL單元類型時,禁止參考有關聯於第3圖片之第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中編碼順序上較前述第1圖片更前面的圖片,且為暫時ID與前述第1圖片相同的圖片。Next, in the step of determining the first filter information, when the NAL (Network Abstraction Layer) unit type of the first picture is a predetermined NAL unit type, the filter unit may prohibit the reference to be associated with the third picture. The filtering information is used as the second filtering information, wherein the third picture is a picture in which the encoding order is higher than the first picture among the plurality of pictures, and the temporary ID is the same picture as the first picture.

又,例如前述編碼裝置也可為將含有複數張圖片之動態圖像編碼的編碼裝置,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID。Further, for example, the encoding device may be an encoding device that encodes a moving image including a plurality of pictures, wherein the pictures are assigned a temporary ID of a hierarchy indicating temporal adjustability.

接著,前述熵編碼部也可進行以下步驟:將複數個參數組合編碼的步驟,前述複數個參數組合分別被分配0來作為顯示有關於前述時間可調性的階層之暫時ID;及,在前述複數個參數組合之編碼之後,將前述複數張圖片之中編碼順序上為最初的圖片編碼的步驟。Next, the entropy coding unit may perform the step of combining and encoding a plurality of parameters, wherein the plurality of parameter combinations are respectively assigned 0 as a temporary ID indicating a hierarchy of the time adjustability; and After the encoding of the plurality of parameter combinations, the encoding sequence of the plurality of pictures is the step of encoding the original picture.

接著,前述複數個參數組合分別對應於由被分配於前述複數張圖片的複數個暫時ID所顯示的複數個階層,前述複數個參數組合的每個也可為相對於1張以上的圖片的參數組合,前述1張以上的圖片為前述複數張圖片之中被分配顯示該參數組合對應的階層之暫時ID的圖片。Then, the plurality of parameter combinations respectively correspond to a plurality of levels displayed by a plurality of temporary IDs allocated to the plurality of pictures, and each of the plurality of parameter combinations may be a parameter relative to one or more pictures. In combination, the one or more pictures are pictures in which the temporary ID of the hierarchy corresponding to the parameter combination is assigned among the plurality of pictures.

又,例如前述編碼裝置也可為將含有複數張圖片的動態圖像編碼的裝置。Further, for example, the encoding device may be a device that encodes a moving image including a plurality of pictures.

接著,前述熵編碼部也可進行以下步驟:將前述複數張圖片之中的第1圖片編碼的步驟;及,進行(i)第1動作或者(ii)第2動作的步驟,前述第1動作是在前述第1圖片的編碼之後,將相對於第2圖片之參數組合編碼,且在前述參數組合的編碼之後,將前述第2圖片編碼,前述第2圖片為前述複數張圖片之中編碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之編碼後,在不將前述參數組合編碼的狀態下,將前述第2圖片編碼。Next, the entropy coding unit may perform the steps of: encoding the first picture among the plurality of pictures; and performing the steps of (i) the first operation or (ii) the second operation, the first action After encoding the first picture, the parameters of the second picture are combined and encoded, and after the coding of the parameter combination, the second picture is encoded, and the second picture is a coding order among the plurality of pictures. In the picture subsequent to the first picture, the second operation is to encode the second picture without encoding the parameters after the coding of the first picture.

接著,前述熵編碼部也可在進行前述第1動作或者前述第2動作的步驟中,當前述第2圖片為規定圖片時,進行前述第1動作。Next, in the step of performing the first operation or the second operation, the entropy coding unit may perform the first operation when the second picture is a predetermined picture.

又,例如前述編碼裝置也可為將含有複數張圖片的動態圖像編碼的編碼裝置,其中前述圖片被分配顯示有關於時間可調性的階層之暫時ID。Further, for example, the encoding device may be an encoding device that encodes a moving image including a plurality of pictures, wherein the picture is assigned a temporary ID of a hierarchy indicating temporal adjustability.

接著,前述熵編碼部也可進行以下步驟:將前述複數張圖片之中的第1圖片編碼的步驟;及,進行(i)第1動作或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片的編碼之後,將相對於第2圖片之參數組合編碼,且在前述參數組合的編碼之後,將前述第2圖片編碼,前述第2圖片為前述複數張圖片之中編碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之編碼後,在不將前述參數組合編碼的狀態下,將前述第2圖片編碼。Next, the entropy coding unit may perform the steps of: encoding the first picture among the plurality of pictures; and performing the steps of (i) the first operation or (ii) the second operation, wherein the first The operation is: after encoding the first picture, combining the parameters of the second picture, and encoding the second picture after the coding of the parameter combination, wherein the second picture is encoded in the plurality of pictures. In the second and subsequent pictures, the second operation is to encode the second picture without encoding the parameters in the first picture after the coding of the first picture.

接著,前述熵編碼部也可在進行前述第1動作或者前述第2動作的步驟中,當被分配於前述第2圖片的暫時ID較被分配於前述複數張圖片的複數個暫時ID之中的最小的暫時ID還大,且較前述複數個暫時ID之中的最大的暫時ID還小時,進行前述第1動作。Next, in the step of performing the first operation or the second operation, the entropy coding unit may allocate a temporary ID assigned to the second picture to a plurality of temporary IDs assigned to the plurality of pictures. The minimum temporary ID is also large, and the first operation is performed when the temporary ID is smaller than the largest temporary ID among the plurality of temporary IDs.

又,例如本揭示一態樣之解碼裝置也可包含有:熵解碼部、反量化部、反轉換部、內預測部、間預測部及濾波部。Furthermore, for example, the decoding apparatus according to one aspect of the present disclosure may include an entropy decoding unit, an inverse quantization unit, an inverse conversion unit, an intra prediction unit, an inter prediction unit, and a filter unit.

前述熵解碼部也可從編碼位元流將圖片內的區塊的量化係數解碼。前述反量化部也可將前述量化係數反量化,取得轉換係數。前述反轉換部也可將前述轉換係數反轉換,取得預測誤差。前述內預測部也可對前述區塊進行內預測。前述間預測部也可對前述區塊進行間預測。前述濾波部也可對再構成圖像適用濾波,其中前述再構成圖像為使用藉前述內預測或者前述間預測所得到的預測圖像與前述預測誤差所產生。The entropy decoding unit may also decode the quantized coefficients of the blocks within the picture from the encoded bit stream. The inverse quantization unit may inversely quantize the quantized coefficients to obtain a conversion coefficient. The inverse conversion unit may inversely convert the conversion coefficient to obtain a prediction error. The aforementioned intra prediction unit may also perform intra prediction on the aforementioned block. The inter-prediction unit may also perform inter-prediction on the block. The filter unit may apply filtering to the reconstructed image, wherein the reconstructed image is generated using a predicted image obtained by the intra prediction or the inter prediction, and the prediction error.

又,例如前述解碼裝置也可在含有複數張圖片的動態圖像之解碼中適用自適應迴路濾波,且前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID。Further, for example, the decoding apparatus may apply adaptive loop filtering to decoding of a moving picture including a plurality of pictures, and the pictures are assigned a temporary ID of a hierarchy indicating temporal adjustability.

接著,前述濾波部也可進行以下步驟:參考有關聯於第2圖片之第2濾波資訊,決定用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊的步驟,其中前述第2圖片為前述複數張圖片之中在解碼順序上較前述第1圖片更前面的圖片;及,使用已決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟。Next, the filter unit may perform the step of: determining, by referring to the second filter information associated with the second picture, a first filter information for applying adaptive loop filtering to the first picture of the plurality of pictures. The second picture is a picture that is earlier than the first picture in the decoding order among the plurality of pictures; and adaptive loop filtering is applied to the first picture by using the determined first filter information. step.

接著,前述濾波部也可在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL單元類型為規定NAL單元類型時,禁止參考有關聯於第3圖片之第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中解碼順序上較前述第1圖片更前面的圖片,且為暫時ID與前述第1圖片相同的圖片。Next, in the step of determining the first filter information, when the NAL unit type of the first picture is a predetermined NAL unit type, the filter unit may prohibit the reference to the third filter information associated with the third picture as the foregoing. In the second filter information, the third picture is a picture in which the decoding order is higher than the first picture among the plurality of pictures, and is a picture in which the temporary ID is the same as the first picture.

又,例如前述解碼裝置也可將含有複數張圖片之動態圖像解碼,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID。Further, for example, the decoding apparatus may decode a moving picture including a plurality of pictures, wherein the pictures are assigned a temporary ID of a hierarchy indicating temporal adjustability.

接著,前述熵解碼部也可進行以下步驟:將複數個參數組合解碼的步驟,前述複數個參數組合分別被分配0來作為顯示有關於前述時間可調性的階層之暫時ID;及,在前述複數個參數組合之解碼之後,將前述複數張圖片之中解碼順序上為最初的圖片解碼的步驟。Next, the entropy decoding unit may perform the step of decoding a plurality of parameters in combination, wherein the plurality of parameter combinations are respectively assigned 0 as a temporary ID indicating a hierarchy of the time adjustability; and After decoding the plurality of parameter combinations, the decoding sequence of the plurality of pictures is the step of decoding the first picture.

接著,前述複數個參數組合分別對應於由被分配於前述複數張圖片的複數個暫時ID所顯示的複數個階層,前述複數個參數組合的每個也可為相對於1張以上的圖片的參數組合,前述1張以上的圖片為前述複數張圖片之中被分配顯示該參數組合對應的階層之暫時ID的圖片。Then, the plurality of parameter combinations respectively correspond to a plurality of levels displayed by a plurality of temporary IDs allocated to the plurality of pictures, and each of the plurality of parameter combinations may be a parameter relative to one or more pictures. In combination, the one or more pictures are pictures in which the temporary ID of the hierarchy corresponding to the parameter combination is assigned among the plurality of pictures.

又,例如前述解碼裝置也可為將含有複數張圖片的動態圖像解碼的解碼裝置。Further, for example, the decoding device may be a decoding device that decodes a moving image including a plurality of pictures.

接著,前述熵解碼部也可進行以下步驟:將前述複數張圖片之中的第1圖片解碼的步驟;及,進行(i)第1動作或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片的解碼之後,將相對於第2圖片之參數組合解碼,且在前述參數組合的解碼之後,將前述第2圖片解碼,前述第2圖片為前述複數張圖片之中解碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之解碼後,在不將前述參數組合解碼的狀態下,將前述第2圖片解碼。Next, the entropy decoding unit may perform the steps of: decoding the first picture among the plurality of pictures; and performing the steps of (i) the first operation or (ii) the second operation, wherein the first The operation is: after the decoding of the first picture, the parameter is combined and decoded with respect to the second picture, and after the decoding of the parameter combination, the second picture is decoded, and the second picture is decoded in the plurality of pictures. In the second and subsequent pictures, the second operation is to decode the second picture without decoding the parameter combination after the decoding of the first picture.

接著,前述熵解碼部也可在進行前述第1動作或者前述第2動作的步驟中,當前述第2圖片為規定圖片時,進行前述第1動作。Next, in the step of performing the first operation or the second operation, the entropy decoding unit may perform the first operation when the second picture is a predetermined picture.

又,例如前述解碼裝置也可為將含有複數張圖片之動態圖像解碼的解碼裝置,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID。Further, for example, the decoding device may be a decoding device that decodes a moving image including a plurality of pictures, wherein the pictures are assigned a temporary ID of a hierarchy indicating temporal adjustability.

接著,前述熵解碼部也可進行以下步驟:將前述複數張圖片之中的第1圖片解碼的步驟;及,進行(i)第1動作或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片的解碼之後,將相對於第2圖片之參數組合解碼,且在前述參數組合的解碼之後,將前述第2圖片解碼,前述第2圖片為前述複數張圖片之中解碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之解碼後,在不將前述參數組合解碼的狀態下,將前述第2圖片解碼。Next, the entropy decoding unit may perform the steps of: decoding the first picture among the plurality of pictures; and performing the steps of (i) the first operation or (ii) the second operation, wherein the first The operation is: after the decoding of the first picture, the parameter is combined and decoded with respect to the second picture, and after the decoding of the parameter combination, the second picture is decoded, and the second picture is decoded in the plurality of pictures. In the second and subsequent pictures, the second operation is to decode the second picture without decoding the parameter combination after the decoding of the first picture.

接著,前述熵解碼部也可在進行前述第1動作或者前述第2動作的步驟中,當被分配於前述第2圖片的暫時ID較被分配於前述複數張圖片的複數個暫時ID之中的最小的暫時ID還大,且較前述複數個暫時ID之中的最大的暫時ID還小時,進行前述第1動作。Next, in the step of performing the first operation or the second operation, the entropy decoding unit may include a temporary ID assigned to the second picture among a plurality of temporary IDs assigned to the plurality of pictures The minimum temporary ID is also large, and the first operation is performed when the temporary ID is smaller than the largest temporary ID among the plurality of temporary IDs.

進而,該等概括性或者是具體性的態樣,可以透過系統、裝置、方法、積體電路、電腦程式或者電腦可讀取之CD-ROM等之非暫時性記錄媒體來實現,也可以透過系統、裝置、方法、積體電路、電腦程式及記錄媒體的任意組合來實現。Furthermore, the general or specific aspects can be realized by a system, a device, a method, an integrated circuit, a computer program, or a non-transitory recording medium such as a computer-readable CD-ROM. Any combination of systems, devices, methods, integrated circuits, computer programs, and recording media can be implemented.

以下,一邊參考圖式,一邊具體說明實施形態。Hereinafter, embodiments will be specifically described with reference to the drawings.

另,在以下所說明的實施形態都是顯示概括性或具體性的例子。在以下的實施形態中所示的數值、形狀、材料、構成要素、構成要素的配置位置及連接形態、步驟、步驟的順序等都只是例示罷了,其旨趣並非是來限定請求的範圍。又,以下的實施形態中之構成要素之中,針對未記載於顯示最上位概念的獨立請求項之構成要素,是當做為任意的構成要素來說明的。
(實施形態1)
Further, the embodiments described below are examples showing generality or specificity. The numerical values, shapes, materials, constituent elements, arrangement positions, connection forms, steps, and order of steps shown in the following embodiments are merely examples, and the scope of the claims is not limited. Further, among the constituent elements in the following embodiments, the constituent elements of the independent request items that are not described in the uppermost concept are described as arbitrary constituent elements.
(Embodiment 1)

首先針對可適用後述的本揭示之各態樣中所說明的處理及/或構成之編碼裝置及解碼裝置的一例,說明實施形態1的概要。惟,實施形態1只不過是可適用本揭示之各態樣所說明之處理及/或構成的編碼裝置及解碼裝置之一例罷了,在本揭示所說明的處理及/或構成也可實施於與實施形態1不同的編碼裝置及解碼裝置中。First, an outline of the first embodiment will be described with respect to an example of an encoding device and a decoding device to which the processing and/or configuration described in each aspect of the present disclosure to be described later is applicable. However, the first embodiment is merely an example of an encoding device and a decoding device to which the processing and/or configuration described in the various aspects of the present disclosure can be applied. The processing and/or configuration described in the present disclosure may be applied to In the encoding device and the decoding device of the first embodiment.

對於實施形態1,適用在本揭示之各態樣所說明的處理及/或構成時,例如亦可以進行以下任一種方式。
(1)對於實施形態1之編碼裝置或者解碼裝置,在構成該編碼裝置或者解碼裝置之複數個構成要素之中,將與本揭示的各態樣中所說明的構成要素對應的構成要素,替換成本揭示的各態樣中所說明的構成要素;
(2) 對於實施形態1之編碼裝置或者解碼裝置,針對構成該編碼裝置或者解碼裝置之複數個構成要素之中一部分的構成要素,先施予功能或者欲實施之處理的追加、替換、刪除等之任意的變更後,再將與本揭示之各態樣中所說明的構成要素對應的構成要素,替換成本揭示之各態樣中所說明的構成要素;
(3) 對於實施形態1之編碼裝置或者解碼裝置所要實施的方法,針對處理的追加、及/或該方法所含的複數個處理之中一部分的處理,先施予替換、刪除等之任意的變更後,再將與本揭示的各態樣中所說明的處理相對應的處理,替換成本揭示的各態樣中所說明的處理;
(4) 將構成實施形態1之編碼裝置或者解碼裝置之複數個構成要素之中一部分的構成要素,和本揭示之各態樣中所說明的構成要素、具有本揭示之各態樣中所說明的構成要素所具備的功能之一部分之構成要素、或者要實施本揭示之各態樣中所說明之構成要素所要實施的處理之一部分的構成要素組合而實施;
(5)將具備構成實施形態1之編碼裝置或者解碼裝置之複數個構成要素之中一部分的構成要素所具備的功能之一部分的構成要素、或者實施構成實施形態1之編碼裝置或者解碼裝置之複數個構成要素之中一部分的構成要素所實施的處理之一部分的構成要素,和本揭示之各態樣中所說明之構成要素、具備在本揭示之各態樣中所說明之構成要素所具備的功能之一部分之構成要素、或者是實施本揭示之各態樣中所說明之構成要素所實施之處理之一部分的構成要素組合來實施;
(6)對於實施形態1之編碼裝置或者解碼裝置所要實施的方法,在該方法所含的複數個處理之中,將對應於本揭示之各態樣中所說明之處理的處理,替換成本揭示之各態樣中所要說明的處理;
(7)將實施形態1之編碼裝置或者解碼裝置所要實施的方法所含之複數個處理之中的一部分處理,和本揭示之各態樣中所說明之處理相組合來實施。
In the first embodiment, when the processing and/or configuration described in each aspect of the present disclosure is applied, for example, any of the following aspects may be employed.
(1) The coding device or the decoding device according to the first embodiment replaces the constituent elements corresponding to the constituent elements described in the respective aspects of the present disclosure among the plurality of constituent elements constituting the encoding device or the decoding device. The constituent elements described in the various aspects of the cost disclosure;
(2) The encoding device or the decoding device according to the first embodiment applies a function or a process to be implemented, such as addition, replacement, deletion, etc., to a part of a plurality of constituent elements constituting the encoding device or the decoding device. After any arbitrary changes, the constituent elements corresponding to the constituent elements described in the respective aspects of the present disclosure are replaced with the constituent elements described in the respective aspects of the cost disclosure;
(3) In the method to be implemented by the encoding device or the decoding device according to the first embodiment, for the addition of the processing and/or the processing of a part of the plurality of processing included in the method, any of the processing such as replacement or deletion is first applied. After the change, the processing corresponding to the processing described in each aspect of the present disclosure is replaced with the processing described in the various aspects of the cost disclosure;
(4) The constituent elements of a part of the plurality of constituent elements constituting the encoding apparatus or the decoding apparatus of the first embodiment, and the constituent elements described in the respective aspects of the present disclosure, and the description of each aspect of the present disclosure The constituent elements of one of the functions of the constituent elements or the constituent elements of the processing to be performed by the constituent elements described in the respective aspects of the present disclosure are combined;
(5) A component including one of the functions of a part of the plurality of components constituting the encoding device or the decoding device of the first embodiment, or a plurality of encoding devices or decoding devices constituting the first embodiment The constituent elements of the processing performed by the constituent elements of some of the constituent elements, and the constituent elements described in the respective aspects of the present disclosure, and the constituent elements described in the respective aspects of the present disclosure are provided. The constituent elements of one of the functions, or a combination of constituent elements that perform part of the processing performed by the constituent elements described in the various aspects of the present disclosure;
(6) In the method to be implemented by the encoding device or the decoding device according to the first embodiment, among the plurality of processes included in the method, the processing corresponding to the processing described in each aspect of the present disclosure is replaced by the cost disclosure. The processing to be described in each aspect;
(7) A part of the plurality of processes included in the method to be implemented by the encoding device or the decoding device according to the first embodiment is combined with the processing described in each aspect of the present disclosure.

另,本揭示之各態樣中所說明之處理及/或構成的實施方式並不限於上述例子。例如,也可以實施在與實施形態1中所揭示之動態圖像/圖像編碼裝置或者是動態圖像/圖像解碼裝置不同的目的而被利用的裝置中,也可以單獨地實施已在各態樣中所說明之處理及/或構成。又,也可將已在不同的態樣中所說明的處理及/或構成組合來實施。
[編碼裝置的概要]
Further, the embodiments of the processes and/or configurations described in the various aspects of the present disclosure are not limited to the above examples. For example, it may be implemented in a device different from the moving image/image encoding device or the moving image/image decoding device disclosed in the first embodiment, or may be implemented separately. The processing and/or composition illustrated in the aspects. Further, the processes and/or configurations already described in the different aspects may be combined.
[Summary of coding device]

首先,說明實施形態1之編碼裝置之概要。圖1是顯示實施形態1之編碼裝置100之功能構成之方塊圖。編碼裝置100是將動態圖像/圖像,以區塊單位進行編碼之動態圖像/圖像編碼裝置。First, an outline of an encoding apparatus according to the first embodiment will be described. Fig. 1 is a block diagram showing the functional configuration of an encoding apparatus 100 according to the first embodiment. The encoding device 100 is a moving image/image encoding device that encodes moving images/images in block units.

如圖1所示,編碼裝置100為將圖像以區塊單位進行編碼之裝置,包含有:分割部102、減法部104、轉換部106、量化部108、熵編碼部110、反量化部112、反轉換部114、加法部116、區塊記憶體118、迴路濾波部120、框記憶體122、內預測部124、間預測部126、及預測控制部128。As shown in FIG. 1, the encoding apparatus 100 is an apparatus for encoding an image in units of blocks, and includes a division unit 102, a subtraction unit 104, a conversion unit 106, a quantization unit 108, an entropy coding unit 110, and an inverse quantization unit 112. The inverse conversion unit 114, the addition unit 116, the block memory 118, the loop filter unit 120, the frame memory 122, the intra prediction unit 124, the inter prediction unit 126, and the prediction control unit 128.

編碼裝置100是例如藉由通用處理器及記憶體來實現。此時,當儲存在記憶體的軟體程式藉由處理器來執行時,處理器是作為分割部102、減法部104、轉換部106、量化部108、熵編碼部110、反量化部112、反轉換部114、加法部116、迴路濾波部120、內預測部124、間預測部126、及預測控制部128而發揮功能。又,編碼裝置100也可作為對應於分割部102、減法部104、轉換部106、量化部108、熵編碼部110、反量化部112、反轉換部114、加法部116、迴路濾波部120、內預測部124、間預測部126、及預測控制部128之專用的1個以上的電子電路來實現。The encoding device 100 is realized by, for example, a general-purpose processor and a memory. At this time, when the software program stored in the memory is executed by the processor, the processor functions as the dividing unit 102, the subtracting unit 104, the converting unit 106, the quantization unit 108, the entropy encoding unit 110, the inverse quantization unit 112, and the counter. The conversion unit 114, the addition unit 116, the loop filter unit 120, the intra prediction unit 124, the inter prediction unit 126, and the prediction control unit 128 function. Further, the encoding device 100 may correspond to the division unit 102, the subtraction unit 104, the conversion unit 106, the quantization unit 108, the entropy coding unit 110, the inverse quantization unit 112, the inverse conversion unit 114, the addition unit 116, and the loop filter unit 120. The internal prediction unit 124, the inter prediction unit 126, and the prediction control unit 128 are implemented by one or more dedicated electronic circuits.

以下,針對編碼裝置100所含之各構成要素予以說明。
[分割部]
Hereinafter, each component included in the encoding device 100 will be described.
[Division Department]

分割部102是將輸入動態圖像所含之各圖片分割成複數個區塊,並將各區塊輸出至減法部104。例如,分割部102,首先將圖片分割成固定尺寸(例如128×128)之區塊。該固定尺寸的區塊有時被稱為編碼樹單元(CTU)。接著,分割部102根據遞迴性的四元樹(quadtree)及/或二元樹(binary tree)區塊分割,將固定尺寸的區塊之每個分割成可變尺寸(例如64×64以下)的區塊。這個可變尺寸的區塊有時被稱為編碼單元(CU)、預測單元(PU)或者轉換單元(TU)。另,在本實施形態中,沒有區別CU、PU及TU的必要,也可以是圖片內的一部分或者全部的區塊成為CU、PU、TU的處理單位。The division unit 102 divides each picture included in the input moving image into a plurality of blocks, and outputs each block to the subtraction unit 104. For example, the dividing unit 102 first divides the picture into blocks of a fixed size (for example, 128 × 128). This fixed size block is sometimes referred to as a coding tree unit (CTU). Next, the segmentation unit 102 divides each of the fixed-size blocks into variable sizes (for example, 64×64 or less) according to the recursive quadtree and/or binary tree segmentation. ) The block. This variable size block is sometimes referred to as a coding unit (CU), a prediction unit (PU), or a conversion unit (TU). Further, in the present embodiment, it is not necessary to distinguish between CU, PU, and TU, and some or all of the blocks in the picture may be processing units of CU, PU, and TU.

圖2是顯示實施形態1中的區塊分割一例之圖。在圖2中,實線是表示透過四元樹區塊分割所得到的區塊邊界,虛線是表示透過二元樹區塊分割所得到的區塊邊界。Fig. 2 is a view showing an example of block division in the first embodiment; In Fig. 2, the solid line indicates the block boundary obtained by the division of the quaternary tree block, and the broken line indicates the block boundary obtained by the division of the binary tree block.

在此,區塊10是128×128像素的正方形區塊(128×128區塊)。該128×128區塊10,首先是被分割成4個正方形的64×64區塊(四元樹區塊分割)。Here, block 10 is a square block of 128 x 128 pixels (128 x 128 blocks). The 128 x 128 block 10 is first divided into 64 square 64 blocks (quaternary tree block partitioning) divided into 4 squares.

左上的64×64區塊是進一步被垂直分割成2個矩形的32×64區塊,左邊的32×64區塊是進一步被垂直分割成2個矩形的16×64區塊(二元樹區塊分割)。其結果,左上的64×64區塊是被分割成2個16×64區塊11、12、及32×64區塊13。The upper left 64×64 block is a 32×64 block that is further vertically divided into two rectangles, and the left 32×64 block is a 16×64 block that is further vertically divided into two rectangles (binary tree area) Block split). As a result, the upper left 64x64 block is divided into two 16x64 blocks 11, 12, and 32x64 blocks 13.

右上的64×64區塊是被水平分割成2個矩形的64×32區塊14、15(二元樹區塊分割)。The upper right 64x64 block is a 64x32 block 14, 15 (binary tree block partition) that is horizontally divided into two rectangles.

左下的64×64區塊是被分割成4個正方形的32×32區塊(四元樹區塊分割)。4個32×32區塊之中,左上的區塊及右下的區塊被進一步分割。左上的32×32區塊是被垂直分割成2個矩形的16×32區塊,右邊的16×32區塊是進一步被水平分割成2個16×16區塊(二元樹區塊分割)。右下的32×32區塊是被水平分割成2個32×16區塊(二元樹區塊分割)。其結果,左下的64×64區塊是被分割成16×32區塊16、2個16×16區塊17、18、2個32×32區塊19、20、及2個32×16區塊21、22。The lower left 64x64 block is a 32x32 block (quaternary tree block partition) that is divided into 4 squares. Among the four 32×32 blocks, the upper left block and the lower right block are further divided. The upper left 32×32 block is a 16×32 block that is vertically divided into two rectangles, and the right 16×32 block is further horizontally divided into two 16×16 blocks (binary tree block division). . The lower right 32x32 block is horizontally divided into two 32x16 blocks (binary tree block partitioning). As a result, the lower left 64×64 block is divided into 16×32 blocks 16, two 16×16 blocks 17, 18, two 32×32 blocks 19, 20, and two 32×16 blocks. Blocks 21, 22.

右下的64×64區塊23不分割。The 64×64 block 23 at the lower right is not divided.

如上,在圖2中,區塊10是根據遞迴性的四元樹及二元樹區塊分割,而被分割成13個可變尺寸的區塊11至23。如此分割,有時被稱為QTBT(quad-tree plus binary tree)分割。As above, in Fig. 2, the block 10 is divided into 13 variable-sized blocks 11 to 23 according to the recursive quadtree and binary tree block division. This division is sometimes referred to as QTBT (quad-tree plus binary tree) segmentation.

另,在圖2中,1個區塊是被分割成4個或者2個區塊(四元樹或者二元樹區塊分割),而分割並不限於此。例如,1個區塊也可被分割成3個區塊(三元樹區塊分割)。如此包括三元樹區塊分割的分割有時被稱為MBT(multi type tree)分割。
[減法部]
In addition, in FIG. 2, one block is divided into four or two blocks (quaternary tree or binary tree block division), and the division is not limited thereto. For example, one block can also be divided into three blocks (three-dimensional tree block division). Such division including ternary tree block division is sometimes referred to as MBT (multi type tree) division.
[Subtraction Department]

減法部104是以分割部102所分割的區塊單位,從原訊號(原樣本)減去預測訊號(預測樣本)。即,減法部104是算出編碼對象區塊(以下,稱為目前區塊)的預測誤差(也稱為殘差)。接著,減法部104將所算出的預測誤差輸出至轉換部106。The subtraction unit 104 subtracts the prediction signal (predicted sample) from the original signal (original sample) in the block unit divided by the division unit 102. In other words, the subtraction unit 104 is a prediction error (also referred to as a residual) for calculating a coding target block (hereinafter referred to as a current block). Next, the subtraction unit 104 outputs the calculated prediction error to the conversion unit 106.

原訊號是編碼裝置100的輸入訊號,為表示構成動態圖像之各圖片的圖像之訊號(例如亮度(luma)訊號及2個色差(chroma)訊號)。在下面內容中,也將表示圖像的訊號稱為樣本。
[轉換部]
The original signal is an input signal of the encoding device 100, and is a signal (for example, a luma signal and two chroma signals) indicating an image of each picture constituting the moving image. In the following, the signal representing the image is also referred to as a sample.
[conversion department]

轉換部106是將空間區域的預測誤差轉換成頻率區域的轉換係數,且將轉換係數輸出至量化部108。具體來說,轉換部106,例如對於空間區域的預測誤差,進行已事先決定的離散餘弦轉換(DCT)或者離散正弦轉換(DST)。The conversion unit 106 converts the prediction error of the spatial region into a conversion coefficient of the frequency region, and outputs the conversion coefficient to the quantization unit 108. Specifically, the conversion unit 106 performs, for example, a discrete cosine transform (DCT) or a discrete sine transform (DST) that has been determined in advance for the prediction error of the spatial region.

另,轉換部106也可從複數個轉換型式之中適應性地選擇轉換型式,使用對應於所選擇的轉換型式之轉換基底函數(transform basis function),將預測誤差轉換成轉換係數。如此轉換有時被稱為EMT(explicit multiple core transform)或者AMT(adaptive multiple transform)。Further, the conversion unit 106 may adaptively select a conversion pattern from among a plurality of conversion patterns, and convert a prediction error into a conversion coefficient using a transform basis function corresponding to the selected conversion pattern. Such a conversion is sometimes referred to as an EMT (explicit multiple core transform) or an AMT (adaptive multiple transform).

複數個轉換型式,例如包括有DCT-II、DCT-V、DCT-VIII、DST-I及DST-VII。圖3是顯示對應於各轉換型式之轉換基底函數之表。在圖3中,N是顯示輸入像素的數量。從該等複數個轉換型式之中的轉換型式的選擇,例如也可依據預測的種類(內預測及間預測),也可依據內預測模式。A plurality of conversion patterns include, for example, DCT-II, DCT-V, DCT-VIII, DST-I, and DST-VII. Figure 3 is a table showing the conversion basis functions corresponding to the respective conversion patterns. In Figure 3, N is the number of input pixels displayed. The selection of the conversion pattern from among the plurality of conversion patterns may be based on, for example, the type of prediction (internal prediction and inter prediction) or the intra prediction mode.

顯示是否適用如此的EMT或者AMT之資訊(例如被稱為AMT旗標)以及顯示所被選擇的轉換型式的資訊是以CU等級而被進行訊號化。另,該等資訊的訊號化沒有必要限定在CU等級,也可為其他等級(例如序列等級(sequence level)、圖片等級(picture level)、切片等級(slice level)、方塊(tile)等級或者CTU等級)。Information indicating whether such EMT or AMT is applicable (for example, referred to as an AMT flag) and information indicating the selected conversion pattern is signaled at the CU level. In addition, the signalization of such information is not necessarily limited to the CU level, but may also be other levels (eg, sequence level, picture level, slice level, tile level, or CTU). grade).

又,轉換部106也可將轉換係數(轉換結果)再轉換。如此再轉換有時被稱為AST(adaptive secondary transform)或者NSST(non-separable secondary transform)。例如,轉換部106是依對應於內預測誤差之轉換係數的區塊所含之各個子區塊(例如4×4子區塊)進行再轉換。顯示是否適用NSST之資訊及有關於使用在NSST之轉換矩陣之資訊是以CU等級進行訊號化。另,該等資訊的訊號化沒有必要限定在CU等級,也可為其他等級(例如序列等級、圖片等級、切片等級、方塊等級或者CTU等級)。Further, the conversion unit 106 may reconvert the conversion coefficient (conversion result). Such reconversion is sometimes referred to as AST (adapive secondary transform) or NSST (non-separable secondary transform). For example, the conversion unit 106 performs reconversion on each sub-block (for example, a 4 × 4 sub-block) included in the block corresponding to the conversion coefficient of the intra prediction error. The information showing whether NSST is applicable and the information about the conversion matrix used in NSST is signaled by the CU level. In addition, the signalization of such information is not necessarily limited to the CU level, but may be other levels (such as sequence level, picture level, slice level, block level or CTU level).

在此,可分離(Separable)的轉換是指依方向分離輸入的維數,來進行數次轉換的方式,不可分離(Non-Separable)的轉換是指在輸入為多維時,將2以上的維度匯整,而視為1維,再一起進行轉換的方式。Here, the separable conversion refers to a method of separating the input dimensions according to the direction and performing the conversion several times. The non-separable conversion refers to a dimension of 2 or more when the input is multi-dimensional. Consolidation, and regarded as a one-dimensional, and then converted together.

例如,以不可分離的轉換之1例來說,可舉例有如下者:在輸入為4×4的區塊時,將該區塊視為具有16個要素之一個陣列,並對該陣列,以16×16的轉換矩陣進行轉換處理。For example, in the case of an inseparable conversion, for example, when a block of 4×4 is input, the block is regarded as an array having 16 elements, and the array is A 16×16 conversion matrix performs conversion processing.

又,同樣地,將4×4的輸入區塊視為如同具有16個要素之一整個排列,之後對該排列進行數次吉文斯旋轉(Givens rotation)之構成(Hypercube Givens Transform/超立方體吉文斯轉換),也是不可分離(Non- Separable)轉換的例子。
[量化部]
Also, similarly, the 4×4 input block is regarded as having the entire arrangement of one of the 16 elements, and then the arrangement is performed several times of Givens rotation (Hypercube Givens Transform) Conversion) is also an example of a non-separable conversion.
[Quantization Department]

量化部108是將從轉換部106所輸出的轉換係數進行量化。具體來說,量化部108是以規定的掃描順序來掃描當前區塊的轉換係數,根據對應於所掃描的轉換係數的量化參數(QP),而將該轉換係數進行量化。然後,量化部108將當前區塊之業經量化的轉換係數(以下稱為量化係數)輸出至熵編碼部110及反量化部112。The quantization unit 108 quantizes the conversion coefficients output from the conversion unit 106. Specifically, the quantization unit 108 scans the conversion coefficient of the current block in a predetermined scanning order, and quantizes the conversion coefficient based on the quantization parameter (QP) corresponding to the scanned conversion coefficient. Then, the quantization unit 108 outputs the quantized conversion coefficients (hereinafter referred to as quantized coefficients) of the current block to the entropy encoding unit 110 and the inverse quantization unit 112.

規定的順序是轉換係數的量化/反量化之用的順序。例如,規定的掃描順序是以頻率的升冪排序(從低頻到高頻的順序)或者降冪排序(從高頻到低頻的順序)來定義。The prescribed order is the order in which the quantization/dequantization of the conversion coefficients is used. For example, the specified scan order is defined by the order of the power of the frequency (from the low frequency to the high frequency) or the order of the power reduction (the order from the high frequency to the low frequency).

量化參數是指定義量化步階(量化幅寬)的參數。例如,若量化參數的值增加時,量化步階也會增加。即,若量化參數的值增加,量化誤差也會變大。
[熵編碼部]
The quantization parameter refers to a parameter that defines a quantization step (quantization width). For example, if the value of the quantization parameter increases, the quantization step also increases. That is, if the value of the quantization parameter increases, the quantization error also becomes large.
[Entropy coding unit]

熵編碼部110是將從量化部108輸入的量化係數進行可變長度編碼,藉此產生編碼訊號(編碼位元流)。具體來說,熵編碼部110是例如將量化係數進行二值化,且將二值化訊號進行算術編碼。
[反量化部]
The entropy coding unit 110 performs variable length coding on the quantized coefficients input from the quantization unit 108, thereby generating an encoded signal (coded bit stream). Specifically, the entropy coding unit 110 performs binarization of the quantized coefficients, for example, and arithmetically encodes the binarized signals.
[Anti-quantization department]

反量化部112是將來自量化部108的輸入之量化係數進行反量化。具體來說,反量化部112是以規定的掃描順序而將當前區塊的量化係數進行反量化。然後,反量化部112是將當前區塊的業經反量化的轉換係數輸出至反轉換部114。
[反轉換部]
The inverse quantization unit 112 inversely quantizes the input quantized coefficients from the quantization unit 108. Specifically, the inverse quantization unit 112 inversely quantizes the quantized coefficients of the current block in a predetermined scanning order. Then, the inverse quantization unit 112 outputs the inverse quantized conversion coefficient of the current block to the inverse conversion unit 114.
[Anti-conversion department]

反轉換部114是將來自反量化部112之輸入的轉換係數進行反轉換,藉此將預測誤差復原。具體來說,反轉換部114是對轉換係數進行與轉換部106所進行的轉換對應之反轉換,藉此將當前區塊的預測誤差進行復原。然後,反轉換部114是將已復原的預測誤差輸出至加法部116。The inverse conversion unit 114 inversely converts the conversion coefficient input from the inverse quantization unit 112, thereby restoring the prediction error. Specifically, the inverse conversion unit 114 performs inverse conversion corresponding to the conversion performed by the conversion unit 106 on the conversion coefficient, thereby restoring the prediction error of the current block. Then, the inverse conversion unit 114 outputs the restored prediction error to the addition unit 116.

另,已復原的預測誤差是因為量化的進行而失去了資訊,因此和減法部104所算出的預測誤差不一致。即,在已復原的預測誤差中含有量化誤差。
[加法部]
Further, since the restored prediction error is lost due to the progress of the quantization, the prediction error calculated by the subtraction unit 104 does not match. That is, the quantization error is included in the restored prediction error.
[Addition Department]

加法部116是將來自反轉換部114之輸入的預測誤差、與來自預測控制部128之輸入的預測樣本相加,藉此再構成當前區塊。然後,加法部116將已再構成的區塊輸出至區塊記憶體118及迴路濾波部120。再構成區塊有時也被稱為局部解碼區塊。
[區塊記憶體]
The addition unit 116 adds the prediction error input from the inverse conversion unit 114 to the prediction sample input from the prediction control unit 128, thereby reconstructing the current block. Then, the addition unit 116 outputs the reconstructed block to the block memory 118 and the loop filter unit 120. Reconstituted blocks are sometimes referred to as local decoded blocks.
[block memory]

區塊記憶體118是用以儲存區塊的記憶體,其中前述區塊為於內預測被參考的區塊,且為編碼對象圖片(以下稱為當前圖片)內的區塊。具體來說,區塊記憶體118是儲存從加法部116所輸出的再構成區塊。
[迴路濾波部]
The block memory 118 is a memory for storing a block, wherein the block is a block to be referred to for intra prediction, and is a block within a picture to be encoded (hereinafter referred to as a current picture). Specifically, the tile memory 118 stores the reconstructed block output from the addition unit 116.
[loop filter unit]

迴路濾波部120是對透過加法部116而再構成的區塊施加迴路濾波,且將已濾波的再構成區塊輸出至框記憶體122。迴路濾波是指在編碼迴路內所使用的濾波器(迴路內濾波器),例如包括解區塊濾波器(DF)、樣本適應性偏移(SAO)及適應性迴路濾波器(ALF)等。The loop filter unit 120 applies loop filtering to the block reconstructed by the pass-adding unit 116, and outputs the filtered reconstructed block to the frame memory 122. Loop filtering refers to the filters (intra-loop filters) used in the coding loop, including, for example, a deblocking filter (DF), a sample adaptive offset (SAO), and an adaptive loop filter (ALF).

在ALF中,適用用以移除編碼變形的最小平方誤差濾波器,例如按當前區塊內的各個2×2子區塊,根據局部性的梯度(gradient)的方向及活性度(activity),適用從複數個濾波器之中所選擇的1個濾波器。In ALF, the least square error filter used to remove the coding distortion is applied, for example, according to the respective 2×2 sub-blocks in the current block, according to the direction of the local gradient and the activity. One filter selected from a plurality of filters is applied.

具體來說,首先子區塊(例如2×2子區塊)被分類成複數個類別(例如15或者25類)。子區塊的分類是根據梯度的方向及活性度來進行。例如,使用梯度的方向值D(例如0至2或者0至4)與梯度的活性值A(例如0至4),而算出分類值C(例如C=5D+A)。然後,根據分類值C,使子區塊被分類成複數個類別(例如15或者25類)。Specifically, first, sub-blocks (for example, 2×2 sub-blocks) are classified into a plurality of categories (for example, 15 or 25 types). The classification of sub-blocks is based on the direction and activity of the gradient. For example, the classification value C (for example, C=5D+A) is calculated using the gradient direction value D (for example, 0 to 2 or 0 to 4) and the gradient activity value A (for example, 0 to 4). Then, based on the classification value C, the sub-blocks are classified into a plurality of categories (for example, 15 or 25 types).

梯度的方向值D,例如是藉由比較複數個方向(例如水平、垂直及2個對角方向)的梯度導出。又,梯度的活性值A,例如是藉由將複數個方向的梯度相加,將加法結果進行量化來導出。The direction value D of the gradient is derived, for example, by comparing gradients in a plurality of directions (eg, horizontal, vertical, and 2 diagonal directions). Further, the gradient activity value A is derived, for example, by adding the gradients of the plurality of directions and quantizing the addition result.

根據如此分類的結果,從複數個濾波器之中,決定子區塊用的濾波器。Based on the result of such classification, a filter for a sub-block is determined from among a plurality of filters.

以於ALF所使用的濾波器的形狀來說,例如利用圓對稱形狀。如圖4A至圖4C是顯示ALF所使用的濾波器的形狀的複數例之圖。圖4A顯示5×5菱形形狀濾波器,圖4B顯示7×7菱形形狀濾波器,圖4C是顯示9×9菱形形狀濾波器。顯示濾波器的形狀之資訊是以圖片等級來被進行訊號化。另,顯示濾波器的形狀之資訊的訊號化並不須限定在圖片等級,也可為其他等級(例如序列等級、切片等級、方塊等級、CTU等級或者是CU等級)。For the shape of the filter used in the ALF, for example, a circularly symmetrical shape is utilized. 4A to 4C are diagrams showing a plurality of examples of shapes of filters used in ALF. Fig. 4A shows a 5 x 5 diamond shaped filter, Fig. 4B shows a 7 x 7 diamond shaped filter, and Fig. 4C shows a 9 x 9 diamond shaped filter. The information showing the shape of the filter is signaled at the picture level. In addition, the signalization of the information showing the shape of the filter is not limited to the picture level, and may be other levels (for example, sequence level, slice level, block level, CTU level, or CU level).

ALF的開啟/關閉,例如是以圖片等級或者CU等級來決定。例如,針對亮度,是以CU等級來決定是否適用ALF,針對色差,是以圖片等級來決定是否適用ALF。顯示ALF的開啟/關閉的資訊,是以圖片等級或者CU等級來進行訊號化。另,顯示ALF的開啟/關閉的資訊,並無須限定在圖片等級或者CU等級,也可為其他等級(例如序列等級、切片等級、方塊等級、或者CTU等級)。The ALF is turned on/off, for example, by picture level or CU level. For example, for brightness, it is determined whether or not ALF is applied by the CU level, and for the color difference, whether or not ALF is applied is determined by the picture level. The information showing the ALF on/off is signalized by the picture level or CU level. In addition, the information indicating the on/off of the ALF is not limited to the picture level or the CU level, and may be other levels (such as sequence level, slice level, block level, or CTU level).

可選擇的複數個濾波器(例如迄至15或25的濾波器)的係數組合是以圖片等級進行訊號化。另,係數組合的訊號化並無須限定在圖片等級,也可為其他等級(例如序列等級、切片等級、方塊等級、CTU等級、CU等級或者是子區塊等級)。
[框記憶體]
The combination of coefficients of a selectable plurality of filters (e.g., filters up to 15 or 25) is signaled at the picture level. In addition, the signalization of the coefficient combination is not limited to the picture level, but may be other levels (such as sequence level, slice level, block level, CTU level, CU level, or sub-block level).
[frame memory]

框記憶體122是一種用以儲存被使用在間預測的參考圖片之記憶部,有時也被稱為框緩衝器。具體來說,框記憶體122是儲存已經由迴路濾波部120過濾的再構成區塊。
[內預測部]
The frame memory 122 is a memory portion for storing reference pictures used for inter prediction, and is sometimes referred to as a frame buffer. Specifically, the frame memory 122 stores the reconstructed blocks that have been filtered by the loop filter unit 120.
[Internal forecasting department]

內預測部124是藉由參考區塊記憶體118所儲存的當前圖片內的區塊,進行當前區塊的內預測(也稱為畫面內預測),以產生預測訊號(內預測訊號)。具體來說,內預測部124是藉由參考鄰接於當前區塊之區塊的樣本(例如亮度值、色差值)進行內預測,以產生內預測訊號,且將內預測訊號輸出至預測控制部128。The intra prediction unit 124 performs intra prediction (also referred to as intra-picture prediction) of the current block by referring to the block in the current picture stored in the block memory 118 to generate a prediction signal (inter prediction signal). Specifically, the intra prediction unit 124 performs intra prediction by referring to samples (eg, luminance values, color difference values) of the blocks adjacent to the current block to generate an intra prediction signal, and outputs the intra prediction signal to the prediction control. Department 128.

例如,內預測部124利用已事先規定的複數個內預測模式之中的1個,來進行內預測。複數個內預測模式是包括1個以上的非方向性預測模式、及複數個方向性預測模式。For example, the intra prediction unit 124 performs intra prediction by using one of a plurality of intra prediction modes that have been previously defined. The plurality of intra prediction modes include one or more non-directional prediction modes and a plurality of directional prediction modes.

1個以上的非方向性預測模式,例如包括以H.265/HEVC(High-Efficiency Video Coding/高效率視訊編碼)規格(非專利文獻1)所規定的平面(Planar)預測模式及直流(DC)預測模式。One or more non-directional prediction modes include, for example, a Planar prediction mode and a direct current (DC) defined by the H.265/HEVC (High-Efficiency Video Coding) specification (Non-Patent Document 1). ) Prediction mode.

複數個方向性預測模式,例如包括以H.265/ HEVC規格所規定的33種方向的預測模式。另,複數個方向性預測模式,除了33種方向外,也可進一步包括32種方向的預測模式(合計共65種方向性預測模式)。圖5A是顯示內預測中的67種內預測模式(2個非方向性預測模式及65個方向性預測模式)之圖。實線箭頭符號是表示以H.265/HEVC規格所規定的33種方向,虛線箭頭符號是表示所追加的32種方向。A plurality of directional prediction modes include, for example, prediction modes of 33 directions specified by the H.265/HEVC specification. In addition, the plurality of directional prediction modes may further include prediction modes of 32 directions (a total of 65 directional prediction modes) in addition to 33 directions. FIG. 5A is a diagram showing 67 intra prediction modes (two non-directional prediction modes and 65 directional prediction modes) in intra prediction. The solid arrow symbol indicates 33 directions defined by the H.265/HEVC standard, and the dotted arrow symbol indicates the 32 additional directions added.

另,在色差區塊的內預測中,亮度區塊也可被參考。即,根據當前區塊的亮度成分,當前區塊的色差成分也可被預測。如此之內預測有時被稱為CCLM (cross- component linear model)預測。像這種參考亮度區塊之色差區塊的內預測模式(例如被稱為CCLM模式),也可作為1種色差區塊的內預測模式而加入。In addition, in the intra prediction of the color difference block, the luminance block can also be referred to. That is, the color difference component of the current block can also be predicted based on the luminance component of the current block. Such intra prediction is sometimes referred to as CCLM (cross-component linear model) prediction. An intra prediction mode such as a color difference block of the reference luminance block (for example, referred to as CCLM mode) can also be added as an intra prediction mode of one color difference block.

內預測部124,也可根據水平/垂直方向的參考像素的梯度,來補正內預測後的像素值。像這樣伴隨著補正的內預測有時被稱為PDPC(position dependent intra prediction combination)。顯示有無PDPC的適用之資訊(例如被稱為PDPC旗標),例如是以CU等級而被進行訊號化。另,該資訊的訊號化並無須限定在CU等級,也可為其他等級(例如序列等級、圖片等級、切片等級、方塊等級、或者CTU等級)。
[間預測部]
The intra prediction unit 124 may correct the intra-predicted pixel value based on the gradient of the reference pixels in the horizontal/vertical direction. The intra prediction accompanying the correction like this is sometimes referred to as PDPC (position dependent intra prediction combination). Applicable information showing the presence or absence of a PDPC (for example, referred to as a PDPC flag), for example, is signaled at the CU level. In addition, the signalization of the information need not be limited to the CU level, but may be other levels (such as sequence level, picture level, slice level, block level, or CTU level).
[Inter forecasting department]

間預測部126是參考參考圖片,來進行當前區塊的間預測(也叫做畫面間預測),以此產生預測訊號(間預測訊號),其中前述參考圖片是框記憶體122所儲存的參考圖片,且為與當前圖片相異的參考圖片。間預測是以當前區塊或者當前區塊內的子區塊(例如4×4區塊)的單位來進行。例如,間預測部126是針對當前區塊或者子區塊,在參考圖片內進行移動估測(motion estimation)。接著,間預測部126是利用藉由移動估測而得到的移動資訊(例如移動向量)來進行移動補償,以此產生當前區塊或者子區塊的間預測訊號。然後,間預測部126是將所產生的間預測訊號輸出至預測控制部128。The inter prediction unit 126 is a reference reference picture for performing inter-layer prediction (also called inter-picture prediction) to generate a prediction signal (inter-predictive signal), wherein the reference picture is a reference picture stored in the frame memory 122. And is a reference picture that is different from the current picture. The inter-prediction is performed in units of a current block or a sub-block within the current block (e.g., a 4x4 block). For example, the inter prediction unit 126 performs motion estimation within the reference picture for the current block or sub-block. Next, the inter prediction unit 126 performs motion compensation using motion information (for example, a motion vector) obtained by motion estimation, thereby generating an inter-prediction signal of the current block or sub-block. Then, the inter prediction unit 126 outputs the generated inter prediction signal to the prediction control unit 128.

用於移動補償的移動資訊被進行訊號化。對於移動向量的訊號化,移動向量預測子(motion vector predictor)也可被使用。即,移動向量與移動向量預測子之間的差分也可被訊號化。The mobile information for motion compensation is signaled. For signalization of motion vectors, a motion vector predictor can also be used. That is, the difference between the motion vector and the motion vector predictor can also be signaled.

另,不僅使用透過移動估測所得到的當前區塊的移動資訊,也可使用鄰接區塊的移動資訊,來產生間預測訊號。具體來說,也可將根據透過移動估測所得到的移動資訊之預測訊號、與根據鄰接區塊的移動資訊之預測訊號予以加權加總,藉此以當前區塊內的子區塊單位來產生間預測訊號。如此之間預測(移動補償)有時被稱為OBMC (overlapped block motion compensation)。In addition, not only the movement information of the current block obtained by the motion estimation but also the movement information of the adjacent block may be used to generate the inter prediction signal. Specifically, the prediction signal according to the mobile information obtained by the motion estimation and the prediction signal according to the mobile information of the adjacent block may be weighted and added, thereby using the sub-block unit in the current block. Generate inter-predictive signals. Such prediction (motion compensation) is sometimes referred to as OBMC (overlapped block motion compensation).

在如此之OBMC模式中,顯示OBMC用的子區塊的尺寸之資訊(例如被稱為OBMC區塊尺寸)是以序列等級而被訊號化。又,顯示是否適用OBMC模式之資訊(例如被叫做OBMC旗標)是以CU等級而被訊號化。另,該等資訊的訊號化的等級並無須限定在序列等級及CU等級,也可為其他等級(例如圖片等級、切片等級、方塊等級、CTU等級、或者子區塊等級)。In such an OBMC mode, information showing the size of a sub-block for OBMC (for example, referred to as an OBMC block size) is signaled at a sequence level. Also, information indicating whether or not the OBMC mode is applicable (for example, referred to as an OBMC flag) is signaled by the CU level. In addition, the level of signalization of such information need not be limited to the sequence level and CU level, but may also be other levels (such as picture level, slice level, block level, CTU level, or sub-block level).

針對OBMC模式,更具體地來進行說明。圖5B及圖5C是用以說明OBMC處理所進行的預測圖像補正處理的概要之流程圖及概念圖。The OBMC mode will be described more specifically. 5B and 5C are a flowchart and a conceptual diagram for explaining an outline of a predicted image correction process performed by the OBMC process.

首先,使用被分配到編碼對象區塊之移動向量(MV),取得依通常的移動補償所得到之預測圖像(Pred)。First, a motion vector (MV) assigned to a coding target block is used to obtain a predicted image (Pred) obtained by normal motion compensation.

其次,將已編碼完畢的左鄰接區塊的移動向量(MV_L)適用在編碼對象區塊,取得預測圖像(Pred_L),將前述預測圖像與Pred_L加權、疊合,以此進行預測圖像的第1次補正。Next, the motion vector (MV_L) of the encoded left adjacent block is applied to the coding target block, the predicted image (Pred_L) is obtained, and the predicted image and the Pred_L are weighted and superimposed to perform the predicted image. The first correction.

以同樣方式,將已編碼完畢之上鄰接區塊的移動向量(MV_U)適用在編碼對象區塊,取得預測圖像 (Pred_U),將前述已進行第1次補正的預測圖像與Pred_U賦予權重、疊合,以此進行預測圖像的第2次補正,將此作為最後的預測圖像。In the same manner, the motion vector (MV_U) of the adjacent block that has been encoded is applied to the coding target block, and the predicted image (Pred_U) is obtained, and the predicted image with the first correction and the Pred_U are weighted. This is superimposed to perform the second correction of the predicted image, and this is used as the final predicted image.

另,在此說明了使用左鄰接區塊與上鄰接區塊的2階段補正的方法,但也能作成如下構成,即,使用右鄰接區塊或下鄰接區塊來進行比2階段更多次數的補正之構成。In addition, a method of using the two-stage correction of the left adjacent block and the upper adjacent block is described here, but it is also possible to adopt a configuration in which the right adjacent block or the lower adjacent block is used for more times than the 2 stages. The composition of the correction.

另,進行疊合的區域,也可為僅只區塊邊界附近之一部分的區域,而非區塊整體的像素區域。In addition, the superimposed region may be an area that is only a part of the vicinity of the block boundary, rather than the pixel area of the block as a whole.

另,在此雖是針對來自1張參考圖片的預測圖像補正處理進行說明,但是在從複數張參考圖片來補正預測圖像的情況也是同樣的方式,從各參考圖片取得已補正的預測圖像後,將所得到的預測圖像進一步疊合,以此作為最後的預測圖像。Here, although the prediction image correction processing from one reference picture is described here, the same applies to the case where the prediction image is corrected from the plurality of reference pictures, and the corrected prediction map is obtained from each reference picture. After the image, the obtained predicted image is further superimposed as the final predicted image.

另,前述處理對象區塊也可為預測區塊單位,也可為將預測區塊進一步加以分割的子區塊單位。In addition, the foregoing processing target block may also be a prediction block unit, or may be a sub-block unit that further divides the prediction block.

作為判定是否適用OBMC處理的方法,例如有一種使用obmc_flag之方法,該obmc_flag是顯示是否適用OBMC處理的訊號。以一具體例來說,在編碼裝置中,判定編碼對象區塊是否屬於移動為複雜的區域,在屬於移動為複雜的區域時,設定值為1來作為obmc_flag,適用OBMC處理進行編碼,在不屬於移動為複雜的區域時,則設定值為0來作為obmc_flag,不適用OBMC處理來進行編碼。另一方面,在解碼裝置中,將記述在串流的obmc_flag解碼,以此因應該值,切換是否適用OBMC處理,來進行解碼。As a method of determining whether or not the OBMC processing is applied, for example, there is a method of using obmc_flag which is a signal indicating whether or not OBMC processing is applied. In a specific example, in the encoding apparatus, it is determined whether the encoding target block belongs to an area where the movement is complicated, and when the movement is a complex area, the set value is 1 as obmc_flag, and the OBMC processing is applied for encoding, When the movement is a complex area, the value is set to 0 as obmc_flag, and OBMC processing is not applied for encoding. On the other hand, in the decoding apparatus, the obmc_flag described in the stream is decoded, and the OBMC processing is switched depending on the value, and decoding is performed.

另,移動資訊也可不被訊號化,而在解碼裝置側導出。例如也可採用以H.265/HEVC規格所規定的合併(merge)模式。又,例如也可於解碼裝置側進行移動估測,藉此導出移動資訊。此時,不使用當前區塊的像素值而進行移動估測。In addition, the mobile information may not be signalized but derived on the decoding device side. For example, a merge mode specified by the H.265/HEVC specification may also be employed. Further, for example, the motion estimation may be performed on the decoding device side to derive the mobile information. At this time, the motion estimation is performed without using the pixel value of the current block.

在此,針對在解碼裝置側進行移動估測之模式來說明。在該解碼裝置側進行移動估測的模式有時被稱為PMMVD(pattern matched motion vector derivation)模式或者FRUC(frame rate up-conversion)模式。Here, a mode in which the motion estimation is performed on the decoding device side will be described. The mode in which the motion estimation is performed on the decoding device side is sometimes referred to as a PMMVD (pattern matched motion vector derivation) mode or a FRUC (frame rate up-conversion) mode.

FRUC處理之一例是顯示在圖5D中。首先,參考空間上或時間上鄰接於當前區塊的編碼完畢區塊之移動向量,產生複數個候選的清單(也可與合併清單為共通),該複數個候選的清單各自具有移動向量預測子。其次,從已登錄在候選清單的複數個候選MV之中選擇最佳候選MV。例如,算出候選清單所含之各候選的評價值,根據評價值,而選擇1個候選。An example of FRUC processing is shown in Figure 5D. First, a reference to a motion vector of a coded block that is spatially or temporally adjacent to the current block is generated, and a list of a plurality of candidates (which may also be common to the merge list) is generated, the list of the plurality of candidates each having a motion vector predictor . Next, the best candidate MV is selected from among a plurality of candidate MVs that have been registered in the candidate list. For example, the evaluation value of each candidate included in the candidate list is calculated, and one candidate is selected based on the evaluation value.

接著,根據所選擇的候選之移動向量,導出當前區塊用的移動向量。具體來說,例如將所選擇的候選之移動向量(最佳候選MV),就這樣導出來作為當前區塊用的移動向量。又,例如在參考圖片內之位置的周邊區域中進行圖案匹配,藉此也可以導出當前區塊用的移動向量,其中前述參考圖片是對應於所選擇之候選的移動向量。即,對於最佳候選MV之周邊的區域,以同樣的方法進行估測,進而有評價值為好的數字之MV時,將最佳候選MV更新為前述MV,將該MV當做為當前區塊之最後的MV亦可。另,也可做成不實施該處理之構成。Next, the motion vector for the current block is derived based on the selected candidate motion vector. Specifically, for example, the selected candidate motion vector (best candidate MV) is derived as the motion vector for the current block. Also, pattern matching is performed, for example, in a peripheral area of a position within a reference picture, whereby a motion vector for the current block may also be derived, wherein the aforementioned reference picture is a motion vector corresponding to the selected candidate. That is, for the region around the best candidate MV, the estimation is performed in the same manner, and when there is an MV with a good evaluation value, the best candidate MV is updated to the aforementioned MV, and the MV is regarded as the current block. The last MV is also available. Alternatively, the configuration may be omitted.

在以子區塊單位進行處理時,也可構成為完全同樣的處理。When processing in sub-block units, it is also possible to configure the same processing.

另,評價值是可透過對應於移動向量之參考圖片內的區域、與規定區域之間的圖案匹配,來求取再構成圖像的差分值,藉此而算出。另,除了差分值外,也可使用除此以外的資訊,來算出評價值。Further, the evaluation value is calculated by obtaining a difference value of the reconstructed image by matching the region in the reference picture corresponding to the motion vector with the predetermined region. In addition to the difference value, information other than this can be used to calculate the evaluation value.

對於圖案匹配,是使用第1圖案匹配或者第2圖案匹配。第1圖案匹配及第2圖案匹配,有時分別被稱為雙向匹配(bilateral matching)以及模板匹配(template matching)。For pattern matching, the first pattern matching or the second pattern matching is used. The first pattern matching and the second pattern matching are sometimes referred to as bidirectional matching and template matching, respectively.

在第1圖案匹配中,是在2個區塊之間進行圖案匹配,該2個區塊是不同的2個參考圖片內的2個區塊,且是沿著當前區塊的移動軌跡(motion trajectory)。因此,在第1圖案匹配中,是使用沿著當前區塊的移動軌跡的其他參考圖片內之區域,來作為算出上述候選的評價值之用的規定區域。In the first pattern matching, pattern matching is performed between two blocks, which are two blocks in two different reference pictures, and are movement trajectories along the current block (motion Trajectory). Therefore, in the first pattern matching, a region in another reference picture along the movement trajectory of the current block is used as a predetermined region for calculating the evaluation value of the candidate.

圖6是用以說明在沿著移動軌跡的2個區塊間之圖案匹配(雙向匹配)一例之圖。如圖6所示,在第1圖案匹配下,在沿著當前區塊(Cur block)的移動軌跡之2個區塊,且為不同的2個參考圖片(Ref0、Ref1)內的2個區塊之配對(pair)之中,估測最為相配的配對,藉此導出2個移動向量(MV0、MV1)。具體來說,對於當前區塊,導出以候選MV所指定的第1編碼完畢參考圖片(Ref0)內的指定位置中之再構成圖像、與已將前述候選MV以顯示時間間隔進行定標(scaling)的對稱MV所指定的第2編碼完畢參考圖片(Ref1)內的指定位置中之再構成圖像間之差分,使用所得到的差分值來算出評價值。在複數個候選MV之中,選擇評價值為最佳值的候選MV,作為最後MV即可。Fig. 6 is a view for explaining an example of pattern matching (bidirectional matching) between two blocks along a movement trajectory. As shown in FIG. 6, under the first pattern matching, two blocks in the moving trajectory along the current block (Cur block) and two regions in the two different reference pictures (Ref0, Ref1) Among the pair of blocks, the most suitable pairing is estimated, thereby deriving two motion vectors (MV0, MV1). Specifically, for the current block, the reconstructed image in the specified position in the first encoded reference picture (Ref0) specified by the candidate MV is derived, and the candidate MV has been scaled at the display time interval ( The difference between the reconstructed images in the specified position in the second encoded reference picture (Ref1) specified by the symmetric MV of the scaling is calculated using the obtained difference value. Among the plurality of candidate MVs, the candidate MV whose evaluation value is the best value is selected as the last MV.

在連續的移動軌跡的假設之下,指示2個參考區塊的移動向量(MV0、MV1)相對於當前圖片(Cur Pic)與2個參考圖片(Ref0、Ref1)間之時間上的距離(TD0、TD1)成比例。例如,當前圖片是時間上位於2個參考圖片之間,在從當前圖片到2個參考圖片的時間上的距離相等時,在第1圖案匹配上,能導出鏡射對稱的雙向之移動向量。Under the assumption of continuous moving trajectory, the distance between the motion vector (MV0, MV1) of the two reference blocks relative to the current picture (Cur Pic) and the two reference pictures (Ref0, Ref1) is indicated (TD0) TD1) is proportional. For example, when the current picture is temporally located between two reference pictures, when the distance from the current picture to the two reference pictures is equal, on the first pattern matching, a mirror-symmetric two-way motion vector can be derived.

在第2圖案匹配上,在當前圖片內的模板(在當前圖片內鄰接於當前區塊的區塊(例如上及/或左鄰接區塊))與參考圖片內的區塊之間,進行圖案匹配。因此,在第2圖案匹配上,使用鄰接於當前圖片內的當前區塊的區塊,以作為上述之候選的評價值之算出用的規定區域。On the second pattern matching, a template in the current picture (a block adjacent to the current block in the current picture (eg, upper and/or left adjacent blocks)) and a block in the reference picture are patterned match. Therefore, in the second pattern matching, a block adjacent to the current block in the current picture is used as a predetermined area for calculating the above-mentioned candidate evaluation value.

圖7是用以說明在當前圖片內的模板(Template)與參考圖片內的區塊之間的圖案匹配(模板匹配)一例之圖。如圖7所示,在第2圖案匹配中,在參考圖片(Ref0)內估測在當前圖片(Cur Pic)內和鄰接於當前區塊(Cur block)之區塊最匹配的區塊,藉此導出當前區塊的移動向量。具體來說,對於當前區塊,導出:左鄰接及上鄰接兩邊或者任一邊的編碼完畢區域的再構成圖像、與以候選MV所指定的編碼完畢參考圖片(Ref0)內的同等位置中的再構成圖像間之差分,且使用所得到的差分值,算出評價值,在複數個候選MV之中選擇評價值為最佳之值的候選MV,作為最佳候選MV,即可。FIG. 7 is a diagram for explaining an example of pattern matching (template matching) between a template in a current picture and a block in a reference picture. As shown in FIG. 7, in the second pattern matching, the most matching block in the current picture (Cur Pic) and the block adjacent to the current block (Cur block) is estimated in the reference picture (Ref0). This exports the motion vector of the current block. Specifically, for the current block, the reconstructed image of the coded region of the left adjacent and the adjacent two sides or either side is derived in the same position as the encoded reference picture (Ref0) specified by the candidate MV. The difference between the images is reconstructed, and the evaluation value is calculated using the obtained difference value, and the candidate MV whose evaluation value is the optimum value is selected among the plurality of candidate MVs as the best candidate MV.

如此之顯示是否適用FRUC模式之資訊(例如被稱為FRUC旗標)是以CU等級而被訊號化。又,在適用FRUC模式時(例如FRUC旗標為真時),顯示圖案匹配之方法(第1圖案匹配或者第2圖案匹配)之資訊(例如被稱為FRUC模式旗標)是以CU等級而被訊號化。另,該等資訊之訊號化並不須限定於CU等級,也可為其他等級(例如序列等級、圖片等級、切片等級、方塊等級、CTU等級或者子區塊等級)。Such information showing whether the FRUC mode is applicable (for example, referred to as the FRUC flag) is signaled by the CU level. Moreover, when the FRUC mode is applied (for example, when the FRUC flag is true), the information of the method of displaying the pattern matching (the first pattern matching or the second pattern matching) (for example, referred to as the FRUC mode flag) is based on the CU level. Be signaled. In addition, the signalization of such information is not limited to the CU level, but may be other levels (such as sequence level, picture level, slice level, block level, CTU level or sub-block level).

在此,針對根據模型來導出移動向量的模式進行說明,其中前述模型為假設為等速直線運動之模型。該模式有時被稱為BIO (bi-directional optical flow,雙向光流)模式。Here, a description will be given of a mode in which a motion vector is derived from a model, which is a model assumed to be a constant-speed linear motion. This mode is sometimes referred to as BIO (bi-directional optical flow) mode.

圖8是用以說明假設為等速直線運動的模型之圖。在圖8中,(vx ,vy )是表示速度向量,τ0 、τ1 各表示為當前圖片 (Cur Pic)與2個參考圖片(Ref0 ,Ref1 )間的時間上的距離。(MVx0 ,MVy0 )是表示對應於參考圖片Ref0 之移動向量,(MVx1 、MVy1 )是表示對應於參考圖片Ref1 之移動向量。Fig. 8 is a view for explaining a model assumed to be a constant-speed linear motion. In Fig. 8, (v x , v y ) represents a velocity vector, and τ 0 and τ 1 are each represented as a temporal distance between a current picture (Cur Pic) and two reference pictures (Ref 0 , Ref 1 ). (MVx 0 , MVy 0 ) is a motion vector indicating a reference picture Ref 0 , and (MVx 1 , MVy 1 ) is a motion vector indicating a reference picture Ref 1 .

此時,速度向量(vx ,vy )在等速直線運動的假設之下,(MVx0 ,MVy0 )及(MVx1 ,MVy1 )各表示為(vx τ0 ,vy τ0 )及(-vx τ1 ,-vy τ1 ),使以下的光流等式(1)成立。
(數1)
At this time, the velocity vectors (v x , v y ) are under the assumption of constant-speed linear motion, and (MVx 0 , MVy 0 ) and (MVx 1 , MVy 1 ) are expressed as (v x τ 0 , v y τ 0 And (-v x τ 1 , -v y τ 1 ), the following optical flow equation (1) is established.
(Number 1)

在此,I(k) 是表示移動補償後之參考圖像k(k=0,1)的亮度值。該光流等式是顯示(i)亮度值的時間微分、(ii)水平方向的速度及參考圖像的空間梯度的水平成分的乘積、與(iii)垂直方向的速度及參考圖像的空間梯度的垂直成分的乘積之和等於零者。根據該光流等式與埃爾米特插值(Hermite interpolation)之組合,將從合併清單等所得到的區塊單位之移動向量以像素單位進行補正。Here, I (k) is a luminance value indicating a reference image k (k = 0, 1) after the motion compensation. The optical flow equation is a product that displays (i) time differential of the luminance value, (ii) the horizontal direction velocity, and the horizontal component of the spatial gradient of the reference image, and (iii) the velocity in the vertical direction and the space of the reference image. The sum of the products of the vertical components of the gradient is equal to zero. According to the combination of the optical flow equation and the Hermitian interpolation, the motion vector of the block unit obtained from the merge list or the like is corrected in units of pixels.

另,也能以異於根據假設等速直線運動之模型之移動向量的導出之方法,在解碼裝置側導出移動向量。例如,也可根據複數個鄰接區塊的移動向量,以子區塊單位導出移動向量。Alternatively, the motion vector can be derived on the decoding device side by a method different from the derivation of the motion vector of the model based on the assumed constant velocity linear motion. For example, the motion vector may also be derived in sub-block units based on the motion vectors of the plurality of contiguous blocks.

在此,針對根據複數個鄰接區塊的移動向量,以子區塊單位導出移動向量的模式進行說明。該模式有時被稱為仿射移動補償預測(affine motion compensation prediction)模式。Here, a mode in which a motion vector is derived in units of sub-blocks based on a motion vector of a plurality of adjacent blocks will be described. This mode is sometimes referred to as an affine motion compensation prediction mode.

圖9A是用以說明子區塊單位的移動向量之導出之圖,該導出是根據複數個鄰接區塊的移動向量來進行。在圖9A中,當前區塊含有16個4×4子區塊。在此,根據鄰接區塊的移動向量,導出當前區塊的左上角控制點的移動向量v0 ,且根據鄰接子區塊的移動向量,導出當前區塊的右上角控制點的移動向量v1 。接著,使用2個移動向量v0 及v1 ,經由以下的式(2),而導出當前區塊內的各子區塊的移動向量(vx ,vy )。
(數2)
Fig. 9A is a diagram for explaining the derivation of a motion vector of a sub-block unit, which is performed based on a motion vector of a plurality of adjacent blocks. In Figure 9A, the current block contains 16 4x4 sub-blocks. Here, the motion vector v 0 of the upper left corner control point of the current block is derived according to the motion vector of the adjacent block, and the motion vector v 1 of the upper right corner control point of the current block is derived according to the motion vector of the adjacent subblock. . Next, using two motion vectors v 0 and v 1 , the motion vectors (v x , v y ) of the respective sub-blocks in the current block are derived via the following equation (2).
(number 2)

在此,x及y各表示子區塊的水平位置及垂直位置,w表示已事先訂定的權重係數。Here, x and y each represent the horizontal position and the vertical position of the sub-block, and w represents the weight coefficient which has been previously set.

在如此之仿射移動補償預測模式中,也可包括左上及右上角控制點的移動向量之導出方法相異之幾個模式。顯示如此之仿射移動補償預測模式之資訊(例如被稱為仿射旗標)是以CU等級而被進行訊號化。另,該顯示仿射移動補償預測模式之資訊的訊號化無須限定在CU等級,也可為其他等級(例如序列等級、圖片等級、切片等級、方塊等級、CTU等級或者子區塊等級)。
[預測控制部]
In such an affine motion compensation prediction mode, it is also possible to include several modes in which the motion vectors of the upper left and upper right control points are different. Information showing such an affine motion compensated prediction mode (e.g., referred to as an affine flag) is signaled at the CU level. In addition, the signalization of the information showing the affine motion compensation prediction mode need not be limited to the CU level, but may be other levels (eg, sequence level, picture level, slice level, block level, CTU level, or sub-block level).
[Predictive Control Department]

預測控制部128是選擇內預測訊號及間預測訊號之任一種,且將所選擇的訊號作為預測訊號,而輸出至減法部104及加法部116。The prediction control unit 128 selects any one of the intra prediction signal and the inter prediction signal, and outputs the selected signal as a prediction signal to the subtraction unit 104 and the addition unit 116.

在此,說明經由合併模式而導出編碼對象圖片的移動向量之例。圖9B是用以說明藉合併模式進行之移動向量導出處理之概要之圖。Here, an example of deriving a motion vector of a coding target picture via a merge mode will be described. Fig. 9B is a diagram for explaining an outline of a motion vector derivation process by a merge mode.

首先,產生已登錄預測MV之候選的預測MV清單。以預測MV的候選來說,包括有:空間鄰接預測MV,是編碼對象區塊之空間上位於周邊的複數個編碼完畢區塊所具有之MV;時間鄰接預測MV,是投影到編碼完畢參考圖片中的編碼對象區塊之位置的附近區塊所具有的MV;結合預測MV,是組合空間鄰接預測MV及時間鄰接預測MV之MV值而產生的MV;以及零預測MV,其值為零的MV等。First, a list of predicted MVs of candidates for the registered prediction MV is generated. The candidate for predicting the MV includes: a spatial neighbor prediction MV, which is an MV of a plurality of coded blocks located in the space of the coding target block; the temporal adjacent prediction MV is projected to the encoded reference picture. The MV of the nearby block in the position of the coding target block; the combined prediction MV is the MV generated by combining the MV value of the spatial neighbor prediction MV and the temporal neighbor prediction MV; and the zero prediction MV whose value is zero MV and so on.

其次,從已登錄在預測MV清單的複數個預測MV之中,選擇1個預測MV,以此將之決定作為編碼對象區塊的MV。Next, one prediction MV is selected from among the plurality of prediction MVs that have been registered in the prediction MV list, and this is determined as the MV of the encoding target block.

進而,在可變長度編碼部中,將merge_idx記述在串流中,並進行編碼,其中前述merge_idx是顯示已選擇哪一預測MV之訊號。Further, in the variable length coding unit, the merge_idx is described and encoded in the stream, wherein the merge_idx is a signal indicating which prediction MV has been selected.

另,登錄在圖9B中所說明之預測MV清單之預測MV只是一個例子,也可為和圖中的個數不同的個數,或者不含圖中的預測MV之一部分的種類之構成,或者追加了圖中的預測MV之種類以外的預測MV之構成。In addition, the predicted MV registered in the predicted MV list illustrated in FIG. 9B is only an example, and may be a number different from the number in the figure, or a type including a part of the predicted MV in the figure, or The structure of the prediction MV other than the type of the prediction MV in the figure is added.

另,也可使用藉合併模式所導出之編碼對象區塊的MV,進行後述的DMVR處理,藉此來決定最後的MV。Alternatively, the MV of the encoding target block derived by the merge mode may be used to perform the DMVR processing described later, thereby determining the last MV.

在此,針對使用DMVR處理來決定MV之例進行說明。Here, an example in which MV is determined using DMVR processing will be described.

圖9C是用以說明DMVR處理的概要之概念圖。Fig. 9C is a conceptual diagram for explaining an outline of DMVR processing.

首先,以已設定於處理對象區塊的最適合的MVP作為候選MV來說,依照前述候選MV,從L0方向的處理完畢圖片即第1參考圖片、及L1方向之處理完畢圖片即第2參考圖片,分別取得參考像素,取各參考像素的平均,以此產生模板。First, the most suitable MVP set in the processing target block is used as the candidate MV, and the processed picture from the L0 direction, that is, the first reference picture and the processed picture in the L1 direction, that is, the second reference, according to the candidate MV. The picture is obtained by taking reference pixels and taking the average of each reference pixel to generate a template.

其次,使用前述模板,分別估測第1參考圖片及第2參考圖片的候選MV之周邊區域,將成本為最小的MV決定作為最後的MV。另,成本值是利用模板的各像素值與估測區域的各像素值之差分值及MV值等來算出。Next, using the template, the peripheral regions of the candidate MVs of the first reference picture and the second reference picture are respectively estimated, and the MV whose cost is the smallest is determined as the last MV. Further, the cost value is calculated by using a difference value between each pixel value of the template and each pixel value of the estimated region, an MV value, and the like.

另,在編碼裝置及解碼裝置中,在此所說明的處理之概要基本上是共通的。Further, in the encoding device and the decoding device, the outline of the processing described herein is basically common.

另,就算不是在此所說明的處理內容,只要是能估測候選MV的周邊而導出最後的MV之處理,也可使用其他處理。Further, even if it is not the processing content described here, other processing may be used as long as it is a process of estimating the periphery of the candidate MV and deriving the last MV.

在此,針對使用LIC處理來產生預測圖像的模式進行說明。Here, a mode in which a predicted image is generated using the LIC processing will be described.

圖9D是用以說明使用依LIC處理之亮度補正處理的預測圖像產生方法之概要之圖。9D is a diagram for explaining an outline of a prediction image generation method using luminance correction processing by LIC processing.

首先,從參考圖片導出MV,其中前述參考圖片是編碼完畢圖片,該MV是用以取得對應於編碼對象區塊之參考圖像。First, the MV is derived from the reference picture, wherein the aforementioned reference picture is an encoded picture, and the MV is used to obtain a reference image corresponding to the coding target block.

其次,對於編碼對象區塊,利用左鄰接及上鄰接之編碼完畢周邊參考區域的亮度像素值、與位於以MV所指定的參考圖片內之同等位置之亮度像素值,擷取顯示亮度值在參考圖片與編碼對象圖片是如何變化的資訊,而算出亮度補正參數。Next, for the coding target block, the brightness pixel value of the coded peripheral reference area of the left adjacent and upper adjacent, and the brightness pixel value of the same position within the reference picture specified by the MV are used, and the display brightness value is used for reference. The information on how the picture and the encoded object picture change, and the brightness correction parameter is calculated.

對於以MV所指定的參考圖片內之參考圖像,使用前述亮度補正參數,進行亮度補正處理,以此產生相對於編碼對象區塊之預測圖像。For the reference image in the reference picture specified by the MV, the brightness correction processing is performed using the aforementioned luminance correction parameter, thereby generating a predicted image with respect to the encoding target block.

另,圖9D中的前述周邊參考區域的形狀只是其中一例而已也可使用除此以外的形狀。In addition, the shape of the aforementioned peripheral reference area in FIG. 9D is only one example, and other shapes may be used.

又,在此已針對從1張參考圖片來產生預測圖像的處理進行說明,但從複數張的參考圖片來產生預測圖像的情況也是同樣,先對已從各個參考圖片取得的參考圖像,以同樣的方法進行亮度補正處理,之後再產生預測圖像。Here, the process of generating a predicted image from one reference picture has been described here, but the same is true for the case where a predicted image is generated from a plurality of reference pictures, and the reference image that has been acquired from each reference picture is first used. The brightness correction processing is performed in the same manner, and then the predicted image is generated.

以判定是否適用LIC處理之方法來說,例如有使用lic_flag之方法,該lic_flag是顯示是否適用LIC處理的訊號。以具體的一例來說,在編碼裝置中,判定編碼對象區塊是否為屬於發生亮度變化之區域,若為屬於發生亮度變化的區域時,對lic_flag設定其值為1,適用LIC處理而進行編碼,若不屬於發生亮度變化之區域時,則對lic_flag設定其值為0,不適用LIC處理而進行編碼。另一方面,在解碼裝置中,將記述於串流之lic_flag進行解碼,以此因應該值來切換是否適用LIC處理,而進行解碼。For the method of determining whether or not the LIC processing is applicable, for example, there is a method of using lic_flag, which is a signal indicating whether LIC processing is applicable. In a specific example, the encoding apparatus determines whether the encoding target block belongs to an area where the luminance change occurs, and if it belongs to the area where the luminance change occurs, sets the value to 1 for lic_flag, and encodes the LIC processing. If it is not in the region where the luminance change occurs, set the value to 0 for lic_flag, and encode without applying LIC processing. On the other hand, in the decoding apparatus, the lic_flag described in the stream is decoded, and the LIC processing is switched depending on the value, and decoding is performed.

以判定是否適用LIC處理之另一方法來說,例如還有依照在周邊區塊是否適用過LIC處理而判定之方法。以具體的一例來說,編碼對象區塊為合併模式時,判定在於合併模式處理中的MV之導出時所選擇的周邊的編碼完畢區塊是否適用LIC處理而進行編碼,因應該結果,切換是否適用LIC處理,而進行編碼。另,在該例的情況,解碼中的處理也是完全相同。
[解碼裝置的概要]
In another method of determining whether or not the LIC processing is applicable, for example, there is a method of determining whether or not the LIC processing is applied in the peripheral block. In a specific example, when the coding target block is in the merge mode, it is determined whether the coded block in the vicinity of the MV in the merge mode process is encoded by the LIC process, and the result is whether the switch is performed. Apply LIC processing and encode. In addition, in the case of this example, the processing in decoding is also identical.
[Summary of decoding device]

其次,針對解碼裝置之概要進行說明,該解碼裝置可將從上述編碼裝置100所輸出的編碼訊號(編碼位元流)進行解碼。圖10是顯示實施形態1之解碼裝置200的功能構成之方塊圖。解碼裝置200是以區塊單位而將動態圖像/圖像進行解碼的動態圖像/圖像解碼裝置。Next, an outline of a decoding apparatus that can decode an encoded signal (encoded bit stream) output from the encoding apparatus 100 will be described. FIG. 10 is a block diagram showing a functional configuration of a decoding device 200 according to the first embodiment. The decoding device 200 is a moving image/image decoding device that decodes a moving image/image in units of blocks.

如圖10所示,解碼裝置200包含有:熵解碼部202、反量化部204、反轉換部206、加法部208、區塊記憶體210、迴路濾波部212、框記憶體214、內預測部216、間預測部218、及預測控制部220。As shown in FIG. 10, the decoding apparatus 200 includes an entropy decoding unit 202, an inverse quantization unit 204, an inverse conversion unit 206, an addition unit 208, a block memory 210, a loop filter unit 212, a frame memory 214, and an internal prediction unit. 216. The inter prediction unit 218 and the prediction control unit 220.

解碼裝置200,例如可透過通用處理器及記憶體來實現。此時,記憶體所儲存的軟體程式經由處理器來執行時,處理器是作為熵解碼部202、反量化部204、反轉換部206、加法部208、迴路濾波部212、內預測部216、間預測部218、及預測控制部220而運作。又,解碼裝置200也可作為對應於熵解碼部202、反量化部204、反轉換部206、加法部208、迴路濾波部212、內預測部216、間預測部218、及預測控制部220之專用的1個以上的電子電路而附諸實現。The decoding device 200 can be realized, for example, by a general purpose processor and a memory. At this time, when the software program stored in the memory is executed by the processor, the processor functions as the entropy decoding unit 202, the inverse quantization unit 204, the inverse conversion unit 206, the addition unit 208, the loop filter unit 212, and the intra prediction unit 216. The inter prediction unit 218 and the prediction control unit 220 operate. Further, the decoding device 200 may correspond to the entropy decoding unit 202, the inverse quantization unit 204, the inverse conversion unit 206, the addition unit 208, the loop filter unit 212, the intra prediction unit 216, the inter prediction unit 218, and the prediction control unit 220. One or more dedicated electronic circuits are dedicated to implementation.

以下,針對解碼裝置200所含之各構成要素予以說明。
[熵解碼部]
Hereinafter, each component included in the decoding device 200 will be described.
[Entropy decoding unit]

熵解碼部202是將編碼位元流進行熵解碼。具體來說,熵解碼部202是例如進行從編碼位元流變成二值訊號的算術解碼。接著,熵解碼部202將二值訊號進行多值化(debinarize)。藉此,熵解碼部202是以區塊單位而將量化係數輸出至反量化部204。
[反量化部]
The entropy decoding unit 202 performs entropy decoding on the encoded bit stream. Specifically, the entropy decoding unit 202 performs, for example, arithmetic decoding from a coded bit stream to a binary signal. Next, the entropy decoding unit 202 demultiplexes the binary signal. Thereby, the entropy decoding unit 202 outputs the quantized coefficients to the inverse quantization unit 204 in units of blocks.
[Anti-quantization department]

反量化部204是將解碼對象區塊(以下稱為當前區塊)的量化係數進行反量化,其中前述解碼對象區塊為來自熵解碼部202的輸入。具體來說,反量化部204是針對當前區塊的量化係數之各個,根據對應於該量化係數之量化參數,而將該量化係數進行反量化。然後,反量化部204是將當前區塊的業經反量化之量化係數(即轉換係數)輸出至反轉換部206。
[反轉換部]
The inverse quantization unit 204 inversely quantizes the quantized coefficients of the decoding target block (hereinafter referred to as the current block) which is an input from the entropy decoding unit 202. Specifically, the inverse quantization unit 204 is for each of the quantized coefficients of the current block, and inversely quantizes the quantized coefficients according to the quantization parameter corresponding to the quantized coefficients. Then, the inverse quantization unit 204 outputs the dequantized quantized coefficients (i.e., conversion coefficients) of the current block to the inverse conversion unit 206.
[Anti-conversion department]

反轉換部206是將轉換係數進行反轉換,藉此將預測誤差復原,其中前述轉換係數為來自反量化部204之輸入。The inverse conversion unit 206 reconstructs the prediction error by inversely converting the conversion coefficient, wherein the conversion coefficient is an input from the inverse quantization unit 204.

例如已從編碼位元流解讀的資訊是顯示適用EMT或者AMT的時候(例如AMT旗標為真),反轉換部206是根據顯示所解讀的轉換型式的資訊,將當前區塊的轉換係數進行反轉換。For example, when the information that has been interpreted from the encoded bit stream is displayed when EMT or AMT is applied (for example, the AMT flag is true), the inverse conversion unit 206 performs the conversion coefficient of the current block according to the information of the converted conversion pattern displayed. Reverse conversion.

又,例如已從編碼位元流解讀的資訊是顯示適用NSST的時候,反轉換部206是對轉換係數適用反再轉換。
[加法部]
Further, for example, when the information that has been interpreted from the encoded bit stream is that the applicable NSST is displayed, the inverse conversion unit 206 applies inverse re-conversion to the conversion coefficient.
[Addition Department]

加法部208是將預測誤差與預測樣本相加,藉此再構成當前區塊,其中前述預測誤差是來自反轉換部206之輸入,該預測樣本是來自預測控制部220之輸入。然後,加法部208是將業經再構成的區塊輸出至區塊記憶體210及迴路濾波部212。
[區塊記憶體]
The addition unit 208 adds the prediction error to the prediction block, thereby reconstructing the current block, wherein the prediction error is an input from the inverse conversion unit 206, which is an input from the prediction control unit 220. Then, the addition unit 208 outputs the reconstructed block to the block memory 210 and the loop filter unit 212.
[block memory]

區塊記憶體210是用以儲存在內預測中被參考的區塊且為解碼對象圖片(以下稱為當前圖片)內的區塊之記憶部。具體來說,區塊記憶體210是儲存從加法部208所輸出的再構成區塊。
[迴路濾波部]
The tile memory 210 is a memory portion for storing a block referenced in the intra prediction and for decoding a block in the target picture (hereinafter referred to as a current picture). Specifically, the tile memory 210 stores the reconstructed block output from the addition unit 208.
[loop filter unit]

迴路濾波部212是對已經由加法部208而再構成的區塊施行迴路濾波,且將業已濾波的再構成區塊輸出至框記憶體214及顯示裝置等。The loop filter unit 212 performs loop filtering on the block that has been reconstructed by the addition unit 208, and outputs the filtered reconstructed block to the frame memory 214, the display device, and the like.

顯示已從編碼位元流解讀之ALF之開啟/關閉的資訊是顯示ALF之開啟的時候,根據一部分的梯度的方向及活性度,從複數個濾波器之中,選擇1個濾波器,將所選擇的濾波器適用於再構成區塊。
[框記憶體]
The information showing the on/off of the ALF that has been interpreted from the encoded bit stream is that when the ALF is turned on, one filter is selected from a plurality of filters according to the direction and activity of a part of the gradient. The selected filter is suitable for reconstituting blocks.
[frame memory]

框記憶體214是用以儲存使用在間預測的參考圖片之記憶部,有時候也被稱為框緩衝器。具體來說,框記憶體214是儲存經由迴路濾波部212所濾波的再構成區塊。
[內預測部]
The frame memory 214 is a memory portion for storing reference pictures used for inter prediction, and is sometimes referred to as a frame buffer. Specifically, the frame memory 214 stores the reconstructed block filtered by the loop filter unit 212.
[Internal forecasting department]

內預測部216是根據已從編碼位元流解讀的內預測模式,參考區塊記憶體210所儲存的當前圖片內的區塊,來進行內預測,以此產生預測訊號(內預測訊號)。具體來說,內預測部216是參考鄰接於當前區塊的區塊之樣本(例如亮度值、色差值)來進行內預測,以此產生內預測訊號,且將內預測訊號輸出至預測控制部220。The intra prediction unit 216 performs intra prediction by referring to the intra-prediction mode that has been interpreted from the encoded bit stream, referring to the block in the current picture stored in the block memory 210, thereby generating a prediction signal (internal prediction signal). Specifically, the intra prediction unit 216 performs intra prediction by referring to samples (for example, luminance values and color difference values) of the blocks adjacent to the current block, thereby generating an intra prediction signal, and outputting the intra prediction signal to the prediction control. Department 220.

另,在色差區塊的內預測中,選擇了參考亮度區塊的內預測模式時,內預測部216也可根據當前區塊的亮度成分,預測當前區塊的色差成分。Further, in the intra prediction of the chroma block, when the intra prediction mode of the reference luma block is selected, the intra prediction unit 216 may also predict the chroma component of the current block based on the luminance component of the current block.

又,在已從編碼位元流解讀的資訊顯示PDPC的適用時,內預測部216是根據水平/垂直方向的參考像素的梯度,來補正內預測後的像素值。
[間預測部]
Further, when the information display PDPC has been interpreted from the encoded bit stream, the intra prediction unit 216 corrects the intra-predicted pixel value based on the gradient of the reference pixels in the horizontal/vertical direction.
[Inter forecasting department]

間預測部218是參考框記憶體214所儲存的參考圖片,來預測當前區塊。預測是以當前區塊或者當前區塊內的子區塊(例如4×4區塊)的單位進行。例如,間預測部218是使用已從編碼位元流解讀的移動資訊(例如移動向量)來進行移動補償,以此產生當前區塊或者子區塊的間預測訊號,且將間預測訊號輸出至預測控制部220。The inter prediction unit 218 refers to the reference picture stored in the frame memory 214 to predict the current block. The prediction is made in units of the current block or sub-blocks within the current block (eg, 4x4 blocks). For example, the inter prediction unit 218 performs motion compensation using motion information (eg, motion vector) that has been interpreted from the encoded bit stream, thereby generating an inter-prediction signal of the current block or sub-block, and outputting the inter-predicted signal to Prediction control unit 220.

另,在已從編碼位元流解讀的資訊是顯示適用OBMC模式時,間預測部218不只是利用經由移動估測而得到的當前區塊的移動資訊,還利用鄰接區塊的移動資訊,產生間預測訊號。In addition, when the information that has been interpreted from the encoded bit stream is the display of the applicable OBMC mode, the inter prediction unit 218 not only uses the mobile information of the current block obtained through the mobile estimation but also uses the mobile information of the adjacent block to generate Inter prediction signal.

又,在已從編碼位元流解讀的資訊是顯示適用FRUC模式時,間預測部218是依照已從編碼流解讀的圖案匹配的方法(雙向匹配或者模板匹配)來進行移動估測,藉此導出移動資訊。然後,間預測部218是使用所導出的移動資訊,來進行移動補償。Further, when the information that has been interpreted from the encoded bit stream indicates that the FRUC mode is applied, the inter prediction unit 218 performs motion estimation in accordance with the pattern matching method (bidirectional matching or template matching) that has been interpreted from the encoded stream, thereby Export mobile information. Then, the inter prediction unit 218 performs motion compensation using the derived movement information.

又,間預測部218是適用BIO模式時,根據假設等速直線運動之模型,導出移動向量。又,在已從編碼位元流解讀的資訊顯示適用仿射移動補償預測模式時,間預測部218是根據複數個鄰接區塊的移動向量,而以子區塊單位導出移動向量。
[預測控制部]
Further, when the BIO mode is applied, the inter prediction unit 218 derives a motion vector based on a model of a hypothetical linear motion. Further, when the information display that has been interpreted from the coded bit stream indicates that the affine motion compensation prediction mode is applied, the inter prediction unit 218 derives the motion vector in units of sub-blocks based on the motion vectors of the plurality of adjacent blocks.
[Predictive Control Department]

預測控制部220是選擇內預測訊號及間預測訊號之任一個,且將所選擇的訊號作為預測訊號,而輸出至加法部208。
[濾波資訊的設定]
The prediction control unit 220 selects any one of the intra prediction signal and the inter prediction signal, and outputs the selected signal as a prediction signal to the addition unit 208.
[Filtering information setting]

其次,詳細說明自適應迴路濾波(ALF:Adaptive Loop Filter)的濾波資訊的設定。Next, the setting of the filtering information of the adaptive loop filter (ALF: Adaptive Loop Filter) will be described in detail.

圖11是顯示實施形態1之編碼裝置100的迴路濾波部120的構成之方塊圖。迴路濾波部120包含有:濾波控制部131、當前濾波資訊記憶部132、參考濾波資訊記憶部133及適應濾波部134。FIG. 11 is a block diagram showing the configuration of the loop filter unit 120 of the encoding apparatus 100 according to the first embodiment. The loop filter unit 120 includes a filter control unit 131, a current filter information storage unit 132, a reference filter information storage unit 133, and an adaptive filter unit 134.

濾波控制部131是用來處理濾波資訊的電路。當前濾波資訊記憶部132為用來記憶自適應迴路濾波所使用的濾波資訊的記憶體。參考濾波資訊記憶部133是用來記憶自適應迴路濾波所使用的濾波資訊的記憶體。適應濾波部134是用來使用當前濾波資訊記憶部132所記憶的濾波資訊,對每區塊適用自適應迴路濾波的電路。The filter control unit 131 is a circuit for processing filter information. The current filter information storage unit 132 is a memory for storing filter information used for adaptive loop filtering. The reference filter information storage unit 133 is a memory for storing filter information used for adaptive loop filtering. The adaptive filter unit 134 is a circuit for applying adaptive loop filtering to each block using the filter information stored in the current filtered information storage unit 132.

濾波資訊也可表現為濾波資訊組合。例如,濾波控制部131在切片的前頭中,參考參考濾波資訊記憶部133所記憶的濾波資訊組合,在當前濾波資訊記憶部132設定濾波資訊組合。Filtering information can also be represented as a combination of filtering information. For example, the filter control unit 131 refers to the filter information combination stored in the reference filter information storage unit 133 in the head of the slice, and sets the filter information combination in the current filter information storage unit 132.

適應濾波部134是用來使用設定於當前濾波資訊記憶部132的濾波資訊組合,對每區塊適用自適應迴路濾波。例如,適應濾波部134從濾波資訊組合所含的複數種濾波係數之中,對每區塊,依照再現圖像的特性,選擇用來讓再現圖(再構成圖像)接近輸入圖(原圖像)的濾波係數。然後,適應濾波部134對每區塊,使用已選擇的濾波係數來適用自適應迴路濾波。The adaptive filter unit 134 is configured to apply adaptive loop filtering to each block using the filter information combination set in the current filter information storage unit 132. For example, the adaptive filter unit 134 selects, for each block, from the plurality of filter coefficients included in the filter information combination, in accordance with the characteristics of the reproduced image, to make the reproduced image (reconstituted image) close to the input image (original image). Filter coefficient like). Then, the adaptive filter section 134 applies adaptive loop filtering to each block using the selected filter coefficients.

又,有當前切片的NAL(Network Abstraction Layer)單元類型對應於被容許使用作為間預測的參考圖片的圖片的情形。此時,濾波控制部131將濾波資訊組合保存在參考濾波資訊記憶部133,前述濾波資訊組合被使用在對於含有當前切片的圖片之自適應迴路濾波。Also, there is a case where the NAL (Network Abstraction Layer) unit type of the current slice corresponds to a picture that is allowed to use the reference picture as the inter prediction. At this time, the filter control unit 131 stores the filter information combination in the reference filter information storage unit 133, and the filter information combination is used for adaptive loop filtering on the picture including the current slice.

然後,濾波控制部131將複數個濾波資訊組合保存在參考濾波資訊記憶部133,前述濾波資訊組合被使用在相對於複數張圖片之自適應迴路濾波。Then, the filter control unit 131 stores a plurality of pieces of filter information in the reference filter information storage unit 133, and the filter information combination is used for adaptive loop filtering with respect to a plurality of pictures.

濾波控制部131將參考濾波資訊記憶部133所保存的複數個濾波資訊組合關聯至參考圖片緩衝器,即,關聯至由框記憶體122所保存的複數張參考圖片來管理。此時,濾波控制部131將複數個濾波資訊組合的每個關聯至參考圖片來管理,前述參考圖片是使用前述濾波資訊組合而適用自適應迴路濾波的圖片。The filter control unit 131 associates the plurality of filter information stored in the reference filter information storage unit 133 with the reference picture buffer, that is, the plurality of reference pictures stored by the frame memory 122. At this time, the filter control unit 131 manages each of the plurality of filter information combinations associated with the reference picture, and the reference picture is a picture to which adaptive loop filtering is applied by using the aforementioned filter information combination.

又,例如,有參考圖片被標記為「unused for reference(非參考)」的情形。此時,濾波控制部131將與被標記為「unused for reference(非參考)」的參考圖片有關聯的濾波資訊組合標記為「unused for reference(非參考)」。即,在參考圖片被刪除時,濾波控制部131刪除有關聯於參考圖片之濾波資訊組合。Also, for example, there is a case where the reference picture is marked as "unused for reference". At this time, the filter control unit 131 marks the filter information combination associated with the reference picture labeled "unused for reference" as "unused for reference". That is, when the reference picture is deleted, the filter control unit 131 deletes the filter information combination associated with the reference picture.

在此,參考圖片或者濾波資訊組合等的資料被標記為「unused for reference(非參考)」是意指:之後該資料不會被參考。Here, the information such as the reference picture or the filter information combination is marked as "unused for reference" means that the data will not be referred to thereafter.

又,濾波控制部131也可輸出濾波控制資訊,前述濾波控制資訊是與用以在當前濾波資訊記憶部132設定濾波資訊的設定方法有關的資訊。接著,也可從編碼裝置100將濾波控制資訊通知到解碼裝置200,前述濾波控制資訊是與用以在當前濾波資訊記憶部132設定濾波資訊的設定方法有關的資訊。Further, the filter control unit 131 may output filter control information which is information related to a setting method for setting filter information in the current filter information storage unit 132. Next, the filtering control information may be notified from the encoding device 100 to the decoding device 200, which is information related to a setting method for setting the filtering information in the current filtering information storage unit 132.

例如,濾波控制資訊是用以指定濾波資訊組合的資訊,前述濾波資訊組合是用於被適用在圖片的自適應迴路濾波。具體來說,濾波控制資訊也可顯示與濾波資訊組合有關聯的參考圖片之參考圖片索引的值,前述濾波資訊組合是用於被適用於圖片的自適應迴路濾波。然後,也可使用參考圖片的參考圖片索引的值,而從參考濾波資訊記憶部133的複數個濾波資訊組合之中,指定濾波資訊組合。For example, the filter control information is information for specifying a combination of filter information, and the filter information combination is used for adaptive loop filtering applied to the picture. Specifically, the filter control information may also display a value of a reference picture index of a reference picture associated with the filter information combination, the filter information combination being used for adaptive loop filtering applied to the picture. Then, the value of the reference picture index of the reference picture can also be used, and the combination of the filter information is specified from the plurality of filter information combinations of the reference filter information storage unit 133.

或者,濾波控制資訊也可顯示根據輸入圖(原圖像)與再現圖(再構成圖像)所產生的濾波資訊組合的濾波係數,而非參考濾波資訊記憶部133的濾波資訊組合的濾波係數。依此,也可指定適用在圖片之自適應迴路濾波所用的濾波資訊組合。Alternatively, the filter control information may also display a filter coefficient combined with the filter information generated by the input map (original image) and the reproduction map (reconstituted image), instead of the filter coefficient of the filter information combination of the reference filter information storage unit 133. . Accordingly, it is also possible to specify a combination of filtering information for adaptive loop filtering of the picture.

又,濾波控制部131也可以只參考與滿足規定條件的參考圖片有關聯之濾波資訊組合的方式來限制參考。具體來說,濾波控制部131也可只對有關聯於圖片之濾波資訊組合來容許參考,且前述圖片要滿足關於TSA圖片之限制條件。滿足關於TSA圖片之限制條件的圖片也可為暫時ID小於TSA圖片的圖片。Further, the filter control unit 131 may limit the reference only by referring to the combination of the filter information associated with the reference picture satisfying the predetermined condition. Specifically, the filtering control unit 131 may also allow reference only for the combination of filtering information associated with the picture, and the foregoing picture is to satisfy the restriction condition regarding the TSA picture. A picture that satisfies the restrictions on the TSA picture may also be a picture with a temporary ID smaller than the TSA picture.

例如,在編碼順序上為TSA圖片之後的圖片之編碼中,禁止對於以下圖片的參考:為編碼順序上較TSA圖片還前面的圖片,且暫時ID與TSA圖片相同,或者暫時ID大於TSA圖片的圖片。也可禁止對有關聯於如此的圖片之濾波資訊組合的參考。For example, in the encoding of the picture after the TSA picture in the coding order, the reference to the following picture is prohibited: the picture in front of the TSA picture in the coding order, and the temporary ID is the same as the TSA picture, or the temporary ID is larger than the TSA picture. image. References to combinations of filtered information associated with such pictures may also be prohibited.

又,滿足關於TSA圖片的限制條件的圖片也可為參考圖片,前述參考圖片的暫時ID小於編碼順序上在當前圖片與參考圖片之間的任一個TSA圖片。Moreover, the picture that satisfies the restriction condition on the TSA picture may also be a reference picture, and the temporary ID of the foregoing reference picture is smaller than any TSA picture between the current picture and the reference picture in the coding order.

例如,當編碼順序上在當前圖片與1個參考圖片之間,且暫時ID與前述1個參考圖片相同,或者暫時ID小於前述1個參考圖片的TSA圖片存在時,禁止對於前述1個參考圖片的參考。因此,也可禁止對有關聯於前述參考圖片之濾波資訊組合的參考。For example, when the coding order is between the current picture and one reference picture, and the temporary ID is the same as the previous reference picture, or the temporary ID is smaller than the TSA picture of the one reference picture, the first reference picture is prohibited. Reference. Therefore, references to filtered information combinations associated with the aforementioned reference pictures may also be disabled.

另,藉暫時ID所顯示的階層是暫時ID越大就越上位的階層。例如,包含在相對來說是上位的階層中的圖片之參考,在包含在相對來說是下位的階層中的其他圖片的編碼中是被禁止的。In addition, the hierarchy displayed by the temporary ID is the higher the temporary ID. For example, a reference to a picture contained in a relatively high-level hierarchy is prohibited in encoding of other pictures included in a relatively lower-level hierarchy.

又,暫時ID得以0以上的整數表現。當暫時ID為0時,藉前述暫時ID所顯示的階層為最下位的階層。基本上,最下位的階層所含的圖片之參考,在最下位的階層或者其他階層所含的其他圖片的編碼中不被禁止。Further, the temporary ID is expressed by an integer of 0 or more. When the temporary ID is 0, the hierarchy indicated by the temporary ID is the lowest hierarchical level. Basically, the reference to the pictures contained in the lowest level is not prohibited in the encoding of the other pictures contained in the lowest level or other classes.

圖12A是顯示實施形態1之濾波資訊的管理順序之第1具體例的流程圖。圖1所示的編碼裝置100例如進行圖12A所示的動作。Fig. 12A is a flowchart showing a first specific example of the management procedure of the filter information in the first embodiment. The coding apparatus 100 shown in Fig. 1 performs, for example, the operation shown in Fig. 12A.

首先,編碼裝置100進行切片標頭的處理(S101)。例如,熵編碼部110產生編碼對象之當前切片的切片標頭,並將之編碼。First, the encoding device 100 performs processing of a slice header (S101). For example, the entropy encoding section 110 generates a slice header of the current slice of the encoding object and encodes it.

接著,編碼裝置100進行濾波控制資訊的處理(S102)。例如,濾波控制部131產生並輸出濾波控制資訊。又,熵編碼部110將由濾波控制部131所輸出的濾波控制資訊編碼。濾波控制資訊也可不包含在切片標頭。因此,濾波控制資訊的處理(S102)也可包含在切片標頭的處理(S101)。Next, the encoding device 100 performs processing of filtering control information (S102). For example, the filter control unit 131 generates and outputs filter control information. Further, the entropy coding unit 110 encodes the filter control information output from the filter control unit 131. Filter control information may also not be included in the slice header. Therefore, the processing of the filter control information (S102) can also be included in the processing of the slice header (S101).

其次,編碼裝置100判定當前切片是否為圖片的前頭的切片(S103)。例如,分割部102判定當前切片是否為圖片的前頭的切片。其他構成要素也可進行前述判定,複數個構成要素的每個也可進行前述判定。Next, the encoding device 100 determines whether the current slice is the slice at the head of the picture (S103). For example, the dividing unit 102 determines whether the current slice is the slice of the head of the picture. The other components may be subjected to the above determination, and each of the plurality of constituent elements may be subjected to the above determination.

在當前切片不是圖片的前頭的切片時(在S103,否),進行對於CU(Coding Unit)之處理的迴路(S109)。即,編碼裝置100對每CU進行編碼處理。此時,編碼裝置100適用自適應迴路濾波。When the current slice is not the slice at the head of the picture (No at S103), a loop for processing of the CU (Coding Unit) is performed (S109). That is, the encoding device 100 performs encoding processing for each CU. At this time, the encoding device 100 is adapted to adaptive loop filtering.

另一方面,在當前切片是圖片的前頭的切片時(在S103,是),編碼裝置100將參考圖片緩衝器更新(S104)。具體來說,間預測部126將框記憶體122所儲存的參考圖片的資訊更新。例如間預測部126將不參考的不需要的參考圖片標記為「unused for reference(非參考)」。依此,不參考的不需要的參考圖片就會被實質性地消去。On the other hand, when the current slice is the slice at the head of the picture (Yes in S103), the encoding device 100 updates the reference picture buffer (S104). Specifically, the inter prediction unit 126 updates the information of the reference picture stored in the frame memory 122. For example, the inter prediction unit 126 marks an unnecessary reference picture that is not referred to as "unused for reference". Accordingly, unwanted reference pictures that are not referenced are substantially eliminated.

在參考圖片緩衝器被更新之後,編碼裝置100刪除不需要的濾波資訊(S105)。例如,濾波控制部131將與被標記為「unused for reference(非參考)」之參考圖片有關聯的濾波資訊組合標記為「unused for reference(非參考)」。依此,不參考的不需要的濾波資訊組合就會被實質性地消去。After the reference picture buffer is updated, the encoding device 100 deletes unnecessary filtering information (S105). For example, the filter control unit 131 marks the filter information combination associated with the reference picture labeled "unused for reference" as "unused for reference". Accordingly, the undesired combination of filtered information that is not referenced is substantially eliminated.

即,在從參考圖片緩衝器將參考圖片消去時,有關聯於參考圖片的濾波資訊組合也會被消去。That is, when the reference picture is erased from the reference picture buffer, the filtered information combination associated with the reference picture is also erased.

然後,編碼裝置100在刪除不需要的濾波資訊之後,判定當前切片的NAL單元類型是對應於參考或者對應於非參考(S106)。Then, after deleting the unnecessary filtering information, the encoding device 100 determines that the NAL unit type of the current slice corresponds to a reference or corresponds to a non-reference (S106).

在此,對應於參考的圖片是要被參考的圖片,即,容許參考的圖片,對應於非參考的圖片是不被參考的圖片,即,被禁止參考的圖片。例如,濾波控制部131判定當前切片的NAL單元類型是對應於要被參考的圖片的類型,或者是對應於不被參考的圖片的類型。Here, the picture corresponding to the reference is a picture to be referred to, that is, a picture that is allowed to be referred to, and a picture corresponding to the non-reference is a picture that is not referred to, that is, a picture that is prohibited from being referred to. For example, the filtering control section 131 determines that the NAL unit type of the current slice is a type corresponding to a picture to be referred to, or a type corresponding to a picture that is not referred to.

在非參考時(在S106,非參考),進行對於CU(Coding Unit)之處理的迴路(S109)。即,編碼裝置100對每CU進行編碼處理。此時,編碼裝置100適用自適應迴路濾波。At the time of non-reference (at S106, non-reference), a loop for processing of the CU (Coding Unit) is performed (S109). That is, the encoding device 100 performs encoding processing for each CU. At this time, the encoding device 100 is adapted to adaptive loop filtering.

另一方面,在參考時(在S106,參考),編碼裝置100將保存區域關聯於當前圖片(S107)。例如,濾波控制部131將參考濾波資訊記憶部133中保存濾波資訊組合的保存區域關聯於含有當前切片的當前圖片。On the other hand, at the time of reference (refer to, at S106), the encoding device 100 associates the save area with the current picture (S107). For example, the filter control unit 131 associates the save area in which the filter information combination is stored in the reference filter information storage unit 133 with the current picture including the current slice.

然後,編碼裝置100在保存區域保存濾波資訊(S108)。具體來說,濾波控制部131是將使用在對於當前圖片的自適應迴路濾波之濾波資訊組合保存在有關聯於當前圖片的保存區域。Then, the encoding device 100 holds the filter information in the save area (S108). Specifically, the filter control unit 131 stores the filter information combined with the adaptive loop filter for the current picture in a storage area associated with the current picture.

在這之後,進行對於CU之處理的迴路(S109)。即,編碼裝置100對每CU進行編碼處理。此時,編碼裝置100適用自適應迴路濾波。After that, a loop for processing the CU is performed (S109). That is, the encoding device 100 performs encoding processing for each CU. At this time, the encoding device 100 is adapted to adaptive loop filtering.

編碼裝置100藉由進行上述的動作,可在圖片的前頭,依照參考圖片緩衝器的狀態,將參考濾波資訊記憶部133中的濾波資訊更新。又,編碼裝置100可將當前圖片的濾波資訊保存在參考濾波資訊記憶部133。By performing the above-described operation, the encoding apparatus 100 can update the filter information in the reference filter information storage unit 133 in accordance with the state of the reference picture buffer at the head of the picture. Further, the encoding device 100 can store the filter information of the current picture in the reference filter information storage unit 133.

又,編碼裝置100藉由進行上述的動作,可在框記憶體122及參考濾波資訊記憶部133中,將參考圖片與濾波資訊組合賦予關聯來管理該等。另,有關聯於參考圖片的濾波資訊組合也可使用用來指定參考圖片的參考圖片索引來管理。Further, by performing the above-described operations, the encoding device 100 can manage the association between the reference picture and the filter information in the frame memory 122 and the reference filter information storage unit 133. In addition, the combination of filtering information associated with the reference picture can also be managed using a reference picture index that specifies the reference picture.

圖12B是顯示實施形態1之濾波資訊的設定順序之第1具體例的流程圖。圖1所示的編碼裝置100例如進行圖12B所示的動作。Fig. 12B is a flowchart showing a first specific example of the procedure for setting the filter information in the first embodiment. The coding apparatus 100 shown in Fig. 1 performs, for example, the operation shown in Fig. 12B.

首先,編碼裝置100構築參考圖片清單(S201)。具體來說,間預測部126構築參考圖片清單。例如,進行在圖12A中更新參考圖片緩衝器的處理(S104)時,也可進行構築參考圖片清單的處理。First, the encoding device 100 constructs a reference picture list (S201). Specifically, the inter prediction unit 126 constructs a reference picture list. For example, when the process of updating the reference picture buffer in FIG. 12A is performed (S104), the process of constructing the reference picture list may be performed.

接著,編碼裝置100取得濾波控制資訊(S202)。例如,濾波控制部131取得在圖12A中的濾波控制資訊處理(S102)中已處理的濾波控制資訊。Next, the encoding device 100 acquires filter control information (S202). For example, the filter control unit 131 acquires the filter control information that has been processed in the filter control information processing (S102) in Fig. 12A.

當使用有關聯於參考圖片的濾波資訊組合時,濾波控制資訊也可包含有在參考濾波資訊記憶部133中用來指定濾波資訊組合的參考圖片索引。When a combination of filtering information associated with a reference picture is used, the filtering control information may also include a reference picture index used in the reference filtering information storage unit 133 to specify a combination of filtering information.

又,當不使用有關聯於參考圖片的濾波資訊組合時,濾波控制資訊也可包含有使用在自適應迴路濾波的濾波資訊組合,來取代參考圖片索引。即,此時,濾波控制資訊也可包含有構成濾波資訊組合的濾波係數。Moreover, when the filter information combination associated with the reference picture is not used, the filter control information may also include a filter information combination used in adaptive loop filtering instead of the reference picture index. That is, at this time, the filter control information may also include filter coefficients constituting the combination of the filter information.

其次,編碼裝置100判定是否參考參考圖片的濾波資訊(S203)。具體來說,在對於當前圖片之濾波資訊組合的設定中,濾波控制部131判定是否參考有關聯於參考圖片的濾波資訊組合。Next, the encoding device 100 determines whether or not to refer to the filter information of the reference picture (S203). Specifically, in the setting of the filter information combination for the current picture, the filter control unit 131 determines whether or not the filter information combination associated with the reference picture is referred to.

當參考參考圖片的濾波資訊時(在S203,是),編碼裝置100設定基於參考圖片索引的濾波資訊(S204)。例如,濾波控制部131從參考濾波資訊記憶部133中的複數個濾波資訊組合之中,指定有關聯於參考圖片的濾波資訊組合,前述參考圖片是藉由濾波控制資訊所含的參考圖片索引來指定。然後,濾波控制部131是將已指定的濾波資訊組合保存在當前濾波資訊記憶部132。When referring to the filter information of the reference picture (Yes in S203), the encoding apparatus 100 sets the filter information based on the reference picture index (S204). For example, the filter control unit 131 specifies, from among the plurality of filter information combinations in the reference filter information storage unit 133, a filter information combination associated with the reference picture, the reference picture being indexed by the reference picture included in the filter control information. Specified. Then, the filter control unit 131 stores the specified filter information in the current filter information storage unit 132.

又,當不參考參考圖片的濾波資訊時(在S203,否),編碼裝置100設定基於輸入圖及再現圖的濾波資訊(S205)。即,編碼裝置100將根據輸入圖及再現圖所產生的濾波資訊組合,保存在當前濾波資訊記憶部132。例如,濾波控制資訊含有根據輸入圖及再現圖所產生的濾波資訊組合,濾波控制部131將濾波控制資訊所含的濾波資訊組合保存在當前濾波資訊記憶部132。Further, when the filter information of the reference picture is not referred to (NO at S203), the encoding device 100 sets the filter information based on the input map and the reproduction map (S205). That is, the encoding device 100 combines the filtered information generated based on the input map and the reproduced image in the current filtered information storage unit 132. For example, the filter control information includes a combination of filter information generated based on the input map and the reproduction map, and the filter control unit 131 stores the filter information combination included in the filter control information in the current filter information storage unit 132.

在這之後,進行對於CU之處理的迴路(S206)。即,編碼裝置100對每CU進行編碼處理。此時,編碼裝置100適用自適應迴路濾波。具體來說,適應濾波部134使用已設定的濾波資訊,適用自適應迴路濾波。After that, a loop for processing the CU is performed (S206). That is, the encoding device 100 performs encoding processing for each CU. At this time, the encoding device 100 is adapted to adaptive loop filtering. Specifically, the adaptive filter unit 134 applies adaptive loop filtering using the set filter information.

編碼裝置100藉由進行上述的動作,可按照濾波控制資訊,將對於當前圖片的濾波資訊保存在當前濾波資訊記憶部132。By performing the above-described operations, the encoding device 100 can store the filter information for the current picture in the current filtered information storage unit 132 in accordance with the filter control information.

另,編碼裝置100在產生濾波控制資訊之前,也可進行各CU的編碼處理的一部分,產生再現圖。依此,編碼裝置100可根據輸入圖及再現圖,適當地產生濾波資訊組合,且可適當地產生濾波控制資訊,前述濾波控制資訊含有基於輸入圖及再現圖的濾波資訊組合。Further, before the generation of the filter control information, the encoding device 100 may perform a part of the encoding process of each CU to generate a reproduction map. Accordingly, the encoding device 100 can appropriately generate the filtering information combination according to the input image and the reproduction map, and can appropriately generate the filtering control information, and the filtering control information includes the filtering information combination based on the input image and the reproduction image.

圖13A是顯示實施形態1之濾波資訊的管理順序之第2具體例的流程圖。圖1所示的編碼裝置100例如亦可進行圖13A所示的動作。Fig. 13A is a flowchart showing a second specific example of the management sequence of the filter information in the first embodiment. The encoding device 100 shown in Fig. 1 can also perform the operations shown in Fig. 13A, for example.

在該例中,與圖12A所示的處理(S101及S102)同樣,首先,編碼裝置100進行切片標頭及濾波控制資訊的處理(S301及S302)。然後,與圖12A所示的處理(S103)同樣,編碼裝置100判定當前切片是否為圖片的前頭的切片(S303)。In this example, similarly to the processing (S101 and S102) shown in FIG. 12A, first, the encoding apparatus 100 performs processing of a slice header and filter control information (S301 and S302). Then, similarly to the processing (S103) shown in FIG. 12A, the encoding apparatus 100 determines whether or not the current slice is the slice of the top of the picture (S303).

在當前切片為圖片的前頭的切片時(在S303,是),與圖12A所示的處理(S104)同樣,編碼裝置100將參考圖片緩衝器更新(S304)。在參考圖片緩衝器被更新之後,與圖12A所示的處理(S105)同樣,編碼裝置100刪除不需要的濾波資訊(S305)。When the current slice is the slice at the head of the picture (Yes in S303), the encoding device 100 updates the reference picture buffer (S304), similarly to the process (S104) shown in FIG. 12A. After the reference picture buffer is updated, the encoding apparatus 100 deletes unnecessary filtering information as in the processing (S105) shown in FIG. 12A (S305).

然後,在刪除不需要的濾波資訊之後,與圖12A所示的處理(S106)同樣,編碼裝置100判定當前切片的NAL單元類型是對應於參考或者對應於非參考(S306)。Then, after the unnecessary filtering information is deleted, the encoding apparatus 100 determines that the NAL unit type of the current slice corresponds to the reference or corresponds to the non-reference (S306), similarly to the processing (S106) shown in FIG. 12A.

當參考時(在S306,參考),與圖12A所示的處理(S107)同樣,編碼裝置100將保存區域關聯於當前圖片(S307)。When referring (at S306, reference), the encoding apparatus 100 associates the save area with the current picture (S307), similarly to the process (S107) shown in FIG. 12A.

在當前切片不是圖片的前頭的切片時(在S303,否),略過從更新參考圖片緩衝器的處理(S304)到將保存區域關聯於當前圖片的處理(S307)之間的處理。又,在當前切片的NAL單元類型為對應於非參考時(在S306,非參考),略過將保存區域關聯於當前圖片的處理(S307)。When the current slice is not the slice of the head of the picture (No at S303), the process from the process of updating the reference picture buffer (S304) to the process of associating the save area with the current picture (S307) is skipped. Also, when the NAL unit type of the current slice corresponds to the non-reference (at S306, non-reference), the process of associating the save area with the current picture is skipped (S307).

然後,進行對於CU之處理的迴路(S308)。即,編碼裝置100對每CU進行編碼處理。Then, a loop for processing the CU is performed (S308). That is, the encoding device 100 performs encoding processing for each CU.

其次,編碼裝置100設定自適應迴路濾波所使用的濾波資訊(S309)。具體來說,濾波控制部131將使用在自適應迴路濾波的濾波資訊組合保存在當前濾波資訊記憶部132。Next, the encoding device 100 sets the filter information used for adaptive loop filtering (S309). Specifically, the filter control unit 131 saves the filter information used in the adaptive loop filter in the current filter information storage unit 132.

接著,編碼裝置100適用自適應迴路濾波(S310)。具體來說,適應濾波部134使用當前濾波資訊記憶部132所保存的濾波資訊組合,對於當前切片適用自適應迴路濾波。Next, the encoding device 100 applies adaptive loop filtering (S310). Specifically, the adaptive filter unit 134 uses the filtered information combination held by the current filtered information storage unit 132 to apply adaptive loop filtering to the current slice.

其次,編碼裝置100判定當前切片的NAL單元類型是對應於參考,或者是對應於非參考(S311)。例如,濾波控制部131判定當前切片的NAL單元類型是對應於要被參考的圖片的類型,或者是對應於不被參考的圖片的類型。Next, the encoding device 100 determines whether the NAL unit type of the current slice corresponds to a reference or corresponds to a non-reference (S311). For example, the filtering control section 131 determines that the NAL unit type of the current slice is a type corresponding to a picture to be referred to, or a type corresponding to a picture that is not referred to.

當參考時(在S311,參考),編碼裝置100將濾波資訊保存在保存區域(S312)。具體來說,濾波控制部131將被使用在對於當前圖片之自適應迴路濾波的濾波資訊組合,保存在關聯於當前圖片的保存區域。在非參考時(在S311,非參考),略過保存的處理(S312)。When referring (at S311, reference), the encoding device 100 saves the filter information in the save area (S312). Specifically, the filter control unit 131 combines the filter information used for the adaptive loop filtering of the current picture, and stores it in the save area associated with the current picture. At the time of non-reference (at S311, non-reference), the saved process is skipped (S312).

編碼裝置100藉由進行上述的動作,可在進行過CU的處理之後,設定濾波資訊,適用自適應迴路濾波。依此,編碼裝置100在設定濾波資訊之前,可適當地產生再現圖。因此,編碼裝置100可根據輸入圖及再現圖,來設定濾波資訊。By performing the above-described operations, the encoding apparatus 100 can set the filtering information after the processing of the CU, and apply adaptive loop filtering. Accordingly, the encoding device 100 can appropriately generate a reproduction map before setting the filter information. Therefore, the encoding device 100 can set the filtering information based on the input map and the reproduction map.

另,熵編碼部110也可不將根據輸入圖及再現圖所設定的濾波資訊追加到切片標頭,而是追加到切片資料後編碼。然後,熵編碼部110也可將含有濾波控制資訊的切片標頭編碼,前述濾波控制資訊顯示使用了已追加到切片資料的濾波資訊之情形。Further, the entropy coding unit 110 may not add the filter information set based on the input map and the reproduction map to the slice header, but may add the slice data to the slice header. Then, the entropy coding unit 110 may encode a slice header including filter control information, and the filter control information may display a filter information added to the slice data.

圖13B是顯示實施形態1之濾波資訊的設定順序之第2具體例的流程圖。圖1所示的編碼裝置100也可進行圖13B所示的動作。Fig. 13B is a flowchart showing a second specific example of the setting procedure of the filter information in the first embodiment. The encoding apparatus 100 shown in Fig. 1 can also perform the operation shown in Fig. 13B.

在該例中,首先,與圖12B所示的處理(S201)同樣,編碼裝置100構築參考圖片清單(S401)。接著,與圖12B所示的處理(S202)同樣,編碼裝置100取得濾波控制資訊(S402)。In this example, first, similarly to the processing (S201) shown in FIG. 12B, the encoding apparatus 100 constructs a reference picture list (S401). Next, similarly to the processing (S202) shown in FIG. 12B, the encoding device 100 acquires filter control information (S402).

然後,進行對於CU之處理的迴路(S403)。即,編碼裝置100對每CU進行編碼處理。Then, a loop for processing the CU is performed (S403). That is, the encoding device 100 performs encoding processing for each CU.

在這之後,與圖12B所示的處理(S203)同樣,編碼裝置100判定是否參考參考圖片的濾波資訊(S404)。After that, similarly to the processing (S203) shown in FIG. 12B, the encoding apparatus 100 determines whether or not to refer to the filtering information of the reference picture (S404).

在參考參考圖片的濾波資訊時(在S404,是),與圖12B所示的處理(S204)同樣,編碼裝置100設定基於參考圖片索引的濾波資訊(S405)。在不參考參考圖片的濾波資訊時(在S404,否),與圖12B所示的處理(S205)同樣,編碼裝置100設定基於輸入圖像及再現圖像的濾波資訊(S406)。When referring to the filter information of the reference picture (Yes in S404), the encoding apparatus 100 sets the filter information based on the reference picture index (S405), similarly to the process (S204) shown in FIG. 12B. When the filter information of the reference picture is not referred to (NO at S404), similarly to the process (S205) shown in FIG. 12B, the encoding device 100 sets filter information based on the input image and the reproduced image (S406).

接著,編碼裝置100適用自適應迴路濾波(S407)。具體來說,適應濾波部134使用已設定的濾波資訊,適用自適應迴路濾波。Next, the encoding device 100 applies adaptive loop filtering (S407). Specifically, the adaptive filter unit 134 applies adaptive loop filtering using the set filter information.

圖14A是顯示實施形態1中的濾波資訊之參考限制的第1具體例的概念圖。在圖14A中,「參考」是對應容許參考,「非參考」是對應禁止參考。又,圖14A所示的圖片p0至p8是以p0、p1、p2、p3、p4、p5、p6、p7及p8的順序來編碼。Fig. 14A is a conceptual diagram showing a first specific example of the reference restriction of the filter information in the first embodiment. In Fig. 14A, "reference" is a corresponding tolerance reference, and "non-reference" is a corresponding prohibition reference. Further, the pictures p0 to p8 shown in FIG. 14A are encoded in the order of p0, p1, p2, p3, p4, p5, p6, p7, and p8.

又,圖片p0至p8的每個被分配顯示時間可調性的階層之暫時ID。具體來說,對圖片p0及p1分配0來作為暫時ID。又,對圖片p2分配1來作為暫時ID。又,對圖片p3及p6分配2來作為暫時ID。又,對圖片p4、p5、p7及p8分配3來作為暫時ID。Further, each of the pictures p0 to p8 is assigned a temporary ID of a hierarchy showing time adjustability. Specifically, 0 is assigned to the pictures p0 and p1 as temporary IDs. Further, 1 is assigned to the picture p2 as a temporary ID. Further, 2 is assigned to the pictures p3 and p6 as the temporary ID. Further, three pictures are assigned to the pictures p4, p5, p7, and p8 as temporary IDs.

又,圖14A顯示圖片p6為編碼對象之當前圖片時的例子。並且,顯示在對於圖片p6的各切片之濾波資訊的設定中被容許參考的濾波資訊及被禁止參考的濾波資訊。Further, FIG. 14A shows an example in which the picture p6 is the current picture of the encoding target. Further, filter information that is allowed to be referred to in the setting of the filter information for each slice of the picture p6 and filter information that is prohibited from being referenced are displayed.

當圖片p6為編碼對象之當前圖片時,圖片p0至p5為編碼完畢圖片。圖片p0至p5之中,圖片p4及p5各自的暫時ID大於圖片p6的暫時ID。因此,在圖片p6的編碼中,禁止圖片p4及p5之參考。按此,在圖片p6之濾波資訊之設定中,也可禁止圖片p4及p5各自的濾波資訊之參考。When the picture p6 is the current picture of the encoding object, the pictures p0 to p5 are the encoded pictures. Among the pictures p0 to p5, the temporary IDs of the pictures p4 and p5 are larger than the temporary ID of the picture p6. Therefore, in the encoding of the picture p6, the references of the pictures p4 and p5 are prohibited. According to this, in the setting of the filtering information of the picture p6, the reference of the filtering information of each of the pictures p4 and p5 can also be prohibited.

又,當圖片p6為TSA圖片時,在圖片p6的編碼中,禁止暫時ID與圖片p6相同的圖片p3之參考。按此,在圖片p6之濾波資訊之設定中,也可禁止圖片p3之濾波資訊之參考。Further, when the picture p6 is a TSA picture, the reference of the picture p3 whose temporary ID is the same as the picture p6 is prohibited in the coding of the picture p6. According to this, in the setting of the filtering information of the picture p6, the reference of the filtering information of the picture p3 can also be prohibited.

因此,也可在圖片p6之濾波資訊之設定中,容許圖片p0至p5之中圖片p0至p2之濾波資訊的參考,禁止圖片p0至p5之中圖片p3至p5之濾波資訊的參考。Therefore, in the setting of the filtering information of the picture p6, the reference of the filtering information of the pictures p0 to p2 among the pictures p0 to p5 is allowed, and the reference of the filtering information of the pictures p3 to p5 among the pictures p0 to p5 is prohibited.

圖14B顯示實施形態1之濾波資訊的參考限制的第2具體例之概念圖。在圖14B中,與圖14A同樣,「參考」是對應於容許參考,「非參考」是對應於禁止參考。又,在圖14B中,與圖14A同樣,顯示了圖片p0至p8。圖14B之例子中的圖片p0至p8的編碼順序,及分配至圖片p0至p8每一張的暫時ID是與圖14A之例子相同。Fig. 14B is a conceptual diagram showing a second specific example of the reference restriction of the filter information in the first embodiment. In Fig. 14B, as in Fig. 14A, "reference" corresponds to the allowable reference, and "non-reference" corresponds to the prohibition reference. Further, in Fig. 14B, pictures p0 to p8 are displayed as in Fig. 14A. The encoding order of the pictures p0 to p8 in the example of Fig. 14B, and the temporary ID assigned to each of the pictures p0 to p8 are the same as the example of Fig. 14A.

並且,在圖14B顯示了圖片p7為編碼對象之當前圖片時的例子。並且,顯示在對於圖片p7的各切片之濾波資訊的設定之中被容許參考的濾波資訊及被禁止參考的濾波資訊。Further, an example in which the picture p7 is the current picture of the encoding target is shown in FIG. 14B. Further, filter information that is allowed to be referred to among the settings of the filter information for each slice of the picture p7 and filter information that is prohibited from being referenced are displayed.

當圖片p7為編碼對象之當前圖片時,圖片p0至p6為編碼完畢圖片。在圖片p0至p6之中,也可容許與編碼順序上從特定圖片的下一張圖片迄至圖片p7的任一圖片相比暫時ID都比較小的特定圖片,或者是暫時ID為0的圖片的參考。When the picture p7 is the current picture of the encoding object, the pictures p0 to p6 are the encoded pictures. Among the pictures p0 to p6, it is also possible to allow a specific picture whose temporary ID is smaller than the picture from the next picture of the specific picture to the picture p7 in the coding order, or a picture whose temporary ID is 0. Reference.

具體來說,圖片p0及p1各自的暫時ID為0。又,圖片p2的暫時ID比圖片p3至p7的任一張都還小。又,圖片p6的暫時ID比圖片p7還小。因此,在圖片p7之濾波資訊的設定之中,也可容許圖片p0至p2及p6之濾波資訊之參考。Specifically, the temporary ID of each of the pictures p0 and p1 is 0. Further, the temporary ID of the picture p2 is smaller than any of the pictures p3 to p7. Also, the temporary ID of the picture p6 is smaller than the picture p7. Therefore, in the setting of the filtering information of the picture p7, the reference of the filtering information of the pictures p0 to p2 and p6 can also be allowed.

又,圖片p3的暫時ID和圖片p4至p7之中圖片p6的暫時ID相同。圖片p4的暫時ID大於圖片p5至p7之中圖片p6的暫時ID。圖片p5的暫時ID大於圖片p6及p7之中圖片p6的暫時ID。因此,在圖片p7之濾波資訊的設定中,也可禁止圖片p3至p5的濾波資訊的參考。Further, the temporary ID of the picture p3 is the same as the temporary ID of the picture p6 among the pictures p4 to p7. The temporary ID of the picture p4 is larger than the temporary ID of the picture p6 among the pictures p5 to p7. The temporary ID of the picture p5 is larger than the temporary ID of the picture p6 among the pictures p6 and p7. Therefore, in the setting of the filtering information of the picture p7, the reference of the filtering information of the pictures p3 to p5 can also be prohibited.

如上述的參考限制是對應於其暫時ID異於0的各圖片為TSA圖片時的參考限制。即,如上述的參考限制對應於圖片p2至p8的各圖片為TSA圖片時的參考限制。The reference restriction as described above is a reference restriction corresponding to the case where each picture whose temporal ID differs from 0 is a TSA picture. That is, the reference restriction as described above corresponds to the reference restriction when each picture of the pictures p2 to p8 is a TSA picture.

又,圖14B所示的參考限制也對應於圖片p6為TSA圖片時的參考限制。例如,暫時ID大於0的編碼完畢圖片與當前圖片之間,存在有其暫時ID等於或小於前述編碼完畢圖片之TSA圖片時,也可禁止前述編碼完畢圖片的濾波資訊之參考。圖14B也顯示了如此的參考限制。Also, the reference restriction shown in FIG. 14B also corresponds to the reference restriction when the picture p6 is a TSA picture. For example, when there is a TSA picture whose temporary ID is equal to or smaller than the encoded picture between the encoded picture whose temporary ID is greater than 0, the reference information of the filtered information of the encoded picture may also be prohibited. Figure 14B also shows such reference limitations.

圖15是顯示實施形態1之解碼裝置200的迴路濾波部212之構成之方塊圖。解碼裝置200的迴路濾波部212的構成是對應於編碼裝置100的迴路濾波部120的構成。具體來說,迴路濾波部212包含有:濾波控制部231、當前濾波資訊記憶部232、參考濾波資訊記憶部233及適應濾波部234。Fig. 15 is a block diagram showing the configuration of the loop filter unit 212 of the decoding device 200 according to the first embodiment. The configuration of the loop filter unit 212 of the decoding device 200 corresponds to the configuration of the loop filter unit 120 of the encoding device 100. Specifically, the loop filter unit 212 includes a filter control unit 231, a current filter information storage unit 232, a reference filter information storage unit 233, and an adaptive filter unit 234.

濾波控制部231是用來處理濾波資訊的電路。當前濾波資訊記憶部232為用來記憶自適應迴路濾波所使用的濾波資訊的記憶體。參考濾波資訊記憶部233是用來記憶自適應迴路濾波已使用的濾波資訊的記憶體。適應濾波部234是用來使用當前濾波資訊記憶部232所記憶的濾波資訊,對每區塊適用自適應迴路濾波的電路。The filter control section 231 is a circuit for processing filter information. The current filter information storage unit 232 is a memory for storing filter information used for adaptive loop filtering. The reference filter information storage unit 233 is a memory for storing filter information that has been used for adaptive loop filtering. The adaptive filter unit 234 is a circuit for applying adaptive loop filtering to each block using the filter information stored in the current filtered information storage unit 232.

解碼裝置200的迴路濾波部212的動作對應於編碼裝置100的迴路濾波部120的動作。例如,濾波控制部231在切片的前頭,參考已記憶在參考濾波資訊記憶部233的濾波資訊組合,在當前濾波資訊記憶部232設定濾波資訊組合。The operation of the loop filter unit 212 of the decoding device 200 corresponds to the operation of the loop filter unit 120 of the encoding device 100. For example, the filter control unit 231 refers to the filter information combination already stored in the reference filter information storage unit 233 at the head of the slice, and sets the filter information combination in the current filter information storage unit 232.

適應濾波部234使用已設定在當前濾波資訊記憶部232的濾波資訊組合,對每區塊適用自適應迴路濾波。例如,適應濾波部234從濾波資訊組合所含的複數種濾波係數之中,對每區塊,依照再現圖的特性,選擇用來讓再現圖(再構成圖像)接近輸入圖(原圖像)的濾波係數。然後,適應濾波部234對每區塊使用已選擇的濾波係數,而適用自適應迴路濾波。The adaptive filter unit 234 applies adaptive loop filtering to each block using the filtered information combination that has been set in the current filtered information storage unit 232. For example, the adaptive filter unit 234 selects, for each block, from the plurality of filter coefficients included in the filter information combination, in accordance with the characteristics of the reproduced image, to make the reproduced image (reconstituted image) close to the input image (original image) Filter coefficient. Then, the adaptive filter section 234 uses the selected filter coefficients for each block, and applies adaptive loop filtering.

有當前切片的NAL單元類型對應於被容許使用作為間預測的參考圖片的圖片的情形。此時,濾波控制部231將濾波資訊組合保存在參考濾波資訊記憶部233,前述濾波資訊組合被使用在對於含有當前切片的圖片之自適應迴路濾波。The NAL unit type having the current slice corresponds to a case where a picture as a reference picture for inter prediction is allowed to be used. At this time, the filter control unit 231 stores the filter information combination in the reference filter information storage unit 233, and the filter information combination is used for adaptive loop filtering on the picture including the current slice.

然後,濾波控制部231將複數個濾波資訊組合保存在參考濾波資訊記憶部233,前述濾波資訊組合被使用在相對於複數張圖片之自適應迴路濾波。Then, the filter control unit 231 stores a plurality of pieces of filter information in the reference filter information storage unit 233, and the filter information combination is used for adaptive loop filtering with respect to a plurality of pictures.

濾波控制部231將參考濾波資訊記憶部233所保存的複數個濾波資訊組合關聯至參考圖片緩衝器,即,關聯至框記憶體214所保存的複數張參考圖片來管理。此時,濾波控制部231將複數個濾波資訊組合的每個關聯至參考圖片來管理,前述參考圖片是使用前述濾波資訊組合而適用自適應迴路濾波的圖片。The filter control unit 231 associates the plurality of filter information stored in the reference filter information storage unit 233 with the reference picture buffer, that is, the plurality of reference pictures stored in the frame memory 214. At this time, the filter control unit 231 manages each of the plurality of filter information combinations associated with the reference picture, which is a picture to which adaptive loop filtering is applied using the aforementioned filter information combination.

又,例如,有參考圖片被標記為「unused for reference(非參考)」的情形。此時,濾波控制部231將與被標記為「unused for reference(非參考)」的參考圖片有關聯的濾波資訊組合標記為「unused for reference(非參考)」。即,在參考圖片被刪除時,濾波控制部231刪除有關聯於參考圖片之濾波資訊組合。Also, for example, there is a case where the reference picture is marked as "unused for reference". At this time, the filter control unit 231 marks the filter information combination associated with the reference picture labeled "unused for reference" as "unused for reference". That is, when the reference picture is deleted, the filter control section 231 deletes the filter information combination associated with the reference picture.

又,也可從編碼裝置100將濾波控制資訊通知到解碼裝置200,前述濾波控制資訊是有關於用來將濾波資訊設定在當前濾波資訊記憶部232的設定方法。接著,也可將濾波控制資訊輸入至濾波控制部231,前述濾波控制資訊是有關於用來將濾波資訊設定在當前濾波資訊記憶部232的設定方法。Further, the filtering control information may be notified from the encoding device 100 to the decoding device 200, and the filtering control information may be a setting method for setting the filtering information to the current filtering information storage portion 232. Next, the filter control information may be input to the filter control unit 231, and the filter control information is a setting method for setting the filter information to the current filter information storage unit 232.

例如,濾波控制資訊是用以指定用來被適用在圖片的自適應迴路濾波之濾波資訊組合的資訊。具體來說,濾波控制資訊也可顯示關聯至濾波資訊組合的參考圖片之參考圖片索引的值,前述濾波資訊組合是用於被適用在圖片的自適應迴路濾波。然後,也可使用參考圖片的參考圖片索引的值,而從參考濾波資訊記憶部233的複數個濾波資訊組合之中,指定濾波資訊組合。For example, the filter control information is information used to specify a combination of filtered information to be applied to the adaptive loop filtering of the picture. Specifically, the filter control information may also display a value of a reference picture index associated with a reference picture of the filter information combination, the filter information combination being used for adaptive loop filtering applied to the picture. Then, the value of the reference picture index of the reference picture can also be used, and the combination of the filter information is specified from the plurality of filter information combinations of the reference filter information storage unit 233.

或者,濾波控制資訊也可為顯示根據輸入圖(原圖像)與再現圖(再構成圖像)所產生的濾波資訊組合的濾波係數,而不是參考濾波資訊記憶部233的濾波資訊組合的濾波係數。依此,也可指定適用在圖片之自適應迴路濾波所用的濾波資訊組合。Alternatively, the filter control information may be a filter coefficient that combines the filter information generated according to the input map (original image) and the reproduction map (reconstituted image), instead of filtering the filter information combination of the reference information storage unit 233. coefficient. Accordingly, it is also possible to specify a combination of filtering information for adaptive loop filtering of the picture.

又,濾波控制部231也可以只參考與滿足規定條件的參考圖片有關聯之濾波資訊組合的方式來限制參考。具體來說,濾波控制部231也可只對有關聯於圖片之濾波資訊組合來容許參考,且前述圖片要滿足有關於TSA圖片之限制條件。滿足有關於TSA圖片的限制條件的圖片也可為暫時ID小於TSA圖片的圖片。Further, the filter control unit 231 may limit the reference only by referring to the combination of the filter information associated with the reference picture satisfying the predetermined condition. Specifically, the filter control unit 231 can also allow reference only for the combination of the filter information associated with the picture, and the picture must satisfy the constraint condition regarding the TSA picture. A picture that satisfies the restrictions on the TSA picture may also be a picture with a temporary ID smaller than the TSA picture.

例如,在解碼順序上為TSA圖片之後的圖片之解碼中,禁止對於以下圖片的參考:為解碼順序上較TSA圖片還前面的圖片,且暫時ID與TSA圖片相同,或者暫時ID大於TSA圖片的圖片。也可禁止對有關聯於如此的圖片之濾波資訊組合的參考。For example, in the decoding of the picture after the TSA picture in the decoding order, the reference to the following picture is prohibited: the picture in front of the TSA picture in the decoding order, and the temporary ID is the same as the TSA picture, or the temporary ID is larger than the TSA picture. image. References to combinations of filtered information associated with such pictures may also be prohibited.

又,滿足有關於TSA圖片的限制條件的圖片也可為參考圖片,前述參考圖片的暫時ID小於解碼順序上在當前圖片與參考圖片之間的任一個TSA圖片。Moreover, the picture that satisfies the restriction condition on the TSA picture may also be a reference picture, and the temporary ID of the foregoing reference picture is smaller than any TSA picture between the current picture and the reference picture in the decoding order.

例如,當解碼順序上在當前圖片與1個參考圖片之間,且暫時ID與前述1個參考圖片相同,或者暫時ID小於前述1個參考圖片的TSA圖片存在時,禁止對於前述1個參考圖片的參考。因此,也可禁止對於有關聯於前述參考圖片之濾波資訊組合的參考。For example, when the decoding order is between the current picture and one reference picture, and the temporary ID is the same as the previous reference picture, or the temporary ID is smaller than the TSA picture of the one reference picture, the first reference picture is prohibited. Reference. Therefore, references to filtered information combinations associated with the aforementioned reference pictures may also be disabled.

關於編碼裝置100,已使用圖12A至圖14B所說明的動作,可透過將編碼換成解碼,而說明有關於解碼裝置200的動作。The encoding apparatus 100 has been described with reference to FIGS. 12A to 14B, and the operation of the decoding apparatus 200 can be described by changing the encoding to decoding.

例如,解碼裝置200進行對應於圖12A所示的動作的動作。解碼裝置200對應於圖12A所示的動作而進行的動作,能根據圖12A來說明。For example, the decoding device 200 performs an action corresponding to the action shown in FIG. 12A. The operation performed by the decoding device 200 in response to the operation shown in FIG. 12A can be described with reference to FIG. 12A.

首先,解碼裝置200進行切片標頭的處理(S101)。例如熵解碼部202解析解碼對象之當前切片的切片標頭,並將之解碼。First, the decoding device 200 performs processing of a slice header (S101). For example, the entropy decoding unit 202 analyzes the slice header of the current slice of the decoding target and decodes it.

其次,解碼裝置200進行濾波控制資訊的處理(S102)。例如熵解碼部202解析濾波控制資訊並解碼。接著,濾波控制部231取得已解碼的濾波控制資訊。濾波控制資訊也可包含在切片標頭。因此,濾波控制資訊的處理(S102)也可包含在切片標頭的處理(S101)。Next, the decoding device 200 performs processing of filtering control information (S102). For example, the entropy decoding unit 202 analyzes the filter control information and decodes it. Next, the filter control unit 231 acquires the decoded filter control information. Filter control information can also be included in the slice header. Therefore, the processing of the filter control information (S102) can also be included in the processing of the slice header (S101).

其次,解碼裝置200判定當前切片是否為圖片的前頭的切片(S103)。例如熵解碼部202判定當前切片是否為圖片的前頭的切片。其他構成要素也可進行前述判定,複數個構成要素的每個也可進行前述判定。Next, the decoding device 200 determines whether the current slice is the slice at the head of the picture (S103). For example, the entropy decoding unit 202 determines whether the current slice is the slice of the top of the picture. The other components may be subjected to the above determination, and each of the plurality of constituent elements may be subjected to the above determination.

在當前切片不是圖片的前頭的切片時(在S103,否),進行對於CU(Coding Unit)之處理的迴路(S109)。即,解碼裝置200對每CU進行解碼處理。此時,解碼裝置200適用自適應迴路濾波。When the current slice is not the slice at the head of the picture (No at S103), a loop for processing of the CU (Coding Unit) is performed (S109). That is, the decoding device 200 performs decoding processing for each CU. At this time, the decoding device 200 is adapted to adaptive loop filtering.

另一方面,在當前切片是圖片的前頭的切片時(在S103,是),解碼裝置200將參考圖片緩衝器更新(S104)。具體來說,間預測部218將框記憶體214所儲存的參考圖片的資訊更新。例如間預測部218將不參考的不需要的參考圖片標記為「unused for reference(非參考)」。依此,不參考的不需要的參考圖片就被實質性地消去。On the other hand, when the current slice is the slice at the head of the picture (Yes in S103), the decoding device 200 updates the reference picture buffer (S104). Specifically, the inter prediction unit 218 updates the information of the reference picture stored in the frame memory 214. For example, the inter prediction unit 218 marks the unneeded reference picture that is not referred to as "unused for reference". Accordingly, unwanted reference pictures that are not referenced are substantially eliminated.

在參考圖片緩衝器被更新之後,解碼裝置200刪除不需要的濾波資訊(S105)。例如,濾波控制部231將與標記為「unused for reference(非參考)」的參考圖片有關聯的濾波資訊組合標記為「unused for reference(非參考)」。依此,不參考的不需要的濾波資訊組合就被實質性地消去。After the reference picture buffer is updated, the decoding device 200 deletes the unnecessary filter information (S105). For example, the filter control unit 231 marks the filter information combination associated with the reference picture labeled "unused for reference" as "unused for reference". Accordingly, the undesired combination of filtered information that is not referenced is substantially eliminated.

即,在從參考圖片緩衝器將參考圖片消去時,有關聯於參考圖片的濾波資訊組合也會被消去。That is, when the reference picture is erased from the reference picture buffer, the filtered information combination associated with the reference picture is also erased.

然後,解碼裝置200在刪除不需要的濾波資訊之後,判定當前切片的NAL單元類型是對應於參考或者對應於非參考(S106)。例如,濾波控制部231判定當前切片的NAL單元類型是對應於要被參考的圖片的類型,或者是對應於於不被參考的圖片的類型。Then, after deleting the unnecessary filtering information, the decoding device 200 determines that the NAL unit type of the current slice corresponds to the reference or corresponds to the non-reference (S106). For example, the filtering control section 231 determines whether the NAL unit type of the current slice is a type corresponding to a picture to be referred to, or a type corresponding to a picture that is not referred to.

在非參考時(在S106,非參考),進行對於CU之處理的迴路(S109)。即,解碼裝置200對每CU進行編碼處理。此時,解碼裝置200適用自適應迴路濾波。At the time of non-reference (at S106, non-reference), a loop for processing of the CU is performed (S109). That is, the decoding device 200 performs encoding processing for each CU. At this time, the decoding device 200 is adapted to adaptive loop filtering.

另一方面,在參考時(在S106,參考),解碼裝置200將保存區域關聯於當前圖片(S107)。例如,濾波控制部231將參考濾波資訊記憶部233中保存濾波資訊組合的保存區域關聯於含有當前切片的當前圖片。On the other hand, at the time of reference (refer to, at S106), the decoding device 200 associates the save area with the current picture (S107). For example, the filter control unit 231 associates the save area in which the filter information combination is stored in the reference filter information storage unit 233 with the current picture including the current slice.

然後,解碼裝置200在保存區域保存濾波資訊(S108)。具體來說,濾波控制部231是將使用在相對於當前圖片的自適應迴路濾波之濾波資訊組合保存在有關聯於當前圖片的保存區域。Then, the decoding device 200 saves the filter information in the save area (S108). Specifically, the filter control unit 231 stores the filter information combined with the adaptive loop filtering with respect to the current picture in a storage area associated with the current picture.

在這之後,進行對於CU之處理的迴路(S109)。即,解碼裝置200對每CU進行編碼處理。此時,解碼裝置200適用自適應迴路濾波。After that, a loop for processing the CU is performed (S109). That is, the decoding device 200 performs encoding processing for each CU. At this time, the decoding device 200 is adapted to adaptive loop filtering.

解碼裝置200藉由進行上述的動作,可在圖片的前頭,依照參考圖片緩衝器的狀態,將參考濾波資訊記憶部233中的濾波資訊更新。又,解碼裝置200可將當前圖片的濾波資訊保存在參考濾波資訊記憶部233。By performing the above-described operation, the decoding device 200 can update the filter information in the reference filter information storage unit 233 in accordance with the state of the reference picture buffer at the head of the picture. Further, the decoding device 200 can store the filter information of the current picture in the reference filter information storage unit 233.

又,解碼裝置200藉由進行上述的動作,可在框記憶體214及參考濾波資訊記憶部233中,將參考圖片與濾波資訊組合賦予關聯並管理該等。另,有關聯於參考圖片的濾波資訊組合,也可使用用來指定參考圖片的參考圖片索引來管理。Further, by performing the above-described operation, the decoding device 200 can associate and manage the reference picture and the filter information combination in the frame memory 214 and the reference filter information storage unit 233. In addition, there is a combination of filtering information associated with the reference picture, which can also be managed using a reference picture index used to specify the reference picture.

又,解碼裝置200進行對應於圖12B所示的動作之動作。對應圖12B所示的動作而藉解碼裝置200所進行的動作得根據圖12B說明。Further, the decoding device 200 performs an operation corresponding to the operation shown in FIG. 12B. The operation performed by the decoding device 200 in response to the operation shown in FIG. 12B will be described with reference to FIG. 12B.

首先,解碼裝置200構築參考圖片清單(S201)。具體來說,間預測部218構築參考圖片清單。例如,在圖12A中進行更新參考圖片緩衝器的處理(S104)時,也可進行構築參考圖片清單的處理。First, the decoding device 200 constructs a reference picture list (S201). Specifically, the inter prediction unit 218 constructs a reference picture list. For example, when the process of updating the reference picture buffer (S104) is performed in FIG. 12A, the process of constructing the reference picture list may be performed.

接著,解碼裝置200取得濾波控制資訊(S202)。例如,濾波控制部231取得在圖12A中的濾波控制資訊處理(S102)中已處理的濾波控制資訊。Next, the decoding device 200 acquires filter control information (S202). For example, the filter control unit 231 acquires the filter control information that has been processed in the filter control information processing (S102) in Fig. 12A.

當使用有關聯於參考圖片的濾波資訊組合時,濾波控制資訊也可含有參考濾波資訊記憶部233中用來指定濾波資訊組合的參考圖片索引。When the filter information combination associated with the reference picture is used, the filter control information may also include a reference picture index in the reference filter information storage unit 233 for specifying the combination of the filter information.

又,當不使用有關聯於參考圖片的濾波資訊組合時,濾波控制資訊也可含有使用在自適應迴路濾波的濾波資訊組合,來取代參考圖片索引。即,此時,濾波控制資訊也可含有構成濾波資訊組合的濾波係數。Moreover, when the filter information combination associated with the reference picture is not used, the filter control information may also contain a filter information combination used in adaptive loop filtering instead of the reference picture index. That is, at this time, the filter control information may also contain filter coefficients constituting a combination of filter information.

其次,解碼裝置200判定是否參考參考圖片的濾波資訊(S203)。具體來說,在對於當前圖片之濾波資訊組合的設定中,濾波控制部231判定是否參考有關聯於參考圖片的濾波資訊組合。Next, the decoding device 200 determines whether or not to refer to the filter information of the reference picture (S203). Specifically, in the setting of the filter information combination for the current picture, the filter control section 231 determines whether or not the filter information combination associated with the reference picture is referred to.

當參考參考圖片的濾波資訊時(在S203,是),解碼裝置200設定基於參考圖片索引的濾波資訊(S204)。例如,濾波控制部231從參考濾波資訊記憶部233中的複數個濾波資訊組合之中,指定有關聯於參考圖片的濾波資訊組合,前述參考圖片是藉由濾波控制資訊所含的參考圖片索引來指定。然後,濾波控制部231是將已指定的濾波資訊組合保存在當前濾波資訊記憶部232。When referring to the filter information of the reference picture (Yes in S203), the decoding device 200 sets the filter information based on the reference picture index (S204). For example, the filter control unit 231 specifies, from among the plurality of filter information combinations in the reference filter information storage unit 233, a filter information combination associated with the reference picture, the reference picture being indexed by the reference picture included in the filter control information. Specified. Then, the filter control unit 231 stores the specified filter information combination in the current filter information storage unit 232.

又,當不參考參考圖片的濾波資訊時(在S203,否),解碼裝置200設定基於輸入圖及再現圖的濾波資訊(S205)。即,解碼裝置200將根據輸入圖及再現圖所產生的濾波資訊組合,保存在當前濾波資訊記憶部232。例如,濾波控制資訊含有根據輸入圖及再現圖所產生的濾波資訊組合,濾波控制部231將濾波控制資訊所含的濾波資訊組合保存在當前濾波資訊記憶部232。Further, when the filter information of the reference picture is not referred to (NO at S203), the decoding device 200 sets the filter information based on the input map and the reproduction map (S205). That is, the decoding device 200 combines the filter information generated based on the input map and the reproduced image in the current filter information storage unit 232. For example, the filter control information includes a combination of filter information generated based on the input map and the reproduction map, and the filter control unit 231 stores the filter information combination included in the filter control information in the current filter information storage unit 232.

在這之後,進行對於CU之處理的迴路(S206)。即,解碼裝置200對每CU進行解碼處理。此時,解碼裝置200適用自適應迴路濾波。具體來說,適應濾波部234使用已設定的濾波資訊,適用自適應迴路濾波。After that, a loop for processing the CU is performed (S206). That is, the decoding device 200 performs decoding processing for each CU. At this time, the decoding device 200 is adapted to adaptive loop filtering. Specifically, the adaptive filter unit 234 applies the adaptive filter filtering using the set filter information.

解碼裝置200藉由進行上述的動作,可按照濾波控制資訊,將對於當前圖片的濾波資訊保存在當前濾波資訊記憶部232。By performing the above-described operations, the decoding device 200 can store the filter information for the current picture in the current filter information storage unit 232 in accordance with the filter control information.

又,解碼裝置200也可進行對應於圖13A所示的動作的動作。對應於圖13A所示的動作而可藉解碼裝置200所進行的動作,可根據圖13A來說明。Further, the decoding device 200 can also perform an operation corresponding to the operation shown in FIG. 13A. The operation that can be performed by the decoding device 200 in accordance with the operation shown in FIG. 13A can be explained based on FIG. 13A.

首先,與圖12A所示的處理(S101及S102)同樣,解碼裝置200進行切片標頭及濾波控制資訊的處理(S301及S302)。然後,與圖12A所示的處理(S103)同樣,解碼裝置200判定當前切片是否為圖片的前頭的切片(S303)。First, similarly to the processing (S101 and S102) shown in FIG. 12A, the decoding device 200 performs processing of a slice header and filter control information (S301 and S302). Then, similarly to the processing (S103) shown in FIG. 12A, the decoding device 200 determines whether or not the current slice is the slice at the head of the picture (S303).

在當前切片為圖片的前頭的切片時(在S303,是),與圖12A所示的處理(S104)同樣,解碼裝置200將參考圖片緩衝器更新(S304)。在參考圖片緩衝器被更新之後,與圖12A所示的處理(S105)同樣,解碼裝置200刪除不需要的濾波資訊(S305)。When the current slice is the slice at the head of the picture (Yes in S303), the decoding device 200 updates the reference picture buffer (S304), similarly to the process (S104) shown in FIG. 12A. After the reference picture buffer is updated, the decoding apparatus 200 deletes unnecessary filter information as in the processing (S105) shown in FIG. 12A (S305).

然後,在刪除不需要的濾波資訊之後,與圖12A所示的處理(S106)同樣,解碼裝置200判定當前切片的NAL單元類型是對應於參考或者對應於非參考(S306)。Then, after the unnecessary filtering information is deleted, the decoding apparatus 200 determines that the NAL unit type of the current slice corresponds to the reference or corresponds to the non-reference (S306), similarly to the processing (S106) shown in FIG. 12A.

當參考時(在S306,參考),與圖12A所示的處理(S107)同樣,解碼裝置200將保存區域關聯於當前圖片(S307)。When referring (at S306, reference), the decoding device 200 associates the save area with the current picture (S307), similarly to the process (S107) shown in Fig. 12A.

在當前切片不是圖片的前頭的切片時(在S303,否),略過從更新參考圖片緩衝器的處理(S304)到將保存區域關聯於當前圖片的處理(S307)之間的處理。又,在當前切片的NAL單元類型為對應於非參考時(在S306,非參考),略過將保存區域關聯於當前圖片的處理(S307)。When the current slice is not the slice of the head of the picture (No at S303), the process from the process of updating the reference picture buffer (S304) to the process of associating the save area with the current picture (S307) is skipped. Also, when the NAL unit type of the current slice corresponds to the non-reference (at S306, non-reference), the process of associating the save area with the current picture is skipped (S307).

然後,進行對於CU之處理的迴路(S308)。即,解碼裝置200對每CU進行解碼處理。Then, a loop for processing the CU is performed (S308). That is, the decoding device 200 performs decoding processing for each CU.

其次,解碼裝置200設定自適應迴路濾波所使用的濾波資訊(S309)。具體來說,濾波控制部231將使用在自適應迴路濾波的濾波資訊組合保存在當前濾波資訊記憶部232。Next, the decoding device 200 sets the filter information used for adaptive loop filtering (S309). Specifically, the filter control unit 231 stores the filter information combined in the adaptive loop filter in the current filter information storage unit 232.

接著,解碼裝置200適用自適應迴路濾波(S310)。具體來說,適應濾波部234使用當前濾波資訊記憶部232所保存的濾波資訊組合,對於當前切片適用自適應迴路濾波。Next, the decoding device 200 applies adaptive loop filtering (S310). Specifically, the adaptive filter unit 234 uses the filtered information combination held by the current filtered information storage unit 232 to apply adaptive loop filtering to the current slice.

其次,解碼裝置200判定當前切片的NAL單元類型是對應於參考,或者是對應於非參考(S311)。例如,濾波控制部231判定當前切片的NAL單元類型是對應於要被參考的圖片的類型,或者是對應於不被參考的圖片的類型。Next, the decoding device 200 determines whether the NAL unit type of the current slice corresponds to a reference or corresponds to a non-reference (S311). For example, the filtering control section 231 determines whether the NAL unit type of the current slice is a type corresponding to a picture to be referred to, or a type corresponding to a picture that is not referred to.

當參考時(在S311,參考),解碼裝置200將濾波資訊保存在保存區域(S312)。具體來說,濾波控制部231將被使用在對於當前圖片之自適應迴路濾波的濾波資訊組合,保存在有關聯於當前圖片的保存區域。在非參考時(在S311,非參考),略過保存的處理(S312)。When referring (at S311, reference), the decoding device 200 saves the filter information in the save area (S312). Specifically, the filter control unit 231 combines the filter information used for the adaptive loop filtering of the current picture, and stores it in a storage area associated with the current picture. At the time of non-reference (at S311, non-reference), the saved process is skipped (S312).

另,也可不將根據輸入圖及再現圖所設定的濾波資訊追加到切片標頭,而是追加到切片資料。然後,濾波控制資訊也可顯示使用了已追加到切片資料的濾波資訊之情形。熵解碼部202也可將如此的濾波資訊及濾波控制資訊解碼。Alternatively, the filter information set based on the input map and the reproduction map may not be added to the slice header, but may be added to the slice data. Then, the filter control information can also display the case where the filter information added to the slice data is used. The entropy decoding unit 202 can also decode such filtering information and filtering control information.

又,解碼裝置200也可進行對應於圖13B所示的動作的動作。對應圖13B所示的動作而可藉解碼裝置200所進行的動作,可根據圖13B來說明。Further, the decoding device 200 can also perform an operation corresponding to the operation shown in FIG. 13B. The operation that can be performed by the decoding device 200 in response to the operation shown in FIG. 13B can be described with reference to FIG. 13B.

首先,與圖12B所示的處理(S201)同樣,解碼裝置200構築參考圖片清單(S401)。接著,與圖12B所示的處理(S202)同樣,解碼裝置200取得濾波控制資訊(S402)。First, similarly to the processing (S201) shown in FIG. 12B, the decoding device 200 constructs a reference picture list (S401). Next, similarly to the processing (S202) shown in FIG. 12B, the decoding device 200 acquires filter control information (S402).

然後,進行對於CU之處理的迴路(S403)。即,解碼裝置200對每CU進行解碼處理。Then, a loop for processing the CU is performed (S403). That is, the decoding device 200 performs decoding processing for each CU.

在這之後,與圖12B所示的處理(S203)同樣,解碼裝置200判定是否參考參考圖片的濾波資訊(S404)。After that, similarly to the processing (S203) shown in FIG. 12B, the decoding apparatus 200 determines whether or not to refer to the filter information of the reference picture (S404).

在參考參考圖片的濾波資訊時(在S404,是),與圖12B所示的處理(S204)同樣,解碼裝置200設定基於參考圖片索引的濾波資訊(S405)。在不參考參考圖片的濾波資訊時(在S404,否),與圖12B所示的處理(S205)同樣,解碼裝置200設定基於輸入圖及再現圖的濾波資訊(S406)。When referring to the filter information of the reference picture (Yes in S404), the decoding apparatus 200 sets the filter information based on the reference picture index (S405), similarly to the process (S204) shown in FIG. 12B. When the filter information of the reference picture is not referred to (NO at S404), similarly to the process (S205) shown in FIG. 12B, the decoding device 200 sets the filter information based on the input map and the reproduction map (S406).

接著,解碼裝置200適用自適應迴路濾波(S407)。具體來說,適應濾波部234使用已設定的濾波資訊,適用自適應迴路濾波。Next, the decoding device 200 applies adaptive loop filtering (S407). Specifically, the adaptive filter unit 234 applies the adaptive filter filtering using the set filter information.

有關圖14A及圖14B的說明,藉由將編碼改寫成解碼,也可適用有關解碼裝置200的說明。
[濾波資訊的處理方法的變形態樣]
14A and 14B, the description of the decoding device 200 can be applied by rewriting the code to be decoded.
[Variation of the processing method of filtering information]

其次,說明濾波資訊的處理方法的變形態樣。即,關於濾波資訊,說明與圖12A至圖14B所示的處理方法不同的處理方法。變形態樣中的基本的構成要素與圖1、圖10、圖11及圖15所示的構成要素相同,因此省略說明。Next, a modification of the processing method of the filter information will be described. That is, regarding the filtering information, a processing method different from the processing method shown in FIGS. 12A to 14B will be described. The basic constituent elements in the modified form are the same as the constituent elements shown in Figs. 1, 10, 11 and 15 and therefore will not be described.

在本變形態樣中,濾波控制資訊藉關聯於切片標頭的參數組合,而由編碼裝置100通知到解碼裝置200。具體來說,濾波控制資訊包含於從編碼裝置100通知到解碼裝置200的參數組合。在此,參數組合也可為PPS(圖片參數組合)。In the present variation, the filter control information is notified to the decoding device 200 by the encoding device 100 by a combination of parameters associated with the slice header. Specifically, the filter control information is included in the parameter combination notified from the encoding device 100 to the decoding device 200. Here, the parameter combination can also be PPS (Picture Parameter Combination).

圖16顯示變形態樣中的濾波資訊的處理順序的第1具體例的流程圖。圖1所示的編碼裝置100,例如進行圖16所示的動作。Fig. 16 is a flow chart showing a first specific example of the processing procedure of the filter information in the modified form. The coding apparatus 100 shown in FIG. 1 performs, for example, the operation shown in FIG.

首先,編碼裝置100判定是否進行PPS處理(S501)。具體來說,PPS處理也可對應於從編碼裝置100往解碼裝置200通知PPS的處理。First, the encoding device 100 determines whether or not the PPS processing is performed (S501). Specifically, the PPS processing may correspond to the process of notifying the PPS from the encoding device 100 to the decoding device 200.

例如,熵編碼部110判定是否將PPS編碼。熵編碼部110也可按照編碼對象圖片的編碼順序、顯示順序或者類別等,來判定是否將PPS編碼。具體來說,當編碼對象圖片為IDR(Instantaneous Decoder Refresh,瞬時解碼器更新)圖片時,熵編碼部110也可判定為將PPS編碼。For example, the entropy encoding unit 110 determines whether or not to encode the PPS. The entropy coding unit 110 may determine whether or not to encode the PPS in accordance with the coding order, display order, or class of the coding target picture. Specifically, when the encoding target picture is an IDR (Instantaneous Decoder Refresh) picture, the entropy encoding unit 110 may determine to encode the PPS.

編碼裝置100在判定為進行PPS處理時(在S501,是),進行PPS處理(S502)。例如,當已判定為將PPS編碼時,熵編碼部110將PPS編碼。又,PPS例如含有濾波控制資訊。又,濾波控制資訊例如含有濾波資訊組合。另一方面,在已判定為不進行PPS處理時(在S501,否),編碼裝置100略過PPS處理。When the encoding device 100 determines that the PPS processing is to be performed (YES in S501), the encoding device 100 performs PPS processing (S502). For example, when it is determined that the PPS is encoded, the entropy encoding section 110 encodes the PPS. Also, the PPS includes, for example, filter control information. Also, the filter control information includes, for example, a combination of filter information. On the other hand, when it is determined that the PPS processing is not performed (NO in S501), the encoding apparatus 100 skips the PPS processing.

其次,編碼裝置100取得NAL單元類型(S503)。例如熵編碼部110取得編碼對象圖片的NAL單元類型。更具體來說,熵編碼部110取得編碼對象圖片中的編碼對象切片的NAL單元類型。編碼對象圖片中的編碼對象切片的NAL單元類型對應於編碼對象圖片的類別。Next, the encoding device 100 acquires the NAL unit type (S503). For example, the entropy coding unit 110 acquires the NAL unit type of the encoding target picture. More specifically, the entropy encoding unit 110 acquires the NAL unit type of the encoding target slice in the encoding target picture. The NAL unit type of the encoding object slice in the encoding target picture corresponds to the category of the encoding target picture.

接著,編碼裝置100判定編碼對象圖片是否為IDR圖片(S504)。例如濾波控制部131按照編碼對象圖片的NAL單元類型,判定編碼對象圖片是否為IDR圖片。Next, the encoding device 100 determines whether or not the encoding target picture is an IDR picture (S504). For example, the filter control unit 131 determines whether or not the encoding target picture is an IDR picture in accordance with the NAL unit type of the encoding target picture.

在已判定編碼對象圖片為IDR圖片時(在S504,是),編碼裝置100刪除已保存的濾波資訊(S505)。例如濾波控制部131刪除參考濾波資訊記憶部133所保存的複數個濾波資訊組合。When it is determined that the encoding target picture is an IDR picture (Yes in S504), the encoding apparatus 100 deletes the saved filtering information (S505). For example, the filter control unit 131 deletes the plurality of filter information combinations held by the reference filter information storage unit 133.

在已判定編碼對象圖片不是IDR圖片時(在S504,否),編碼裝置100判定PPS處理(S502)是否已進行 (S506)。例如,濾波控制部131按照編碼對象圖片的編碼順序、顯示順序或者類別等,來判定PPS是否已被編碼。When it is determined that the encoding target picture is not an IDR picture (NO in S504), the encoding apparatus 100 determines whether or not the PPS processing (S502) has been performed (S506). For example, the filter control unit 131 determines whether or not the PPS has been encoded in accordance with the encoding order, display order, or category of the encoding target picture.

然後,在判定PPS處理(S502)已進行時(在S506,是),編碼裝置100根據PPS處理(S502)中的PPS,保存濾波資訊(S507)。另一方面,在判定為PPS處理(S502)不進行時(在S506,否),編碼裝置100略過保存濾波資訊的處理(S507)。Then, when it is determined that the PPS processing (S502) has been performed (YES at S506), the encoding apparatus 100 saves the filter information based on the PPS in the PPS processing (S502) (S507). On the other hand, when it is determined that the PPS processing (S502) is not performed (NO in S506), the encoding apparatus 100 skips the process of storing the filter information (S507).

又,在已判定編碼對象圖片為IDR圖片時(在S504,是),假設已進行PPS處理(S502)。因此,編碼裝置100,此時,在刪除濾波資訊之後,不進行是否已進行PPS處理的判定,而是根據PPS處理(S502)中的PPS,保存濾波資訊。When it is determined that the encoding target picture is an IDR picture (Yes in S504), it is assumed that PPS processing has been performed (S502). Therefore, the encoding apparatus 100, at this time, does not perform the determination as to whether or not the PPS processing has been performed after deleting the filter information, but saves the filter information based on the PPS in the PPS processing (S502).

例如,濾波控制部131根據在PPS處理(S502)中已被編碼的PPS所含的濾波控制資訊,特定出濾波資訊組合,將已特定的濾波資訊組合保存在參考濾波資訊記憶部133。又,濾波控制部131將已根據PPS所含的濾波控制資訊來特定出的濾波資訊組合,關聯至PPS的圖片參數組合ID(PPS ID)而管理。即,濾波資訊組合關聯至圖片參數組合ID並被保存。For example, the filter control unit 131 specifies the filter information combination based on the filter control information included in the PPS that has been encoded in the PPS process (S502), and stores the specific filter information combination in the reference filter information storage unit 133. Further, the filter control unit 131 associates the filter information specified based on the filter control information included in the PPS with the picture parameter combination ID (PPS ID) of the PPS. That is, the filtered information combination is associated with the picture parameter combination ID and saved.

又,要處理複數個PPS時,針對複數個PPS的每個,根據前述PPS的濾波控制資訊,特定出對應於前述PPS之濾波資訊組合,並保存之。藉此,例如,分別對應於連續***的複數個PPS之複數個濾波資訊組合被特定出來並予以保存。Moreover, when a plurality of PPSs are to be processed, for each of the plurality of PPSs, the filter information combination corresponding to the PPS is specified and stored according to the filtering control information of the PPS. Thereby, for example, a plurality of filter information combinations respectively corresponding to a plurality of consecutively inserted PPSs are specified and saved.

其次,編碼裝置100取得切片標頭的圖片參數組合ID(S508)。即,濾波控制部131取得編碼對象切片的切片標頭所含的圖片參數組合ID。Next, the encoding device 100 acquires the picture parameter combination ID of the slice header (S508). In other words, the filter control unit 131 acquires the picture parameter combination ID included in the slice header of the encoding target slice.

接著,編碼裝置100根據圖片參數組合ID,設定濾波資訊(S509)。例如,濾波控制部131從參考濾波資訊記憶部133所保存的複數個濾波資訊組合之中,選擇有關聯於切片標頭的圖片參數組合ID之濾波資訊組合。然後,濾波控制部131將已選擇的濾波資訊組合保存在當前濾波資訊記憶部132,藉此設定濾波資訊組合。Next, the encoding device 100 sets filter information based on the picture parameter combination ID (S509). For example, the filter control unit 131 selects a filter information combination having a picture parameter combination ID associated with the slice header from among a plurality of filter information combinations held by the reference filter information storage unit 133. Then, the filter control unit 131 saves the selected filter information in the current filter information storage unit 132, thereby setting the filter information combination.

在這之後,進行對於CU之處理的迴路(S510)。即,編碼裝置100對每CU進行編碼處理。此時,編碼裝置100適用自適應迴路濾波。After that, a loop for processing the CU is performed (S510). That is, the encoding device 100 performs encoding processing for each CU. At this time, the encoding device 100 is adapted to adaptive loop filtering.

編碼裝置100藉由進行上述之動作,可將基於PPS的濾波控制資訊的濾波資訊組合保存在參考濾波資訊記憶部133。又,編碼裝置100可從參考濾波資訊記憶部133中的複數個濾波資訊組合之中,特定出基於切片標頭的圖片參數組合ID之濾波資訊組合。然後,編碼裝置100可將已特定出的濾波資訊組合設定在當前濾波資訊記憶部132。By performing the above-described operations, the encoding device 100 can store the filter information combination of the PPS-based filter control information in the reference filter information storage unit 133. Further, the encoding device 100 can specify a filter information combination based on the slice parameter combination ID of the slice header from among the plurality of filter information combinations in the reference filter information storage unit 133. Then, the encoding device 100 can set the specific filter information combination to be set in the current filter information storage unit 132.

圖17顯示變形態樣中的濾波資訊的處理順序的第2具體例的流程圖。圖1所示的編碼裝置100也可進行圖17所示的動作。Fig. 17 is a flow chart showing a second specific example of the processing procedure of the filter information in the modified embodiment. The coding apparatus 100 shown in FIG. 1 can also perform the operation shown in FIG.

在該例中,首先,與圖16所示的處理(S501)同樣,編碼裝置100判定是否進行PPS處理(S601)。編碼裝置100在已判定為進行PPS處理時(在S601,是),與圖16所示的處理(S502)同樣,進行PPS處理(S602)。另一方面,在已判定為不進行PPS處理時(在S601,否),編碼裝置100略過PPS處理。In this example, first, similarly to the processing (S501) shown in FIG. 16, the encoding apparatus 100 determines whether or not the PPS processing is performed (S601). When it is determined that the PPS processing is performed (YES in S601), the encoding apparatus 100 performs PPS processing (S602) in the same manner as the processing (S502) shown in FIG. On the other hand, when it is determined that the PPS processing is not performed (NO in S601), the encoding apparatus 100 skips the PPS processing.

接著,編碼裝置100進行切片標頭的處理(S603)。例如,熵編碼部110產生編碼對象的當前切片的切片標頭,並將之編碼。Next, the encoding device 100 performs processing of a slice header (S603). For example, the entropy encoding section 110 generates a slice header of the current slice of the encoding object and encodes it.

接著,編碼裝置100進行濾波控制資訊的處理(S604)。例如濾波控制部131產生濾波控制資訊,並將之輸出。又,熵編碼部110將從濾波控制部131所輸出的濾波控制資訊編碼。Next, the encoding device 100 performs processing of filtering control information (S604). For example, the filter control unit 131 generates filter control information and outputs it. Further, the entropy coding unit 110 encodes the filter control information output from the filter control unit 131.

濾波控制資訊也可包含在PPS。因此,濾波控制資訊的處理(S604)也可包含在PPS處理(S602)。又,也可在切片標頭的處理(S603)中產生含有PPS的圖片參數組合ID之切片標頭並將之編碼,前述 PPS含有對應於當前切片的濾波控制資訊。Filter control information can also be included in the PPS. Therefore, the processing of the filter control information (S604) may also be included in the PPS processing (S602). Alternatively, a slice header including a picture parameter combination ID of the PPS may be generated and encoded in the processing of the slice header (S603), and the PPS includes filter control information corresponding to the current slice.

然後,進行對於CU之處理的迴路(S605)。即,編碼裝置100對每CU進行編碼處理。Then, a loop for processing the CU is performed (S605). That is, the encoding device 100 performs encoding processing for each CU.

其次,與圖16所示的處理(S503)同樣,編碼裝置100取得NAL單元類型(S606)。接著,與圖16所示的處理(S504)同樣,編碼裝置100判定編碼對象圖片是否為IDR圖片(S607)。Next, similarly to the processing (S503) shown in Fig. 16, the encoding apparatus 100 acquires the NAL unit type (S606). Next, similarly to the processing (S504) shown in FIG. 16, the encoding apparatus 100 determines whether or not the encoding target picture is an IDR picture (S607).

在已判定編碼對象圖片為IDR圖片時(在S607,是),與圖16所示的處理(S505)同樣,編碼裝置100刪除已保存的濾波資訊(S608)。When it is determined that the encoding target picture is an IDR picture (Yes in S607), the encoding apparatus 100 deletes the saved filtering information as in the processing (S505) shown in FIG. 16 (S608).

在已判定編碼對象圖片不是IDR圖片時(在S504,否),與圖16所示的處理(S506)同樣,編碼裝置100判定PPS處理(S602)是否已進行(S609)。When it is determined that the encoding target picture is not an IDR picture (NO in S504), similarly to the processing (S506) shown in FIG. 16, the encoding apparatus 100 determines whether or not the PPS processing (S602) has been performed (S609).

然後,在判定PPS處理(S602)已進行時(在S609,是),編碼裝置100根據PPS處理(S602)中的PPS,設定濾波資訊並保存之(S610)。Then, when it is determined that the PPS processing (S602) has been performed (Yes in S609), the encoding apparatus 100 sets the filtering information according to the PPS in the PPS processing (S602) and stores it (S610).

又,在已判定編碼對象圖片為IDR圖片時(在S607,是),假設已進行PPS處理(S602)。因此,編碼裝置100,此時,在刪除濾波資訊之後,不進行是否已進行PPS處理的判定,而是根據PPS處理(S602)中的PPS,設定濾波資訊並保存之(S610)。When it is determined that the encoding target picture is an IDR picture (Yes in S607), it is assumed that PPS processing has been performed (S602). Therefore, the encoding apparatus 100 does not perform the determination as to whether or not the PPS processing has been performed after deleting the filter information, and sets the filter information based on the PPS in the PPS processing (S602) and stores it (S610).

例如,濾波控制部131根據在PPS處理(S602)中已被編碼的PPS所含的濾波控制資訊,特定出濾波資訊組合。然後,濾波控制部131將已特定的濾波資訊組合保存在當前濾波資訊記憶部132及參考濾波資訊記憶部133的每個。For example, the filter control unit 131 specifies the filter information combination based on the filter control information included in the PPS that has been encoded in the PPS process (S602). Then, the filter control unit 131 stores the specific filter information combination in each of the current filter information storage unit 132 and the reference filter information storage unit 133.

又,濾波控制部131在參考濾波資訊記憶部133中,將已根據PPS所含的濾波控制資訊來特定出的濾波資訊組合,關聯至PPS的圖片參數組合ID而管理。即,濾波資訊組合關聯至圖片參數組合ID並被保存。Further, the filter control unit 131 associates the filter information specified by the filter control information included in the PPS with the picture parameter combination ID of the PPS and manages it in the reference filter information storage unit 133. That is, the filtered information combination is associated with the picture parameter combination ID and saved.

又,要處理複數個PPS時,針對複數個PPS的每個,根據前述PPS的濾波控制資訊,特定出對應於前述PPS之濾波資訊組合,並保存之。藉此,例如,分別對應於連續***的複數個PPS之複數個濾波資訊組合被特定出來並予以保存。Moreover, when a plurality of PPSs are to be processed, for each of the plurality of PPSs, the filter information combination corresponding to the PPS is specified and stored according to the filtering control information of the PPS. Thereby, for example, a plurality of filter information combinations respectively corresponding to a plurality of consecutively inserted PPSs are specified and saved.

另一方面,在判定為PPS處理(S602)未進行時(在S609,否),與圖16所示的處理(S508)同樣,編碼裝置100取得切片標頭的圖片參數組合ID(S611)。其次,與圖16所示的處理(S509)同樣,編碼裝置100根據圖片參數組合ID,設定濾波資訊(S612)。On the other hand, when it is determined that the PPS processing (S602) is not performed (NO in S609), the encoding apparatus 100 acquires the picture parameter combination ID of the slice header as in the processing (S508) shown in FIG. 16 (S611). Next, similarly to the processing (S509) shown in Fig. 16, the encoding apparatus 100 sets the filter information based on the picture parameter combination ID (S612).

然後,編碼裝置100適用自適應迴路濾波(S613)。具體來說,適應濾波部134使用已保存在當前濾波資訊記憶部132的濾波資訊組合,對於當前切片適用自適應迴路濾波。Then, the encoding device 100 applies adaptive loop filtering (S613). Specifically, the adaptive filter unit 134 uses the filtered information combination already stored in the current filtered information storage unit 132, and applies adaptive loop filtering to the current slice.

編碼裝置100藉由進行上述之動作,可在進行了CU的處理之後,設定濾波資訊,適用自適應迴路濾波。依此,編碼裝置100可在設定濾波資訊之前,適當地產生再現圖。因此,編碼裝置100可根據輸入圖及再現圖,設定濾波資訊。By performing the above-described operations, the encoding apparatus 100 can set the filtering information after the processing of the CU, and apply adaptive loop filtering. Accordingly, the encoding device 100 can appropriately generate a reproduction map before setting the filter information. Therefore, the encoding device 100 can set the filtering information based on the input map and the reproduction map.

另,熵編碼部110也可不將根據輸入圖及再現圖所設定的濾波資訊追加到PPS,而是追加到切片資料後編碼。然後,熵編碼部110也可將含有濾波控制資訊的PPS編碼,前述濾波控制資訊顯示使用了已追加到切片資料的濾波資訊之情形。Further, the entropy coding unit 110 may not add the filter information set based on the input map and the reproduction map to the PPS, but may add the slice data to the PPS. Then, the entropy coding unit 110 may encode the PPS including the filter control information, and the filter control information may display the filter information added to the slice data.

關於編碼裝置100,已使用圖16及圖17所說明的動作可透過將編碼換成解碼,而說明有關於解碼裝置200的動作。The encoding apparatus 100 has described the operation of the decoding apparatus 200 by changing the encoding to decoding using the operations described with reference to FIGS. 16 and 17.

例如,解碼裝置200進行對應於圖16所示的動作的動作。解碼裝置200對應於圖16所示的動作而進行的動作,能根據圖16來說明。For example, the decoding device 200 performs an operation corresponding to the operation shown in FIG. The operation performed by the decoding device 200 in response to the operation shown in FIG. 16 can be described with reference to FIG. 16.

首先,解碼裝置200判定是否進行PPS處理(S501)。例如,熵解碼部202判定是否將PPS解碼。熵解碼部202也可按照編碼流,來判定是否將PPS解碼。具體來說,熵解碼部202也可在編碼流中PPS已被編碼時,判定將PPS解碼。First, the decoding device 200 determines whether or not the PPS processing is performed (S501). For example, the entropy decoding unit 202 determines whether or not to decode the PPS. The entropy decoding unit 202 may determine whether or not to decode the PPS in accordance with the encoded stream. Specifically, the entropy decoding unit 202 may determine to decode the PPS when the PPS has been encoded in the encoded stream.

解碼裝置200在判定為進行PPS處理時(在S501,是),進行PPS處理(S502)。例如,當已判定為將PPS解碼時,熵解碼部202將PPS解碼。另一方面,在已判定為不進行PPS處理時(在S501,否),解碼裝置200略過PPS處理。When it is determined that the PPS processing is performed (YES in S501), the decoding device 200 performs PPS processing (S502). For example, when it is determined that the PPS is decoded, the entropy decoding unit 202 decodes the PPS. On the other hand, when it is determined that the PPS processing is not performed (NO in S501), the decoding device 200 skips the PPS processing.

其次,解碼裝置200取得NAL單元類型(S503)。例如熵解碼部202取得解碼對象圖片的NAL單元類型。更具體來說,熵解碼部202取得解碼對象圖片中的解碼對象切片的NAL單元類型。解碼對象圖片中的解碼對象切片的NAL單元類型對應於解碼對象圖片的類別。Next, the decoding device 200 acquires the NAL unit type (S503). For example, the entropy decoding unit 202 acquires the NAL unit type of the decoding target picture. More specifically, the entropy decoding unit 202 acquires the NAL unit type of the decoding target slice in the decoding target picture. The NAL unit type of the decoding target slice in the decoding target picture corresponds to the category of the decoding target picture.

接著,解碼裝置200判定解碼對象圖片是否為IDR圖片(S504)。例如,濾波控制部231按照解碼對象圖片的NAL單元類型,判定解碼對象圖片是否為IDR圖片。Next, the decoding device 200 determines whether or not the decoding target picture is an IDR picture (S504). For example, the filter control unit 231 determines whether or not the decoding target picture is an IDR picture in accordance with the NAL unit type of the decoding target picture.

在已判定解碼對象圖片為IDR圖片時(在S504,是),解碼裝置200刪除已保存的濾波資訊(S505)。例如,濾波控制部231刪除參考濾波資訊記憶部233所保存的複數個濾波資訊組合。When it is determined that the decoding target picture is an IDR picture (Yes in S504), the decoding apparatus 200 deletes the saved filter information (S505). For example, the filter control unit 231 deletes a plurality of filter information combinations held by the reference filter information storage unit 233.

在已判定解碼對象圖片不是IDR圖片時(在S504,否),解碼裝置200判定PPS處理(S502)是否已進行 (S506)。例如濾波控制部231判定PPS是否已解碼。When it is determined that the decoding target picture is not an IDR picture (NO in S504), the decoding apparatus 200 determines whether or not the PPS processing (S502) has been performed (S506). For example, the filter control unit 231 determines whether or not the PPS has been decoded.

然後,在判定PPS處理(S502)已進行時(在S506,是),解碼裝置200根據PPS處理(S502)中的PPS,保存濾波資訊(S507)。另一方面,在判定PPS處理(S502)未進行時(在S506,否),解碼裝置200略過保存濾波資訊的處理(S507)。Then, when it is determined that the PPS processing (S502) has been performed (Yes in S506), the decoding apparatus 200 saves the filter information based on the PPS in the PPS processing (S502) (S507). On the other hand, when it is determined that the PPS processing (S502) is not performed (NO in S506), the decoding apparatus 200 skips the process of storing the filter information (S507).

又,在已判定解碼對象圖片為IDR圖片時(在S504,是),假設已進行PPS處理(S502)。因此,解碼裝置200,此時,在刪除濾波資訊之後,不進行是否已進行PPS處理的判定,而是根據PPS處理(S502)中的PPS,保存濾波資訊。When it is determined that the decoding target picture is an IDR picture (Yes in S504), it is assumed that PPS processing has been performed (S502). Therefore, the decoding apparatus 200, at this time, does not perform the determination as to whether or not the PPS processing has been performed after deleting the filter information, but saves the filter information based on the PPS in the PPS processing (S502).

例如,濾波控制部231根據在PPS處理(S502)中已被解碼的PPS所含的濾波控制資訊,特定出濾波資訊組合,將已特定的濾波資訊組合保存在參考濾波資訊記憶部233。又,濾波控制部231將已根據PPS所含的濾波控制資訊來特定出的濾波資訊組合關聯至PPS的圖片參數組合ID而管理。即,濾波資訊組合被關聯至圖片參數組合ID並被保存。For example, the filter control unit 231 specifies the filter information combination based on the filter control information included in the PPS that has been decoded in the PPS process (S502), and stores the specific filter information in the reference filter information storage unit 233. Further, the filter control unit 231 manages the filter information combination specified based on the filter control information included in the PPS to the picture parameter combination ID of the PPS. That is, the filtered information combination is associated to the picture parameter combination ID and saved.

又,要處理複數個PPS時,針對複數個PPS的每個,根據前述PPS的濾波控制資訊,特定出對應於前述PPS之濾波資訊組合,並保存之。藉此,例如,分別對應於連續***的複數個PPS之複數個濾波資訊組合被特定出來並予以保存。Moreover, when a plurality of PPSs are to be processed, for each of the plurality of PPSs, the filter information combination corresponding to the PPS is specified and stored according to the filtering control information of the PPS. Thereby, for example, a plurality of filter information combinations respectively corresponding to a plurality of consecutively inserted PPSs are specified and saved.

其次,解碼裝置200取得切片標頭的圖片參數組合ID(S508)。即,濾波控制部231取得解碼對象切片的切片標頭所含的圖片參數組合ID。Next, the decoding device 200 acquires the picture parameter combination ID of the slice header (S508). In other words, the filter control unit 231 acquires the picture parameter combination ID included in the slice header of the decoding target slice.

接著,解碼裝置200根據圖片參數組合ID,設定濾波資訊(S509)。例如,濾波控制部231從參考濾波資訊記憶部233所保存的複數個濾波資訊組合之中,選擇有關聯於切片標頭的圖片參數組合ID之濾波資訊組合。然後,濾波控制部231將已選擇的濾波資訊組合保存在當前濾波資訊記憶部232,藉此設定濾波資訊組合。Next, the decoding device 200 sets the filter information based on the picture parameter combination ID (S509). For example, the filter control unit 231 selects a filter information combination having a picture parameter combination ID associated with the slice header from among a plurality of filter information combinations held by the reference filter information storage unit 233. Then, the filter control unit 231 stores the selected filter information combination in the current filter information storage unit 232, thereby setting the filter information combination.

在這之後,進行對於CU之處理的迴路(S510)。即,解碼裝置200對每CU進行解碼處理。此時,解碼裝置200適用自適應迴路濾波。After that, a loop for processing the CU is performed (S510). That is, the decoding device 200 performs decoding processing for each CU. At this time, the decoding device 200 is adapted to adaptive loop filtering.

解碼裝置200藉由進行上述之動作,可將基於PPS的濾波控制資訊的濾波資訊組合保存在參考濾波資訊記憶部233。又,解碼裝置200可從參考濾波資訊記憶部233中的複數個濾波資訊組合之中,特定出基於切片標頭的圖片參數組合ID之濾波資訊組合。然後,解碼裝置200可將已特定的濾波資訊組合設定在當前濾波資訊記憶部232。By performing the above-described operations, the decoding device 200 can store the filter information combination of the PPS-based filter control information in the reference filter information storage unit 233. Further, the decoding device 200 can specify a filter information combination based on the slice parameter combination ID of the slice header from among the plurality of filter information combinations in the reference filter information storage unit 233. Then, the decoding device 200 can set the specific filter information combination to the current filter information storage unit 232.

又,解碼裝置200也可進行對應於圖17所示的動作的動作。對應於圖17所示的動作而可藉解碼裝置200所進行的動作,可根據圖17來說明。Further, the decoding device 200 can also perform an operation corresponding to the operation shown in FIG. The operation that can be performed by the decoding device 200 in accordance with the operation shown in FIG. 17 can be explained based on FIG.

首先,與圖16所示的處理(S501)同樣,解碼裝置200判定是否進行PPS處理(S601)。解碼裝置200在已判定為進行PPS處理時(在S601,是),與圖16所示的處理(S502)同樣,進行PPS處理(S602)。另一方面,在已判定為不進行PPS處理時(在S601,否),解碼裝置200略過PPS處理。First, similarly to the processing (S501) shown in FIG. 16, the decoding apparatus 200 determines whether or not the PPS processing is performed (S601). When it is determined that the PPS processing is performed (YES in S601), the decoding device 200 performs PPS processing (S602) in the same manner as the processing (S502) shown in FIG. On the other hand, when it is determined that the PPS processing is not performed (NO at S601), the decoding device 200 skips the PPS processing.

接著,解碼裝置200進行切片標頭的處理(S603)。例如熵解碼部202解析解碼對象之當前切片的切片標頭並將之解碼。Next, the decoding device 200 performs processing of a slice header (S603). For example, the entropy decoding unit 202 analyzes and decodes the slice header of the current slice of the decoding target.

其次,解碼裝置200進行濾波控制資訊的處理(S604)。例如,熵解碼部202將濾波控制資訊解碼,濾波控制部231取得已解碼的濾波控制資訊。Next, the decoding device 200 performs processing of filtering control information (S604). For example, the entropy decoding unit 202 decodes the filter control information, and the filter control unit 231 acquires the decoded filter control information.

濾波控制資訊也可包含在PPS。因此,濾波控制資訊的處理(S604)也可包含在PPS處理(S602)。又,在切片標頭的處理(S603)中,也可將含有PPS的圖片參數組合ID的切片標頭解碼,前述PPS含有對應於當前切片的濾波控制資訊。Filter control information can also be included in the PPS. Therefore, the processing of the filter control information (S604) may also be included in the PPS processing (S602). Further, in the processing of the slice header (S603), the slice header of the picture parameter combination ID including the PPS may be decoded, and the PPS may contain filter control information corresponding to the current slice.

然後,進行對於CU之處理的迴路(S605)。即,解碼裝置200對每CU進行解碼處理。Then, a loop for processing the CU is performed (S605). That is, the decoding device 200 performs decoding processing for each CU.

其次,與圖16所示的處理(S503)同樣,解碼裝置200取得NAL單元類型(S606)。接著,與圖16所示的處理(S504)同樣,解碼裝置200判定解碼對象圖片是否為IDR圖片(S607)。Next, similarly to the processing (S503) shown in Fig. 16, the decoding device 200 acquires the NAL unit type (S606). Next, similarly to the processing (S504) shown in FIG. 16, the decoding device 200 determines whether or not the decoding target picture is an IDR picture (S607).

在已判定解碼對象圖片為IDR圖片時(在S607,是),與圖16所示的處理(S505)同樣,解碼裝置200刪除已保存的濾波資訊(S608)。When it is determined that the decoding target picture is an IDR picture (Yes in S607), similarly to the processing (S505) shown in FIG. 16, the decoding apparatus 200 deletes the saved filter information (S608).

在已判定解碼對象圖片不是IDR圖片時(在S607,否),與圖16所示的處理(S506)同樣,解碼裝置200判定PPS處理(S602)是否已進行(S609)。When it is determined that the decoding target picture is not an IDR picture (NO in S607), similarly to the processing (S506) shown in FIG. 16, the decoding apparatus 200 determines whether or not the PPS processing (S602) has been performed (S609).

然後,在判定PPS處理(S602)已進行時(在S609,是),解碼裝置200根據PPS處理(S602)中的PPS,設定濾波資訊,並保存之(S610)。Then, when it is determined that the PPS processing (S602) has been performed (Yes in S609), the decoding apparatus 200 sets the filtering information based on the PPS in the PPS processing (S602), and stores it (S610).

又,在已判定解碼對象圖片為IDR圖片時(在S607,是),假設已進行PPS處理(S602)。因此,解碼裝置200,此時,在刪除濾波資訊之後,不進行是否已進行PPS處理的判定,而是根據PPS處理(S602)中的PPS,設定濾波資訊,並保存之(S610)。When it is determined that the decoding target picture is an IDR picture (Yes in S607), it is assumed that PPS processing has been performed (S602). Therefore, the decoding apparatus 200, at this time, does not perform the determination as to whether or not the PPS processing has been performed after deleting the filter information, but sets the filter information based on the PPS in the PPS processing (S602) and stores it (S610).

例如,濾波控制部231根據在PPS處理(S602)中已被解碼的PPS所含的濾波控制資訊,特定出濾波資訊組合。然後,濾波控制部231將已特定的濾波資訊組合保存在當前濾波資訊記憶部232及參考濾波資訊記憶部233的每個。For example, the filter control unit 231 specifies the filter information combination based on the filter control information included in the PPS that has been decoded in the PPS process (S602). Then, the filter control unit 231 stores the specific filter information combination in each of the current filter information storage unit 232 and the reference filter information storage unit 233.

又,濾波控制部231在參考濾波資訊記憶部233中,將根據PPS所含的濾波控制資訊來特定出的濾波資訊組合,關聯至PPS的圖片參數組合ID而管理。即,濾波資訊組合是關聯至圖片參數組合ID並被保存。Further, the filter control unit 231 associates the filter information specified based on the filter control information included in the PPS with the picture parameter combination ID of the PPS and manages it in the reference filter information storage unit 233. That is, the filtered information combination is associated with the picture parameter combination ID and saved.

又,要處理複數個PPS時,針對複數個PPS的每個,根據前述PPS的濾波控制資訊,特定出對應於前述PPS之濾波資訊組合,並保存之。藉此,例如,分別對應於連續***的複數個PPS之複數個濾波資訊組合被特定出來並予以保存。Moreover, when a plurality of PPSs are to be processed, for each of the plurality of PPSs, the filter information combination corresponding to the PPS is specified and stored according to the filtering control information of the PPS. Thereby, for example, a plurality of filter information combinations respectively corresponding to a plurality of consecutively inserted PPSs are specified and saved.

另一方面,在判定PPS處理(S602)未進行時(在S609,否),與圖16所示的處理(S508)同樣,解碼裝置200取得切片標頭的圖片參數組合ID(S611)。其次,與圖16所示的處理(S509)同樣,解碼裝置200根據圖片參數組合ID,設定濾波資訊(S612)。On the other hand, when it is determined that the PPS processing (S602) is not performed (NO in S609), the decoding apparatus 200 acquires the picture parameter combination ID of the slice header as in the processing (S508) shown in FIG. 16 (S611). Next, similarly to the processing (S509) shown in Fig. 16, the decoding device 200 sets the filter information based on the picture parameter combination ID (S612).

然後,解碼裝置200適用自適應迴路濾波(S613)。具體來說,適應濾波部234使用已保存在當前濾波資訊記憶部232的濾波資訊組合,對於當前切片適用自適應迴路濾波。Then, the decoding device 200 applies adaptive loop filtering (S613). Specifically, the adaptive filter unit 234 uses the filtered information combination that has been stored in the current filtered information storage unit 232, and applies adaptive loop filtering to the current slice.

解碼裝置200藉由進行上述之動作,可在進行了CU的處理之後,設定濾波資訊,適用自適應迴路濾波。依此,解碼裝置200可在設定濾波資訊之前,適當地產生再現圖。因此,解碼裝置200可根據輸入圖及再現圖,設定濾波資訊。By performing the above-described operations, the decoding device 200 can set the filter information after the CU is processed, and adaptive loop filtering can be applied. Accordingly, the decoding device 200 can appropriately generate a reproduction map before setting the filter information. Therefore, the decoding device 200 can set the filter information based on the input map and the reproduction map.

另,也可不將根據輸入圖及再現圖所設定的濾波資訊追加到PPS,而是追加到切片資料。然後,濾波控制資訊也可顯示使用了已追加到切片資料的濾波資訊之情形。熵解碼部202也可將如此的濾波資訊及濾波控制資訊解碼。
[PPS通知]
Further, the filter information set based on the input map and the reproduction map may not be added to the PPS, but may be added to the slice data. Then, the filter control information can also display the case where the filter information added to the slice data is used. The entropy decoding unit 202 can also decode such filtering information and filtering control information.
[PPS notification]

例如,含有濾波控制資訊的PPS是從編碼裝置100通知到解碼裝置200。即,編碼裝置100的熵編碼部110將含有濾波控制資訊的PPS編碼,解碼裝置200的熵解碼部202將含有濾波控制資訊的PPS解碼。依此,濾波控制資訊得以在編碼裝置100與解碼裝置200之間共有。For example, the PPS containing the filter control information is notified from the encoding device 100 to the decoding device 200. That is, the entropy encoding unit 110 of the encoding device 100 encodes the PPS including the filter control information, and the entropy decoding unit 202 of the decoding device 200 decodes the PPS including the filter control information. Accordingly, the filter control information is shared between the encoding device 100 and the decoding device 200.

又,動態圖像所含的複數張圖片有分別被分配顯示有關於時間可調性的階層之暫時ID的情形。進而,PPS也有被分配顯示有關於時間可調性的階層之暫時ID的情形。Further, in the plurality of pictures included in the moving image, there are cases in which the temporary ID of the hierarchy relating to the time adjustability is assigned. Further, the PPS may also be assigned a temporary ID indicating a hierarchy of time adjustability.

又,例如也可為:複數個PPS分別對應於有關於時間可調性的複數個階層,且複數個PPS的每個為相對於屬於前述PPS所對應的階層之1張以上的圖片之PPS。換言之,複數個PPS針對被分配於複數張圖片的複數個暫時ID的每個,也可以相對於被分配前述暫時ID的1張以上的圖片之PPS所構成。Further, for example, the plurality of PPSs may correspond to a plurality of levels having time adjustability, and each of the plurality of PPSs is a PPS of one or more pictures belonging to the level corresponding to the PPS. In other words, each of the plurality of PPSs for the plurality of temporary IDs assigned to the plurality of pictures may be configured with respect to the PPS of one or more pictures to which the temporary ID is assigned.

在此,相對於1張以上的圖片之PPS意指:適用於1張以上的圖片之共通的PPS。又,對應於階層的PPS意指:相對於屬於前述階層的1張以上的圖片之PPS,即,相對於被分配有顯示前述階層的暫時ID的1張以上的圖片之PPS。即,在此,PPS對應於階層意指:PPS為適用於被分配有顯示前述階層的暫時ID的1張以上的圖片之共通的PPS。Here, the PPS with respect to one or more pictures means a PPS that is common to one or more pictures. Further, the PPS corresponding to the hierarchy means a PPS with respect to one or more pictures belonging to the above-described hierarchy, that is, a PPS to which one or more pictures in which the temporary ID of the above-described hierarchy is assigned are allocated. In other words, the PPS corresponds to the hierarchy means that the PPS is a common PPS that is applied to one or more pictures to which the temporary ID indicating the above-described hierarchy is assigned.

另,PPS對應的階層也可與被分配給PPS的暫時ID所顯示的階層相異。該等階層可被決定為相互獨立而無關。又,PPS對應的階層也可表現為與PPS有關係的階層。In addition, the hierarchy corresponding to the PPS may be different from the hierarchy displayed by the temporary ID assigned to the PPS. These classes can be determined to be independent of each other. Further, the hierarchy corresponding to the PPS can also be expressed as a hierarchy related to the PPS.

又,例如,PPS與PPS所對應的階層是藉屬於前述階層的圖片內的切片的切片標頭所含的圖片參數組合ID來賦予對應。基本上,在圖片內的切片的切片標頭中,含有對應於前述圖片所屬的階層之PPS的圖片參數組合ID。Further, for example, the hierarchy corresponding to the PPS and the PPS is assigned by the picture parameter combination ID included in the slice header of the slice in the picture of the above-mentioned hierarchy. Basically, the slice header of the slice in the picture contains the picture parameter combination ID corresponding to the PPS of the hierarchy to which the picture belongs.

以下,說明有關於濾波資訊的處理方法的變形態樣中的PPS通知之複數個具體例。Hereinafter, a plurality of specific examples of the PPS notification in the modified form of the processing method of the filter information will be described.

圖18是顯示變形態樣之PPS通知的第1具體例的概念圖。在圖18中,和圖14A同樣,顯示有圖片p0至p8。圖18的例子中的圖片p0至p8的編碼順序,及被分配於圖片p0至p8每個的暫時ID,和圖14A的例子相同。Fig. 18 is a conceptual diagram showing a first specific example of a PPS notification of a modified form. In Fig. 18, as in Fig. 14A, pictures p0 to p8 are displayed. The encoding order of the pictures p0 to p8 in the example of Fig. 18 and the temporary ID assigned to each of the pictures p0 to p8 are the same as the example of Fig. 14A.

並且,圖18顯示著PPS0至PPS3。在此,PPSx為在暫時層x所參考的PPS。又,在此,x為暫時ID,暫時層x含有被分配x來作為暫時ID的圖片。具體來說,PPS0為在暫時層0所參考的PPS。也就是說,PPS0為相對於被分配0來作為暫時ID的圖片之PPS。Also, Fig. 18 shows PPS0 to PPS3. Here, PPSx is the PPS referenced in the temporary layer x. Here, x is a temporary ID, and the temporary layer x includes a picture to which x is assigned as a temporary ID. Specifically, PPS0 is the PPS referenced in the temporary layer 0. That is to say, PPS0 is a PPS with respect to a picture to which 0 is assigned as a temporary ID.

同樣,PPS1為在暫時層1所參考的PPS。也就是說,PPS1是相對於被分配1來作為暫時ID的圖片之PPS。同樣,PPS2是在暫時層2所參考的PPS。也就是說,PPS2是相對於被分配2來作為暫時ID的圖片之PPS。同樣,PPS3是在暫時層3所參考的PPS。也就是說,PPS3是相對於被分配3來作為暫時ID的圖片之PPS。Similarly, PPS1 is the PPS referenced in the temporary layer 1. That is to say, PPS1 is a PPS with respect to a picture to which 1 is assigned as a temporary ID. Similarly, PPS2 is the PPS referenced in the temporary layer 2. That is to say, PPS2 is a PPS with respect to a picture assigned as 2 as a temporary ID. Similarly, PPS3 is the PPS referenced in the temporary layer 3. That is to say, PPS3 is a PPS with respect to a picture to which 3 is assigned as a temporary ID.

在圖18中,對PPSx分配x來作為暫時ID。具體來說,對PPS0分配0來作為暫時ID。同樣,對PPS1分配1來作為暫時ID,對PPS2分配2來作為暫時ID,對PPS3分配3來作為暫時ID。In Fig. 18, x is assigned to PPSx as a temporary ID. Specifically, 0 is assigned to PPS0 as a temporary ID. Similarly, PPS1 is assigned 1 as a temporary ID, PPS2 is assigned 2 as a temporary ID, and PPS3 is assigned 3 as a temporary ID.

又,在圖18中,編碼裝置100在將圖片p0至p8編碼之前,將PPS0至PPS3編碼。接著,編碼裝置100按照PPS0而將圖片p0及p1編碼。又,編碼裝置100按照PPS1而將圖片p2編碼。又,編碼裝置100按照PPS2而將圖片p3及p6編碼。又,編碼裝置100按照PPS3而將圖片p4、p5、p7及p8編碼。Further, in Fig. 18, the encoding apparatus 100 encodes PPS0 to PPS3 before encoding the pictures p0 to p8. Next, the encoding device 100 encodes the pictures p0 and p1 in accordance with PPS0. Further, the encoding device 100 encodes the picture p2 in accordance with PPS1. Further, the encoding device 100 encodes the pictures p3 and p6 in accordance with PPS2. Further, the encoding device 100 encodes the pictures p4, p5, p7, and p8 in accordance with PPS3.

同樣,解碼裝置200在將圖片p0至p8解碼之前,將PPS0至PPS3解碼。接著,解碼裝置200按照PPS0而將圖片p0及p1解碼。又,解碼裝置200按照PPS1而將圖片p2解碼。又,解碼裝置200按照PPS2而將圖片p3及p6解碼。又,解碼裝置200按照PPS3而將圖片p4、p5、p7及p8解碼。Also, the decoding device 200 decodes PPS0 to PPS3 before decoding the pictures p0 to p8. Next, the decoding device 200 decodes the pictures p0 and p1 in accordance with PPS0. Further, the decoding device 200 decodes the picture p2 in accordance with PPS1. Further, the decoding device 200 decodes the pictures p3 and p6 in accordance with the PPS 2. Further, the decoding device 200 decodes the pictures p4, p5, p7, and p8 in accordance with PPS3.

又,解碼裝置200也可只將一部分圖片解碼,前述一部分圖片在圖片p0至p8之中暫時ID為規定值以下。例如,在前述規定值為1時,解碼裝置200按照PPS0,將圖片p0及p1解碼,按照PPS1,將圖片p2解碼。Further, the decoding device 200 may decode only a part of the picture, and the partial picture may have a temporary ID equal to or less than a predetermined value among the pictures p0 to p8. For example, when the predetermined value is 1, the decoding device 200 decodes the pictures p0 and p1 in accordance with PPS0, and decodes the picture p2 in accordance with PPS1.

例如,在解碼裝置200只將一部分圖片解碼,且前述一部分圖片在圖片p0至p8之中暫時ID為規定值以下時,不解碼而廢棄圖片p0至p8之中暫時ID較規定值大的圖片。此時,解碼裝置200也有可能不解碼而廢棄暫時ID較規定值大的PPS。由於有可能像這樣不解碼而廢棄暫時ID大的PPS,因此,適當的向上切換是有困難的。For example, when only a part of the picture is decoded by the decoding device 200, and the temporary picture ID is equal to or less than the predetermined value among the pictures p0 to p8, the picture in which the temporary ID is larger than the predetermined value among the pictures p0 to p8 is discarded without decoding. At this time, the decoding device 200 may discard the PPS whose temporary ID is larger than the predetermined value without decoding. Since it is possible to discard the PPS having a large temporary ID without decoding as such, it is difficult to appropriately switch up.

例如,在只將圖片p0至p8之中暫時ID為1以下之圖片p0至p2解碼時,解碼裝置200也可將PPS0及PPS1解碼,且不解碼而廢棄PP2及PPS3。另一方面,在如此的狀態下,要在圖片p2之解碼之後將圖片p6解碼的向上切換是有困難的。即,在圖18的例子中,適當的向上切換是有困難的。For example, when only the pictures p0 to p2 whose temporary ID is 1 or less among the pictures p0 to p8 are decoded, the decoding device 200 may decode PPS0 and PPS1 and discard PP2 and PPS3 without decoding. On the other hand, in such a state, it is difficult to switch the upward decoding of the picture p6 after the decoding of the picture p2. That is, in the example of Fig. 18, it is difficult to appropriately switch up.

圖19是顯示變形態樣之PPS通知的第2具體例的概念圖。在圖19中,和圖18同樣,顯示有圖片p0至p8。圖19的例子中的圖片p0至p8的編碼順序,及被分配於圖片p0至p8的每個的暫時ID和圖18的例子相同。並且,圖19顯示著PPS0至PPS3。在此,與圖18之例同樣,PPSx為在暫時層x所參考的PPS。Fig. 19 is a conceptual diagram showing a second specific example of the PPS notification of the modified form. In Fig. 19, as in Fig. 18, pictures p0 to p8 are displayed. The encoding order of the pictures p0 to p8 in the example of Fig. 19 and the temporary ID assigned to each of the pictures p0 to p8 are the same as those of the example of Fig. 18. Also, Fig. 19 shows PPS0 to PPS3. Here, as in the example of FIG. 18, PPSx is the PPS referenced in the temporary layer x.

在圖19的例子中,對PPS0至PPS3的每個分配0來作為暫時ID。In the example of Fig. 19, 0 is assigned to each of PPS0 to PPS3 as a temporary ID.

又,在圖19中,與圖18的例子同樣,編碼裝置100在將圖片p0至p8編碼之前,將PPS0至PPS3編碼。接著,編碼裝置100按照PPS0而將圖片p0及p1編碼,按照PPS1而將圖片p2編碼,按照PPS2而將圖片p3及p6編碼,按照PPS3而將圖片p4、p5、p7及p8編碼。Further, in Fig. 19, similarly to the example of Fig. 18, the encoding apparatus 100 encodes PPS0 to PPS3 before encoding the pictures p0 to p8. Next, the encoding apparatus 100 encodes the pictures p0 and p1 in accordance with PPS0, encodes the picture p2 in accordance with PPS1, encodes pictures p3 and p6 in accordance with PPS2, and encodes pictures p4, p5, p7, and p8 in accordance with PPS3.

同樣,解碼裝置200在將圖片p0至p8解碼之前,將PPS0至PPS3解碼。接著,解碼裝置200按照PPS0而將圖片p0及p1解碼,按照PPS1而將圖片p2解碼,按照PPS2而將圖片p3及p6解碼,按照PPS3而將圖片p4、p5、p7及p8解碼。Also, the decoding device 200 decodes PPS0 to PPS3 before decoding the pictures p0 to p8. Next, the decoding device 200 decodes the pictures p0 and p1 in accordance with PPS0, decodes the picture p2 in accordance with PPS1, decodes pictures p3 and p6 in accordance with PPS2, and decodes pictures p4, p5, p7, and p8 in accordance with PPS3.

又,解碼裝置200也可只將一部分圖片解碼,前述一部分圖片在圖片p0至p8之中暫時ID為規定值以下。例如,在前述規定值為1時,解碼裝置200按照PPS0而將圖片p0及p1解碼,按照PPS1而將圖片p2解碼。Further, the decoding device 200 may decode only a part of the picture, and the partial picture may have a temporary ID equal to or less than a predetermined value among the pictures p0 to p8. For example, when the predetermined value is 1, the decoding device 200 decodes the pictures p0 and p1 in accordance with PPS0, and decodes the picture p2 in accordance with PPS1.

又,例如,在解碼裝置200只將一部分圖片解碼,且前述一部分圖片在圖片p0至p8之中暫時ID為規定值以下時,不解碼而廢棄圖片p0至p8之中暫時ID較規定值大的圖片。即使在此時,解碼裝置200也將暫時ID為0之PPS0至PPS3解碼。因此,能做到適當的向上切換。Further, for example, when only a part of the picture is decoded by the decoding device 200, and the temporary picture ID is equal to or smaller than the predetermined value among the pictures p0 to p8, the temporary ID of the pictures p0 to p8 is discarded from the predetermined value without being decoded. image. Even at this time, the decoding device 200 decodes PPS0 to PPS3 whose temporary ID is 0. Therefore, an appropriate upward switching can be achieved.

具體來說,例如即使在只將圖片p0至p8之中暫時ID為1以下之圖片p0至p2解碼時,解碼裝置200仍將PPS0至PPS3解碼。因此,在圖片p2的解碼之後,可按照PPS2將圖片p6解碼。即,在圖19的例子中,可做到適當的向上切換。Specifically, for example, even when only the pictures p0 to p2 whose temporary ID is 1 or less among the pictures p0 to p8 are decoded, the decoding device 200 decodes PPS0 to PPS3. Therefore, after decoding of picture p2, picture p6 can be decoded in accordance with PPS2. That is, in the example of Fig. 19, an appropriate upward switching can be achieved.

圖20A是顯示變形態樣之PPS通知的第3具體例的概念圖。在圖20A中,和圖18同樣,顯示有圖片p0至p8。圖20A的例子中的圖片p0至p8的編碼順序,及被分配於圖片p0至p8的每個的暫時ID和圖18的例子相同。並且,圖20A顯示著PPS0至PPS3。在此,與圖18的例子同樣,PPSx為在暫時層x所參考的PPS。Fig. 20A is a conceptual diagram showing a third specific example of the PPS notification of the modified form. In Fig. 20A, as in Fig. 18, pictures p0 to p8 are displayed. The encoding order of the pictures p0 to p8 in the example of Fig. 20A and the temporary ID assigned to each of the pictures p0 to p8 are the same as those of the example of Fig. 18. Also, Fig. 20A shows PPS0 to PPS3. Here, as in the example of FIG. 18, PPSx is the PPS referenced in the temporary layer x.

又,在圖20A的例子中,和圖18的例子同樣,在圖片p0至p8編碼之前,編碼裝置100將PPS0至PPS3編碼。對此時被編碼的PPSx分配x來作為暫時ID。具體來說,對PPS0分配0來作為暫時ID。同樣,對PPS1分配1來作為暫時ID,對PPS2分配2來作為暫時ID,對PPS3分配3來作為暫時ID。Further, in the example of Fig. 20A, as in the example of Fig. 18, the encoding apparatus 100 encodes PPS0 to PPS3 before the pictures p0 to p8 are encoded. In this case, the encoded PPSx allocates x as the temporary ID. Specifically, 0 is assigned to PPS0 as a temporary ID. Similarly, PPS1 is assigned 1 as a temporary ID, PPS2 is assigned 2 as a temporary ID, and PPS3 is assigned 3 as a temporary ID.

然後,編碼裝置100按照PPS0,將圖片p0及p1編碼,按照PPS1,將圖片p2編碼,按照PPS2,將圖片p3及p6編碼,按照PPS3,將圖片p4、p5、p7及p8編碼。Then, the encoding apparatus 100 encodes the pictures p0 and p1 in accordance with PPS0, encodes the picture p2 in accordance with PPS1, encodes pictures p3 and p6 in accordance with PPS2, and encodes pictures p4, p5, p7, and p8 in accordance with PPS3.

又,在圖20A的例子中,在TSA圖片的編碼之前,編碼裝置100將1個以上的PPS編碼,前述1個以上的PPS在被分配於TSA圖片的暫時ID以上之1個以上的暫時層被參考。對此時被編碼的1個以上的PPS也可分配暫時ID,前述暫時ID與分配於TSA圖片的暫時ID相同。Further, in the example of FIG. 20A, before the encoding of the TSA picture, the encoding apparatus 100 encodes one or more PPSs, and the one or more PPSs are allocated to one or more temporary layers of the temporary ID of the TSA picture or more. Referenced. A temporary ID may be assigned to one or more PPSs encoded in this case, and the temporary ID is the same as the temporary ID assigned to the TSA picture.

具體來說,在圖20A的例子中,被分配2來作為暫時ID之圖片p6為TSA圖片。此時,編碼裝置100在圖片p6之編碼之前,將在暫時層2及暫時層3分別參考的PPS2及PPS3編碼。對此時被編碼的PPS2及PPS3也可分配2來作為暫時ID。Specifically, in the example of FIG. 20A, the picture p6 assigned as the temporary ID is a TSA picture. At this time, the encoding device 100 encodes the PPS 2 and the PPS 3 which are referred to in the temporary layer 2 and the temporary layer 3, respectively, before the encoding of the picture p6. PPS2 and PPS3 encoded at this time can also be assigned 2 as a temporary ID.

同樣,解碼裝置200在將圖片p0至p8解碼之前,將PPS0至PPS3解碼。對此時被解碼的PPSx分配x來作為暫時ID。然後,解碼裝置200按照PPS0而將圖片p0及p1解碼,按照PPS1而將圖片p2解碼,按照PPS2而將圖片p3及p6解碼,按照PPS3而將圖片p4、p5、p7及p8解碼。Also, the decoding device 200 decodes PPS0 to PPS3 before decoding the pictures p0 to p8. The PPSx that is decoded at this time allocates x as a temporary ID. Then, the decoding device 200 decodes the pictures p0 and p1 in accordance with PPS0, decodes the picture p2 in accordance with PPS1, decodes pictures p3 and p6 in accordance with PPS2, and decodes pictures p4, p5, p7, and p8 in accordance with PPS3.

又,解碼裝置200在TSA圖片之解碼之前,將1個以上的PPS解碼,前述1個以上的PPS是在被分配於TSA圖片的暫時ID以上之1個以上的暫時層被參考。對此時被解碼的1個以上的PPS也可分配暫時ID,前述暫時ID與被分配於TSA圖片的暫時ID相同。Further, the decoding device 200 decodes one or more PPSs before decoding the TSA picture, and the one or more PPSs are referred to one or more temporary layers assigned to the temporary ID of the TSA picture. The temporary ID may be assigned to one or more PPSs decoded at this time, and the temporary ID is the same as the temporary ID assigned to the TSA picture.

具體來說,在圖20A的例子中,被分配2來作為暫時ID之圖片p6為TSA圖片。因此,解碼裝置200在圖片p6之解碼之前,將在暫時層2及暫時層3分別參考的PPS2及PPS3解碼。對此時被解碼的PPS2及PPS3也可分配2來作為暫時ID。Specifically, in the example of FIG. 20A, the picture p6 assigned as the temporary ID is a TSA picture. Therefore, the decoding device 200 decodes the PPS 2 and the PPS 3 respectively referred to in the temporary layer 2 and the temporary layer 3 before the decoding of the picture p6. PPS2 and PPS3 which are decoded at this time can also be assigned 2 as a temporary ID.

例如,解碼裝置200為了只將圖片p0至p8之中暫時ID為1以下的圖片p0至p2解碼,在圖片p0之解碼之前,也可只將PPS0至PPS3之中PPS0及PPS1解碼。然後,解碼裝置200在圖片p0之解碼之前,也可不解碼而廢棄PPS0至PPS3之中PPS2及PPS3。For example, in order to decode only the pictures p0 to p2 in which the temporary ID is 1 or less among the pictures p0 to p8, the decoding device 200 may decode only PPS0 and PPS1 among the PPS0 to PPS3 before the decoding of the picture p0. Then, the decoding device 200 may discard PPS2 and PPS3 among PPS0 to PPS3 without decoding before decoding the picture p0.

在這之後,解碼裝置200為了將暫時層2的TSA圖片即圖片p6解碼,而將在暫時層2所參考的PPS2解碼。進而,解碼裝置200將在暫時層3所參考的PPS3解碼。After that, the decoding device 200 decodes the PPS 2 referenced by the temporary layer 2 in order to decode the picture P6 which is the TSA picture of the temporary layer 2. Further, the decoding device 200 decodes the PPS 3 referenced by the temporary layer 3.

依此,解碼裝置200可在圖片p2之後,按照PPS2將圖片p6解碼,且可按照PP3,將暫時ID為3之圖片p7及p8解碼。Accordingly, the decoding device 200 can decode the picture p6 according to the PPS 2 after the picture p2, and can decode the pictures p7 and p8 with the temporary ID 3 according to PP3.

即,解碼裝置200在將TSA圖片解碼時,可按照TSA圖片,適當地進行已被容許的向上切換。That is, when decoding the TSA picture, the decoding device 200 can appropriately perform the upward switching that is allowed in accordance with the TSA picture.

另,在從低的暫時層轉移到高的暫時層的向上切換之中,對應於高的暫時層的圖片及PPS被解碼的可能性高。因此,對在TSA圖片之前被處理的PPS也可分配前述PPS所參考之暫時層的暫時ID。In addition, in the upward switching from the low temporary layer to the high temporary layer, the picture and the PPS corresponding to the high temporary layer are highly likely to be decoded. Therefore, the temporary ID of the temporary layer referenced by the aforementioned PPS can also be allocated to the PPS processed before the TSA picture.

例如在圖20A的例子中,也可針對在圖片p6之前被處理的PPS2及PP3,對PPS2分配2來作為暫時ID,對PPS3分配3來作為暫時ID。For example, in the example of FIG. 20A, PPS2 and PP3 processed before picture p6 may be assigned 2 as a temporary ID to PPS2 and 3 as a temporary ID to PPS3.

圖20B是顯示變形態樣之PPS通知的第4具體例的概念圖。在圖20B中,和圖20A同樣,顯示有圖片p0至p8。圖20B的例子中的圖片p0至p8的編碼順序,及被分配於圖片p0至p8的每個的暫時ID,和圖20A的例子相同。並且,圖20B顯示著PPS0至PPS3。在此,與圖20A的例子同樣,PPSx為在暫時層x所參考的PPS。Fig. 20B is a conceptual diagram showing a fourth specific example of the PPS notification of the modified form. In Fig. 20B, as in Fig. 20A, pictures p0 to p8 are displayed. The encoding order of the pictures p0 to p8 in the example of Fig. 20B and the temporary ID assigned to each of the pictures p0 to p8 are the same as the example of Fig. 20A. Also, Fig. 20B shows PPS0 to PPS3. Here, as in the example of FIG. 20A, PPSx is the PPS referenced in the temporary layer x.

又,在圖20B的例子中,和圖20A的例子同樣,在圖片p0至p8編碼之前,編碼裝置100將PPS0至PPS3編碼。對此時被編碼的PPSx分配x來作為暫時ID。然後,編碼裝置100按照PPS0,將圖片p0及p1編碼,按照PPS1,將圖片p2編碼,按照PPS2,將圖片p3及p6編碼,按照PPS3,將圖片p4、p5、p7及p8編碼。Further, in the example of Fig. 20B, as in the example of Fig. 20A, the encoding device 100 encodes PPS0 to PPS3 before encoding the pictures p0 to p8. In this case, the encoded PPSx allocates x as the temporary ID. Then, the encoding apparatus 100 encodes the pictures p0 and p1 in accordance with PPS0, encodes the picture p2 in accordance with PPS1, encodes pictures p3 and p6 in accordance with PPS2, and encodes pictures p4, p5, p7, and p8 in accordance with PPS3.

又,在圖20B的例子中,在STSA圖片的編碼之前,編碼裝置100將在被分配於STSA圖片之暫時ID的暫時層所參考的PPS編碼。對此時被編碼的PPS,也分配與被分配於STSA圖片的暫時ID相同之暫時ID。Further, in the example of FIG. 20B, before encoding of the STSA picture, the encoding apparatus 100 encodes the PPS referenced by the temporary layer assigned to the temporary ID of the STSA picture. The PPS encoded at this time is also assigned the same temporary ID as the temporary ID assigned to the STSA picture.

具體來說,在圖20B的例子中,被分配2來作為暫時ID的圖片p6為STSA圖片。此時,編碼裝置100在圖片p6之編碼之前,將在暫時層2所參考的PPS2編碼。對此時被編碼的PPS2也分配2來作為暫時ID。Specifically, in the example of FIG. 20B, the picture p6 assigned as the temporary ID is the STSA picture. At this time, the encoding device 100 encodes the PPS 2 referenced in the temporary layer 2 before the encoding of the picture p6. The PPS2 encoded at this time is also assigned 2 as a temporary ID.

同樣,解碼裝置200在將圖片p0至p8解碼之前,將PPS0至PPS3解碼。對此時被解碼的PPSx分配x來作為暫時ID。然後,解碼裝置200按照PPS0,將圖片p0及p1解碼,按照PPS1而將圖片p2解碼,按照PPS2而將圖片p3及p6解碼,按照PPS3而將圖片p4、p5、p7及p8解碼。Also, the decoding device 200 decodes PPS0 to PPS3 before decoding the pictures p0 to p8. The PPSx that is decoded at this time allocates x as a temporary ID. Then, the decoding device 200 decodes the pictures p0 and p1 in accordance with PPS0, decodes the picture p2 in accordance with PPS1, decodes pictures p3 and p6 in accordance with PPS2, and decodes pictures p4, p5, p7, and p8 in accordance with PPS3.

又,解碼裝置200在STSA圖片之解碼之前,將在被分配於STSA圖片之暫時ID的暫時層所參考之PPS解碼。對此時被解碼的PPS也可分配與被分配於STSA圖片的暫時ID相同之暫時ID。Further, the decoding device 200 decodes the PPS referenced by the temporary layer assigned to the temporary ID of the STSA picture before decoding the STSA picture. The PPS decoded at this time can also be assigned the same temporary ID as the temporary ID assigned to the STSA picture.

具體來說,在圖20B的例子中,被分配2來作為暫時ID之圖片p6為STSA圖片。因此,解碼裝置200在圖片p6之解碼之前,將在暫時層2所參考的PPS2解碼。對此時被解碼的PPS2也可分配2來作為暫時ID。Specifically, in the example of FIG. 20B, the picture p6 assigned as the temporary ID is the STSA picture. Therefore, the decoding device 200 decodes the PPS 2 referenced at the temporary layer 2 before the decoding of the picture p6. PPS2 decoded at this time can also be assigned 2 as a temporary ID.

例如,解碼裝置200為了只將圖片p0至p8之中暫時ID為1以下的圖片p0至p2解碼,也可在圖片p0之解碼之前,只將PPS0至PPS3之中PPS0及PPS1解碼。然後,解碼裝置200在圖片p0之解碼之前,也可不解碼而廢棄PPS0至PPS3之中PPS2及PPS3。For example, in order to decode only the pictures p0 to p2 in which the temporary ID is 1 or less among the pictures p0 to p8, the decoding device 200 may decode only PPS0 and PPS1 among the PPS0 to PPS3 before the decoding of the picture p0. Then, the decoding device 200 may discard PPS2 and PPS3 among PPS0 to PPS3 without decoding before decoding the picture p0.

在這之後,解碼裝置200為了將暫時ID為2的STSA圖片即圖片p6解碼,而將在暫時層2所參考的PPS2解碼。After that, the decoding device 200 decodes the PPS 2 referenced by the temporary layer 2 in order to decode the picture p6 which is the STSA picture whose temporary ID is 2.

依此,解碼裝置200可在圖片p2之後,按照PPS2將圖片p6解碼。Accordingly, the decoding device 200 can decode the picture p6 in accordance with the PPS 2 after the picture p2.

即,解碼裝置200在將STSA圖片解碼時,可按照STSA圖片,適當地進行已被容許的向上切換。That is, when decoding the STSA picture, the decoding apparatus 200 can appropriately perform the upward switching that is permitted in accordance with the STSA picture.

圖21A是顯示變形態樣之PPS通知的第5具體例的概念圖。在圖21A中,和圖18同樣,顯示有圖片p0至p8。圖21A的例子中的圖片p0至p8的編碼順序,及被分配於圖片p0至p8的每個的暫時ID,和圖18的例子相同。並且,圖21A顯示著PPS0至PPS3。在此,與圖18的例子同樣,PPSx為在暫時層x所參考的PPS。Fig. 21A is a conceptual diagram showing a fifth specific example of the PPS notification of the modified form. In Fig. 21A, as in Fig. 18, pictures p0 to p8 are displayed. The encoding order of the pictures p0 to p8 in the example of Fig. 21A and the temporary ID assigned to each of the pictures p0 to p8 are the same as those of the example of Fig. 18. Also, Fig. 21A shows PPS0 to PPS3. Here, as in the example of FIG. 18, PPSx is the PPS referenced in the temporary layer x.

在圖21A的例子中,暫時ID大於0的圖片p2至p8的每個為TSA圖片。也可按照序列參數組合所含的旗標,將暫時ID大於0的圖片p2至p8的每個規定為TSA圖片。例如,在HEVC中,在sps_temporal_id_nesting_flag為1時,暫時ID大於0之圖片p2至p8的每個被規定為TSA圖片。In the example of FIG. 21A, each of the pictures p2 to p8 whose temporary ID is greater than 0 is a TSA picture. Each of the pictures p2 to p8 whose temporary ID is greater than 0 may also be defined as a TSA picture according to the flag included in the sequence parameter combination. For example, in HEVC, when sps_temporal_id_nesting_flag is 1, each of pictures p2 to p8 whose temporary ID is greater than 0 is specified as a TSA picture.

又,在圖21A的例子中,編碼裝置100在將圖片p0至p8編碼之前,將在暫時層0所參考的PPS0編碼。對此時被編碼的PPS0分配0來作為暫時ID。然後,編碼裝置100按照PPS0,將圖片p0及p1編碼。Further, in the example of FIG. 21A, the encoding apparatus 100 encodes the PPS0 referenced at the temporary layer 0 before encoding the pictures p0 to p8. At this time, the encoded PPS0 is assigned 0 as a temporary ID. Then, the encoding device 100 encodes the pictures p0 and p1 in accordance with PPS0.

又,在圖21A的例子中,編碼裝置100在TSA圖片的編碼之前,將相對於TSA圖片的PPS編碼。在此,對相對於TSA圖片的PPS分配與被分配於TSA圖片的暫時ID相同之暫時ID。然後,編碼裝置100在相對於TSA圖片之PPS的編碼之後,按照相對於TSA圖片之PPS,將TSA圖片編碼。Further, in the example of FIG. 21A, the encoding apparatus 100 encodes the PPS with respect to the TSA picture before encoding of the TSA picture. Here, the PPS with respect to the TSA picture is assigned the same temporary ID as the temporary ID assigned to the TSA picture. Then, the encoding device 100 encodes the TSA picture in accordance with the PPS with respect to the TSA picture after encoding with respect to the PPS of the TSA picture.

例如,編碼裝置100在圖片p2之編碼之前,將相對於圖片p2之PPS1編碼。在此,對相對於圖片p2之PPS1分配1,來作為與被分配於圖片p2之暫時ID相同的暫時ID。然後,編碼裝置100在相對於圖片p2之PPS1之編碼之後,按照相對於圖片p2之PPS1,將圖片p2編碼。對於其他圖片p3至p8之處理也與對於圖片p2之處理同樣。For example, the encoding device 100 encodes PPS1 with respect to the picture p2 before encoding of the picture p2. Here, 1 is assigned to PPS1 with respect to picture p2 as the same temporary ID as the temporary ID assigned to picture p2. Then, the encoding device 100 encodes the picture p2 in accordance with PPS1 with respect to the picture p2 after encoding with respect to the PPS1 of the picture p2. The processing for the other pictures p3 to p8 is also the same as the processing for the picture p2.

同樣,解碼裝置200在將圖片p0至p8解碼之前,將在暫時層0所參考的PPS0解碼。對此時被解碼的PPS0分配0來作為暫時ID。然後,解碼裝置200按照PPS0,將圖片p0及p1解碼。Similarly, the decoding device 200 decodes the PPS0 referenced at the temporary layer 0 before decoding the pictures p0 to p8. The PPS0 decoded at this time is assigned 0 as a temporary ID. Then, the decoding device 200 decodes the pictures p0 and p1 in accordance with PPS0.

又,解碼裝置200在TSA圖片的解碼之前,將相對於TSA圖片的PPS解碼。在此,對相對於TSA圖片的PPS分配與被分配於TSA圖片的暫時ID相同之暫時ID。然後,解碼裝置200在相對於TSA圖片之PPS的解碼之後,按照相對於TSA圖片之PPS,將TSA圖片解碼。Further, the decoding device 200 decodes the PPS with respect to the TSA picture before decoding the TSA picture. Here, the PPS with respect to the TSA picture is assigned the same temporary ID as the temporary ID assigned to the TSA picture. Then, the decoding device 200 decodes the TSA picture in accordance with the PPS with respect to the TSA picture after decoding with respect to the PPS of the TSA picture.

例如,解碼裝置200在圖片p2的解碼之前,將相對於圖片p2之PPS1解碼。在此,對相對於圖片p2之PPS1分配1來作為與被分配於圖片p2的暫時ID相同之暫時ID。然後,解碼裝置200在相對於圖片p2之PPS1的解碼之後,按照相對於圖片p2之PPS1,將圖片p2解碼。對於其他圖片p3至p8之處理也與對於圖片p2之處理同樣。For example, the decoding device 200 decodes the PPS1 with respect to the picture p2 before the decoding of the picture p2. Here, 1 is assigned to PPS1 with respect to picture p2 as the same temporary ID as the temporary ID assigned to picture p2. Then, the decoding device 200 decodes the picture p2 in accordance with PPS1 with respect to the picture p2 after decoding with respect to the PPS1 of the picture p2. The processing for the other pictures p3 to p8 is also the same as the processing for the picture p2.

又,解碼裝置200也可只將一部分圖片解碼,前述一部分圖片在圖片p0至p8之中暫時ID為規定值以下。接著,解碼裝置200也可不解碼而廢棄圖片p0至p8之中暫時ID較規定值大的圖片。又,解碼裝置200也可只將一部分的PPS解碼,前述一部分的PPS在PPS0至PPS3之中暫時ID為規定值以下。接著,解碼裝置200也可不解碼而廢棄PPS0至PPS3之中暫時ID為大於規定值之PPS。Further, the decoding device 200 may decode only a part of the picture, and the partial picture may have a temporary ID equal to or less than a predetermined value among the pictures p0 to p8. Next, the decoding device 200 may discard the pictures in which the temporary IDs are larger than the predetermined values among the pictures p0 to p8 without decoding. Further, the decoding device 200 may decode only a part of the PPS, and the PPS of the part of the PPS0 to PPS3 may have a temporary ID of a predetermined value or less. Next, the decoding device 200 may discard the PPS whose temporary ID is greater than a predetermined value among the PPS0 to PPS3 without decoding.

例如,在前述規定值為1時,解碼裝置200將PPS0解碼,按照PPS0而將圖片p0及p1解碼。又,解碼裝置200在圖片p2之解碼之前,將相對於圖片p2之PPS1解碼。然後,解碼裝置200在相對於圖片p2之PPS1之解碼之後,按照相對於圖片p2之PPS1,將圖片p2解碼。然後,解碼裝置200不解碼而廢棄暫時ID大於1的其他圖片及PPS。For example, when the predetermined value is 1, the decoding device 200 decodes the PPS0 and decodes the pictures p0 and p1 in accordance with PPS0. Further, the decoding device 200 decodes the PPS 1 with respect to the picture p2 before decoding the picture p2. Then, the decoding device 200 decodes the picture p2 in accordance with PPS1 with respect to the picture p2 after decoding with respect to the PPS1 of the picture p2. Then, the decoding device 200 discards other pictures and PPS whose temporary ID is greater than 1 without decoding.

在進行上述的動作的途中,有可能進行向上切換。例如,有可能規定值變更成大於1的值。In the middle of the above operation, it is possible to perform an upward switching. For example, it is possible to change the value to a value greater than one.

具體來說,例如,就像在圖片p2解碼之後圖片p6被解碼一樣,有可能進行向上切換的。即使進行如此的向上切換,解碼裝置200在圖片p6之解碼之前,也可將相對於圖片p6之PPS2解碼。因此,解碼裝置200可按照相對於圖片p6之PPS2,適當地將圖片p6解碼。因此,解碼裝置200可進行如此的向上切換。Specifically, for example, just as the picture p6 is decoded after the picture p2 is decoded, it is possible to switch up. Even if such an upward switching is performed, the decoding device 200 can decode the PPS 2 with respect to the picture p6 before the decoding of the picture p6. Therefore, the decoding device 200 can appropriately decode the picture p6 in accordance with the PPS 2 with respect to the picture p6. Therefore, the decoding device 200 can perform such an upward switching.

即,解碼裝置200即使進行如此的向上切換,在各TSA圖片的解碼之前,也可將相對於前述TSA圖片之PPS解碼。因此,解碼裝置200可按照相對於前述TSA圖片之PPS,適當地將前述TSA圖片解碼。因此,解碼裝置200可適當地進行向上切換。That is, even if the decoding apparatus 200 performs such an upward switching, the PPS with respect to the TSA picture can be decoded before the decoding of each TSA picture. Therefore, the decoding device 200 can appropriately decode the aforementioned TSA picture in accordance with the PPS of the aforementioned TSA picture. Therefore, the decoding device 200 can appropriately perform the upward switching.

圖21B是顯示變形態樣之PPS通知的第6具體例的概念圖。在圖21B中,和圖21A同樣,顯示有圖片p0至p8。在圖21B的例子中的圖片p0至p8的編碼順序及被分配於圖片p0至p8的每個的暫時ID是和圖21A的例子相同。並且,在圖21B顯示有PPS0至PPS3。在此,PPSx和圖21A的例子同樣,是在暫時層x所參考的PPS。Fig. 21B is a conceptual diagram showing a sixth specific example of the PPS notification of the modified form. In Fig. 21B, as in Fig. 21A, pictures p0 to p8 are displayed. The encoding order of the pictures p0 to p8 in the example of Fig. 21B and the temporary ID assigned to each of the pictures p0 to p8 are the same as the example of Fig. 21A. Also, PPS0 to PPS3 are shown in FIG. 21B. Here, PPSx is the same as the example of FIG. 21A, and is the PPS referenced in the temporary layer x.

在圖21B的例子中,和圖21A的例子同樣,暫時ID比0大的圖片p2至p8各為TSA圖片。In the example of FIG. 21B, as in the example of FIG. 21A, the pictures p2 to p8 whose temporary ID is larger than 0 are each a TSA picture.

又,在圖21B的例子中,和圖21A的例子同樣,編碼裝置100在將圖片p0至p8編碼之前,將在暫時層0所參考的PPS0編碼。對此時被編碼的PPS0分配0來作為暫時ID。然後,編碼裝置100按照PPS0,將圖片p0及p1編碼。Further, in the example of Fig. 21B, as in the example of Fig. 21A, the encoding apparatus 100 encodes the PPS0 referenced at the temporary layer 0 before encoding the pictures p0 to p8. At this time, the encoded PPS0 is assigned 0 as a temporary ID. Then, the encoding device 100 encodes the pictures p0 and p1 in accordance with PPS0.

又,在圖21B的例子中,編碼裝置100在中間層圖片的編碼之前,將相對於中間層圖片之PPS編碼。在此,對相對於中間層圖片的PPS分配與被分配於中間層圖片之暫時ID相同的暫時ID。然後,編碼裝置100在相對於中間層圖片之PPS的編碼之後,按照相對於中間層圖片之PPS,將中間層圖片編碼。Further, in the example of FIG. 21B, the encoding apparatus 100 encodes the PPS with respect to the intermediate layer picture before encoding of the intermediate layer picture. Here, the PPS with respect to the middle layer picture is assigned the same temporary ID as the temporary ID assigned to the middle layer picture. Then, the encoding device 100 encodes the intermediate layer picture in accordance with the PPS with respect to the intermediate layer picture after encoding with respect to the PPS of the intermediate layer picture.

在此,中間層圖片為被分配暫時ID的圖片,前述暫時ID較最小的暫時ID還大,且較最大的暫時ID還小。Here, the middle layer picture is a picture to which a temporary ID is assigned, and the temporary ID is larger than the smallest temporary ID, and the larger temporary ID is smaller.

又,在圖21B之例子中,編碼裝置100在特定中間層圖片之編碼之前,將相對於最上位層圖片之PPS編碼。在此,最上位層圖片為被分配最大的暫時ID之圖片。特定中間層圖片為被分配最大的暫時ID的下一個大的暫時ID的中間層圖片。Further, in the example of FIG. 21B, the encoding apparatus 100 encodes the PPS with respect to the uppermost layer picture before encoding of the specific intermediate layer picture. Here, the top layer picture is the picture to which the largest temporary ID is assigned. The specific middle layer picture is the middle layer picture of the next large temporary ID to which the largest temporary ID is assigned.

即,編碼裝置100在特定中間層之編碼之前,將相對於特定中間層圖片的PPS及相對於最上位層圖片的PPS編碼。在此,也可將與被分配於特定中間層圖片的暫時ID相同的暫時ID,分別分配於相對於特定中間層圖片的PPS、以及相對於最上位層圖片的PPS。That is, the encoding apparatus 100 encodes the PPS with respect to the specific intermediate layer picture and the PPS with respect to the uppermost layer picture before encoding of the specific intermediate layer. Here, the same temporary ID as the temporary ID assigned to the specific intermediate layer picture may be allocated to the PPS with respect to the specific intermediate layer picture and the PPS with respect to the highest layer picture.

接著,編碼裝置100在相對於特定中間層圖片的PPS之編碼之後,按照相對於特定中間層圖片的PPS,將特定中間層圖片編碼。又,編碼裝置100在相對於最上位層圖片的PPS之編碼之後,按照相對於最上位層圖片的PPS,將最上位層圖片編碼。Next, the encoding device 100 encodes the specific intermediate layer picture in accordance with the PPS with respect to the specific intermediate layer picture after encoding with respect to the PPS of the specific intermediate layer picture. Further, after encoding the PPS with respect to the uppermost layer picture, the encoding apparatus 100 encodes the uppermost layer picture in accordance with the PPS with respect to the highest layer picture.

具體來說,圖片p0至p8之中,圖片p2、p3及p6的每個為中間層圖片。又,圖片p2、p3及p6之中,圖片p3及p6的每個為特定中間層圖片。又,圖片p0至p8之中,圖片p4、p5、p7及p8的每個為最上位層圖片。Specifically, among the pictures p0 to p8, each of the pictures p2, p3, and p6 is an intermediate layer picture. Further, among the pictures p2, p3, and p6, each of the pictures p3 and p6 is a specific intermediate layer picture. Further, among the pictures p0 to p8, each of the pictures p4, p5, p7, and p8 is the top layer picture.

例如編碼裝置100在圖片p2之編碼之前,將PPS1編碼。在此,和被分配於圖片p2的暫時ID相同,對PPS1分配1來作為暫時ID。然後,編碼裝置100在PPS1之編碼之後,按照PPS1,將圖片p2編碼。For example, the encoding device 100 encodes PPS1 before encoding of the picture p2. Here, as with the temporary ID assigned to the picture p2, 1 is assigned to the PPS1 as the temporary ID. Then, the encoding device 100 encodes the picture p2 in accordance with PPS1 after the encoding of PPS1.

又,編碼裝置100在圖片p3之編碼之前,將PPS2及PPS3編碼。在此,和被分配於圖片p3的暫時ID相同,分別對PPS2及PPS3分配2來作為暫時ID。接著,編碼裝置100在PPS2之編碼之後,按照PPS2,將圖片p3編碼。又,編碼裝置100在PPS3之編碼之後,按照PPS3,將圖片p4及p5編碼。Further, the encoding device 100 encodes PPS2 and PPS3 before encoding of the picture p3. Here, as with the temporary ID assigned to the picture p3, 2 is assigned to the PPS 2 and the PPS 3 as the temporary ID. Next, the encoding apparatus 100 encodes the picture p3 in accordance with PPS 2 after the encoding of the PPS 2. Further, after encoding by PPS3, the encoding apparatus 100 encodes pictures p4 and p5 in accordance with PPS3.

又,編碼裝置100在圖片p6之編碼之前,將PPS2及PPS3編碼。在此,和被分配於圖片p6的暫時ID相同,分別對PPS2及PPS3分配2來作為暫時ID。接著,編碼裝置100在PPS2之編碼之後,按照PPS2,將圖片p6編碼。又,編碼裝置100在PPS3之編碼之後,按照PPS3,將圖片p7及p8編碼。Further, the encoding device 100 encodes PPS2 and PPS3 before encoding of the picture p6. Here, as with the temporary ID assigned to the picture p6, 2 is assigned to the PPS 2 and the PPS 3 as the temporary ID. Next, the encoding device 100 encodes the picture p6 in accordance with PPS 2 after the encoding of the PPS 2. Further, after encoding by PPS3, the encoding apparatus 100 encodes pictures p7 and p8 in accordance with PPS3.

同樣,解碼裝置200在將圖片p0至p8解碼之前,將在暫時層0所參考的PPS0解碼。對於此時解碼的PPS0分配0來作為暫時ID。然後,解碼裝置200按照PPS0,將圖片p0及p1解碼。Similarly, the decoding device 200 decodes the PPS0 referenced at the temporary layer 0 before decoding the pictures p0 to p8. For the PPS0 decoded at this time, 0 is assigned as the temporary ID. Then, the decoding device 200 decodes the pictures p0 and p1 in accordance with PPS0.

又,解碼裝置200在中間層圖片之解碼之前,將相對於中間層圖片之PPS解碼。在此,對相對於中間層圖片之PPS分配與被分配於中間層圖片的暫時ID相同的暫時ID。然後,解碼裝置200在相對於中間層圖片的PPS之解碼之後,按照相對於中間層圖片的PPS,將中間層圖片解碼。Further, the decoding device 200 decodes the PPS with respect to the intermediate layer picture before decoding the intermediate layer picture. Here, the PPS with respect to the middle layer picture is assigned the same temporary ID as the temporary ID assigned to the middle layer picture. Then, the decoding device 200 decodes the intermediate layer picture in accordance with the PPS with respect to the intermediate layer picture after decoding with respect to the PPS of the intermediate layer picture.

在此,中間層圖片為被分配較最小的暫時ID還大,且較最大的暫時ID還小之暫時ID的圖片。Here, the middle layer picture is a picture of a temporary ID that is assigned a smaller temporary ID and is smaller than the largest temporary ID.

又,解碼裝置200在特定中間層圖片之解碼之前,將相對於最上位層圖片之PPS解碼。在此,最上位層圖片為被分配最大的暫時ID的圖片。特定中間層圖片為被分配最大的暫時ID的下一個大的暫時ID的中間層圖片。Further, the decoding device 200 decodes the PPS with respect to the uppermost layer picture before decoding the specific intermediate layer picture. Here, the top layer picture is the picture to which the largest temporary ID is assigned. The specific middle layer picture is the middle layer picture of the next large temporary ID to which the largest temporary ID is assigned.

即,解碼裝置200在特定中間層圖片之解碼之前,將相對於特定中間層圖片之PPS及相對於最上位層圖片之PPS解碼。在此,也可將與被分配於特定中間層圖片的暫時ID相同的暫時ID分別分配於相對於特定中間層圖片的PPS、以及相對於最上位層圖片的PPS。That is, the decoding device 200 decodes the PPS with respect to the specific intermediate layer picture and the PPS with respect to the uppermost layer picture before decoding of the specific intermediate layer picture. Here, the same temporary IDs as the temporary IDs assigned to the specific intermediate layer picture may be allocated to the PPS with respect to the specific intermediate layer picture and the PPS with respect to the uppermost layer picture, respectively.

接著,解碼裝置200在相對於特定中間層圖片的PPS之解碼之後,按照相對於特定中間層圖片的PPS,將特定中間層圖片解碼。又,解碼裝置200在相對於最上位層圖片的PPS之解碼之後,按照相對於最上位層圖片的PPS,將最上位層圖片解碼。Next, the decoding device 200 decodes the specific intermediate layer picture according to the PPS with respect to the specific intermediate layer picture after decoding with respect to the PPS of the specific intermediate layer picture. Further, after decoding the PPS with respect to the uppermost layer picture, the decoding device 200 decodes the uppermost layer picture in accordance with the PPS with respect to the uppermost picture.

具體來說,如上所述,圖片p0至p8之中,圖片p2、p3及p6的每個為中間層圖片。又,圖片p2、p3及p6之中,圖片p3及p6的每個為特定中間層圖片。又,圖片p0至p8之中,圖片p4、p5、p7及p8的每個為最上位層圖片。Specifically, as described above, among the pictures p0 to p8, each of the pictures p2, p3, and p6 is an intermediate layer picture. Further, among the pictures p2, p3, and p6, each of the pictures p3 and p6 is a specific intermediate layer picture. Further, among the pictures p0 to p8, each of the pictures p4, p5, p7, and p8 is the top layer picture.

例如解碼裝置200在圖片p2之解碼之前,將PPS1解碼。在此,和被分配於圖片p2的暫時ID相同,對PPS1分配1來作為暫時ID。然後,解碼裝置200在PPS1之解碼之後,按照PPS1,將圖片p2解碼。For example, the decoding device 200 decodes PPS1 before decoding of the picture p2. Here, as with the temporary ID assigned to the picture p2, 1 is assigned to the PPS1 as the temporary ID. Then, the decoding device 200 decodes the picture p2 in accordance with PPS1 after the decoding of the PPS1.

又,解碼裝置200在圖片p3之解碼之前,將PPS2及PPS3解碼。在此,和被分配於圖片p3的暫時ID相同,分別對PPS2及PPS3分配2來作為暫時ID。接著,解碼裝置200在PPS2之解碼之後,按照PPS2,將圖片p3解碼。又,解碼裝置200在PPS3之解碼之後,按照PPS3,將圖片p4及p5解碼。Further, the decoding device 200 decodes the PPS 2 and the PPS 3 before decoding the picture p3. Here, as with the temporary ID assigned to the picture p3, 2 is assigned to the PPS 2 and the PPS 3 as the temporary ID. Next, the decoding device 200 decodes the picture p3 in accordance with PPS 2 after the decoding of the PPS 2. Further, after decoding by the PPS 3, the decoding device 200 decodes the pictures p4 and p5 in accordance with PPS 3.

又,解碼裝置200在圖片p6之解碼之前,將PPS2及PPS3解碼。在此,和被分配於圖片p6的暫時ID相同,分別對PPS2及PPS3分配2來作為暫時ID。接著,解碼裝置200在PPS2之解碼之後,按照PPS2,將圖片p6解碼。又,解碼裝置200在PPS3之解碼之後,按照PPS3,將圖片p7及p8解碼。Further, the decoding device 200 decodes the PPS 2 and the PPS 3 before the decoding of the picture p6. Here, as with the temporary ID assigned to the picture p6, 2 is assigned to the PPS 2 and the PPS 3 as the temporary ID. Next, the decoding device 200 decodes the picture p6 in accordance with PPS 2 after the decoding of the PPS 2. Further, after decoding by the PPS 3, the decoding device 200 decodes the pictures p7 and p8 in accordance with PPS 3.

又,解碼裝置200也可只將圖片p0至p8之中暫時ID為規定值以下的一部分的圖片解碼。然後,解碼裝置200也可不解碼而廢棄圖片p0至p8之中暫時ID大於規定值的圖片。又,解碼裝置200也可只將PPS0至PPS3之中暫時ID為規定值以下之一部分的PPS解碼。然後,解碼裝置200也可不解碼而廢棄PPS0至PPS3之中暫時ID大於規定值的PPS。Further, the decoding device 200 may decode only a part of the pictures p0 to p8 whose temporary ID is equal to or less than a predetermined value. Then, the decoding device 200 may discard the pictures in which the temporary ID is larger than the predetermined value among the pictures p0 to p8 without decoding. Further, the decoding device 200 may decode only the PPS whose temporary ID is one of the predetermined values or less among the PPS0 to PPS3. Then, the decoding device 200 may discard the PPS in which the temporary ID is larger than the predetermined value among the PPS0 to PPS3 without decoding.

例如當前述規定值為1時,解碼裝置200將PPS0解碼,按照PPS0來將圖片p0及p1解碼。又,解碼裝置200在圖片p2之解碼之前,將相對於圖片p2之PPS1解碼。接著,解碼裝置200在相對於圖片p2的PPS1之解碼之後,按照相對於圖片p2之PPS1來將圖片p2解碼。然後,解碼裝置200不解碼而廢棄暫時ID大於1的其他圖片及PPS。For example, when the predetermined value is 1, the decoding device 200 decodes the PPS0 and decodes the pictures p0 and p1 in accordance with PPS0. Further, the decoding device 200 decodes the PPS 1 with respect to the picture p2 before decoding the picture p2. Next, after decoding by PPS1 with respect to picture p2, decoding apparatus 200 decodes picture p2 in accordance with PPS1 of picture p2. Then, the decoding device 200 discards other pictures and PPS whose temporary ID is greater than 1 without decoding.

在進行上述動作的途中,有進行向上切換的可能性。例如有規定值變更為大於1的值的可能性。In the middle of the above operation, there is a possibility of switching upwards. For example, there is a possibility that the predetermined value is changed to a value larger than one.

具體來說,例如像在圖片p2之解碼之後將圖片p6解碼一樣,有進行向上切換的可能性。即使進行了像這樣的向上切換,解碼裝置200在圖片p6之解碼之前,仍可將相對於圖片p6的PPS2解碼。因此,解碼裝置200可按照相對於圖片p6之PPS2,適當地將圖片p6解碼。因此,解碼裝置200可進行如此的向上切換。Specifically, for example, like the decoding of the picture p6 after the decoding of the picture p2, there is a possibility of performing an upward switching. Even if an upward switching like this is performed, the decoding device 200 can decode the PPS 2 with respect to the picture p6 before the decoding of the picture p6. Therefore, the decoding device 200 can appropriately decode the picture p6 in accordance with the PPS 2 with respect to the picture p6. Therefore, the decoding device 200 can perform such an upward switching.

又,進而,像在圖片p6之解碼之後將圖片p7解碼一樣,有進行向上切換的可能性。即使進行了像這樣的向上切換,解碼裝置200在圖片p6之解碼之前,仍可將相對於圖片p7的PPS3解碼。因此,解碼裝置200可按照相對於圖片p7之PPS3,適當地將圖片p7解碼。因此,解碼裝置200也可進行如此的向上切換。Further, as in the case of decoding the picture p7 after the decoding of the picture p6, there is a possibility that the picture is switched upward. Even if an upward switching like this is performed, the decoding device 200 can decode the PPS 3 with respect to the picture p7 before the decoding of the picture p6. Therefore, the decoding device 200 can appropriately decode the picture p7 in accordance with the PPS 3 with respect to the picture p7. Therefore, the decoding device 200 can also perform such an upward switching.

即,解碼裝置200就算進行向上切換,也能按照PPS適當地將圖片解碼。因此,解碼裝置200可適當地進行向上切換。That is, even if the decoding device 200 performs the upward switching, the picture can be appropriately decoded in accordance with the PPS. Therefore, the decoding device 200 can appropriately perform the upward switching.

使用圖18至圖21B來說明的PPS通知並不限於濾波資訊的處理方法的變形態樣中的PPS通知。例如PPS也可不包含濾波控制資訊,也可不關聯於自適應迴路濾波。PPS也可不包含關聯於自適應迴路濾波的資訊,而是包含圖片的編碼或者解碼所使用的其他資訊。例如PPS也可包含參考圖片清單的資訊,或者量化矩陣的資訊。The PPS notification described using FIGS. 18 to 21B is not limited to the PPS notification in the modified form of the processing method of the filtered information. For example, PPS may not include filtering control information or may be associated with adaptive loop filtering. The PPS may also not contain information associated with adaptive loop filtering, but rather other information used to encode or decode the picture. For example, the PPS may also contain information of a reference picture list, or information of a quantization matrix.

又,與圖18至圖21B有關聯的動作不限於PPS通知,也可適用序列參數組合或者自適應參數組合等的其他參數組合的通知。即,有關聯於圖18至圖21B的說明中的PPS也可改寫為參數組合。Further, the operations associated with FIGS. 18 to 21B are not limited to the PPS notification, and notification of other parameter combinations such as sequence parameter combination or adaptive parameter combination may be applied. That is, the PPS in the description associated with FIGS. 18 to 21B can also be rewritten as a parameter combination.

又,與圖14A、圖14B及圖18至圖21B等有關聯的暫時ID的分配,也可按照編碼順序、解碼順序、顯示順序或者資料類別等來進行。又,編碼裝置100也可將暫時ID編碼,解碼裝置200也可將暫時ID解碼。或者,暫時ID的分配在編碼裝置100及解碼裝置200之間以相同的基準來進行,藉此也可省略暫時ID的編碼及解碼。Further, the allocation of the temporary IDs associated with FIG. 14A, FIG. 14B, FIG. 18 to FIG. 21B, and the like may be performed in accordance with the encoding order, the decoding order, the display order, the material type, and the like. Further, the encoding device 100 may encode the temporary ID, and the decoding device 200 may decode the temporary ID. Alternatively, the allocation of the temporary ID is performed on the same basis between the encoding device 100 and the decoding device 200, whereby the encoding and decoding of the temporary ID may be omitted.

在編碼裝置100中,熵編碼部110也可進行暫時ID的分配,其他構成要素也可進行暫時ID的分配。又,在解碼裝置200中,熵解碼部202也可進行暫時ID的分配,其他構成要素也可進行暫時ID的分配。
[編碼裝置的安裝例]
In the encoding device 100, the entropy encoding unit 110 may perform the allocation of the temporary ID, and other components may also allocate the temporary ID. Further, in the decoding device 200, the entropy decoding unit 202 may perform the assignment of the temporary ID, and the other components may also allocate the temporary ID.
[Installation example of coding device]

圖22是顯示編碼裝置100之安裝例之方塊圖。編碼裝置100包含有電路160及記憶體162。例如,圖1所示之編碼裝置100之複數個構成要素是透過圖22所示之電路160及記憶體162來安裝。Fig. 22 is a block diagram showing an example of mounting of the encoding device 100. The encoding device 100 includes a circuit 160 and a memory 162. For example, a plurality of components of the encoding device 100 shown in FIG. 1 are mounted through the circuit 160 and the memory 162 shown in FIG.

電路160是可對記憶體162進行存取的電子電路,且進行資訊處理。例如,電路160是使用記憶體162將動態圖像編碼之專用或者通用的電子電路。電路160也可為如CPU般之處理器。又,電路160也可為複數個電子電路的集合體。The circuit 160 is an electronic circuit that can access the memory 162 and performs information processing. For example, circuit 160 is a dedicated or general purpose electronic circuit that encodes moving images using memory 162. Circuitry 160 can also be a CPU-like processor. Also, circuit 160 can be an aggregate of a plurality of electronic circuits.

又,例如電路160也可展現圖1所示之編碼裝置100之複數個構成要素中除了用以記憶資訊的構成要素之外的複數個構成要素的作用。即,電路160也可進行上述的動作,作為該等構成要素的動作。Further, for example, the circuit 160 may exhibit a plurality of constituent elements other than the constituent elements for storing information among the plurality of constituent elements of the encoding apparatus 100 shown in FIG. That is, the circuit 160 can perform the above-described operations as operations of the components.

記憶體162是通用或者專用的記憶體,記憶電路160用以將動態圖像編碼之資訊。記憶體162可為電子電路,也可連接於電路160,也可包含在電路160。The memory 162 is a general purpose or dedicated memory used by the memory circuit 160 to encode the moving image. The memory 162 can be an electronic circuit, can be connected to the circuit 160, or can be included in the circuit 160.

又,記憶體162也可為複數個電子電路的集合體,也可由複數個次記憶體構成。又,記憶體162也可為磁碟或者是光碟等,也可表現為儲存器(storage)或者是記錄媒體等。又,記憶體162可為非揮發性記憶體,也可為揮發性記憶體。Further, the memory 162 may be an aggregate of a plurality of electronic circuits, or may be composed of a plurality of secondary memories. Further, the memory 162 may be a magnetic disk or a compact disk, or may be embodied as a storage or a recording medium. Moreover, the memory 162 can be a non-volatile memory or a volatile memory.

例如記憶體162也可展現在圖1所示的編碼裝置100之複數個構成要素之中用以記憶資訊之構成要素的作用。具體來說,記憶體162也可展現圖1所示之區塊記憶體118、框記憶體122、當前濾波資訊記憶部132及參考濾波資訊記憶部133的作用。For example, the memory 162 can also exhibit the function of memorizing the constituent elements of the information among the plurality of constituent elements of the encoding device 100 shown in FIG. Specifically, the memory 162 can also function as the block memory 118, the frame memory 122, the current filter information storage unit 132, and the reference filter information storage unit 133 shown in FIG.

例如,記憶體162也可記憶要被編碼的動態圖像,也可記憶對應於已被編碼的動態圖像之位元列。又,在記憶體162也可記憶電路160用以將動態圖像編碼的程式。For example, the memory 162 can also memorize the moving image to be encoded, and can also memorize the bit string corresponding to the dynamic image that has been encoded. Further, the memory 162 can also store a program for encoding the moving image by the circuit 160.

另,在編碼裝置100中,也可不用安裝圖1所示的複數個構成要素全部,也可不用進行上述之複數個處理全部。圖1所示的複數個構成要素之一部分也可包含在其他裝置,上述之複數個處理之一部分也可透過其他裝置來執行。然後,在編碼裝置100中,安裝圖1所示的複數個構成要素之中的一部分,且進行上述之複數個處理的一部分,藉此,可適當地設定與動態圖像之編碼有關聯的資訊。Further, in the coding apparatus 100, it is not necessary to install all of the plurality of constituent elements shown in FIG. 1, and it is not necessary to perform all of the above-described plural processing. One of the plurality of components shown in FIG. 1 may be included in other devices, and one of the plurality of processes described above may also be executed by other devices. Then, in the encoding apparatus 100, a part of the plurality of constituent elements shown in FIG. 1 is mounted, and a part of the plurality of processing described above is performed, whereby information related to encoding of the moving image can be appropriately set. .

圖23是顯示圖22所示的編碼裝置100的第1動作例的流程圖。例如圖22所示的編碼裝置100是在含有複數張圖片之動態圖像的編碼中適用自適應迴路濾波之際,進行圖23所示的動作,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID。具體來說,電路160使用記憶體162進行以下的動作。FIG. 23 is a flowchart showing a first operation example of the encoding device 100 shown in FIG. 22. For example, the encoding apparatus 100 shown in FIG. 22 performs an operation shown in FIG. 23 when adaptive loop filtering is applied to encoding of a moving image including a plurality of pictures, wherein the pictures are respectively assigned and displayed with respect to time adjustment. Temporary ID of the sex class. Specifically, the circuit 160 performs the following operations using the memory 162.

首先,電路160參考有關聯於第2圖片之第2濾波資訊,決定用來對複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊 (S701)。在此,第2圖片是複數張圖片之中編碼順序上較第1圖片還前面的圖片。First, the circuit 160 determines the first filter information for applying the adaptive loop filter to the first picture among the plurality of pictures with reference to the second filter information associated with the second picture (S701). Here, the second picture is a picture in which the coding order is earlier than the first picture in the plurality of pictures.

此時,當前述第1圖片的NAL單元類型為規定NAL單元類型時,電路160禁止參考有關聯於第3圖片之第3濾波資訊來作為第2濾波資訊。在此,第3圖片為複數張圖片之中在編碼順序上較第1圖片更前面的圖片,且為暫時ID與第1圖片相同的圖片。然後,電路160使用已決定的第1濾波資訊,對第1圖片適用自適應迴路濾波(S702)。At this time, when the NAL unit type of the first picture is a predetermined NAL unit type, the circuit 160 prohibits the reference to the third filter information associated with the third picture as the second filter information. Here, the third picture is a picture in which the coding order is earlier than the first picture among the plurality of pictures, and is a picture in which the temporary ID is the same as the first picture. Then, the circuit 160 applies adaptive loop filtering to the first picture using the determined first filter information (S702).

依此,編碼裝置100可參考第2圖片的第2濾波資訊,來決定第1圖片的第1濾波資訊。此時,編碼裝置100可禁止參考第3濾波資訊來作為第2濾波資訊,前述第3濾波資訊為與規定NAL單元類型的第1圖片相同階層的第3圖片的濾波資訊。Accordingly, the encoding device 100 can determine the first filter information of the first picture by referring to the second filter information of the second picture. At this time, the encoding apparatus 100 can prohibit the reference third filtering information as the second filtering information, and the third filtering information is the filtering information of the third picture of the same level as the first picture of the predetermined NAL unit type.

即,和可對與規定NAL單元類型的第1圖片相同階層的圖片所進行的參考限制一樣,編碼裝置100能對與規定NAL單元類型的第1圖片相同階層的圖片之濾波資訊進行參考限制。因此,編碼裝置100可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。That is, the encoding apparatus 100 can refer to the filtering information of the picture of the same level as the first picture of the predetermined NAL unit type, similarly to the reference restriction of the picture of the same level as the first picture of the predetermined NAL unit type. Therefore, the encoding device 100 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

例如也可在前述第1濾波資訊之決定中,電路160禁止參考有關聯於第4圖片之第4濾波資訊來作為第2濾波資訊。在此,第4圖片是複數張圖片之中編碼順序上較第1圖片還前面的圖片,且為暫時ID大於第1圖片的圖片。For example, in the determination of the first filter information, the circuit 160 may prohibit the reference to the fourth filter information associated with the fourth picture as the second filter information. Here, the fourth picture is a picture in which the coding order is earlier than the first picture among the plurality of pictures, and is a picture whose temporary ID is larger than the first picture.

依此,在參考第2圖片的第2濾波資訊,來決定第1圖片的第1濾波資訊之際,得禁止參考暫時ID較第1圖片大的第4圖片之第4濾波資訊來作為第2濾波資訊。According to this, when the first filter information of the first picture is determined with reference to the second filter information of the second picture, the fourth filter information of the fourth picture whose reference temporary ID is larger than the first picture is prohibited from being used as the second Filter information.

因此,編碼裝置100在時間可調性之中,和對圖片所進行的參考限制一樣,可對有關聯於圖片的濾波資訊進行參考限制。藉此,編碼裝置100可適當地限制來設定要參考的濾波資訊。Therefore, the encoding apparatus 100 can make reference restrictions on the filtering information associated with the picture, among the time adjustability, as well as the reference limitation on the picture. Thereby, the encoding device 100 can be appropriately limited to set the filter information to be referred to.

又,例如電路160也可參考有關聯於第6圖片之第6濾波資訊,決定用來對第5圖片適用自適應迴路濾波之第5濾波資訊,其中前述第5圖片是複數張圖片之中編碼順序上較第1圖片還後面的圖片。在此,第6圖片是複數張圖片之中編碼順序上較第5圖片還前面的圖片。For example, the circuit 160 may also refer to the sixth filtering information associated with the sixth picture to determine the fifth filtering information for applying adaptive loop filtering to the fifth picture, wherein the fifth picture is a code among the plurality of pictures. The picture in the order that is later than the first picture. Here, the sixth picture is a picture in which the coding order is earlier than the fifth picture in the plurality of pictures.

此時,當第1圖片的NAL單元類型為規定NAL單元類型時,電路160也可禁止參考有關聯於第3圖片之第3濾波資訊來作為第6濾波資訊。然後,電路160也可使用已決定的第5濾波資訊,對第5圖片適用自適應迴路濾波。At this time, when the NAL unit type of the first picture is a predetermined NAL unit type, the circuit 160 may prohibit the reference to the third filter information associated with the third picture as the sixth filter information. Circuit 160 can then apply adaptive loop filtering to the fifth picture using the determined fifth filtering information.

依此,編碼裝置100可參考第6圖片的第6濾波資訊,來決定編碼順序上較第1圖片還後面的第5圖片的第5濾波資訊。此時,編碼裝置100可禁止參考第3圖片之第3濾波資訊來作為第6濾波資訊,前述第3圖片是與規定NAL單元類型的第1圖片相同階層的圖片。Accordingly, the encoding device 100 can refer to the sixth filtering information of the sixth picture to determine the fifth filtering information of the fifth picture that is later than the first picture in the encoding order. At this time, the encoding apparatus 100 can prohibit the third filtering information of the reference third picture as the sixth filtering information, and the third picture is a picture of the same level as the first picture of the predetermined NAL unit type.

即,編碼裝置100在較規定NAL單元類型的第1圖片還後面之中,和可對與第1圖片相同階層的圖片進行的參考限制一樣,能對與第1圖片相同階層的圖片的濾波資訊進行參考限制。因此,編碼裝置100可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。In other words, the encoding apparatus 100 can filter the information of the same-level picture as the first picture, even after the first picture of the predetermined NAL unit type, and the reference restriction of the picture of the same level as the first picture. Make reference restrictions. Therefore, the encoding device 100 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

又,例如也可在第5濾波資訊之決定中,當第1圖片的NAL單元類型為規定NAL單元類型時,電路160禁止參考有關聯於第4圖片之第4濾波資訊來作為第6濾波資訊。在此,第4圖片是複數張圖片之中編碼順序上較第1圖片還前面的圖片,且為暫時ID大於第1圖片的圖片。Further, for example, in the determination of the fifth filtering information, when the NAL unit type of the first picture is a predetermined NAL unit type, the circuit 160 prohibits the reference to the fourth filtering information associated with the fourth picture as the sixth filtering information. . Here, the fourth picture is a picture in which the coding order is earlier than the first picture among the plurality of pictures, and is a picture whose temporary ID is larger than the first picture.

依此,在參考第6圖片的第6濾波資訊來決定第5圖片的第5濾波資訊之際,得禁止參考暫時ID較第1圖片還大的第4圖片的第4濾波資訊來作為第5濾波資訊。Accordingly, when the fifth filter information of the fifth picture is determined with reference to the sixth filter information of the sixth picture, the fourth filter information of the fourth picture whose reference temporary ID is larger than the first picture is prohibited from being used as the fifth. Filter information.

即,編碼裝置100在較規定NAL單元類型的第1圖片還後面之中,和可對暫時ID大於第1圖片的圖片進行的參考限制一樣,能對濾波資訊進行參考限制。因此,編碼裝置100可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。That is, the encoding apparatus 100 can refer to the filtering information in the same manner as the reference restriction of the picture having the temporary ID larger than the first picture, even after the first picture of the predetermined NAL unit type. Therefore, the encoding device 100 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

又,例如也可在第1濾波資訊之決定中,電路160在規定的情形下,禁止參考有關聯於第7圖片之第7濾波資訊來作為第2濾波資訊。Further, for example, in the determination of the first filter information, the circuit 160 may prohibit the reference to the seventh filter information associated with the seventh picture as the second filter information in a predetermined case.

在此,規定的情形為:第1圖片與第7圖片之間存在有第8圖片,且第8圖片的NAL單元類型為規定NAL單元類型的情形。又,第7圖片是複數張圖片之中編碼順序上較第1圖片還前面的圖片且為暫時ID大於0的圖片。又,第8圖片是暫時ID與第7圖片相同或者暫時ID小於第7圖片的圖片。Here, the predetermined case is a case where the eighth picture exists between the first picture and the seventh picture, and the NAL unit type of the eighth picture is a predetermined NAL unit type. Further, the seventh picture is a picture in which the encoding order is earlier than the first picture among the plurality of pictures, and the picture whose temporary ID is greater than 0. Further, the eighth picture is a picture in which the temporary ID is the same as the seventh picture or the temporary ID is smaller than the seventh picture.

依此,編碼裝置100可禁止參考第7濾波資訊來作為第2濾波資訊,前述第7濾波資訊是在較規定NAL單元類型的第8圖片還後面之中暫時ID等於或者大於第8圖片的第7圖片的濾波資訊。Accordingly, the encoding apparatus 100 can prohibit the reference to the seventh filtering information as the second filtering information, and the seventh filtering information is that the temporary ID is equal to or larger than the eighth picture after the eighth picture of the predetermined NAL unit type. 7 picture filtering information.

即,編碼裝置100在較規定NAL單元類型的第8圖片還後面之中,和可對第7圖片進行的參考限制一樣,能對第7圖片的第7濾波資訊進行參考限制。因此,編碼裝置100可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。That is, the encoding apparatus 100 can refer to the seventh filtering information of the seventh picture in the same manner as the reference picture of the seventh picture, in addition to the eighth picture of the predetermined NAL unit type. Therefore, the encoding device 100 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

又,例如規定NAL單元類型也可為TSA圖片的NAL單元類型。Also, for example, the NAL unit type may be defined as a NAL unit type of a TSA picture.

依此,和可對與TSA圖片相同階層的圖片進行的參考限制一樣,編碼裝置100可對與TSA圖片相同階層的圖片的濾波資訊進行參考限制。因此,編碼裝置100可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding apparatus 100 can refer to the filtering information of the picture of the same level as the TSA picture as the reference limit of the picture of the same level as the TSA picture. Therefore, the encoding device 100 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

又,例如電路160也可參考有關聯於第6圖片之第6濾波資訊,決定用來對第5圖片適用自適應迴路濾波之第5濾波資訊,其中前述第5圖片是複數張圖片之中編碼順序上較第1圖片還後面的圖片。在此,第6圖片是複數張圖片之中編碼順序上較第5圖片還前面的圖片。For example, the circuit 160 may also refer to the sixth filtering information associated with the sixth picture to determine the fifth filtering information for applying adaptive loop filtering to the fifth picture, wherein the fifth picture is a code among the plurality of pictures. The picture in the order that is later than the first picture. Here, the sixth picture is a picture in which the coding order is earlier than the fifth picture in the plurality of pictures.

此時,電路160在規定的情形下,也可禁止參考有關聯於第3圖片之第3濾波資訊來作為第6濾波資訊。在此,規定的情形為:第1圖片的NAL單元類型為規定NAL單元類型,且第5圖片的暫時ID與第1圖片的暫時ID相同的情形。然後,電路160亦可使用已決定的第5濾波資訊,對第5圖片適用自適應迴路濾波。At this time, the circuit 160 may prohibit the reference to the third filter information associated with the third picture as the sixth filter information in a predetermined case. Here, the predetermined case is a case where the NAL unit type of the first picture is a predetermined NAL unit type, and the temporary ID of the fifth picture is the same as the temporary ID of the first picture. Circuit 160 can also apply adaptive loop filtering to the fifth picture using the determined fifth filtering information.

依此,編碼裝置100可參考第6圖片的第6濾波資訊,來決定第5圖片的第5濾波資訊,前述第5圖片為編碼順序上較第1圖片還後面之中與第1圖片相同階層的圖片。此時,編碼裝置100可禁止參考與規定NAL單元類型的第1圖片相同階層的第3圖片之第3濾波資訊來作為第6濾波資訊。Accordingly, the encoding apparatus 100 can determine the fifth filtering information of the fifth picture by referring to the sixth filtering information of the sixth picture, and the fifth picture is the same level as the first picture in the coding order compared with the first picture. picture of. At this time, the encoding apparatus 100 can prohibit the reference to the third filter information of the third picture having the same level as the first picture of the predetermined NAL unit type as the sixth filter information.

即,編碼裝置100在較規定NAL單元類型的第1圖片還後面,且與第1圖片相同的階層之中,和可對較第1圖片還前面的圖片所進行的參考限制一樣,能對濾波資訊進行參考限制。因此,編碼裝置100可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。That is, the encoding apparatus 100 can perform filtering on the same level as the first picture of the predetermined NAL unit type and in the same level as the first picture, as well as the reference restriction on the picture preceding the first picture. Information for reference restrictions. Therefore, the encoding device 100 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

又,例如規定NAL單元類型也可為STSA圖片的NAL單元類型。Also, for example, the NAL unit type may be specified as the NAL unit type of the STSA picture.

依此,和可對與STSA圖片相同階層的圖片進行的參考限制一樣,編碼裝置100可對與STSA圖片相同階層的圖片的濾波資訊進行參考限制。因此,編碼裝置100可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding apparatus 100 can refer to the filtering information of the picture of the same level as the STSA picture as the reference limit of the picture of the same level as the STSA picture. Therefore, the encoding device 100 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

圖24是顯示圖22所示的編碼裝置100的第2動作例的流程圖。例如圖22所示的編碼裝置100是在將含有複數張圖片之動態圖像編碼之際,進行圖24所示的動作,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID。具體來說,電路160使用記憶體162進行以下的動作。FIG. 24 is a flowchart showing a second operation example of the encoding device 100 shown in FIG. 22. For example, the encoding apparatus 100 shown in FIG. 22 performs an operation shown in FIG. 24 when encoding a moving image including a plurality of pictures, wherein the pictures are assigned and displayed with a temporary ID of a level with respect to time adjustability. . Specifically, the circuit 160 performs the following operations using the memory 162.

首先,電路160將複數個參數組合編碼,前述參數組合分別被分配0來作為顯示有關於時間可調性的階層之暫時ID(S801)。然後,在複數個參數組合之編碼之後,電路160將複數張圖片之中編碼順序上為最初的圖片編碼(S802)。First, the circuit 160 combines and encodes a plurality of parameters, and the combination of the above parameters is assigned 0 as a temporary ID indicating a hierarchy with respect to time adjustability (S801). Then, after encoding of the plurality of parameter combinations, the circuit 160 encodes the first picture in the order of encoding among the plurality of pictures (S802).

在此,複數個參數組合分別對應於由被分配於複數張圖片之複數個暫時ID所顯示的複數個階層。又,複數個參數組合的每個是相對於1張以上的圖片之參數組合,前述1張以上的圖片為複數張圖片之中被分配顯示前述參數組合所對應的階層之暫時ID的圖片。Here, the plurality of parameter combinations respectively correspond to a plurality of levels displayed by a plurality of temporary IDs assigned to the plurality of pictures. Further, each of the plurality of parameter combinations is a parameter combination with respect to one or more pictures, and the one or more pictures are pictures in which a temporary ID of a hierarchy corresponding to the parameter combination is assigned among the plurality of pictures.

依此,編碼裝置100可以在一開始匯集對應於複數個階層的每個階層之複數個參數組合後再編碼。又,對複數個參數組合分別分配0來作為暫時ID。因此,可在不廢棄的狀態下適當地處理複數個參數組合。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding apparatus 100 can recombine a plurality of parameter combinations corresponding to each of the plurality of levels at the beginning. Further, 0 is assigned to each of the plurality of parameter combinations as the temporary ID. Therefore, a plurality of parameter combinations can be appropriately handled in a state of not being discarded. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

例如複數張圖片也可構成第1圖片群。又,複數個參數組合也可構成第1參數組合群。又,動態圖像也可更含有構成第2圖片群的複數張圖片。並且,電路160也可在構成第1圖片群的圖片之編碼之後,將構成第2參數組合群之複數個參數組合編碼。For example, a plurality of pictures may also constitute a first picture group. Further, a plurality of parameter combinations may also constitute a first parameter combination group. Further, the moving image may further include a plurality of pictures constituting the second picture group. Further, the circuit 160 may combine and encode a plurality of parameters constituting the second parameter combination group after encoding the picture constituting the first picture group.

在此,構成第2參數組合群的複數個參數組合也可為分別被分配0來作為暫時ID的複數個參數組合,前述暫時ID顯示有關於時間可調性之階層。又,構成第2參數組合群的複數個參數組合也可分別對應於複數個暫時ID所顯示的複數個階層,前述暫時ID被分配於構成第2圖片群的複數張圖片。Here, the plurality of parameter combinations constituting the second parameter combination group may be a plurality of parameter combinations each assigned 0 as a temporary ID, and the temporary ID display has a hierarchy of time adjustability. Further, the plurality of parameter combinations constituting the second parameter combination group may correspond to a plurality of levels displayed by the plurality of temporary IDs, and the temporary IDs are allocated to the plurality of pictures constituting the second picture group.

又,構成第2參數組合群的各參數組合也可為相對於1張以上的圖片的參數組合,前述1張以上的圖片為第2圖片群的複數張圖片之中被分配顯示前述參數組合所對應的階層之暫時ID的圖片。Further, each parameter combination constituting the second parameter combination group may be a parameter combination with respect to one or more pictures, and the one or more pictures are assigned and displayed in the plurality of pictures of the second picture group. A picture of the temporary ID of the corresponding hierarchy.

又,電路160也可在構成第2參數組合群之複數個參數組合之編碼之後,將構成第2圖片群之複數張圖片之中編碼順序上為最初的圖片編碼。Further, the circuit 160 may encode the first picture in the coding order of the plurality of pictures constituting the second picture group after the coding of the plurality of parameter combinations constituting the second parameter combination group.

依此,編碼裝置100可對每圖片群,在一開始匯集對應於複數個階層的每個階層之複數個參數組合後再編碼。藉此,編碼裝置100可對每圖片群,適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding apparatus 100 can recombine a plurality of parameters corresponding to each of the plurality of levels at the beginning for each group of pictures. Thereby, the encoding device 100 can appropriately set information related to the encoding of the moving image for each group of pictures.

圖25是顯示圖22所示的編碼裝置100的第3動作例的流程圖。例如圖22所示的編碼裝置100是在將含有複數張圖片之動態圖像編碼之際,進行圖25所示的動作。具體來說,電路160使用記憶體162進行以下的動作。FIG. 25 is a flowchart showing a third operation example of the encoding device 100 shown in FIG. 22. For example, the encoding apparatus 100 shown in FIG. 22 performs the operation shown in FIG. 25 when encoding a moving image including a plurality of pictures. Specifically, the circuit 160 performs the following operations using the memory 162.

首先,電路160將複數張圖片之中的第1圖片編碼(S901)。接著,電路160進行第1動作或者第2動作(S902)。此時,當第2圖片為規定圖片時,電路160進行第1動作。First, the circuit 160 encodes the first picture among the plurality of pictures (S901). Next, the circuit 160 performs a first operation or a second operation (S902). At this time, when the second picture is a predetermined picture, the circuit 160 performs the first operation.

在此,第1動作意指如下動作:在第1圖片之編碼之後,將相對於第2圖片的參數組合編碼,且在相對於第2圖片的參數組合之編碼之後,將第2圖片編碼。又,第2動作意指如下動作:在第1圖片之編碼之後,在不將相對於第2圖片的參數組合編碼的狀態下,將第2圖片編碼。又,第2圖片是複數張圖片之中編碼順序上較第1圖片還後面的圖片。Here, the first operation means an operation of encoding the parameters of the second picture after the encoding of the first picture, and encoding the second picture after the encoding of the parameter combination with the second picture. Further, the second operation means an operation of encoding the second picture without coding the parameters of the second picture after the coding of the first picture. Further, the second picture is a picture in which the coding order is later than the first picture in the plurality of pictures.

依此,編碼裝置100能在規定圖片之前,將相對於規定圖片的參數組合編碼。因此,在相對於規定圖片的向上切換等之中,能適當地處理相對於規定圖片的參數組合。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device 100 can encode the parameters of the predetermined picture in combination before the picture is specified. Therefore, among the upward switching with respect to the predetermined picture or the like, the parameter combination with respect to the predetermined picture can be appropriately processed. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

例如前述規定圖片也可為TSA圖片。依此,編碼裝置100可在TSA圖片之前,將相對於TSA圖片之參數組合編碼。因此,在相對於TSA圖片之向上切換等之中,能適當地處理相對於TSA圖片之參數組合。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。For example, the aforementioned prescribed picture may also be a TSA picture. Accordingly, the encoding device 100 can encode the parameters relative to the TSA picture in combination before the TSA picture. Therefore, among the upward switching with respect to the TSA picture or the like, the parameter combination with respect to the TSA picture can be appropriately processed. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

又,例如複數張圖片的每張也可為被分配顯示有關於時間可調性的階層之暫時ID的圖片。接著,電路160也可在第1動作中,在第1圖片的編碼之後,將含有相對於第2圖片的參數組合之複數個參數組合即複數個關聯參數組合編碼,且在複數個關聯參數組合之編碼之後,將第2圖片編碼。Further, for example, each of the plurality of pictures may be a picture to which a temporary ID of a hierarchy showing time adjustability is assigned. Next, in the first operation, the circuit 160 may combine a plurality of parameter combinations including a plurality of parameters combined with parameters of the second picture, that is, a plurality of associated parameters, and combine the plurality of associated parameters in the first operation. After the encoding, the second picture is encoded.

在此,複數個關聯參數組合分別對應於由被分配給第2圖片的暫時ID以上之複數個暫時ID所顯示的複數個階層。又,複數個關聯參數組合的每個為相對於1張以上的圖片之參數組合,前述1張以上的圖片為複數張圖片之中被分配顯示前述關聯參數組合所對應的階層之暫時ID的圖片。Here, the plurality of association parameter combinations respectively correspond to a plurality of levels displayed by a plurality of temporary IDs assigned to the temporary ID of the second picture. Further, each of the plurality of associated parameter combinations is a parameter combination with respect to one or more pictures, and the one or more pictures are pictures in which a temporary ID of a hierarchy corresponding to the associated parameter combination is assigned among the plurality of pictures. .

依此,編碼裝置100能在規定圖片之前,將相對於複數張圖片的複數個參數組合編碼,前述圖片分別是暫時ID與規定圖片相同,或者暫時ID大於規定圖片。因此,在相對於暫時ID大於規定圖片的圖片之向上切換等之中,能適當地處理參數組合。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device 100 can encode a plurality of parameters relative to the plurality of pictures before the predetermined picture, wherein the picture is the same as the predetermined picture, or the temporary ID is larger than the predetermined picture. Therefore, the parameter combination can be appropriately handled in the upward switching with respect to the picture whose temporary ID is larger than the predetermined picture. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

又,例如規定圖片也可為STSA圖片。依此,編碼裝置100可在STSA圖片之前,將相對於STSA圖片之參數組合編碼。因此,在相對於STSA圖片之向上切換等之中,能適當地處理相對於STSA圖片之參數組合。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。Further, for example, the predetermined picture may be an STSA picture. Accordingly, the encoding device 100 can encode the parameters of the STSA picture in combination before the STSA picture. Therefore, the parameter combination with respect to the STSA picture can be appropriately handled among the upward switching with respect to the STSA picture or the like. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

又,例如第2圖片也可為複數張圖片之中在第1圖片的下一張被編碼的圖片。依此,編碼裝置100可在剛要將規定圖片編碼之前,將相對於規定圖片的參數組合適當地編碼。因此,能適當地處理相對於規定圖片之參數組合。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。Further, for example, the second picture may be a picture encoded in the next picture of the first picture among the plurality of pictures. Accordingly, the encoding device 100 can appropriately encode the parameter combination with respect to the predetermined picture just before encoding the prescribed picture. Therefore, the parameter combination with respect to the prescribed picture can be handled appropriately. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

又,例如複數張圖片的每張也可為被分配顯示有關於時間可調性的階層之暫時ID的圖片。Further, for example, each of the plurality of pictures may be a picture to which a temporary ID of a hierarchy showing time adjustability is assigned.

接著,電路160也可在將複數張圖片之中編碼順序上為最初的圖片編碼之前,將含有相對於第2圖片之參數組合的複數個參數組合即複數個概括參數組合編碼。Next, the circuit 160 may combine and encode a plurality of parameter combinations, that is, a plurality of parameter combinations that are combined with the parameters of the second picture, before encoding the first picture in the coding order.

在此,複數個概括參數組合分別對應於由被分配於複數張圖片之複數個暫時ID所顯示的複數個階層。又,複數個概括參數組合的每個為相對於1張以上的圖片之參數組合,前述1張以上的圖片為複數張圖片之中被分配顯示前述概括參數組合所對應的階層之暫時ID的圖片。Here, the plurality of summary parameter combinations respectively correspond to a plurality of levels displayed by a plurality of temporary IDs assigned to the plurality of pictures. Further, each of the plurality of summary parameter combinations is a parameter combination with respect to one or more pictures, and the one or more pictures are pictures in which a temporary ID of a hierarchy corresponding to the summary parameter combination is assigned among the plurality of pictures. .

依此,就算含有相對於規定圖片的參數組合之複數個參數組合一開始已被編碼時,編碼裝置100也可在規定圖片之前,再度將相對於規定圖片之參數組合編碼。因此,能適當地處理相對於規定圖片之參數組合。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, even if a plurality of parameter combinations including a parameter combination with respect to a predetermined picture are initially encoded, the encoding apparatus 100 can again encode the parameters of the predetermined picture in combination before specifying the picture. Therefore, the parameter combination with respect to the prescribed picture can be handled appropriately. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

又,例如規定圖片也可為TSA圖片或者是STSA圖片。又,例如在第2圖片為規定圖片時,電路160也可禁止第2動作。Further, for example, the predetermined picture may be a TSA picture or an STSA picture. Further, for example, when the second picture is a predetermined picture, the circuit 160 may prohibit the second operation.

圖26是顯示圖22所示的編碼裝置100的第4動作例之流程圖。例如將含有複數張圖片的動態圖像編碼時,圖22所示的編碼裝置100進行圖26所示的動作,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID。具體來說,電路160使用記憶體162,進行以下的動作。FIG. 26 is a flowchart showing a fourth operation example of the encoding device 100 shown in FIG. 22. For example, when encoding a moving image including a plurality of pictures, the encoding apparatus 100 shown in Fig. 22 performs an operation shown in Fig. 26 in which the aforementioned pictures are assigned a temporary ID of a hierarchy with respect to time adjustability. Specifically, the circuit 160 uses the memory 162 to perform the following operations.

首先,電路160將複數張圖片之中的第1圖片編碼(S1001)。接著,電路160進行第1動作或者第2動作(S1002)。此時,當被分配於第2圖片的暫時ID大於最小的暫時ID,且小於最大的暫時ID時,電路160進行第1動作。First, the circuit 160 encodes the first picture among the plurality of pictures (S1001). Next, the circuit 160 performs the first operation or the second operation (S1002). At this time, when the temporary ID assigned to the second picture is larger than the minimum temporary ID and smaller than the maximum temporary ID, the circuit 160 performs the first operation.

在此,第1動作意指如下動作­­­­:在第1圖片之編碼之後,將相對於第2圖片之參數組合編碼,在相對於第2圖片之參數組合的編碼之後,將第2圖片編碼。又,第2動作意指如下動作:在第1圖片之編碼之後,在不將相對於第2圖片的參數組合編碼之狀態下,將第2圖片編碼。又,第2圖片為複數張圖片之中編碼順序上較第1圖片還後面的圖片。Here, the first operation means an operation in which, after encoding of the first picture, the parameters of the second picture are combined and encoded, and after encoding with respect to the parameter combination of the second picture, the second picture is encoded. Further, the second operation means an operation of encoding the second picture without coding the parameters of the second picture after the coding of the first picture. Further, the second picture is a picture in which the coding order is later than the first picture in the plurality of pictures.

又,最小的暫時ID為被分配於複數張圖片的複數個暫時ID之中最小的暫時ID。又,最大的暫時ID為被分配於複數張圖片的複數個暫時ID之中最大的暫時ID。Further, the smallest temporary ID is the smallest temporary ID among the plurality of temporary IDs assigned to the plurality of pictures. Further, the largest temporary ID is the largest temporary ID among the plurality of temporary IDs assigned to the plurality of pictures.

依此,編碼裝置100可在中間層之圖片之前將相對於中間層之圖片的參數組合編碼。因此,在相對於中間層之圖片的向上切換等之中,能適當地處理相對於中間層的圖片之參數組合。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。Accordingly, the encoding device 100 can encode the parameters of the picture relative to the intermediate layer in combination before the picture of the intermediate layer. Therefore, among the upward switching or the like with respect to the picture of the intermediate layer, the parameter combination of the picture with respect to the intermediate layer can be appropriately processed. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

例如在被分配於第2圖片的暫時ID為最大的暫時ID時,電路160也可進行第1動作。依此,編碼裝置100在最上位層的圖片之前,可將相對於最上位層的圖片之參數組合編碼。因此,在相對於最上位層的圖片之向上切換等之中,可適當地處理相對於最上位層的圖片之參數組合。藉此,編碼裝置100可適當地設定與動態圖像之編碼有關聯的資訊。For example, when the temporary ID assigned to the second picture is the largest temporary ID, the circuit 160 may perform the first operation. Accordingly, the encoding device 100 can combine the parameters of the picture with respect to the uppermost layer before the picture of the uppermost layer. Therefore, among the upward switching of the picture with respect to the uppermost layer, the parameter combination with respect to the picture of the uppermost layer can be appropriately processed. Thereby, the encoding device 100 can appropriately set the information associated with the encoding of the moving image.

又,例如電路160也可在規定的情形下所進行的第1動作中,在第1圖片之編碼之後,將相對於第2圖片之參數組合及最上位參數組合編碼。然後,電路160也可在相對於第2圖片之參數組合及最上位參數組合之編碼之後,將第2圖片編碼。Further, for example, in the first operation performed in a predetermined situation, the circuit 160 may combine the parameter combination and the highest parameter with respect to the second picture after the encoding of the first picture. Then, the circuit 160 may encode the second picture after the combination of the parameter combination of the second picture and the combination of the highest order parameters.

在此,規定的情形是指被分配於第2圖片的暫時ID為複數個暫時ID之中第2大的暫時ID的情形。又,最上位參數組合是相對於被分配最大的暫時ID的1張以上的圖片之參數組合。Here, the predetermined case refers to a case where the temporary ID assigned to the second picture is the second largest temporary ID among the plurality of temporary IDs. Further, the combination of the topmost parameters is a parameter combination of one or more pictures with the largest temporary ID assigned.

依此,編碼裝置100能將包含有相對於最上位層的圖片的參數組合之2個參數組合有效率地編碼。Accordingly, the encoding device 100 can efficiently encode two parameter combinations including parameters of the picture with respect to the highest layer.

又,例如當被分配於第2圖片的暫時ID為最大的暫時ID時,電路160也可進行第2動作。依此,編碼裝置100可省略如下動作,即,在最上位層的圖片之前將相對於最上位層的圖片的參數組合編碼。Further, for example, when the temporary ID assigned to the second picture is the largest temporary ID, the circuit 160 may perform the second operation. Accordingly, the encoding apparatus 100 can omit the combination of encoding the parameters of the picture of the highest layer before the picture of the uppermost layer.

又,例如在規定條件下,被分配於第2圖片的暫時ID大於最小的暫時ID,且小於最大的暫時ID時,電路160也可進行第1動作。在此,規定條件意指如下條件:相對於複數張圖片的序列參數組合所含的規定旗標為規定值。藉此,編碼裝置100在規定的序列中,在中間層之圖片之前,能將相對於中間層之圖片的參數組合適當地編碼。Further, for example, under the predetermined condition, when the temporary ID assigned to the second picture is larger than the smallest temporary ID and smaller than the maximum temporary ID, the circuit 160 may perform the first operation. Here, the predetermined condition means a condition that a predetermined flag included in a sequence parameter combination with respect to a plurality of pictures is a predetermined value. Thereby, the encoding apparatus 100 can appropriately encode the parameter combination with respect to the picture of the intermediate layer in the predetermined sequence before the picture of the intermediate layer.

又,例如在所謂規定旗標為規定值之條件下,複數張圖片的每張在被分配於前述圖片的暫時ID不是最小的暫時ID時,也可為TSA圖片。依此,編碼裝置100在除了最下位層以外皆由TSA圖片所構成的規定的序列中,在中間層之圖片之前能將相對於中間層之圖片的參數組合適當地編碼。Further, for example, when the predetermined flag is a predetermined value, each of the plurality of pictures may be a TSA picture when the temporary ID assigned to the picture is not the smallest temporary ID. Accordingly, in the predetermined sequence in which the encoding apparatus 100 is composed of TSA pictures except for the lowermost layer, the parameter combination with respect to the picture of the intermediate layer can be appropriately encoded before the picture of the intermediate layer.

又,例如當被分配於第2圖片的暫時ID大於最小的暫時ID,且小於最大的暫時ID時,電路160也可禁止第2動作。又,例如當被分配於第2圖片的暫時ID為最大的暫時ID時,電路160也可禁止第2動作。又,例如電路160也可在規定條件下,依照被分配於第2圖片的暫時ID來禁止第2動作。
[解碼裝置的安裝例]
Further, for example, when the temporary ID assigned to the second picture is larger than the minimum temporary ID and smaller than the maximum temporary ID, the circuit 160 may prohibit the second operation. Further, for example, when the temporary ID assigned to the second picture is the largest temporary ID, the circuit 160 may prohibit the second operation. Further, for example, the circuit 160 may prohibit the second operation in accordance with the temporary ID assigned to the second picture under predetermined conditions.
[Installation example of decoding device]

圖27是顯示解碼裝置200之安裝例之方塊圖。解碼裝置200包含有電路260及記憶體262。例如,圖10所示之解碼裝置200之複數個構成要素是透過圖27所示之電路260及記憶體262來安裝。FIG. 27 is a block diagram showing an example of mounting of the decoding device 200. The decoding device 200 includes a circuit 260 and a memory 262. For example, a plurality of components of the decoding device 200 shown in FIG. 10 are mounted through the circuit 260 and the memory 262 shown in FIG.

電路260是可對記憶體262進行存取的電子電路,且進行資訊處理。例如,電路260是使用記憶體262將動態圖像解碼之專用或者通用的電子電路。電路260也可為如CPU般之處理器。又,電路260也可為複數個電子電路的集合體。The circuit 260 is an electronic circuit that can access the memory 262 and performs information processing. For example, circuit 260 is a dedicated or general purpose electronic circuit that decodes moving images using memory 262. Circuit 260 can also be a CPU-like processor. Also, circuit 260 can be an aggregate of a plurality of electronic circuits.

又,例如,電路260也可展現圖10所示之解碼裝置200之複數個構成要素中除了用以記憶資訊的構成要素之外的複數個構成要素的作用。即,電路260也可進行上述的動作,作為該等構成要素的動作。Further, for example, the circuit 260 may also function as a plurality of constituent elements other than the constituent elements for storing information among the plurality of constituent elements of the decoding apparatus 200 shown in FIG. In other words, the circuit 260 can perform the above-described operations as operations of the components.

記憶體262是專用或者通用的記憶體,記憶電路260用以將動態圖像解碼之資訊。記憶體262可為電子電路,也可連接於電路260,也可包含在電路260。The memory 262 is a dedicated or general purpose memory, and the memory circuit 260 is used to decode the dynamic image. The memory 262 can be an electronic circuit, can be connected to the circuit 260, or can be included in the circuit 260.

又,記憶體262也可為複數個電子電路的集合體,也可以複數個次記憶體構成。又,記憶體262也可為磁碟或者是光碟等,也可表現為儲存器(storage)或者是記錄媒體等。又,記憶體262可為非揮發性記憶體,也可為揮發性記憶體。Further, the memory 262 may be an aggregate of a plurality of electronic circuits or a plurality of secondary memories. Further, the memory 262 may be a magnetic disk or a compact disk, or may be embodied as a storage or a recording medium. Moreover, the memory 262 can be a non-volatile memory or a volatile memory.

例如記憶體262也可展現在圖10所示的解碼裝置200之複數個構成要素之中用以記憶資訊之構成要素的作用。具體來說,記憶體262也可展現圖10所示之區塊記憶體210、框記憶體214、當前濾波資訊記憶部232及參考濾波資訊記憶部233的作用。For example, the memory 262 can also function as a constituent element for storing information among a plurality of constituent elements of the decoding device 200 shown in FIG. Specifically, the memory 262 can also function as the block memory 210, the frame memory 214, the current filter information storage unit 232, and the reference filter information storage unit 233 shown in FIG.

又,記憶體262也可記憶對應於已被編碼的動態圖像的位元列,也可記憶已被解碼的動態圖像。又,記憶體262也可記憶用於電路260將動態圖像解碼的程式。Further, the memory 262 can also memorize the bit string corresponding to the encoded moving image, and can also memorize the decoded moving image. Also, the memory 262 can also store a program for the circuit 260 to decode the moving image.

另,在解碼裝置200中,也可不用安裝圖10所示的複數個構成要素全部,也可不用進行上述之複數個處理全部。圖10所示的複數個構成要素之一部分也可包含在其他裝置,上述之複數個處理之一部分也可透過其他裝置來執行。然後,在解碼裝置200中,安裝圖10所示的複數個構成要素之中的一部分,且進行上述之複數個處理的一部分,藉此,可適當地設定與動態圖像之解碼有關聯的資訊。Further, in the decoding device 200, it is not necessary to install all of the plurality of constituent elements shown in FIG. 10, and it is not necessary to perform all of the above-described plural processing. One of the plurality of components shown in FIG. 10 may be included in other devices, and one of the plurality of processes described above may also be executed by other devices. Then, in the decoding device 200, a part of the plurality of constituent elements shown in FIG. 10 is mounted, and a part of the plurality of processing described above is performed, whereby information related to decoding of the moving image can be appropriately set. .

圖28是顯示圖27所示的解碼裝置200的第1動作例的流程圖。例如圖27所示的解碼裝置200是在含有複數張圖片之動態圖像的解碼中適用自適應迴路濾波之際,進行圖28所示的動作,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID。具體來說,電路260使用記憶體262進行以下的動作。FIG. 28 is a flowchart showing a first operation example of the decoding device 200 shown in FIG. 27. For example, the decoding apparatus 200 shown in FIG. 27 performs an operation shown in FIG. 28 when adaptive loop filtering is applied to decoding of a moving picture including a plurality of pictures, wherein the pictures are respectively assigned and displayed with respect to time adjustment. Temporary ID of the sex class. Specifically, the circuit 260 performs the following operations using the memory 262.

首先,電路260參考有關聯於第2圖片之第2濾波資訊,決定用來對複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊 (S1101)。在此,第2圖片為複數張圖片之中在解碼順序上較第1圖片更前面的圖片。First, the circuit 260 determines the first filter information for applying adaptive loop filtering to the first picture among the plurality of pictures with reference to the second filter information associated with the second picture (S1101). Here, the second picture is a picture in front of the first picture in the decoding order among the plurality of pictures.

此時,當第1圖片的NAL單元類型為規定NAL單元類型時,電路260禁止參考有關聯於第3圖片之第3濾波資訊來作為第2濾波資訊。在此,第3圖片為複數張圖片之中解碼順序上較第1圖片更前面的圖片,且為暫時ID與第1圖片相同的圖片。接著,電路260使用已決定的第1濾波資訊,對第1圖片適用自適應迴路濾波(S1102)。At this time, when the NAL unit type of the first picture is a predetermined NAL unit type, the circuit 260 prohibits the reference to the third filter information associated with the third picture as the second filter information. Here, the third picture is a picture in which the decoding order is earlier than the first picture among the plurality of pictures, and is a picture in which the temporary ID is the same as the first picture. Next, the circuit 260 applies adaptive loop filtering to the first picture using the determined first filter information (S1102).

依此,解碼裝置200可參考第2圖片的第2濾波資訊,來決定第1圖片的第1濾波資訊。此時,解碼裝置200可禁止參考與規定NAL單元類型的第1圖片相同階層的第3圖片之第3濾波資訊來作為第2濾波資訊。Accordingly, the decoding device 200 can determine the first filter information of the first picture by referring to the second filter information of the second picture. At this time, the decoding device 200 can prohibit the reference to the third filter information of the third picture having the same level as the first picture of the predetermined NAL unit type as the second filter information.

即,和可對與規定NAL單元類型的第1圖片相同階層的圖片所進行的參考限制一樣,解碼裝置200能對與規定NAL單元類型的第1圖片相同階層的圖片之濾波資訊進行參考限制。因此,解碼裝置200可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。That is, the decoding apparatus 200 can refer to the filtering information of the picture of the same level as the first picture of the predetermined NAL unit type, similarly to the reference restriction of the picture of the same level as the first picture of the predetermined NAL unit type. Therefore, the decoding device 200 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

例如也可在第1濾波資訊之決定中,電路260禁止參考有關聯於第4圖片之第4濾波資訊來作為第2濾波資訊。在此,第4圖片是複數張圖片之中解碼順序上較第1圖片還前面的圖片,且為暫時ID大於第1圖片的圖片。For example, in the determination of the first filter information, the circuit 260 may prohibit the reference to the fourth filter information associated with the fourth picture as the second filter information. Here, the fourth picture is a picture in front of the first picture in the decoding order among the plurality of pictures, and is a picture in which the temporary ID is larger than the first picture.

依此,在參考第2圖片的第2濾波資訊,來決定第1圖片的第1濾波資訊之際,得禁止參考暫時ID較第1圖片大的第4圖片之第4濾波資訊來作為第2濾波資訊。According to this, when the first filter information of the first picture is determined with reference to the second filter information of the second picture, the fourth filter information of the fourth picture whose reference temporary ID is larger than the first picture is prohibited from being used as the second Filter information.

因此,解碼裝置200在時間可調性之中,和對圖片所進行的參考限制一樣,可對關聯於圖片的濾波資訊進行參考限制。藉此,解碼裝置200可適當地限制來設定要參考的濾波資訊。Therefore, the decoding apparatus 200 can make reference restrictions on the filtering information associated with the picture, among the time adjustability, as well as the reference limitation on the picture. Thereby, the decoding device 200 can appropriately limit the setting of the filter information to be referred to.

又,例如電路260也可參考有關聯於第6圖片之第6濾波資訊,決定用來對第5圖片適用自適應迴路濾波之第5濾波資訊,其中前述第5圖片是複數張圖片之中解碼順序上較第1圖片還後面的圖片。在此,第6圖片是複數張圖片之中解碼順序上較第5圖片還前面的圖片。For example, the circuit 260 may also refer to the sixth filtering information associated with the sixth picture to determine the fifth filtering information for applying the adaptive loop filtering to the fifth picture, wherein the fifth picture is a decoding of the plurality of pictures. The picture in the order that is later than the first picture. Here, the sixth picture is a picture in front of the fifth picture in the decoding order among the plurality of pictures.

此時,當第1圖片的NAL單元類型為規定NAL單元類型時,電路260也可禁止參考有關聯於第3圖片之第3濾波資訊來作為第6濾波資訊。接著,電路260也可使用已決定的第5濾波資訊,對第5圖片適用自適應迴路濾波。At this time, when the NAL unit type of the first picture is a predetermined NAL unit type, the circuit 260 may also prohibit the reference to the third filter information associated with the third picture as the sixth filter information. Next, the circuit 260 can also apply adaptive loop filtering to the fifth picture using the determined fifth filtering information.

依此,解碼裝置200可參考第6圖片的第6濾波資訊,來決定解碼順序上較第1圖片還後面的第5圖片的第5濾波資訊。此時,解碼裝置200可禁止參考與規定NAL單元類型的第1圖片相同階層的第3圖片之第3濾波資訊來作為第6濾波資訊。Accordingly, the decoding device 200 can refer to the sixth filter information of the sixth picture to determine the fifth filter information of the fifth picture that is later than the first picture in the decoding order. At this time, the decoding apparatus 200 can prohibit the reference to the third filter information of the third picture having the same level as the first picture of the predetermined NAL unit type as the sixth filter information.

即,解碼裝置200在較規定NAL單元類型的第1圖片還後面之中,和可對與第1圖片相同階層的圖片進行的參考限制一樣,能對與第1圖片相同階層的圖片的濾波資訊進行參考限制。因此,解碼裝置200可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。In other words, the decoding apparatus 200 can filter the information of the same-level picture as the first picture, even after the first picture of the predetermined NAL unit type, and the reference restriction of the picture of the same level as the first picture. Make reference restrictions. Therefore, the decoding device 200 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

又,例如也可在第5濾波資訊之決定中,當第1圖片的NAL單元類型為規定NAL單元類型時,電路260禁止參考有關聯於第4圖片之第4濾波資訊來作為第6濾波資訊。在此,第4圖片是複數張圖片之中解碼順序上較第1圖片還前面的圖片,且為暫時ID大於第1圖片的圖片。Further, for example, in the determination of the fifth filter information, when the NAL unit type of the first picture is a predetermined NAL unit type, the circuit 260 prohibits the reference to the fourth filtered information associated with the fourth picture as the sixth filtered information. . Here, the fourth picture is a picture in front of the first picture in the decoding order among the plurality of pictures, and is a picture in which the temporary ID is larger than the first picture.

依此,在參考第6圖片的第6濾波資訊來決定第5圖片的第5濾波資訊之際,得禁止參考暫時ID較第1圖片還大的第4圖片之第4濾波資訊來作為第5濾波資訊。Accordingly, when the fifth filter information of the fifth picture is determined with reference to the sixth filter information of the sixth picture, the fourth filter information of the fourth picture whose reference temporary ID is larger than the first picture is prohibited from being used as the fifth. Filter information.

即,解碼裝置200在較規定NAL單元類型的第1圖片還後面之中,和可對暫時ID大於第1圖片的圖片進行的參考限制一樣,能對濾波資訊進行參考限制。因此,解碼裝置200可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。That is, the decoding apparatus 200 can refer to the filtering information in the same manner as the reference restriction of the picture having the temporary ID larger than the first picture, even after the first picture of the predetermined NAL unit type. Therefore, the decoding device 200 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

又,例如在第1濾波資訊之決定中,電路260也可在規定的情形下,禁止參考有關聯於第7圖片之第7濾波資訊來作為第2濾波資訊。Further, for example, in the determination of the first filter information, the circuit 260 may prohibit the reference to the seventh filter information associated with the seventh picture as the second filter information in a predetermined case.

在此,規定的情形為:第1圖片與第7圖片之間存在有第8圖片,且第8圖片的NAL單元類型為規定NAL單元類型的情形。又,第7圖片是複數張圖片之中解碼順序上較第1圖片還前面的圖片且為暫時ID大於0的圖片。又,第8圖片是暫時ID與第7圖片相同或者暫時ID小於第7圖片的圖片。Here, the predetermined case is a case where the eighth picture exists between the first picture and the seventh picture, and the NAL unit type of the eighth picture is a predetermined NAL unit type. Further, the seventh picture is a picture in which the decoding order is higher than the first picture in the decoding order and the temporary ID is greater than 0. Further, the eighth picture is a picture in which the temporary ID is the same as the seventh picture or the temporary ID is smaller than the seventh picture.

依此,解碼裝置200可禁止參考第7濾波資訊來作為第2濾波資訊,前述第7濾波資訊是在較規定NAL單元類型的第8圖片還後面之中,暫時ID等於或者大於第8圖片的第7圖片的濾波資訊。Accordingly, the decoding apparatus 200 can prohibit the reference to the seventh filtering information as the second filtering information, wherein the seventh filtering information is later than the eighth picture of the predetermined NAL unit type, and the temporary ID is equal to or larger than the eighth picture. Filter information of the 7th picture.

即,解碼裝置200在較規定NAL單元類型的第8圖片還後面之中,和可對第7圖片進行的參考限制一樣,能對第7圖片的第7濾波資訊進行參考限制。因此,解碼裝置200可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。That is, the decoding apparatus 200 can perform reference restriction on the seventh filter information of the seventh picture, even after the eighth picture of the predetermined NAL unit type, as well as the reference restriction that can be performed on the seventh picture. Therefore, the decoding device 200 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

又,例如規定NAL單元類型也可為TSA圖片的NAL單元類型。Also, for example, the NAL unit type may be defined as a NAL unit type of a TSA picture.

依此,和可對與TSA圖片相同階層的圖片進行的參考限制一樣,解碼裝置200可對與TSA圖片相同階層的圖片的濾波資訊進行參考限制。因此,解碼裝置200可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding apparatus 200 can refer to the filtering information of the picture of the same level as the TSA picture as the reference limit of the picture of the same level as the TSA picture. Therefore, the decoding device 200 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

又,例如電路260參考有關聯於第6圖片之第6濾波資訊,決定用來對第5圖片適用自適應迴路濾波之第5濾波資訊,其中前述第5圖片是複數張圖片之中解碼順序上較第1圖片還後面的圖片。在此,第6圖片是複數張圖片之中解碼順序上較第5圖片還前面的圖片。Further, for example, the circuit 260 refers to the sixth filtering information associated with the sixth picture, and determines the fifth filtering information for applying the adaptive loop filtering to the fifth picture, wherein the fifth picture is the decoding order among the plurality of pictures. The picture behind the first picture. Here, the sixth picture is a picture in front of the fifth picture in the decoding order among the plurality of pictures.

此時,電路260在規定的情形下,也可禁止參考有關聯於第3圖片之第3濾波資訊來作為第6濾波資訊。在此,規定的情形為:第1圖片的NAL單元類型為規定NAL單元類型,且第5圖片的暫時ID與第1圖片的暫時ID相同的情形。接著,電路260也可使用已決定的第5濾波資訊,對第5圖片適用自適應迴路濾波。At this time, in a predetermined case, the circuit 260 may prohibit the reference to the third filter information associated with the third picture as the sixth filter information. Here, the predetermined case is a case where the NAL unit type of the first picture is a predetermined NAL unit type, and the temporary ID of the fifth picture is the same as the temporary ID of the first picture. Next, the circuit 260 can also apply adaptive loop filtering to the fifth picture using the determined fifth filtering information.

依此,解碼裝置200可參考第6圖片的第6濾波資訊,來決定第5圖片的第5濾波資訊,其中前述第5圖片是解碼順序上較第1圖片還後面之中與第1圖片相同階層的圖片。此時,解碼裝置200可禁止參考第3濾波資訊來作為第6濾波資訊,其中前述第3濾波資訊是與規定NAL單元類型的第1圖片相同階層的第3圖片之濾波資訊。Accordingly, the decoding device 200 can determine the fifth filtering information of the fifth picture by referring to the sixth filtering information of the sixth picture, wherein the fifth picture is the same as the first picture in the decoding order. The picture of the class. At this time, the decoding device 200 can prohibit the reference third filtering information as the sixth filtering information, wherein the third filtering information is the filtering information of the third picture of the same level as the first picture of the predetermined NAL unit type.

即,解碼裝置200在較規定NAL單元類型的第1圖片還後面,且與第1圖片相同的階層之中,和可對較第1圖片還前面的圖片所進行的參考限制一樣,能對濾波資訊進行參考限制。因此,解碼裝置200可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。That is, the decoding apparatus 200 can perform filtering on the same level as the first picture of the predetermined NAL unit type and in the same level as the first picture, as well as the reference restriction on the picture preceding the first picture. Information for reference restrictions. Therefore, the decoding device 200 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

又,例如規定NAL單元類型也可為STSA圖片的NAL單元類型。Also, for example, the NAL unit type may be specified as the NAL unit type of the STSA picture.

依此,和可對與STSA圖片相同階層的圖片進行的參考限制一樣,解碼裝置200可對與STSA圖片相同階層的圖片的濾波資訊進行參考限制。因此,解碼裝置200可將濾波資訊關聯於圖片來適當地管理,可適當地限制來設定要參考的濾波資訊。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device 200 can refer to the filtering information of the picture of the same level as the STSA picture as the reference limit of the picture of the same level as the STSA picture. Therefore, the decoding device 200 can appropriately manage the filter information in association with the picture, and can appropriately limit the setting of the filter information to be referred to. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

圖29是顯示圖27所示的解碼裝置200的第2動作例的流程圖。例如圖27所示的解碼裝置200是在將含有複數張圖片之動態圖像解碼時,進行圖29所示的動作,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID。具體來說,電路260使用記憶體262進行以下的動作。FIG. 29 is a flowchart showing a second operation example of the decoding device 200 shown in FIG. 27. For example, the decoding device 200 shown in FIG. 27 performs an operation shown in FIG. 29 when decoding a moving image including a plurality of pictures, wherein the pictures are assigned and displayed with a temporary ID of a hierarchy of time adjustability. Specifically, the circuit 260 performs the following operations using the memory 262.

首先,電路260將複數個參數組合解碼,前述參數組合分別被分配0來作為顯示有關於時間可調性的階層之暫時ID(S1201)。接著,電路260在複數個參數組合之解碼之後,將複數張圖片之中解碼順序上為最初的圖片解碼(S1202)。First, the circuit 260 decodes a plurality of parameters in combination, and the combination of the parameters is assigned 0 as a temporary ID indicating a hierarchy with respect to time adjustability (S1201). Next, after decoding the plurality of parameter combinations, the circuit 260 decodes the first picture in the decoding order among the plurality of pictures (S1202).

在此,複數個參數組合分別對應於由被分配於複數張圖片之複數個暫時ID所顯示的複數個階層。又,複數個參數組合的每個是相對於1張以上的圖片之參數組合,前述1張以上的圖片為複數張圖片之中被分配顯示前述參數組合所對應的階層之暫時ID的圖片。Here, the plurality of parameter combinations respectively correspond to a plurality of levels displayed by a plurality of temporary IDs assigned to the plurality of pictures. Further, each of the plurality of parameter combinations is a parameter combination with respect to one or more pictures, and the one or more pictures are pictures in which a temporary ID of a hierarchy corresponding to the parameter combination is assigned among the plurality of pictures.

依此,解碼裝置200可以在一開始匯集對應於複數個階層的每個階層之複數個參數組合後再解碼。又,對複數個參數組合的每個分配0來作為暫時ID。因此,可以在不廢棄的狀態下適當地處理複數個參數組合。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device 200 can decode a plurality of parameter combinations corresponding to each of the plurality of levels at the beginning. Further, 0 is assigned to each of a plurality of parameter combinations as a temporary ID. Therefore, a plurality of parameter combinations can be appropriately handled in a state of not being discarded. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

例如複數張圖片也可構成第1圖片群。又,複數個參數組合也可構成第1參數組合群。又,動態圖像也可含有構成第2圖片群的複數張圖片。並且,電路260也可在構成第1圖片群的圖片之解碼之後,將構成第2參數組合群的複數個參數組合解碼。For example, a plurality of pictures may also constitute a first picture group. Further, a plurality of parameter combinations may also constitute a first parameter combination group. Further, the moving image may include a plurality of pictures constituting the second picture group. Further, the circuit 260 may decode a plurality of parameters constituting the second parameter combination group after decoding the picture constituting the first picture group.

在此,構成第2參數組合群之複數個參數組合也可為分別被分配0來作為顯示有關於時間可調性的階層之暫時ID之複數個參數組合。又,構成第2參數組合群的複數個參數組合也可分別對應於由複數個暫時ID所顯示的複數個階層,前述暫時ID被分配於構成第2圖片群的複數張圖片。Here, the plurality of parameter combinations constituting the second parameter combination group may be assigned 0 as a plurality of parameter combinations each displaying a temporary ID of a hierarchy with respect to time adjustability. Further, the plurality of parameter combinations constituting the second parameter combination group may correspond to a plurality of levels displayed by the plurality of temporary IDs, and the temporary IDs are allocated to the plurality of pictures constituting the second picture group.

又,構成第2參數組合群的各參數組合也可為相對於1張以上的圖片的參數組合,前述1張以上的圖片為構成第2圖片群的複數張圖片之中被分配暫時ID的圖片,前述暫時ID顯示前述參數組合所對應的階層。Further, each parameter combination constituting the second parameter combination group may be a parameter combination with respect to one or more pictures, and the one or more pictures are pictures in which a temporary ID is assigned among a plurality of pictures constituting the second picture group. The aforementioned temporary ID displays the level corresponding to the aforementioned parameter combination.

又,電路260也可在構成第2參數組合群之複數個參數組合之解碼之後,將構成第2圖片群之複數張圖片之中解碼順序上為最初的圖片解碼。Further, the circuit 260 may decode the first picture in the decoding order among the plurality of pictures constituting the second picture group after decoding the plurality of parameter combinations constituting the second parameter combination group.

依此,解碼裝置200可對每圖片群,在一開始匯集對應於複數個階層的每個階層之複數個參數組合後再解碼。藉此,解碼裝置200可對每圖片群,適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding apparatus 200 can combine a plurality of parameters corresponding to each of the plurality of levels at the beginning of each picture group to be decoded. Thereby, the decoding device 200 can appropriately set information related to the decoding of the moving image for each picture group.

圖30是顯示圖27所示的解碼裝置200的第3動作例之流程圖。例如將含有複數張圖片的動態圖像解碼時,圖27所示的解碼裝置200進行圖30所示的動作。具體來說,電路260使用記憶體262進行以下的動作。FIG. 30 is a flowchart showing a third operation example of the decoding device 200 shown in FIG. 27. For example, when a moving image including a plurality of pictures is decoded, the decoding device 200 shown in FIG. 27 performs the operation shown in FIG. Specifically, the circuit 260 performs the following operations using the memory 262.

首先,電路260將複數張圖片之中的第1圖片解碼(S1301)。接著,電路260進行第1動作或者第2動作(S1302)。此時,當第2圖片為規定圖片時,電路260進行第1動作。First, the circuit 260 decodes the first picture among the plurality of pictures (S1301). Next, the circuit 260 performs the first operation or the second operation (S1302). At this time, when the second picture is a predetermined picture, the circuit 260 performs the first operation.

在此,第1動作意指如下動作­­­­:在第1圖片之解碼之後,將相對於第2圖片之參數組合解碼,在相對於第2圖片之參數組合的解碼之後,將第2圖片解碼。又,第2動作意指如下動作:在第1圖片之解碼之後,在不將相對於第2圖片的參數組合解碼之狀態下,將第2圖片解碼。又,第2圖片為複數張圖片之中解碼順序上較第1圖片還後面的圖片。Here, the first operation means an operation in which, after decoding of the first picture, the parameters of the second picture are combined and decoded, and after decoding of the parameter combination with respect to the second picture, the second picture is decoded. Further, the second operation means an operation of decoding the second picture without decoding the parameter combination with respect to the second picture after the decoding of the first picture. Further, the second picture is a picture in which the decoding order is later than the first picture in the plurality of pictures.

依此,解碼裝置200能在規定圖片之前,將相對於規定圖片的參數組合解碼。因此,在相對於規定圖片的向上切換等之中,能適當地處理相對於規定圖片的參數組合。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device 200 can decode the parameters of the predetermined picture in combination before the picture is specified. Therefore, among the upward switching with respect to the predetermined picture or the like, the parameter combination with respect to the predetermined picture can be appropriately processed. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

例如規定圖片也可為TSA圖片。依此,解碼裝置200可在TSA圖片之前,將相對於TSA圖片之參數組合解碼。因此,在相對於TSA圖片之向上切換等之中,能適當地處理相對於TSA圖片之參數組合。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。For example, the specified picture can also be a TSA picture. Accordingly, the decoding device 200 can combine the parameters of the TSA picture in combination before the TSA picture. Therefore, among the upward switching with respect to the TSA picture or the like, the parameter combination with respect to the TSA picture can be appropriately processed. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

又,例如複數張圖片的每張也可為被分配顯示有關於時間可調性的階層之暫時ID的圖片。接著,電路260也可在第1動作中,在第1圖片的解碼之後,將含有相對於第2圖片的參數組合之複數個參數組合即複數個關聯參數組合解碼,且在複數個關聯參數組合之解碼之後,將第2圖片解碼。Further, for example, each of the plurality of pictures may be a picture to which a temporary ID of a hierarchy showing time adjustability is assigned. Next, in the first operation, the circuit 260 may combine a plurality of parameter combinations including a plurality of parameter combinations combined with parameters of the second picture, that is, after the decoding of the first picture, and combine the plurality of associated parameters in a plurality of associated parameter combinations. After decoding, the second picture is decoded.

在此,複數個關聯參數組合分別對應於由被分配給第2圖片的暫時ID以上之複數個暫時ID所顯示的複數個階層。又,複數個關聯參數組合的每個為相對於1張以上的圖片之參數組合,前述1張以上的圖片為複數張圖片之中被分配顯示前述關聯參數組合所對應的階層之暫時ID的圖片。Here, the plurality of association parameter combinations respectively correspond to a plurality of levels displayed by a plurality of temporary IDs assigned to the temporary ID of the second picture. Further, each of the plurality of associated parameter combinations is a parameter combination with respect to one or more pictures, and the one or more pictures are pictures in which a temporary ID of a hierarchy corresponding to the associated parameter combination is assigned among the plurality of pictures. .

依此,解碼裝置200能在規定圖片之前,將相對於複數張圖片的複數個參數組合解碼,前述圖片分別是暫時ID與規定圖片相同,或者暫時ID大於規定圖片。因此,在相對於暫時ID大於規定圖片的圖片之向上切換等之中,能適當地處理參數組合。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device 200 can combine a plurality of parameters for a plurality of pictures before the predetermined picture, and the picture is the same as the predetermined picture, or the temporary ID is larger than the predetermined picture. Therefore, the parameter combination can be appropriately handled in the upward switching with respect to the picture whose temporary ID is larger than the predetermined picture. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

又,例如規定圖片也可為STSA圖片。依此,解碼裝置200可在STSA圖片之前,將相對於STSA圖片之參數組合解碼。因此,在相對於STSA圖片之向上切換等之中,能適當地處理相對於STSA圖片之參數組合。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。Further, for example, the predetermined picture may be an STSA picture. Accordingly, the decoding device 200 can combine the parameters of the STSA picture in combination before the STSA picture. Therefore, the parameter combination with respect to the STSA picture can be appropriately handled among the upward switching with respect to the STSA picture or the like. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

又,例如第2圖片也可為複數張圖片之中在第1圖片的下一張被解碼的圖片。依此,解碼裝置200可在剛要將規定圖片解碼之前,將相對於規定圖片的參數組合適當地解碼。因此,能適當地處理相對於規定圖片之參數組合。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。Further, for example, the second picture may be a picture that is decoded next to the first picture among the plurality of pictures. Accordingly, the decoding device 200 can appropriately decode the parameter combination with respect to the predetermined picture just before decoding the predetermined picture. Therefore, the parameter combination with respect to the prescribed picture can be handled appropriately. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

又,例如複數張圖片的每張也可為被分配顯示有關於時間可調性的階層之暫時ID的圖片。Further, for example, each of the plurality of pictures may be a picture to which a temporary ID of a hierarchy showing time adjustability is assigned.

然後,電路260也可在將複數張圖片之中解碼順序上為最初的圖片解碼之前,將含有相對於第2圖片之參數組合的複數個參數組合即複數個概括參數組合解碼。Then, the circuit 260 may combine and decode a plurality of parameter combinations, that is, a plurality of parameter combinations, which are combined with the parameters of the second picture, before decoding the first picture in the decoding order.

在此,複數個概括參數組合分別對應於由被分配於複數張圖片之複數個暫時ID所顯示的複數個階層。又,複數個概括參數組合的每個為相對於1張以上的圖片之參數組合,前述1張以上的圖片為前述複數張圖片之中被分配顯示前述概括參數組合所對應的階層之暫時ID的圖片。Here, the plurality of summary parameter combinations respectively correspond to a plurality of levels displayed by a plurality of temporary IDs assigned to the plurality of pictures. Further, each of the plurality of summary parameter combinations is a parameter combination with respect to one or more pictures, and the one or more pictures are the temporary IDs of the hierarchy corresponding to the combination of the summary parameter combinations among the plurality of pictures. image.

依此,就算在一開始已將含有相對於規定圖片的參數組合之複數個參數組合解碼,解碼裝置200仍可在規定圖片之前,再度將相對於規定圖片之參數組合解碼。因此,能適當地處理相對於規定圖片之參數組合。藉此,解碼裝置200可適當地設定與動態圖像的解碼有關聯的資訊。Accordingly, even if a plurality of parameters including a combination of parameters with respect to a predetermined picture have been combined and decoded at the beginning, the decoding apparatus 200 can again decode the parameters of the predetermined picture in combination before the specified picture. Therefore, the parameter combination with respect to the prescribed picture can be handled appropriately. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

又,例如規定圖片也可為TSA圖片或者是STSA圖片。又,例如在第2圖片為規定圖片時,電路260也可禁止第2動作。Further, for example, the predetermined picture may be a TSA picture or an STSA picture. Further, for example, when the second picture is a predetermined picture, the circuit 260 may prohibit the second operation.

圖31是顯示圖27所示的解碼裝置200的第4動作例之流程圖。例如將含有複數張圖片的動態圖像解碼時,圖27所示的解碼裝置200進行圖31所示的動作,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID。具體來說,電路260使用記憶體262進行以下的動作。FIG. 31 is a flowchart showing a fourth operation example of the decoding device 200 shown in FIG. 27. For example, when decoding a moving image including a plurality of pictures, the decoding apparatus 200 shown in FIG. 27 performs an operation shown in FIG. 31 in which the pictures are assigned a temporary ID of a hierarchy indicating temporal adjustability. Specifically, the circuit 260 performs the following operations using the memory 262.

首先,電路260將複數張圖片之中的第1圖片解碼(S1401)。接著,電路260進行第1動作或者第2動作(S1402)。此時,當被分配於第2圖片的暫時ID大於最小的暫時ID,且小於最大的暫時ID時,電路260進行第1動作。First, the circuit 260 decodes the first picture among the plurality of pictures (S1401). Next, the circuit 260 performs the first operation or the second operation (S1402). At this time, when the temporary ID assigned to the second picture is larger than the smallest temporary ID and smaller than the largest temporary ID, the circuit 260 performs the first operation.

在此,第1動作意指如下動作­­­­:在第1圖片之解碼之後,將相對於第2圖片之參數組合解碼,在相對於第2圖片之參數組合的解碼之後,將第2圖片解碼。又,第2動作意指如下動作:在第1圖片之解碼之後,在不將相對於第2圖片的參數組合解碼之狀態下,將第2圖片解碼。又,第2圖片為複數張圖片之中解碼順序上較第1圖片還後面的圖片。Here, the first operation means an operation in which, after decoding of the first picture, the parameters of the second picture are combined and decoded, and after decoding of the parameter combination with respect to the second picture, the second picture is decoded. Further, the second operation means an operation of decoding the second picture without decoding the parameter combination with respect to the second picture after the decoding of the first picture. Further, the second picture is a picture in which the decoding order is later than the first picture in the plurality of pictures.

又,最小的暫時ID為被分配於複數張圖片的複數個暫時ID之中最小的暫時ID。又,最大的暫時ID為被分配於複數張圖片的複數個暫時ID之中最大的暫時ID。Further, the smallest temporary ID is the smallest temporary ID among the plurality of temporary IDs assigned to the plurality of pictures. Further, the largest temporary ID is the largest temporary ID among the plurality of temporary IDs assigned to the plurality of pictures.

依此,解碼裝置200可在中間層之圖片之前將相對於中間層之圖片的參數組合解碼。因此,在相對於中間層之圖片的向上切換等之中,能適當地處理相對於中間層的圖片之參數組合。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。Accordingly, the decoding device 200 can decode the parameter combination of the picture with respect to the intermediate layer before the picture of the intermediate layer. Therefore, among the upward switching or the like with respect to the picture of the intermediate layer, the parameter combination of the picture with respect to the intermediate layer can be appropriately processed. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

例如在被分配於第2圖片的暫時ID為最大的暫時ID時,電路260也可進行第1動作。依此,解碼裝置200可在最上位層的圖片之前,將相對於最上位層的圖片之參數組合解碼。因此,在相對於最上位層的圖片之向上切換等之中,可適當地處理相對於最上位層的圖片之參數組合。藉此,解碼裝置200可適當地設定與動態圖像之解碼有關聯的資訊。For example, when the temporary ID assigned to the second picture is the largest temporary ID, the circuit 260 may perform the first operation. Accordingly, the decoding device 200 can combine the parameters of the picture with respect to the uppermost layer before the picture of the uppermost layer. Therefore, among the upward switching of the picture with respect to the uppermost layer, the parameter combination with respect to the picture of the uppermost layer can be appropriately processed. Thereby, the decoding device 200 can appropriately set the information associated with the decoding of the moving image.

又,例如電路260也可在規定的情形下所進行的第1動作中,在第1圖片之解碼之後,將相對於第2圖片之參數組合及最上位參數組合解碼。然後,電路260也可在相對於第2圖片之參數組合及最上位參數組合之解碼之後,將第2圖片解碼。Further, for example, in the first operation performed in a predetermined situation, the circuit 260 may combine the parameter combination and the highest parameter combination with respect to the second picture after decoding of the first picture. Then, the circuit 260 may decode the second picture after decoding the parameter combination and the highest parameter combination with respect to the second picture.

在此,規定的情形是指被分配於第2圖片的暫時ID為複數個暫時ID之中第2大的暫時ID的情形。又,最上位參數組合是相對於被分配最大的暫時ID之1張以上的圖片的參數組合。Here, the predetermined case refers to a case where the temporary ID assigned to the second picture is the second largest temporary ID among the plurality of temporary IDs. Further, the top-level parameter combination is a parameter combination with respect to one or more pictures to which the largest temporary ID is assigned.

依此,解碼裝置200能將包含有相對於最上位層的圖片之參數組合的2個參數組合有效率地解碼。Accordingly, the decoding device 200 can efficiently decode the two parameter combinations including the parameters of the picture with respect to the highest layer.

又,例如當被分配於第2圖片的暫時ID為最大的暫時ID時,電路260也可進行第2動作。依此,解碼裝置200可省略如下動作,即,在最上位層的圖片之前將相對於最上位層的圖片的參數組合解碼。Further, for example, when the temporary ID assigned to the second picture is the largest temporary ID, the circuit 260 may perform the second operation. Accordingly, the decoding apparatus 200 can omit the operation of decoding the parameter combination of the picture of the highest layer before the picture of the uppermost layer.

又,例如在規定條件下,被分配於第2圖片的暫時ID大於最小的暫時ID,且小於最大的暫時ID時,電路260也可進行第1動作。在此,規定條件意指如下條件:相對於複數張圖片的序列參數組合所含的規定旗標為規定值。藉此,解碼裝置200在規定的序列中,在中間層之圖片之前,能將相對於中間層之圖片的參數組合適當地解碼。Further, for example, under the predetermined condition, when the temporary ID assigned to the second picture is larger than the minimum temporary ID and smaller than the maximum temporary ID, the circuit 260 may perform the first operation. Here, the predetermined condition means a condition that a predetermined flag included in a sequence parameter combination with respect to a plurality of pictures is a predetermined value. Thereby, the decoding apparatus 200 can appropriately decode the parameter combination with respect to the picture of the intermediate layer in the predetermined sequence before the picture of the intermediate layer.

又,例如在所謂規定旗標為規定值之條件下,複數張圖片的每張在被分配於前述圖片的暫時ID不是最小的暫時ID時,也可為TSA圖片。依此,解碼裝置200在除了最下位層以外皆由TSA圖片所構成的規定的序列中,在中間層之圖片之前,能將相對於中間層之圖片的參數組合適當地解碼。Further, for example, when the predetermined flag is a predetermined value, each of the plurality of pictures may be a TSA picture when the temporary ID assigned to the picture is not the smallest temporary ID. Accordingly, in the predetermined sequence including the TSA picture except the lowest layer, the decoding apparatus 200 can appropriately decode the parameter combination of the picture of the intermediate layer before the picture of the intermediate layer.

又,例如當被分配於第2圖片的暫時ID大於最小的暫時ID,且小於最大的暫時ID時,電路260也可禁止第2動作。又,例如當被分配於第2圖片的暫時ID為最大的暫時ID時,電路260也可禁止第2動作。又,例如電路260也可在規定條件下,依照被分配於第2圖片的暫時ID來禁止第2動作。
[補充]
Further, for example, when the temporary ID assigned to the second picture is larger than the minimum temporary ID and smaller than the maximum temporary ID, the circuit 260 may prohibit the second operation. Further, for example, when the temporary ID assigned to the second picture is the largest temporary ID, the circuit 260 may prohibit the second operation. Further, for example, the circuit 260 may prohibit the second operation in accordance with the temporary ID assigned to the second picture under predetermined conditions.
[supplement]

本實施形態中之編碼裝置100及解碼裝置200,各自也可被利用作為圖像編碼裝置及圖像解碼裝置,也可被利用作為動態圖像編碼裝置及動態圖像解碼裝置。Each of the encoding device 100 and the decoding device 200 in the present embodiment may be used as an image encoding device and an image decoding device, or may be used as a moving image encoding device and a moving image decoding device.

或者,編碼裝置100及解碼裝置200各自可被利用來作為參數編碼裝置及參數解碼裝置。即,編碼裝置100及解碼裝置200各自也可只對應於熵編碼部110及熵解碼部202。然後,間預測部126或者218等之其他構成要素也可包含在其他裝置。Alternatively, each of the encoding device 100 and the decoding device 200 can be utilized as a parameter encoding device and a parameter decoding device. In other words, each of the encoding device 100 and the decoding device 200 may correspond to only the entropy encoding unit 110 and the entropy decoding unit 202. Then, other components such as the inter prediction unit 126 or 218 may be included in other devices.

或者,編碼裝置100及解碼裝置200各自可被利用作為濾波裝置。即,編碼裝置100及解碼裝置200各自也可只對應於迴路濾波部120及迴路濾波部212。然後,間預測部126或者218等之其他構成要素也可包含在其他裝置。Alternatively, each of the encoding device 100 and the decoding device 200 can be utilized as a filtering device. In other words, each of the encoding device 100 and the decoding device 200 may correspond to only the loop filter unit 120 and the loop filter unit 212. Then, other components such as the inter prediction unit 126 or 218 may be included in other devices.

或者,編碼裝置100也可只對應於熵編碼部110及迴路濾波部120。解碼裝置200也可只對應於熵解碼部202及迴路濾波部212。Alternatively, the encoding device 100 may correspond to only the entropy encoding unit 110 and the loop filter unit 120. The decoding device 200 may correspond to only the entropy decoding unit 202 and the loop filter unit 212.

又,本實施形態的至少一部分也可作為編碼方法來利用,也可作為解碼方法來利用,也可作為參數設定方法來利用,也可作為其他方法來利用。Further, at least a part of the embodiment may be used as an encoding method, may be used as a decoding method, may be used as a parameter setting method, or may be used as another method.

又,在本實施形態中,各構成要素可以專用的硬體所構成,或透過執行適於各構成要素的軟體程式來實現。各構成要素也可藉由讓CPU或者處理器等之程式執行部讀出記錄在硬碟或者半導體記憶體等之記錄媒體的軟體程式並執行而實現。Further, in the present embodiment, each component can be realized by a dedicated hardware or by executing a software program suitable for each component. Each component can be realized by causing a program execution unit such as a CPU or a processor to read and execute a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

具體來說,編碼裝置100及解碼裝置200各自也可具有處理電路(Processing Circuitry)、及記憶裝置(Storage),前述記憶裝置是電連接於該處理電路,可由該處理電路進行存取。例如,處理電路是對應於電路160或260、記憶裝置是對應記憶體162或262。Specifically, each of the encoding device 100 and the decoding device 200 may have a processing circuit (Processing Circuitry) and a memory device (Storage), and the memory device is electrically connected to the processing circuit and can be accessed by the processing circuit. For example, the processing circuit corresponds to circuit 160 or 260, and the memory device is corresponding memory 162 or 262.

處理電路包含有專用的硬體及程式執行部之至少一者,並使用記憶裝置來執行處理。又,當處理電路含有程式執行部時,記憶裝置記憶藉該程式執行部所執行之軟體程式。The processing circuit includes at least one of a dedicated hardware and a program execution unit, and uses a memory device to perform processing. Further, when the processing circuit includes the program execution unit, the memory device stores the software program executed by the program execution unit.

在此,實現本實施形態之編碼裝置100或者解碼裝置200等之軟體為如下的程式。Here, the software that implements the encoding device 100 or the decoding device 200 of the present embodiment is the following program.

即,前述程式也可讓電腦執行一種編碼方法,前述編碼方法是在含有複數張圖片之動態圖像的編碼中適用自適應迴路濾波,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述編碼方法包含以下步驟:參考有關聯於第2圖片之第2濾波資訊,決定用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊的步驟,其中前述第2圖片是前述複數張圖片之中編碼順序上較前述第1圖片還前面的圖片;及,使用已決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟;在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL(Network Abstraction Layer)單元類型為規定NAL單元類型時,禁止參考有關聯於第3圖片之第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中編碼順序上較前述第1圖片還前面的圖片,且為暫時ID與前述第1圖片相同的圖片。That is, the aforementioned program may also cause the computer to execute an encoding method which is adapted to adaptive loop filtering in encoding of a moving image containing a plurality of pictures, wherein the pictures are respectively assigned to display a hierarchy with respect to time adjustability a temporary ID, wherein the encoding method includes the step of: determining, by referring to the second filter information associated with the second picture, a first filtering information for applying adaptive loop filtering to the first picture of the plurality of pictures; The second picture is a picture in which the coding order is earlier than the first picture in the plurality of pictures; and the step of applying adaptive loop filtering to the first picture using the determined first filter information In the step of determining the first filter information, when the NAL (Network Abstraction Layer) unit type of the first picture is a predetermined NAL unit type, it is prohibited to refer to the third filter information associated with the third picture as the foregoing 2 filtering information, wherein the third picture is a picture in which the coding order is earlier than the first picture in the plurality of pictures, And a temporary ID to the first picture of the same picture.

或者,前述程式也可讓電腦執行一種解碼方法,前述解碼方法是在含有複數張圖片之動態圖像的解碼中適用自適應迴路濾波,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述解碼方法包含以下步驟:參考有關聯於第2圖片之第2濾波資訊,決定用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊的步驟,其中前述第2圖片是前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片;及,使用已決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟;在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL(Network Abstraction Layer)單元類型為規定NAL單元類型時,禁止參考有關聯於第3圖片之第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片,且為暫時ID與前述第1圖片相同的圖片。Alternatively, the aforementioned program may also cause the computer to perform a decoding method, wherein the decoding method is adapted to adaptive loop filtering in decoding of a moving image containing a plurality of pictures, wherein the pictures are respectively assigned to display a hierarchy with respect to time adjustability. The temporary ID, the decoding method includes the step of: determining, by referring to the second filter information associated with the second picture, a first filtering information for applying adaptive loop filtering to the first picture of the plurality of pictures. The second picture is a picture in which the decoding order is earlier than the first picture in the plurality of pictures; and the step of applying adaptive loop filtering to the first picture using the determined first filtering information In the step of determining the first filter information, when the NAL (Network Abstraction Layer) unit type of the first picture is a predetermined NAL unit type, it is prohibited to refer to the third filter information associated with the third picture as the foregoing 2 filtering information, wherein the third picture is a picture in front of the first picture in the decoding order among the plurality of pictures And a temporary ID for the first image and the same image.

或者,前述程式也可讓電腦執行一種編碼方法,前述編碼方法是將含有複數張圖片的動態圖像編碼,前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述編碼方法包含有以下步驟:將複數個參數組合編碼的步驟,其中前述參數組合分別被分配0來作為顯示有關於前述時間可調性的階層之暫時ID;及,在前述複數個參數組合之編碼之後,將前述複數張圖片之中編碼順序上為最初的圖片編碼的步驟;前述複數個參數組合分別對應於由被分配於前述複數張圖片之複數個暫時ID所顯示的複數個階層,前述複數個參數組合的每個為相對於1張以上的圖片的參數組合,前述1張以上的圖片為前述複數張圖片之中被分配顯示該參數組合對應的階層之暫時ID的圖片。Alternatively, the foregoing program may also cause the computer to execute an encoding method. The encoding method is to encode a moving image containing a plurality of pictures, the pictures being respectively assigned a temporary ID indicating a time adjustable property, and the encoding method includes There is the following steps: a step of combining a plurality of parameters, wherein the foregoing parameter combinations are respectively assigned 0 as a temporary ID indicating a hierarchy with respect to the aforementioned time adjustability; and, after the encoding of the plurality of parameter combinations, a step of encoding the first picture in the coding order among the plurality of pictures; the plurality of parameter combinations respectively corresponding to a plurality of levels displayed by a plurality of temporary IDs allocated to the plurality of pictures, the plurality of parameter combinations Each of the plurality of pictures is a combination of parameters of one or more pictures, and the one or more pictures are pictures in which the temporary ID of the hierarchy corresponding to the parameter combination is assigned among the plurality of pictures.

或者,前述程式也可讓電腦執行一種解碼方法,前述解碼方法將含有複數張圖片的動態圖像解碼,前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述解碼方法包含有以下步驟:將複數個參數組合解碼的步驟,前述參數組合分別被分配0來作為顯示有關於前述時間可調性的階層之暫時ID;及,在前述複數個參數組合之解碼之後,將前述複數張圖片之中解碼順序上為最初的圖片解碼的步驟;前述複數個參數組合分別對應於由被分配於前述複數張圖片之複數個暫時ID所顯示的複數個階層,前述複數個參數組合的每個是相對於1張以上的圖片之參數組合,前述1張以上的圖片為前述複數張圖片之中被分配顯示該參數組合對應的階層之暫時ID的圖片。Alternatively, the program may also cause the computer to perform a decoding method. The decoding method decodes a dynamic image including a plurality of pictures, and the pictures are respectively assigned a temporary ID indicating a time adjustable property, and the decoding method includes a step of decoding a plurality of parameters in combination, wherein the parameter combinations are respectively assigned 0 as a temporary ID indicating a hierarchy with respect to the time adjustability; and, after decoding of the plurality of parameter combinations, the foregoing plural a step of decoding the first picture in the decoding order; the plurality of parameter combinations respectively correspond to a plurality of levels displayed by a plurality of temporary IDs allocated to the plurality of pictures, each of the plurality of parameter combinations One is a parameter combination with respect to one or more pictures, and the one or more pictures are pictures in which the temporary ID of the hierarchy corresponding to the parameter combination is assigned among the plurality of pictures.

或者,前述程式也可讓電腦執行一種編碼方法,前述編碼方法是將含有複數張圖片之動態圖像編碼,且包含有以下步驟:將前述複數張圖片之中的第1圖片編碼的步驟;及進行(i)第1動作、或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片之編碼之後,將相對於第2圖片的參數組合編碼,且在前述參數組合之編碼之後,將前述第2圖片編碼,前述第2圖片是前述複數張圖片之中編碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之編碼之後,在不將前述參數組合編碼的狀態下,將前述第2圖片編碼;在進行前述第1動作或者前述第2動作的步驟中,當前述第2圖片為規定圖片時,進行前述第1動作。Alternatively, the program may also cause the computer to execute an encoding method, the encoding method is to encode a moving image containing a plurality of pictures, and the method includes the steps of: encoding the first picture of the plurality of pictures; and Performing the steps of (i) the first operation or (ii) the second operation, wherein the first operation is to encode the parameters of the second picture after the coding of the first picture, and combine the parameters in the foregoing After encoding, the second picture is encoded, and the second picture is a picture in which the coding order is later than the first picture in the plurality of pictures, and the second operation is after the coding of the first picture, The second picture is encoded in a state in which the parameters are combined and encoded, and in the step of performing the first operation or the second operation, when the second picture is a predetermined picture, the first operation is performed.

或者,前述程式也可讓電腦執行一種解碼方法,前述解碼方法是將含有複數張圖片之動態圖像解碼,且包含有以下步驟:將前述複數張圖片之中的第1圖片解碼的步驟;及進行(i)第1動作、或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片之解碼之後,將相對於第2圖片的參數組合解碼,且在前述參數組合之解碼之後,將前述第2圖片解碼,前述第2圖片是前述複數張圖片之中解碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之解碼之後,在不將前述參數組合解碼的狀態下,將前述第2圖片解碼;在進行前述第1動作或者前述第2動作的步驟中,當前述第2圖片為規定圖片時,進行前述第1動作。Alternatively, the program may also cause the computer to perform a decoding method, the decoding method is to decode a moving image including a plurality of pictures, and the step of decoding the first picture among the plurality of pictures; and a step of (i) the first operation or (ii) the second operation, wherein the first operation is to decode the parameter combination with the second picture after the decoding of the first picture, and combine the parameters in the foregoing After decoding, the second picture is decoded, wherein the second picture is a picture that is later than the first picture in the decoding order, and the second operation is after the decoding of the first picture, The second picture is decoded in a state in which the parameter combination is decoded, and in the step of performing the first operation or the second operation, when the second picture is a predetermined picture, the first operation is performed.

或者,前述程式也可讓電腦執行一種編碼方法,前述編碼方法是將含有複數張圖片的動態圖像編碼,前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述編碼方法包含有以下步驟:將前述複數張圖片之中的第1圖片編碼的步驟;及進行(i)第1動作、或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片之編碼之後,將相對於第2圖片的參數組合編碼,在前述參數組合之編碼之後,將前述第2圖片編碼,前述第2圖片為前述複數張圖片之中編碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之編碼之後,在不將前述參數組合編碼的狀態下,將前述第2圖片編碼;在進行前述第1動作或者前述第2動作的步驟中,當被分配於前述第2圖片的暫時ID大於被分配於前述複數張圖片的複數個暫時ID之中最小的暫時ID,且小於前述複數個暫時ID之中最大的暫時ID時,進行前述第1動作。Alternatively, the foregoing program may also cause the computer to execute an encoding method. The encoding method is to encode a moving image containing a plurality of pictures, the pictures being respectively assigned a temporary ID indicating a time adjustable property, and the encoding method includes a step of encoding a first picture among the plurality of pictures; and performing (i) a first operation or (ii) a second operation, wherein the first operation is in the first picture After encoding, the parameters of the second picture are combined and encoded, and after the encoding of the parameter combination, the second picture is encoded, and the second picture is encoded in the plurality of pictures, and the coding order is later than the first picture. In the second picture, after the encoding of the first picture, the second picture is encoded without combining the parameters, and in the step of performing the first operation or the second operation, When the temporary ID assigned to the second picture is larger than the smallest temporary ID among the plurality of temporary IDs allocated to the plurality of pictures, and smaller than the plurality of temporary I When the largest temporary ID among D is performed, the first operation described above is performed.

或者,前述程式也可讓電腦執行一種解碼方法,前述解碼方法是將含有複數張圖片的動態圖像解碼,前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID,前述解碼方法包含有以下步驟:將前述複數張圖片之中的第1圖片解碼的步驟;及進行(i)第1動作、或者(ii)第2動作的步驟,其中前述第1動作是在前述第1圖片之解碼之後,將相對於第2圖片的參數組合解碼,在前述參數組合之解碼之後,將前述第2圖片解碼,前述第2圖片為前述複數張圖片之中解碼順序上較前述第1圖片還後面的圖片,前述第2動作是在前述第1圖片之解碼之後,在不將前述參數組合解碼的狀態下,將前述第2圖片解碼;在進行前述第1動作或者前述第2動作的步驟中,當被分配於前述第2圖片的暫時ID大於被分配於前述複數張圖片的複數個暫時ID之中最小的暫時ID,且小於前述複數個暫時ID之中最大的暫時ID時,進行前述第1動作。Alternatively, the program may also cause the computer to execute a decoding method. The decoding method is to decode a moving image including a plurality of pictures, and the pictures are respectively assigned a temporary ID indicating a time adjustable property, and the decoding method includes a step of decoding a first picture among the plurality of pictures; and performing (i) a first operation or (ii) a second operation, wherein the first operation is in the first picture After decoding, the parameter combination is decoded with respect to the second picture, and after the decoding of the parameter combination, the second picture is decoded, and the second picture is the decoding order of the plurality of pictures, which is later than the first picture. In the second operation, after the decoding of the first picture, the second picture is decoded without decoding the parameter combination; and in the step of performing the first operation or the second operation, When the temporary ID assigned to the second picture is larger than the smallest temporary ID among the plurality of temporary IDs allocated to the plurality of pictures, and smaller than the plurality of temporary I When the largest temporary ID among D is performed, the first operation described above is performed.

又,如上述,各構成要素也可為電路。該等電路也可整體構成為1個電路,也可分別為個別的電路。又,各構成要素也可以通用式的處理器來實現,也可以專用的處理器來實現。Further, as described above, each component may be a circuit. The circuits may be integrally formed as one circuit or as individual circuits. Further, each component may be implemented by a general-purpose processor or by a dedicated processor.

又,也可讓別的構成要素來執行特定的構成要素所要執行的處理。又,要執行處理的順序也可變更,複數個處理也可並行地執行。又,編碼解碼裝置也可包含有編碼裝置100及解碼裝置200。Further, it is also possible to allow other constituent elements to execute the processing to be executed by the specific constituent elements. Further, the order in which the processing is to be executed may be changed, and a plurality of processing may be executed in parallel. Further, the codec device may include the encoding device 100 and the decoding device 200.

又,在說明中所使用過的第1及第2等序數,也可適當地替換。又,對構成要素等,也可重新附上序數,也可移除之。Further, the first and second orthographic numbers used in the description may be appropriately replaced. Further, the constituent numbers may be re-attached to the constituent elements or the like, and may be removed.

以上,針對編碼裝置100及解碼裝置200之態樣,已根據實施形態來說明,但編碼裝置100及解碼裝置200的態樣並不限於前述實施形態。只要不脫離本揭示的旨趣,熟悉此項技藝之人士可思及之各種變形實施在本實施形態者、或者將不同實施形態的構成要素組合而所構建的形態,也可包括在編碼裝置100及解碼裝置200之態樣的範圍內。Although the aspects of the encoding device 100 and the decoding device 200 have been described above based on the embodiments, the aspects of the encoding device 100 and the decoding device 200 are not limited to the above embodiments. Any configuration that can be implemented by combining the various embodiments of the present invention with those skilled in the art can be included in the encoding device 100 and without departing from the scope of the present disclosure. Within the scope of the aspect of the decoding device 200.

也可以將本態樣與本揭示中的其他態樣之至少一部分組合來實施。又,也可以將本態樣的流程圖所記載的一部分處理、裝置的一部分構成、語法(syntax)的一部分等與其他態樣組合來實施。
(實施形態2)
This aspect can also be implemented in combination with at least a portion of other aspects of the disclosure. Further, a part of the processing described in the flowchart of the present aspect, a part of the configuration of the apparatus, a part of the syntax, and the like may be combined with other aspects.
(Embodiment 2)

在以上之各實施形態中,功能區塊每一個通常可藉MPU及記憶體等來實現。又,藉功能區塊每一個所進行的處理通常可以經由處理器等之程式執行部讀出ROM等之記錄媒體所記錄的軟體(程式)來執行,而予以實現。該軟體也可藉下載等來分發,也可記錄在半導體記憶體等之記錄媒體來分發。另,當然也可以將各功能區塊透過硬體(專用電路)來實現。In each of the above embodiments, each of the functional blocks can be implemented by an MPU, a memory, or the like. Further, the processing performed by each of the function blocks can be realized by executing a software (program) recorded on a recording medium such as a ROM by a program execution unit such as a processor. The software may be distributed by downloading or the like, or may be recorded on a recording medium such as a semiconductor memory. In addition, it is of course also possible to implement each functional block through a hardware (dedicated circuit).

又,在各實施形態中所說明的處理也可以使用單一裝置(系統)進行集中處理來實現,或者也可以使用複數個裝置進行分散處理來實現。又,執行上述程式的處理器也可為單數個,也可為複數個。即,可進行集中處理,或者也可進行分散處理。Further, the processing described in the respective embodiments may be realized by performing centralized processing using a single device (system), or may be realized by performing distributed processing using a plurality of devices. Moreover, the processor that executes the above program may be singular or plural. That is, the centralized processing may be performed or the dispersion processing may be performed.

本揭示的態樣並不限於以上的實施例,可做各種變更,其等變更也包括在本揭示的態樣之範圍內。The aspects of the present disclosure are not limited to the above embodiments, and various changes can be made, and variations thereof are also included in the scope of the present disclosure.

進而在此,說明在上述各實施形態中所示之動態圖像編碼方法(圖像編碼方法)或動態圖像解碼方法(圖像解碼方法)之應用例及使用前述方法之系統。該系統是以具有使用圖像編碼方法之圖像編碼裝置、使用圖像解碼方法之圖像解碼裝置、及具有兩者之圖像編碼解碼裝置為特徵所在。針對系統中的其他構成,配合情況的需要,可適當地變更。
[使用例]
Further, an application example of the moving picture coding method (image coding method) or the moving picture decoding method (image decoding method) shown in each of the above embodiments and a system using the above method will be described. This system is characterized by an image encoding device using an image encoding method, an image decoding device using an image decoding method, and an image encoding and decoding device having both. The other components in the system can be appropriately changed in accordance with the needs of the situation.
[usage]

圖32是顯示實現內容分發服務之內容供給系統ex100之整體構成圖。將通訊服務之提供領域分割成所期望之大小,在各胞元內分別設置有為固定無線台之基地台ex106、ex107、ex108、ex109、ex110。Fig. 32 is a view showing the overall configuration of a content supply system ex100 that realizes a content distribution service. The area of communication service is divided into desired sizes, and base stations ex106, ex107, ex108, ex109, and ex110, which are fixed wireless stations, are provided in each cell.

在該內容供給系統ex100中,經由網際網路服務提供者ex102或通訊網ex104、及基地台ex106至ex110,而將電腦ex111、遊戲機ex112、攝像機ex113、家電ex114、及智慧型手機ex115等各機器連接於網際網路ex101。該內容供給系統ex100可構成為組合上述任意要素而連接。也可不經過為固定無線台之基地台ex106至ex110,而是使各機器經由電話網路或者近距離無線等直接或間接地互相連接。又,串流伺服器ex103是經由網際網路ex101等而與電腦ex111、遊戲機ex112、攝像機ex113、家電ex114、及智慧型手機ex115等之各機器連接。又,串流伺服器ex103是經由衛星ex116而與飛機ex117內之熱點內的終端機等連接。In the content supply system ex100, each of the machines such as the computer ex111, the game machine ex112, the camera ex113, the home appliance ex114, and the smart phone ex115 is connected via the Internet service provider ex102 or the communication network ex104 and the base stations ex106 to ex110. Connected to the Internet ex101. The content supply system ex100 can be configured to be connected in combination with any of the above elements. It is also possible to connect the machines directly or indirectly via a telephone network or short-range wireless, without going through the base stations ex106 to ex110 of the fixed wireless station. Further, the streaming server ex103 is connected to each of the devices such as the computer ex111, the game machine ex112, the camera ex113, the home appliance ex114, and the smartphone ex115 via the Internet ex101 or the like. Further, the streaming server ex103 is connected to a terminal or the like in the hot spot in the aircraft ex117 via the satellite ex116.

另,也可利用無線存取點或熱點等,來替代基地台ex106至ex110。又,串流伺服器ex103也可以不經由網際網路ex101或者網際網路服務提供者ex102,而直接與通訊網ex104連接,也可不經由衛星ex116,而直接與飛機ex117連接。Alternatively, the base station ex106 to ex110 may be replaced by a wireless access point or a hot spot or the like. Further, the streaming server ex103 may be directly connected to the communication network ex104 without via the Internet ex101 or the Internet service provider ex102, or may be directly connected to the aircraft ex117 without via the satellite ex116.

攝像機ex113是數位相機等可進行靜態圖像攝影及動態圖像攝影之機器。又,智慧型手機ex115一般是指對應於2G、3G、3.9G、4G、以及今後被稱為5G之行動通訊系統的方式之智慧型話機、行動電話機、或者PHS(Personal Handyphone System)等。The camera ex113 is a machine that can perform still image shooting and moving image shooting such as a digital camera. In addition, the smart phone ex115 generally refers to a smart phone, a mobile phone, or a PHS (Personal Handyphone System) corresponding to 2G, 3G, 3.9G, 4G, and a mobile communication system called 5G in the future.

家電ex118是包括在冰箱、或者家用燃料電池熱電共生系統之機器等。The home appliance ex118 is a machine included in a refrigerator or a domestic fuel cell thermoelectric symbiosis system.

在內容供給系統ex100中,讓具有攝影功能的終端機經由基地台ex106等而連接到串流伺服器ex103,以此可進行現場直播等。在現場直播中,終端機(電腦ex111、遊戲機ex112、攝像機ex113、家電ex114、智慧型手機ex115、及飛機ex117內之終端機等)是將如下所得到的資料發送到串流伺服器ex103,該資料是對使用者使用該終端機所攝影的靜態圖像或者動態圖像內容進行在上述各實施形態所說明的編碼處理,且對藉編碼所得到的影像資料、及已將對應於影像的聲音編碼後的聲音資料進行多工而所得到者。即,各終端機是作為本揭示一態樣的圖像編碼裝置而發揮功能。In the content supply system ex100, the terminal having the photographing function is connected to the streaming server ex103 via the base station ex106 or the like, thereby enabling live broadcast or the like. In the live broadcast, the terminal (computer ex111, game machine ex112, camera ex113, home appliance ex114, smart phone ex115, terminal in the aircraft ex117, etc.) transmits the data obtained as follows to the stream server ex103. The data is obtained by performing the encoding process described in the above embodiments on the still image or the moving image content captured by the user using the terminal device, and the image data obtained by the encoding and the image corresponding to the image. The voice-coded sound data is obtained by multiplexing. That is, each terminal functions as an image coding apparatus according to one aspect of the present disclosure.

另一方面,串流伺服器ex103是對於有了請求的客戶端將被發送的內容資料進行串流分發。客戶端是指可將上述經過編碼處理的資料進行解碼之電腦ex111、遊戲機ex112、攝像機ex113、家電ex114、智慧型手機ex115、或者飛機ex117內的終端機等。已接收到所分發的資料的各機器將所接收的資料進行解碼處理後進行播放。即,各機器是作為本揭示一態樣之圖像解碼裝置而發揮功能。
[分散處理]
On the other hand, the streaming server ex103 is to stream-distribute the content material to be transmitted to the client having the request. The client is a computer ex111, a game machine ex112, a camera ex113, a home appliance ex114, a smart phone ex115, or a terminal in the aircraft ex117, which can decode the encoded data. Each machine that has received the distributed data decodes the received data and plays it. That is, each device functions as an image decoding device of one aspect of the present disclosure.
[Distributed processing]

又,串流伺服器ex103也可為複數個伺服器或者是複數個電腦,將資料分散處理或記錄分發者。例如,串流伺服器ex103也可藉由CDN(Contents Delivery Network)來實現,透過連接分散在世界各地的多數邊緣伺服器(edge server)與邊緣伺服器間的網路來實現內容分發。在CDN中,因應客戶端而動態地分配實體上接近的邊緣伺服器。然後,內容被該邊緣伺服器快取及分發,以此可減少延遲的情況。又,在發生有任何錯誤時或者因流量增加等而使通訊狀態改變時,可以複數個邊緣伺服器分散處理,或者將分發主體切換到其他邊緣伺服器,而對已發生障礙的網路部分進行迂迴,來繼續進行分發,因此可實現高速且穩定的分發。Further, the stream server ex103 may be a plurality of servers or a plurality of computers, and the data may be distributed or recorded to the distributor. For example, the streaming server ex103 can also be implemented by a CDN (Contents Delivery Network) to realize content distribution by connecting a network between a plurality of edge servers and edge servers scattered around the world. In the CDN, dynamically approaching edge servers are dynamically allocated in response to the client. The content is then cached and distributed by the edge server, which reduces latency. Moreover, when any error occurs or the communication state is changed due to an increase in traffic, etc., a plurality of edge servers may be distributed, or the distribution body may be switched to another edge server, and the network portion where the obstacle has occurred may be performed. It is roundabout to continue the distribution, so high-speed and stable distribution can be achieved.

又,不只是分發自身的分散處理,也可將所攝影的資料的編碼處理在各終端機進行,也可在伺服器側進行,也可互相分擔來進行。舉一例來說,一般在編碼處理中,進行處理循環2次。第1次的循環,會檢測以框或者場景單位的圖像之複雜度、或者編碼量。又,在第2次的循環,會進行維持畫質,並使編碼效率提高的處理。例如,終端機進行第1次的編碼處理,已收到內容的伺服器側進行第2次的編碼處理,以此可一邊減輕在各終端機的處理負擔,又能一邊提高內容的品質及效率。此時,若有幾乎以實時接收而要解碼的請求時,也可將終端機已進行過第一次的編碼完畢資料在其他終端機接收且進行播放,因此能達到更靈活的實時分發。Further, not only the distribution processing of the distribution itself, but also the encoding processing of the photographed data may be performed at each terminal, or may be performed on the server side or may be performed separately. For example, in the encoding process, the processing loop is generally performed twice. In the first loop, the complexity or the amount of encoding of the image in the frame or scene unit is detected. In addition, in the second cycle, processing for maintaining image quality and improving coding efficiency is performed. For example, the terminal device performs the first encoding process, and the server side that has received the content performs the second encoding process, thereby reducing the processing load on each terminal device and improving the quality and efficiency of the content. . At this time, if there is a request to be decoded almost in real time, the encoded data that has been processed by the terminal for the first time can be received and played on other terminal devices, thereby achieving more flexible real-time distribution.

舉另一例來說,攝像機ex113等是從圖像進行特徵量擷取,將有關於特徵量的資料作為詮釋(meta)資料進行壓縮,而發送到伺服器。伺服器是例如從特徵量來判斷物件的重要性,而切換量化精度等因應圖像的意義來進行壓縮。特徵量資料對於伺服器上之再次壓縮時的移動向量預測之精度及效率提昇特別有效。又,也可在終端機進行VLC(可變長度編碼)等之簡易性編碼,在伺服器進行CABAC(上下文適應型二值算術編碼方式)等處理負荷大的編碼。For another example, the camera ex113 or the like extracts the feature amount from the image, compresses the material having the feature amount as a meta material, and transmits it to the server. The server determines the importance of the object from the feature amount, for example, and switches the quantization accuracy or the like in accordance with the meaning of the image. The feature quantity data is particularly effective for the accuracy and efficiency improvement of the motion vector prediction when recompressing on the server. Further, it is also possible to perform simple coding such as VLC (variable length coding) in the terminal, and to perform processing with a large load such as CABAC (Context Adaptive Binary Arithmetic Coding) on the server.

進而,以其他例來說,在體育場、購物商場、或者工廠等之中,會有經由複數個終端機而拍攝到幾乎相同的場景的複數個影像資料存在的情況。在該情況下,使用進行過拍攝的複數個終端機、及因應需要而未進行拍攝的其他終端機及伺服器,以例如GOP(Group of Picture)單位、圖片單位、或者將圖片分割之方塊單位等,分別分配編碼處理,來進行分散處理。藉此,可減少延遲,並實現更佳的實時性。Further, in another example, in a stadium, a shopping mall, a factory, or the like, a plurality of pieces of video data in which almost the same scene is captured via a plurality of terminals may exist. In this case, a plurality of terminals that have been photographed and other terminals and servers that are not photographed as needed are used, for example, a GOP (Group of Picture) unit, a picture unit, or a block unit that divides a picture. And, the coding process is separately assigned to perform the dispersion process. This reduces latency and enables better real-time performance.

又,由於複數個影像資料為幾乎相同的場景,因此也可在伺服器進行管理及/或指示,將在各終端機所拍攝的影像資料相互參考。或者,也可使伺服器接收來自各終端機的編碼完畢資料,在複數個資料之間變更參考關係,或者將圖片本身進行補正或更換,來重新進行編碼。藉此,可產生將一個一個資料的品質及效率提高的串流。Moreover, since the plurality of video data are almost the same scene, it is also possible to manage and/or instruct the server to refer to the image data captured by each terminal. Alternatively, the server may receive the encoded data from each terminal, change the reference relationship between the plurality of materials, or correct or replace the image itself to re-encode. Thereby, a stream that improves the quality and efficiency of one piece of data can be generated.

又,伺服器也可先進行將影像資料的編碼方式變更的轉碼,再分發影像資料。例如,伺服器也可將MPEG系的編碼方式轉換成VP系,也可將H.264轉換成H.265。In addition, the server may first perform transcoding to change the encoding mode of the image data, and then distribute the image data. For example, the server can also convert the MPEG-based encoding method into a VP system, or convert H.264 to H.265.

如此,編碼處理可透過終端機或者是1個以上的伺服器來進行。藉此,在下文中,作為進行處理的主體是採用「伺服器」或者是「終端機」等的記述,但也可讓以伺服器所進行的處理的一部分或者全部在終端機來進行,也可讓以終端機所進行的處理的一部分或者全部在伺服器來進行。又,有關於該等部分,針對解碼處理也是同樣。
[3D、多視角]
In this way, the encoding process can be performed by a terminal or by one or more servers. In the following, the main body of the processing is a description using a "server" or a "terminal", but some or all of the processing by the server may be performed at the terminal. Part or all of the processing performed by the terminal is performed on the server. Also, regarding these parts, the same applies to the decoding process.
[3D, multiple viewing angles]

近年來,將幾乎互相同步的複數個攝像機ex113及/或智慧型手機ex115等之終端機所攝影的不同場景、或者是相同場景以不同的視角拍攝的圖像或影像整合來利用的情形也變多了。以各終端機所拍攝的影像是根據另外取得的終端機間之相對的位置關係、或者影像所含的特徵點一致的區域等來整合。In recent years, the situation in which different scenes photographed by a plurality of cameras ex113 and/or a smart phone ex115, which are almost simultaneously synchronized, or images or images captured at different angles of the same scene are integrated is also used. too much. The images captured by the respective terminals are integrated based on the relative positional relationship between the separately obtained terminals, or the area where the feature points included in the images match.

伺服器不只將2維的動態圖像進行編碼,還可根據動態圖像的場景解析等,而自動或者是在使用者所指定的時刻,將靜態圖像進行編碼,再發送到接收終端機。伺服器進而在可取得攝影終端機之間的相對的位置關係時,不只是2維的動態圖像,還可根據從不同視角對相同場景拍攝的影像,來產生該場景的3維形狀。另,伺服器也可另外將透過點雲(point cloud)等所產生的3維的資料進行編碼,也可根據使用3維資料來辨識或者追蹤人物或物件的結果,從以複數個終端機拍攝的影像中選擇、或再構成,以產生要發送到接收終端機的影像。The server not only encodes the two-dimensional moving image, but also encodes the still image automatically or at the time specified by the user according to the scene analysis of the moving image, and then transmits the still image to the receiving terminal. Further, when the server can obtain the relative positional relationship between the photographing terminals, it is not only a two-dimensional moving image, but also a three-dimensional shape of the scene based on images taken from the same scene from different viewing angles. In addition, the server can also encode 3D data generated by point cloud or the like, or use 3D data to identify or track the results of people or objects, and shoot from multiple terminals. The image is selected, or reconstructed, to produce an image to be transmitted to the receiving terminal.

如此進行後,使用者要任意選擇對應於各攝影終端機的各影像來觀賞場景也可,要觀賞從使用複數個圖像或者影像而再構成的3維資料剪出任意視點的影像的內容也可。進而,與影像同樣,也可從複數個不同視角收取聲音,令伺服器配合影像,與來自特定視角或空間的聲音和影像進行多工而發送。In this way, the user can arbitrarily select each of the images corresponding to each of the imaging terminals to view the scene, and to view the contents of the image from the three-dimensional data reconstructed from the plurality of images or images. can. Further, similar to the image, the sound can be collected from a plurality of different viewing angles, and the server can be multiplexed with the image and the sound and image from a specific viewing angle or space.

又,近年來,Virtual Reality(VR/虛擬實境)及Augmented Reality(AR/擴增實境)等對現實世界與虛擬世界建立對應關係的內容也漸漸普及了。在VR的圖像的情況,也可使伺服器分別作出右眼用及左眼用的視點圖像,透過Multi-View Coding(MVC/多視角編碼)等,進行在各視點影像之間容許參考的編碼,也可不互相參考而作為不同串流來進行編碼。在解碼不同串流時,宜以因應使用者的視點而將虛擬的3維空間重現的方式,使其互相同步且播放。In addition, in recent years, contents such as Virtual Reality (VR/Virtual Reality) and Augmented Reality (AR/Augmented Reality) have become popular in the relationship between the real world and the virtual world. In the case of an VR image, the server can also make viewpoint images for the right eye and the left eye, and allow reference between the viewpoint images by Multi-View Coding (MVC/Multi-view coding). The encoding may also be encoded as a different stream without referring to each other. When decoding different streams, it is preferable to synchronize and play each other in a manner that reproduces the virtual three-dimensional space in response to the user's viewpoint.

在AR的圖像的情況,伺服器會根據3維上的位置或者使用者的視點的移動,而將虛擬空間上的虛擬物體資訊重疊在現實空間的攝像機資訊。解碼裝置也可取得或者保持虛擬物體資訊及3維資料,並因應使用者的視點的移動來產生2維圖像,而順利地接續,以此作成重疊資料。或者,解碼裝置也可除了虛擬物體資訊的請求指令外,將使用者的視點的移動也發送到伺服器,伺服器配合接收的視點的移動而從保持在伺服器的3維資料來作成重疊資料,且將重疊資料進行編碼,再分發到解碼裝置。另,也可以是:重疊資料除了RGB以外還具有顯示穿透度的α值,伺服器將從3維資料所作成的物件以外的部分之α值設定為0等,且使該部分為穿透的狀態下進行編碼。或者,伺服器也可如同色鍵(Chroma key)產生資料,該資料為將規定的值之RGB值設定為背景,物件以外的部份則設定為背景色。In the case of the image of the AR, the server superimposes the virtual object information on the virtual space on the camera information in the real space according to the position in the 3D or the movement of the user's viewpoint. The decoding device can also acquire or maintain the virtual object information and the three-dimensional data, and generate a two-dimensional image in response to the movement of the user's viewpoint, and smoothly connect to create overlapping data. Alternatively, the decoding device may transmit the movement of the user's viewpoint to the server in addition to the request instruction of the virtual object information, and the server cooperates with the movement of the received viewpoint to create overlapping data from the three-dimensional data held by the server. And the overlapping data is encoded and distributed to the decoding device. Alternatively, the superimposed data may have an alpha value indicating the transmittance in addition to RGB, and the server may set the alpha value of the portion other than the object made from the three-dimensional data to 0, etc., and make the portion penetrate. Encoding in the state of the state. Alternatively, the server may generate data as a chroma key, which sets the RGB value of the specified value to the background, and sets the portion other than the object to the background color.

同樣,被進行分發的資料的解碼處理也可在客戶端的各終端機進行,或是也可在伺服器側進行,或者也可相互分擔進行。以一例來說,某終端機也可先將接收請求送到伺服器,以其他終端機接收因應該請求的內容,進行解碼處理,並將已解碼完畢的訊號發送到具有顯示器的裝置。能在不依賴可通訊的終端機本身的性能之狀態下,將處理分散而選擇適合的內容,以此可播放畫質佳的資料。又,以另一例來說,也可一邊在TV等接收大尺寸的圖像資料,一邊將圖片分割後的方塊等一部分的區域在觀眾的個人終端進行解碼而顯示。藉此,可共享整體圖像,並可在身邊確認本身的負責領域或者想更加詳細確認的區域。Similarly, the decoding processing of the distributed data may be performed at each terminal of the client, or may be performed on the server side, or may be shared with each other. For example, a terminal device may first send a receiving request to the server, receive the content requested by the other terminal device, perform decoding processing, and send the decoded signal to the device having the display. It is possible to play the content with good picture quality by dispersing the processing and selecting the appropriate content without depending on the performance of the communication terminal itself. Further, in another example, while a large-sized image data is received by a TV or the like, a part of a region such as a square divided by the image may be decoded and displayed on the personal terminal of the viewer. By this, the entire image can be shared, and the area of responsibility for itself or the area to be confirmed in more detail can be confirmed by the side.

又,今後不管是室內或室外,在可使用近距離、中距離、或者長距離之數種無線通訊的狀況下,利用MPEG-DASH等之分發系統規格,一邊對於連線中的通訊切換適合的資料,一邊無縫地接收內容,這是可預想得到的。藉此,使用者不只是本身的終端機,也可一邊自由地選擇設在室內或室外之顯示器等之解碼裝置或者顯示裝置,一邊實時地進行切換。又,根據本身的位置資訊等,可一邊切換解碼的終端機及顯示的終端機,一邊進行解碼。藉此,使得如下方式也可變得可行,即:在往目的地的移動中,一邊讓埋設有可進行顯示的設備之旁邊的建築物的壁面或者是地面的一部分顯示地圖資訊,一邊移動。又,也可以基於網路上之對編碼資料的存取容易性,諸如有編碼資料會被可在短時間內從接收終端機進行存取的伺服器快取、或者是被複製到內容分發服務(Contents Delivery Service)中的邊緣伺服器等,來切換接收資料的位元率。
[可調式編碼]
In the future, in the case of indoor or outdoor use, it is possible to use a distribution system specification such as MPEG-DASH in a situation where a plurality of types of wireless communication such as a short distance, a medium distance, or a long distance can be used. Data, while receiving content seamlessly, is predictable. Thereby, the user can switch in real time not only by the terminal device but also by a decoding device or a display device such as a display provided indoors or outdoors. Further, it is possible to perform decoding while switching the decoded terminal device and the displayed terminal device based on the own location information and the like. Thereby, it is also possible to make it possible to move the map information while displaying the map information on the wall surface of the building or the part of the ground adjacent to the device in which the display is embedded. Moreover, it is also possible to make it easy to access the encoded material on the network, such as the encoded data may be cached by a server that can be accessed from the receiving terminal in a short time, or copied to the content distribution service ( The edge server in the Contents Delivery Service, etc., to switch the bit rate of the received data.
[Adjustable coding]

有關於內容的切換,是利用顯示於圖33之可調式之串流來說明,該串流是應用在上述各實施形態所示的動態圖像編碼方法而被壓縮編碼的串流。伺服器雖然具有作為個別的串流,為內容相同但品質不同的複數個串流也無妨,但也可為靈活運用時間型/空間型可調式的串流之特徵來切換內容之構成,其中前述時間型/空間型可調式的串流是如圖所示藉由分層來進行編碼而實現。即,解碼側因應例如性能的內在因素及通訊頻帶的狀態等之外在因素,來決定要解碼到哪一層,以此解碼側可自由地切換低影像解析度的內容及高影像解析度的內容,而進行解碼。例如想要把曾在移動中於智慧型手機ex115收看的影像的後續部分放到回家後以網路TV等的機器收看時,該機器只要將相同的串流進行解碼到不同層即可,因此可減輕伺服器側的負擔。The switching of the content is described by an adjustable stream shown in Fig. 33, which is a stream compressed and encoded by the moving image encoding method described in each of the above embodiments. Although the server has a plurality of streams having the same content but different qualities as individual streams, it is also possible to switch the content by using the characteristics of the stream type/space type adjustable stream, wherein the foregoing The time/space type adjustable stream is implemented by layering as shown in the figure. In other words, the decoding side determines which layer to decode based on factors such as the inherent factors of performance and the state of the communication band, so that the decoding side can freely switch between low-resolution content and high-resolution content. And decode it. For example, if you want to put a subsequent part of the image that was viewed on the mobile phone ex115 on the mobile home and watch it on a network TV or the like, the machine only needs to decode the same stream to different layers. Therefore, the burden on the server side can be reduced.

進而,如上述,在每層將圖片進行編碼,且在基本層的上位有加強層存在之實現可調性(scalability)之構成以外,也可為加強層含有基於圖像的統計資訊等之詮釋資訊,解碼側根據詮釋資訊,將基本層的圖片進行超影像解析,以此產生已高畫質化的內容。所謂超影像解析也可是同一解析度下的SN比的提昇、以及解析度的擴大之任一者。詮釋資訊是包括用以特定超影像解析處理所使用的線性或者是非線性的濾波係數的資訊、或者、用以特定超影像解析處理所使用的濾波處理、機械學習或者是最小平方運算中的參數值的資訊等。Further, as described above, in addition to the configuration in which the picture is encoded in each layer and the scalability of the enhancement layer exists in the upper layer of the base layer, the enhancement layer may contain an interpretation based on image-based statistical information or the like. Information, the decoding side based on the interpretation information, the base layer of the image is super-image analysis, in order to produce high-quality content. The super-image analysis may be any one of the improvement of the SN ratio and the expansion of the resolution at the same resolution. The interpretation information is information including linear or non-linear filter coefficients used for a specific super image analysis process, or filter values used in a specific super image analysis process, mechanical learning, or parameter values in a least squares operation. Information, etc.

或者,也可為如下構成,即:因應圖像內的物件(object)等的意涵,將圖片分割成方塊等,解碼側選擇要解碼的方塊,以此只將一部分的區域進行解碼。又,把物件的屬性(人物、車、球等)與影像內的位置(同一圖像中的座標位置等),當做為詮釋資訊來儲存,以此,解碼側可根據詮釋資訊來特定所希望的物件的位置,並決定包含該物件的方塊。例如,如圖34所示,詮釋資訊是使用HEVC中的SEI訊息等與像素資料不同之資料儲存構造來儲存。該詮釋資訊是例如顯示主物件的位置、尺寸、或者色彩等。Alternatively, the image may be divided into squares or the like in accordance with the meaning of an object or the like in the image, and the decoding side selects a block to be decoded, thereby decoding only a part of the area. In addition, the attributes of the object (person, car, ball, etc.) and the position in the image (coordinate position in the same image, etc.) are stored as interpretation information, so that the decoding side can specify the desired information according to the interpretation information. The position of the object and decide which square to contain the object. For example, as shown in FIG. 34, the interpretation information is stored using a material storage structure different from the pixel material, such as an SEI message in HEVC. The interpretation information is, for example, displaying the position, size, or color of the main object.

又,也可以串流、序列或者隨機存取單位等由複數張圖片所構成的單位來儲存詮釋資訊。藉此,解碼側可取得特定人物出現在影像內的時刻等,配合圖片單位的資訊,以此便可特定物件存在的圖片、及在圖片內之物件的位置。
[網頁的最適化]
Further, the interpretation information may be stored in a unit composed of a plurality of pictures such as a stream, a sequence, or a random access unit. Thereby, the decoding side can obtain the time when the specific person appears in the image, and the information of the picture unit can be used, so that the picture of the specific object and the position of the object in the picture can be specified.
[Optimization of web pages]

圖35是顯示電腦ex111等之中網頁(web page)的顯示畫面例之圖。圖36是顯示智慧型手機ex115等之網頁的顯示畫面例之圖。如圖35及圖36所示,網頁有包括複數個鏈接圖像的情況,其中該等鏈接圖像為朝圖像內容的鏈接,該等鏈接圖像的看到方式會依據閱覽的設備而有所不同。在於畫面上看得到複數個鏈接圖像時,迄至使用者明白表示選擇鏈接圖像為止,或者是迄至鏈接圖像靠近畫面的中央附近或者鏈接圖像整體進入畫面內為止,顯示裝置(解碼裝置)是顯示各內容所具有的靜態圖像或I圖片來作為鏈接圖像,或以複數個靜態圖像或I圖片等顯示像gif動畫般的影像,或只有接收基本層而將影像進行解碼及顯示。35 is a diagram showing an example of a display screen of a web page in a computer ex111 or the like. FIG. 36 is a view showing an example of a display screen of a web page of the smart phone ex115 or the like. As shown in FIG. 35 and FIG. 36, the webpage includes a plurality of linked images, wherein the linked images are links to image content, and the manner in which the linked images are viewed depends on the device being viewed. Different. When a plurality of linked images are viewed on the screen, the display device (decoding) is displayed until the user selects the link image or until the link image approaches the center of the screen or the entire link image enters the screen. The device displays a still image or an I picture as a link image, or displays a gif-like image in a plurality of still images or I pictures, or decodes the image only by receiving the base layer. And display.

在由使用者選擇了鏈接圖像時,顯示裝置會將基本層視為最優先,來進行解碼。另,若在構成網頁的HTML中,有顯示可調式的內容的資訊時,顯示裝置也可進行解碼迄至加強層為止。又,為了保證實時性,在被選擇之前或者通訊頻帶極窄時,顯示裝置只對參考前方的圖片(I圖片、P圖片、僅只參考前方的B圖片)進行解碼及顯示,以此可減少前頭圖片的解碼時刻與顯示時刻間的延遲(從內容的解碼開始迄至顯示開始之延遲)。又,顯示裝置也可硬是忽視圖片的參考關係,而使全部的B圖片及P圖片為參考前方,先粗略地進行解碼,然後經過一段時間,隨著所接收的圖片的增加,再進行正常的解碼。
[自動行駛]
When the linked image is selected by the user, the display device regards the base layer as the highest priority for decoding. Further, when there is information for displaying the adjustable content in the HTML constituting the web page, the display device can decode until the enhancement layer. Moreover, in order to ensure real-time performance, before the selection or the communication band is extremely narrow, the display device can only decode and display the picture in front of the reference picture (I picture, P picture, only the B picture in front), thereby reducing the head. The delay between the decoding time of the picture and the display time (delay from the start of decoding of the content to the start of display). Moreover, the display device can also ignore the reference relationship of the picture, so that all the B pictures and the P picture are referred to the front, and the decoding is roughly performed first, and then, after a period of time, the normal picture is added as the received picture increases. decoding.
[Automatic driving]

又,為了汽車的自動行駛或者支援行駛,而發送及接收2維或者3維的地圖資訊等之靜態圖像或者是影像資料時,接收終端機除了屬於1層以上的層級之圖像資料以外,也可接收天氣或者施工的資訊等來作為詮釋資訊,並對該等資訊建立對應關係而進行解碼。另,詮釋資訊也可屬於層,也可只單純地與圖像資料進行多工。In addition, when a static image or a video material such as two-dimensional or three-dimensional map information is transmitted and received for automatic driving or support traveling of a car, the receiving terminal device has image data of one or more layers. It is also possible to receive weather or construction information as an interpretation information, and to decode the information by establishing correspondence with the information. In addition, the interpretation of information can also belong to the layer, or simply multiplex with the image data.

此時,由於含有接收終端機的汽車、空拍機或者飛機等會移動,因此接收終端機會在請求接收時,發送該接收終端機的位置資訊,以此可一邊切換基地台ex106至ex110,一邊實現無縫的接收及解碼。又,接收終端機可因應使用者的選擇、使用者的狀況或者通訊頻帶的狀態,而動態地切換將詮釋資訊接收到哪一程度,或者將地圖資訊更新到何種程度。At this time, since the car, the aerial camera, or the airplane including the receiving terminal moves, the receiving terminal transmits the location information of the receiving terminal when requesting reception, thereby switching the base stations ex106 to ex110 while switching. Achieve seamless reception and decoding. Moreover, the receiving terminal can dynamically switch to which extent the interpretation information is received or to what extent the map information is updated, depending on the user's selection, the user's condition, or the state of the communication band.

如上進行,在內容供給系統ex100中,可讓客戶端實時接收使用者所發送的已編碼的資訊並將其解碼,且進行播放。
[個人內容的分發]
As described above, in the content supply system ex100, the client can receive the encoded information transmitted by the user in real time and decode it, and play it.
[Distribution of personal content]

又,在內容供給系統ex100中,不只以透過影像分發業者所進行的高畫質進行長時間的內容,還能以透過個人所進行的低畫質進行短時間的內容的單點傳播(unicast)、或者多點傳播(multicast)進行分發。又,像這樣的個人的內容,認為今後也會增加。為了將個人內容做成更優異的內容,伺服器也可進行編輯處理,之後再進行編碼處理。這是例如可以如下構成來實現。Further, in the content supply system ex100, not only the long-term content is transmitted through the high image quality performed by the image distribution company, but also the unicast of the short-term content can be performed with low image quality by the individual. , or multicast for distribution. In addition, the content of the individual is considered to increase in the future. In order to make the personal content into more excellent content, the server can also perform editing processing and then perform encoding processing. This can be realized, for example, as follows.

在攝影時實時或者先儲存後於攝影後,伺服器從原圖或者編碼完畢資料,進行攝影錯誤、場景搜尋、意義的解析、及物件檢測等之辨識處理。接著,伺服器根據辨識結果,而以手動或者自動地進行補正失焦或手震等、或者是刪除亮度比其他圖片低或未對焦的場景等重要性低的場景、或者是強調物件的邊緣、或者是變化色調等之編輯。伺服器根據編輯結果,而將編輯後的資料進行編碼。又,已知道攝影時間太長時,收視率會下降,伺服器也可根據圖像處理結果,不只是對如上述般重要性低的場景,亦對動作少的場景等自動地進行剪輯,以因應撮影時間而成為特定的時間範圍內的內容。或者,伺服器也可根據場景的意義解析的結果,來產生摘要(digest),且進行編碼。In the real-time or first-time storage after photography, the server performs recognition processing such as shooting error, scene search, meaning analysis, and object detection from the original image or the encoded data. Then, according to the identification result, the server manually or automatically performs a correction of the out-of-focus or the jitter, or deletes a scene having a low importance such as a scene with a lower brightness or an unfocused image, or emphasizes the edge of the object, Or edit the color tones, etc. The server encodes the edited data based on the edited result. Moreover, it is known that when the shooting time is too long, the viewing rate is lowered, and the server can automatically edit the scenes based on the image processing results, not only for scenes of low importance as described above, but also for scenes with less motion. It becomes content within a specific time range in response to the shadow time. Alternatively, the server may also generate a digest based on the result of the semantic analysis of the scene and encode it.

另,在個人內容中,若保持原狀,也有成為著作權、著作人格權、或者肖像權等侵害的東西被拍進去的事例,也有共享的範圍超過所意圖的範圍等,對個人來說是不宜的情況。因此,例如,伺服器也可刻意地將畫面的周邊部的人臉或者是家裡等,變更成不對焦的圖像,來進行編碼。又,伺服器也可辨識在編碼對象圖像內是否有拍到與事先登錄的人物不同之人物的臉,若有拍到時,對臉的部分進行加上馬賽克等之處理。或者,在編碼的前處理或者後處理上,從著作權等的觀點來看,使用者對圖像指定想要加工的人物或者背景區域,伺服器將所指定的區域替換成別的影像,或者進行模糊焦點等的處理也可。若是人物時,在動態圖像中,可一邊追蹤人物,一邊將臉的部分影像替換。In addition, in the personal content, if the original content is changed, there are cases in which copyrights, copyrights, or portrait rights are taken, and the scope of sharing exceeds the intended range, which is not appropriate for individuals. Happening. Therefore, for example, the server can also intentionally change the face of the peripheral portion of the screen or the home to an unfocused image to perform encoding. Further, the server can recognize whether or not a face of a person different from the person registered in advance is captured in the image to be encoded, and if it is photographed, a part of the face is subjected to a mosaic or the like. Alternatively, in the pre-processing or post-processing of the encoding, from the viewpoint of copyright, etc., the user specifies the person or background area to be processed for the image, and the server replaces the designated area with another image, or performs Processing such as blur focus can also be performed. In the case of a character, in the moving image, it is possible to replace a part of the image of the face while tracking the person.

又,由於資料量小的個人內容的收看在實時性的要求高,因此雖然依頻帶寬度有所差異,但解碼裝置首先是以基本層最優先地接收,並進行解碼及播放。解碼裝置也可在這期間接收加強層,在有循環播放的情況等有播放2次以上的時候,連同加強層在內將高畫質的影像播放。若是已如此地進行可調式的編碼之串流,就能提供如下體驗,即,雖然在未選擇時或者剛開始看的階段,是粗糙的動畫,但會漸漸地串流變精緻了,圖像變好。除了可調式編碼以外,以在第1次播放的粗糙的串流、及參考第1次動畫來編碼的第2次的串流,當做為1個串流來構成,也可提供同樣的體驗。
[其他使用例]
Further, since the viewing of personal content having a small amount of data is highly demanded in real time, the decoding apparatus first receives the highest priority in the base layer and performs decoding and playback depending on the bandwidth. The decoding device can also receive the enhancement layer during this period, and when there are two or more playbacks in the case of loop playback, the high-quality video is played together with the enhancement layer. If the stream of tunable encoding has been performed in this way, the following experience can be provided, that is, although it is a rough animation when it is not selected or at the beginning of the viewing, it gradually becomes refined and refined, and the image is gradually refined. Getting better. In addition to the adjustable coding, the same stream can be provided by using a rough stream that is played for the first time and a second stream that is coded with reference to the first animation as one stream.
[Other use cases]

又,該等編碼或者解碼處理,一般來說是在各終端機所具有的LSIex500中來處理。LSIex500可以是單晶片,也可以是由複數個晶片所構成。另,也可將動態圖像編碼或者解碼用的軟體裝入能以電腦ex111等讀取的某些記錄媒體(CD-ROM、軟碟、或者硬碟等),並使用該軟體來進行編碼或者解碼處理。進而,智慧型手機ex115是附有攝像機時,也可發送以該攝像機取得的動畫資料。此時的動畫資料是已經透過智慧型手機ex115所具有的LSIex500進行編碼處理的資料。Further, these encoding or decoding processes are generally processed in the LSI ex500 included in each terminal. The LSI ex500 may be a single wafer or a plurality of wafers. Alternatively, the software for encoding or decoding moving pictures may be loaded into some recording medium (CD-ROM, floppy disk, or hard disk, etc.) that can be read by a computer ex111 or the like, and encoded using the software or Decoding processing. Further, when the smartphone ex115 is attached to a camera, it can also transmit animation data acquired by the camera. The animation data at this time is data that has been encoded by the LSI ex500 which is included in the smart phone ex115.

另,LSIex500也可為下載應用軟體程式來啟動之構成。此時,首先,終端機要判定該終端機是否支援內容的編碼方式,或者是否具有特定服務的執行能力。在終端機未支援內容的編碼方式時,或者不具有特定服務的執行能力時,終端機要下載編解碼器或者應用軟體程式,之後進行內容的取得及播放。In addition, the LSIex500 can also be configured to download an application software program. At this time, first, the terminal determines whether the terminal supports the encoding mode of the content or whether it has the execution capability of the specific service. When the terminal does not support the encoding method of the content, or does not have the execution capability of the specific service, the terminal downloads the codec or the application software program, and then acquires and plays the content.

又,不限於經由網際網路ex101的內容供給系統ex100,在數位式廣播用系統也可裝入上述各實施形態之至少動態圖像編碼裝置(圖像編碼裝置)或者動態圖像解碼裝置(圖像解碼裝置)之任一者。由於是利用衛星等而在廣播用的電波乘載已將影像與聲音進行多工處理的多工資料,來進行傳送接收,所以相對於內容供給系統ex100的易於進行單點傳播的構成,數位式廣播用系統雖有利於多點播送的差異,但有關於編碼處理及解碼處理,仍可做同樣的應用。
[硬體構成]
Further, the content encoding system ex100 via the Internet ex101 is not limited, and at least the moving image encoding device (image encoding device) or the moving image decoding device of the above embodiments may be incorporated in the digital broadcasting system. Any of the decoding devices. Since it is a multiplexed data that has been subjected to multiplex processing of video and audio by radio waves for broadcasting by satellite or the like, and is transmitted and received by the radio wave for broadcasting, it is easy to perform unicast propagation with respect to the content supply system ex100, and digitally. Although the broadcasting system is advantageous for the difference of multicasting, the same application can be applied to the encoding processing and the decoding processing.
[Hardware composition]

圖37是顯示智慧型手機ex115的圖。又,圖38是顯示智慧型手機ex115的構成例之圖。智慧型手機ex115包含有:天線ex450,是用以於與基地台ex110之間收發電波;攝像機部ex465,是可拍攝影像及靜態圖像;以及顯示部ex458,是顯示已將以攝像機部ex465所拍攝的影像、及以天線ex450所接收的影像等進行解碼之資料。智慧型手機ex115更包含有:操作部ex466,為觸控面板等;聲音輸出部ex457,為用以輸出聲音或者音響的揚聲器等;聲音輸入部ex456,為用以輸入聲音之麥克風等;記憶部ex467,可保存所拍攝的影像或者靜態圖像、已錄取的聲音、已接收的影像或者靜態圖像、郵件等的已編碼的資料、或者已解碼的資料;及插槽部ex464,為與SIMex468之間的介面部,其中SIMex468為用以特定使用者,並以網路為首,實行對各種資料進行存取的認證。另,也可使用外接式記憶體代替記憶部ex467。Fig. 37 is a diagram showing the smartphone ex115. FIG. 38 is a diagram showing an example of the configuration of the smartphone ex115. The smart phone ex115 includes an antenna ex450 for transmitting and receiving radio waves with the base station ex110, a camera portion ex465 for capturing images and a still image, and a display portion ex458 for displaying the camera portion ex465. The captured image and the data decoded by the image received by the antenna ex450. The smart phone ex115 further includes an operation unit ex466, which is a touch panel or the like, a sound output unit ex457, which is a speaker for outputting sound or sound, and an audio input unit ex456, which is a microphone for inputting sound, and the like. Ex467, can save captured images or still images, recorded sounds, received images or still images, mailed and other encoded materials, or decoded data; and slot ex464, and SIMex468 The interface between the SIMex 468 is used for specific users, and the Internet is the first to perform authentication for accessing various materials. Alternatively, an external memory may be used instead of the memory unit ex467.

又,將顯示部ex458及操作部ex466等統合性地控制的主控制部ex460,與電源電路部ex461、操作輸入控制部ex462、影像訊號處理部ex455、攝像機I/F部ex463、LCD控制部ex459、調變/解調部ex452、多工/分離部ex453、聲音訊號處理部ex454、插槽部ex464、以及記憶部ex467是經由匯流排ex470來連接。Further, the main control unit ex460, which is integrally controlled by the display unit ex458 and the operation unit ex466, and the power supply circuit unit ex461, the operation input control unit ex462, the video signal processing unit ex455, the camera I/F unit ex463, and the LCD control unit ex459 The modulation/demodulation unit ex452, the multiplex/separation unit ex453, the audio signal processing unit ex454, the slot unit ex464, and the memory unit ex467 are connected via the bus bar ex470.

電源電路部ex461是藉由使用者的操作使電源開關成為開啟狀態時,從電池組對各部供應電力,藉此使智慧型手機ex115啟動成可動作的狀態。When the power switch is turned on by the user's operation, the power supply circuit unit ex461 supplies power to each unit from the battery pack, thereby causing the smartphone ex115 to be activated.

智慧型手機ex115是基於具有CPU、ROM及RAM等之主控制部ex460的控制,進行通話及資料通訊等的處理。在通話時是將以聲音輸入部ex456所收音的聲音訊號在聲音訊號處理部ex454轉換成數位式聲音訊號,將該訊號在調變/解調部ex452進行頻譜擴散處理,在發送/接收部ex451實施數位類比轉換處理以及頻率轉換處理,之後再經由天線ex450進行發送。又,將接收資料放大,並實施頻率轉換處理以及類比數位轉換處理,在調變/解調部ex452進行頻譜反擴散處理,在聲音訊號處理部ex454轉換成類比聲音訊號,之後再將該訊號從聲音輸出部ex457進行輸出。在資料通訊模式時,透過本體部的操作部ex466等的操作,將正文、靜態圖像、或者影像資料經由操作輸入控制部ex462而送出至主控制部ex460,並同樣地被進行收發處理。在資料通訊模式時,於發送影像、靜態圖像、或者影像及聲音的情況,影像訊號處理部ex455是將記憶部ex467所保存的影像訊號、或者從攝像機部ex465所輸入的影像訊號透過上述各實施形態所示的動態圖像編碼方法進行壓縮編碼,且將業經編碼的影像資料送出至多工/分離部ex453。又,聲音訊號處理部ex454是將在以攝像機部ex465將影像或者靜態圖像等攝影中於聲音輸入部ex456所收音的聲音訊號進行編碼,且將業經編碼的聲音資料送出至多工/分離部ex453。多工/分離部ex453是將業經編碼完畢的影像資料及業經編碼完畢的聲音資料以規定的方式進行多工,且於調變/解調部(調變/解調電路部)ex452、及發送/接收部ex451實施調變處理及轉換處理,並經由天線ex450來發送。The smartphone ex115 performs processing such as call and data communication based on the control of the main control unit ex460 such as a CPU, a ROM, and a RAM. At the time of the call, the audio signal received by the voice input unit ex456 is converted into a digital audio signal by the audio signal processing unit ex454, and the signal is subjected to spectrum diffusion processing in the modulation/demodulation unit ex452, and the transmission/reception unit ex451 The digital analog conversion processing and the frequency conversion processing are performed, and then transmitted via the antenna ex450. Further, the received data is amplified, and the frequency conversion processing and the analog digital conversion processing are performed, and the spectrum de-diffusion processing is performed in the modulation/demodulation unit ex452, and converted into an analog sound signal by the audio signal processing unit ex454, and then the signal is transmitted from the analog signal. The sound output unit ex457 outputs. In the data communication mode, the text, the still image, or the video data is sent to the main control unit ex460 via the operation input control unit ex462 through the operation of the operation unit ex466 or the like of the main unit, and is similarly transmitted and received. In the data communication mode, when transmitting a video, a still image, or a video or a sound, the video signal processing unit ex455 transmits the video signal stored in the memory unit ex467 or the video signal input from the camera unit ex465 through the respective The moving picture coding method shown in the embodiment performs compression coding, and the coded video data is sent to the multiplex/separation unit ex453. Further, the audio signal processing unit ex454 encodes the audio signal received by the audio input unit ex456 during the imaging of the video or the still image by the camera unit ex465, and sends the encoded audio data to the multiplex/separation unit ex453. . The multiplex/separation unit ex453 multiplexes the encoded video data and the encoded audio data in a predetermined manner, and performs modulation and demodulation (modulation/demodulation circuit unit) ex452 and transmission. The receiving unit ex451 performs the modulation processing and the conversion processing, and transmits it via the antenna ex450.

在接收到電子郵件或者對話(chat)所附的影像、或者連結到網頁等的影像時,為了將經由天線ex450所接收到的多工資料進行解碼,多工/分離部ex453將多工資料進行分離,藉此把多工資料分成影像資料的位元串流及聲音資料的位元串流,經由同步匯流排ex470,而將業經編碼的影像資料供給至影像訊號處理部ex455,並將業經編碼的聲音資料供給至聲音訊號處理部ex454。影像訊號處理部ex455透過對應於上述各實施形態所示的動態圖像編碼方法之動態圖像解碼方法,而將影像訊號進行解碼,且透過LCD控制部ex459,而從顯示部ex458,顯示被連結的動態圖像檔所含之影像或者靜態圖像。又,聲音訊號處理部ex454是將聲音訊號進行解碼,且從聲音輸出部ex457輸出聲音。另,由於實時串流傳輸(real-time streaming)已經普及了,依使用者的狀況,聲音的播放也可能會有對社會上不合適的場面發生。為此,作為初始值,聲音訊號不要播放,而只將影像資料播放的構成是較被希望的。也可以是只有在使用者進行了操作,如點選影像資料等的時候,將聲音同步地播放。When receiving an image attached to an e-mail or a chat or connecting to a web page or the like, the multiplexer/extension unit ex453 performs the multiplexed data in order to decode the multiplexed data received via the antenna ex450. Separating, thereby dividing the multiplexed data into a bit stream of the image data and a bit stream of the sound data, and supplying the encoded image data to the image signal processing unit ex455 via the synchronous bus ex470, and encoding the data The sound data is supplied to the audio signal processing unit ex454. The video signal processing unit ex455 decodes the video signal by the video decoding method corresponding to the video encoding method described in each of the above embodiments, and transmits the video signal to the display unit ex458 via the LCD control unit ex459. The image or still image contained in the dynamic image file. Further, the audio signal processing unit ex454 decodes the audio signal and outputs the sound from the audio output unit ex457. In addition, since real-time streaming has become widespread, depending on the user's situation, sound playback may also occur in socially inappropriate scenes. For this reason, as an initial value, the audio signal is not played, and only the composition of the video material is more desirable. It is also possible to play the sound synchronously only when the user performs an operation, such as clicking on image data.

又,在此,是以智慧型手機ex115為例進行了說明,以終端機而言,也可考慮如下3種安裝形式:除了具有編碼器及解碼器兩者的訊號收發型終端機之外,只具有編碼器的發訊終端機、及只具有解碼器的收訊終端機。進而,在數位廣播用系統中,是以接收或者發送在影像資料上已有聲音資料等進行多工處理之多工資料的情形來說明,但多工資料上除了聲音資料以外,也可有與影像有關聯的文字資料等進行多工處理,也可接收或者發送影像資料本身,而不是多工資料。Here, the smart phone ex115 is taken as an example, and in the terminal device, three types of mounting forms are also considered: in addition to the signal transceiving type terminal having both the encoder and the decoder, A messaging terminal having only an encoder, and a receiving terminal having only a decoder. Further, in the digital broadcasting system, the multiplexed data for performing multiplex processing on the video data is received or transmitted, but the multiplexed data may be combined with the sound data. The image has associated text data and other multiplex processing, and can also receive or send the image data itself, rather than multiplex data.

另,以含有CPU的主控制部ex460控制編碼處理或者解碼處理的情形來說明,但終端機具備GPU的情況也居多。因此,如後述構成也可,即,透過在CPU與GPU共通化的記憶體、或者有將位址加以管理以形成可以共通使用之狀態的記憶體,來靈活運用GPU的性能,並將廣大區域匯整來一起處理者。藉此,可縮短編碼時間,確保實時性,可實現低延遲。尤其,不是利用CPU,而是透過GPU,以圖片等的單位匯整來一起進行移動估測、解區塊濾波器、SAO(Sample Adaptive Offset)、及轉換、量化的處理時,是有效率的。
(產業利用性)
Further, the case where the main control unit ex460 including the CPU controls the encoding process or the decoding process will be described, but the case where the terminal has the GPU is also large. Therefore, the configuration of the GPU can be flexibly utilized by using a memory that is shared between the CPU and the GPU, or a memory that manages the address to form a state that can be used in common. Consolidate to work together. Thereby, the encoding time can be shortened, real-time performance can be ensured, and low latency can be realized. In particular, it is efficient to use the CPU instead of the GPU to perform motion estimation, deblocking filter, SAO (Sample Adaptive Offset), and conversion and quantization processing in units of pictures and the like. .
(industrial use)

本揭示是可利用在諸如電視接收機、數位視頻錄影機、車用導航、行動電話機、數位照相機、數位視頻攝影機、視訊會議系統、或者電子鏡等。The present disclosure is applicable to, for example, television receivers, digital video recorders, car navigation, mobile phones, digital cameras, digital video cameras, video conferencing systems, or electronic mirrors.

100‧‧‧編碼裝置100‧‧‧ coding device

102‧‧‧分割部 102‧‧‧ Division

104‧‧‧減法部 104‧‧‧Subtraction Department

106‧‧‧轉換部 106‧‧‧Transition Department

108‧‧‧量化部 108‧‧‧Quantity Department

110‧‧‧熵編碼部 110‧‧‧ Entropy Coding Department

112、204‧‧‧反量化部 112, 204‧‧‧Anti-Quantization Department

114、206‧‧‧反轉換部 114, 206‧‧‧Anti-conversion department

116、208‧‧‧加法部 116, 208‧‧ Addition Department

118、210‧‧‧區塊記憶體 118, 210‧‧‧ Block memory

120、212‧‧‧迴路濾波部 120, 212‧‧‧Circuit Filtering Department

122、214‧‧‧框記憶體 122, 214‧‧‧ box memory

124、216‧‧‧內預測部 124, 216‧‧ Internal Forecasting Department

126、218‧‧‧間預測部 126, 218‧ ‧ forecasting department

128、220‧‧‧預測控制部 128, 220‧‧‧Predictive Control Department

131、231‧‧‧濾波控制部 131, 231‧‧‧ Filter Control Department

132、232‧‧‧當前濾波資訊記憶部 132, 232‧‧‧ Current Filter Information Memory Department

133、233‧‧‧參考濾波資訊記憶部 133, 233‧‧‧Reference filtering information memory

134、234‧‧‧適應濾波部 134, 234‧‧‧ Adaptation Filtering Department

160、260‧‧‧電路 160, 260‧‧‧ circuits

162、262‧‧‧記憶體 162, 262‧‧‧ memory

200‧‧‧解碼裝置 200‧‧‧ decoding device

202‧‧‧熵解碼部 202‧‧‧ Entropy Decoding Department

ex100‧‧‧內容供給系統 Ex100‧‧‧Content Supply System

ex101‧‧‧網際網路 Ex101‧‧‧Internet

ex102‧‧‧網際網路服務提供者 Ex102‧‧‧Internet Service Provider

ex103‧‧‧串流伺服器 Ex103‧‧‧Streaming server

ex104‧‧‧通訊網 Ex104‧‧‧Communication Network

ex106至ex110‧‧‧基地台 Ex106 to ex110‧‧‧ base station

ex111‧‧‧電腦 Ex111‧‧‧ computer

ex112‧‧‧遊戲機 Ex112‧‧‧game machine

ex113‧‧‧攝像機 Ex113‧‧‧Camera

ex114‧‧‧家電 Ex114‧‧‧Home appliances

ex115‧‧‧智慧型手機 Ex115‧‧‧Smart mobile phone

ex116‧‧‧衛星 Ex116‧‧‧ satellite

ex117‧‧‧飛機 Ex117‧‧ aircraft

ex450‧‧‧天線 Ex450‧‧‧Antenna

ex451‧‧‧發送/接收部 Ex451‧‧‧Send/Receive Department

ex452‧‧‧調變/解調部 Ex452‧‧‧Modulation/Demodulation Department

ex453‧‧‧多工/分離部 Ex453‧‧‧Multiplex/Separation Department

ex454‧‧‧聲音訊號處理部 Ex454‧‧‧Sound Signal Processing Department

ex455‧‧‧影像訊號處理部 Ex455‧‧‧Image Signal Processing Department

ex456‧‧‧聲音輸入部 Ex456‧‧‧Sound Input Department

ex457‧‧‧聲音輸出部 Ex457‧‧‧Sound Output Department

ex458‧‧‧顯示部 Ex458‧‧‧Display Department

ex459‧‧‧LCD控制部 Ex459‧‧‧LCD Control Department

ex460‧‧‧主控制部 Ex460‧‧‧Main Control Department

ex461‧‧‧電源電路部 Ex461‧‧‧Power Circuit Department

ex462‧‧‧操作輸入控制部 Ex462‧‧‧Operation Input Control Department

ex463‧‧‧攝像機I/F部 Ex463‧‧‧Camera I/F Department

ex464‧‧‧插槽部 Ex464‧‧‧Slots

ex465‧‧‧攝像機部 Ex465‧‧‧ camera department

ex466‧‧‧操作部 Ex466‧‧‧Operation Department

ex467‧‧‧記憶部 Ex467‧‧‧Memory Department

ex468‧‧‧SIM Ex468‧‧‧SIM

ex470‧‧‧匯流排 Ex470‧‧‧ busbar

圖1是顯示實施形態1之編碼裝置之功能構成的方塊圖。Fig. 1 is a block diagram showing a functional configuration of an encoding apparatus according to a first embodiment.

圖2是顯示實施形態1中之區塊分割之一例之圖。Fig. 2 is a view showing an example of block division in the first embodiment;

圖3是顯示對應於各轉換型式之轉換基底函數之表格。Figure 3 is a table showing the conversion basis functions corresponding to the respective conversion patterns.

圖4A是顯示ALF所使用之濾波器之形狀一例之圖。Fig. 4A is a view showing an example of the shape of a filter used in ALF.

圖4B是顯示ALF所使用之濾波器的形狀另一例之圖。Fig. 4B is a view showing another example of the shape of the filter used in the ALF.

圖4C是顯示ALF所使用之濾波器的形狀另一例之圖。Fig. 4C is a view showing another example of the shape of the filter used in the ALF.

圖5A是顯示內預測中之67個內預測模式之圖。Figure 5A is a graph showing 67 intra prediction modes in intra prediction.

圖5B是用以說明藉OBMC處理之預測圖像補正處理之概要的流程圖。FIG. 5B is a flowchart for explaining an outline of predicted image correction processing by OBMC processing.

圖5C是用以說明藉OBMC處理之預測圖像補正處理之概要的概念圖。FIG. 5C is a conceptual diagram for explaining an outline of a predicted image correction process by OBMC processing.

圖5D是顯示FRUC一例之圖。Fig. 5D is a diagram showing an example of FRUC.

圖6是用以說明在沿著移動軌跡的2個區塊間的圖案匹配(雙向匹配)之圖。Fig. 6 is a diagram for explaining pattern matching (bidirectional matching) between two blocks along a movement trajectory.

圖7是用以說明當前圖片內的模板與參考圖片內的區塊之間的圖案匹配(模板匹配)之圖。FIG. 7 is a diagram for explaining pattern matching (template matching) between a template in a current picture and a block in a reference picture.

圖8是用以說明假設等速直線運動之模型的圖。Fig. 8 is a view for explaining a model assuming constant-speed linear motion.

圖9A是用以說明導出基於複數個鄰接區塊的移動向量之子區塊單位的移動向量的圖。FIG. 9A is a diagram for explaining a motion vector for deriving a sub-block unit based on a motion vector of a plurality of adjacent blocks. FIG.

圖9B是用以說明合併模式之移動向量導出處理之概要之圖。Fig. 9B is a diagram for explaining an outline of a motion vector derivation process in a merge mode.

圖9C是用以說明DMVR處理之概要之概念圖。Fig. 9C is a conceptual diagram for explaining an outline of DMVR processing.

圖9D是用以說明預測圖像產生方法之概要之圖,前述預測圖像產生方法使用了LIC處理的亮度補正處理。9D is a diagram for explaining an outline of a method of generating a predicted image using the luminance correction processing of the LIC processing.

圖10是顯示實施形態1之解碼裝置的功能構成的方塊圖。Fig. 10 is a block diagram showing a functional configuration of a decoding apparatus according to the first embodiment.

圖11是顯示實施形態1之編碼裝置之迴路濾波部的構成之方塊圖。Fig. 11 is a block diagram showing the configuration of a loop filter unit of the coding apparatus according to the first embodiment.

圖12A是顯示實施形態1之濾波資訊的管理順序的第1具體例的流程圖。Fig. 12A is a flowchart showing a first specific example of the management procedure of the filter information in the first embodiment.

圖12B是顯示實施形態1之濾波資訊的設定順序的第1具體例的流程圖。Fig. 12B is a flowchart showing a first specific example of the setting procedure of the filter information in the first embodiment.

圖13A是顯示實施形態1之濾波資訊的管理順序的第2具體例的流程圖。Fig. 13A is a flowchart showing a second specific example of the management procedure of the filter information in the first embodiment.

圖13B是顯示實施形態1之濾波資訊的設定順序的第2具體例的流程圖。Fig. 13B is a flowchart showing a second specific example of the setting procedure of the filter information in the first embodiment.

圖14A是顯示實施形態1之濾波資訊的參考限制的第1具體例的概念圖。Fig. 14A is a conceptual diagram showing a first specific example of the reference restriction of the filter information in the first embodiment.

圖14B是顯示實施形態1之濾波資訊的參考限制的第2具體例的概念圖。Fig. 14B is a conceptual diagram showing a second specific example of the reference restriction of the filter information in the first embodiment.

圖15是顯示實施形態1之解碼裝置的迴路濾波部的構成之方塊圖。Fig. 15 is a block diagram showing the configuration of a loop filter unit of the decoding device of the first embodiment.

圖16是顯示變形態樣之濾波資訊的處理順序之第1具體例之流程圖。Fig. 16 is a flowchart showing a first specific example of the processing procedure of the filter information of the modified embodiment.

圖17是顯示變形態樣之濾波資訊的處理順序之第2具體例之流程圖。Fig. 17 is a flowchart showing a second specific example of the processing procedure of the filter information of the modified form.

圖18是顯示變形態樣之PPS通知的第1具體例之概念圖。Fig. 18 is a conceptual diagram showing a first specific example of a PPS notification of a modified form.

圖19是顯示變形態樣之PPS通知的第2具體例之概念圖。Fig. 19 is a conceptual diagram showing a second specific example of the PPS notification of the modified form.

圖20A是顯示變形態樣之PPS通知的第3具體例之概念圖。Fig. 20A is a conceptual diagram showing a third specific example of the PPS notification of the modified form.

圖20B是顯示變形態樣之PPS通知的第4具體例之概念圖。Fig. 20B is a conceptual diagram showing a fourth specific example of the PPS notification of the modified form.

圖21A是顯示變形態樣之PPS通知的第5具體例之概念圖。Fig. 21A is a conceptual diagram showing a fifth specific example of the PPS notification of the modified form.

圖21B是顯示變形態樣之PPS通知的第6具體例之概念圖。Fig. 21B is a conceptual diagram showing a sixth specific example of the PPS notification of the modified form.

圖22是顯示編碼裝置的安裝例的方塊圖。Fig. 22 is a block diagram showing an example of mounting of an encoding device.

圖23是顯示編碼裝置的第1動作例的流程圖。Fig. 23 is a flowchart showing a first operation example of the encoding device.

圖24是顯示編碼裝置的第2動作例的流程圖。Fig. 24 is a flowchart showing a second operation example of the encoding device.

圖25是顯示編碼裝置的第3動作例的流程圖。Fig. 25 is a flowchart showing a third operation example of the encoding device.

圖26是顯示編碼裝置的第4動作例的流程圖。Fig. 26 is a flowchart showing a fourth operation example of the encoding device.

圖27是顯示解碼裝置的安裝例的方塊圖。Fig. 27 is a block diagram showing an example of mounting of a decoding device.

圖28是顯示解碼裝置的第1動作例的流程圖。FIG. 28 is a flowchart showing a first operation example of the decoding device.

圖29是顯示解碼裝置的第2動作例的流程圖。Fig. 29 is a flowchart showing a second operation example of the decoding device.

圖30是顯示解碼裝置的第3動作例的流程圖。Fig. 30 is a flowchart showing a third operation example of the decoding device.

圖31是顯示解碼裝置的第4動作例的流程圖。Fig. 31 is a flowchart showing a fourth operation example of the decoding device.

圖32是實現內容分發服務之內容供給系統的整體構成圖。Fig. 32 is a view showing the overall configuration of a content supply system for realizing a content distribution service.

圖33是顯示可調式編碼時之編碼構造一例之圖。Fig. 33 is a view showing an example of a coding structure in the case of adjustable coding.

圖34是顯示可調式編碼時之編碼構造一例之圖。Fig. 34 is a view showing an example of a coding structure in the case of adjustable coding.

圖35是顯示網頁的顯示畫面例之圖。35 is a diagram showing an example of a display screen of a web page.

圖36是顯示網頁的顯示畫面例之圖。36 is a diagram showing an example of a display screen of a web page.

圖37是顯示智慧型手機一例之圖。Figure 37 is a diagram showing an example of a smart phone.

圖38是顯示智慧型手機的構成例之方塊圖。Fig. 38 is a block diagram showing a configuration example of a smart phone.

Claims (18)

一種編碼裝置,在含有複數張圖片之動態圖像的編碼中適用自適應迴路濾波,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID, 前述編碼裝置包含有: 電路;及 記憶體; 前述電路使用前述記憶體,進行以下步驟: 參考有關聯於第2圖片之第2濾波資訊,決定用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊的步驟,其中前述第2圖片為前述複數張圖片之中在編碼順序上較前述第1圖片更前面的圖片;及 使用已被決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟; 在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL(Network Abstraction Layer,網路抽象層)單元類型為規定NAL單元類型時,前述電路禁止參考有關聯於第3圖片之第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中在編碼順序上較前述第1圖片更前面的圖片,且為暫時ID與前述第1圖片相同的圖片。An encoding apparatus that applies adaptive loop filtering in encoding of a moving image containing a plurality of pictures, wherein the pictures are respectively assigned a temporary ID indicating a level of time adjustability, The aforementioned encoding device comprises: Circuit; and Memory; The foregoing circuit uses the aforementioned memory to perform the following steps: Referring to the second filtering information associated with the second picture, determining a first filtering information for applying adaptive loop filtering to the first picture of the plurality of pictures, wherein the second picture is the plurality of pictures Among the pictures in the coding order that are earlier than the first picture; and And applying the adaptive loop filtering step to the first picture by using the first filtering information that has been determined; In the step of determining the first filter information, when the NAL (Network Abstraction Layer) unit type of the first picture is a predetermined NAL unit type, the circuit prohibition reference is associated with the third picture of the third picture. The filtering information is used as the second filtering information, wherein the third picture is a picture that is earlier than the first picture in the encoding order among the plurality of pictures, and is a picture in which the temporary ID is the same as the first picture. 如請求項1之編碼裝置,其中在決定前述第1濾波資訊的步驟中,前述電路禁止參考有關聯於第4圖片之第4濾波資訊來作為前述第2濾波資訊,其中前述第4圖片是前述複數張圖片之中編碼順序上較前述第1圖片還前面的圖片,且是暫時ID大於前述第1圖片的圖片。The coding apparatus of claim 1, wherein in the step of determining the first filter information, the circuit prohibits reference to the fourth filter information associated with the fourth picture as the second filter information, wherein the fourth picture is the aforementioned Among the plurality of pictures, the picture in the coding order is earlier than the first picture, and the picture whose temporary ID is larger than the first picture. 如請求項1或2之編碼裝置,其中前述電路更進行以下步驟: 參考有關聯於第6圖片之第6濾波資訊,決定用來對第5圖片適用自適應迴路濾波之第5濾波資訊的步驟,其中前述第5圖片是前述複數張圖片之中編碼順序上較前述第1圖片還後面的圖片,前述第6圖片是前述複數張圖片之中編碼順序上較前述第5圖片還前面的圖片;及 使用已決定的前述第5濾波資訊,對前述第5圖片適用自適應迴路濾波的步驟; 在決定前述第5濾波資訊的步驟中,當前述第1圖片的NAL單元類型為前述規定NAL單元類型時,前述電路禁止參考有關聯於前述第3圖片之前述第3濾波資訊來作為前述第6濾波資訊。The encoding device of claim 1 or 2, wherein the foregoing circuit further performs the following steps: Referring to the sixth filtering information associated with the sixth picture, the step of applying the fifth filtering information for adaptive loop filtering to the fifth picture is determined, wherein the fifth picture is the coding order among the plurality of pictures. a picture in the back of the first picture, wherein the sixth picture is a picture in front of the fifth picture in a coding order among the plurality of pictures; and Applying the adaptive loop filtering step to the fifth picture using the determined fifth filtering information; In the step of determining the fifth filtering information, when the NAL unit type of the first picture is the predetermined NAL unit type, the circuit prohibits the reference to the third filtering information associated with the third picture as the sixth Filter information. 如請求項3之編碼裝置,其中在決定前述第5濾波資訊的步驟中,當前述第1圖片的NAL單元類型為前述規定NAL單元類型時,前述電路禁止參考有關聯於第4圖片之第4濾波資訊來作為前述第6濾波資訊,其中前述第4圖片是前述複數張圖片之中編碼順序上較前述第1圖片還前面的圖片,且是暫時ID大於前述第1圖片的圖片。The coding apparatus of claim 3, wherein, in the step of determining the fifth filtering information, when the NAL unit type of the first picture is the predetermined NAL unit type, the circuit prohibition reference is associated with the fourth picture 4 The filtering information is used as the sixth filtering information, wherein the fourth picture is a picture in which the encoding order is earlier than the first picture, and the temporary ID is larger than the first picture. 如請求項1或2之編碼裝置,其中在決定前述第1濾波資訊的步驟中,當前述第1圖片與第7圖片之間存在有第8圖片,且前述第8圖片的NAL單元類型為前述規定NAL單元類型時,前述電路禁止參考有關聯於前述第7圖片之第7濾波資訊來作為前述第2濾波資訊,其中前述第7圖片是前述複數張圖片之中編碼順序上較前述第1圖片還前面的圖片,且是暫時ID大於0的圖片,前述第8圖片是暫時ID與前述第7圖片相同或者暫時ID小於前述第7圖片的圖片。The coding apparatus of claim 1 or 2, wherein in the step of determining the first filter information, an eighth picture exists between the first picture and the seventh picture, and the NAL unit type of the eighth picture is the foregoing When the NAL unit type is specified, the foregoing circuit prohibits the reference to the seventh filtering information associated with the seventh picture as the second filtering information, wherein the seventh picture is that the coding order in the plurality of pictures is higher than the first picture The previous picture is a picture whose temporary ID is greater than 0, and the eighth picture is a picture in which the temporary ID is the same as the seventh picture or the temporary ID is smaller than the seventh picture. 如請求項1或2之編碼裝置,其中前述規定NAL單元類型為TSA(Temporal Sub-layer Access,時間子層存取)圖片的NAL單元類型。The coding apparatus of claim 1 or 2, wherein the foregoing NAL unit type is a NAL unit type of a TSA (Temporal Sub-layer Access) picture. 如請求項1或2之編碼裝置,其中前述電路更進行以下步驟: 參考有關聯於第6圖片之第6濾波資訊,決定用來對第5圖片適用自適應迴路濾波之第5濾波資訊的步驟,其中前述前述第5圖片是前述複數張圖片之中編碼順序上較前述第1圖片還後面的圖片,前述第6圖片是前述複數張圖片之中編碼順序上較前述第5圖片還前面的圖片;及 使用已決定的前述第5濾波資訊,對前述第5圖片適用自適應迴路濾波的步驟; 在決定前述第5濾波資訊的步驟中,當前述第1圖片的NAL單元類型為前述規定NAL單元類型,且前述第5圖片的暫時ID與前述第1圖片的暫時ID相同時,前述電路禁止參考有關聯於前述第3圖片之前述第3濾波資訊來作為前述第6濾波資訊。The encoding device of claim 1 or 2, wherein the foregoing circuit further performs the following steps: Referring to the sixth filtering information associated with the sixth picture, the step of applying the fifth filtering information for adaptive loop filtering to the fifth picture is determined, wherein the foregoing fifth picture is a coding order among the plurality of pictures. In the picture after the first picture, the sixth picture is a picture in which the coding order is earlier than the fifth picture in the plurality of pictures; and Applying the adaptive loop filtering step to the fifth picture using the determined fifth filtering information; In the step of determining the fifth filtering information, when the NAL unit type of the first picture is the predetermined NAL unit type, and the temporary ID of the fifth picture is the same as the temporary ID of the first picture, the circuit prohibits reference The third filter information associated with the third picture is used as the sixth filter information. 如請求項1或2之編碼裝置,其中前述規定NAL單元類型為STSA(Step-wise Temporal Sub-layer Access,逐步時間子層存取)圖片的NAL單元類型。The encoding device of claim 1 or 2, wherein the foregoing NAL unit type is a NAL unit type of a STSA (Step-wise Temporal Sub-layer Access) picture. 一種解碼裝置,在含有複數張圖片之動態圖像的解碼中適用自適應迴路濾波,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID, 前述解碼裝置包含有: 電路;及 記憶體; 前述電路使用前述記憶體,進行以下步驟: 參考有關聯於第2圖片之第2濾波資訊,決定用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊的步驟,其中前述第2圖片是在前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片;及 使用已決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟; 在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL(Network Abstraction Layer)單元類型為規定NAL單元類型時,前述電路禁止參考有關聯於第3圖片之第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片,且為暫時ID與前述第1圖片相同的圖片。A decoding apparatus that applies adaptive loop filtering in decoding of a moving image containing a plurality of pictures, wherein the pictures are respectively assigned a temporary ID indicating a level of time adjustability, The foregoing decoding device includes: Circuit; and Memory; The foregoing circuit uses the aforementioned memory to perform the following steps: Referring to the second filter information associated with the second picture, determining a first filter information for applying adaptive loop filtering to the first picture of the plurality of pictures, wherein the second picture is in the plurality of pictures a picture in the picture that is in the order of decoding earlier than the first picture; and And applying the adaptive loop filtering to the first picture by using the determined first filtering information; In the step of determining the first filter information, when the NAL (Network Abstraction Layer) unit type of the first picture is a predetermined NAL unit type, the circuit prohibits reference to the third filter information associated with the third picture as the foregoing In the second filter information, the third picture is a picture in which the decoding order is higher than the first picture in the decoding order, and the temporary ID is the same picture as the first picture. 如請求項9之解碼裝置,其中在決定前述第1濾波資訊的步驟中,前述電路禁止參考有關聯於第4圖片之第4濾波資訊來作為前述第2濾波資訊,其中前述第4圖片是前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片,且是暫時ID大於前述第1圖片的圖片。The decoding device of claim 9, wherein in the step of determining the first filter information, the circuit prohibits reference to the fourth filter information associated with the fourth picture as the second filter information, wherein the fourth picture is the aforementioned Among the plurality of pictures, the picture in the decoding order is higher than the picture in front of the first picture, and the picture whose temporary ID is larger than the first picture. 如請求項9或10之解碼裝置,其中前述電路更進行以下步驟: 參考有關聯於第6圖片之第6濾波資訊,決定用來對第5圖片適用自適應迴路濾波之第5濾波資訊的步驟,其中前述第5圖片是前述複數張圖片之中解碼順序上較前述第1圖片還後面的圖片,前述第6圖片是前述複數張圖片之中解碼順序上較前述第5圖片還前面的圖片;及 使用已決定的前述第5濾波資訊,對前述第5圖片適用自適應迴路濾波的步驟; 在決定前述第5濾波資訊的步驟中,當前述第1圖片的NAL單元類型為前述規定NAL單元類型時,前述電路禁止參考有關聯於前述第3圖片之前述第3濾波資訊來作為前述第6濾波資訊。The decoding device of claim 9 or 10, wherein the foregoing circuit further performs the following steps: Referring to the sixth filtering information associated with the sixth picture, the step of applying the fifth filtering information for adaptive loop filtering to the fifth picture is determined, wherein the fifth picture is the decoding order among the plurality of pictures. In the picture after the first picture, the sixth picture is a picture in front of the fifth picture in the decoding order among the plurality of pictures; and Applying the adaptive loop filtering step to the fifth picture using the determined fifth filtering information; In the step of determining the fifth filtering information, when the NAL unit type of the first picture is the predetermined NAL unit type, the circuit prohibits the reference to the third filtering information associated with the third picture as the sixth Filter information. 如請求項11之解碼裝置,其中在決定前述第5濾波資訊的步驟中,當前述第1圖片的NAL單元類型為前述規定NAL單元類型時,前述電路禁止參考有關聯於第4圖片之第4濾波資訊來作為前述第6濾波資訊,其中前述第4圖片是前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片,且是暫時ID大於前述第1圖片的圖片。The decoding device of claim 11, wherein in the step of determining the fifth filtering information, when the NAL unit type of the first picture is the predetermined NAL unit type, the circuit prohibition reference is associated with the fourth picture 4 The filtering information is used as the sixth filtering information, wherein the fourth picture is a picture in which the decoding order is higher than the first picture in the decoding order, and the picture whose temporary ID is larger than the first picture. 如請求項9或10之解碼裝置,其中在決定前述第1濾波資訊的步驟中,當前述第1圖片與第7圖片之間存在有第8圖片,且前述第8圖片的NAL單元類型為前述規定NAL單元類型時,前述電路禁止參考有關聯於前述第7圖片之第7濾波資訊來作為前述第2濾波資訊,其中前述第7圖片是前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片,且是暫時ID大於0的圖片,前述第8圖片是暫時ID與前述第7圖片相同或者暫時ID小於前述第7圖片的圖片。The decoding device of claim 9 or 10, wherein in the step of determining the first filtering information, an eighth picture exists between the first picture and the seventh picture, and the NAL unit type of the eighth picture is the foregoing When the NAL unit type is specified, the foregoing circuit prohibits the reference to the seventh filtering information associated with the seventh picture as the second filtering information, wherein the seventh picture is that the decoding order is the same as the first picture in the plurality of pictures. The previous picture is a picture whose temporary ID is greater than 0, and the eighth picture is a picture in which the temporary ID is the same as the seventh picture or the temporary ID is smaller than the seventh picture. 如請求項9或10之解碼裝置,其中前述規定NAL單元類型為TSA(Temporal Sub-layer Access)圖片的NAL單元類型。The decoding device of claim 9 or 10, wherein the aforementioned NAL unit type is a NAL unit type of a TSA (Temporal Sub-layer Access) picture. 如請求項9或10之解碼裝置,其中前述電路更進行以下步驟: 參考有關聯於第6圖片之第6濾波資訊,決定用來對第5圖片適用自適應迴路濾波之第5濾波資訊的步驟,其中前述前述第5圖片是前述複數張圖片之中解碼順序上較前述第1圖片還後面的圖片,前述第6圖片是前述複數張圖片之中解碼順序上較前述第5圖片還前面的圖片;及 使用已決定的前述第5濾波資訊,對前述第5圖片適用自適應迴路濾波的步驟; 在決定前述第5濾波資訊的步驟中,當前述第1圖片的NAL單元類型為前述規定NAL單元類型,且前述第5圖片的暫時ID與前述第1圖片的暫時ID相同時,前述電路禁止參考有關聯於前述第3圖片之前述第3濾波資訊來作為前述第6濾波資訊。The decoding device of claim 9 or 10, wherein the foregoing circuit further performs the following steps: Referring to the sixth filtering information associated with the sixth picture, the step of applying the fifth filtering information for adaptive loop filtering to the fifth picture is determined, wherein the foregoing fifth picture is a decoding order among the plurality of pictures. In the picture after the first picture, the sixth picture is a picture in front of the fifth picture in the decoding order among the plurality of pictures; and Applying the adaptive loop filtering step to the fifth picture using the determined fifth filtering information; In the step of determining the fifth filtering information, when the NAL unit type of the first picture is the predetermined NAL unit type, and the temporary ID of the fifth picture is the same as the temporary ID of the first picture, the circuit prohibits reference The third filter information associated with the third picture is used as the sixth filter information. 如請求項9或10之解碼裝置,其中前述規定NAL單元類型為STSA(Step-wise Temporal Sub-layer Access)圖片的NAL單元類型。The decoding device of claim 9 or 10, wherein the foregoing NAL unit type is a NAL unit type of a STSA (Step-wise Temporal Sub-layer Access) picture. 一種編碼方法,在含有複數張圖片之動態圖像的編碼中適用自適應迴路濾波,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID, 前述編碼方法包含有以下步驟: 參考有關聯於第2圖片之第2濾波資訊,決定用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊的步驟,其中前述第2圖片是在前述複數張圖片之中編碼順序上較前述第1圖片還前面的圖片;及 使用已決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟; 在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL(Network Abstraction Layer)單元類型為規定NAL單元類型時,禁止參考有關聯於第3圖片之第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中編碼順序上較前述第1圖片還前面的圖片,且為暫時ID與前述第1圖片相同的圖片。An encoding method for adapting adaptive loop filtering in encoding of a moving image containing a plurality of pictures, wherein the aforementioned pictures are respectively assigned a temporary ID indicating a hierarchy of time adjustability, The foregoing encoding method includes the following steps: Referring to the second filter information associated with the second picture, determining a first filter information for applying adaptive loop filtering to the first picture of the plurality of pictures, wherein the second picture is in the plurality of pictures The picture in the picture sequence that is earlier than the first picture; and And applying the adaptive loop filtering to the first picture by using the determined first filtering information; In the step of determining the first filter information, when the NAL (Network Abstraction Layer) unit type of the first picture is a predetermined NAL unit type, it is prohibited to refer to the third filter information associated with the third picture as the second The filter information is that the third picture is a picture in which the coding order is earlier than the first picture, and the temporary ID is the same picture as the first picture. 一種解碼方法,在含有複數張圖片之動態圖像的解碼中適用自適應迴路濾波,其中前述圖片分別被分配顯示有關於時間可調性的階層之暫時ID, 前述解碼方法包含有以下步驟: 參考有關聯於第2圖片之第2濾波資訊,決定用來對前述複數張圖片之中的第1圖片適用自適應迴路濾波之第1濾波資訊的步驟,其中前述第2圖片是在前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片;及 使用已決定的前述第1濾波資訊,對前述第1圖片適用自適應迴路濾波的步驟; 在決定前述第1濾波資訊的步驟中,當前述第1圖片的NAL(Network Abstraction Layer)單元類型為規定NAL單元類型時,禁止參考有關聯於第3圖片之第3濾波資訊來作為前述第2濾波資訊,其中前述第3圖片為前述複數張圖片之中解碼順序上較前述第1圖片還前面的圖片,且為暫時ID與前述第1圖片相同的圖片。A decoding method for applying adaptive loop filtering in decoding of a dynamic image containing a plurality of pictures, wherein the pictures are respectively assigned a temporary ID indicating a hierarchy of time adjustability, The foregoing decoding method includes the following steps: Referring to the second filter information associated with the second picture, determining a first filter information for applying adaptive loop filtering to the first picture of the plurality of pictures, wherein the second picture is in the plurality of pictures a picture in the picture that is in the order of decoding earlier than the first picture; and And applying the adaptive loop filtering to the first picture by using the determined first filtering information; In the step of determining the first filter information, when the NAL (Network Abstraction Layer) unit type of the first picture is a predetermined NAL unit type, it is prohibited to refer to the third filter information associated with the third picture as the second The filtering information, wherein the third picture is a picture in which the decoding order is higher than the first picture in the decoding order, and the temporary ID is the same picture as the first picture.
TW107135272A 2017-10-06 2018-10-05 Encoding device, decoding device, encoding method, and decoding method TW201924330A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201762569197P 2017-10-06 2017-10-06
US62/569,197 2017-10-06

Publications (1)

Publication Number Publication Date
TW201924330A true TW201924330A (en) 2019-06-16

Family

ID=65994298

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107135272A TW201924330A (en) 2017-10-06 2018-10-05 Encoding device, decoding device, encoding method, and decoding method

Country Status (2)

Country Link
TW (1) TW201924330A (en)
WO (1) WO2019069857A1 (en)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140092953A1 (en) * 2012-10-02 2014-04-03 Sharp Laboratories Of America, Inc. Method for signaling a step-wise temporal sub-layer access sample
US10038899B2 (en) * 2012-10-04 2018-07-31 Qualcomm Incorporated File format for video data
JP5680812B1 (en) * 2013-07-05 2015-03-04 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America Image encoding method, image decoding method, image encoding device, and image decoding device
EP3056005A4 (en) * 2013-10-11 2017-05-17 Sharp Kabushiki Kaisha Signaling information for coding
JP2015119402A (en) * 2013-12-19 2015-06-25 シャープ株式会社 Image decoder, image encoder, and encoded data
JP6472449B2 (en) * 2014-01-02 2019-02-20 シャープ株式会社 Method for decoding a video sequence

Also Published As

Publication number Publication date
WO2019069857A1 (en) 2019-04-11

Similar Documents

Publication Publication Date Title
CN110495177B (en) Decoding device, decoding method, and storage medium
WO2019151279A1 (en) Encoding device, decoding device, encoding method, and decoding method
CN111684805B (en) Encoding device, decoding device, encoding method, and decoding method
TWI761551B (en) Encoding device, encoding method, decoding device, and decoding method
CN111183643B (en) Encoding device, decoding device, encoding method, and decoding method
JP2023145787A (en) Encoder and decoder
TW202404351A (en) Coding device, decoding device
WO2019151284A1 (en) Encoding device, decoding device, encoding method, and decoding method
CN110692242B (en) Encoding device, decoding device, encoding method, and decoding method
JP2024003221A (en) Encoder and encoding method
WO2019151280A1 (en) Coding device, decoding device, coding method, and decoding method
WO2019151297A1 (en) Encoding device, decoding device, encoding method, and decoding method
TW201924338A (en) Encoding device, decoding device, encoding method, and decoding method
TW201909631A (en) Encoding device, decoding device, encoding method, and decoding method
WO2019151408A1 (en) Encoding device, decoding device, encoding method and decoding method
CN117640950A (en) Decoding device and encoding device
TW201924330A (en) Encoding device, decoding device, encoding method, and decoding method
WO2019069970A1 (en) Encoding device, decoding device, encoding method, and decoding method
WO2019069987A1 (en) Encoding device, decoding device, encoding method, and decoding method