TW202416715A - Equivalent intra mode for non-intra predicted coding blocks - Google Patents

Equivalent intra mode for non-intra predicted coding blocks Download PDF

Info

Publication number
TW202416715A
TW202416715A TW112138694A TW112138694A TW202416715A TW 202416715 A TW202416715 A TW 202416715A TW 112138694 A TW112138694 A TW 112138694A TW 112138694 A TW112138694 A TW 112138694A TW 202416715 A TW202416715 A TW 202416715A
Authority
TW
Taiwan
Prior art keywords
frame prediction
directional intra
prediction mode
intra
mode
Prior art date
Application number
TW112138694A
Other languages
Chinese (zh)
Inventor
卡拉姆 納澤
陳婭
凱文 勒茲
帝艾里 杜馬斯
Original Assignee
法商內數位Ce專利控股公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 法商內數位Ce專利控股公司 filed Critical 法商內數位Ce專利控股公司
Publication of TW202416715A publication Critical patent/TW202416715A/en

Links

Images

Abstract

A video decoding device may determine that a current block is coded in a non-directional intra prediction mode (e.g., an inter prediction mode, a cross component prediction mode, a palette mode, an intra block copy (IBC) mode, or an intra template matching prediction (IntraTMP) mode). The device may derive a directional intra prediction mode that corresponds to the non-directional intra prediction mode. The derived directional intra prediction mode may indicate a derived intra prediction direction. The device may decode the current block based at least in part on the derived directional intra prediction mode.

Description

非幀內預測編碼區塊的等效幀內模式Equivalent intra mode for non-intra prediction coded blocks

本發明揭示了用於導出等效幀內模式的系統、方法、及儀器。The present invention discloses a system, method, and apparatus for deriving equivalent intra-frame patterns.

視訊編碼系統可用以壓縮數位視訊信號例如以降低此類信號所需的儲存及/或傳輸頻寬。視訊編碼系統可包括例如基於區塊、基於小波(wavelet)、及/或基於物件的系統。Video coding systems may be used to compress digital video signals, for example, to reduce the storage and/or transmission bandwidth required for such signals. Video coding systems may include, for example, block-based, wavelet-based, and/or object-based systems.

揭示了用於導出等效幀內模式的系統、方法、及儀器。Systems, methods, and apparatus for deriving equivalent intra-frame patterns are disclosed.

實例裝置(例如,視訊解碼裝置)可判定一目前區塊以一非方向性幀內預測模式編碼。該裝置可導出對應於該非方向性幀內預測模式的一方向性幀內預測模式。經導出的該方向性幀內預測模式可指示一經導出幀內預測方向。該裝置可至少部分地基於經導出的該方向性幀內預測模式而解碼該目前區塊。An example device (e.g., a video decoding device) may determine that a current block is encoded with a non-directional intra-frame prediction mode. The device may derive a directional intra-frame prediction mode corresponding to the non-directional intra-frame prediction mode. The derived directional intra-frame prediction mode may indicate a derived intra-frame prediction direction. The device may decode the current block based at least in part on the derived directional intra-frame prediction mode.

類似地,一實例裝置(例如,視訊編碼裝置)可識別用於編碼一目前區塊的一非方向性幀內預測模式。該裝置可導出對應於該非方向性幀內預測模式的一方向性幀內預測模式。經導出的該方向性幀內預測模式可包括一經導出幀內預測方向。該裝置可至少部分地基於經導出的該方向性幀內預測模式而編碼該目前區塊。Similarly, an example device (e.g., a video encoding device) may identify a non-directional intra-frame prediction mode for encoding a current block. The device may derive a directional intra-frame prediction mode corresponding to the non-directional intra-frame prediction mode. The derived directional intra-frame prediction mode may include a derived intra-frame prediction direction. The device may encode the current block at least in part based on the derived directional intra-frame prediction mode.

該裝置可使用該非方向性幀內預測模式來獲得該目前區塊之一預測區塊。該裝置可獲得該預測區塊中之複數個經重建樣本。該方向性幀內預測模式可基於該預測區塊中之該複數個經重建樣本及該目前區塊的複數個經重建相鄰樣本而導出。The device may use the non-directional intra-frame prediction mode to obtain a prediction block for the current block. The device may obtain a plurality of reconstructed samples in the prediction block. The directional intra-frame prediction mode may be derived based on the plurality of reconstructed samples in the prediction block and a plurality of reconstructed neighboring samples of the current block.

該裝置可儲存經導出的該方向性幀內預測模式。該裝置可使用經導出的該方向性幀內預測模式,以產生一相鄰預測區塊的一最可能模式(most probable mode, MPM)清單。該裝置可基於經導出的該方向性幀內預測模式而判定一低頻非可分離轉換(low-frequency non-separable transform, LFNST)轉換集合。該目前區塊可基於該LFNST轉換集合而解碼/編碼。該裝置可基於經導出的該方向性幀內預測模式而判定一多轉換選擇(multi-transform selection, MTS)轉換集合。該目前區塊可基於該MTS轉換集合而解碼/編碼。The device may store the derived directional intra-frame prediction mode. The device may use the derived directional intra-frame prediction mode to generate a most probable mode (MPM) list of adjacent prediction blocks. The device may determine a low-frequency non-separable transform (LFNST) transform set based on the derived directional intra-frame prediction mode. The current block may be decoded/encoded based on the LFNST transform set. The device may determine a multi-transform selection (MTS) transform set based on the derived directional intra-frame prediction mode. The current block may be decoded/encoded based on the MTS transform set.

導出該方向性幀內預測模式可涉及:基於與相鄰該目前區塊之經重建像素相關聯的一梯度直方圖而導出該方向性幀內預測模式。導出該方向性幀內預測模式可涉及:在相鄰該目前區塊的經重建像素上測試複數個候選方向性幀內預測模式;且基於該測試,從該複數個候選方向性幀內預測模式選擇該方向性幀內預測模式。Deriving the directional intra-frame prediction mode may involve: deriving the directional intra-frame prediction mode based on a gradient histogram associated with reconstructed pixels adjacent to the current block. Deriving the directional intra-frame prediction mode may involve: testing a plurality of candidate directional intra-frame prediction modes on reconstructed pixels adjacent to the current block; and based on the testing, selecting the directional intra-frame prediction mode from the plurality of candidate directional intra-frame prediction modes.

該裝置可使用該非方向性幀內預測模式來獲得該目前區塊之一預測區塊。該裝置可獲得該預測區塊中之複數個經重建樣本。該裝置可獲得複數個可能預測模式。該裝置可基於該複數個可能預測模式,而運算該預測區塊中之該複數個經重建樣本的複數個預測。該裝置可基於該預測區塊中之該複數個經重建樣本、及對應的該複數個預測,而運算對應於該複數個可能預測模式的複數個預測誤差。該裝置可基於該複數個預測誤差,而在該複數個可能預測模式中選擇該方向性幀內預測模式。The device may use the non-directional intra-frame prediction mode to obtain a prediction block for the current block. The device may obtain a plurality of reconstructed samples in the prediction block. The device may obtain a plurality of possible prediction modes. The device may calculate a plurality of predictions of the plurality of reconstructed samples in the prediction block based on the plurality of possible prediction modes. The device may calculate a plurality of prediction errors corresponding to the plurality of possible prediction modes based on the plurality of reconstructed samples in the prediction block and the corresponding plurality of predictions. The device may select the directional intra-frame prediction mode from the plurality of possible prediction modes based on the plurality of prediction errors.

該非方向性幀內預測模式可係一幀間預測模式、一交叉分量預測模式、一調色板模式、一幀內區塊複製(intra block copy, IBC)模式、或一幀內模板匹配預測(幀內TMP (intra template matching prediction))模式。The non-directional intra prediction mode may be an inter-frame prediction mode, a cross-component prediction mode, a palette mode, an intra block copy (IBC) mode, or an intra template matching prediction (TMP) mode.

該裝置可基於該方向性幀內預測模式而選擇一低頻非可分離轉換(LFNST)轉換集合。該裝置可基於該LFNST轉換集合而對該目前區塊的一殘量執行逆轉換。The device may select a low frequency non-separable transform (LFNST) transform set based on the directional intra-frame prediction mode. The device may perform an inverse transform on a residual of the current block based on the LFNST transform set.

該裝置可基於該方向性幀內預測模式而選擇一多轉換選擇(MTS)轉換集合。該裝置可基於該MTS轉換集合而對該目前區塊的一殘量執行逆轉換。The device may select a multi-transform selection (MTS) transform set based on the directional intra-frame prediction mode. The device may perform inverse transformation on a residual of the current block based on the MTS transform set.

一種視訊解碼裝置可包括一處理器,其經組態以判定一目前區塊以一非幀內預測模式(例如,並非方向幀內預測模式、DC模式、或平面模式)編碼。例如,該非幀內預測模式可係一幀間預測模式、一交叉分量預測模式、一調色板模式、一幀內區塊複製(IBC)模式、或一幀內模板匹配預測(幀內TMP)模式中之一或多者。可導出對應於該非幀內預測模式的一幀內預測模式。該目前區塊可至少部分地基於經導出的該幀內預測模式而解碼。A video decoding device may include a processor configured to determine that a current block is encoded in a non-intra-frame prediction mode (e.g., non-directional intra-frame prediction mode, DC mode, or planar mode). For example, the non-intra-frame prediction mode may be one or more of an inter-frame prediction mode, a cross-component prediction mode, a palette mode, an intra-frame block copy (IBC) mode, or an intra-frame template matching prediction (intra-frame TMP) mode. An intra-frame prediction mode corresponding to the non-intra-frame prediction mode may be derived. The current block may be decoded based at least in part on the derived intra-frame prediction mode.

在一實例中,該目前區塊之一預測區塊可使用該非幀內預測模式獲得。對應於該非幀內預測模式的該幀內預測模式可基於該預測區塊而導出。In one example, a prediction block of the current block can be obtained using the non-intra prediction mode. The intra prediction mode corresponding to the non-intra prediction mode can be derived based on the prediction block.

在一實例中,該目前區塊之一預測區塊可使用該非幀內預測模式獲得。可獲得該預測區塊中之經重建樣本。該幀內預測模式可基於該預測區塊中之該等經重建樣本及經重建相鄰樣本而導出。In one example, a prediction block of the current block may be obtained using the non-intra-frame prediction model. Reconstructed samples in the prediction block may be obtained. The intra-frame prediction model may be derived based on the reconstructed samples and reconstructed neighboring samples in the prediction block.

可藉由將一解碼器側幀內模式導出(decoder-side intra mode derivation, DIMD)程序應用至該目前區塊之一經重建模板(例如,在目前區塊周圍的模板、相鄰目前區塊的模板樣本)、使用非幀內預測模式獲得之目前區塊的預測區塊、或預測區塊內部的經重建模板中之至少一者,而導出該幀內預測模式。可藉由將一基於模板的幀內模式導出(template-based intra mode derivation, TIMD)程序應用至目前區塊之經重建模板、使用非幀內預測模式獲得之目前區塊的預測區塊、或預測區塊內部的經重建模板中之至少一者,而導出該幀內預測模式。The intra-frame prediction mode may be derived by applying a decoder-side intra mode derivation (DIMD) procedure to at least one of a reconstructed template of the current block (e.g., a template around the current block, a template sample adjacent to the current block), a prediction block of the current block obtained using a non-intra prediction mode, or a reconstructed template inside the prediction block. The intra-frame prediction mode may be derived by applying a template-based intra mode derivation (TIMD) procedure to at least one of a reconstructed template of the current block, a prediction block of the current block obtained using a non-intra prediction mode, or a reconstructed template inside the prediction block.

在一實例中,該目前區塊之一預測區塊可使用該非幀內預測模式獲得。可獲得該預測區塊中之經重建樣本。可獲得可能預測模式。可基於該等可能預測模式而運算該預測區塊中之該等經重建樣本的預測。對應於該等可能預測模式的預測誤差可基於該預測區塊中之該等經重建樣本及對應的該等預測而運算。該幀內預測模式可基於該等預測誤差而從該等可能預測模式而選擇。該幀內預測模式可基於對應於該幀內預測模式的該預測誤差在該等預測誤差中係最小的一判定而選擇。In one example, a prediction block for the current block can be obtained using the non-intra-frame prediction mode. Reconstructed samples in the prediction block can be obtained. A possible prediction mode can be obtained. Predictions of the reconstructed samples in the prediction block can be calculated based on the possible prediction modes. Prediction errors corresponding to the possible prediction modes can be calculated based on the reconstructed samples in the prediction block and the corresponding predictions. The intra-frame prediction mode can be selected from the possible prediction modes based on the prediction errors. The intra-frame prediction mode can be selected based on a determination that the prediction error corresponding to the intra-frame prediction mode is the smallest among the prediction errors.

在一實例中,該目前區塊之一預測區塊可使用該非幀內預測模式獲得。可獲得該預測區塊中之樣本。可基於該預測區塊中的該等樣本而判定該預測區塊的一方向性。該幀內預測模式可基於該預測區塊之經判定方向性而導出。In one example, a prediction block for the current block may be obtained using the non-intra-frame prediction mode. Samples in the prediction block may be obtained. A directionality of the prediction block may be determined based on the samples in the prediction block. The intra-frame prediction mode may be derived based on the determined directionality of the prediction block.

一種視訊編碼裝置可包括一處理器,其經組態以識別用於編碼一目前區塊的一非幀內預測模式。可導出對應於該非幀內預測模式的一幀內預測模式。該目前區塊可至少部分地基於經導出的該幀內預測模式而編碼。A video encoding device may include a processor configured to identify a non-intra prediction mode for encoding a current block. An intra prediction mode corresponding to the non-intra prediction mode may be derived. The current block may be encoded at least in part based on the derived intra prediction mode.

相關申請案之交互參照Cross-reference to related applications

本申請案主張於2022年10月11日申請之歐洲臨時專利申請案第EP22306526.9號之優先權,其內容特此以引用方式併入本文中。This application claims priority to European provisional patent application No. EP22306526.9 filed on October 11, 2022, the contents of which are hereby incorporated by reference into this document.

圖1A係繪示一或多個經揭示實施例可實施於其中之實例通訊系統100的圖。通訊系統100可係提供內容(諸如語音、資料、視訊、通信報、廣播等)至多個無線使用者的多重存取系統。通訊系統100可賦能多個無線使用者以透過系統資源(包括無線頻寬)的共用而存取此類內容。例如,通訊系統100可採用一或多個通道存取方法,諸如分碼多重存取(code division multiple access, CDMA)、分時多重存取(time division multiple access, TDMA)、分頻多重存取(frequency division multiple access, FDMA)、正交FDMA (orthogonal FDMA, OFDMA)、單載波FDMA (single-carrier FDMA, SC-FDMA)、零尾唯一字DFT擴展OFDM (zero-tail unique-word DFT-Spread OFDM, ZT UW DTS-s OFDM)、唯一字OFDM (unique word OFDM, UW-OFDM)、資源區塊濾波OFDM、濾波器組多載波(filter bank multicarrier, FBMC)、及類似者。FIG. 1A is a diagram of an example communication system 100 in which one or more disclosed embodiments may be implemented. The communication system 100 may be a multiple access system that provides content (e.g., voice, data, video, newsletter, broadcast, etc.) to multiple wireless users. The communication system 100 may enable multiple wireless users to access such content through sharing of system resources (including wireless bandwidth). For example, the communication system 100 may employ one or more channel access methods such as code division multiple access (CDMA), time division multiple access (TDMA), frequency division multiple access (FDMA), orthogonal FDMA (OFDMA), single-carrier FDMA (SC-FDMA), zero-tail unique-word DFT-Spread OFDM (ZT UW DTS-s OFDM), unique word OFDM (UW-OFDM), resource block filter OFDM, filter bank multicarrier (FBMC), and the like.

如圖1A所示,通訊系統100可包括無線傳輸/接收單元(WTRU) 102a、102b、102c、102d、RAN 104/113、CN 106/115、公共交換電話網路(public switched telephone network, PSTN) 108、網際網路110、及其他網路112,雖然將理解所揭示的實施例設想任何數目的WTRU、基地台、網路、及/或網路元件。WTRU 102a、102b、102c、102d之各者可係經組態以在無線環境中操作及/或通訊的任何類型的裝置。舉實例而言,WTRU 102a、102b、102c、102d(其任一者可稱為「站台(station)」及/或「STA」)可經組態以傳輸及/或接收無線信號,並可包括使用者設備(user equipment, UE)、行動電台、固定或行動訂戶單元、基於訂閱的單元、呼叫器、蜂巢式電話、個人數位助理(personal digital assistant, PDA)、智慧型手機、膝上型電腦、輕省筆電、個人電腦、無線感測器、熱點或Mi-Fi裝置、物聯網(Internet of Things, IoT)裝置、手錶或其他可穿戴式、頭戴式顯示器(head-mounted display, HMD)、車輛、無人機、醫療裝置及應用(例如,遠端手術)、工業裝置及應用(例如,在工業及/或自動化處理鏈背景中操作的機器人及/或其他無線裝置)、消費性電子裝置、在商業及/或工業無線網路上操作的裝置、及類似者。WTRU 102a、102b、102c、及102d的任一者可互換地稱為UE。1A, a communication system 100 may include wireless transmit/receive units (WTRUs) 102a, 102b, 102c, 102d, RAN 104/113, CN 106/115, a public switched telephone network (PSTN) 108, the Internet 110, and other networks 112, although it will be understood that the disclosed embodiments contemplate any number of WTRUs, base stations, networks, and/or network elements. Each of the WTRUs 102a, 102b, 102c, 102d may be any type of device configured to operate and/or communicate in a wireless environment. By way of example, the WTRUs 102a, 102b, 102c, 102d (any of which may be referred to as a “station” and/or “STA”) may be configured to transmit and/or receive wireless signals and may include user equipment (UE), a mobile radio, a fixed or mobile subscriber unit, a subscription-based unit, a pager, a cellular phone, a personal digital assistant (PDA), a smartphone, a laptop, a notebook computer, a personal computer, a wireless sensor, a hotspot or Mi-Fi device, an Internet of Things (IoT) device, a watch or other wearable, a head-mounted display (HMD), or the like. The WTRUs 102a, 102b, 102c, and 102d may be interchangeably referred to as UEs.

通訊系統100亦可包括基地台114a及/或基地台114b。基地台114a、114b之各者可係經組態以與WTRU 102a、102b、102c、102d中之至少一者無線地介接的任何類型的裝置,以促進存取一或多個通訊網路(諸如CN 106/115、網際網路110、及/或其他網路112)。舉實例而言,基地台114a、114b可係基地收發站(base transceiver station, BTS)、節點B、e節點B、本地節點B、本地e節點B、gNB、NR節點B、站台控制器、存取點(access point, AP)、無線路由器、及類似者。雖然將基地台114a、114b各描繪成單一元件,將理解基地台114a、114b可包括任何數目的互連基地台及/或網路元件。The communication system 100 may also include a base station 114a and/or a base station 114b. Each of the base stations 114a, 114b may be any type of device configured to wirelessly interface with at least one of the WTRUs 102a, 102b, 102c, 102d to facilitate access to one or more communication networks (e.g., the CN 106/115, the Internet 110, and/or other networks 112). For example, the base stations 114a, 114b may be a base transceiver station (BTS), a Node B, an eNode B, a local Node B, a local eNode B, a gNB, a NR Node B, a site controller, an access point (AP), a wireless router, and the like. Although the base stations 114a, 114b are each depicted as a single element, it will be appreciated that the base stations 114a, 114b may include any number of interconnected base stations and/or network elements.

基地台114a可係RAN 104/113的部分,該RAN亦可包括其他基地台及/或網路元件(未圖示),諸如基地台控制器(base station controller, BSC)、無線電網路控制器(radio network controller, RNC)、中繼節點等。基地台114a及/或基地台114b可經組態以在一或多個載波頻率上傳輸及/或接收無線信號,該等基地台可稱為胞元(cell)(未圖示)。此等頻率可在授權頻譜、非授權頻譜、或授權頻譜及非授權頻譜的組合中。胞元可對可係相對固定或可隨時間變化的特定地理區域提供無線服務覆蓋。胞元可進一步劃分成胞元扇區(cell sector)。例如,與基地台114a關聯的胞元可劃分成三個扇區。因此,在一個實施例中,基地台114a可包括三個收發器,亦即,一個收發器用於胞元的一個扇區。在一實施例中,基地台114a可採用多輸入多輸出(multiple-input multiple output, MIMO)技術,且可將多個收發器用於胞元的各扇區。例如,波束成形可用以在所欲空間方向上傳輸及/或接收信號。Base station 114a may be part of RAN 104/113, which may also include other base stations and/or network elements (not shown), such as a base station controller (BSC), a radio network controller (RNC), relay nodes, etc. Base station 114a and/or base station 114b may be configured to transmit and/or receive wireless signals on one or more carrier frequencies, which may be referred to as cells (not shown). Such frequencies may be in a licensed spectrum, an unlicensed spectrum, or a combination of a licensed spectrum and an unlicensed spectrum. A cell may provide wireless service coverage for a specific geographic area that may be relatively fixed or may vary over time. Cells may be further divided into cell sectors. For example, the cell associated with the base station 114a may be divided into three sectors. Thus, in one embodiment, the base station 114a may include three transceivers, i.e., one transceiver for each sector of the cell. In one embodiment, the base station 114a may employ multiple-input multiple output (MIMO) technology and may use multiple transceivers for each sector of the cell. For example, beamforming may be used to transmit and/or receive signals in a desired spatial direction.

基地台114a、114b可透過空中介面116與WTRU 102a、102b、102c、102d的一或多者通訊,該空中介面可係任何合適的無線通訊鏈路(例如,射頻(radio frequency, RF)、微波、厘米波、微米波、紅外線(infrared, IR)、紫外線(ultraviolet, UV)、可見光等)。空中介面116可使用任何合適的無線電存取技術(radio access technology, RAT)建立。The base stations 114a, 114b may communicate with one or more of the WTRUs 102a, 102b, 102c, 102d via an air interface 116, which may be any suitable wireless communication link (e.g., radio frequency (RF), microwave, centimeter wave, micrometer wave, infrared (IR), ultraviolet (UV), visible light, etc.). The air interface 116 may be established using any suitable radio access technology (RAT).

更具體地說,如上文提到的,通訊系統100可係多重存取系統且可採用一或多個通道存取方案,諸如CDMA、TDMA、FDMA、OFDMA、SC-FDMA、及類似者。例如,RAN 104/113中的基地台114a及WTRU 102a、102b、102c可實施無線電技術,諸如可使用寬頻CDMA (wideband CDMA, WCDMA)建立空中介面115/116/117的通用行動電信系統(Universal Mobile Telecommunications System, UMTS)地面無線電存取(UTRA)。WCDMA可包括通訊協定,諸如高速封包存取(High-Speed Packet Access, HSPA)及/或演進HSPA (HSPA+)。HSPA可包括高速下行鏈路(DL)封包存取(High-Speed Downlink Packet Access, HSDPA)及/或高速UL封包存取(High-Speed Uplink Packet Access, HSUPA)。More specifically, as mentioned above, the communication system 100 may be a multiple access system and may employ one or more channel access schemes such as CDMA, TDMA, FDMA, OFDMA, SC-FDMA, and the like. For example, the base station 114a and the WTRUs 102a, 102b, 102c in the RAN 104/113 may implement a radio technology such as Universal Mobile Telecommunications System (UMTS) Terrestrial Radio Access (UTRA) which may establish an air interface 115/116/117 using wideband CDMA (WCDMA). WCDMA may include communication protocols such as High-Speed Packet Access (HSPA) and/or Evolved HSPA (HSPA+). HSPA may include High-Speed Downlink Packet Access (HSDPA) and/or High-Speed Uplink Packet Access (HSUPA).

在一實施例中,基地台114a及WTRU 102a、102b、102c可實施無線電技術,諸如可使用長期演進技術(Long Term Evolution, LTE)及/或進階LTE (LTE-Advanced, LTE-A)及/或進階LTE加強版(LTE-Advanced Pro, LTE-A Pro)建立空中介面116的演進UMTS地面無線電存取(Evolved UMTS Terrestrial Radio Access, E-UTRA)。In one embodiment, the base station 114a and the WTRUs 102a, 102b, 102c may implement a radio technology such as Evolved UMTS Terrestrial Radio Access (E-UTRA) which may establish an airborne medium plane 116 using Long Term Evolution (LTE) and/or LTE-Advanced (LTE-A) and/or LTE-Advanced Pro (LTE-A Pro).

在一實施例中,基地台114a及WTRU 102a、102b、102c可實施無線電技術,諸如可使用新無線電(New Radio, NR)建立空中介面116的NR無線電存取。In one embodiment, the base station 114a and the WTRUs 102a, 102b, 102c may implement a radio technology such as New Radio (NR) to establish NR radio access over the air interface 116.

在一實施例中,基地台114a及WTRU 102a、102b、102c可實施多個無線電存取技術。例如,基地台114a及WTRU 102a、102b、102c可一起實施LTE無線電存取及NR無線電存取,例如,使用雙連接性(dual connectivity, DC)原理。因此,由WTRU 102a、102b、102c利用的空中介面可藉由多種類型的無線電存取技術及/或發送至/自多種類型之基地台(例如,eNB及gNB)的傳輸特徵化。In one embodiment, the base station 114a and the WTRUs 102a, 102b, 102c may implement multiple radio access technologies. For example, the base station 114a and the WTRUs 102a, 102b, 102c may implement LTE radio access and NR radio access together, for example, using dual connectivity (DC) principles. Therefore, the air interface utilized by the WTRUs 102a, 102b, 102c may be characterized by multiple types of radio access technologies and/or transmissions to/from multiple types of base stations (e.g., eNBs and gNBs).

在其他實施例中,基地台114a及WTRU 102a、102b、102c可實施無線電技術,諸如IEEE 802.11(亦即,無線保真度(Wireless Fidelity, WiFi)、IEEE 802.16(亦即,全球互通微波存取(WiMAX))、CDMA2000、CDMA2000 1X、CDMA2000 EV-DO、暫時性標準2000 (IS-2000)、暫時性標準95 (IS-95)、暫時性標準856 (IS-856)、全球行動通訊系統(GSM)、GSM演進增強型資料速率(EDGE)、GSM EDGE (GERAN)、及類似者。In other embodiments, the base station 114a and the WTRUs 102a, 102b, 102c may implement a radio technology such as IEEE 802.11 (i.e., Wireless Fidelity (WiFi), IEEE 802.16 (i.e., Worldwide Interoperability for Microwave Access (WiMAX)), CDMA2000, CDMA2000 1X, CDMA2000 EV-DO, Interim Standard 2000 (IS-2000), Interim Standard 95 (IS-95), Interim Standard 856 (IS-856), Global System for Mobile Communications (GSM), Enhanced Data rates for GSM Evolution (EDGE), GSM EDGE (GERAN), and the like.

圖1A中的基地台114b可係無線路由器、本地節點B、本地e節點B、或存取點,例如,且可利用任何合適的RAT以用於促進局部化區域(諸如營業場所、家庭、車輛、校園、工業設施、空中走廊(例如,用於由無人機使用)、道路、及類似者)中的無線連接性。在一個實施例中,基地台114b及WTRU 102c、102d可實施無線電技術,諸如IEEE 802.11以建立無線區域網路(wireless local area network, WLAN)。在一實施例中,基地台114b及WTRU 102c、102d可實施無線電技術,諸如IEEE 802.15以建立無線個人區域網路(wireless personal area network, WPAN)。在又另一實施例中,基地台114b及WTRU 102c、102d可利用基於蜂巢式的RAT(例如,WCDMA、CDMA2000、GSM、LTE、LTE-A、LTE-A Pro、NR等)以建立微微型胞元或毫微微型胞元。如圖1A所示,基地台114b可具有至網際網路110的直接連接。因此,基地台114b可能不需要經由CN 106/115存取網際網路110。The base station 114b in FIG1A may be a wireless router, a local node B, a local eNode B, or an access point, for example, and may utilize any suitable RAT for facilitating wireless connectivity in a localized area, such as a business premises, a home, a vehicle, a campus, an industrial facility, a skyway (e.g., for use by drones), a road, and the like. In one embodiment, the base station 114b and the WTRUs 102c, 102d may implement a radio technology such as IEEE 802.11 to establish a wireless local area network (WLAN). In one embodiment, the base station 114b and the WTRUs 102c, 102d may implement a radio technology such as IEEE 802.15 to establish a wireless personal area network (WPAN). In yet another embodiment, the base station 114b and the WTRUs 102c, 102d may utilize a cellular-based RAT (e.g., WCDMA, CDMA2000, GSM, LTE, LTE-A, LTE-A Pro, NR, etc.) to establish a picocell or femtocell. As shown in FIG1A , the base station 114b may have a direct connection to the Internet network 110. Therefore, the base station 114b may not need to access the Internet network 110 via the CN 106/115.

RAN 104/113可與CN 106/115通訊,其可係經組態以提供語音、資料、應用、及/或網際網路協定上的語音(voice over internet protocol, VoIP)服務至WTRU 102a、102b、102c、102d的一或多者的任何類型的網路。資料可具有不同的服務品質(quality of service, QoS)需求,諸如不同的通量需求、延遲需求、容錯需求、可靠性需求、資料通量需求、行動需求、及類似者。CN 106/115可提供呼叫控制、帳單服務、基於行動定位的服務、預付電話、網際網路連接性、視訊分布等、及/或執行高階安全功能,諸如使用者認證。雖然未顯示於圖1A中,將理解RAN 104/113及/或CN 106/115可與採用與RAN 104/113相同的RAT或採用不同RAT的其他RAN直接或間接通訊。例如,除了連接至RAN 104/113(其可利用NR無線電技術)外,CN 106/115亦可與採用GSM、UMTS、CDMA 2000、WiMAX、E-UTRA、或WiFi無線電技術的另一RAN(未圖示)通訊。The RAN 104/113 may communicate with the CN 106/115, which may be any type of network configured to provide voice, data, applications, and/or voice over internet protocol (VoIP) services to one or more of the WTRUs 102a, 102b, 102c, 102d. The data may have different quality of service (QoS) requirements, such as different throughput requirements, latency requirements, fault tolerance requirements, reliability requirements, data throughput requirements, mobility requirements, and the like. The CN 106/115 may provide call control, billing services, mobile location-based services, prepaid telephony, Internet connectivity, video distribution, etc., and/or perform advanced security functions, such as user authentication. Although not shown in FIG1A , it will be appreciated that the RAN 104/113 and/or the CN 106/115 may be in direct or indirect communication with other RANs that employ the same RAT as the RAN 104/113 or that employ a different RAT. For example, in addition to being connected to the RAN 104/113 (which may utilize NR radio technology), the CN 106/115 may also be in communication with another RAN (not shown) that employs GSM, UMTS, CDMA 2000, WiMAX, E-UTRA, or WiFi radio technology.

CN 106/115亦可作用為WTRU 102a、102b、102c、102d的閘道,以存取PSTN 108、網際網路110、及/或其他網路112。PSTN 108可包括提供簡易老式電話服務(plain old telephone service, POTS)的電路交換電話網路。網際網路110可包括使用共同通訊協定的互連電腦網路及裝置的全球系統,諸如TCP/IP網際網路協定套組中的傳輸控制協定(transmission control protocol, TCP)、使用者資料包協定(user datagram protocol, UDP)、及/或網際網路協定(internet protocol, IP)。網路112可包括由其他服務供應商所擁有及/或操作的有線及/或無線通訊網路。例如,網路112可包括連接至一或多個RAN的另一CN,該一或多個RAN可採用與RAN 104/113相同的RAT或不同的RAT。The CN 106/115 may also act as a gateway for the WTRUs 102a, 102b, 102c, 102d to access the PSTN 108, the Internet 110, and/or other networks 112. The PSTN 108 may include a circuit-switched telephone network that provides plain old telephone service (POTS). The Internet 110 may include a global system of interconnected computer networks and devices using common communication protocols, such as the transmission control protocol (TCP), the user datagram protocol (UDP), and/or the internet protocol (IP) in the TCP/IP internet protocol suite. The network 112 may include wired and/or wireless communication networks owned and/or operated by other service providers. For example, the network 112 may include another CN connected to one or more RANs, which may employ the same RAT as the RAN 104/113 or a different RAT.

通訊系統100中的WTRU 102a、102b、102c、102d的一些或全部可包括多模式能力(例如,WTRU 102a、102b、102c、102d可包括用於透過不同的無線鏈路與不同的無線網路通訊的多個收發器)。例如,顯示於圖1A中的WTRU 102c可經組態以與可採用以基於蜂巢式的無線電技術的基地台114a,且與可採用IEEE 802無線電技術的基地台114b通訊。Some or all of the WTRUs 102a, 102b, 102c, 102d in the communication system 100 may include multi-mode capabilities (e.g., the WTRUs 102a, 102b, 102c, 102d may include multiple transceivers for communicating with different wireless networks via different radio links). For example, the WTRU 102c shown in FIG. 1A may be configured to communicate with a base station 114a that may employ a cellular-based radio technology and with a base station 114b that may employ IEEE 802 radio technology.

圖1B係繪示實例WTRU 102的系統圖。如圖1B所示,WTRU 102可尤其包括處理器118、收發器120、傳輸/接收元件122、揚聲器/麥克風124、小鍵盤126、顯示器/觸控板128、非可移除式記憶體130、可移除式記憶體132、電源134、全球定位系統(global positioning system, GPS)晶片組136、及/或其他週邊設備138等。將理解WTRU 102可包括上述元件的任何次組合,同時仍與實施例保持一致。FIG1B is a system diagram illustrating an example WTRU 102. As shown in FIG1B, the WTRU 102 may include, among other things, a processor 118, a transceiver 120, a transmit/receive element 122, a speaker/microphone 124, a keypad 126, a display/touchpad 128, a non-removable memory 130, a removable memory 132, a power supply 134, a global positioning system (GPS) chipset 136, and/or other peripherals 138. It will be appreciated that the WTRU 102 may include any subcombination of the above elements while still remaining consistent with an embodiment.

處理器118可係一般用途處理器、特殊用途處理器、習知處理器、數位信號處理器(digital signal processor, DSP)、複數個微處理器、與DSP核心關聯的一或多個微處理器、控制器、微控制器、特殊應用積體電路(Application Specific Integrated Circuit, ASIC)、現場可程式化閘陣列(Field Programmable Gate Array, FPGA)電路、任何其他類型的積體電路(integrated circuit, IC)、狀態機、及類似者。如上文建議的,處理器118可包括複數個處理器。處理器118可執行信號編碼、資料處理、電力控制、輸入/輸出處理、及/或使WTRU 102能在無線環境中操作的任何其他功能性。處理器118可耦接至收發器120,該收發器可耦接至傳輸/接收元件122。雖然圖1B將處理器118及收發器120描繪成分開的組件,將理解處理器118及收發器120可在電子封裝或晶片中整合在一起。The processor 118 may be a general purpose processor, a special purpose processor, a learning processor, a digital signal processor (DSP), a plurality of microprocessors, one or more microprocessors associated with a DSP core, a controller, a microcontroller, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) circuit, any other type of integrated circuit (IC), a state machine, and the like. As suggested above, the processor 118 may include a plurality of processors. The processor 118 may perform signal coding, data processing, power control, input/output processing, and/or any other functionality that enables the WTRU 102 to operate in a wireless environment. The processor 118 may be coupled to a transceiver 120, which may be coupled to a transmit/receive element 122. Although FIG. 1B depicts the processor 118 and the transceiver 120 as separate components, it will be appreciated that the processor 118 and the transceiver 120 may be integrated together in an electronic package or chip.

傳輸/接收元件122可經組態以透過空中介面116傳輸信號至基地台(例如,基地台114a)或自該基地台接收信號。例如,在一個實施例中,傳輸/接收元件122可係經組態以傳輸及/或接收RF信號的天線。在一實施例中,例如,傳輸/接收元件122可係經組態以傳輸及/或接收IR、UV、或可見光信號的發射器/偵測器。在又另一實施例中,傳輸/接收元件122可經組態以傳輸及/或接收RF及光信號二者。應理解傳輸/接收元件122可經組態以傳輸及/或接收無線信號的任何組合。Transmission/reception element 122 can be configured to transmit signals to base stations (e.g., base stations 114a) or receive signals from the base stations through air interface 116. For example, in one embodiment, transmission/reception element 122 can be configured to transmit and/or receive antennas of RF signals. In one embodiment, for example, transmission/reception element 122 can be configured to transmit and/or receive transmitters/detectors of IR, UV or visible light signals. In another embodiment, transmission/reception element 122 can be configured to transmit and/or receive both RF and optical signals. It should be understood that transmission/reception element 122 can be configured to transmit and/or receive any combination of wireless signals.

雖然在圖1B中將傳輸/接收元件122描繪成單一元件,WTRU 102可包括任何數目的傳輸/接收元件122。更具體地說,WTRU 102可採用MIMO技術。因此,在一個實施例中,WTRU 102可包括二或更多個傳輸/接收元件122(例如,多個天線)以用於透過空中介面116傳輸及接收無線信號。Although the transmit/receive element 122 is depicted as a single element in FIG. 1B , the WTRU 102 may include any number of transmit/receive elements 122. More specifically, the WTRU 102 may employ MIMO technology. Thus, in one embodiment, the WTRU 102 may include two or more transmit/receive elements 122 (e.g., multiple antennas) for transmitting and receiving wireless signals through the air interface 116.

收發器120可經組態以調變待藉由傳輸/接收元件122傳輸的信號及解調變藉由傳輸/接收元件122接收的信號。如上文提到的,WTRU 102可具有多模式能力。因此,例如,收發器120可包括用於使WTRU 102能經由多個RAT(諸如,NR及IEEE 802.11)通訊的多個收發器。The transceiver 120 may be configured to modulate signals to be transmitted by the transmit/receive element 122 and to demodulate signals received by the transmit/receive element 122. As mentioned above, the WTRU 102 may have multi-mode capabilities. Thus, for example, the transceiver 120 may include multiple transceivers for enabling the WTRU 102 to communicate via multiple RATs (e.g., NR and IEEE 802.11).

WTRU 102的處理器118可耦接至揚聲器/麥克風124、小鍵盤126、及/或顯示器/觸控板128(例如,液晶顯示器(liquid crystal display, LCD)顯示器單元或有機發光二極體(organic light-emitting diode, OLED)顯示器單元)並可接收來自其等的使用者輸入資料。處理器118亦可將使用者資料輸出至揚聲器/麥克風124、小鍵盤126、及/或顯示器/觸控板128。額外地,處理器118可存取來自任何類型的合適記憶體(諸如非可移除式記憶體130及/或可移除式記憶體132)的資訊及將資料儲存在任何類型的合適記憶體中。非可移除式記憶體130可包括隨機存取記憶體(random-access memory, RAM)、唯讀記憶體(read-only memory, ROM)、硬碟、或任何其他類型的記憶體儲存裝置。可移除式記憶體132可包括用戶身份模組(subscriber identity module, SIM)卡、記憶棒、安全數位(secure digital, SD)記憶卡、及類似者。在其他實施例中,處理器118可存取來自未實體位於WTRU 102上(諸如在伺服器或家用電腦(未圖示)上)之記憶體的資訊及將資料儲存在該記憶體中。The processor 118 of the WTRU 102 may be coupled to and may receive user input data from a speaker/microphone 124, a keypad 126, and/or a display/touchpad 128 (e.g., a liquid crystal display (LCD) display unit or an organic light-emitting diode (OLED) display unit). The processor 118 may also output user data to the speaker/microphone 124, the keypad 126, and/or the display/touchpad 128. Additionally, the processor 118 may access information from and store data in any type of suitable memory, such as the non-removable memory 130 and/or the removable memory 132. The non-removable memory 130 may include random-access memory (RAM), read-only memory (ROM), a hard drive, or any other type of memory storage device. The removable memory 132 may include a subscriber identity module (SIM) card, a memory stick, a secure digital (SD) memory card, and the like. In other embodiments, the processor 118 may access information from, and store data in, memory that is not physically located on the WTRU 102, such as on a server or a home computer (not shown).

處理器118可接收來自電源134的電力,並可經組態以分布及/或控制至WTRU 102中之其他組件的電力。電源134可係用於對WTRU 102供電的任何合適裝置。例如,電源134可包括一或多個乾電池電池組(例如,鎳-鎘(NiCd)、鎳-鋅(NiZn)、鎳氫(NiMH)、鋰離子(Li-離子)等)、太陽能電池、燃料電池、及類似者。The processor 118 may receive power from the power source 134 and may be configured to distribute and/or control power to other components in the WTRU 102. The power source 134 may be any suitable device for powering the WTRU 102. For example, the power source 134 may include one or more dry cell battery packs (e.g., nickel-cadmium (NiCd), nickel-zinc (NiZn), nickel hydrogen (NiMH), lithium ion (Li-ion), etc.), solar cells, fuel cells, and the like.

處理器118亦可耦接至GPS晶片組136,該GPS晶片組可經組態以提供關於WTRU 102之目前位置的位置資訊(例如,經度和緯度)。除了(或替代)來自GPS晶片組136的資訊外,WTRU 102可透過空中介面116接收來自基地台(例如,基地台114a、114b)的位置資訊,及/或基於從二或更多個附近基地台接收之信號的時序判定其位置。將理解WTRU 102可藉由任何合適的位置判定方法獲得位置資訊,同時仍與實施例保持一致。The processor 118 may also be coupled to the GPS chipset 136, which may be configured to provide location information (e.g., longitude and latitude) regarding the current location of the WTRU 102. In addition to (or in lieu of) the information from the GPS chipset 136, the WTRU 102 may receive location information from a base station (e.g., base stations 114a, 114b) via the air interface 116, and/or determine its location based on the timing of signals received from two or more nearby base stations. It will be appreciated that the WTRU 102 may obtain location information by any suitable location determination method while remaining consistent with an embodiment.

處理器118可進一步耦接至其他週邊設備138,該等週邊設備可包括提供額外特徵、功能性、及/或有線或無線連接性的一或多個軟體及/或硬體模組。例如,週邊設備138可包括加速度計、電子羅盤、衛星收發器、數位相機(用於相片及/或視訊)、通用串列匯流排(universal serial bus, USB)埠、振動裝置、電視機收發器、免持式頭戴裝置、Bluetooth ®模組、調頻(frequency modulated, FM)無線電單元、數位音樂播放器、媒體播放器、視訊遊戲機模組、網際網路瀏覽器、虛擬實境及/或擴增實境(virtual reality and/or augmented reality, VR/AR)裝置、活動追蹤器、及類似者。週邊設備138可包括一或多個感測器,該等感測器可係陀螺儀、加速度計、霍爾效應感測器、磁力計、定向感測器、近接感測器、溫度感測器、時間感測器;地理位置感測器;高度計、光感測器、觸控感測器、磁力計、氣壓計、手勢感測器、生物特徵感測器、及/或濕度感測器的一或多者。 The processor 118 may be further coupled to other peripherals 138, which may include one or more software and/or hardware modules that provide additional features, functionality, and/or wired or wireless connectivity. For example, peripheral device 138 may include an accelerometer, an electronic compass, a satellite transceiver, a digital camera (for photos and/or video), a universal serial bus (USB) port, a vibration device, a television transceiver, a hands-free headset, a Bluetooth® module, a frequency modulated (FM) radio unit, a digital music player, a media player, a video game console module, an Internet browser, a virtual reality and/or augmented reality (VR/AR) device, an activity tracker, and the like. The peripheral device 138 may include one or more sensors, which may be one or more of a gyroscope, an accelerometer, a Hall effect sensor, a magnetometer, an orientation sensor, a proximity sensor, a temperature sensor, a time sensor; a geolocation sensor; an altimeter, a light sensor, a touch sensor, a magnetometer, a barometer, a gesture sensor, a biometric sensor, and/or a humidity sensor.

WTRU 102可包括一些或所有信號(例如,與用於UL(例如,用於傳輸)及下行鏈路(例如,用於接收)二者的特定子訊框關聯)針對其的傳輸及接收可係並行及/或同時的全雙工無線電。全雙工無線電可包括干擾管理單元,以經由硬體(例如,扼流器)或經由處理器(例如,分開的處理器(未圖示)或經由處理器118)的信號處理的其中一者降低及或實質消除自干擾。在一實施例中,WRTU 102可包括一些或所有信號(例如,與用於UL(例如,用於傳輸)或下行鏈路(例如,用於接收)其中一者的特定子訊框關聯)針對其傳輸及接收的半雙工無線電。The WTRU 102 may include a full-duplex radio for which transmission and reception may be concurrent and/or simultaneous for some or all signals (e.g., associated with specific subframes for both UL (e.g., for transmission) and downlink (e.g., for reception). The full-duplex radio may include an interference management unit to reduce and or substantially eliminate self-interference via either hardware (e.g., choke) or signal processing via a processor (e.g., a separate processor (not shown) or via processor 118). In one embodiment, the WRTU 102 may include a half-duplex radio for which transmission and reception may be concurrent and/or simultaneous for some or all signals (e.g., associated with specific subframes for either UL (e.g., for transmission) or downlink (e.g., for reception).

圖1C係根據一實施例繪示RAN 104及CN 106的系統圖。如上文提到的,RAN 104可採用E-UTRA無線電技術以透過空中介面116與WTRU 102a、102b、102c通訊。RAN 104亦可與CN 106通訊。1C is a system diagram illustrating the RAN 104 and the CN 106 according to an embodiment. As mentioned above, the RAN 104 may employ E-UTRA radio technology to communicate with the WTRUs 102a, 102b, 102c via the air interface 116. The RAN 104 may also communicate with the CN 106.

RAN 104可包括e節點B 160a、160b、160c,雖然應理解RAN 104可包括任何數目的e節點B,同時仍與實施例保持一致。e節點B 160a、160b、160c各可包括一或多個收發器以用於透過空中介面116與WTRU 102a、102b、102c通訊。在一個實施例中,e節點B 160a、160b、160c可實施MIMO技術。因此,e節點B 160a,例如,可使用多個天線以傳輸無線信號至WTRU 102a,及/或接收來自該WTRU的無線信號。The RAN 104 may include eNode-Bs 160a, 160b, 160c, although it will be appreciated that the RAN 104 may include any number of eNode-Bs while remaining consistent with an embodiment. The eNode-Bs 160a, 160b, 160c may each include one or more transceivers for communicating with the WTRUs 102a, 102b, 102c via the air interface 116. In one embodiment, the eNode-Bs 160a, 160b, 160c may implement MIMO technology. Thus, the eNode-B 160a, for example, may use multiple antennas to transmit wireless signals to and/or receive wireless signals from the WTRU 102a.

e節點B 160a、160b、160c之各者可與特定胞元(未圖示)關聯,並可經組態以處理無線電資源管理決策、交遞決策、UL及/或DL中之使用者的排程、及類似者。如圖1C所示,e節點B 160a、160b、160c可透過X2介面彼此通訊。Each of the eNodeBs 160a, 160b, 160c may be associated with a particular cell (not shown) and may be configured to handle radio resource management decisions, handover decisions, scheduling of users in the UL and/or DL, and the like. As shown in FIG1C , the eNodeBs 160a, 160b, 160c may communicate with each other via an X2 interface.

顯示於圖1C中的CN 106可包括行動管理實體(mobility management entity, MME) 162、服務閘道(serving gateway, SGW) 164、及封包資料網路(packet data network, PDN)閘道(或PGW)166。雖然將上述元件之各者描繪成CN 106的部分,將理解此等元件的任一者可由CN操作者之外的實體擁有及/或操作。1C may include a mobility management entity (MME) 162, a serving gateway (SGW) 164, and a packet data network (PDN) gateway (or PGW) 166. Although each of the above elements are depicted as part of the CN 106, it will be understood that any of these elements may be owned and/or operated by an entity other than the CN operator.

MME 162可經由S1介面連接至RAN 104中的e節點B 162a、162b、162c之各者,並可作用為控制節點。例如,MME 162可負責在WTRU 102a、102b、102c、及類似者的最初附接期間認證WTRU 102a、102b、102c的使用者、承載啟用/停用、選擇特定的服務閘道。MME 162可提供控制平面功能以用於在RAN 104與採用其他無線電技術(諸如GSM及/或WCDMA)的其他RAN(未圖示)之間切換。The MME 162 may be connected to each of the eNode-Bs 162a, 162b, 162c in the RAN 104 via an S1 interface and may function as a control node. For example, the MME 162 may be responsible for authenticating users of the WTRUs 102a, 102b, 102c, bearer activation/deactivation, and selecting a specific serving gateway during an initial attach of the WTRUs 102a, 102b, 102c, and the like. The MME 162 may provide control plane functions for switching between the RAN 104 and other RANs (not shown) that employ other radio technologies, such as GSM and/or WCDMA.

SGW 164可經由S1介面連接至RAN 104中的e節點B 160a、160b、160c的各者。SGW 164通常可將使用者資料封包路由及轉發至WTRU 102a、102b、102c/路由及轉發來自該等WTRU的使用者資料封包。SGW 164可執行其他功能,諸如在e節點B間交遞期間錨定使用者平面、在DL資料可用於WTRU 102a、102b、102c時觸發呼叫、管理及儲存WTRU 102a、102b、102c的背景、及類似者。The SGW 164 may be connected to each of the eNode-Bs 160a, 160b, 160c in the RAN 104 via an S1 interface. The SGW 164 may generally route and forward user data packets to/from the WTRUs 102a, 102b, 102c. The SGW 164 may perform other functions such as anchoring the user plane during inter-eNode-B handovers, triggering calls when DL data is available for the WTRUs 102a, 102b, 102c, managing and storing the context of the WTRUs 102a, 102b, 102c, and the like.

SGW 164可連接至PGW 166,該PGW可將對封包交換網路(諸如網際網路110)的存取提供給WTRU 102a、102b、102c,以促進WTRU 102a、102b、102c與IP賦能裝置之間的通訊。The SGW 164 may be connected to the PGW 166, which may provide the WTRUs 102a, 102b, 102c with access to packet-switched networks, such as the Internet 110, to facilitate communications between the WTRUs 102a, 102b, 102c and IP-enabled devices.

CN 106可促進與其他網路的通訊。例如,CN 106可將對電路交換網路(諸如PSTN 108)的存取提供給WTRU 102a、102b、102c,以促進WTRU 102a、102b、102c與傳統陸地線路通訊裝置之間的通訊。例如,CN 106可包括作用為CN 106與PSTN 108之間的介面的IP閘道器(例如,IP多媒體子系統(IP multimedia subsystem, IMS)伺服器)或可與該IP閘道器通訊。額外地,CN 106可將對其他網路112的存取提供給WTRU 102a、102b、102c,該等其他網路可包括由其他服務供應商擁有及/或操作的其他有線及/或無線網路。The CN 106 may facilitate communications with other networks. For example, the CN 106 may provide the WTRUs 102a, 102b, 102c with access to circuit-switched networks, such as the PSTN 108, to facilitate communications between the WTRUs 102a, 102b, 102c and traditional landline communications devices. For example, the CN 106 may include or may communicate with an IP gateway (e.g., an IP multimedia subsystem (IMS) server) that acts as an interface between the CN 106 and the PSTN 108. Additionally, the CN 106 may provide the WTRUs 102a, 102b, 102c with access to other networks 112, which may include other wired and/or wireless networks owned and/or operated by other service providers.

雖然在圖1A至圖1D中將WTRU描述為無線終端,預計在某些代表性實施例中,此一終端可與通訊網路一起使用(例如,暫時地或永久地)有線通訊介面。Although the WTRU is depicted in FIGS. 1A-1D as a wireless terminal, it is contemplated that in certain representative embodiments such a terminal may utilize (eg, temporarily or permanently) a wired communication interface with a communications network.

在代表性實施例中,其他網路112可係WLAN。In a representative embodiment, the other network 112 may be a WLAN.

在基礎設施基本服務集(Basic Service Set, BSS)模式中的WLAN可具有用於BSS的存取點(AP)及與AP關聯的一或多個站台(STA)。AP可具有對分配系統(Distribution System, DS)或將訊務載入及/或載出BSS之另一類型的有線/無線網路的存取或介面。源自BSS外側之至STA的訊務可透過AP到達並遞送至STA。可將源自STA至BSS外側之目的地的訊務發送至AP以遞送至各別目的地。在BSS內的STA之間的訊務可透過AP發送,例如,其中來源STA可將訊務發送至AP且AP可將訊務遞送至目的地STA。可將BSS內的STA之間的訊務視為及/或稱為同級間訊務。同級間訊務可以直接鏈路設置(direct link setup, DLS)在來源STA與目的地STA之間(例如,直接於其間)發送。在某些代表性實施例中,DLS可使用802.11e DLS或802.11z隧道式DLS (tunneled DLS, TDLS)。使用獨立BSS (Independent BSS, IBSS)模式的WLAN可不具有AP,且在IBSS內或使用該IBSS的STA(例如,所有的STA)可彼此直接通訊。IBSS通訊模式在本文中有時可稱為「特設(ad-hoc)」通訊模式。A WLAN in infrastructure Basic Service Set (BSS) mode may have an access point (AP) for a BSS and one or more stations (STAs) associated with the AP. The AP may have access or an interface to a distribution system (DS) or another type of wired/wireless network that loads traffic into and/or out of the BSS. Traffic originating from outside the BSS to a STA may arrive and be delivered to the STA through the AP. Traffic originating from a STA to a destination outside the BSS may be sent to the AP for delivery to respective destinations. Traffic between STAs within a BSS may be sent through the AP, for example, where a source STA may send traffic to the AP and the AP may deliver the traffic to the destination STA. Traffic between STAs within a BSS may be considered and/or referred to as peer-to-peer traffic. Peer-to-peer traffic may be sent between a source STA and a destination STA (e.g., directly between them) using a direct link setup (DLS). In certain representative embodiments, the DLS may use 802.11e DLS or 802.11z tunneled DLS (TDLS). A WLAN using an independent BSS (IBSS) mode may not have an AP, and STAs (e.g., all STAs) within or using the IBSS may communicate directly with each other. The IBSS communication mode may sometimes be referred to herein as an "ad-hoc" communication mode.

當使用802.11ac基礎設施操作模式或類似操作模式時,AP可在固定通道(諸如主通道)上傳輸信標。主通道可係固定寬度的(例如,20 MHz寬的頻寬)或經由傳訊動態地設定寬度。主通道可係BSS的操作通道並可由STA使用以建立與AP的連接。在某些代表性實施例中,可將具有碰撞避免的載波感測多重存取(Carrier Sense Multiple Access with Collision Avoidance, CSMA/CA)實施在例如802.11系統中。對於CSMA/CA,包括AP的STA(例如,每一個STA)可感測主通道。若主通道由特定STA感測/偵測及/或判定成忙碌,該特定STA可退出。一個STA(例如,僅一個站台)可在給定BSS中的任何給定時間傳輸。When using 802.11ac infrastructure operation mode or similar operation mode, the AP may transmit beacons on a fixed channel (such as a primary channel). The primary channel may be of fixed width (e.g., a 20 MHz wide bandwidth) or the width may be dynamically set via messaging. The primary channel may be an operating channel of the BSS and may be used by STAs to establish a connection with the AP. In certain representative embodiments, Carrier Sense Multiple Access with Collision Avoidance (CSMA/CA) may be implemented in, for example, an 802.11 system. For CSMA/CA, STAs including the AP (e.g., each STA) may sense the primary channel. If the primary channel is sensed/detected and/or determined to be busy by a particular STA, the particular STA may exit. One STA (e.g., only one station) may transmit at any given time in a given BSS.

高通量(High Throughput, HT) STA可使用40 MHz寬的通道以用於通訊,例如經由20 MHz主通道與相鄰或不相鄰的20 MHz通道的組合以形成40 MHz寬的通道。High Throughput (HT) STAs may use a 40 MHz wide channel for communication, for example, by combining a 20 MHz main channel with adjacent or non-adjacent 20 MHz channels to form a 40 MHz wide channel.

非常高通量(Very High Throughput, VHT) STA可支援20 MHz、40 MHz、80 MHz、及/或160 MHz寬的通道。40 MHz及/或80 MHz通道可藉由組合連續的20 MHz通道形成。160 MHz通道可藉由組合8個連續的20 MHz通道,或藉由組合二個非連續的80 MHz通道(其可稱為80+80組態)形成。對於80+80組態,在通道編碼後,可將資料傳過可將資料分成二個串流的區段剖析器。快速傅立葉逆變換(Inverse Fast Fourier Transform, IFFT)處理及時域處理可在各串流上分開完成。可將串流映射至二個80 MHz通道上,且資料可藉由傳輸STA傳輸。在接收STA的接收器處,用於80+80組態的上述操作可反轉,並可將經組合資料發送至媒體存取控制(MAC)。Very High Throughput (VHT) STAs can support 20 MHz, 40 MHz, 80 MHz, and/or 160 MHz wide channels. 40 MHz and/or 80 MHz channels can be formed by combining contiguous 20 MHz channels. A 160 MHz channel can be formed by combining eight contiguous 20 MHz channels, or by combining two non-contiguous 80 MHz channels (which may be referred to as an 80+80 configuration). For the 80+80 configuration, after channel encoding, the data may be passed through a segment parser that may separate the data into two streams. Inverse Fast Fourier Transform (IFFT) processing and time domain processing may be done separately on each stream. The streams may be mapped onto two 80 MHz channels, and the data may be transmitted by the transmitting STA. At the receiver of the receiving STA, the above operations for the 80+80 configuration may be reversed and the combined data may be sent to the Medium Access Control (MAC).

次1 GHz操作模式是由802.11af及802.11ah所支援。通道操作頻寬及載波在802.11af及802.11ah中相對於使用在802.11n及802.11ac中的通道操作頻寬及載波係降低的。802.11af在電視空白頻段(TV White Space, TVWS)頻譜中支援5 MHz、10 MHz、及20 MHz頻寬,且802.11ah使用非TVWS頻譜支援1 MHz、2 MHz、4 MHz、8 MHz、及16 MHz頻寬。根據代表性實施例,802.11ah可支援儀表類型控制/機器類型通訊,諸如在巨型涵蓋區中的MTC裝置。MTC裝置可具有某些能力,例如,包括支援(例如,僅支援)某些及/或有限頻寬的有限能力。MTC裝置可包括具有高於臨限之電池組壽命的電池組(例如,以維持非常長的電池組壽命)。Sub-1 GHz operation mode is supported by 802.11af and 802.11ah. Channel operating bandwidth and carrier are reduced in 802.11af and 802.11ah relative to those used in 802.11n and 802.11ac. 802.11af supports 5 MHz, 10 MHz, and 20 MHz bandwidths in the TV White Space (TVWS) spectrum, and 802.11ah supports 1 MHz, 2 MHz, 4 MHz, 8 MHz, and 16 MHz bandwidths using non-TVWS spectrum. According to a representative embodiment, 802.11ah can support instrument type control/machine type communications, such as MTC devices in large coverage areas. The MTC device may have certain capabilities, for example, including limited capabilities to support (e.g., only support) certain and/or limited bandwidths. The MTC device may include a battery with a battery life above a critical limit (e.g., to maintain a very long battery life).

可支援多個通道及通道頻寬(諸如802.11n、802.11ac、802.11af、及802.11ah)的WLAN系統包括可指定成主通道的通道。主通道可具有等於由BSS中的所有STA支援的最大共同操作頻寬的頻寬。主通道的頻寬可由在BSS中操作的所有STA之中的支援最小頻寬操作模式的STA設定及/或限制。在802.11ah的實例中,即使AP(及BSS中的其他STA)支援2 MHz、4 MHz、8 MHz、16 MHz、及/或其他通道頻寬操作模式,主通道對於支援(例如,僅支援)1 MHz模式的STA(例如,MTC類型裝置)可係1 MHz寬。載波感測及/或網路配置向量(Network Allocation Vector, NAV)設定可取決於主通道的狀態。例如,若主通道例如導因於STA(其僅支援1 MHz操作模式)傳輸至AP而係忙碌的,即使大部分的頻帶維持閒置且可係可用的,可將整個可用頻帶視為係忙碌的。A WLAN system that can support multiple channels and channel bandwidths (such as 802.11n, 802.11ac, 802.11af, and 802.11ah) includes a channel that can be designated as a primary channel. The primary channel can have a bandwidth equal to the maximum common operating bandwidth supported by all STAs in the BSS. The bandwidth of the primary channel can be set and/or limited by the STA that supports the smallest bandwidth operating mode among all STAs operating in the BSS. In the example of 802.11ah, even if the AP (and other STAs in the BSS) support 2 MHz, 4 MHz, 8 MHz, 16 MHz, and/or other channel bandwidth operating modes, the primary channel can be 1 MHz wide for STAs (e.g., MTC type devices) that support (e.g., only support) 1 MHz mode. Carrier sensing and/or Network Allocation Vector (NAV) settings may depend on the status of the primary channel. For example, if the primary channel is busy, for example due to a STA (which only supports 1 MHz operation mode) transmitting to the AP, the entire available band may be considered busy even though a large portion of the band remains idle and may be available.

在美國,可用頻帶(其可由802.11ah使用)係從902 MHz至928 MHz。在韓國,可用頻帶係從917.5 MHz至923.5 MHz。在日本,可用頻帶係從916.5 MHz至927.5 MHz。取決於國碼,可用於802.11ah的總頻寬係6 MHz至26 MHz。In the United States, the available frequency bands (which can be used by 802.11ah) are from 902 MHz to 928 MHz. In Korea, the available frequency bands are from 917.5 MHz to 923.5 MHz. In Japan, the available frequency bands are from 916.5 MHz to 927.5 MHz. Depending on the country code, the total bandwidth available for 802.11ah is 6 MHz to 26 MHz.

圖1D係根據一實施例繪示RAN 113及CN 115的系統圖。如上文提到的,RAN 113可採用NR無線電技術以透過空中介面116與WTRU 102a、102b、102c通訊。RAN 113亦可與CN 115通訊。FIG1D is a system diagram illustrating the RAN 113 and the CN 115 according to an embodiment. As mentioned above, the RAN 113 may employ NR radio technology to communicate with the WTRUs 102a, 102b, 102c via the air interface 116. The RAN 113 may also communicate with the CN 115.

RAN 113可包括gNB 180a、180b、180c,雖然應理解RAN 113可包括任何數目的gNB,同時仍與實施例保持一致。gNB 180a、180b、180c各可包括一或多個收發器以用於透過空中介面116與WTRU 102a、102b、102c通訊。在一個實施例中,gNB 180a、180b、180c可實施MIMO技術。例如,gNB 180a、108b可利用波束成形以傳輸信號至gNB 180a、180b、180c及/或接收來自該等gNB的信號。因此,gNB 180a例如可使用多個天線以傳輸無線信號至WTRU 102a及/或接收來自該WTRU的無線信號。在一實施例中,gNB 180a、180b、180c可實施載波聚合技術。例如,gNB 180a可將多個組成載波傳輸至WTRU 102a(未圖示)。此等組成載波的子集可在非授權頻譜上,而其餘的組成載波可在授權頻譜上。在一實施例中,gNB 180a、180b、180c可實施協調多點(Coordinated Multi-Point, CoMP)技術。例如,WTRU 102a可接收來自gNB 180a及gNB 180b(及/或gNB 180c)的經協調傳輸。The RAN 113 may include gNBs 180a, 180b, 180c, although it should be understood that the RAN 113 may include any number of gNBs while remaining consistent with an embodiment. The gNBs 180a, 180b, 180c may each include one or more transceivers for communicating with the WTRUs 102a, 102b, 102c via the air interface 116. In one embodiment, the gNBs 180a, 180b, 180c may implement MIMO technology. For example, the gNBs 180a, 180b may utilize beamforming to transmit signals to and/or receive signals from the gNBs 180a, 180b, 180c. Thus, the gNB 180a, for example, may use multiple antennas to transmit wireless signals to and/or receive wireless signals from the WTRU 102a. In one embodiment, gNBs 180a, 180b, 180c may implement carrier aggregation techniques. For example, gNB 180a may transmit multiple component carriers to WTRU 102a (not shown). A subset of these component carriers may be on an unlicensed spectrum, while the remaining component carriers may be on a licensed spectrum. In one embodiment, gNBs 180a, 180b, 180c may implement Coordinated Multi-Point (CoMP) techniques. For example, WTRU 102a may receive coordinated transmissions from gNB 180a and gNB 180b (and/or gNB 180c).

WTRU 102a、102b、102c可使用與可擴縮參數集(numerology)關聯的傳輸與gNB 180a、180b、180c通訊。例如,OFDM符號間距及/或OFDM副載波間距可針對不同傳輸、不同胞元、及/或無線傳輸頻譜的不同部分變化。WTRU 102a、102b、102c可使用子訊框或各種長度或可擴縮長度的傳輸時間間隔(transmission time interval, TTI)(例如,含有變化數目的OFDM符號及/或持續變化的絕對時間長度)與gNB 180a、180b、180c通訊。The WTRUs 102a, 102b, 102c may communicate with the gNBs 180a, 180b, 180c using transmissions associated with a scalable numerology. For example, OFDM symbol spacing and/or OFDM subcarrier spacing may vary for different transmissions, different cells, and/or different portions of the radio transmission spectrum. The WTRUs 102a, 102b, 102c may communicate with the gNBs 180a, 180b, 180c using subframes or transmission time intervals (TTIs) of various or scalable lengths (e.g., containing a varying number of OFDM symbols and/or a continuously varying absolute time length).

gNB 180a、180b、180c可經組態以與採獨立組態及/或非獨立組態的WTRU 102a、102b、102c通訊。在獨立組態中,WTRU 102a、102b、102c可與gNB 180a、180b、180c通訊而無需亦存取其他RAN(例如,諸如e節點B 160a、160b、160c)。在獨立組態中,WTRU 102a、102b、102c可利用gNB 180a、180b、180c的一或多者作用為行動錨點。在獨立組態中,WTRU 102a、102b、102c可使用在非授權頻帶中的信號與gNB 180a、180b、180c通訊。在非獨立組態中,WTRU 102a、102b、102c可與gNB 180a、180b、180c通訊/連接至該等gNB,同時亦與另一RAN(諸如e節點B 160a、160b、160c)通訊/連接至該另一RAN。例如,WTRU 102a、102b、102c可實施DC原理以實質同時地與一或多個gNB 180a、180b、180c及一或多個e節點B 160a、160b、160c通訊。在非獨立組態中,e節點B 160a、160b、160c可作用為WTRU 102a、102b、102c的行動錨點,且gNB 180a、180b、180c可提供用於服務WTRU 102a、102b、102c的額外覆蓋及/或通量。The gNBs 180a, 180b, 180c may be configured to communicate with the WTRUs 102a, 102b, 102c in a standalone configuration and/or a non-standalone configuration. In a standalone configuration, the WTRUs 102a, 102b, 102c may communicate with the gNBs 180a, 180b, 180c without also accessing other RANs (e.g., such as the eNodeBs 160a, 160b, 160c). In a standalone configuration, the WTRUs 102a, 102b, 102c may utilize one or more of the gNBs 180a, 180b, 180c to act as mobile anchors. In a standalone configuration, the WTRUs 102a, 102b, 102c may communicate with the gNBs 180a, 180b, 180c using signals in an unlicensed band. In a non-standalone configuration, the WTRU 102a, 102b, 102c may communicate/connect to the gNBs 180a, 180b, 180c while also communicating/connecting to another RAN, such as an eNode-B 160a, 160b, 160c. For example, the WTRU 102a, 102b, 102c may implement DC principles to communicate with one or more gNBs 180a, 180b, 180c and one or more eNode-Bs 160a, 160b, 160c substantially simultaneously. In a non-standalone configuration, the eNode-B 160a, 160b, 160c may act as mobile anchors for the WTRUs 102a, 102b, 102c and the gNBs 180a, 180b, 180c may provide additional coverage and/or throughput for serving the WTRUs 102a, 102b, 102c.

gNB 180a、180b、180c之各者可與特定胞元(未圖示)關聯,並可經組態以處理無線電資源管理決策、交遞決策、UL及/或DL中之使用者的排程、網路切片的支援、雙連接性、NR與E-UTRA之間的交互工作、使用者平面資料朝向使用者平面功能(User Plane Function, UPF) 184a、184b的路由、控制平面資訊朝向存取及行動性管理功能(Access and Mobility Management Function, AMF) 182a、182b的路由、及類似者。如圖1D所示,gNB 180a、180b、180c可透過Xn介面彼此通訊。Each of the gNBs 180a, 180b, 180c may be associated with a particular cell (not shown) and may be configured to handle radio resource management decisions, handover decisions, scheduling of users in UL and/or DL, support of network slicing, dual connectivity, interworking between NR and E-UTRA, routing of user plane data towards a User Plane Function (UPF) 184a, 184b, routing of control plane information towards an Access and Mobility Management Function (AMF) 182a, 182b, and the like. As shown in FIG. 1D , the gNBs 180a, 180b, 180c may communicate with each other via an Xn interface.

顯示於圖1D中的CN 115可包括至少一個AMF 182a、182b、至少一個UPF 184a、184b、至少一個對話管理功能(Session Management Function, SMF) 183a、183b、並可能包括資料網路(Data Network, DN) 185a、185b。雖然將上述元件之各者描繪成CN 115的部分,將理解此等元件的任一者可由CN操作者之外的實體擁有及/或操作。The CN 115 shown in FIG. 1D may include at least one AMF 182a, 182b, at least one UPF 184a, 184b, at least one Session Management Function (SMF) 183a, 183b, and may include a Data Network (DN) 185a, 185b. Although each of the above elements is depicted as part of the CN 115, it will be understood that any of these elements may be owned and/or operated by an entity other than the CN operator.

AMF 182a、182b可經由N2介面連接至RAN 113中的gNB 180a、180b、180c的一或多者,並可作用為控制節點。例如,AMF 182a、182b可負責認證WTRU 102a、102b、102c的使用者、支援網路切片(例如,具有不同需求之不同PDU對話的處理)、選擇特定的SMF 183a、183b、登錄區的管理、NAS傳訊的終止、行動管理、及類似者。網路切片可由AMF 182a、182b使用,以基於正使用之WTRU 102a、102b、102c之服務的類型將用於WTRU 102a、102b、102c的CN支援客製化。例如,不同網路切片可針對不同的使用情形建立,諸如依賴超可靠低延遲(ultra-reliable low latency, URLLC)存取的服務、依賴增強大量行動寬頻(enhanced massive mobile broadband, eMBB)存取的服務、用於機器類型通訊(machine type communication, MTC)存取的服務、及/或類似者。AMF 162可提供用於在RAN 113與其他RAN(未圖示)之間切換的控制平面功能,該等其他RAN採用其他無線電技術(諸如LTE、LTE-A、LTE-A Pro、及/或非3GPP存取技術(諸如WiFi))。The AMF 182a, 182b may be connected to one or more of the gNBs 180a, 180b, 180c in the RAN 113 via the N2 interface and may act as a control node. For example, the AMF 182a, 182b may be responsible for authenticating users of the WTRU 102a, 102b, 102c, supporting network slicing (e.g., handling of different PDU sessions with different requirements), selecting a specific SMF 183a, 183b, management of registration areas, termination of NAS messages, mobility management, and the like. Network slicing may be used by the AMF 182a, 182b to customize CN support for the WTRU 102a, 102b, 102c based on the type of service being used by the WTRU 102a, 102b, 102c. For example, different network slices may be established for different use cases, such as services relying on ultra-reliable low latency (URLLC) access, services relying on enhanced massive mobile broadband (eMBB) access, services for machine type communication (MTC) access, and/or the like. The AMF 162 may provide control plane functions for switching between the RAN 113 and other RANs (not shown) that employ other radio technologies such as LTE, LTE-A, LTE-A Pro, and/or non-3GPP access technologies such as WiFi.

SMF 183a、183b可經由N11介面連接至CN 115中的AMF 182a、182b。SMF 183a、183b亦可經由N4介面連接至CN 115中的UPF 184a、184b。SMF 183a、183b可選擇及控制UPF 184a、184b並組態透過UPF 184a、184b之訊務的路由。SMF 183a、183b可執行其他功能,諸如管理及分配UE IP位址、管理PDU對話、控制政策執行及QoS、提供下行鏈路資料通知、及類似者。PDU對話類型可係基於IP的、非基於IP的、基於乙太網路的、及類似者。The SMF 183a, 183b may be connected to the AMF 182a, 182b in the CN 115 via the N11 interface. The SMF 183a, 183b may also be connected to the UPF 184a, 184b in the CN 115 via the N4 interface. The SMF 183a, 183b may select and control the UPF 184a, 184b and configure the routing of traffic through the UPF 184a, 184b. The SMF 183a, 183b may perform other functions such as managing and allocating UE IP addresses, managing PDU conversations, controlling policy enforcement and QoS, providing downlink data notifications, and the like. The PDU conversation type may be IP-based, non-IP-based, Ethernet-based, and the like.

UPF 184a、184b可經由N3介面連接至RAN 113中的gNB 180a、180b、180c的一或多者,該介面可將對封包交換網路(諸如網際網路110)的存取提供給WTRU 102a、102b、102c,以促進WTRU 102a、102b、102c與IP賦能裝置之間的通訊。UPF 184、184b可執行其他功能,諸如路由及轉發封包、執行使用者平面政策、支援多連接(multi-homed) PDU對話、處理使用者平面QoS、緩衝下行鏈路封包、提供行動錨定、及類似者。The UPF 184a, 184b may be connected to one or more of the gNBs 180a, 180b, 180c in the RAN 113 via an N3 interface, which may provide the WTRUs 102a, 102b, 102c with access to packet-switched networks, such as the Internet 110, to facilitate communications between the WTRUs 102a, 102b, 102c and IP-enabled devices. The UPF 184, 184b may perform other functions, such as routing and forwarding packets, enforcing user plane policies, supporting multi-homed PDU sessions, handling user plane QoS, buffering downlink packets, providing mobile anchoring, and the like.

CN 115可促進與其他網路的通訊。例如,CN 115可包括作用為CN 115與PSTN 108之間的介面的IP閘道器(例如,IP多媒體子系統(IP multimedia subsystem, IMS)伺服器)或可與該IP閘道器通訊。額外地,CN 115可將對其他網路112的存取提供給WTRU 102a、102b、102c,該等其他網路可包括由其他服務供應商擁有及/或操作的其他有線及/或無線網路。在一個實施例中,WTRU 102a、102b、102c可經由至UPF 184a、184b的N3介面及UPF 184a、184b與區域資料網路(DN) 185a、185b之間的N6介面透過UPF 184a、184b連接至DN 185a、185b。The CN 115 may facilitate communications with other networks. For example, the CN 115 may include or may communicate with an IP gateway (e.g., an IP multimedia subsystem (IMS) server) that acts as an interface between the CN 115 and the PSTN 108. Additionally, the CN 115 may provide the WTRUs 102a, 102b, 102c with access to other networks 112, which may include other wired and/or wireless networks owned and/or operated by other service providers. In one embodiment, the WTRU 102a, 102b, 102c may be connected to a local data network (DN) 185a, 185b via an N3 interface to the UPF 184a, 184b and an N6 interface between the UPF 184a, 184b and the DN 185a, 185b through the UPF 184a, 184b.

鑑於圖1A至圖1D及圖1A至圖1D的對應描述,關於下列一或多者於本文描述之功能的一或多者或全部可藉由一或多個仿真裝置(未圖示)執行:可藉由一或多個仿真裝置(未圖示)執行WTRU 102a至102d、基地台114a至114b、e節點B 160a至160c、MME 162、SGW 164、PGW 166、gNB 180a至180c、AMF 182a至182b、UPF 184a至184b、SMF 183a至183b、DN 185a至185b、及/或本文描述的任何其他(多個)裝置。仿真裝置可係經組態以仿真本文描述之功能的一或多者或全部的一或多個裝置。例如,仿真裝置可用以測試其他裝置及/或模擬網路及/或WTRU功能。In view of FIGS. 1A-1D and the corresponding descriptions of FIGS. 1A-1D , one or more or all of the functions described herein with respect to one or more of the following may be performed by one or more emulation devices (not shown): the WTRUs 102 a-102 d, the base stations 114 a-114 b, the eNode Bs 160 a-160 c, the MME 162, the SGW 164, the PGW 166, the gNBs 180 a-180 c, the AMFs 182 a-182 b, the UPFs 184 a-184 b, the SMFs 183 a-183 b, the DNs 185 a-185 b, and/or any other device(s) described herein may be performed by one or more emulation devices (not shown). The emulation devices may be one or more devices configured to emulate one or more or all of the functions described herein. For example, a simulation device may be used to test other devices and/or simulate network and/or WTRU functionality.

仿真裝置可經設計以在實驗室環境及/或操作者網路環境中實施其他裝置的一或多個測試。例如,一或多個仿真裝置可在完全或部分地實施及/或部署為有線及/或無線通訊網路的部分的同時執行一或多個或全部的功能以測試通訊網路內的其他裝置。一或多個仿真裝置可在暫時地實施/部署成有線及/或無線通訊網路的部分的同時執行一或多個或全部的功能。仿真裝置可針對測試目的而直接耦接至另一裝置及/或可使用空中無線通訊執行測試。The simulation device may be designed to implement one or more tests of other devices in a laboratory environment and/or an operator network environment. For example, one or more simulation devices may perform one or more or all functions while being fully or partially implemented and/or deployed as part of a wired and/or wireless communication network to test other devices within the communication network. One or more simulation devices may perform one or more or all functions while being temporarily implemented/deployed as part of a wired and/or wireless communication network. The simulation device may be directly coupled to another device for testing purposes and/or may perform tests using over-the-air wireless communications.

一或多個仿真裝置可在未實施/部署成有線及/或無線通訊網路的部分的同時執行一或多個(包括全部)功能。例如,仿真裝置可利用在測試實驗室及/或非部署(例如,測試)的有線及/或無線通訊網路中的測試場景中,以實施一或多個組件的測試。一或多個仿真裝置可係測試儀器。直接RF耦合及/或經由RF電路系統(例如,其可包括一或多個天線)的無線通訊可由仿真裝置使用以傳輸及/或接收資料。One or more emulation devices may perform one or more (including all) functions while not being implemented/deployed as part of a wired and/or wireless communication network. For example, the emulation device may be utilized in a test lab and/or in a test scenario in a non-deployed (e.g., testing) wired and/or wireless communication network to implement testing of one or more components. One or more emulation devices may be test instruments. Direct RF coupling and/or wireless communication via an RF circuit system (e.g., which may include one or more antennas) may be used by the emulation device to transmit and/or receive data.

本申請案描述多種態樣,包括工具、特徵、實例、模型、方法等。此等態樣的許多態樣係以特定性描述(以至少顯示個別特性),且常以聽起來可係限定的方式描述。然而,此係出於描述清楚性的目的,且並不限制此等態樣的應用或範圍。實際上,所有的不同態樣皆可組合及互換以提供進一步態樣。此外,該等態樣亦可與描述於先前申請案中的態樣組合及互換。This application describes a variety of aspects, including tools, features, examples, models, methods, etc. Many of these aspects are described in a specific manner (to at least show individual characteristics) and are often described in a way that sounds restrictive. However, this is for the purpose of clarity of description and does not limit the application or scope of these aspects. In fact, all of the different aspects can be combined and interchanged to provide further aspects. In addition, these aspects can also be combined and interchanged with aspects described in previous applications.

於此申請案中描述及設想的態樣可以許多不同形式實施。本文描述的圖5至圖25可提供一些實例,但亦設想其他實例。圖5至圖25的討論不限制實施方案的廣泛性。該等態樣中之至少一者大致上係關於視訊編碼及解碼,且至少一個其他態樣大致上係關於傳輸經產生或經編碼的位元流。可將此等及其他態樣實施為方法、設備、具有儲存於其上之用於根據所描述之方法的任一者編碼或解碼視訊資料之指令的電腦可讀儲存媒體、及/或具有儲存於其上之根據所描述之方法的任一者產生之位元流的電腦可讀儲存媒體。The aspects described and contemplated in this application may be implemented in many different forms. Figures 5 to 25 described herein may provide some examples, but other examples are also contemplated. The discussion of Figures 5 to 25 does not limit the breadth of the implementation scheme. At least one of the aspects is generally related to video encoding and decoding, and at least one other aspect is generally related to transmitting a generated or encoded bit stream. These and other aspects may be implemented as methods, apparatus, computer-readable storage media having instructions stored thereon for encoding or decoding video data according to any of the described methods, and/or computer-readable storage media having a bit stream generated according to any of the described methods stored thereon.

在本申請案中,用語「經重建(reconstructed)」及「經解碼(decoded)」可互換地使用、用語「像素(pixel)」及「樣本(sample)」可互換地使用、用語「影像(image)」、「圖像(picture)」、及「訊框(frame)」可互換地使用。In this application, the terms “reconstructed” and “decoded” are used interchangeably, the terms “pixel” and “sample” are used interchangeably, and the terms “image”, “picture”, and “frame” are used interchangeably.

於本文中描述各種方法,且該等方法之各者包含用於實現所描述之方法的一或多個步驟或動作。除非方法的適當操作需要特定順序的步驟或動作,可修改或組合特定步驟及/或動作的順序及/或用途。額外地,諸如「第一(first)」、「第二(second)」等的用語可使用在各種實例中,以修飾元件、組件、步驟、操作等,諸如例如,「第一解碼(first decoding)」及「第二解碼(second decoding)」。除非具體要求,此類用語的使用並不意味對經修飾操作的排序。所以在此實例中,第一解碼不需要在第二解碼之前執行,並可例如在第二解碼之前、期間、或與其重疊的時間期間中發生。Various methods are described herein, and each of the methods includes one or more steps or actions for implementing the described method. Unless proper operation of the method requires a specific order of steps or actions, the order and/or use of specific steps and/or actions may be modified or combined. Additionally, terms such as "first," "second," and the like may be used in various examples to modify elements, components, steps, operations, and the like, such as, for example, "first decoding" and "second decoding." Unless specifically required, the use of such terms does not imply an ordering of the modified operations. So in this example, the first decoding need not be performed before the second decoding, and may, for example, occur before, during, or during a time period overlapping with the second decoding.

描述於本申請案中的各種方法及其他態樣可用以修改如圖2及圖3所示的視訊編碼器200及解碼器300的模組(例如,解碼模組)。此外,本文揭示的標的可應用至例如任何類型、格式、或版本的視訊編碼(無論是在標準或建議中描述、無論是預先存在或未來發展的、及任何此類標準及建議的延伸)。除非以其他方式指示或在技術上排除,描述於本申請案中的態樣可個別或組合地使用。The various methods and other aspects described in this application can be used to modify the modules (e.g., decoding modules) of the video encoder 200 and decoder 300 shown in FIG. 2 and FIG. 3. In addition, the subject matter disclosed herein can be applied to, for example, any type, format, or version of video coding (whether described in a standard or recommendation, whether pre-existing or developed in the future, and any extension of such standards and recommendations). Unless otherwise indicated or technically excluded, the aspects described in this application can be used individually or in combination.

各種數值使用在本申請案描述的實例中,諸如位元、位元深度等。此等及其他特定值用於描述實例的目的,且所描述的態樣不限於此等特定值。Various numerical values are used in the examples described in this application, such as bits, bit depth, etc. These and other specific values are used for the purpose of describing the examples, and the described aspects are not limited to these specific values.

圖2係顯示實例視訊編碼器的圖。設想實例編碼器200的變化,但編碼器200於下文的描述係出於清楚的目的而未描述所有的預期變化。2 is a diagram showing an example video encoder. Variations of the example encoder 200 are contemplated, but the encoder 200 is described below for the sake of clarity and does not describe all contemplated variations.

在編碼前,視訊序列可經歷預編碼處理(201),例如,將顏色轉換施加至輸入顏色圖像(例如,從RGB 4:4:4轉換成YCbCr 4:2:0),或執行輸入圖像分量的重映射以得到對壓縮更有彈性的信號分布(例如,使用顏色分量的一者的直方圖等化)。後設資料可與預處理關聯,並附加至位元流。Before encoding, the video sequence may undergo pre-encoding processing (201), for example, applying a color conversion to the input color image (e.g., from RGB 4:4:4 to YCbCr 4:2:0), or performing a remapping of the input image components to obtain a signal distribution that is more resilient to compression (e.g., using histogram equalization of one of the color components). Metadata may be associated with the pre-processing and appended to the bitstream.

在編碼器200中,圖像係藉由如下文描述的編碼器元件編碼。待編碼圖像係以例如編碼單元(coding unit, CU)為單位分割(202)及處理。各單元係使用例如幀內或幀間模式任一者編碼。當單元以幀內模式編碼時,其執行幀內預測(260)。在幀間模式中,執行運動評估(275)及補償(270)。編碼器決定(205)將幀內或幀間模式的哪一者用於編碼該單元,並藉由例如預測模式旗標指示幀內/幀間決策。預測殘量係例如藉由從原始影像區塊減去(210)經預測區塊而計算。In a coder 200, an image is encoded by coder elements as described below. The image to be encoded is divided (202) and processed in units such as coding units (CUs). Each unit is encoded using, for example, either intra or inter mode. When a unit is encoded in intra mode, it performs intra prediction (260). In inter mode, motion estimation (275) and compensation (270) are performed. The coder decides (205) which of intra or inter mode is to be used for encoding the unit and indicates the intra/inter decision by, for example, a prediction mode flag. The prediction residual is calculated, for example, by subtracting (210) the predicted block from the original image block.

接著轉換(225)及量化(230)預測殘量。將量化轉換係數以及運動向量及其他語法元素熵編碼(245)以輸出位元流。編碼器可跳過轉換,並將量化直接施加至未轉換的殘餘信號。編碼器可略過轉換及量化二者,亦即殘量係在未應用轉換或量化程序的狀況下直接編碼。The predicted residue is then transformed (225) and quantized (230). The quantized transform coefficients are entropy encoded (245) along with the motion vectors and other syntax elements to output a bitstream. The encoder may skip the transform and apply quantization directly to the untransformed residue signal. The encoder may skip both the transform and quantization, i.e. the residue is encoded directly without applying the transform or quantization process.

編碼器解碼經編碼區塊以提供用於進一步預測的參考。將量化轉換係數解量化(240)及逆轉換(250)以解碼預測殘量。組合(255)經解碼預測殘量及預測區塊,重建影像區塊。將迴路內濾波器(in-loop filter) (265)應用至重建圖像,以執行例如解塊/SAO(樣本適應性偏移(Sample Adaptive Offset))濾波以降低編碼假影。將經濾波影像儲存在參考圖像緩衝器(280)處。The encoder decodes the encoded block to provide a reference for further prediction. The quantized transform coefficients are dequantized (240) and inverse transformed (250) to decode the prediction residue. The decoded prediction residue and the prediction block are combined (255) to reconstruct the image block. An in-loop filter (265) is applied to the reconstructed image to perform, for example, deblocking/SAO (Sample Adaptive Offset) filtering to reduce coding artifacts. The filtered image is stored in a reference image buffer (280).

圖3係顯示視訊解碼器的一實例的圖。在實例解碼器300中,位元流係藉由如下文描述的解碼器元件解碼。視訊解碼器300大致執行與圖2中所描述之編碼階段互逆的解碼階段。編碼器200通常亦執行視訊解碼作為編碼視訊資料的部分。FIG3 is a diagram showing an example of a video decoder. In the example decoder 300, a bit stream is decoded by decoder elements as described below. Video decoder 300 generally performs a decoding phase that is the inverse of the encoding phase described in FIG2. Encoder 200 also typically performs video decoding as part of encoding video data.

具體而言,解碼器的輸入包括可由視訊編碼器200產生的視訊位元流。位元流首先經熵解碼(330)以獲得轉換係數、運動向量、及其他經編碼資訊。圖像分割資訊指示該圖像係如何分割的。解碼器因此可根據經解碼圖像分割資訊劃分(335)圖像。將轉換係數解量化(340)及逆轉換(350)以解碼預測殘量。組合(355)經解碼預測殘量及預測區塊,重建影像區塊。經預測區塊可從幀內預測(360)或運動補償預測(亦即,幀間預測)(375)獲得(370)。將迴路內濾波器(365)應用至經重建影像。將經濾波影像儲存在參考圖像緩衝器(380)處。Specifically, the input to the decoder includes a video bitstream that may be generated by the video encoder 200. The bitstream is first entropy decoded (330) to obtain transform coefficients, motion vectors, and other encoded information. The image segmentation information indicates how the image is segmented. The decoder can therefore divide (335) the image according to the decoded image segmentation information. The transform coefficients are dequantized (340) and inversely transformed (350) to decode the prediction residual. The decoded prediction residual and the prediction block are combined (355) to reconstruct the image block. The predicted block can be obtained (370) from intra-frame prediction (360) or motion compensated prediction (i.e., inter-frame prediction) (375). An in-loop filter (365) is applied to the reconstructed image. The filtered image is stored in a reference image buffer (380).

經解碼圖像可進一步完成後解碼處理(385),例如顏色逆轉換(例如,從YCbCr 4:2:0至RGB 4:4:4的轉換)或執行在預編碼處理(201)中執行之重新映射處理之相反的逆重新映射。後解碼處理可使用在預編碼處理中衍生並在位元流中傳訊的後設資料。在一實例中,可將經解碼影像(例如,在應用迴路內濾波器(365)之後及/或若使用後解碼處理,在後解碼處理(385)之後)發送至顯示裝置以用於演現給使用者。The decoded image may further undergo post-decoding processing (385), such as color inversion (e.g., conversion from YCbCr 4:2:0 to RGB 4:4:4) or performing an inverse remapping that is the opposite of the remapping process performed in the pre-coding process (201). The post-decoding process may use metadata derived in the pre-coding process and signaled in the bitstream. In one example, the decoded image (e.g., after applying the in-loop filter (365) and/or after the post-decoding process (385) if post-decoding processing is used) may be sent to a display device for presentation to a user.

圖4係顯示本文描述的各種態樣及實例可實施於其中之系統的一實例的圖。系統400可體現為包括下文描述的各種組件,並經組態以執行描述於本文件中之態樣的一或多者的裝置。此類裝置的實例包括,但不限於,各種電子裝置,諸如個人電腦、膝上型電腦、智慧型手機、平板電腦、數位多媒體機上盒、數位電視接收器、個人視訊記錄系統、連接式家用電器、及伺服器。系統400的元件可單一地或組合地體現在單一積體電路(IC)、多個IC、及/或離散組件中。例如,在至少一個實例中,系統400的處理及編碼器/解碼器元件跨多個IC及/或離散組件分布。在各種實例中,系統400經由例如通訊匯流排或透過專用輸入埠及/或輸出埠通訊地耦接至一或多個其他系統或其他電子裝置。在各種實例中,系統400經組態以實施描述於本文件中之態樣的一或多者。Fig. 4 is a diagram showing an example of a system in which the various aspects and examples described herein can be implemented. System 400 can be embodied as a device including various components described below and configured to execute one or more of the aspects described in this document. Examples of such devices include, but are not limited to, various electronic devices, such as personal computers, laptops, smart phones, tablet computers, digital multimedia set-top boxes, digital television receivers, personal video recording systems, connected home appliances, and servers. The elements of system 400 can be embodied singly or in combination in a single integrated circuit (IC), multiple ICs, and/or discrete components. For example, in at least one example, the processing and encoder/decoder elements of system 400 are distributed across multiple ICs and/or discrete components. In various embodiments, the system 400 is communicatively coupled to one or more other systems or other electronic devices via, for example, a communication bus or through dedicated input ports and/or output ports. In various embodiments, the system 400 is configured to implement one or more of the aspects described in this document.

系統400包括至少一個處理器410,該處理器經組態以執行載入至其中之用於實施例如描述於本文件中的各種態樣的指令。處理器410可包括嵌入式記憶體、輸入輸出介面、及所屬技術領域中已知的各種其他電路系統。系統400包括至少一個記憶體420(例如,揮發性記憶體裝置及/或非揮發性記憶體裝置)。系統400包括儲存裝置440,該儲存裝置可包括非揮發性記憶體及/或揮發性記憶體,包括但不限於電可抹除可程式化唯讀記憶體(Electrically Erasable Programmable Read-Only Memory, EEPROM)、唯讀記憶體(ROM)、可程式化唯讀記憶體(Programmable Read-Only Memory, PROM)、隨機存取記憶體(RAM)、動態隨機存取記憶體(Dynamic Random Access Memory, DRAM)、靜態隨機存取記憶體(Static Random Access Memory, SRAM)、快閃記憶體、磁碟驅動機、及/或光碟驅動機。作為非限制性實例,儲存裝置440可包括內部儲存裝置、附接儲存裝置(包括可拆離及不可拆離儲存裝置)、及/或網路可存取儲存裝置。The system 400 includes at least one processor 410 configured to execute instructions loaded therein for implementing various aspects described in this document, for example. The processor 410 may include embedded memory, input and output interfaces, and various other circuit systems known in the art. The system 400 includes at least one memory 420 (e.g., a volatile memory device and/or a non-volatile memory device). The system 400 includes a storage device 440, which may include non-volatile memory and/or volatile memory, including but not limited to Electrically Erasable Programmable Read-Only Memory (EEPROM), Read-Only Memory (ROM), Programmable Read-Only Memory (PROM), Random Access Memory (RAM), Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), flash memory, disk drive, and/or optical disk drive. As non-limiting examples, storage devices 440 may include internal storage devices, attached storage devices (including removable and non-removable storage devices), and/or network-accessible storage devices.

系統400包括編碼器/解碼器模組430,該編碼器/解碼器模組經組態以例如處理資料以提供經編碼視訊或經解碼視訊,且編碼器/解碼器模組430可包括其自有的處理器及記憶體。編碼器/解碼器模組430表示可包括在裝置中以執行編碼及/或解碼功能的(多個)模組。如已知的,裝置可包括編碼及解碼模組的一或二者。額外地,如所屬技術領域中具有通常知識者已知的,可將編碼器/解碼器模組430實施為系統400的分開元件,或可併入處理器410內作為硬體與軟體的組合。The system 400 includes a codec module 430 that is configured to, for example, process data to provide encoded video or decoded video, and the codec module 430 may include its own processor and memory. The codec module 430 represents a module(s) that may be included in a device to perform encoding and/or decoding functions. As is known, a device may include one or both encoding and decoding modules. Additionally, as known to those of ordinary skill in the art, the codec module 430 may be implemented as a separate component of the system 400, or may be incorporated into the processor 410 as a combination of hardware and software.

待載入至處理器410或編碼器/解碼器430上以執行描述於本文件中的各種態樣的程式碼可儲存在儲存裝置440中,且隨後載入至記憶體420上以用於由處理器410執行。根據各種實例,處理器410、記憶體420、儲存裝置440、及編碼器/解碼器模組430的一或多者可在描述於本文件中的程序的執行期間儲存各種項目的一或多者。此類經儲存項目可包括但不限於來自方程式、公式、操作、及操作邏輯之處理的輸入視訊、經解碼視訊或經解碼視訊的部分、位元流、矩陣、變數、及中間或最終結果。Program code to be loaded onto the processor 410 or the encoder/decoder 430 to execute various aspects described in this document may be stored in the storage device 440 and subsequently loaded onto the memory 420 for execution by the processor 410. According to various examples, one or more of the processor 410, the memory 420, the storage device 440, and the encoder/decoder module 430 may store one or more of various items during execution of the procedures described in this document. Such stored items may include, but are not limited to, input video, decoded video or portions of decoded video, bit streams, matrices, variables, and intermediate or final results from the processing of equations, formulas, operations, and operational logic.

在一些實例中,處理器410及/或編碼器/解碼器模組430內側的記憶體係用以儲存指令,並為編碼或解碼期間所需的處理提供工作記憶體。然而,在其他實例中,處理裝置(例如,處理裝置可係處理器410或編碼器/解碼器模組430的任一者)外部的記憶體係用於此等功能的一或多者。外部記憶體可係記憶體420及/或儲存裝置440,例如動態揮發性記憶體及/或非揮發性快閃記憶體。在數個實例中,外部非揮發性快閃記憶體係用以儲存例如電視機的作業系統。在至少一個實例中,快速外部動態揮發性記憶體(諸如RAM)係使用為用於視訊編碼及解碼操作的工作記憶體。In some examples, memory internal to the processor 410 and/or encoder/decoder module 430 is used to store instructions and provide working memory for processing required during encoding or decoding. However, in other examples, memory external to the processing device (e.g., the processing device can be either the processor 410 or the encoder/decoder module 430) is used for one or more of these functions. The external memory can be memory 420 and/or storage device 440, such as dynamic volatile memory and/or non-volatile flash memory. In several examples, the external non-volatile flash memory is used to store, for example, the operating system of the television. In at least one example, fast external dynamic volatile memory (such as RAM) is used as working memory for video encoding and decoding operations.

至系統400之元件的輸入可透過如方塊445中所指示的各種輸入裝置提供。此類輸入裝置包括但不限於(i)射頻(RF)部分,其接收例如由廣播器透過空氣傳輸的RF信號、(ii)分量(COMP)輸入端子(或一組COMP輸入端子)、(iii)通用串列匯流排(Universal Serial Bus, USB)輸入端子、及/或(iv)高畫質多媒體介面(High Definition Multimedia Interface, HDMI)輸入端子。其他實例(未顯示於圖4中)包括複合視訊。Input to the components of system 400 may be provided via various input devices as indicated in block 445. Such input devices include, but are not limited to, (i) a radio frequency (RF) section that receives an RF signal transmitted through the air, such as by a broadcaster, (ii) a component (COMP) input terminal (or a set of COMP input terminals), (iii) a Universal Serial Bus (USB) input terminal, and/or (iv) a High Definition Multimedia Interface (HDMI) input terminal. Other examples (not shown in FIG. 4 ) include composite video.

在各種實例中,方塊445的輸入裝置具有如所屬技術領域中已知的關聯各別輸入處理元件。例如,RF部分可與適用於(i)選擇所欲頻率(亦稱為選擇信號或將信號頻帶限制至頻帶)、(ii)降頻轉換經選擇信號、(iii)再次頻帶限制至更窄的頻帶以選擇(例如)在某些實例中可稱為通道的信號頻帶、(iv)解調變經降頻轉換及經頻帶限制的信號、(v)執行錯誤校正、及/或(vi)解多工以選擇所欲的資料封包串流的元件關聯。各種實例的RF部分包括一或多個元件以執行此等功能,例如頻率選擇器、信號選擇器、頻帶限制器、通道選擇器、濾波器、降頻轉換器、解調變器、錯誤校正器、及解多工器。RF部分可包括執行各種此等功能(包括例如將經接收信號降頻轉換至較低頻率(例如,中間頻率或近基帶頻率)或至基帶)的調諧器。在一個機上盒實例中,RF部分及其關聯輸入處理元件接收透過有線(例如,纜線)媒體傳輸的RF信號,並藉由濾波、降頻轉換、及再次濾波至所欲頻帶來執行頻率選擇。各種實例重配置上述(及其他)元件的順序、移除此等元件的一些、及/或加入執行類似或不同功能的其他元件。加入元件可包括將元件***在現有元件之間,諸如例如***放大器及類比轉數位轉換器。在各種實例中,RF部分包括天線。In various examples, the input device of block 445 has associated respective input processing elements as are known in the art. For example, the RF portion may be associated with elements adapted to (i) select a desired frequency (also referred to as selecting a signal or band-limiting a signal to a frequency band), (ii) down-convert the selected signal, (iii) again band-limit to a narrower frequency band to select a signal band, which may be referred to as a channel in some examples, (iv) demodulate the down-converted and band-limited signal, (v) perform error correction, and/or (vi) demultiplex to select a desired data packet stream. The RF section of various embodiments includes one or more components to perform such functions, such as frequency selectors, signal selectors, band limiters, channel selectors, filters, down-converters, demodulators, error correctors, and demultiplexers. The RF section may include a tuner that performs various such functions, including, for example, down-converting a received signal to a lower frequency (e.g., an intermediate frequency or a near-baseband frequency) or to baseband. In a set-top box embodiment, the RF section and its associated input processing elements receive RF signals transmitted through a wired (e.g., cable) medium and perform frequency selection by filtering, down-converting, and filtering again to a desired frequency band. Various embodiments reconfigure the order of the above (and other) components, remove some of these components, and/or add other components that perform similar or different functions. Adding components may include inserting components between existing components, such as, for example, inserting an amplifier and an analog-to-digital converter. In various embodiments, the RF portion includes an antenna.

USB及/或HDMI端子可包括用於跨USB及/或HDMI連接將系統400連接至其他電子裝置的各別介面處理器。應理解輸入處理的各種態樣(例如,里德-所羅門(Reed-Solomon)錯誤校正)可依需要實施在例如分開的輸入處理IC內或在處理器410內。類似地,USB或HDMI介面處理的態樣可依需要實施在分開的介面IC內或在處理器410內。將經解調變、經錯誤校正、及經解多工串流提供至各種處理元件,包括例如處理器410及與記憶體及儲存元件組合操作的編碼器/解碼器430以針對呈現在輸出裝置上依需要處理資料流。The USB and/or HDMI terminals may include respective interface processors for connecting the system 400 to other electronic devices across the USB and/or HDMI connections. It will be appreciated that various aspects of input processing (e.g., Reed-Solomon error correction) may be implemented, for example, in a separate input processing IC or in the processor 410 as desired. Similarly, aspects of USB or HDMI interface processing may be implemented, for example, in a separate interface IC or in the processor 410 as desired. The demodulated, error corrected, and demultiplexed streams are provided to various processing elements, including, for example, the processor 410 and an encoder/decoder 430 operating in combination with memory and storage elements to process the data streams as desired for presentation on an output device.

系統400的各種元件可提供在整合外殼內,在整合外殼內,各種元件可使用合適的連接配置425(例如,如所屬技術領域中已知的內部匯流排,包括IC間(Inter-IC, I2C)匯流排、布線、及印刷電路板)於其間互連及傳輸資料。The various components of the system 400 may be provided within an integrated housing, within which the various components may be interconnected and transmit data therebetween using an appropriate connection configuration 425 (e.g., an internal bus as known in the art, including an Inter-IC (I2C) bus, wiring, and a printed circuit board).

系統400包括通訊介面450,該通訊介面實現經由通訊通道460與其他裝置的通訊。通訊介面450可包括但不限於經組態以透過通訊通道460傳輸及接收資料的收發器。通訊介面450可包括但不限於數據機或網路卡,且通訊通道460可實施在例如有線及/或無線媒體內。The system 400 includes a communication interface 450 that enables communication with other devices via a communication channel 460. The communication interface 450 may include, but is not limited to, a transceiver configured to transmit and receive data via the communication channel 460. The communication interface 450 may include, but is not limited to, a modem or a network card, and the communication channel 460 may be implemented in, for example, wired and/or wireless media.

在各種實例中,使用無線網路(諸如Wi-Fi網路,例如IEEE 802.11(IEEE係指美國電機電子工程師學會))將資料串流或以其他方式提供至系統400。此等實例的Wi-Fi信號係透過經調適用於Wi-Fi通訊的通訊通道460及通訊介面450接收。此等實例的通訊通道460一般連接至提供對外部網路(包括網際網路)之存取以用於允許串流應用及其他過頂(over-the-top)通訊的存取點或路由器。其他實例使用透過輸入方塊445的HDMI連接遞送資料的機上盒將經串流資料提供至系統400。又其他實例使用輸入方塊445的RF連接將經串流資料提供至系統400。如上文所指示的,各種實例以非串流方式提供資料。額外地,各種實例使用Wi-Fi以外的無線網路,例如,蜂巢式網路或Bluetooth ®網路。 In various examples, data is streamed or otherwise provided to system 400 using a wireless network, such as a Wi-Fi network, such as IEEE 802.11 (IEEE refers to the Institute of Electrical and Electronics Engineers). Wi-Fi signals for these examples are received via a communication channel 460 and a communication interface 450 adapted for Wi-Fi communications. The communication channel 460 for these examples is generally connected to an access point or router that provides access to external networks, including the Internet, for allowing streaming applications and other over-the-top communications. Other examples provide streamed data to system 400 using a set-top box that delivers data via an HDMI connection to input block 445. Still other examples provide streamed data to system 400 using an RF connection to input block 445. As indicated above, various examples provide data in a non-streaming manner. Additionally, various examples use wireless networks other than Wi-Fi, such as cellular networks or Bluetooth® networks.

系統400可將輸出信號提供至各種輸出裝置,包括顯示器475、揚聲器485、及其他週邊裝置495。各種實例的顯示器475包括例如觸控螢幕顯示器、有機發光二極體(OLED)顯示器、曲面顯示器、及/或可摺疊顯示器的一或多者。顯示器475可用於電視機、平板電腦、膝上型電腦、蜂巢式電話(行動電話)、或其他裝置。顯示器475亦可與其他組件整合(例如,如智慧型手機中),或係分開的(例如,膝上型電腦的外部監視器)。在各種實例中,其他週邊裝置495包括獨立數位視訊光碟(或數位多功能光碟)(DVD,針對二種用語)、光碟機、立體聲系統、及/或照明系統的一或多者。各種實例使用基於系統400的輸出提供功能的一或多個週邊裝置495。例如,光碟機執行播放系統400之輸出的功能。The system 400 can provide output signals to various output devices, including a display 475, speakers 485, and other peripheral devices 495. Various examples of the display 475 include, for example, one or more of a touch screen display, an organic light emitting diode (OLED) display, a curved display, and/or a foldable display. The display 475 can be used in a television, a tablet computer, a laptop computer, a cellular phone (mobile phone), or other devices. The display 475 can also be integrated with other components (e.g., as in a smart phone), or separate (e.g., an external monitor for a laptop computer). In various embodiments, other peripheral devices 495 include one or more of a stand-alone digital video disc (or digital versatile disc) (DVD, for both terms), a disc player, a stereo system, and/or a lighting system. Various embodiments use one or more peripheral devices 495 that provide functions based on the output of system 400. For example, a disc player performs the function of playing the output of system 400.

在各種實例中,控制信號使用傳訊(諸如AV.Link、消費性電子控制(Consumer Electronics Control, CEC)、或以需要或不需要使用者介入的方式實現裝置對裝置控制的其他通訊協定)在系統400與顯示器475、揚聲器485、或其他週邊裝置495之間傳達。輸出裝置可經由透過各別介面470、480、及490的專用連接通訊地耦接至系統400。替代地,輸出裝置可經由通訊介面450使用通訊通道460連接至系統400。顯示器475及揚聲器485可與電子裝置(諸如例如電視機)中的系統400的其他組件整合在單一單元中。在各種實例中,顯示器介面470包括顯示器驅動器,諸如例如時序控制器(T Con)晶片。In various examples, control signals are communicated between the system 400 and a display 475, speakers 485, or other peripheral devices 495 using communications such as AV.Link, Consumer Electronics Control (CEC), or other communications protocols that enable device-to-device control with or without user intervention. Output devices may be communicatively coupled to the system 400 via dedicated connections through respective interfaces 470, 480, and 490. Alternatively, output devices may be connected to the system 400 via communications interface 450 using communications channel 460. The display 475 and speakers 485 may be integrated into a single unit with other components of the system 400 in an electronic device such as, for example, a television. In various examples, display interface 470 includes a display driver, such as, for example, a timing controller (T Con) chip.

例如,若輸入445的RF部分係分開的機上盒的部件,顯示器475及揚聲器485可替代地與其他組件的一或多者分開。在顯示器475及揚聲器485係外部組件的各種實例中,輸出信號可經由專用輸出連接(包括例如HDMI埠、USB埠、或COMP輸出)提供。For example, if the RF portion of input 445 is part of a separate set-top box, display 475 and speaker 485 may alternatively be separate from one or more of the other components. In various examples where display 475 and speaker 485 are external components, output signals may be provided via dedicated output connections (including, for example, an HDMI port, a USB port, or a COMP output).

實例可藉由由處理器410實施的電腦軟體或藉由硬體、或藉由硬體及軟體的組合實行。作為非限制性實例,實例可藉由一或多個積體電路實施。作為非限制性實例,記憶體420可係對技術環境適當的任何類型的,且可使用任何適當的資料儲存技術實施,諸如光學記憶體裝置、磁性記憶體裝置、基於半導體的記憶體裝置、固定式記憶體、及可移除式記憶體。作為非限制性實例,處理器410可係對技術環境適當的任何類型的,並可涵蓋微處理器、通用電腦、特殊用途電腦、及基於多核心架構之處理器的一或多者。Examples may be implemented by computer software implemented by processor 410 or by hardware, or by a combination of hardware and software. As a non-limiting example, examples may be implemented by one or more integrated circuits. As a non-limiting example, memory 420 may be of any type appropriate to the technical environment and may be implemented using any appropriate data storage technology, such as optical memory devices, magnetic memory devices, semiconductor-based memory devices, fixed memory, and removable memory. As a non-limiting example, processor 410 may be of any type appropriate to the technical environment and may include one or more of a microprocessor, a general-purpose computer, a special-purpose computer, and a processor based on a multi-core architecture.

各種實施方案涉及解碼。如本申請案中所使用的,「解碼(decoding)」可涵蓋例如在經接收經編碼序列上執行以產生適合顯示器的最終輸出之程序的全部或部分。在各種實例中,此類程序包括一般藉由解碼器執行之程序(例如,熵解碼、逆量化、逆轉換、及差分解碼)的一或多者。在各種實例中,此類程序亦(或替代地)包括藉由在本申請案中描述的各種實施方案的解碼器執行的程序,例如,判定一目前區塊以一非方向性幀內預測模式編碼; 導出對應於該非方向性幀內預測模式的一方向性幀內預測模式,其中經導出的該方向性幀內預測模式指示一經導出幀內預測方向;且至少部分地基於經導出方向性幀內預測模式等,而解碼目前區塊。Various embodiments involve decoding. As used in this application, "decoding" may encompass all or part of a process performed on a received coded sequence to produce a final output suitable for a display, for example. In various examples, such processes include one or more of the processes typically performed by a decoder (e.g., entropy decoding, inverse quantization, inverse transform, and differential decoding). In various examples, such procedures also (or alternatively) include procedures performed by a decoder of the various embodiments described in the present application, for example, determining that a current block is encoded with a non-directional intra-frame prediction mode; deriving a directional intra-frame prediction mode corresponding to the non-directional intra-frame prediction mode, wherein the derived directional intra-frame prediction mode indicates a derived intra-frame prediction direction; and decoding the current block based at least in part on the derived directional intra-frame prediction mode, etc.

作為進一步實例,在一實例中,「解碼」僅指熵解碼,在另一實例中,「解碼」僅指差分解碼,且在另一實例中,「解碼」係指熵解碼與差分解碼的組合。不論片語「解碼程序(decoding process)」是否意圖具體地係指操作的子集或大致係指更廣泛者,解碼程序將基於特定描述的上下文而係清楚的並據信可係所屬技術領域中具有通常知識者良好地理解的。As a further example, in one example, "decoding" refers only to entropy decoding, in another example, "decoding" refers only to differential decoding, and in another example, "decoding" refers to a combination of entropy decoding and differential decoding. Regardless of whether the phrase "decoding process" is intended to refer specifically to a subset of operations or generally to something more general, the decoding process will be clear based on the context of the specific description and is believed to be well understood by those of ordinary skill in the art.

各種實施方案涉及編碼。以類似於上述關於「解碼(decoding)」的討論之方式,在本申請案中所使用的「編碼(encoding)」可涵蓋例如在輸入視訊序列上執行以產生經編碼位元流的程序之全部或部分。在各種實例中,此類程序包括一般藉由編碼器執行之程序(例如,分割、差分編碼、轉換、量化、及熵編碼)的一或多者。在各種實例中,此類程序亦(或替代地)包括藉由描述在本申請案中的各種實施方案的編碼器執行的程序,例如,識別用於編碼目前區塊的非方向性幀內預測模式;導出對應於該非方向性幀內預測模式的一方向性幀內預測模式,其中經導出的該方向性幀內預測模式包含一經導出幀內預測方向;且至少部分地基於經導出方向性幀內預測模式等,而編碼目前區塊。Various embodiments involve encoding. In a manner similar to the above discussion of "decoding", "encoding" as used in this application may encompass all or part of the processes performed on an input video sequence to produce an encoded bit stream, for example. In various examples, such processes include one or more of the processes typically performed by an encoder (e.g., segmentation, differential coding, conversion, quantization, and entropy coding). In various examples, such procedures also (or alternatively) include procedures executed by an encoder of the various embodiments described in the present application, for example, identifying a non-directional intra-frame prediction mode for encoding a current block; deriving a directional intra-frame prediction mode corresponding to the non-directional intra-frame prediction mode, wherein the derived directional intra-frame prediction mode includes a derived intra-frame prediction direction; and encoding the current block at least in part based on the derived directional intra-frame prediction mode, etc.

作為進一步實例,在一實例中,「編碼」僅指熵編碼,在另一實例中,「編碼」僅指差分編碼,且在另一實例中,「編碼」係指熵編碼與差分編碼的組合。不論片語「編碼程序(encoding process)」是否意圖具體地指稱操作的子集或大致係指更廣泛者,編碼程序將基於特定描述的上下文而係清楚的並據信可係所屬技術領域中具有通常知識者良好地理解的。As a further example, in one example, "encoding" refers only to entropy coding, in another example, "encoding" refers only to differential coding, and in another example, "encoding" refers to a combination of entropy coding and differential coding. Regardless of whether the phrase "encoding process" is intended to refer specifically to a subset of operations or generally to something more general, the encoding process will be clear based on the context of the particular description and is believed to be well understood by those of ordinary skill in the art.

當將圖式表示成流程圖時,應瞭解其亦提供對應設備的方塊圖。類似地,當將圖式表示成方塊圖時,應瞭解其亦提供對應方法/程序的流程圖。When the diagram is represented as a flow chart, it should be understood that it also provides a block diagram of the corresponding apparatus. Similarly, when the diagram is represented as a block diagram, it should be understood that it also provides a flow chart of the corresponding method/process.

描述於本文中的實施方案及態樣可以例如方法或程序、設備、軟體程式、資料流、或信號實施。即使僅在單一形式的實施方案的上下文中討論(例如,僅作為方法討論),所討論之特徵的實施方案亦可以其他形式實施(例如,設備或程式)。設備可以例如適當硬體、軟體、及韌體實施。方法可在例如處理器中實施,該處理器通常指處理裝置,包括例如電腦、微處理器、積體電路、或可程式化邏輯裝置。處理器亦包括通訊裝置,諸如例如電腦、蜂巢式電話、可攜式/個人數位助理(「PDA」)、及促進終端使用者之間的資訊的通訊的其他裝置。The embodiments and aspects described herein may be implemented, for example, as methods or procedures, apparatuses, software programs, data flows, or signals. Even if discussed only in the context of a single form of an embodiment (e.g., discussed only as a method), the embodiments of the features discussed may also be implemented in other forms (e.g., apparatus or program). An apparatus may be implemented, for example, in appropriate hardware, software, and firmware. A method may be implemented, for example, in a processor, which generally refers to a processing device, including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device. A processor also includes a communication device, such as, for example, a computer, a cellular phone, a portable/personal digital assistant ("PDA"), and other devices that facilitate the communication of information between end users.

對「一個實例(one example)」或「一實例(an example)」或「一個實施方案(one implementation)」、或「一實施方案(an implementation)」以及其等的其他變化的參考意指相關於該實例陳述的特定特徵、結構、特性等包括在至少一個實例中。因此,片語「在一個實例中(in one example)」或「在一實例中(in an example)」或「在一個實施方案中(in one implementation)」、或「在一實施方案中(in an implementation)」的出現,以及在遍及本申請案各處出現的任何其他變化不必全部參考至相同實例。Reference to "one example" or "an example" or "one implementation" or "an implementation" and other variations thereof means that a particular feature, structure, characteristic, etc. described in connection with that example is included in at least one example. Thus, the appearance of the phrase "in one example" or "in an example" or "in one implementation" or "in an implementation" and any other variations appearing throughout this application are not necessarily all referenced to the same example.

額外地,此申請案可與「判定」各項資訊相關。判定資訊可包括例如評估資訊、計算資訊、預測資訊、或從記憶體檢索資訊的一或多者。獲得可包括接收、檢索、建構、產生、及/或判定。Additionally, the application may be related to "determining" various information. Determining information may include, for example, one or more of evaluating information, calculating information, predicting information, or retrieving information from memory. Obtaining may include receiving, retrieving, constructing, generating, and/or determining.

進一步地,此申請案可與「存取」各項資訊相關。存取資訊可包括例如接收資訊、檢索資訊(例如,從記憶體)、儲存資訊、移動資訊、複製資訊、計算資訊、判定資訊、預測資訊、或評估資訊的一或多者。Further, the application may be related to "accessing" various information. Accessing information may include, for example, one or more of receiving information, retrieving information (e.g., from memory), storing information, moving information, copying information, calculating information, determining information, predicting information, or evaluating information.

額外地,此申請案可與「接收」各項資訊相關。意圖使接收與「存取(accessing)」般成為廣泛用語。接收資訊可包括例如存取資訊或檢索資訊(例如,從記憶體)的一或多者。進一步地,在操作期間(諸如例如儲存資訊、處理資訊、傳輸資訊、移動資訊、複製資訊、抹除資訊、計算資訊、判定資訊、預測資訊、或評估資訊)一般以某種方式或另一者涉及「接收(receiving)」。Additionally, this application may be related to "receiving" various items of information. Receiving is intended to be a broad term, as is "accessing." Receiving information can include, for example, one or more of accessing information or retrieving information (e.g., from memory). Further, during operations such as, for example, storing information, processing information, transmitting information, moving information, copying information, erasing information, calculating information, determining information, predicting information, or evaluating information, generally involves "receiving" in some way or another.

應理解下列「/」、「及/或(and/or)」、及「中之至少一者(at least one of)」在例如「A/B」、「A及/或B (A and/or B)」、及「A及B中之至少一者(at least one of A and B)」之情形中的使用意圖涵蓋僅選擇第一列出選項(A)、或僅選擇第二列出選項(B)、或選擇二個選項(A及B)。作為進一步實例,在「A、B、及/或C (A, B, and/or C)」及「A、B、及C中之至少一者(at least one of A, B, and C)」的情形中,此類片語意圖涵蓋僅選擇第一列出選項(A)、或僅選擇第二列出選項(B)、或僅選擇第三列出選項(C)、或僅選擇第一及第二列出選項(A及B)、或僅選擇第一及第三列出選項(A及C)、或僅選擇第二及第三列出選項(B及C)、或選擇所有三個選項(A及B及C)。此可對與所列項目一樣多的項目延伸,如對所屬及相關技術領域中具有通常知識者係明顯的。It should be understood that the use of “/”, “and/or”, and “at least one of” in situations such as “A/B”, “A and/or B”, and “at least one of A and B” is intended to cover selecting only the first listed option (A), or only the second listed option (B), or selecting both options (A and B). As a further example, in the case of "A, B, and/or C" and "at least one of A, B, and C", such phrases are intended to cover selecting only the first listed option (A), or only the second listed option (B), or only the third listed option (C), or only the first and second listed options (A and B), or only the first and third listed options (A and C), or only the second and third listed options (B and C), or all three options (A and B and C). This may extend to as many items as listed, as would be apparent to one of ordinary skill in the pertinent and related art.

再者,如本文中所使用的,用詞「傳訊(signal)」尤其係指將某物指示給對應解碼器。以此方式,在一實例中,相同參數在編碼器側及解碼器側兩者使用。因此,舉例來說,一編碼器可傳輸(明確傳訊)一特定參數至解碼器,使得解碼器可使用相同的特定參數。相反地,若解碼器已具有該特定參數以及其他參數,則可使用傳訊而不傳輸(隱式傳訊),以僅允許解碼器知道並選擇特定參數。藉由避免傳輸任何實際功能,在各種實例中實現位元節省。應理解傳訊可以各種方式達成。例如,在各種實例中,使用一或多個語法元素、旗標等以將資訊傳訊至對應解碼器。雖然前文係關於詞「傳訊(signal)」的動詞形式,但詞「信號(signal)」在本文中可(例如亦可)使用為名詞。Furthermore, as used herein, the term "signal" refers in particular to indicating something to a corresponding decoder. In this way, in one example, the same parameters are used on both the encoder side and the decoder side. Thus, for example, an encoder may transmit (explicitly signal) a specific parameter to a decoder so that the decoder can use the same specific parameter. Conversely, if the decoder already has the specific parameter as well as other parameters, signaling may be used without transmission (implicit signaling) to allow only the decoder to know and select the specific parameter. Bit savings are achieved in various examples by avoiding the transmission of any actual functionality. It should be understood that signaling can be achieved in various ways. For example, in various examples, one or more syntax elements, flags, etc. are used to signal information to a corresponding decoder. Although the foregoing is about the verb form of the word "signal", the word "signal" may (for example also) be used as a noun in this article.

如所屬技術領域中具有通常知識者所將顯而易見的,實施方案可產生經格式化以運載可例如儲存或傳輸之資訊的各種信號。該資訊可包括例如用於執行方法的指令、或由所描述的實施方案的一者產生的資料。例如,可將信號格式化以運載所描述實例的位元流。此一信號可格式化成例如電磁波(例如,使用光譜的射頻部分)或基頻信號。格式化可包括例如編碼資料流及調變具有經編碼資料流的載波。該信號所運載的資訊可係例如類比或數位資訊。如已知的,該信號可透過各種不同的有線或無線鏈路傳輸。信號可儲存在處理器可讀媒體上,或可自其存取或接收。As will be apparent to one of ordinary skill in the art, embodiments may generate various signals formatted to carry information that may, for example, be stored or transmitted. The information may include, for example, instructions for executing a method, or data generated by one of the described embodiments. For example, a signal may be formatted to carry a bit stream of the described example. Such a signal may be formatted, for example, as an electromagnetic wave (e.g., using the radio frequency portion of the optical spectrum) or as a baseband signal. Formatting may include, for example, encoding a data stream and modulating a carrier with the encoded data stream. The information carried by the signal may be, for example, analog or digital information. As is known, the signal may be transmitted over a variety of different wired or wireless links. The signal may be stored on a processor-readable medium, or may be accessed or received therefrom.

許多實例於本文中描述。實例的特徵可單獨或採任何組合跨各種請求項類別及類型提供。進一步地,實例可包括單獨或採任何組合跨各種請求項類別及類型於本文中描述的特徵、裝置、或態樣的一或多者。例如,本文描述的特徵可實施在包括如本文所描述地產生之資訊的位元流或信號中。資訊可根據所描述之實施例之任一者允許解碼器解碼位元流、編碼器、位元流、及/或解碼器。例如,本文描述的特徵可藉由建立及/或傳輸及/或接收及/或解碼位元流或信號而實施。例如,本文描述的特徵可實施方法、程序、設備、儲存指令的媒體、儲存資料的媒體、或信號。例如,本文描述的特徵可藉由TV、機上盒、蜂巢式電話、平板電腦、或執行解碼的其他電子裝置實施。TV、機上盒、蜂巢式電話、平板電腦、或其他電子裝置可顯示(例如,使用監視器、螢幕、或其他類型的顯示器)所得影像(例如,來自視訊位元流之殘量重建的影像)。TV、機上盒、蜂巢式電話、平板電腦、或其他電子裝置可接收包括經編碼影像的信號並執行解碼。Many examples are described herein. Features of the examples may be provided individually or in any combination across various request item categories and types. Further, an example may include one or more of the features, devices, or aspects described herein, individually or in any combination across various request item categories and types. For example, the features described herein may be implemented in a bit stream or signal including information generated as described herein. The information may allow a decoder to decode a bit stream, an encoder, a bit stream, and/or a decoder according to any of the described embodiments. For example, the features described herein may be implemented by establishing and/or transmitting and/or receiving and/or decoding a bit stream or signal. For example, the features described herein may implement a method, a procedure, an apparatus, a medium for storing instructions, a medium for storing data, or a signal. For example, the features described herein may be implemented by a TV, set-top box, cellular phone, tablet computer, or other electronic device that performs decoding. The TV, set-top box, cellular phone, tablet computer, or other electronic device may display (e.g., using a monitor, screen, or other type of display) the resulting image (e.g., an image reconstructed from a residual image of a video bit stream). The TV, set-top box, cellular phone, tablet computer, or other electronic device may receive a signal including a coded image and perform decoding.

此等實例可藉由具有至少一個處理器的裝置執行。該裝置可係一編碼器或一解碼器。此等實例可藉由儲存在一非暫時性電腦可讀媒體上且包括程式碼指令的一電腦程式產品執行。此等實例可藉由包含程式碼指令的一電腦程式執行。此等實例可藉由包含表示編碼區塊之資訊的一位元流執行。These examples may be executed by a device having at least one processor. The device may be a codec or a decoder. These examples may be executed by a computer program product stored on a non-transitory computer-readable medium and including program code instructions. These examples may be executed by a computer program including program code instructions. These examples may be executed by a bit stream including information representing a coded block.

幀內樣本預測可包括基於一參考樣本集合而預測目標編碼單元(CU)之像素。預測模式可包括平面及DC預測模式,其等可用以預測平順且逐漸改變的區域。角度預測模式(例如,在順時針方向上從45度至-135度定義的角度)可用以擷取不同的方向性結構。對於方形區塊而言,可使用方向性預測模式(例如,針對方形區塊的33個方向性模式),其等可經編索引(例如,從2編索引至34)。預測模式可對應於如圖5A所繪示之不同預測方向。角度預測模式可對應於角度方向(例如,65個角度預測模式可對應於33個角度方向),且角度方向(例如,進一步32個角度方向)可對應於如圖5B所繪示之相鄰對之間的中間方向。Intra-frame sample prediction may include predicting pixels of a target coding unit (CU) based on a reference sample set. Prediction modes may include planar and DC prediction modes, which may be used to predict smoothly and gradually changing areas. Angular prediction modes (e.g., angles defined from 45 degrees to -135 degrees in a clockwise direction) may be used to capture different directional structures. For square blocks, directional prediction modes (e.g., 33 directional modes for square blocks) may be used, which may be indexed (e.g., indexed from 2 to 34). Prediction modes may correspond to different prediction directions as shown in FIG. 5A . Angular prediction modes may correspond to angular directions (e.g., 65 angular prediction modes may correspond to 33 angular directions), and angular directions (e.g., further 32 angular directions) may correspond to intermediate directions between adjacent pairs as shown in FIG. 5B .

圖5A繪示實例幀內預測方向。數字可表示與對應方向相關聯的預測模式索引。模式2至17可指示水平預測(H-26至H+32),且模式18至34可指示垂直預測(V-32至V+32)。圖5B繪示針對方形區塊(例如,針對方形區塊)的幀內預測。小於34的模式可指示水平預測。大於34的模式可指示垂直預測。圖5C繪示可用(例如,所有可用)幀內預測方向。虛線可指示寬角度幀內預測模式(wide angle intra prediction mode, WAIP)。圖5C所繪示之索引-1至-14可重新映射以從1進行至-12(例如,使得角度模式索引為連續的)。模式-15(例如,重新映射至-13)及81可能不存在於圖5C中,因為區塊大小(例如,不被允許的區塊大小)可能不使用模式-15(例如,重新映射至-13)及81。模式-15(例如,重新映射至-13)及81可藉由參考碼處理。FIG. 5A illustrates example intra-frame prediction directions. Numbers may represent prediction mode indices associated with the corresponding directions. Modes 2 to 17 may indicate horizontal prediction (H-26 to H+32), and modes 18 to 34 may indicate vertical prediction (V-32 to V+32). FIG. 5B illustrates intra-frame prediction for square blocks (e.g., for square blocks). Modes less than 34 may indicate horizontal prediction. Modes greater than 34 may indicate vertical prediction. FIG. 5C illustrates available (e.g., all available) intra-frame prediction directions. Dashed lines may indicate wide angle intra prediction mode (WAIP). The indices -1 to -14 illustrated in FIG. 5C may be remapped to proceed from 1 to -12 (e.g., so that the angle mode indices are continuous). Mode-15 (e.g., remapped to -13) and 81 may not exist in FIG. 5C because the block size (e.g., not allowed block size) may not use mode-15 (e.g., remapped to -13) and 81. Mode-15 (e.g., remapped to -13) and 81 may be handled by the reference code.

可執行基於模板的幀內模式導出(template-based intra mode derivation, TIMD)以導出編碼區塊之(多個)預測模式。經由TIMD的幀內預測模式導出可針對給定亮度而應用於編碼器及解碼器側上(例如,以相同方式),諸如,圖6(a)所示之CB 603。在亮度CB之最可能模式(most probable mode, MPM)清單中之(例如,各)幀內預測模式(例如,以預設模式輔助)可用以從模板(602)之經解碼參考樣本運算亮度CB之模板(600及601)的預測。可計算預測與亮度CB之模板之間的絕對變換誤差和(sum of absolute transformed difference, SATD)。具有最低(例如,最小)SATD的(多個)(例如,兩個)幀內預測模式可選擇為(多個)TIMD模式。該方向性幀內預測模式集合(例如,用於TIMD)可例如藉由在圖5B中之各實體箭頭及相鄰虛線箭頭之間***一方向而延伸(例如,從65個延伸至129個)。經由TIMD導出之可能的幀內預測模式集合可聚集模式(例如,131個模式)。可保留一或多個(例如,兩個)幀內預測模式而不進行涉及MPM清單之第一遍次的測試,可以預設模式輔助。對於非平面或DC的各經保留幀內預測模式,可測試(多個)(例如,兩個)最接近的經延伸方向性幀內預測模式。可計算使用(多個)最接近經延伸方向性幀內預測模式運算的預測與亮度CB之模板之間的(多個)SATD。具有最低(例如,最小)SATD的(多個)幀內預測模式可選擇為(多個)TIMD模式。Template-based intra mode derivation (TIMD) may be performed to derive prediction mode(s) for a coding block. Intra prediction mode derivation via TIMD may be applied on both the encoder and decoder side (e.g., in the same manner) for a given luma, e.g., CB 603 shown in FIG. 6( a ). (e.g., each) intra prediction mode in a most probable mode (MPM) list for luma CB (e.g., assisted by a default mode) may be used to compute a prediction of a template ( 600 and 601 ) of luma CB from decoded reference samples of the template ( 602 ). The sum of absolute transformed difference (SATD) between the prediction and the template of luma CB may be computed. (Multiple) (e.g., two) intra-frame prediction modes with the lowest (e.g., minimum) SATD may be selected as (multiple) TIMD modes. The directional intra-frame prediction mode set (e.g., for TIMD) may be extended (e.g., from 65 to 129), for example, by inserting a direction between each solid arrow and the adjacent dashed arrow in FIG. 5B . The possible intra-frame prediction mode set derived from TIMD may aggregate modes (e.g., 131 modes). One or more (e.g., two) intra-frame prediction modes may be retained without performing a first pass of testing involving the MPM list, and mode assistance may be preset. For each retained intra-frame prediction mode of a non-planar or DC, (multiple) (e.g., two) closest extended directional intra-frame prediction modes may be tested. The SATD(s) between the prediction calculated using the closest extended directional intra-frame prediction mode(s) and the template of the luminance CB may be calculated. The intra-frame prediction mode(s) with the lowest (e.g., minimum) SATD may be selected as the TIMD mode(s).

圖6繪示目前亮度CB之實例模板、及用於TIMD中之模板的實例經解碼參考樣本。在圖6(a)中,亮度CB之模板並未超出目前訊框之界限。目前 亮度CB 603可由其完全可用模板包圍,該等模板由在其左側600處的 部分、及在其上方601處的 部分組成。在TIMD導出步驟期間,經測試幀內預測模式可從模板之 經解碼參考樣本602之集合預測目前亮度CB之模板。若 ,則 可等於二;否則, 可等於四。若 ,則 可等於二;否則, 可等於四。 FIG6 shows an example template of the current luminance CB and an example decoded reference sample of the template used in TIMD. In FIG6(a), the template of the luminance CB does not exceed the boundary of the current frame. The brightness CB 603 can be surrounded by its fully available templates, which are composed of the part, and above it at 601 During the TIMD derivation step, the predicted model in the test frame can be obtained from the template The set of decoded reference samples 602 predicts the template of the current brightness CB. , then can be equal to two; otherwise, can be equal to four. , then can be equal to two; otherwise, It can be equal to four.

圖6(b)及圖6(c)顯示其中亮度CB之模板的至少一(例如,一個)部分超出目前訊框之界限的實例。在圖6(b)中,目前 亮度CB 603可由其模板包圍,其中在其上方之601處的其 部分係可用的。在TIMD導出步驟期間,經測試幀內預測模式可從模板之602處之 經解碼參考樣本之集合預測目前亮度CB之模板。在圖6(c)中,目前 亮度CB 603可由其模板包圍,其中僅在其左側之600處的其 部分係可用的。在TIMD導出步驟期間,經測試幀內預測模式許多從在模板之602處之 經解碼參考樣本之集合預測目前亮度CB之模板。 FIG6(b) and FIG6(c) show examples where at least one (eg, one) portion of the template of the brightness CB exceeds the limit of the current frame. Brightness CB 603 can be surrounded by its template, where its During the TIMD derivation step, the predicted model in the tested frame can be obtained from the template at 602. The set of decoded reference samples predicts the template of the current brightness CB. In Figure 6(c), the current Brightness CB 603 can be surrounded by its template, where only its left side at 600 During the TIMD derivation step, the predicted models in the tested frame are many from the template at 602. The set of decoded reference samples predicts the template of the current brightness CB.

目前亮度CB可經由TIMD預測,例如藉由融合基於從具有權重之數個遍次的測試(例如,兩個遍次)所導致之(例如,兩個)TIMD模式所運算之亮度CB的(例如,兩個)預測(例如,在應用定位相依預測組合(position dependent prediction combination, PDPC)之後)。所使用之權重可取決於(例如,兩個)TIMD模式的預測SATD。Currently the luminance CB may be predicted via TIMD, for example by fusing (e.g. two) predictions of the luminance CB computed based on (e.g. two) TIMD modes resulting from several passes of testing (e.g. two passes) with weights (e.g. after applying a position dependent prediction combination (PDPC)). The weights used may depend on the predicted SATD of the (e.g. two) TIMD modes.

可執行解碼器側幀內模式導出(decoder side intra mode derivation, DIMD)以導出編碼區塊之(多個)幀內預測模式。例如,兩個幀內模式可從經重建相鄰樣本導出。兩個預測器可用從梯度導出的權重來與平面模式預測器組合。權重導出中之除法運算可利用由交叉投訴線性模型(cross-complaint linear model, CCLM)使用之基於相同查找表(LUT)的整數化方案來執行。例如,在定向計算中的除法運算 Decoder side intra mode derivation (DIMD) can be performed to derive intra prediction mode(s) for a coding block. For example, two intra modes can be derived from reconstructed neighboring samples. The two predictors can be combined with a planar mode predictor using weights derived from the gradients. The division operations in the weight derivation can be performed using the same lookup table (LUT) based integerization scheme used by the cross-complaint linear model (CCLM). For example, the division operations in the directional calculations

可由以下基於LUT的方案運算: x = Floor(Log2(Gx)) normDiff = ((Gx<< 4) >> x) & 15 x +=(3 + (normDiff != 0) ? 1 : 0) Orient = (Gy* (DivSigTable[ normDiff ] | 8) + (1<<(x-1))) >> x, 其中 DivSigTable[16] = { 0, 7, 6, 5 ,5, 4, 4, 3, 3, 2, 2, 1, 1, 1, 1, 0 }. This can be calculated using the following LUT-based solution: x = Floor(Log2(Gx)) normDiff = ((Gx<< 4) >> x) & 15 x +=(3 + (normDiff != 0) ? 1 : 0) Orient = (Gy* (DivSigTable[ normDiff ] | 8) + (1<<(x-1))) >> x, where DivSigTable[16] = { 0, 7, 6, 5 ,5, 4, 4, 3, 3, 2, 2, 1, 1, 1, 1, 0 }.

經導出幀內模式可包括在幀內MPM清單的主清單中。可在建構MPM清單之前執行DIMD程序。DIMD區塊之主要經導出幀內模式可以區塊儲存,且可用於相鄰區塊的MPM清單建構。The derived in-frame pattern can be included in the master list of the in-frame MPM list. The DIMD process can be executed before the MPM list is constructed. The main derived in-frame pattern of the DIMD block can be stored in the block and can be used for the MPM list construction of the adjacent block.

圖7繪示用於DIMD色度模式的相鄰經重建樣本。DIMD色度模式可使用DIMD導出,以基於在第二相鄰列及行中之相鄰經重建Y、Cb、及Cr樣本而導出目前區塊的色度預測模式,如圖7所示。水平梯度及垂直梯度可針對目前色度區塊之共置經重建亮度樣本(例如,各共置經重建亮度樣本)、以及經重建Cb及Cr樣本計算,以建立經定向梯度之直方圖(HoG)。具有最大直方圖振幅值的幀內預測模式可用於執行目前色度區塊的色度幀內預測。FIG7 illustrates neighboring reconstructed samples for DIMD chroma mode. The DIMD chroma mode may be derived using DIMD to derive a chroma prediction mode for the current block based on neighboring reconstructed Y, Cb, and Cr samples in second neighboring columns and rows, as shown in FIG7 . Horizontal and vertical gradients may be calculated for co-located reconstructed luma samples (e.g., each co-located reconstructed luma sample) and reconstructed Cb and Cr samples of the current chroma block to create a histogram of oriented gradients (HoG). The intra prediction mode with the maximum histogram amplitude value may be used to perform chroma intra prediction for the current chroma block.

當從DIMD色度模式導出的幀內預測模式與從直接模式(DM)導出的幀內預測模式相同時,具有第二大直方圖振幅值的幀內預測模式可使用為DIMD色度模式。CU層級指示(例如,旗標)可經傳訊以指示是否應用DIMD色度模式。When the intra prediction mode derived from the DIMD chroma mode is the same as the intra prediction mode derived from the direct mode (DM), the intra prediction mode with the second largest histogram amplitude value may be used as the DIMD chroma mode. A CU level indication (eg, a flag) may be signaled to indicate whether the DIMD chroma mode is applied.

圖8繪示矩陣加權幀內預測(matrix weighted intra prediction, MIP)程序的實例。為了預測寬度W及高度H之矩形區塊的樣本,MIP可採用該區塊左側一排之H個經重建相鄰邊界樣本、及該區塊上方一排之W個經重建相鄰邊界樣本作為輸入。若經重建樣本不可用,則其等可與其他幀內預測實例(例如,習知幀內預測)中相同或類似的方式產生。預測信號的產生可基於至少以下三個步驟:取平均;矩陣向量乘法;及線性內插(例如,如圖8所示)。FIG8 illustrates an example of a matrix weighted intra prediction (MIP) procedure. To predict samples of a rectangular block of width W and height H, the MIP may take as input H reconstructed neighboring boundary samples in a row to the left of the block and W reconstructed neighboring boundary samples in a row above the block. If reconstructed samples are not available, they may be generated in the same or similar manner as in other intra prediction examples (e.g., learned intra prediction). The generation of the prediction signal may be based on at least the following three steps: averaging; matrix vector multiplication; and linear interpolation (e.g., as shown in FIG8 ).

可執行CCLM以預測編碼區塊。CCLM預測模式可用於視訊編碼,例如以減少交叉分量冗餘。例如藉由使用線性模型,可基於(例如,相同CU的)經重建亮度樣本來預測色度樣本。線性模型可例如根據Eq. 1重建: Eq. 1 CCLM can be performed to predict coded blocks. CCLM prediction mode can be used in video coding, for example to reduce cross-component redundancy. For example, by using a linear model, chrominance samples can be predicted based on reconstructed luma samples (e.g., of the same CU). The linear model can be reconstructed, for example, according to Eq. 1: Eq. 1

如Eq. 1中之實例所示, 可表示CU中之經預測色度樣本。如Eq. 1中之實例所示, 可表示(例如,相同)CU之經降取樣的經重建亮度樣本。 As shown in the example in Eq. 1, It can represent the predicted chrominance samples in the CU. As shown in the example in Eq. 1, may represent downsampled reconstructed luma samples of a (eg, the same) CU.

CCLM參數(例如,α及β)可例如基於/使用(例如,至多四個)相鄰色度樣本及對應的經降取樣亮度樣本而導出。為了描述實例,假設目前色度區塊尺寸係W×H。在一些實例中,W''及H'可根據以下邏輯設定: 例如,若/當應用LM模式時,則W' = W, H' = H; 例如,若/當應用LM-A模式時,則W' = W + H;及/或 例如,若/當應用LM-L模式時,則H' = H + W。 CCLM parameters (e.g., α and β) may be derived, for example, based on/using (e.g., up to four) adjacent chroma samples and corresponding downsampled luma samples. To describe an example, assume that the current chroma block size is W×H. In some examples, W'' and H' may be set according to the following logic: For example, if/when LM mode is applied, then W' = W, H' = H; For example, if/when LM-A mode is applied, then W' = W + H; and/or For example, if/when LM-L mode is applied, then H' = H + W.

在實例之進一步討論中,上方之相鄰定位可表示為S[ 0, -1 ] … S[ W' - 1, -1 ],且左側之相鄰定位可表示為S[ -1, 0 ] … S[ -1, H' - 1 ]。可選擇四個樣本(例如根據實例邏輯),如下: 例如,若/當應用LM模式且上方及左側相鄰樣本皆可用時,則S[W' / 4, -1 ], S[ 3 * W' / 4, -1 ], S[ -1, H' / 4 ], S[ -1, 3 * H' / 4 ]; 例如,若/當應用LM-A模式或僅上方之相鄰樣本可用時,則S[ W' / 8, -1 ], S[ 3 * W' / 8, -1 ], S[ 5 * W' / 8, -1 ], S[ 7 * W' / 8, -1 ];及/或 例如,若/當應用LM-L模式或僅左側之相鄰樣本可用時,則S[ -1, H' / 8 ], S[ -1, 3 * H' / 8 ], S[ -1, 5 * H' / 8 ], S[ -1, 7 * H' / 8 ]。 In further discussion of the example, the neighboring locations on the top can be represented as S[ 0, -1 ] … S[ W' - 1, -1 ], and the neighboring locations on the left can be represented as S[ -1, 0 ] … S[ -1, H' - 1 ]. Four samples can be selected (e.g., according to the example logic), as follows: For example, if/when the LM mode is applied and both upper and left neighboring samples are available, then S[W' / 4, -1], S[3 * W' / 4, -1], S[-1, H' / 4], S[-1, 3 * H' / 4]; For example, if/when the LM-A mode is applied or only upper neighboring samples are available, then S[W' / 8, -1], S[3 * W' / 8, -1], S[5 * W' / 8, -1], S[7 * W' / 8, -1]; and/or For example, if/when the LM-L mode is applied or only left neighboring samples are available, then S[-1, H' / 8], S[-1, 3 * H' / 8 ], S[ -1, 5 * H' / 8 ], S[ -1, 7 * H' / 8 ].

在實例中,在經選擇定位處的四個相鄰亮度樣本可經降取樣且比較(例如,四次),以找出(例如,兩個)較大值(例如,表示為 x 0 A x 1 A )及(例如,兩個)較小值(例如,表示為 x 0 B x 1 B )。對應的色度樣本值可表示為 y 0 A y 1 A y 0 B 、及 y 1 B 。在實例中, x A x B y A 、及 y B 可例如根據Eq. 2a至Eq. 2d導出: X a =( x 0 A + x 1 A +1)>>1                                             Eq. 2a X b =( x 0 B + x 1 B +1)>>1                                             Eq. 2b Y a =( y 0 A + y 1 A +1)>>1                                             Eq. 2c Y b =( y 0 B + y 1 B +1)>>1                                             Eq. 2d 線性模型參數α、及β可例如根據Eq. 3及Eq. 4判定: Eq. 3 Eq. 4 In an example, four adjacent luma samples at selected locations may be downsampled and compared (e.g., four times) to find the (e.g., two) larger values (e.g., denoted as x 0 A and x 1 A ) and the (e.g., two) smaller values (e.g., denoted as x 0 B and x 1 B ). The corresponding chroma sample values may be denoted as y 0 A , y 1 A , y 0 B , and y 1 B . In an example, x A , x B , y A , and y B can be derived, for example, according to Eq. 2a to Eq. 2d: X a =( x 0 A + x 1 A +1)>>1 Eq. 2a X b =( x 0 B + x 1 B +1)>>1 Eq. 2b Y a =( y 0 A + y 1 A +1)>>1 Eq. 2c Y b =( y 0 B + y 1 B +1)>>1 Eq. 2d The linear model parameters α and β can be determined, for example, according to Eq. 3 and Eq. 4: Eq. 3 Eq. 4

圖9繪示在CCLM模式中所涉及的之左側之樣本及上方之樣本及目前區塊之樣本之位置的實例。圖9顯示用於線性模型參數α與β之導出的樣本之位置的實例。Figure 9 shows an example of the positions of the samples on the left, the samples on the top, and the samples of the current block involved in the CCLM model. Figure 9 shows an example of the positions of the samples used for the derivation of the linear model parameters α and β.

CCLM可藉由加入三個多模型LM (multi-model LM, MMLM)模式來延伸。在各MMLM模式中,經重建相鄰樣本可使用臨限而分類成兩個類別。臨限可係亮度經重建相鄰樣本之平均。各類別之線性模型可使用最小均方(Least-Mean-Square, LMS)方法來導出。對於CCLM模式而言,LMS方法可用以導出線性模型。斜率調整可應用至CCLM及MMLM預測。該調整可涉及相對於藉由參考樣本之平均亮度值判定的中心點將線性函數傾斜(例如,其將亮度值映射至色度值)。CCLM can be extended by adding three multi-model LM (MMLM) modes. In each MMLM mode, the reconstructed neighboring samples can be classified into two categories using a threshold. The threshold can be the average of the reconstructed neighboring samples of brightness. The linear model of each category can be derived using the Least-Mean-Square (LMS) method. For the CCLM mode, the LMS method can be used to derive the linear model. Slope adjustment can be applied to CCLM and MMLM predictions. The adjustment may involve tilting the linear function relative to a center point determined by the average brightness value of the reference sample (e.g., it maps brightness values to chrominance values).

可實施CCLM斜率調整。CCLM可使用具有一或多個(例如,兩個)參數的模型,以將亮度值映射至色度值。斜率參數「a」及偏置(bias)參數「b」可例如根據Eq. 5而定義映射: chromaVal = a * lumaVal + b                                 Eq. 5 CCLM slope adjustment may be implemented. CCLM may use a model with one or more (e.g., two) parameters to map luma values to chroma values. Slope parameter "a" and bias parameter "b" may define the mapping, for example, according to Eq. 5: chromaVal = a * lumaVal + b                                     Eq. 5

對斜率參數的調整「u」可例如根據Eq. 6而經傳訊以更新模型: chromaVal = a' * lumaVal + b'                                Eq. 6 經更新斜率參數可例如根據Eq. 7a及Eq. 7b判定: a' = a + u                                                     Eq. 7a b' = b - u * y rEq. 7b The adjustment to the slope parameter "u" may be signaled to update the model, for example, according to Eq. 6: chromaVal = a' * lumaVal + b' Eq. 6 The updated slope parameter may be determined, for example, according to Eq. 7a and Eq. 7b: a' = a + u Eq. 7a b' = b - u * y r Eq. 7b

映射函數可例如基於選擇而圍繞具有亮度值y r的點傾斜或旋轉。在模型建立中使用之參考亮度樣本的平均可使用為y r,例如以提供對模型的(例如,有意義)修改。 The mapping function may, for example, be tilted or rotated around points with brightness value y r based on the selection. The average of the reference brightness samples used in model building may be used as y r , for example to provide a (eg, meaningful) modification of the model.

圖10A及圖10B繪示斜率調整參數「u」之效應的實例。圖10A顯示針對CCLM建立的模型,其不具有經更新斜率參數。圖10B顯示針對CCLM建立的模型,其具有經更新斜率參數。Figures 10A and 10B illustrate examples of the effect of the slope adjustment parameter "u". Figure 10A shows a model built for CCLM without an updated slope parameter. Figure 10B shows a model built for CCLM with an updated slope parameter.

本文提供與卷積交叉分量模式(convolutional cross component mode, CCCM)相關聯的(多個)特徵。待用於色度預測之經重建亮度樣本可經過濾。卷積7抽頭過濾器(7-tap filter)包括5抽頭(5-tap)加號(plus sign)形空間分量、非線性項、及偏置項,如圖11所示。過濾器之空間5抽頭分量的輸入可包括中心(C)亮度樣本(例如,其可與待預測之色度樣本共置)、及上方/北邊(N)、下方/南邊(S)、左側/西邊(W)、及右側/東邊(E)相鄰者,如圖所示。(multiple) features associated with a convolutional cross component mode (CCCM) are provided herein. Reconstructed luma samples to be used for chroma prediction may be filtered. The convolutional 7-tap filter includes a 5-tap plus sign spatial component, a nonlinear term, and a bias term, as shown in FIG. 11 . The input to the spatial 5-tap component of the filter may include a center (C) luma sample (e.g., which may be co-located with the chroma sample to be predicted), and the upper/north (N), lower/south (S), left/west (W), and right/east (E) neighbors, as shown.

非線性項P可表示中心亮度樣本C的平方,且經縮放至內容之樣本值範圍: P = (C*C + midVal) >> bitDepth                           Eq. 8 The nonlinear term P represents the square of the center brightness sample C, scaled to the sample value range of the content: P = (C*C + midVal) >> bitDepth                             Eq. 8

對於10位元內容而言,P可計算為: P = (C*C + 512) >> 10                                           Eq. 9 For 10-bit content, P can be calculated as: P = (C*C + 512) >> 10                                               Eq. 9

偏置項B可表示輸入與輸出之間的純量偏置(例如,類似於CCLM中的偏置項),且可設定成中間色度值(例如,針對10位元內容設定成512)。The bias term B may represent a scalar bias between input and output (e.g., similar to the bias term in CCLM) and may be set to an intermediate chrominance value (e.g., 512 for 10-bit content).

過濾器之輸出可計算為過濾器係數c i與輸入值之間的卷積,且縮減至有效色度樣本之範圍,如Eq. 10所示: predChromaVal = c 0C + c 1N + c 2S + c 3E + c 4W + c 5P + c 6B                                                                                           Eq. 10 The output of the filter can be calculated as the convolution between the filter coefficients ci and the input value, scaled down to the range of valid chrominance samples, as shown in Eq. 10: predChromaVal = c 0 C + c 1 N + c 2 S + c 3 E + c 4 W + c 5 P + c 6 B Eq. 10

幀內區塊複製(intra block copy, IBC)可改良螢幕內容材料的編碼效率。IBC模式可係區塊層級編碼模式。可在編碼器處執行區塊匹配(BM),以尋找針對CU(例如,各CU)的最佳區塊向量(或運動向量)。區塊向量可用以指示從目前區塊至參考區塊(例如,其已在目前圖像內部重建)的位移。經IBC編碼的CU之亮度區塊向量可呈整數精度。色度區塊向量可捨入至整數精度。當與AMVR組合時,IBC模式可在1個pel及4個pel運動向量精度之間切換。經IBC編碼的CU可視為(例如,除了幀內或幀間預測模式以外的)第三預測模式。IBC模式可適用於所具有的寬度及高度兩者皆小於或等於64個亮度樣本的CU。Intra block copy (IBC) can improve coding efficiency for screen content material. The IBC mode can be a block level coding mode. Block matching (BM) can be performed at the encoder to find the best block vector (or motion vector) for a CU (e.g., each CU). A block vector can be used to indicate the displacement from a current block to a reference block (e.g., which has been reconstructed inside the current image). The luma block vector of an IBC encoded CU can be in integer precision. The chroma block vector can be rounded to integer precision. When combined with AMVR, the IBC mode can be switched between 1 pel and 4 pel motion vector precision. An IBC encoded CU can be regarded as a third prediction mode (e.g., in addition to the intra or inter prediction mode). IBC mode is applicable to CUs whose width and height are both less than or equal to 64 luma samples.

IBC之參考區可經延伸(例如,延伸至上方兩個CTU列)。圖12繪示用於編碼一編碼樹單元(coding tree unit, CTU) (m,n)的參考區。圖12繪示當對CTU (m,n)編碼時之IBC的實例參考區。標示為「m,n」的區塊表示目前CTU;其他陰影區塊表示參考區;且白色區塊表示無效參考區。對於待編碼的CTU (m,n)而言,參考區可包括具有索引(m–2,n–2)…(W,n–2)、(0,n–1)…(W,n–1)、(0,n)…(m,n)的CTU,其中W表示在目前圖塊、切片、或圖像內的最大水平索引。當CTU大小係256時,參考區可限於上方一個CTU列。此可確保,在CTU大小為128或256的情況下,IBC不使用額外記憶體。每樣本區塊向量搜尋(有時稱為局域搜尋)範圍可水平地限於[–(C << 1), C >> 2]且垂直地限於[–C, C >> 2],以調適至參考區域延伸,其中C表示CTU大小。The reference region of the IBC may be extended (e.g., to the upper two CTU rows). FIG. 12 illustrates a reference region for encoding a coding tree unit (CTU) (m,n). FIG. 12 illustrates an example reference region of the IBC when encoding CTU (m,n). The block labeled “m,n” represents the current CTU; the other shaded blocks represent reference regions; and the white blocks represent invalid reference regions. For a CTU (m,n) to be encoded, the reference region may include CTUs with indices (m–2,n–2)…(W,n–2), (0,n–1)…(W,n–1), (0,n)…(m,n), where W represents the maximum horizontal index within the current tile, slice, or picture. When the CTU size is 256, the reference region may be limited to the upper one CTU row. This ensures that IBC uses no additional memory when the CTU size is 128 or 256. The per-sample block vector search (sometimes called local search) range can be limited horizontally to [–(C << 1), C >> 2] and vertically to [–C, C >> 2] to adapt to the reference region extension, where C denotes the CTU size.

本文提供幀內模板匹配預測(幀內TMP (intra template matching prediction))的實例。幀內TMP係可從目前訊框的經重建部分複製其L形模板匹配目前模板的最佳預測區塊的幀內預測模式。對於預定義搜尋範圍而言,編碼器可在目前訊框的經重建部分中搜尋目前模板的最類似模板。對於預定義搜尋範圍而言,解碼器可將對應區塊使用為預測區塊。編碼器可傳訊此模式的使用,且相同預測操作可在解碼器側執行。This document provides an example of intra template matching prediction (intra TMP). Intra TMP is an intra prediction mode that can copy its L-shaped template from the reconstructed part of the current frame to the best prediction block of the current template. For a predefined search range, the encoder can search for the most similar template of the current template in the reconstructed part of the current frame. For the predefined search range, the decoder can use the corresponding block as the prediction block. The encoder can signal the use of this mode, and the same prediction operation can be performed on the decoder side.

圖13繪示幀內模板匹配搜尋區的實例。預測信號可藉由使目前區塊的L形因果相鄰者與圖13中的預定義搜尋區中的另一區塊匹配而產生,其包括: R1:目前CTU R2:左上方CTU R3:上方CTU R4:左方CTU FIG13 shows an example of an intra-frame template matching search area. The predicted signal can be generated by matching the L-shaped causal neighbors of the current block with another block in the predefined search area in FIG13, which includes: R1: Current CTU R2: Upper left CTU R3: Upper CTU R4: Left CTU

絕對誤差和(sum of absolute differences, SAD)可使用為成本函數。在區域內(例如,在各區域內),解碼器可搜尋相對於目前區塊具有最少SAD的模板,且將其對應區塊使用為預測區塊。區域的尺寸(SearchRange_w, SearchRange_h)可設定成與區塊尺寸(BlkW, BlkH)成比例,以每像素具有固定數目的SAD比較。亦即: SearchRange_w = a * BlkW                               Eq. 11 SearchRange_h = a * BlkH                                 Eq. 12 其中「a」係控制增益/複雜度權衡的常數。例如,「a」可等於5。 The sum of absolute differences (SAD) can be used as a cost function. Within a region (e.g., within each region), the decoder can search for the template with the minimum SAD relative to the current block and use its corresponding block as the prediction block. The size of the region (SearchRange_w, SearchRange_h) can be set to be proportional to the block size (BlkW, BlkH) to compare with a fixed number of SADs per pixel. That is: SearchRange_w = a * BlkW                               Eq. 11 SearchRange_h = a * BlkH                                 Eq. 12 Where "a" is a constant that controls the gain/complexity tradeoff. For example, "a" can be equal to 5.

幀內模板匹配工具可經啟用用於具有小於或等於64之寬度及高度的大小之CU。幀內模板匹配的此最大CU大小可係可組態的。幀內模板匹配預測模式可透過專用旗標在CU層級傳訊。若DIMD未經啟用(例如,DIMD = 0),則幀內模板匹配預測模式可透過專用旗標在CU層級傳訊。雖然幀內模板匹配實例係於本文中描述,本文的實例亦可應用於幀間模板匹配。The intra-frame template matching tool can be enabled for CUs with a size of width and height less than or equal to 64. This maximum CU size for intra-frame template matching can be configurable. The intra-frame template matching prediction mode can be signaled at the CU level through a dedicated flag. If DIMD is not enabled (e.g., DIMD = 0), the intra-frame template matching prediction mode can be signaled at the CU level through a dedicated flag. Although intra-frame template matching examples are described in this article, the examples in this article can also be applied to inter-frame template matching.

可使用調色板模式(palette mode)來編碼/解碼編碼區塊。在一些實例中,調色板模式可用於支援4:4:4設定檔(亦即,4:4:4、4:2:0、4:2:2、及單色)之色度格式的螢幕內容編碼。若調色板模式經啟用,若CU大小小於或等於64×64,且CU中之樣本量大於16,則旗標可在CU層級傳輸,以指示是否使用調色模式。對小型CU應用調色板模式可能引入不顯著的編碼增益,且對小型區塊帶來額外複雜度。可針對小於或等於16個樣本的CU停用調色板模式。經調色板編碼的CU可視為預測模式(例如,與幀內預測、幀間預測、及IBC模式分開)。A palette mode may be used to encode/decode a coding block. In some examples, palette mode may be used for encoding screen content in a chroma format that supports a 4:4:4 profile (i.e., 4:4:4, 4:2:0, 4:2:2, and monochrome). If palette mode is enabled, if the CU size is less than or equal to 64×64, and the number of samples in the CU is greater than 16, a flag may be transmitted at the CU level to indicate whether the palette mode is used. Applying palette mode to small CUs may introduce insignificant coding gain and bring additional complexity to small blocks. Palette mode may be disabled for CUs less than or equal to 16 samples. A palette-coded CU may be considered a prediction mode (e.g., separate from intra-frame prediction, inter-frame prediction, and IBC mode).

圖14繪示調色板模式編碼的實例(例如,具有大小為四的調色板)。若利用調色板模式,則CU中之樣本值可由表示色值之一集合表示。該集合可稱為調色板。對於具有接近調色板色彩之樣本值的定位,可傳訊調色板索引。可指定在調色板外部的樣本(例如,藉由傳訊逸出符號)。對於在使用逸出符號編碼之CU內的樣本,其等分量值可使用經量化分量值傳訊(例如,直接傳訊)。經量化逸出符號可經二元化(例如,以五階指數哥倫布二元化程序(fifth order Exp-Golomb binarization process, EG5))。FIG. 14 illustrates an example of palette mode coding (e.g., with a palette of size four). If palette mode is utilized, sample values in a CU may be represented by a set representing color values. The set may be referred to as a palette. For positioning sample values having colors close to the palette, a palette index may be signaled. Samples outside the palette may be specified (e.g., by signaling escape symbols). For samples within a CU coded using escape symbols, their component values may be signaled using quantized component values (e.g., directly). The quantized escape symbols may be binarized (e.g., with a fifth order Exp-Golomb binarization process (EG5)).

組合幀內幀間預測(combined intra inter prediction, CIIP)模式可用以編碼區塊。在CIIP模式中,可藉由加權使用經CIIP模板匹配(CIIP-TM)合併候選者預測的幀間預測信號、及使用經TIMD導出之幀內預測模式預測的幀內預測信號,而產生預測樣本。可將CIIP模式應用(例如,僅應用)至具有小於或等於1024區的編碼區塊。Combined intra inter prediction (CIIP) mode may be used to encode blocks. In CIIP mode, prediction samples may be generated by weighting an intra prediction signal using a combination of candidate predictions using CIIP template matching (CIIP-TM) and an intra prediction signal predicted using an intra prediction mode derived from TIMD. CIIP mode may be applied (e.g., only) to encoding blocks having less than or equal to 1024 blocks.

TIMD導出方法可用以導出CIIP中之幀內預測模式。具體而言,TIMD模式清單中具有最小SATD值的幀內預測模式可經選擇,且映射至67個方向性幀內預測模式(例如,常規幀內預測模式)中之一者。The TIMD derivation method can be used to derive the intra-frame prediction mode in CIIP. Specifically, the intra-frame prediction mode with the smallest SATD value in the TIMD mode list can be selected and mapped to one of the 67 directional intra-frame prediction modes (e.g., conventional intra-frame prediction modes).

若經導出幀內預測模式係角度模式,則可修改兩個測試之權重(w Intra, w Inter)。對於近水平模式(例如,2 <= 角度模式索引 < 34)而言,目前區塊可垂直地劃分。對於近垂直模式(例如,34 <= 角度模式索引 <= 66)而言,目前區塊可水平地劃分。 If the derived intra prediction mode is an angular mode, the weights of the two tests (w Intra , w Inter ) can be modified. For nearly horizontal modes (e.g., 2 ≤ angular mode index < 34), the current block can be split vertically. For nearly vertical modes (e.g., 34 ≤ angular mode index <= 66), the current block can be split horizontally.

在一些實例中,幾何分割模式(geometric partitioning mode, GPM)可與幀間預測及幀內預測一起使用。在具有幀間預測及幀內預測的GPM中,最終預測樣本可藉由加權各GPM分離區域之經幀間預測的樣本及經幀內預測的樣本而產生。經幀間預測的樣本可藉由幀間GPM導出,而經幀內預測的樣本可藉由幀內預測模式(intra prediction mode, IPM)候選清單及/或從編碼器傳訊的索引而導出。IPM候選清單大小可預定義為三。可用的IPM候選者可係如圖15A至圖15C分別顯示之相對於GPM區塊邊界的平行角度模式(平行模式)、相對於GPM區塊邊界的垂直角度模式(垂直模式)、及平面模式。圖15D繪示具有幀內預測及幀內預測的GPM。具有幀內預測及幀內預測的GPM可能受限制(例如,以減少IPM之傳訊負擔(overhead)且/或避免硬體解碼器上之幀內預測電路的大小增加)。可在GPM混合區上引入直接運動向量及IPM儲存(例如,以進一步改良編碼效能)。In some examples, a geometric partitioning mode (GPM) can be used with inter-frame prediction and intra-frame prediction. In a GPM with inter-frame prediction and intra-frame prediction, the final prediction samples can be generated by weighting the inter-frame predicted samples and the intra-frame predicted samples of each GPM separated region. The inter-frame predicted samples can be derived by the inter-frame GPM, and the intra-frame predicted samples can be derived by the intra-frame prediction mode (IPM) candidate list and/or an index signaled from the encoder. The IPM candidate list size can be predefined as three. Available IPM candidates may be parallel angle modes (parallel modes), vertical angle modes (vertical modes), and planar modes relative to the GPM block boundaries as shown in FIGS. 15A to 15C , respectively. FIG. 15D illustrates a GPM with intra-frame prediction and intra-frame prediction. A GPM with intra-frame prediction and intra-frame prediction may be limited (e.g., to reduce the signaling overhead of the IPM and/or to avoid an increase in the size of the intra-frame prediction circuit on the hardware decoder). Direct motion vector and IPM storage may be introduced on the GPM mixed region (e.g., to further improve coding performance).

在DIMD及基於相鄰模式的IPM導出中,平行模式可經登記(例如,首先登記)。若相同的IPM候選者不在清單中,則最多可登記從DIMD方法及/或相鄰區塊導出的兩個IPM候選者。對於相鄰模式導出而言,可能存在可用相鄰區塊的五個定位(例如,至多)。定位可能受GPM區塊邊界的角度限制(例如,如圖16所示),其可用於具有模板匹配的GPM (GPM-TM)。在圖16中,A及L可分別表示預測區塊之上方及左側。In DIMD and neighbor-mode-based IPM derivation, parallel modes may be registered (e.g., registered first). If the same IPM candidate is not in the list, up to two IPM candidates derived from the DIMD method and/or neighbor blocks may be registered. For neighbor mode derivation, there may be five locations (e.g., at most) of available neighbor blocks. The location may be limited by the angle of the GPM block boundary (e.g., as shown in FIG. 16 ), which can be used for GPM with template matching (GPM-TM). In FIG. 16 , A and L may represent the top and left side of the prediction block, respectively.

在一些實例中,GPM幀內可與GPM與運動向量差合併(GPM with merge with motion vector difference, GPM-MMVD)組合。TIMD可用於GPM幀內之IPM候選者上(例如,以進一步改良編碼效能)。可首先登記平行模式。TIMD、DIMD、及相鄰區塊之IPM候選者可隨後登記。In some examples, GPM-MMVD can be combined with GPM with merge with motion vector difference (GPM-MMVD) within a GPM frame. TIMD can be used on IPM candidates within a GPM frame (e.g., to further improve coding performance). Parallel mode can be registered first. TIMD, DIMD, and IPM candidates of adjacent blocks can be registered subsequently.

可執行低頻非可分離轉換(low frequency non-separable transform, LFNST)。一正向LFNST可應用至一左上方之低頻區域,其可稱為關注區域(ROI)。若應用LFNST,則存在於ROI外部之區域中的主轉換係數可清零。A low frequency non-separable transform (LFNST) may be performed. A forward LFNST may be applied to an upper left low frequency region, which may be referred to as a region of interest (ROI). If LFNST is applied, the main transform coefficients in the region outside the ROI may be cleared.

圖17繪示LFNST16的ROI。LFNST16的ROI包括六個4×4個子區塊(例如,其等在掃描順序中可係連續的)。輸入樣本之數目可係96個。在此情況下,正向FLNST16之轉換矩陣可係Rx96。32個係數(兩個4×4個子區塊)可從正向LFNST16產生(例如,若R值經選擇為32)。係數可遵循係數掃描順序置放。FIG. 17 illustrates the ROI of LFNST16. The ROI of LFNST16 includes six 4×4 sub-blocks (e.g., which may be consecutive in the scanning order). The number of input samples may be 96. In this case, the transformation matrix of the forward FLNST16 may be Rx96. 32 coefficients (two 4×4 sub-blocks) may be generated from the forward LFNST16 (e.g., if the R value is selected as 32). The coefficients may be placed following the coefficient scanning order.

圖18繪示LFNST8的ROI。正向LFNST8矩陣可係Rx64。R之值可係32個。所產生的係數可以如同LFNST16相同的方式定位。圖19繪示從幀內預測模式至LFNST集合索引的實例映射。FIG18 shows the ROI for LFNST8. The forward LFNST8 matrix may be Rx64. The value of R may be 32. The resulting coefficients may be positioned in the same manner as for LFNST16. FIG19 shows an example mapping from intra-frame prediction mode to LFNST set index.

可使用多轉換選擇(multiple transform selection, MTS)。對於MTS、DST7、及DST8(例如,僅DST7及DCT8)而言,可利用轉換核心。DST7及DST8轉換核心可用於幀內編碼及幀間編碼。Multiple transform selection (MTS) may be used. For MTS, DST7, and DST8 (eg, only DST7 and DCT8), transform cores may be used. DST7 and DST8 transform cores may be used for intra-frame coding and inter-frame coding.

可採用其他主轉換(例如,包括DCT5、DST4、DST1)及/或恆等轉換(identity transform, IDT)。可使MTS集合取決於TU大小及/或幀內模式資訊。可考慮16個不同TU大小。對於各TU大小而言,可取決於幀內模式資訊考慮五個不同類別。對於各類別而言,可考慮一個、四個、或六個不同轉換對。幀內MTS候選者之數目可經調適地選擇(例如,在一個、四個、及六個MTS候選者之間選擇)。幀內MTS候選者之數目可取決於轉換係數之絕對值的總和。總和可與一或多個臨限(例如,兩個固定臨限)比較,以判定經允許MTS候選者的總數。例如: 1個候選者:sum <= th0                                         Eq. 13 4個候選者:th0 < sum <= th1                                Eq. 14 6個候選者:sum > th1                                            Eq. 15 Other main transforms (e.g., including DCT5, DST4, DST1) and/or identity transform (IDT) may be used. The MTS set may be made dependent on the TU size and/or intra-frame mode information. 16 different TU sizes may be considered. For each TU size, five different categories may be considered depending on the intra-frame mode information. For each category, one, four, or six different transform pairs may be considered. The number of intra-frame MTS candidates may be adaptively selected (e.g., between one, four, and six MTS candidates). The number of intra-frame MTS candidates may depend on the sum of the absolute values of the transform coefficients. The sum may be compared with one or more thresholds (e.g., two fixed thresholds) to determine the total number of allowed MTS candidates. For example: 1 candidate: sum <= th0                                             Eq. 13 4 candidates: th0 < sum <= th1                                    Eq. 14 6 candidates: sum > th1                                            Eq. 15

可執行幀內模式傳播。對於未以幀內預測編碼的CU,參考CU之幀內模式可視為與目前CU相同的幀內模式。當建構其他區塊之最可能模式(MPM)清單時,可使用此模式。MPM可使用一方法產生。在該方法中,MPM清單中的第一項可係平面模式。其餘的項可包括左側(L)、上方(A)、左下方(BL)、右上方(AR)、及左上方(AL)相鄰區塊(例如,如圖20所示)的幀內模式、具有從相鄰區塊之前兩個可用方向性模式加入之偏置的方向性模式、及/或預設模式。Intra-mode propagation may be performed. For CUs that are not coded with intra-prediction, the intra-mode of the reference CU may be considered to be the same intra-mode as the current CU. This mode may be used when constructing a most probable mode (MPM) list for other blocks. The MPM may be generated using a method. In the method, the first item in the MPM list may be a planar mode. The remaining items may include intra-modes of left (L), top (A), bottom left (BL), top right (AR), and top left (AL) neighboring blocks (e.g., as shown in FIG. 20 ), directional modes with biases added from the first two available directional modes of the neighboring blocks, and/or default modes.

若相鄰區塊中之任一者經幀間編碼,則區塊的幀內模式可從參考區塊獲得(或者,若其亦經幀間編碼則從其參考者獲得)。可產生針對定位之幀內模式的緩衝器(例如,具有最小CU大小(4×4)之解析度)。在編碼CU時,緩衝器可以幀內模式或參考幀內模式填入(例如,若經幀間編碼)。此程序可稱為幀內模式傳播。MIP、幀內TMP、及/或調色板模式可傳播為平面模式。具有幀內幀間模式的GPM模式可產生具有三個項的MPM(例如,類似於MPM清單產生)。If any of the neighboring blocks is inter coded, the intra mode of the block may be obtained from the reference block (or from its reference if it is also inter coded). A buffer for the localized intra mode may be generated (e.g., with a resolution of the smallest CU size (4×4)). When encoding a CU, the buffer may be filled with the intra mode or the reference intra mode (e.g., if inter coded). This process may be referred to as intra mode propagation. MIP, intra TMP, and/or palette mode may be propagated as planar mode. A GPM mode with intra and inter modes may generate an MPM with three entries (e.g., similar to MPM list generation).

幀內模式可提供關於目前區塊之統計的有用資訊。幀內模式可提供關於該區塊之方向性的資訊。此資訊可用以設計MTS及/或LFSNT中的轉換(例如,最佳轉換)。LFNST可係藉由根據其等幀內模式將殘餘信號分群而學習的轉換。幀內模式可用以建構MPM清單。幀內模式可用於GPM MPM。Intra-frame patterns can provide useful information about the statistics of the current block. Intra-frame patterns can provide information about the directionality of the block. This information can be used to design transformations in MTS and/or LFSNT (e.g., optimal transformations). LFNST can be a transformation that is learned by grouping residual signals according to their intra-frame patterns. Intra-frame patterns can be used to construct the MPM list. Intra-frame patterns can be used for GPM MPM.

在一些實例中,當以非方向性幀內預測模式(例如,幀間預測模式、IBC模式、幀內TMP模式、MIP、調色板模式、交叉分量預測模式等)編碼區塊時,可停用幀內模式相依工具。例如,LFNST可基於以非方向性幀內預測模式編碼的區塊而停用(例如,由於LFNST係方向性模式相依的)。若考慮平面模式,則MIP可與LFNST一起使用。在一些實例中,幀內相依工具可使用等效模式(equivalent mode)。等效模式(例如,使用DIMD程序)可用於LFNST核心選擇,其中提供編碼增益。In some examples, when a block is coded in a non-directional intra-frame prediction mode (e.g., inter-frame prediction mode, IBC mode, intra-frame TMP mode, MIP, palette mode, cross-component prediction mode, etc.), the intra-frame mode-dependent tools may be disabled. For example, LFNST may be disabled based on a block coded in a non-directional intra-frame prediction mode (e.g., because LFNST is directional mode-dependent). If a planar mode is considered, MIP may be used with LFNST. In some examples, the intra-frame dependent tools may use an equivalent mode. The equivalent mode (e.g., using a DIMD procedure) may be used for LFNST core selection, where coding gain is provided.

可針對採用非方向性幀內預測模式的區塊(例如,未採用常規幀內編碼的CU)導出一等效模式(equivalent mode)(例如,方向性幀內預測模式)。例如,可使用TIMD及/或DIMD程序來導出方向性幀內預測模式。等效模式可用以選擇MTS/LFSNT核心及/或幀內模式傳播程序。An equivalent mode (e.g., directional intra prediction mode) may be derived for blocks that use non-directional intra prediction mode (e.g., CUs that do not use conventional intra coding). For example, the directional intra prediction mode may be derived using TIMD and/or DIMD procedures. The equivalent mode may be used to select the MTS/LFSNT core and/or the intra mode propagation procedure.

在一些實例中,視訊解碼裝置可判定目前區塊以非方向性幀內預測模式編碼。可導出對應於非方向性幀內預測模式的方向性幀內預測模式(例如,其指示經導出幀內預測方向)。視訊解碼裝置可至少部分地基於經導出方向性幀內預測模式而解碼目前區塊。In some examples, the video decoding device may determine that the current block is encoded in a non-directional intra-frame prediction mode. A directional intra-frame prediction mode corresponding to the non-directional intra-frame prediction mode may be derived (e.g., indicating a derived intra-frame prediction direction). The video decoding device may decode the current block based at least in part on the derived directional intra-frame prediction mode.

目前區塊之預測區塊可使用非方向性幀內預測模式獲得。在一些實例中,對應於非方向性幀內預測模式的方向性幀內預測模式可基於預測區塊而導出。在一些實例中,可獲得預測區塊中之經重建樣本(例如,複數個經重建樣本)。方向性幀內預測模式可基於預測區塊中之經重建樣本及目前區塊之經重建相鄰樣本(例如,複數個經重建相鄰樣本)而導出。A prediction block for a current block may be obtained using a non-directional intra-frame prediction mode. In some instances, a directional intra-frame prediction mode corresponding to the non-directional intra-frame prediction mode may be derived based on the prediction block. In some instances, reconstructed samples (e.g., a plurality of reconstructed samples) in the prediction block may be obtained. The directional intra-frame prediction mode may be derived based on the reconstructed samples in the prediction block and reconstructed neighboring samples (e.g., a plurality of reconstructed neighboring samples) of the current block.

方向性幀內預測模式可基於與相鄰目前區塊之經重建像素相關聯的梯度直方圖而導出(例如,方向性幀內預測模式可藉由將DIMD程序應用至目前區塊之經重建模板(例如,模板、使用非方向性幀內預測模式獲得之目前區塊的預測區塊、或預測區塊內部的經重建模板)而導出)。例如,可獲得預測區塊中的複數個樣本。可判定預測區塊的方向性。A directional intra-frame prediction mode may be derived based on a gradient histogram associated with reconstructed pixels adjacent to the current block (e.g., the directional intra-frame prediction mode may be derived by applying a DIMD procedure to a reconstructed template of the current block (e.g., a template, a prediction block of the current block obtained using a non-directional intra-frame prediction mode, or a reconstructed template within the prediction block)). For example, a plurality of samples in the prediction block may be obtained. The directionality of the prediction block may be determined.

圖21繪示用於導出等效模式的程序。例如,DIMD程序可用以導出等效模式(例如,對應於非方向性幀內預測模式的方向性幀內預測模式)。可在MIP預測程序期間產生MIP的等效方向性幀內預測模式(例如,如圖21所繪示)。在一些實例中,DIMD可應用至目前區塊周圍的經重建模板。在一些實例中,DIMD程序可應用至預測區塊(例如,預測信號)。例如,DIMD程序可用以找出由MIP程序產生之預測區塊的方向性。例如,可基於預測區塊中的複數個樣本而判定預測區塊的方向性。該幀內預測模式可基於該預測區塊之經判定方向性而導出。Figure 21 illustrates a procedure for deriving an equivalent pattern. For example, the DIMD procedure can be used to derive an equivalent pattern (e.g., a directional intra-frame prediction pattern corresponding to a non-directional intra-frame prediction pattern). An equivalent directional intra-frame prediction pattern of a MIP can be generated during a MIP prediction procedure (e.g., as shown in Figure 21). In some examples, the DIMD can be applied to a reconstructed template around the current block. In some examples, the DIMD procedure can be applied to a prediction block (e.g., a prediction signal). For example, the DIMD procedure can be used to find the directionality of a prediction block generated by a MIP procedure. For example, the directionality of a prediction block can be determined based on a plurality of samples in the prediction block. The intra-frame prediction pattern can be derived based on the determined directionality of the prediction block.

圖22A繪示實例DIMD程序,其中使用在待編碼之目前區塊周圍的模板。圖22B繪示用於導出MIP等效模式的程序,其中模板係預測區塊之一部分(例如,在升取樣之前)。Figure 22A illustrates an example DIMD process where a template is used around the current block to be encoded. Figure 22B illustrates a process for deriving a MIP equivalent model where the template is a portion of the predicted block (e.g., before upsampling).

在一些實例中,DIMD程序可用以分析從幀間預測、IBC、CCLM/MMLM/CCCM、及/或幀內TMP產生的預測信號。在一些實例中,預測單元(例如,整個預測單元)可經分析以導出等效方向性幀內預測模式(例如,而非使用預測單元內部的模板)。在一些實例中,預設DIMD程序可使用為等效方向性幀內預測模式。此可用於調色板模式(例如,由於調色板模式可能不會產生預測信號)。In some examples, the DIMD routine can be used to analyze prediction signals generated from inter-frame prediction, IBC, CCLM/MMLM/CCCM, and/or intra-frame TMP. In some examples, a prediction unit (e.g., an entire prediction unit) can be analyzed to derive an equivalent directional intra-frame prediction mode (e.g., rather than using a template internal to the prediction unit). In some examples, the default DIMD routine can be used for an equivalent directional intra-frame prediction mode. This can be used for palette mode (e.g., since palette mode may not generate a prediction signal).

在一些實例中,方向性幀內預測模式可藉由以下導出:在相鄰目前區塊的經重建像素上測試複數個候選方向性幀內預測模式;及基於測試,從複數個候選方向性幀內預測模式選擇方向性幀內預測模式。例如,基於模板的幀內模式導出(TIMD)程序可應用至目前區塊之經重建模板、使用非方向性幀內預測模式獲得之目前區塊的預測區塊、或預測區塊內部的經重建模板中之至少一者。In some examples, the directional intra-frame prediction mode can be derived by: testing a plurality of candidate directional intra-frame prediction modes on reconstructed pixels adjacent to the current block; and selecting the directional intra-frame prediction mode from the plurality of candidate directional intra-frame prediction modes based on the testing. For example, a template-based intra-frame mode derivation (TIMD) procedure can be applied to at least one of a reconstructed template of the current block, a prediction block of the current block obtained using a non-directional intra-frame prediction mode, or a reconstructed template inside the prediction block.

例如,TIMD程序可用以導出等效方向性幀內預測模式(例如,對應於非方向性幀內預測模式的方向性幀內預測模式)。TIMD可以環繞目前區塊的模板來應用(例如,以與對於DIMD相同或類似的方式)。例如,TIMD可使用預測區塊內部的模板,以環繞目前區塊的模板來應用。例如,TIMD可使用整個預測區塊,以環繞目前區塊的模板來應用。For example, the TIMD procedure can be used to derive an equivalent directional intra-frame prediction pattern (e.g., a directional intra-frame prediction pattern corresponding to a non-directional intra-frame prediction pattern). TIMD can be applied with a template around the current block (e.g., in the same or similar manner as for DIMD). For example, TIMD can be applied with a template around the current block using a template inside the prediction block. For example, TIMD can be applied with a template around the current block using the entire prediction block.

例如,目前區塊之預測區塊可使用非方向性幀內預測模式獲得。在一些實例中,可獲得預測區塊中之經重建樣本(例如,複數個經重建樣本)。在一些實例中,可獲得可能預測模式(例如,複數個可能預測模式)。可運算在預測區塊中之經重建樣本的預測(例如,複數個預測)。例如,可基於可能預測模式而運算預測區塊中之經重建樣本的預測。可運算預測誤差(例如,複數個預測誤差)。例如,預測誤差可基於預測區塊中之經重建樣本及對應預測而運算。預測誤差可對應於可能預測模式。方向性幀內預測模式可基於預測誤差而選擇(例如,從可能預測模式選擇)。在一些實例中,方向性幀內預測模式可基於對應於方向性幀內預測模式的預測誤差在預測誤差中係最小的之判定而選擇。For example, a prediction block for a current block may be obtained using a non-directional intra-frame prediction mode. In some instances, reconstructed samples (e.g., a plurality of reconstructed samples) in a prediction block may be obtained. In some instances, possible prediction modes (e.g., a plurality of possible prediction modes) may be obtained. Predictions of reconstructed samples in a prediction block may be calculated (e.g., a plurality of predictions). For example, predictions of reconstructed samples in a prediction block may be calculated based on possible prediction modes. Prediction errors (e.g., a plurality of prediction errors) may be calculated. For example, prediction errors may be calculated based on reconstructed samples in a prediction block and corresponding predictions. The prediction errors may correspond to possible prediction modes. A directional intra-frame prediction mode may be selected based on the prediction errors (e.g., selected from possible prediction modes). In some examples, the directional intra-frame prediction mode may be selected based on a determination that the prediction error corresponding to the directional intra-frame prediction mode is the smallest among the prediction errors.

在一些實例中,平面或DC模式可使用為等效方向性幀內預測模式。例如,MIP及幀內TMP可視為在LFNST核心選擇中的平面模式。在一些實例中,LFNST可針對(多個)方向性幀間預測模式及IBC模式啟用。In some examples, planar or DC modes can be used as equivalent directional intra-frame prediction modes. For example, MIP and intra-frame TMP can be considered as planar modes in LFNST core selection. In some examples, LFNST can be enabled for (multiple) directional inter-frame prediction modes and IBC mode.

在一些實例中,基於歷史的幀內預測模式(history-based intra prediction mode, HIPM)可使用為等效方向性幀內預測模式。基於歷史的幀內預測模式可使用為採用非方向性幀內預測模式之CU(例如,未採用常規幀內編碼的CU)的等效方向性幀內預測模式。在實例中,導出程序可類似於基於歷史的MVP (HMVP)合併候選者。(例如,先前經常規幀內編碼區塊之)經導出方向性幀內預測模式可儲存在表格中。經導出方向性幀內預測模式可用以產生相鄰預測區塊的MPM清單。具有多個HIPM候選者的表格可使用為目前CU的等效方向性幀內預測模式。可在編碼及/或解碼程序期間維持具有多個HIPM候選者的表格。當遇到新的CTU列時,可重設(例如,清空)表格。若存在以方向性幀內預測模式編碼的CU(例如,經常規幀內編碼的CU),相關聯的方向性幀內預測模式可加入至表格之最後項(例如,作為新的HIPM候選者)。In some examples, a history-based intra prediction mode (HIPM) can be used as an equivalent directional intra prediction mode. The history-based intra prediction mode can be used as an equivalent directional intra prediction mode for a CU that adopts a non-directional intra prediction mode (e.g., a CU that does not adopt conventional intra coding). In an example, the derivation process can be similar to the history-based MVP (HMVP) merging candidates. The derived directional intra prediction mode (e.g., of a previously conventional intra coded block) can be stored in a table. The derived directional intra prediction mode can be used to generate an MPM list of adjacent prediction blocks. A table with multiple HIPM candidates can be used as the equivalent directional intra prediction mode for the current CU. A table with multiple HIPM candidates may be maintained during the encoding and/or decoding process. When a new CTU row is encountered, the table may be reset (e.g., cleared). If there are CUs coded with directional intra prediction mode (e.g., CUs coded with regular intra), the associated directional intra prediction mode may be added to the last entry of the table (e.g., as a new HIPM candidate).

HIPM表大小S可設定成值M(例如,指示至多M-1個HIPM候選者可加入至表格)。當將新的方向性幀內預測模式候選者***至表格時可考慮兩個選項。例如,在第一選項中,新的HIPM可移動至表格之最後項。在此實例中,後方的HIPM候選者(例如,後方的所有HIPM候選者)可向前移動。在此實例中,表格之最後項中的HIPM候選者可視為「最近/最接近」,且可使用為等效方向性幀內預測模式。The HIPM table size S may be set to a value of M (e.g., indicating that at most M-1 HIPM candidates may be added to the table). Two options may be considered when inserting a new directional intra-frame prediction mode candidate into the table. For example, in a first option, the new HIPM may be moved to the last entry of the table. In this example, the following HIPM candidates (e.g., all the following HIPM candidates) may be moved forward. In this example, the HIPM candidate in the last entry of the table may be considered the "nearest/closest" and may be used as an equivalent directional intra-frame prediction mode.

例如,在第二選項中,可計數表格中現有HIPM的出現。可判定相同HIPM是否存在於表格中。若經發現,則可增加相同HIPM的計數。在此情況下,目前HIPM表格可經重新排序。例如,若HIPM候選者出現計數高於目前HIPM表格之最後項,則HIPM候選者可移動至表格之最後項。在此情況下,表格之最後項中的HIPM候選者可使用為等效方向性幀內預測模式(例如,由於其頻繁地使用)。For example, in the second option, the occurrences of existing HIPMs in the table may be counted. It may be determined whether the same HIPM exists in the table. If found, the count of the same HIPM may be increased. In this case, the current HIPM table may be reordered. For example, if the HIPM candidate has a higher occurrence count than the last entry of the current HIPM table, the HIPM candidate may be moved to the last entry of the table. In this case, the HIPM candidate in the last entry of the table may be used as an equivalent directional intra-frame prediction mode (e.g., due to its frequent use).

LFNST可基於等效方向性幀內預測模式而執行。例如,可基於經導出方向性幀內預測模式而判定/選擇LFNST轉換集合。等效方向性幀內預測模式可如本文所述導出。目前區塊可基於LFNST轉換集合而編碼及/或解碼。例如,可基於LFNST轉換集合而對目前區塊之殘量執行轉換或逆轉換。LFNST may be performed based on an equivalent directional intra-frame prediction mode. For example, a LFNST transform set may be determined/selected based on a derived directional intra-frame prediction mode. The equivalent directional intra-frame prediction mode may be derived as described herein. The current block may be encoded and/or decoded based on the LFNST transform set. For example, a transform or inverse transform may be performed on the residual of the current block based on the LFNST transform set.

可啟用經幀間編碼之CU的LFNST、及IBC模式。等效方向性幀內預測模式導出可用於LFNST核心選擇。可啟用交叉分量預測/幀內TMP的LFNST(例如,以LFNST核心選擇的等效模式導出,而非假設以平面模式)。LFNST for inter-coded CUs, and IBC mode may be enabled. Equivalent directional intra prediction mode derivation may be used for LFNST core selection. LFNST for cross-component prediction/intra-TMP may be enabled (e.g., derived with equivalent mode for LFNST core selection, rather than assuming planar mode).

在實例中,MTS可使用等效方向性幀內預測模式來執行。例如,可基於經導出方向性幀內預測模式而判定MTS轉換集合。目前區塊可基於MTS轉換集合而編碼及/或解碼。例如,可基於MTS轉換集合而對目前區塊之殘量執行轉換或逆轉換。可啟用MTS IBC及幀內TMP模式(例如,以LFNST核心選擇的等效模式導出)。在一些實例中,可啟用色度部分的MTS(例如,以LFNST核心選擇的具有等效模式導出之交叉分量預測,而非假設以平面模式)。MTS核心選擇可用於幀間CU(例如,以核心選擇的等效方向性幀內預測模式導出)。In an example, MTS may be performed using an equivalent directional intra-frame prediction mode. For example, an MTS transform set may be determined based on a derived directional intra-frame prediction mode. The current block may be encoded and/or decoded based on the MTS transform set. For example, a transform or inverse transform may be performed on the residue of the current block based on the MTS transform set. MTS IBC and intra-frame TMP modes may be enabled (e.g., derived with an equivalent mode selected with LFNST core). In some examples, MTS may be enabled for the chroma portion (e.g., with cross-component prediction derived with an equivalent mode selected with LFNST core, rather than assuming a planar mode). MTS core selection may be used for inter-frame CUs (e.g., derived with an equivalent directional intra-frame prediction mode selected with core).

在一些實例中(例如,對於幀間CU),MTS索引可獨立於方向性幀內預測模式而編碼。在一些實例中,可(預)定義將MTS索引映射至核心的表格。In some examples (eg, for inter-CUs), the MTS index may be coded independently of the directional intra prediction mode. In some examples, a table mapping the MTS index to the kernel may be (pre)defined.

可提供TU分隔之特定考量。在一些實例中,可允許TU分隔。CU可分隔成多個TU。例如,CU可使用殘量四叉樹(residual quad tree, RQT)分隔成多個TU。在一些實例中可移除RQT。Specific considerations for TU partitioning may be provided. In some examples, TU partitioning may be allowed. A CU may be partitioned into multiple TUs. For example, a CU may be partitioned into multiple TUs using a residual quad tree (RQT). In some examples, the RQT may be removed.

子區塊轉換(subblock transform, SBT)可類似於RQT。SBT可用於經幀間編碼的CU上。使用SBT,CU可分隔成兩個部分(例如,如圖23所繪示)。該等部分中之一者可清零。其他部分可使用(預)定義的轉換集合轉換。Subblock transform (SBT) can be similar to RQT. SBT can be used on inter-frame coded CUs. Using SBT, the CU can be separated into two parts (e.g., as shown in Figure 23). One of the parts can be cleared. The other part can be transformed using a (pre)defined transform set.

在TU小於CU(例如,如在SBT中)的情況下,等效方向性幀內預測模式導出可在每個TU上進行。此可得出N個子分割的N個等效模式。此可允許MTS/LFNST核心的適當選擇,且/或可提供等效方向性幀內預測模式的更佳傳播。特別在SBT中,由於(例如,一個)分割區經清零,可能無法判定彼分割的等效方向性幀內預測模式。In the case where a TU is smaller than a CU (e.g., as in SBT), equivalent directional intra-frame prediction mode derivation can be performed on each TU. This may result in N equivalent modes for N sub-partitions. This may allow appropriate selection of the MTS/LFNST core and/or may provide better propagation of equivalent directional intra-frame prediction modes. In particular in SBT, due to (e.g., one) partition being cleared, it may not be possible to determine the equivalent directional intra-frame prediction mode for that partition.

在一些實例中,可傳播等效方向性幀內預測模式。當使用幀內模式傳播時,可導出等效方向性幀內預測模式(例如,如本文所述)。例如,若使用非方向性幀內預測模式(例如,IBC、幀間、交叉分量預測、幀內TMP、調色板模式),等效方向性幀內預測模式可用以填充幀內模式緩衝器。In some examples, equivalent directional intra-frame prediction modes may be propagated. When intra-frame mode propagation is used, equivalent directional intra-frame prediction modes may be derived (e.g., as described herein). For example, if non-directional intra-frame prediction modes (e.g., IBC, inter-frame, cross-component prediction, intra-frame TMP, palette mode) are used, equivalent directional intra-frame prediction modes may be used to fill an intra-frame mode buffer.

可提供CIIP及/或GPM的特定考量。例如,當使用CIIP時,CIIP可用以導出一幀內部分的方向性幀內預測模式。例如,當使用GPM幀內幀間時,可導出方向性幀內預測模式。等效方向性幀內預測模式可能不會針對CIIP及/或GPM模式而導出。CIIP及/或GPM模式之幀內部分的幀內模式可用於LFNST/MTS核心選擇及幀內模式傳播。Specific considerations for CIIP and/or GPM may be provided. For example, when CIIP is used, CIIP may be used to derive a directional intra-frame prediction pattern for an intra-frame portion. For example, when GPM intra-frame-to-frame is used, a directional intra-frame prediction pattern may be derived. Equivalent directional intra-frame prediction patterns may not be derived for CIIP and/or GPM patterns. Intra-frame patterns for intra-frame portions of CIIP and/or GPM patterns may be used for LFNST/MTS core selection and intra-frame pattern propagation.

視訊編碼裝置(例如,編碼器)可如上文所述者般執行相同或類似的動作。例如,編碼器可識別用於編碼目前區塊的非方向性幀內預測模式。編碼器可導出對應於非方向性幀內預測模式的方向性幀內預測模式(例如,其包含經導出幀內預測方向)。編碼器可至少部分地基於經導出方向性幀內預測模式而編碼目前區塊。A video encoding device (e.g., an encoder) may perform the same or similar actions as described above. For example, the encoder may identify a non-directional intra-frame prediction mode used to encode a current block. The encoder may derive a directional intra-frame prediction mode corresponding to the non-directional intra-frame prediction mode (e.g., which includes a derived intra-frame prediction direction). The encoder may encode the current block at least in part based on the derived directional intra-frame prediction mode.

圖24繪示用於解碼目前區塊的實例流程圖2400。在2410處,可判定目前區塊係以非方向性幀內預測模式編碼。在2420處,可導出對應於該非方向性幀內預測模式的方向性幀內預測模式。在2430處,目前區塊可至少部分地基於經導出之該方向性幀內預測模式而解碼。FIG. 24 illustrates an example flow chart 2400 for decoding a current block. At 2410, it may be determined that the current block is encoded in a non-directional intra prediction mode. At 2420, a directional intra prediction mode corresponding to the non-directional intra prediction mode may be derived. At 2430, the current block may be decoded based at least in part on the derived directional intra prediction mode.

圖25繪示用於編碼目前區塊的實例流程圖2500。在2510處,可識別用於編碼目前區塊的非方向性幀內預測模式。在2520處,可導出對應於該非方向性幀內預測模式的方向性幀內預測模式。在2530處,目前區塊可至少部分地基於經導出之該方向性幀內預測模式而編碼。FIG. 25 illustrates an example flow chart 2500 for encoding a current block. At 2510, a non-directional intra prediction mode for encoding the current block may be identified. At 2520, a directional intra prediction mode corresponding to the non-directional intra prediction mode may be derived. At 2530, the current block may be encoded based at least in part on the derived directional intra prediction mode.

雖然於上文描述採特定組合的特徵及元件,所屬技術領域中具有通常知識者將理解各特徵或元件可單獨使用或與其他特徵及元件組合使用。額外地,本文描述的方法可以併入電腦可讀取媒體中以用於由電腦或處理器執行的電腦程式、軟體、或韌體實施。電腦可讀媒體的實例包括電子信號(透過有線或無線連接傳輸)及電腦可讀儲存媒體。電腦可讀儲存媒體的實例包括但不限於唯讀記憶體(ROM)、隨機存取記憶體(RAM)、暫存器、快取記憶體、半導體記憶體裝置、磁性媒體(諸如內接硬碟及可移除式磁碟)、磁光媒體、及光學媒體(諸如,CD-RAM光碟、及數位多功能光碟(digital versatile disk, DVD))。與軟體相關聯的處理器可用以實施用於在WTRU、UE、終端機、基地台、RNC、或任何主機電腦中使用的射頻收發器。Although the above description uses a specific combination of features and elements, it will be understood by those skilled in the art that each feature or element can be used alone or in combination with other features and elements. In addition, the methods described herein can be incorporated into a computer-readable medium for use in a computer program, software, or firmware implementation executed by a computer or processor. Examples of computer-readable media include electronic signals (transmitted via wired or wireless connections) and computer-readable storage media. Examples of computer readable storage media include, but are not limited to, read-only memory (ROM), random access memory (RAM), temporary storage, cache memory, semiconductor memory devices, magnetic media (such as internal hard disks and removable disks), magneto-optical media, and optical media (such as CD-RAM discs and digital versatile disks (DVDs)). The processor associated with the software may be used to implement a radio frequency transceiver for use in a WTRU, UE, terminal, base station, RNC, or any host computer.

100:通訊系統 102:無線傳輸/接收單元(WTRU) 102a:無線傳輸/接收單元 102b:無線傳輸/接收單元 102c:無線傳輸/接收單元 102d:無線傳輸/接收單元 104:RAN 106:CN 108:公共交換電話網路(PSTN) 110:網際網路 112:其他網路 113:RAN 114a:基地台 114b:基地台 115:CN;空中介面 116:空中介面 117:空中介面 118:處理器 120:收發器 122:傳輸/接收元件 124:揚聲器/麥克風 126:小鍵盤 128:顯示器/觸控板 130:非可移除式記憶體 132:可移除式記憶體 134:電源 136:全球定位系統晶片組 138:其他週邊設備 160a:e節點B 160b:e節點B 160c:e節點B 162:行動管理實體162 164:服務閘道164 166:封包資料網路閘道 180a:gNB 180b:gNB 180c:gNB 182a:AMF 182b:AMF 183a:對話管理功能 183b:對話管理功能 184a:UPF 184b:UPF 185a:資料網路 185b:資料網路 200:編碼器 201:預編碼處理 202:分割 205:決定 210:減去 225:轉換 230:量化 240:解量化 245:熵編碼 250:逆轉換 255:組合 260:幀內預測 265:迴路內濾波器 270:補償 275:運動評估 280:參考圖像緩衝器 300:解碼器 330:熵解碼 335:劃分 340:解量化 350:逆轉換 355:組合 360:幀內預測 365:迴路內濾波器 370:獲得 375:運動補償預測 380:參考圖像緩衝器 385:後解碼處理 400:系統 410:處理器 420:記憶體 425:連接配置 430:編碼器/解碼器模組 440:儲存裝置 445:方塊 450:通訊介面 460:通訊通道 470:介面 475:顯示器 480:介面 485:揚聲器 490:介面 495:其他週邊裝置 600:模板 601:模板 602:模板 603:CB 2400:流程圖 2410, 2420, 2430:步驟 2500:流程圖 2510, 2520, 2530:步驟 A:上方 AL:左上方 AR:右上方 BL:左下方 C:中心 E:右側/東邊 L:左側 N:上方/北邊 N2:介面 N3:介面 N4:介面 N6:介面 N11:介面 R1:目前CTU R2:左上方CTU R3:上方CTU R4:左方CTU S:下方/南邊 S1:介面 W:左側/西邊 X2:介面 Xn:介面 100: Communication system 102: Wireless transmission/reception unit (WTRU) 102a: Wireless transmission/reception unit 102b: Wireless transmission/reception unit 102c: Wireless transmission/reception unit 102d: Wireless transmission/reception unit 104: RAN 106: CN 108: Public switched telephone network (PSTN) 110: Internet 112: Other networks 113: RAN 114a: Base station 114b: Base station 115: CN; air interface 116: air interface 117: air interface 118: Processor 120: Transceiver 122: Transmission/reception element 124: Speaker/microphone 126: Keypad 128: Display/Touchpad 130: Non-removable memory 132: Removable memory 134: Power supply 136: GPS chipset 138: Other peripherals 160a: eNodeB 160b: eNodeB 160c: eNodeB 162: Mobile management entity 162 164: Service gateway 164 166: Packet data network gateway 180a: gNB 180b: gNB 180c: gNB 182a: AMF 182b: AMF 183a: Session management function 183b: Session management function 184a: UPF 184b: UPF 185a: Data network 185b: Data network 200: Encoder 201: Precoding 202: Segmentation 205: Decision 210: Subtraction 225: Transformation 230: Quantization 240: Dequantization 245: Entropy coding 250: Inverse transformation 255: Combination 260: Intra-frame prediction 265: In-loop filter 270: Compensation 275: Motion estimation 280: Reference picture buffer 300: Decoder 330: Entropy decoding 335: Segmentation 340: Dequantization 350: Inverse transformation 355: Combination 360: In-frame prediction 365: In-loop filter 370: Acquisition 375: Motion compensation prediction 380: Reference image buffer 385: Post-decoding processing 400: System 410: Processor 420: Memory 425: Connection configuration 430: Encoder/decoder module 440: Storage device 445: Block 450: Communication interface 460: Communication channel 470: Interface 475: Display 480: Interface 485: Speaker 490: Interface 495: Other peripherals 600: Template 601: Template 602: Template 603: CB 2400: Flowchart 2410, 2420, 2430: Steps 2500: Flowchart 2510, 2520, 2530: Steps A: Top AL: Top Left AR: Top Right BL: Bottom Left C: Center E: Right/East L: Left N: Top/North N2: Interface N3: Interface N4: Interface N6: Interface N11: Interface R1: Current CTU R2: Top Left CTU R3: Top CTU R4: Left CTU S: Bottom/South S1: Interface W: Left/West X2: Interface Xn: Interface

此外,圖式中的相似元件符號指示相似元件,且其中: [圖1A]係繪示一或多個經揭示實施例可實施於其中之實例通訊系統的系統圖。 [圖1B]係繪示根據一實施例之可使用在繪示於圖1A中的通訊系統內的實例無線傳輸/接收單元(wireless transmit/receive unit, WTRU)的系統圖。 [圖1C]係繪示根據一實施例之可使用在繪示於圖1A中的通訊系統內的實例無線電存取網路(radio access network, RAN)及實例核心網路(core network, CN)的系統圖。 [圖1D]係繪示根據一實施例之可使用在繪示於圖1A中的通訊系統內的進一步實例RAN及進一步實例CN的系統圖。 [圖2]繪示實例視訊編碼器。 [圖3]繪示實例視訊解碼器。 [圖4]繪示各種態樣及實例可實施於其中之系統的實例。 [圖5A]至[圖5C]顯示實例預測模式及預測方向。 [圖6]顯示目前亮度之模板的實例、及該模板之經解碼參考樣本。 [圖7]顯示用於例如解碼器側幀內模式導出(decoder-side intra mode derivation, DIMD)色度模式的相鄰經重建樣本。 [圖8]繪示矩陣加權幀內預測(matrix weighted intra prediction, MIP)程序的實例。 [圖9]繪示用於交叉分量線性模型(cross-component linear model, CCLM)模式中之樣本的實例位置。 [圖10A]及[圖10B]繪示斜率調整參數之實例效應。 [圖11]繪示卷積過濾器之空間部分。 [圖12]繪示當對編碼樹單元(coding tree unit, CTU)編碼時之幀內區塊複製(intra block copy, IBC)的實例參考區。 [圖13]繪示實例幀內模板匹配搜尋區。 [圖14]繪示以調色板模式編碼之區塊的實例。 [圖15A]至[圖15D]繪示具有幀間預測及幀內預測的實例幾何分割模式(geometric partitioning mode, GPM)。 [圖16]係基於GPM區塊邊界之角度的幀內預測模式(intra prediction mode, IPM)候選導出之可用相鄰區塊的定位的表格。 [圖17]繪示實例關注區域(region of interest, ROI)。 [圖18]繪示實例ROI。 [圖19]繪示幀內預測模式至低頻非可分離轉換(low frequency non-separable transform, LFNST)集合索引的實例映射。 [圖20]繪示用以導出大致最可能模式(most probably mode, MPM)清單的實例相鄰區塊。 [圖21]繪示導出等效模式(equivalent mode)的實例。 [圖22A]繪示實例DIMD程序。 [圖22B]繪示MIP等效模式導出。 [圖23]繪示實例編碼區塊分隔分割。 [圖24]繪示用於解碼目前區塊的實例流程圖。 [圖25]繪示及用於編碼目前區塊的實例流程圖。 In addition, like element symbols in the drawings indicate like elements, and wherein: [ FIG. 1A ] is a system diagram illustrating an example communication system in which one or more disclosed embodiments may be implemented. [ FIG. 1B ] is a system diagram illustrating an example wireless transmit/receive unit (WTRU) that may be used in the communication system illustrated in FIG. 1A according to an embodiment. [ FIG. 1C ] is a system diagram illustrating an example radio access network (RAN) and an example core network (CN) that may be used in the communication system illustrated in FIG. 1A according to an embodiment. [ FIG. 1D ] is a system diagram illustrating a further example RAN and a further example CN that may be used in the communication system illustrated in FIG. 1A according to an embodiment. [ FIG. 2 ] illustrates an example video encoder. [FIG. 3] illustrates an example video decoder. [FIG. 4] illustrates an example of a system in which various aspects and examples may be implemented. [FIG. 5A] through [FIG. 5C] illustrate example prediction modes and prediction directions. [FIG. 6] illustrates an example of a current luma template and decoded reference samples for the template. [FIG. 7] illustrates neighboring reconstructed samples for a chroma mode such as decoder-side intra mode derivation (DIMD). [FIG. 8] illustrates an example of a matrix weighted intra prediction (MIP) procedure. [FIG. 9] illustrates example locations of samples for a cross-component linear model (CCLM) mode. [Figure 10A] and [Figure 10B] show example effects of slope adjustment parameters. [Figure 11] shows a spatial portion of a convolution filter. [Figure 12] shows an example reference region of intra block copy (IBC) when encoding a coding tree unit (CTU). [Figure 13] shows an example intra template matching search region. [Figure 14] shows an example of a block encoded in palette mode. [Figure 15A] to [Figure 15D] show example geometric partitioning modes (GPM) with inter-frame prediction and intra-frame prediction. [Figure 16] is a table showing the locations of available neighboring blocks derived from intra prediction mode (IPM) candidates based on the angle of the GPM block boundary. [Figure 17] shows an example region of interest (ROI). [Figure 18] shows an example ROI. [Figure 19] shows an example mapping of intra prediction mode to low frequency non-separable transform (LFNST) set index. [Figure 20] shows an example neighboring block used to derive the most probably mode (MPM) list. [Figure 21] shows an example of deriving equivalent modes. [Figure 22A] shows an example DIMD procedure. [Figure 22B] shows MIP equivalent mode derivation. [Figure 23] shows an example encoding block partitioning. [Figure 24] shows an example flow chart for decoding the current block. [Figure 25] shows an example flow chart for encoding the current block.

2400:流程圖 2400: Flowchart

2410,2420,2430:步驟 2410,2420,2430:Steps

Claims (46)

一種用於視訊解碼之裝置,其包含: 一處理器,其經組態以: 判定一目前區塊係以一非方向性幀內預測模式編碼; 導出對應於該非方向性幀內預測模式的一方向性幀內預測模式,其中經導出的該方向性幀內預測模式指示一經導出幀內預測方向;及 至少部分地基於經導出的該方向性幀內預測模式而解碼該目前區塊。 A device for video decoding, comprising: A processor configured to: Determine that a current block is encoded with a non-directional intra-frame prediction mode; Derive a directional intra-frame prediction mode corresponding to the non-directional intra-frame prediction mode, wherein the derived directional intra-frame prediction mode indicates a derived intra-frame prediction direction; and Decode the current block based at least in part on the derived directional intra-frame prediction mode. 如請求項1之裝置,其中該處理器進一步經組態以: 使用該非方向性幀內預測模式來獲得該目前區塊之一預測區塊;及 獲得該預測區塊中之複數個經重建樣本,其中該方向性幀內預測模式係基於該預測區塊中之該複數個經重建樣本及該目前區塊的複數個經重建相鄰樣本而導出。 The device of claim 1, wherein the processor is further configured to: obtain a prediction block for the current block using the non-directional intra-frame prediction mode; and obtain a plurality of reconstructed samples in the prediction block, wherein the directional intra-frame prediction mode is derived based on the plurality of reconstructed samples in the prediction block and a plurality of reconstructed neighboring samples of the current block. 如請求項1或2之裝置,其中該處理器進一步經組態以: 儲存經導出的該方向性幀內預測模式;及 使用經導出的該方向性幀內預測模式,以產生一相鄰預測區塊的一最可能模式(most probable mode, MPM)清單。 The device of claim 1 or 2, wherein the processor is further configured to: store the derived directional intra-frame prediction mode; and use the derived directional intra-frame prediction mode to generate a most probable mode (MPM) list of adjacent prediction blocks. 如請求項1至3中任一項之裝置,其中該處理器進一步經組態以基於經導出的該方向性幀內預測模式而判定一低頻非可分離轉換(low-frequency non-separable transform, LFNST)轉換集合,且其中該目前區塊係基於該LFNST轉換集合而解碼。A device as in any of claims 1 to 3, wherein the processor is further configured to determine a low-frequency non-separable transform (LFNST) transform set based on the derived directional intra-frame prediction model, and wherein the current block is decoded based on the LFNST transform set. 如請求項1至3中任一項之裝置,其中該處理器進一步經組態以基於經導出的該方向性幀內預測模式而判定一多轉換選擇(multi-transform selection, MTS)轉換集合,且其中該目前區塊係基於該MTS轉換集合而解碼。The apparatus of any of claims 1 to 3, wherein the processor is further configured to determine a multi-transform selection (MTS) transform set based on the derived directional intra-frame prediction model, and wherein the current block is decoded based on the MTS transform set. 如請求項1至5中任一項之裝置,其中該處理器經組態以導出該方向性幀內預測模式包含:該處理器經組態以基於與相鄰該目前區塊之經重建像素相關聯的一梯度直方圖而導出該方向性幀內預測模式。A device as in any of claims 1 to 5, wherein the processor is configured to derive the directional intra-frame prediction mode comprises: the processor is configured to derive the directional intra-frame prediction mode based on a gradient histogram associated with reconstructed pixels adjacent to the current block. 如請求項1至5中任一項之裝置,其中該處理器經組態以導出該方向性幀內預測模式包含:該處理器經組態以: 在相鄰該目前區塊的經重建像素上測試複數個候選方向性幀內預測模式;及 基於該測試,從該複數個候選方向性幀內預測模式選擇該方向性幀內預測模式。 A device as claimed in any one of claims 1 to 5, wherein the processor is configured to derive the directional intra-frame prediction mode, comprising: the processor is configured to: test a plurality of candidate directional intra-frame prediction modes on reconstructed pixels adjacent to the current block; and based on the testing, select the directional intra-frame prediction mode from the plurality of candidate directional intra-frame prediction modes. 如請求項1至5中任一項之裝置,其中該處理器進一步經組態以: 使用該非方向性幀內預測模式來獲得該目前區塊之一預測區塊; 獲得該預測區塊中之複數個經重建樣本; 獲得複數個可能預測模式; 基於該複數個可能預測模式,運算該預測區塊中之該複數個經重建樣本的複數個預測; 基於該預測區塊中之該複數個經重建樣本、及對應的該複數個預測,運算對應於該複數個可能預測模式的複數個預測誤差;及 基於該複數個預測誤差,在該複數個可能預測模式中選擇該方向性幀內預測模式。 A device as claimed in any one of claims 1 to 5, wherein the processor is further configured to: obtain a prediction block for the current block using the non-directional intra-frame prediction mode; obtain a plurality of reconstructed samples in the prediction block; obtain a plurality of possible prediction modes; based on the plurality of possible prediction modes, calculate a plurality of predictions for the plurality of reconstructed samples in the prediction block; based on the plurality of reconstructed samples in the prediction block and the corresponding plurality of predictions, calculate a plurality of prediction errors corresponding to the plurality of possible prediction modes; and based on the plurality of prediction errors, select the directional intra-frame prediction mode from the plurality of possible prediction modes. 如請求項1至8中任一項之裝置,其中該非方向性幀內預測模式包含一幀間預測模式、一交叉分量預測模式、一調色板模式、一幀內區塊複製(intra block copy, IBC)模式、或一幀內模板匹配預測(幀內TMP (intra template matching prediction))模式。A device as in any one of claims 1 to 8, wherein the non-directional intra-frame prediction mode includes an inter-frame prediction mode, a cross-component prediction mode, a palette mode, an intra-frame block copy (IBC) mode, or an intra-frame template matching prediction (TMP (intra template matching prediction)) mode. 如請求項1至3及6至9中任一項之裝置,其中該處理器進一步經組態以: 基於該方向性幀內預測模式,選擇一低頻非可分離轉換(LFNST)轉換集合;及 基於該LFNST轉換集合,對該目前區塊的一殘量執行逆轉換。 The device of any of claims 1 to 3 and 6 to 9, wherein the processor is further configured to: select a low frequency non-separable transform (LFNST) transform set based on the directional intra-frame prediction mode; and perform an inverse transform on a residual of the current block based on the LFNST transform set. 如請求項1至3及6至9中任一項之裝置,其中該處理器進一步經組態以: 基於該方向性幀內預測模式,選擇一多轉換選擇(MTS)轉換集合;及 基於該MTS轉換集合,對該目前區塊的一殘量執行逆轉換。 A device as claimed in any one of claims 1 to 3 and 6 to 9, wherein the processor is further configured to: select a multi-transform selection (MTS) transform set based on the directional intra-frame prediction mode; and perform an inverse transform on a residual of the current block based on the MTS transform set. 一種用於視訊解碼之方法,其包含: 判定一目前區塊係以一非方向性幀內預測模式編碼; 導出對應於該非方向性幀內預測模式的一方向性幀內預測模式,其中經導出的該方向性幀內預測模式指示一經導出幀內預測方向;及 至少部分地基於經導出的該方向性幀內預測模式而解碼該目前區塊。 A method for video decoding, comprising: Determining that a current block is encoded with a non-directional intra-frame prediction mode; Deriving a directional intra-frame prediction mode corresponding to the non-directional intra-frame prediction mode, wherein the derived directional intra-frame prediction mode indicates a derived intra-frame prediction direction; and Decoding the current block based at least in part on the derived directional intra-frame prediction mode. 如請求項12之方法,其中該方法進一步包含: 使用該非方向性幀內預測模式來獲得該目前區塊之一預測區塊;及 獲得該預測區塊中之複數個經重建樣本,其中該方向性幀內預測模式係基於該預測區塊中之該複數個經重建樣本及該目前區塊的複數個經重建相鄰樣本而導出。 The method of claim 12, wherein the method further comprises: using the non-directional intra-frame prediction mode to obtain a prediction block for the current block; and obtaining a plurality of reconstructed samples in the prediction block, wherein the directional intra-frame prediction mode is derived based on the plurality of reconstructed samples in the prediction block and a plurality of reconstructed neighboring samples of the current block. 如請求項12或13之方法,其中該方法進一步包含: 儲存經導出的該方向性幀內預測模式;及 使用經導出的該方向性幀內預測模式,以產生一相鄰預測區塊的一最可能模式(most probable mode, MPM)清單。 The method of claim 12 or 13, wherein the method further comprises: Storing the derived directional intra-frame prediction mode; and Using the derived directional intra-frame prediction mode to generate a most probable mode (MPM) list of adjacent prediction blocks. 如請求項12至14中任一項之方法,其中該方法進一步包含基於經導出的該方向性幀內預測模式而判定一低頻非可分離轉換(low-frequency non-separable transform, LFNST)轉換集合,且其中該目前區塊係基於該LFNST轉換集合而解碼。A method as in any one of claims 12 to 14, wherein the method further comprises determining a low-frequency non-separable transform (LFNST) transform set based on the derived directional intra-frame prediction mode, and wherein the current block is decoded based on the LFNST transform set. 如請求項12至14中任一項之方法,其中該方法進一步包含基於經導出的該方向性幀內預測模式而判定一多轉換選擇(multi-transform selection, MTS)轉換集合,且其中該目前區塊係基於該MTS轉換集合而解碼。A method as in any one of claims 12 to 14, wherein the method further comprises determining a multi-transform selection (MTS) transform set based on the derived directional intra-frame prediction model, and wherein the current block is decoded based on the MTS transform set. 如請求項12至16中任一項之方法,其中導出該方向性幀內預測模式包含:基於與相鄰該目前區塊之經重建像素相關聯的一梯度直方圖而導出該方向性幀內預測模式。A method as in any one of claims 12 to 16, wherein deriving the directional intra-frame prediction mode comprises deriving the directional intra-frame prediction mode based on a gradient histogram associated with reconstructed pixels adjacent to the current block. 如請求項12至16中任一項之方法,其中導出該方向性幀內預測模式包含: 在相鄰該目前區塊的經重建像素上測試複數個候選方向性幀內預測模式;及 基於該測試,從該複數個候選方向性幀內預測模式選擇該方向性幀內預測模式。 A method as claimed in any one of claims 12 to 16, wherein deriving the directional intra-frame prediction mode comprises: testing a plurality of candidate directional intra-frame prediction modes on reconstructed pixels adjacent to the current block; and selecting the directional intra-frame prediction mode from the plurality of candidate directional intra-frame prediction modes based on the testing. 如請求項12至16中任一項之方法,其中該方法進一步包含: 使用該非方向性幀內預測模式來獲得該目前區塊之一預測區塊; 獲得該預測區塊中之複數個經重建樣本; 獲得複數個可能預測模式; 基於該複數個可能預測模式,運算該預測區塊中之該複數個經重建樣本的複數個預測; 基於該預測區塊中之該複數個經重建樣本、及對應的該複數個預測,運算對應於該複數個可能預測模式的複數個預測誤差;及 基於該複數個預測誤差,在該複數個可能預測模式中選擇該方向性幀內預測模式。 A method as claimed in any one of claims 12 to 16, wherein the method further comprises: Using the non-directional intra-frame prediction mode to obtain a prediction block for the current block; Obtaining a plurality of reconstructed samples in the prediction block; Obtaining a plurality of possible prediction modes; Based on the plurality of possible prediction modes, calculating a plurality of predictions of the plurality of reconstructed samples in the prediction block; Based on the plurality of reconstructed samples in the prediction block and the corresponding plurality of predictions, calculating a plurality of prediction errors corresponding to the plurality of possible prediction modes; and Based on the plurality of prediction errors, selecting the directional intra-frame prediction mode from the plurality of possible prediction modes. 如請求項12至19中任一項之方法,其中該非方向性幀內預測模式包含一幀間預測模式、一交叉分量預測模式、一調色板模式、一幀內區塊複製(intra block copy, IBC)模式、或一幀內模板匹配預測(幀內TMP (intra template matching prediction))模式。A method as in any one of claims 12 to 19, wherein the non-directional intra-frame prediction mode comprises an inter-frame prediction mode, a cross-component prediction mode, a palette mode, an intra-frame block copy (IBC) mode, or an intra-frame template matching prediction (TMP (intra template matching prediction)) mode. 如請求項12至14及17至20中任一項之方法,其中該方法進一步包含: 基於該方向性幀內預測模式,選擇一低頻非可分離轉換(LFNST)轉換集合;及 基於該LFNST轉換集合,對該目前區塊的一殘量執行逆轉換。 A method as in any of claims 12 to 14 and 17 to 20, wherein the method further comprises: Based on the directional intra-frame prediction mode, selecting a low frequency non-separable transform (LFNST) transform set; and Based on the LFNST transform set, performing an inverse transform on a residual of the current block. 如請求項12至14及17至20中任一項之方法,其中該方法進一步包含: 基於該方向性幀內預測模式,選擇一多轉換選擇(MTS)轉換集合;及 基於該MTS轉換集合,對該目前區塊的一殘量執行逆轉換。 A method as in any one of claims 12 to 14 and 17 to 20, wherein the method further comprises: Based on the directional intra-frame prediction mode, selecting a multi-transform selection (MTS) transform set; and Based on the MTS transform set, performing an inverse transform on a residual of the current block. 一種用於視訊編碼之裝置,其包含: 一處理器,其經組態以: 識別用於編碼一目前區塊的一非方向性幀內預測模式; 導出對應於該非方向性幀內預測模式的一方向性幀內預測模式,其中經導出的該方向性幀內預測模式包含一經導出幀內預測方向;及 至少部分地基於經導出的該方向性幀內預測模式而編碼該目前區塊。 A device for video encoding, comprising: A processor configured to: Identify a non-directional intra-frame prediction mode for encoding a current block; Derive a directional intra-frame prediction mode corresponding to the non-directional intra-frame prediction mode, wherein the derived directional intra-frame prediction mode includes a derived intra-frame prediction direction; and Encode the current block based at least in part on the derived directional intra-frame prediction mode. 如請求項23之裝置,其中該處理器進一步經組態以: 使用該非方向性幀內預測模式來獲得該目前區塊之一預測區塊;及 獲得該預測區塊中之複數個經重建樣本,其中該方向性幀內預測模式係基於該預測區塊中之該複數個經重建樣本及複數個經重建相鄰樣本而導出。 The device of claim 23, wherein the processor is further configured to: obtain a prediction block for the current block using the non-directional intra-frame prediction mode; and obtain a plurality of reconstructed samples in the prediction block, wherein the directional intra-frame prediction mode is derived based on the plurality of reconstructed samples and a plurality of reconstructed neighboring samples in the prediction block. 如請求項23或24之裝置,其中該處理器進一步經組態以: 儲存經導出的該方向性幀內預測模式;及 使用經導出的該方向性幀內預測模式,以產生一相鄰預測區塊的一最可能模式(most probable mode, MPM)清單。 The device of claim 23 or 24, wherein the processor is further configured to: store the derived directional intra-frame prediction mode; and use the derived directional intra-frame prediction mode to generate a most probable mode (MPM) list of adjacent prediction blocks. 如請求項23至25中任一項之裝置,其中該處理器進一步經組態以基於經導出的該方向性幀內預測模式而判定一低頻非可分離轉換(low-frequency non-separable transform, LFNST)轉換集合,且其中該目前區塊係基於該LFNST轉換集合而編碼。A device as in any of claims 23 to 25, wherein the processor is further configured to determine a low-frequency non-separable transform (LFNST) transform set based on the derived directional intra-frame prediction model, and wherein the current block is encoded based on the LFNST transform set. 如請求項23至25中任一項之裝置,其中該處理器進一步經組態以基於經導出的該方向性幀內預測模式而判定一多轉換選擇(multi-transform selection, MTS)轉換集合,且其中該目前區塊係基於該MTS轉換集合而編碼。A device as in any of claims 23 to 25, wherein the processor is further configured to determine a multi-transform selection (MTS) transform set based on the derived directional intra-frame prediction model, and wherein the current block is encoded based on the MTS transform set. 如請求項23至27中任一項之裝置,其中該處理器經組態以導出該方向性幀內預測模式包含:該處理器經組態以基於與相鄰該目前區塊之經重建像素相關聯的一梯度直方圖而導出該方向性幀內預測模式。A device as in any of claims 23 to 27, wherein the processor is configured to derive the directional intra-frame prediction mode comprises: the processor is configured to derive the directional intra-frame prediction mode based on a gradient histogram associated with reconstructed pixels adjacent to the current block. 如請求項23至27中任一項之裝置,其中該處理器經組態以導出該方向性幀內預測模式包含:該處理器經組態以: 在相鄰該目前區塊的經重建像素上測試複數個候選方向性幀內預測模式;及 基於該測試,從該複數個候選方向性幀內預測模式選擇該方向性幀內預測模式。 A device as claimed in any one of claims 23 to 27, wherein the processor is configured to derive the directional intra-frame prediction mode, comprising: the processor is configured to: test a plurality of candidate directional intra-frame prediction modes on reconstructed pixels adjacent to the current block; and based on the testing, select the directional intra-frame prediction mode from the plurality of candidate directional intra-frame prediction modes. 如請求項23至27中任一項之裝置,其中該處理器進一步經組態以: 使用該非方向性幀內預測模式來獲得該目前區塊之一預測區塊; 獲得該預測區塊中之複數個經重建樣本; 獲得複數個可能預測模式; 基於該複數個可能預測模式,運算該預測區塊中之該複數個經重建樣本的複數個預測; 基於該預測區塊中之該複數個經重建樣本、及對應的該複數個預測,運算對應於該複數個可能預測模式的複數個預測誤差;及 基於該複數個預測誤差,在該複數個可能預測模式中選擇該方向性幀內預測模式。 A device as claimed in any one of claims 23 to 27, wherein the processor is further configured to: obtain a prediction block for the current block using the non-directional intra-frame prediction mode; obtain a plurality of reconstructed samples in the prediction block; obtain a plurality of possible prediction modes; based on the plurality of possible prediction modes, calculate a plurality of predictions of the plurality of reconstructed samples in the prediction block; based on the plurality of reconstructed samples in the prediction block and the corresponding plurality of predictions, calculate a plurality of prediction errors corresponding to the plurality of possible prediction modes; and based on the plurality of prediction errors, select the directional intra-frame prediction mode from the plurality of possible prediction modes. 如請求項23至30中任一項之裝置,其中該非方向性幀內預測模式包含一幀間預測模式、一交叉分量預測模式、一調色板模式、一幀內區塊複製(intra block copy, IBC)模式、或一幀內模板匹配預測(幀內TMP (intra template matching prediction))模式。A device as in any one of claims 23 to 30, wherein the non-directional intra-frame prediction mode includes an inter-frame prediction mode, a cross-component prediction mode, a palette mode, an intra-frame block copy (IBC) mode, or an intra-frame template matching prediction (TMP (intra template matching prediction)) mode. 如請求項23至25及28至31中任一項之裝置,其中該處理器進一步經組態以: 基於該方向性幀內預測模式,選擇一低頻非可分離轉換(LFNST)轉換集合;及 基於該LFNST轉換集合,對該目前區塊的一殘量執行轉換。 A device as claimed in any of claims 23 to 25 and 28 to 31, wherein the processor is further configured to: select a low frequency non-separable transform (LFNST) transform set based on the directional intra-frame prediction mode; and perform a transform on a residual of the current block based on the LFNST transform set. 如請求項23至25及28至31中任一項之裝置,其中該處理器進一步經組態以: 基於該方向性幀內預測模式,選擇一多轉換選擇(MTS)轉換集合;及 基於該MTS轉換集合,對該目前區塊的一殘量執行轉換。 A device as claimed in any of claims 23 to 25 and 28 to 31, wherein the processor is further configured to: select a multi-transform selection (MTS) transform set based on the directional intra-frame prediction mode; and perform a transform on a residual of the current block based on the MTS transform set. 一種用於視訊編碼之方法,其包含: 識別用於編碼一目前區塊的一非方向性幀內預測模式; 導出對應於該非方向性幀內預測模式的一方向性幀內預測模式,其中經導出的該方向性幀內預測模式包含一經導出幀內預測方向;及 至少部分地基於經導出的該方向性幀內預測模式而編碼該目前區塊。 A method for video encoding, comprising: identifying a non-directional intra-frame prediction mode for encoding a current block; deriving a directional intra-frame prediction mode corresponding to the non-directional intra-frame prediction mode, wherein the derived directional intra-frame prediction mode includes a derived intra-frame prediction direction; and encoding the current block based at least in part on the derived directional intra-frame prediction mode. 如請求項34之方法,其中該方法進一步包含: 使用該非方向性幀內預測模式來獲得該目前區塊之一預測區塊;及 獲得該預測區塊中之複數個經重建樣本,其中該方向性幀內預測模式係基於該預測區塊中之該複數個經重建樣本及複數個經重建相鄰樣本而導出。 The method of claim 34, wherein the method further comprises: using the non-directional intra-frame prediction model to obtain a prediction block for the current block; and obtaining a plurality of reconstructed samples in the prediction block, wherein the directional intra-frame prediction model is derived based on the plurality of reconstructed samples and a plurality of reconstructed neighboring samples in the prediction block. 如請求項34或35之方法,其中該方法進一步包含: 儲存經導出的該方向性幀內預測模式;及 使用經導出的該方向性幀內預測模式,以產生一相鄰預測區塊的一最可能模式(most probable mode, MPM)清單。 The method of claim 34 or 35, wherein the method further comprises: Storing the derived directional intra-frame prediction mode; and Using the derived directional intra-frame prediction mode to generate a most probable mode (MPM) list of adjacent prediction blocks. 如請求項34至36中任一項之方法,其中該方法進一步包含基於經導出的該方向性幀內預測模式而判定一低頻非可分離轉換(low-frequency non-separable transform, LFNST)轉換集合,且其中該目前區塊係基於該LFNST轉換集合而編碼。A method as in any one of claims 34 to 36, wherein the method further comprises determining a low-frequency non-separable transform (LFNST) transform set based on the derived directional intra-frame prediction mode, and wherein the current block is encoded based on the LFNST transform set. 如請求項34至36中任一項之方法,其中該方法進一步包含基於經導出的該方向性幀內預測模式而判定一多轉換選擇(multi-transform selection, MTS)轉換集合,且其中該目前區塊係基於該MTS轉換集合而編碼。A method as in any of claims 34 to 36, wherein the method further comprises determining a multi-transform selection (MTS) transform set based on the derived directional intra-frame prediction model, and wherein the current block is encoded based on the MTS transform set. 如請求項34至38中任一項之方法,其中導出該方向性幀內預測模式係基於與相鄰該目前區塊之經重建像素相關聯的一梯度直方圖。A method as in any of claims 34 to 38, wherein deriving the directional intra-frame prediction model is based on a gradient histogram associated with reconstructed pixels adjacent to the current block. 如請求項34至38中任一項之方法,其中導出該方向性幀內預測模式包含: 在相鄰該目前區塊的經重建像素上測試複數個候選方向性幀內預測模式;及 基於該測試,從該複數個候選方向性幀內預測模式選擇該方向性幀內預測模式。 A method as claimed in any one of claims 34 to 38, wherein deriving the directional intra-frame prediction mode comprises: testing a plurality of candidate directional intra-frame prediction modes on reconstructed pixels adjacent to the current block; and selecting the directional intra-frame prediction mode from the plurality of candidate directional intra-frame prediction modes based on the testing. 如請求項34至38中任一項之方法,其中該方法進一步包含: 使用該非方向性幀內預測模式來獲得該目前區塊之一預測區塊; 獲得該預測區塊中之複數個經重建樣本; 獲得複數個可能預測模式; 基於該複數個可能預測模式,運算該預測區塊中之該複數個經重建樣本的複數個預測; 基於該預測區塊中之該複數個經重建樣本、及對應的該複數個預測,運算對應於該複數個可能預測模式的複數個預測誤差;及 基於該複數個預測誤差,在該複數個可能預測模式中選擇該方向性幀內預測模式。 A method as claimed in any one of claims 34 to 38, wherein the method further comprises: Using the non-directional intra-frame prediction mode to obtain a prediction block for the current block; Obtaining a plurality of reconstructed samples in the prediction block; Obtaining a plurality of possible prediction modes; Based on the plurality of possible prediction modes, calculating a plurality of predictions of the plurality of reconstructed samples in the prediction block; Based on the plurality of reconstructed samples in the prediction block and the corresponding plurality of predictions, calculating a plurality of prediction errors corresponding to the plurality of possible prediction modes; and Based on the plurality of prediction errors, selecting the directional intra-frame prediction mode from the plurality of possible prediction modes. 如請求項34至41中任一項之方法,其中該非方向性幀內預測模式包含一幀間預測模式、一交叉分量預測模式、一調色板模式、一幀內區塊複製(intra block copy, IBC)模式、或一幀內模板匹配預測(幀內TMP (intra template matching prediction))模式。A method as in any one of claims 34 to 41, wherein the non-directional intra-frame prediction mode includes an inter-frame prediction mode, a cross-component prediction mode, a palette mode, an intra-frame block copy (IBC) mode, or an intra-frame template matching prediction (TMP (intra template matching prediction)) mode. 如請求項34至36及39至42中任一項之方法,其中該方法進一步包含: 基於該方向性幀內預測模式,選擇一低頻非可分離轉換(LFNST)轉換集合;及 基於該LFNST轉換集合,對該目前區塊的一殘量執行轉換。 A method as in any of claims 34 to 36 and 39 to 42, wherein the method further comprises: Based on the directional intra-frame prediction mode, selecting a low frequency non-separable transform (LFNST) transform set; and Based on the LFNST transform set, performing a transform on a residual of the current block. 如請求項34至36及39至42中任一項之方法,其中該方法進一步包含: 基於該方向性幀內預測模式,選擇一多轉換選擇(MTS)轉換集合;及 基於該MTS轉換集合,對該目前區塊的一殘量執行轉換。 A method as in any of claims 34 to 36 and 39 to 42, wherein the method further comprises: Based on the directional intra-frame prediction mode, selecting a multi-transform selection (MTS) transform set; and Based on the MTS transform set, performing a transform on a residual of the current block. 一種電腦可讀媒體,其包含用於使一或多個處理器執行如請求項12至22及34至44中任一項之方法的指令。A computer-readable medium comprising instructions for causing one or more processors to perform a method as in any of claims 12 to 22 and 34 to 44. 一種視訊資料,其包含表示根據如請求項34至44中的任一項的方法產生的經編碼的該目前區塊的資訊。A video data comprising information representing the encoded current block produced according to the method of any of claims 34 to 44.
TW112138694A 2022-10-11 2023-10-11 Equivalent intra mode for non-intra predicted coding blocks TW202416715A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP22306526.9 2022-10-11

Publications (1)

Publication Number Publication Date
TW202416715A true TW202416715A (en) 2024-04-16

Family

ID=

Similar Documents

Publication Publication Date Title
US20230045182A1 (en) Quantization parameter coding
US20220394298A1 (en) Transform coding for inter-predicted video data
CN114600452A (en) Adaptive interpolation filter for motion compensation
CN114556928A (en) Intra-sub-partition related intra coding
TW202416715A (en) Equivalent intra mode for non-intra predicted coding blocks
US20240196007A1 (en) Overlapped block motion compensation
WO2024079185A1 (en) Equivalent intra mode for non-intra predicted coding blocks
WO2023057501A1 (en) Cross-component depth-luma coding
WO2023194568A1 (en) Template based most probable mode list reordering
WO2024133767A1 (en) Motion compensation for video blocks
WO2024079187A1 (en) Video coding combining intra-sub partition and template-based intra-mode derivation techniques
WO2024008611A1 (en) Spatial geometric partition mode
WO2023194395A1 (en) Chroma direct mode
CA3232975A1 (en) Template-based syntax element prediction
WO2023118339A1 (en) Gdr adapted filtering
WO2024079193A1 (en) Extended angular prediction modes with decoder side refinement
WO2023194193A1 (en) Sign and direction prediction in transform skip and bdpcm
WO2024133053A1 (en) Combination of intra template prediction and intra block copy with other coding tools
WO2023194604A1 (en) Template based cclm/mmlm slope adjustment
WO2024133776A2 (en) Planar horizontal, planar vertical mode, and planar directional mode
WO2024133762A1 (en) Extension of spatial geometric prediction mode
WO2023194588A1 (en) Template-based intra mode derivation with wide angle intra prediction
WO2023194138A1 (en) Transform index determination
WO2023194558A1 (en) Improved subblock-based motion vector prediction (sbtmvp)
WO2023198535A1 (en) Residual coefficient sign prediction with adaptive cost function for intra prediction modes