WO2015003635A1 - Method of sub-prediction unit inter-view motion predition in 3d video coding - Google Patents

Method of sub-prediction unit inter-view motion predition in 3d video coding Download PDF

Info

Publication number
WO2015003635A1
WO2015003635A1 PCT/CN2014/081931 CN2014081931W WO2015003635A1 WO 2015003635 A1 WO2015003635 A1 WO 2015003635A1 CN 2014081931 W CN2014081931 W CN 2014081931W WO 2015003635 A1 WO2015003635 A1 WO 2015003635A1
Authority
WO
WIPO (PCT)
Prior art keywords
sub
texture
block
motion
disparity
Prior art date
Application number
PCT/CN2014/081931
Other languages
French (fr)
Inventor
Jicheng An
Kai Zhang
Jian-Liang Lin
Original Assignee
Mediatek Singapore Pte. Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mediatek Singapore Pte. Ltd. filed Critical Mediatek Singapore Pte. Ltd.
Priority to CN201480028930.6A priority Critical patent/CN105247858A/en
Priority to AU2014289739A priority patent/AU2014289739A1/en
Priority to US14/891,822 priority patent/US10165252B2/en
Priority to EP14822485.0A priority patent/EP2997730A4/en
Publication of WO2015003635A1 publication Critical patent/WO2015003635A1/en
Priority to AU2017202368A priority patent/AU2017202368A1/en
Priority to US16/171,149 priority patent/US10587859B2/en
Priority to AU2019201221A priority patent/AU2019201221A1/en
Priority to AU2021201240A priority patent/AU2021201240B2/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • H04N19/517Processing of motion vectors by encoding
    • H04N19/52Processing of motion vectors by encoding by predictive encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability

Definitions

  • the present invention relates to three-dimensional video coding.
  • the present invention relates to sub-PU (prediction unit) based prediction associated with inter-view motion prediction (IVMP) for a texture PU in a three-dimensional (3D) coding system.
  • IVMP inter-view motion prediction
  • Three-dimensional (3D) television has been a technology trend in recent years that intends to bring viewers sensational viewing experience.
  • Various technologies have been developed to enable 3D viewing and the multi-view video is a key technology for 3DTV application among others.
  • 3D coding tools such as inter-view motion prediction (IVMP) have been integrated to conventional 3D-HEVC (High Efficiency Video Coding) or 3D-AVC (Advanced Video Coding) codec.
  • Fig. 1 illustrates the basic concept of the IVMP in current 3DV-HTM.
  • a disparity vector (DV) can be derived to locate a reference block (120) in a reference view.
  • the derived DV can be based on the neighboring block disparity vector (NBDV) or the depth-oriented NBDV (DoNBDV) for the current prediction unit (PU).
  • NBDV neighboring block disparity vector
  • DoNBDV depth-oriented NBDV
  • this reference block is coded using motion compensated prediction (MCP)
  • MCP motion compensated prediction
  • the associated motion parameters can be used as the TIVMC for the current PU in the current view.
  • the derived DV can also be directly used as the disparity inter-view Merge candidate (DIVMC) for disparity compensated prediction (DCP) of the current PU.
  • DIVMC disparity inter-view Merge candidate
  • DCP disparity compensated prediction
  • Embodiments of the present invention utilize motion or disparity parameters associated with reference sub-blocks in a reference picture of a reference view corresponding to the texture sub-PUs split from a current texture PU (prediction unit) to predict the motion or disparity parameters of the current texture PU.
  • the location of each reference sub-block can be determined by adding a derived DV (disparity vector) to a specific location of each texture sub-PU.
  • An individual DV (disparity vector) or a unified derived DV can be used to locate each reference sub-block corresponding to each texture sub-PU.
  • the unified derived DV can be signaled explicitly to a decoder or can be derived implicitly by the decoder.
  • the unified derived DV can be selected from a plurality of DV candidates and DV selection information can be signaled explicitly to a decoder or can be derived implicitly by the decoder.
  • a texture sub-PU may share the motion or disparity parameters of a neighboring sub-PU when the motion or disparity parameters of the reference sub-block corresponding to the texture sub-PU are not available.
  • a texture sub-PU may use default motion or disparity parameters when the motion or disparity parameters of the reference sub-block corresponding to the texture sub-PU are not available.
  • the motion or disparity parameters of a reference sub-block correspond to a temporal direction
  • the motion or disparity parameters of the reference sub-block can be used as candidate motion parameters in the temporal direction for the texture sub-PU corresponding to the reference sub-block.
  • the motion or disparity parameters of the reference sub-block can be used as the candidate motion parameters in the inter-view direction for the texture sub-PU corresponding to the reference sub-block.
  • the texture sub-PU corresponding to the reference sub-block can be assigned a same motion vector and POC (Picture Order Count) of the reference sub-block.
  • POC Picture Order Count
  • a motion vector of a reference sub-block can be scaled to generate the motion vector of the texture sub-PU corresponding to the reference sub-block when POC (Picture Order Count) of the reference picture for the reference sub-block is different from the POC of the reference picture for the sub-PU.
  • POC Picture Order Count
  • candidate motion or disparity parameters for the current texture PU comprise one or more candidate motion or disparity parameters derived for at least one texture sub-PU from splitting the current texture PU.
  • the candidate motion or disparity parameters for the current texture PU can be used as a sub-block-based inter-view Merge candidate for the current texture PU in Merge mode.
  • the sub-block-based inter-view Merge candidate can be inserted into a first position of a candidate list.
  • the current texture PU may have more than one sub-block-based inter-view Merge candidates corresponding to different sub-PU sizes, and each sub-PU size includes one or more block sizes smaller than or equal to a PU size.
  • the texture sub-PU size can be selected from a group consisting of 4x4, 8x8, 16x16 and current texture PU size.
  • the current texture PU will not be further divided when the texture sub-PU size is larger than or equal to the current texture PU size.
  • a flag can be signaled to indicate the texture sub-PU size, a partition level of texture sub-PU partition, a quadtree/split depth for the texture sub-PU partition, or whether the current texture PU is divided into the texture sub-PUs.
  • the flag may be explicitly transmitted in a sequence level, view level, picture level, or slice level of a bitstream, such as in SPS (sequence parameter set), PPS (picture parameter set), VPS (video parameter set), APS (adaptation parameter set), or slice header, or the flag is implicitly derived on decoder side.
  • SPS sequence parameter set
  • PPS picture parameter set
  • VPS video parameter set
  • APS adaptive parameter set
  • slice header or the flag is implicitly derived on decoder side.
  • Fig. 1 illustrates an example of inter-view motion prediction (IVMP) for prediction of motion or disparity parameters of a current block in three-dimensional video coding according to existing 3D-HEVC (three dimensional video coding based on High Efficiency
  • Fig. 2 illustrates an example of sub-PU (prediction unit) based inter- view motion prediction (IVMP) for prediction of motion or disparity parameters of a current block in three-dimensional video coding according to an embodiment of the present invention.
  • IVMP inter- view motion prediction
  • Fig. 3 illustrates an exemplary flowchart of sub-PU (prediction unit) based inter-view motion prediction (IVMP) for three-dimensional video coding according to an embodiment of the present invention.
  • FIG. 2 illustrates an example of SPIVMP according to an embodiment of the present invention.
  • a current PU (222) in a current dependent view (i.e., VI) is divided into multiple sub-PUs, (i.e., A, B, C and D), where each sub-PU has a smaller size.
  • the disparity vector (DV) associated with each sub-PU is added to the respective position (as illustrated by a dot in the center of each sub-PU) to locate a respective prediction block (i.e., A', B', C or D') in the reference view (i.e., V0), where the prediction blocks (i.e., A', B', C and D') in the reference view are already coded.
  • the prediction blocks covering the sample positions are used as reference blocks.
  • the DV used to derive a reference block in a reference view for each sub-PU can be a derived DV and the derived DV can be different for each sub-PU or all sub-PUs can share a unified derived DV.
  • TIVMC temporal inter-view Merge candidate of a current Prediction Unit (PU) can be derived according to the SPIVMP as shown below.
  • a reference sub-block in a reference view is usually derived for each sub-PU according to a derived DV.
  • the derived DV can be different for each sub-PU or all sub-PUs can share a unified derived DV.
  • the associated motion parameters can be used as TIVMC for the corresponding sub-PU in the current PU in the current view. Otherwise, the corresponding sub-PU can share the candidate motion parameters with its spatial neighboring sub-PU.
  • the TIVMC of the current PU is composed of the TIVMCs of all the sub-PUs.
  • - tempMP is set equal to null.
  • CMP(SPi) The candidate motion parameters of SPi denoted as CMP(SPi) is set to null. o If the motion parameters, MP(RefBlk(SPi)) of the reference sub-block of SPi is available,
  • ⁇ CMP(SPi) is set to MP(RefBlk(SP );
  • ⁇ tempMP is set to MP(RefBlk(SPi));
  • CMP(SP j ) is set to tempMP.
  • the TIMVC of the current PU is marked as available.
  • the derived TIVMC or disparity inter-view Merge candidate can be included in the Merge candidate list to improve coding efficiency for a 3D coding system.
  • the Merge candidate list may include other Merge candidates such as one or more spatial Merge candidates and/or one or more temporal Merge candidates.
  • the candidates in the candidate list usually are arranged in a special priority order for Merge candidate selection.
  • the TIVMC is placed at a leading position in the Merge candidate list.
  • a Merge candidate list may include ordered members ⁇ TIVMC, Left, Above, DIVMC, VSP, Left-bottom, Above-left, shifted TIVMC, shifted DIVMC and TMVP ⁇ , where Left, Above, Left-bottom, and Above-left correspond to spatial candidates at corresponding locations as implied by the names, TMVP corresponds to temporal candidate, and VSP corresponds to a candidate derived using view synthesis prediction. Shifted TIVMC and shifted DIVMC are resulted from adding an offset value to the respective TIVMC and DIVMC.
  • the above list is intended to illustrate an example.
  • the TIVMC may be placed at other position in the list.
  • the candidate list may include different candidates as well.
  • the associated motion (i.e., disparity) parameter can be derived as the disparity inter-view Merge candidate (DIVMC) for current sub-PU to perform DCP, or the derived DV of the current sub-PU can also be directly used as DIVMC for the current sub-PU to perform DCP.
  • DCP disparity compensated prediction
  • DIVMC disparity inter-view Merge candidate
  • the current sub-PU assumes to have the same motion vector and POC (Picture Order Count) as the first reference sub-block.
  • the current sub-PU uses the MV and POC of a corresponding reference sub-block coded in DCP.
  • the motion vector or disparity vector of the reference sub-block can be scaled according to view distance to generate the motion vector of the texture sub-PU corresponding to the reference sub-block.
  • the MV (or DV) view-direction scaling techniques are known in the art and the details will not be repeated here.
  • the POC of the reference picture for a sub-PU may be different from the POC of the reference picture for the reference sub-block.
  • the motion vector of the reference sub-block can be scaled according to POC distance to generate the motion vector of the texture sub-PU corresponding to the reference sub-block.
  • the temporal MV scaling techniques are known in the art and the details will not be repeated here.
  • the current sub-PU can use the motion parameter from the neighboring sub-PU or use the derived DV or a default motion parameter as the candidate motion parameter.
  • the associated motion parameter is used as the TIVMC for the current sub-PU. If the reference sub-block is DCP coded, the associated motion parameter is used as DIVMC for the current sub-PU. If the reference sub-block is Intra coded, the motion parameter from the neighboring sub-PUs or a default motion parameter can be used as the candidate motion parameter for the current sub-PU.
  • Another embodiment of the present invention uses multiple sub-PU based inter-view Merge candidates corresponding to different sub-PU sizes.
  • the sub-PU size may be selected from one or more block sizes smaller than or equal to a PU size.
  • a PU may have a block size of 32x32.
  • One inter-view Merge candidate may be determined from reference sub-blocks corresponding to 16x16 sub-PUs and another inter-view Merge candidate may be determined from reference block corresponding to the 32x32 PU (i.e., no partition).
  • one inter-view Merge candidate may be determined from reference sub-blocks corresponding to 16x16 sub-PUs and another inter-view Merge candidate may be determined from reference sub-blocks corresponding to 8x8 sub-PUs.
  • the block size of sub-PU can be 4x4, 8x8, 16x16, other sizes, or the current PU size. If a PU is smaller than or equal to the sub-PU, then this PU will not be further divided.
  • Each sub-PU can have its own associated derived DV, or all the sub-PUs in the current PU can share one derived DV.
  • One or more syntax elements can be used to signal whether the current PU is further divided into sub-PUs or not, a partition level of texture sub-PU partition, a quadtree/split depth for the texture sub-PU partition, or to indicate the sub-PU size.
  • the syntax elements can be explicitly transmitted in the sequence, view, picture, or slice level, such as SPS (sequence parameter set), PPS (picture parameter set), VPS (video parameter set), APS (adaptation parameter set), or slice header.
  • SPS sequence parameter set
  • PPS picture parameter set
  • VPS video parameter set
  • APS adaptive parameter set
  • slice header the information about whether the PU is further divided, a partition level of texture sub-PU partition, a quadtree/split depth for the texture sub-PU partition, or the sub-PU size can also be derived implicitly at the decoder side.
  • the above information can be derived implicitly at the decoder side according to mode selections, motion parameters of the neighboring PUs, or according to the motion parameters of the reference blocks of the sub-PUs.
  • a system incorporating sub-PU based inter-view Merge candidates is compared with a conventional system (3D-HEVC Test Model version 7.0rl (HTM 7.0rl)) based on full PU.
  • the performance comparison is based on different sets of test data listed in the first column.
  • the BD-rate differences are shown for texture pictures in view 1 (video 1) and view 2 (video 2).
  • a negative value in the BD-rate implies that the present invention has a better performance.
  • the system incorporating an embodiment of the present invention shows substantial BD-rate reduction for view 1 and view 2, where the improvement is as high as 7% in average BD-rate for the 4x4 sub-PU.
  • the BD-rate measure for the coded video PSNR with video bitrate, the coded video PSNR with total bitrate (texture bitrate and depth bitrate), and the synthesized video PSNR with total bitrate also show noticeable BD-rate reduction.
  • the encoding time and rendering time are above same as the conventional system. However, the decoding timing is increased for all cases. For the 4x4 sub-PU, the decoding time is increased by 24.2%. However, for the 16x16 sub-PU, the decoding time is only increased by 3.9%>.
  • Table 4 The performance comparisons are summarized in Table 4.
  • Fig. 3 illustrates an exemplary flowchart of a three-dimensional encoding or decoding system incorporating sub-PU based inter-view motion prediction (IVMP) according to an embodiment of the present invention.
  • the system receives input data associated with one or more motion or disparity parameters of a current texture PU (prediction unit) in a dependent view in step 310.
  • the input data corresponds to the motion or disparity parameters to be encoded.
  • the input data corresponds to coded motion or disparity parameters to be decoded.
  • the input data may be retrieved from memory (e.g., computer memory, buffer (RAM or DRAM) or other media) or from a processor.
  • the current texture PU is split into texture sub-PUs as shown in step 320.
  • Reference sub-blocks in a reference picture of a reference view corresponding to the texture sub-PUs are located as shown in step 330.
  • the motion or disparity parameters of the reference sub-blocks are identified as shown in step 340.
  • the motion or disparity parameters of the current texture PU are encoded or decoded based on the motion or disparity parameters of the reference sub-blocks as shown in step 350.
  • Embodiment of the present invention as described above may be implemented in various hardware, software codes, or a combination of both.
  • an embodiment of the present invention can be a circuit integrated into a video compression chip or program code integrated into video compression software to perform the processing described herein.
  • An embodiment of the present invention may also be program code to be executed on a Digital Signal Processor (DSP) to perform the processing described herein.
  • DSP Digital Signal Processor
  • the invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA). These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention.
  • the software code or firmware code may be developed in different programming languages and different formats or styles.
  • the software code may also be compiled for different target platforms.
  • different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

A method for a three-dimensional encoding or decoding system incorporating sub-block based inter-view motion prediction is disclosed. The system utilizes motion or disparity parameters associated with reference sub-blocks in a reference picture of a reference view corresponding to the texture sub-PUs split from a current texture PU (prediction unit) to predict the motion or disparity parameters of the current texture PU. Candidate motion or disparity parameters for the current texture PU may comprise candidate motion or disparity parameters derived for all texture sub-PUs from splitting the current texture PU. The candidate motion or disparity parameters for the current texture PU can be used as a sub-block-based inter-view Merge candidate for the current texture PU in Merge mode. The sub-block-based inter-view Merge candidate can be inserted into a first position of a candidate list.

Description

METHOD OF SUB-PREDICTION UNIT INTER- VIEW
MOTION PREDITION IN 3D VIDEO
CODING CROSS REFERENCE TO RELATED APPLICATIONS
[0001] The present invention claims priority to PCT Patent Application, Serial No. PCT/CN2013/079287, filed on July 12, 2013, entitled "Methods for Inter-view Motion Prediction". The PCT Patent Application is hereby incorporated by reference in its entirety.
FIELD OF THE INVENTION
[0002] The present invention relates to three-dimensional video coding. In particular, the present invention relates to sub-PU (prediction unit) based prediction associated with inter-view motion prediction (IVMP) for a texture PU in a three-dimensional (3D) coding system.
BACKGROUND AND RELATED ART
[0003] Three-dimensional (3D) television has been a technology trend in recent years that intends to bring viewers sensational viewing experience. Various technologies have been developed to enable 3D viewing and the multi-view video is a key technology for 3DTV application among others. To exploit the inter-view redundancy, 3D coding tools such as inter-view motion prediction (IVMP) have been integrated to conventional 3D-HEVC (High Efficiency Video Coding) or 3D-AVC (Advanced Video Coding) codec.
[0004] Fig. 1 illustrates the basic concept of the IVMP in current 3DV-HTM. For deriving the motion parameters of temporal inter-view Merge candidate (TIVMC) for a current Prediction Unit (PU, 110) in a dependent view, a disparity vector (DV) can be derived to locate a reference block (120) in a reference view. The derived DV can be based on the neighboring block disparity vector (NBDV) or the depth-oriented NBDV (DoNBDV) for the current prediction unit (PU). By adding the derived DV (130) to the middle position of the current PU (110), a reference sample location (120) is obtained. The prediction block in the already coded picture in the reference view covering the sample location is used as a reference block. If this reference block is coded using motion compensated prediction (MCP), the associated motion parameters can be used as the TIVMC for the current PU in the current view. The derived DV can also be directly used as the disparity inter-view Merge candidate (DIVMC) for disparity compensated prediction (DCP) of the current PU. [0005] The corresponding area in a reference view may have plentiful motion information. However, according to the existing coding practice, only the motion information in the middle position of the area in the reference view is used for current PU in a dependent view. Therefore, it is desirable to develop an improved coding method that can further utilize the motion information of the reference block in the reference view.
BRIEF SUMMARY OF THE INVENTION
[0006] A method for a three-dimensional encoding or decoding system incorporating sub-block based inter-view motion prediction is disclosed. Embodiments of the present invention utilize motion or disparity parameters associated with reference sub-blocks in a reference picture of a reference view corresponding to the texture sub-PUs split from a current texture PU (prediction unit) to predict the motion or disparity parameters of the current texture PU. The location of each reference sub-block can be determined by adding a derived DV (disparity vector) to a specific location of each texture sub-PU. An individual DV (disparity vector) or a unified derived DV can be used to locate each reference sub-block corresponding to each texture sub-PU. The unified derived DV can be signaled explicitly to a decoder or can be derived implicitly by the decoder. The unified derived DV can be selected from a plurality of DV candidates and DV selection information can be signaled explicitly to a decoder or can be derived implicitly by the decoder.
[0007] A texture sub-PU may share the motion or disparity parameters of a neighboring sub-PU when the motion or disparity parameters of the reference sub-block corresponding to the texture sub-PU are not available. A texture sub-PU may use default motion or disparity parameters when the motion or disparity parameters of the reference sub-block corresponding to the texture sub-PU are not available. When the motion or disparity parameters of a reference sub-block correspond to a temporal direction, the motion or disparity parameters of the reference sub-block can be used as candidate motion parameters in the temporal direction for the texture sub-PU corresponding to the reference sub-block. Otherwise, when the motion or disparity parameters of the reference sub-block correspond to an inter-view direction, the motion or disparity parameters of the reference sub-block can be used as the candidate motion parameters in the inter-view direction for the texture sub-PU corresponding to the reference sub-block. When the motion or disparity parameters of a reference sub-block correspond to a temporal direction, the texture sub-PU corresponding to the reference sub-block can be assigned a same motion vector and POC (Picture Order Count) of the reference sub-block. When the reference picture is in an inter-view direction, a motion vector or disparity vector of a reference sub-block is scaled to generate the motion vector of the texture sub-PU corresponding to the reference sub-block. A motion vector of a reference sub-block can be scaled to generate the motion vector of the texture sub-PU corresponding to the reference sub-block when POC (Picture Order Count) of the reference picture for the reference sub-block is different from the POC of the reference picture for the sub-PU.
[0008] According to one embodiment of the present invention, candidate motion or disparity parameters for the current texture PU comprise one or more candidate motion or disparity parameters derived for at least one texture sub-PU from splitting the current texture PU. The candidate motion or disparity parameters for the current texture PU can be used as a sub-block-based inter-view Merge candidate for the current texture PU in Merge mode. The sub-block-based inter-view Merge candidate can be inserted into a first position of a candidate list. The current texture PU may have more than one sub-block-based inter-view Merge candidates corresponding to different sub-PU sizes, and each sub-PU size includes one or more block sizes smaller than or equal to a PU size.
[0009] The texture sub-PU size can be selected from a group consisting of 4x4, 8x8, 16x16 and current texture PU size. The current texture PU will not be further divided when the texture sub-PU size is larger than or equal to the current texture PU size. A flag can be signaled to indicate the texture sub-PU size, a partition level of texture sub-PU partition, a quadtree/split depth for the texture sub-PU partition, or whether the current texture PU is divided into the texture sub-PUs. The flag may be explicitly transmitted in a sequence level, view level, picture level, or slice level of a bitstream, such as in SPS (sequence parameter set), PPS (picture parameter set), VPS (video parameter set), APS (adaptation parameter set), or slice header, or the flag is implicitly derived on decoder side.
BRIEF DESCRIPTION OF THE DRAWINGS
[0010] Fig. 1 illustrates an example of inter-view motion prediction (IVMP) for prediction of motion or disparity parameters of a current block in three-dimensional video coding according to existing 3D-HEVC (three dimensional video coding based on High Efficiency
Video Coding).
[0011] Fig. 2 illustrates an example of sub-PU (prediction unit) based inter- view motion prediction (IVMP) for prediction of motion or disparity parameters of a current block in three-dimensional video coding according to an embodiment of the present invention.
[0012] Fig. 3 illustrates an exemplary flowchart of sub-PU (prediction unit) based inter-view motion prediction (IVMP) for three-dimensional video coding according to an embodiment of the present invention.
DETAILED DESCRIPTION OF THE INVENTION [0013] As mentioned above, the existing coding practice only uses the motion information in the middle position of the area in the reference view for the current PU in a dependent view. This practice does not efficiently use the motion information associated with the reference. Therefore, embodiments of the present invention use sub-PU level inter-view motion prediction (SPIVMP) to obtain refined motion information for the current PU. Fig. 2 illustrates an example of SPIVMP according to an embodiment of the present invention. A current PU (222) in a current dependent view (i.e., VI) is divided into multiple sub-PUs, (i.e., A, B, C and D), where each sub-PU has a smaller size. The disparity vector (DV) associated with each sub-PU is added to the respective position (as illustrated by a dot in the center of each sub-PU) to locate a respective prediction block (i.e., A', B', C or D') in the reference view (i.e., V0), where the prediction blocks (i.e., A', B', C and D') in the reference view are already coded. The prediction blocks covering the sample positions are used as reference blocks. The DV used to derive a reference block in a reference view for each sub-PU can be a derived DV and the derived DV can be different for each sub-PU or all sub-PUs can share a unified derived DV.
[0014] The temporal inter-view Merge candidate (TIVMC) of a current Prediction Unit (PU) can be derived according to the SPIVMP as shown below.
1.First, divide the current PU into multiple sub-PUs having smaller size.
2. Second, add a derived DV to a specific position (for example, the middle position) of each sub-PU to obtain a group of reference sample locations. For each reference sample location, a prediction sub-block in the already coded picture in the reference view that covers that sample position is used as a reference sub-block. A reference sub-block in a reference view is usually derived for each sub-PU according to a derived DV. The derived DV can be different for each sub-PU or all sub-PUs can share a unified derived DV.
3. Third, for each reference sub-block, if it is coded using MCP, the associated motion parameters can be used as TIVMC for the corresponding sub-PU in the current PU in the current view. Otherwise, the corresponding sub-PU can share the candidate motion parameters with its spatial neighboring sub-PU.
[0015] Finally, the TIVMC of the current PU is composed of the TIVMCs of all the sub-PUs.
[0016] The following pseudo code illustrates an example of the above third step in details. In this example, the current PU is partitioned into N sub-PUs. The process is shown as follows.
- tempMP is set equal to null.
- For each sub-PU denoted as SPi in the current PU, where i=0,...,N-l :
o The candidate motion parameters of SPi denoted as CMP(SPi) is set to null. o If the motion parameters, MP(RefBlk(SPi)) of the reference sub-block of SPi is available,
CMP(SPi) is set to MP(RefBlk(SP );
tempMP is set to MP(RefBlk(SPi));
■ if CMP(SPi-i) is null, for each j=0,...,i-l :
• CMP(SPj) is set to tempMP .
o Else,
If tempMP is not null, CMP(SPj) is set to tempMP.
- If tempMP is not null, the TIMVC of the current PU is marked as available.
- Else, the TIVMC of current PU is marked as unavailable.
[0017] The derived TIVMC or disparity inter-view Merge candidate (DIVMC) can be included in the Merge candidate list to improve coding efficiency for a 3D coding system. The Merge candidate list may include other Merge candidates such as one or more spatial Merge candidates and/or one or more temporal Merge candidates. The candidates in the candidate list usually are arranged in a special priority order for Merge candidate selection. In one embodiment, the TIVMC is placed at a leading position in the Merge candidate list. For example, a Merge candidate list may include ordered members {TIVMC, Left, Above, DIVMC, VSP, Left-bottom, Above-left, shifted TIVMC, shifted DIVMC and TMVP}, where Left, Above, Left-bottom, and Above-left correspond to spatial candidates at corresponding locations as implied by the names, TMVP corresponds to temporal candidate, and VSP corresponds to a candidate derived using view synthesis prediction. Shifted TIVMC and shifted DIVMC are resulted from adding an offset value to the respective TIVMC and DIVMC. The above list is intended to illustrate an example. The TIVMC may be placed at other position in the list. The candidate list may include different candidates as well.
[0018] In another example, if the reference sub-block of the current sub-PU is coded using disparity compensated prediction (DCP), the associated motion (i.e., disparity) parameter can be derived as the disparity inter-view Merge candidate (DIVMC) for current sub-PU to perform DCP, or the derived DV of the current sub-PU can also be directly used as DIVMC for the current sub-PU to perform DCP.
[0019] When the reference sub-block of the current sub-PU is coded using disparity compensated prediction (DCP), the current sub-PU assumes to have the same motion vector and POC (Picture Order Count) as the first reference sub-block. In other words, the current sub-PU uses the MV and POC of a corresponding reference sub-block coded in DCP. When the reference sub-block is coded DCP, the motion vector or disparity vector of the reference sub-block can be scaled according to view distance to generate the motion vector of the texture sub-PU corresponding to the reference sub-block. The MV (or DV) view-direction scaling techniques are known in the art and the details will not be repeated here.
[0020] The POC of the reference picture for a sub-PU may be different from the POC of the reference picture for the reference sub-block. In this case, the motion vector of the reference sub-block can be scaled according to POC distance to generate the motion vector of the texture sub-PU corresponding to the reference sub-block. The temporal MV scaling techniques are known in the art and the details will not be repeated here.
[0021] In another example, if the reference sub-block of a current sub-PU is Intra coded or DCP coded, the current sub-PU can use the motion parameter from the neighboring sub-PU or use the derived DV or a default motion parameter as the candidate motion parameter.
[0022] In another example, if the reference sub-block is MCP coded, the associated motion parameter is used as the TIVMC for the current sub-PU. If the reference sub-block is DCP coded, the associated motion parameter is used as DIVMC for the current sub-PU. If the reference sub-block is Intra coded, the motion parameter from the neighboring sub-PUs or a default motion parameter can be used as the candidate motion parameter for the current sub-PU.
[0023] Another embodiment of the present invention uses multiple sub-PU based inter-view Merge candidates corresponding to different sub-PU sizes. The sub-PU size may be selected from one or more block sizes smaller than or equal to a PU size. For example, a PU may have a block size of 32x32. One inter-view Merge candidate may be determined from reference sub-blocks corresponding to 16x16 sub-PUs and another inter-view Merge candidate may be determined from reference block corresponding to the 32x32 PU (i.e., no partition). In another example, one inter-view Merge candidate may be determined from reference sub-blocks corresponding to 16x16 sub-PUs and another inter-view Merge candidate may be determined from reference sub-blocks corresponding to 8x8 sub-PUs.
[0024] The block size of sub-PU can be 4x4, 8x8, 16x16, other sizes, or the current PU size. If a PU is smaller than or equal to the sub-PU, then this PU will not be further divided.
[0025] Each sub-PU can have its own associated derived DV, or all the sub-PUs in the current PU can share one derived DV.
[0026] One or more syntax elements can be used to signal whether the current PU is further divided into sub-PUs or not, a partition level of texture sub-PU partition, a quadtree/split depth for the texture sub-PU partition, or to indicate the sub-PU size.
[0027] The syntax elements can be explicitly transmitted in the sequence, view, picture, or slice level, such as SPS (sequence parameter set), PPS (picture parameter set), VPS (video parameter set), APS (adaptation parameter set), or slice header. The information about whether the PU is further divided, a partition level of texture sub-PU partition, a quadtree/split depth for the texture sub-PU partition, or the sub-PU size can also be derived implicitly at the decoder side.
[0028] The above information can be derived implicitly at the decoder side according to mode selections, motion parameters of the neighboring PUs, or according to the motion parameters of the reference blocks of the sub-PUs.
[0029] A system incorporating sub-PU based inter-view Merge candidates is compared with a conventional system (3D-HEVC Test Model version 7.0rl (HTM 7.0rl)) based on full PU. Tables 1, 2 and 3 illustrate the comparison results for sub-PU = 4x4, 8x8 and 16x16. The performance comparison is based on different sets of test data listed in the first column. The BD-rate differences are shown for texture pictures in view 1 (video 1) and view 2 (video 2). A negative value in the BD-rate implies that the present invention has a better performance. As shown in Tables 1-3, the system incorporating an embodiment of the present invention shows substantial BD-rate reduction for view 1 and view 2, where the improvement is as high as 7% in average BD-rate for the 4x4 sub-PU. The BD-rate measure for the coded video PSNR with video bitrate, the coded video PSNR with total bitrate (texture bitrate and depth bitrate), and the synthesized video PSNR with total bitrate also show noticeable BD-rate reduction. The encoding time and rendering time are above same as the conventional system. However, the decoding timing is increased for all cases. For the 4x4 sub-PU, the decoding time is increased by 24.2%. However, for the 16x16 sub-PU, the decoding time is only increased by 3.9%>. The performance comparisons are summarized in Table 4.
Table 1
Video Video Synth
PSNR/ PSNR/ PSNR/ Enc Dec Ren
Video 0 Video 1 Video 2
video total total time time time bitrate bitrate bitrate
Balloons 0.0% -7.5% -7.8% -2.5% -2.2% -2.0% 98.0% 119.5% 99.4%
Kendo 0.0% -4.3% -4.7% -1.3% -1.0% -0.8% 99.8% 126.6% 99.4%
NewspaperCC 0.0% -4.4% -3.6% -1.3% -1.1% -1.3% 99.7% 119.4% 102.4%
GhostTownFly 0.0% -13.7% -14.0% -2.7% -2.5% -2.2% 99.2% 125.0% 99.4%
PoznanHall2 0.0% -7.7% -7.3% -2.7% -2.4% -2.1% 100.7% 126.5% 99.0%
PoznanStreet 0.0% -5.2% -5.2% -1.3% -1.2% -1.1% 100.6% 123.3% 98.1% UndoDancer 0.0% -6.3% -6.3% -1.5% -1.4% -1.3% 100.8% 128.8% 98.5%
1024x768 0.0% -5.4% -5.4% -1.7% -1.4% -1.4% 99.2% 121.9% 100.4%
1920x1088 0.0% -8.2% -8.2% -2.1% -1.9% -1.7% 100.3% 125.9% 98.7% average 0.0% -7.0% -7.0% -1.9% -1.7% -1.6% 99.8% 124.2% 99.5%
Table 2
Video Video Synth
PSNR/ PSNR/ PSNR/ Enc Dec Ren
Video 0 Video 1 Video 2
video total total time time time bitrate bitrate bitrate
Balloons 0.0% -6.5% -6.8% -2.2% -1.9% -1.8% 96.9% 107.8% 98.6%
Kendo 0.0% -3.9% -4.2% -1.2% -0.9% -0.8% 99.0% 107.3% 99.6%
NewspaperCC 0.0% -4.0% -3.4% -1.2% -1.0% -0.8% 99.2% 105.0% 99.4%
GhostTownFly 0.0% -12.0% -12.7% -2.4% -2.2% -2.0% 98.1% 105.6% 100.4%
PoznanHall2 0.0% -7.1% -7.0% -2.6% -2.2% -2.1% 99.3% 105.4% 100.2%
PoznanStreet 0.0% -4.7% -4.6% -1.1% -1.1% -1.0% 99.9% 110.0% 98.1%
UndoDancer 0.0% -4.6% -4.8% -1.1% -1.0% -0.5% 99.1% 106.5% 98.1%
1024x768 0.0% -4.8% -4.8% -1.5% -1.3% -1.1% 98.4% 106.7% 99.2%
1920x1088 0.0% -7.1% -7.3% -1.8% -1.6% -1.4% 99.1% 106.9% 99.2% average 0.0% -6.1% -6.2% -1.7% -1.5% -1.3% 98.8% 106.8% 99.2%
Table 3
Video Video Synth
PSNR/ PSNR/ PSNR/ Enc Dec Ren
Video 0 Video 1 Video 2
video total total time time time bitrate bitrate bitrate
Balloons 0.0% -5.0% -5.3% -1.7% -1.5% -1.4% 97.1% 99.5% 96.6%
Kendo 0.0% -2.7% -2.9% -0.8% -0.6% -0.5% 99.2% 100.3% 99.1%
NewspaperCC 0.0% -2.2% -2.0% -0.7% -0.6% 0.0% 99.6% 104.5% 100.5%
GhostTownFly 0.0% -8.5% -9.4% -1.7% -1.6% -1.5% 98.7% 108.0% 101.5%
PoznanHall2 0.0% -6.3% -5.8% -2.2% -1.9% -1.8% 99.4% 100.6% 99.0%
PoznanStreet 0.0% -3.0% -3.0% -0.7% -0.6% -0.6% 100.2% 108.5% 98.2%
UndoDancer 0.0% -2.8% -2.9% -0.6% -0.6% -0.6% 99.9% 105.7% 95.9%
1024x768 0.0% -3.3% -3.4% -1.1% -0.9% -0.6% 98.6% 101.4% 98.8%
1920x1088 0.0% -5.1% -5.3% -1.3% -1.2% -1.1% 99.6% 105.7% 98.7% average 0.0% -4.3% -4.5% -1.2% -1.1% -0.9% 99.2% 103.9% 98.7% Table 4
Figure imgf000010_0001
[0030] Fig. 3 illustrates an exemplary flowchart of a three-dimensional encoding or decoding system incorporating sub-PU based inter-view motion prediction (IVMP) according to an embodiment of the present invention. The system receives input data associated with one or more motion or disparity parameters of a current texture PU (prediction unit) in a dependent view in step 310. For encoding, the input data corresponds to the motion or disparity parameters to be encoded. For decoding, the input data corresponds to coded motion or disparity parameters to be decoded. The input data may be retrieved from memory (e.g., computer memory, buffer (RAM or DRAM) or other media) or from a processor. The current texture PU is split into texture sub-PUs as shown in step 320. Reference sub-blocks in a reference picture of a reference view corresponding to the texture sub-PUs are located as shown in step 330. The motion or disparity parameters of the reference sub-blocks are identified as shown in step 340. The motion or disparity parameters of the current texture PU are encoded or decoded based on the motion or disparity parameters of the reference sub-blocks as shown in step 350.
[0031] The flowcharts shown above are intended to illustrate examples 3D or multi-view coding with sub-PU based inter-view motion prediction according to the present invention. A person skilled in the art may modify each step, re-arranges the steps, split a step, or combine steps to practice the present invention without departing from the spirit of the present invention.
[0032] The above description is presented to enable a person of ordinary skill in the art to practice the present invention as provided in the context of a particular application and its requirement. Various modifications to the described embodiments will be apparent to those with skill in the art, and the general principles defined herein may be applied to other embodiments. Therefore, the present invention is not intended to be limited to the particular embodiments shown and described, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed. In the above detailed description, various specific details are illustrated in order to provide a thorough understanding of the present invention. Nevertheless, it will be understood by those skilled in the art that the present invention may be practiced.
[0033] Embodiment of the present invention as described above may be implemented in various hardware, software codes, or a combination of both. For example, an embodiment of the present invention can be a circuit integrated into a video compression chip or program code integrated into video compression software to perform the processing described herein. An embodiment of the present invention may also be program code to be executed on a Digital Signal Processor (DSP) to perform the processing described herein. The invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA). These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention. The software code or firmware code may be developed in different programming languages and different formats or styles. The software code may also be compiled for different target platforms. However, different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
[0034] The invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described examples are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.

Claims

1.A method for three-dimensional or multi-view video encoding or decoding, the method comprising:
receiving input data associated with one or more motion or disparity parameters of a current texture PU (prediction unit) in a dependent view;
splitting the current texture PU into texture sub-Pus;
locating reference sub-blocks in a reference picture of a reference view corresponding to the texture sub-Pus;
identifying said one or more motion or disparity parameters of the reference sub-blocks; and
encoding or decoding said one or more motion or disparity parameters of the current texture PU based on said one or more motion or disparity parameters of the reference sub-blocks.
2. The method of Claim 1, wherein a derived DV (disparity vector) is added to middle location of each texture sub-PU to locate each reference sub-block.
3. The method of Claim 1, wherein a first texture sub-PU shares the motion or disparity parameters of a neighboring sub-PU when the motion or disparity parameters of the reference sub-block corresponding to the first texture sub-PU are not available.
4. The method of Claim 1, wherein a first texture sub-PU uses default motion or disparity parameters when the motion or disparity parameters of the reference sub-block corresponding to the first texture sub-PU are not available.
5. The method of Claim 1, wherein if a first reference sub-block is a motion compensated prediction (MCP) block, the motion or disparity parameters of the first reference sub-block are used as candidate motion parameters in a temporal direction for the texture sub-PU corresponding to the first reference sub-block; and otherwise when the first reference sub-block is a disparity compensated prediction (DCP) block, the motion or disparity parameters of the first reference sub-block are used as candidate disparity parameters in an inter-view direction for the texture sub-PU corresponding to the first reference sub-block.
6. The method of Claim 1, wherein when a first reference sub-block is a disparity compensated prediction (DCP) block, the texture sub-PU corresponding to the first reference sub-block is assigned a same motion vector and POC (Picture Order Count) of the first reference sub-block.
7. The method of Claim 1 , wherein when the reference picture is in an inter-view direction, a motion vector or disparity vector of a first reference sub-block is scaled to generate the motion vector of the texture sub-PU corresponding to the first reference sub-block.
8. The method of Claim 1, wherein a motion vector of a first reference sub-block is scaled to generate the motion vector of the texture sub-PU corresponding to the first reference sub-block when POC (Picture Order Count) of a first reference picture for the first reference sub-block is different from the POC of a second reference picture for the texture sub-PU.
9. The method of Claim 1 , wherein an individual DV (disparity vector) or a unified derived DV is used to locate each reference sub-block corresponding to each texture sub-PU.
10. The method of Claim 9, wherein the unified derived DV is signaled explicitly to a decoder or is derived implicitly by the decoder.
11.The method of Claim 9, wherein the unified derived DV is selected from a plurality of
DV candidates and DV selection information is signaled explicitly to a decoder or is derived implicitly by the decoder.
12. The method of Claim 1, wherein candidate motion or disparity parameters for the current texture PU comprise one or more candidate motion or disparity parameters derived for at least one texture sub-PU from splitting the current texture PU.
13. The method of Claim 12, wherein the candidate motion or disparity parameters for the current texture PU are used as a sub-block-based inter-view Merge candidate for the current texture PU in Merge mode.
14. The method of Claim 13, wherein the sub-block-based inter-view merge candidate is inserted into a first position of a candidate list.
15. The method of Claim 13, wherein the current texture PU has more than one sub-block-based inter-view merge candidates corresponding to different sub-PU sizes, and each sub-PU size includes one or more block sizes smaller than or equal to a PU size.
16. The method of Claim 1, wherein texture sub-PU size is selected from a group.
17. The method of Claim 16, wherein the current texture PU is not further divided when the texture sub-PU size is larger than or equal to the current texture PU size.
18. The method of Claim 16, wherein a flag is signaled to indicate the texture sub-PU size, a partition level of texture sub-PU partition, a quadtree/split depth for the texture sub-PU partition, or whether the current texture PU is divided into the texture sub-Pus.
19. The method of Claim 18, wherein the flag is explicitly transmitted in a sequence level, view level, picture level, or slice level of a bitstream, or the flag is implicitly derived on decoder side.
20. The method of Claim 19, wherein the flag is implicitly derived according to mode selections, the motion parameters of one or more neighboring PUs, or according to the motion parameters of the reference sub-blocks of the sub-PUs.
PCT/CN2014/081931 2013-07-12 2014-07-10 Method of sub-prediction unit inter-view motion predition in 3d video coding WO2015003635A1 (en)

Priority Applications (8)

Application Number Priority Date Filing Date Title
CN201480028930.6A CN105247858A (en) 2013-07-12 2014-07-10 Method of sub-prediction unit inter-view motion predition in 3d video coding
AU2014289739A AU2014289739A1 (en) 2013-07-12 2014-07-10 Method of sub-prediction unit inter-view motion predition in 3D video coding
US14/891,822 US10165252B2 (en) 2013-07-12 2014-07-10 Method of sub-prediction unit inter-view motion prediction in 3D video coding
EP14822485.0A EP2997730A4 (en) 2013-07-12 2014-07-10 Method of sub-prediction unit inter-view motion predition in 3d video coding
AU2017202368A AU2017202368A1 (en) 2013-07-12 2017-04-11 Method of sub-prediction unit inter-view motion prediction in 3d video coding
US16/171,149 US10587859B2 (en) 2013-07-12 2018-10-25 Method of sub-predication unit inter-view motion prediction in 3D video coding
AU2019201221A AU2019201221A1 (en) 2013-07-12 2019-02-21 Method of sub-prediction unit inter-view motion prediction in 3D video coding
AU2021201240A AU2021201240B2 (en) 2013-07-12 2021-02-25 Method of sub-prediction unit inter-view motion prediction in 3D video coding

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CNPCT/CN2013/079287 2013-07-12
PCT/CN2013/079287 WO2015003383A1 (en) 2013-07-12 2013-07-12 Methods for inter-view motion prediction

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US14/891,822 A-371-Of-International US10165252B2 (en) 2013-07-12 2014-07-10 Method of sub-prediction unit inter-view motion prediction in 3D video coding
US16/171,149 Continuation US10587859B2 (en) 2013-07-12 2018-10-25 Method of sub-predication unit inter-view motion prediction in 3D video coding

Publications (1)

Publication Number Publication Date
WO2015003635A1 true WO2015003635A1 (en) 2015-01-15

Family

ID=52279329

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/CN2013/079287 WO2015003383A1 (en) 2013-07-12 2013-07-12 Methods for inter-view motion prediction
PCT/CN2014/081931 WO2015003635A1 (en) 2013-07-12 2014-07-10 Method of sub-prediction unit inter-view motion predition in 3d video coding

Family Applications Before (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/079287 WO2015003383A1 (en) 2013-07-12 2013-07-12 Methods for inter-view motion prediction

Country Status (4)

Country Link
US (2) US10165252B2 (en)
EP (1) EP2997730A4 (en)
AU (4) AU2014289739A1 (en)
WO (2) WO2015003383A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016123476A1 (en) * 2015-01-30 2016-08-04 Qualcomm Incorporated Flexible partitioning of prediction units

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105556970B (en) * 2013-07-12 2019-01-11 三星电子株式会社 Use the method for video coding and its equipment, video encoding/decoding method and its equipment of amendment vector derivation
KR102216128B1 (en) * 2013-07-24 2021-02-16 삼성전자주식회사 Method and apparatus for determining motion vector
ES2906238T3 (en) * 2013-07-24 2022-04-13 Qualcomm Inc Simplified Advanced Motion Prediction for 3D-HEVC
US9948915B2 (en) * 2013-07-24 2018-04-17 Qualcomm Incorporated Sub-PU motion prediction for texture and depth coding
EP3059970B1 (en) * 2013-10-18 2020-01-08 LG Electronics Inc. Method predicting view synthesis in multi-view video coding and method for constituting merge candidate list by using same
CN110381317B (en) * 2014-01-03 2022-12-02 庆熙大学校产学协力团 Method and apparatus for deriving motion information between time points of sub-prediction units
CN106105212A (en) 2014-03-07 2016-11-09 高通股份有限公司 Sub-predicting unit (SUB PU) kinematic parameter simplifying inherits (MPI)
US10218957B2 (en) * 2014-06-20 2019-02-26 Hfi Innovation Inc. Method of sub-PU syntax signaling and illumination compensation for 3D and multi-view video coding
KR102447511B1 (en) * 2016-10-11 2022-09-26 엘지전자 주식회사 Image decoding method and apparatus relying on intra prediction in image coding system
KR102471076B1 (en) * 2017-09-19 2022-11-25 삼성전자주식회사 Encoding and decoding method of motion information, and encoding and decoding apparatus of motion information
WO2019118536A1 (en) 2017-12-14 2019-06-20 Interdigital Vc Holdings, Inc. Texture-based partitioning decisions for video compression
WO2020075053A1 (en) 2018-10-08 2020-04-16 Beijing Bytedance Network Technology Co., Ltd. Generation and usage of combined affine merge candidate
WO2020084476A1 (en) 2018-10-22 2020-04-30 Beijing Bytedance Network Technology Co., Ltd. Sub-block based prediction
WO2020084553A1 (en) 2018-10-24 2020-04-30 Beijing Bytedance Network Technology Co., Ltd. Motion candidate derivation based on multiple information in sub-block motion vector prediction
JP7334246B2 (en) 2018-11-12 2023-08-28 北京字節跳動網絡技術有限公司 Simplification of inter-intra compound prediction
CN113170171B (en) 2018-11-20 2024-04-12 北京字节跳动网络技术有限公司 Prediction refinement combining inter intra prediction modes
CN113056914B (en) 2018-11-20 2024-03-01 北京字节跳动网络技术有限公司 Partial position based difference calculation
WO2020103940A1 (en) 2018-11-22 2020-05-28 Beijing Bytedance Network Technology Co., Ltd. Coordination method for sub-block based inter prediction
EP3915259A4 (en) 2019-03-06 2022-03-30 Beijing Bytedance Network Technology Co., Ltd. Usage of converted uni-prediction candidate
CN113647099B (en) 2019-04-02 2022-10-04 北京字节跳动网络技术有限公司 Decoder-side motion vector derivation
JP7323641B2 (en) 2019-05-21 2023-08-08 北京字節跳動網絡技術有限公司 Adaptive Motion Vector Differential Decomposition for Affine Modes
CN113966616B (en) 2019-06-04 2023-11-14 北京字节跳动网络技术有限公司 Motion candidate list construction using neighboring block information
CN114097228B (en) 2019-06-04 2023-12-15 北京字节跳动网络技术有限公司 Motion candidate list with geometric partition mode coding
CN117354507A (en) 2019-06-06 2024-01-05 北京字节跳动网络技术有限公司 Motion candidate list construction for video coding and decoding
CN114128258B (en) 2019-07-14 2023-12-22 北京字节跳动网络技术有限公司 Restriction of transform block size in video codec
WO2021027774A1 (en) 2019-08-10 2021-02-18 Beijing Bytedance Network Technology Co., Ltd. Subpicture dependent signaling in video bitstreams
EP3997877A4 (en) 2019-08-13 2023-05-24 Beijing Bytedance Network Technology Co., Ltd. Motion precision in sub-block based inter prediction
CN114424553A (en) 2019-09-22 2022-04-29 北京字节跳动网络技术有限公司 Inter-frame prediction scaling method based on sub-blocks
WO2021057996A1 (en) 2019-09-28 2021-04-01 Beijing Bytedance Network Technology Co., Ltd. Geometric partitioning mode in video coding
EP4333431A1 (en) 2019-10-18 2024-03-06 Beijing Bytedance Network Technology Co., Ltd. Syntax constraints in parameter set signaling of subpictures
US11871143B2 (en) 2020-09-17 2024-01-09 Lemon Inc. Subpicture tracks in coded video

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101222639A (en) * 2007-01-09 2008-07-16 华为技术有限公司 Inter-view prediction method, encoder and decoder of multi-viewpoint video technology
KR20100056757A (en) * 2008-11-20 2010-05-28 한국전자통신연구원 Apparatus and method for playback of contents based on scene description
US20120229602A1 (en) * 2011-03-10 2012-09-13 Qualcomm Incorporated Coding multiview video plus depth content
CN102790892A (en) * 2012-07-05 2012-11-21 清华大学 Depth map coding method and device
WO2013030456A1 (en) * 2011-08-30 2013-03-07 Nokia Corporation An apparatus, a method and a computer program for video coding and decoding
WO2013053309A1 (en) * 2011-10-11 2013-04-18 Mediatek Inc. Method and apparatus of motion and disparity vector derivation for 3d video coding and hevc
WO2013068548A2 (en) 2011-11-11 2013-05-16 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Efficient multi-view coding using depth-map estimate for a dependent view

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011146980A (en) 2010-01-15 2011-07-28 Sony Corp Image processor and image processing method
KR20140011481A (en) * 2011-06-15 2014-01-28 미디어텍 인크. Method and apparatus of motion and disparity vector prediction and compensation for 3d video coding
EP2579592A1 (en) * 2011-10-04 2013-04-10 Thomson Licensing Method and device for inter-view-predictive encoding of data of a view, device for decoding and computer-readable storage medium carrying encoded data of a view
US9525861B2 (en) * 2012-03-14 2016-12-20 Qualcomm Incorporated Disparity vector prediction in video coding

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101222639A (en) * 2007-01-09 2008-07-16 华为技术有限公司 Inter-view prediction method, encoder and decoder of multi-viewpoint video technology
KR20100056757A (en) * 2008-11-20 2010-05-28 한국전자통신연구원 Apparatus and method for playback of contents based on scene description
US20120229602A1 (en) * 2011-03-10 2012-09-13 Qualcomm Incorporated Coding multiview video plus depth content
WO2013030456A1 (en) * 2011-08-30 2013-03-07 Nokia Corporation An apparatus, a method and a computer program for video coding and decoding
WO2013053309A1 (en) * 2011-10-11 2013-04-18 Mediatek Inc. Method and apparatus of motion and disparity vector derivation for 3d video coding and hevc
WO2013068548A2 (en) 2011-11-11 2013-05-16 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Efficient multi-view coding using depth-map estimate for a dependent view
CN102790892A (en) * 2012-07-05 2012-11-21 清华大学 Depth map coding method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2997730A4

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016123476A1 (en) * 2015-01-30 2016-08-04 Qualcomm Incorporated Flexible partitioning of prediction units
CN107211125A (en) * 2015-01-30 2017-09-26 高通股份有限公司 The flexible partition of predicting unit
US10070130B2 (en) 2015-01-30 2018-09-04 Qualcomm Incorporated Flexible partitioning of prediction units

Also Published As

Publication number Publication date
AU2021201240B2 (en) 2022-09-08
EP2997730A1 (en) 2016-03-23
US20160134857A1 (en) 2016-05-12
WO2015003383A1 (en) 2015-01-15
AU2021201240A1 (en) 2021-03-11
US10165252B2 (en) 2018-12-25
AU2014289739A1 (en) 2015-11-05
AU2019201221A1 (en) 2019-03-14
AU2017202368A1 (en) 2017-05-04
US10587859B2 (en) 2020-03-10
US20190068948A1 (en) 2019-02-28
EP2997730A4 (en) 2016-11-16

Similar Documents

Publication Publication Date Title
AU2021201240B2 (en) Method of sub-prediction unit inter-view motion prediction in 3D video coding
US9918068B2 (en) Method and apparatus of texture image compress in 3D video coding
US10116964B2 (en) Method of sub-prediction unit prediction in 3D video coding
US10264281B2 (en) Method and apparatus of inter-view candidate derivation in 3D video coding
EP3059970A1 (en) Method predicting view synthesis in multi-view video coding and method for constituting merge candidate list by using same
US9992494B2 (en) Method of depth based block partitioning
US20150172714A1 (en) METHOD AND APPARATUS of INTER-VIEW SUB-PARTITION PREDICTION in 3D VIDEO CODING
US9596484B2 (en) Method of depth intra prediction using depth map modelling
JP2016513924A (en) Method and apparatus for deriving inter-view candidate for 3D video coding
US20150382019A1 (en) Method and Apparatus of View Synthesis Prediction in 3D Video Coding
WO2014000664A1 (en) Method and apparatus of disparity vector derivation in 3d video coding
US20160057453A1 (en) Method and Apparatus of Camera Parameter Signaling in 3D Video Coding
EP2984821A1 (en) Method and apparatus of compatible depth dependent coding
US20150264356A1 (en) Method of Simplified Depth Based Block Partitioning
US20160119643A1 (en) Method and Apparatus for Advanced Temporal Residual Prediction in Three-Dimensional Video Coding
WO2014166349A1 (en) Method and apparatus of disparity vector derivation for three-dimensional and multi-view video coding
CN105247858A (en) Method of sub-prediction unit inter-view motion predition in 3d video coding

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14822485

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2014289739

Country of ref document: AU

Date of ref document: 20140710

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 14891822

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2014822485

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE