EP3970361A4 - Immersive video coding techniques for three degree of freedom plus/metadata for immersive video (3dof+/miv) and video-point cloud coding (v-pcc) - Google Patents

Immersive video coding techniques for three degree of freedom plus/metadata for immersive video (3dof+/miv) and video-point cloud coding (v-pcc) Download PDF

Info

Publication number
EP3970361A4
EP3970361A4 EP20805154.0A EP20805154A EP3970361A4 EP 3970361 A4 EP3970361 A4 EP 3970361A4 EP 20805154 A EP20805154 A EP 20805154A EP 3970361 A4 EP3970361 A4 EP 3970361A4
Authority
EP
European Patent Office
Prior art keywords
video
immersive video
coding
3dof
miv
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20805154.0A
Other languages
German (de)
French (fr)
Other versions
EP3970361A1 (en
Inventor
Jill Boyce
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intel Corp
Original Assignee
Intel Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corp filed Critical Intel Corp
Publication of EP3970361A1 publication Critical patent/EP3970361A1/en
Publication of EP3970361A4 publication Critical patent/EP3970361A4/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178—Metadata, e.g. disparity information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Library & Information Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
EP20805154.0A 2019-05-14 2020-05-14 Immersive video coding techniques for three degree of freedom plus/metadata for immersive video (3dof+/miv) and video-point cloud coding (v-pcc) Pending EP3970361A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201962847779P 2019-05-14 2019-05-14
PCT/US2020/032953 WO2020232281A1 (en) 2019-05-14 2020-05-14 IMMERSIVE VIDEO CODING TECHNIQUES FOR THREE DEGREE OF FREEDOM PLUS/METADATA FOR IMMERSIVE VIDEO (3DoF+/MIV) AND VIDEO-POINT CLOUD CODING (V-PCC)

Publications (2)

Publication Number Publication Date
EP3970361A1 EP3970361A1 (en) 2022-03-23
EP3970361A4 true EP3970361A4 (en) 2023-03-22

Family

ID=73289301

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20805154.0A Pending EP3970361A4 (en) 2019-05-14 2020-05-14 Immersive video coding techniques for three degree of freedom plus/metadata for immersive video (3dof+/miv) and video-point cloud coding (v-pcc)

Country Status (7)

Country Link
US (1) US20220159298A1 (en)
EP (1) EP3970361A4 (en)
JP (1) JP2022532302A (en)
KR (1) KR20210155386A (en)
CN (1) CN113728625A (en)
BR (1) BR112021020654A2 (en)
WO (1) WO2020232281A1 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11013734B2 (en) 2018-05-16 2021-05-25 Forma Therapeutics, Inc. Treating patients harboring an isocitrate dehydrogenase-1 (IDH-1) mutation
WO2020261690A1 (en) * 2019-06-28 2020-12-30 ソニー株式会社 Information processing device, information processing method, reproduction processing device, and reproduction processing method
WO2021062447A2 (en) * 2020-01-06 2021-04-01 Futurewei Technologies, Inc. Signaling camera parameters in point cloud coding
US11838485B2 (en) * 2020-04-16 2023-12-05 Electronics And Telecommunications Research Institute Method for processing immersive video and method for producing immersive video
FR3109685A1 (en) * 2020-04-22 2021-10-29 Orange Methods and devices for encoding and decoding a multi-view video sequence
US20230362409A1 (en) * 2020-09-30 2023-11-09 Interdigital Ce Patent Holdings, Sas A method and apparatus for signaling depth of multi-plane images-based volumetric video
US20240249462A1 (en) * 2021-04-07 2024-07-25 Interdigital Ce Patent Holdings, Sas Volumetric video supporting light effects
CN115412717B (en) * 2021-05-26 2024-05-17 荣耀终端有限公司 Method and device for predicting coding and decoding of point cloud azimuth information
US11979606B2 (en) 2021-06-04 2024-05-07 Tencent America LLC Conditional recolor for video based point cloud coding
EP4199362A1 (en) * 2021-12-20 2023-06-21 Beijing Xiaomi Mobile Software Co., Ltd. Method and apparatus of encoding/decoding sensed point cloud geometry data
KR102666871B1 (en) * 2022-01-26 2024-05-20 한국전자통신연구원 Method and apparatus for displaying massive 3d models for ar device
WO2023219278A1 (en) * 2022-05-09 2023-11-16 현대자동차주식회사 Method for grouping and updating camera parameters for mpeg immersive video
WO2024006436A1 (en) * 2022-07-01 2024-01-04 Innopeak Technology, Inc. Bitstream encoding and decoding for geometry point cloud coding
WO2024014826A1 (en) * 2022-07-11 2024-01-18 엘지전자 주식회사 Transmission device for point cloud data, method performed by transmission device, reception device for point cloud data, and method performed by reception device
WO2024077637A1 (en) * 2022-10-14 2024-04-18 浙江大学 Encoding method and apparatus, decoding method and apparatus, encoder, decoder, and storage medium
CN116704472B (en) * 2023-05-15 2024-04-02 小米汽车科技有限公司 Image processing method, device, apparatus, medium, and program product

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9813692B2 (en) * 2015-09-25 2017-11-07 Intel Corporation Online compensation of thermal distortions in a stereo depth camera
WO2017082078A1 (en) * 2015-11-11 2017-05-18 ソニー株式会社 Image processing device and image processing method
US9721393B1 (en) * 2016-04-29 2017-08-01 Immersive Enterprises, LLC Method for processing and delivering virtual reality content to a user
EP3349182A1 (en) * 2017-01-13 2018-07-18 Thomson Licensing Method, apparatus and stream for immersive video format
KR101760639B1 (en) * 2017-03-31 2017-07-24 한국과학기술원 Immersive Display Apparatus and Method for Creation of Peripheral View corresponding to Input Video

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"Test Model for Immersive Video", no. n18470, 6 May 2019 (2019-05-06), XP030208739, Retrieved from the Internet <URL:http://phenix.int-evry.fr/mpeg/doc_end_user/documents/126_Geneva/wg11/w18470.zip w18470.docx> [retrieved on 20190506] *

Also Published As

Publication number Publication date
US20220159298A1 (en) 2022-05-19
EP3970361A1 (en) 2022-03-23
KR20210155386A (en) 2021-12-22
WO2020232281A1 (en) 2020-11-19
CN113728625A (en) 2021-11-30
JP2022532302A (en) 2022-07-14
BR112021020654A2 (en) 2022-01-25

Similar Documents

Publication Publication Date Title
EP3970361A4 (en) Immersive video coding techniques for three degree of freedom plus/metadata for immersive video (3dof+/miv) and video-point cloud coding (v-pcc)
EP4028026A4 (en) Novel nucleobase editors and methods of using same
IL291120A (en) Methods, apparatus and systems for three degrees of freedom (3dof+) extension of mpeg-h 3d audio
EP3888290A4 (en) High performance distributed system of record with conference-based consensus
EP3808087A4 (en) System and method for encoding 360-degree immersive video
EP3970366A4 (en) Handling video unit boundaries and virtual boundaries
EP4115633A4 (en) Immersive audio platform
EP3763128A4 (en) Method and apparatus of optimized splitting structure for video coding
EP4052468A4 (en) Range of minimum coding block size in video coding
EP3791568A4 (en) Piecewise hybrid video and audio synchronization
EP4082119A4 (en) Systems and methods of data compression
EP3750322A4 (en) Systems and methods for synchronizing audio and video
EP4018644A4 (en) Systems and methods for participant-controlled video conferencing
EP3811623A4 (en) Devices and methods for image and video coding
EP4025954A4 (en) Optical devices having dichroic beam combiners, optical devices for use with dichroic beam combiners, and methods of manufacture therefor
EP3789812A4 (en) Optical hybrid reality system having digital correction of aberrations
EP3973499A4 (en) Methods and systems for video stabilization
EP4038886A4 (en) Immersive video coding using object metadata
EP4035069A4 (en) Lossless coding of video data
EP3987776A4 (en) Block size dependent use of video coding mode
EP3984231A4 (en) Methods and system of subblock transform for video coding
EP3977719A4 (en) Methods and systems for video stabilization
EP4032058A4 (en) Automating the creation of listings using augmented reality computer technology
EP3895447A4 (en) Combination of immersive and binaural sound
EP3844280A4 (en) Enpp1 polypeptides and methods of using same

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210907

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20230217

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 19/70 20140101ALI20230213BHEP

Ipc: H04N 19/593 20140101ALI20230213BHEP

Ipc: H04N 19/597 20140101ALI20230213BHEP

Ipc: H04N 13/194 20180101ALI20230213BHEP

Ipc: H04N 13/161 20180101AFI20230213BHEP