SG11201803682RA - Encoding apparatus and encoding method, decoding apparatus and decoding method - Google Patents

Encoding apparatus and encoding method, decoding apparatus and decoding method

Info

Publication number
SG11201803682RA
SG11201803682RA SG11201803682RA SG11201803682RA SG11201803682RA SG 11201803682R A SG11201803682R A SG 11201803682RA SG 11201803682R A SG11201803682R A SG 11201803682RA SG 11201803682R A SG11201803682R A SG 11201803682RA SG 11201803682R A SG11201803682R A SG 11201803682RA
Authority
SG
Singapore
Prior art keywords
image data
encoding
decoding
dimensional
dimensional image
Prior art date
Application number
SG11201803682RA
Inventor
Junichi Tanaka
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of SG11201803682RA publication Critical patent/SG11201803682RA/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178—Metadata, e.g. disparity information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/246—Calibration of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/257—Colour aspects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
    • H04N13/268—Image signal generators with monoscopic-to-stereoscopic image conversion based on depth image-based rendering [DIBR]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • H04N13/279—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals the virtual viewpoint locations being selected by the viewers or determined by tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/286—Image signal generators having separate monoscopic and stereoscopic modes
    • H04N13/289—Switching between monoscopic and stereoscopic modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/296—Synchronisation thereof; Control thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/36—Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00—Details of stereoscopic systems
    • H04N2213/003—Aspects relating to the "2D+depth" image format

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Library & Information Science (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

ENCODING APPARATUS AND ENCODING METHOD, DECODING APPARATUS AND DECODING METHOD [] The present disclosure relates to an encoding apparatus and an encoding method as well as a decoding apparatus and a decoding method that make it possible to acquire two-dimensional image data of a viewpoint corresponding to a predetermined display image generation method and depth image data without depending upon the viewpoint upon image pickup. A conversion unit generates, from three-dimensional data of an image pickup object generated from two- dimensional image data of a plurality of viewpoints, two- dimensional image data of a plurality of viewpoints corresponding to a predetermined display image generation method and depth image data indicative of a position of each of pixels in a depthwise direction of the image pickup object. An encoding unit encodes the two- dimensional image data and the depth image data generated by the conversion unit. A transmission unit transmits the two-dimensional image data and the depth image data encoded by the encoding unit. The present disclosure can be applied, for example, to an encoding apparatus and so forth. Figure 1
SG11201803682RA 2015-11-11 2016-10-28 Encoding apparatus and encoding method, decoding apparatus and decoding method SG11201803682RA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015221233 2015-11-11
PCT/JP2016/082024 WO2017082076A1 (en) 2015-11-11 2016-10-28 Encoding device and encoding method, and decoding device and decoding method

Publications (1)

Publication Number Publication Date
SG11201803682RA true SG11201803682RA (en) 2018-06-28

Family

ID=58695131

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201803682RA SG11201803682RA (en) 2015-11-11 2016-10-28 Encoding apparatus and encoding method, decoding apparatus and decoding method

Country Status (14)

Country Link
US (1) US11716487B2 (en)
EP (1) EP3343914A4 (en)
JP (3) JP6384744B2 (en)
KR (1) KR102516992B1 (en)
CN (2) CN113286137B (en)
AU (2) AU2016352648A1 (en)
BR (1) BR112018009070A8 (en)
CA (1) CA3004241A1 (en)
MX (1) MX2018005501A (en)
PH (1) PH12018500977A1 (en)
RU (1) RU2721678C2 (en)
SG (1) SG11201803682RA (en)
WO (1) WO2017082076A1 (en)
ZA (1) ZA201802193B (en)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10269181B2 (en) * 2017-05-31 2019-04-23 Verizon Patent And Licensing Inc. Methods and systems for generating a virtualized projection of a customized view of a real-world scene for inclusion within virtual reality media content
US10311630B2 (en) * 2017-05-31 2019-06-04 Verizon Patent And Licensing Inc. Methods and systems for rendering frames of a virtual scene from different vantage points based on a virtual entity description frame of the virtual scene
JP7003994B2 (en) * 2017-08-08 2022-01-21 ソニーグループ株式会社 Image processing equipment and methods
JP7119425B2 (en) 2018-03-01 2022-08-17 ソニーグループ株式会社 Image processing device, encoding device, decoding device, image processing method, program, encoding method and decoding method
CN108769643A (en) * 2018-06-15 2018-11-06 深圳超多维科技有限公司 Video capture method, apparatus and system
CN112369016A (en) * 2018-07-06 2021-02-12 索尼公司 Information processing apparatus, information processing method, and program
CN110876050B (en) * 2018-08-31 2021-08-20 盎锐（上海）信息科技有限公司 Data processing device and method based on 3D camera
JP2020086700A (en) 2018-11-20 2020-06-04 ソニー株式会社 Image processing device, image processing method, program, and display device
JP2020095465A (en) 2018-12-12 2020-06-18 ソニー株式会社 Image processing device, image processing method, and program
JP2022028091A (en) 2018-12-19 2022-02-15 ソニーグループ株式会社 Image processing device, image processing method, and program
US11825066B2 (en) 2018-12-25 2023-11-21 Sony Corporation Video reproduction apparatus, reproduction method, and program
WO2020181073A1 (en) 2019-03-07 2020-09-10 Alibaba Group Holding Limited Method, apparatus, terminal, capturing system and device for setting capturing devices
CN111669570B (en) * 2019-03-07 2023-12-19 阿里巴巴集团控股有限公司 Multi-angle free view video data processing method and device, medium and equipment
JPWO2020262261A1 (en) 2019-06-28 2020-12-30
EP4026094A4 (en) * 2019-10-07 2022-11-09 Huawei Technologies Co., Ltd. Video-based point cloud compression (v-pcc) timing information
CN114556433A (en) 2019-10-21 2022-05-27 索尼集团公司 Information processing device, 3D data generation method, and program
CN112788325B (en) * 2019-11-06 2023-06-02 Oppo广东移动通信有限公司 Image processing method, encoding device, decoding device and storage medium
JP2021099430A (en) * 2019-12-23 2021-07-01 セイコーエプソン株式会社 Control method for display unit and display unit
KR102242710B1 (en) * 2019-12-31 2021-04-22 서울과학기술대학교 산학협력단 Apparatus for providing half free-viewpoint video
JPWO2021187093A1 (en) 2020-03-17 2021-09-23
US20230260199A1 (en) * 2020-07-30 2023-08-17 Sony Group Corporation Information processing device, information processing method, video distribution method, and information processing system
CN114926605B (en) * 2022-07-19 2022-09-30 北京飞渡科技有限公司 Shell extraction method of three-dimensional model

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3231618B2 (en) * 1996-04-23 2001-11-26 日本電気株式会社 3D image encoding / decoding system
US20050185711A1 (en) * 2004-02-20 2005-08-25 Hanspeter Pfister 3D television system and method
US8244025B2 (en) * 2006-03-20 2012-08-14 Siemens Energy, Inc. Method of coalescing information about inspected objects
US8345751B2 (en) * 2007-06-26 2013-01-01 Koninklijke Philips Electronics N.V. Method and system for encoding a 3D video signal, enclosed 3D video signal, method and system for decoder for a 3D video signal
CN101453662B (en) * 2007-12-03 2012-04-04 华为技术有限公司 Stereo video communication terminal, system and method
CN101472190B (en) * 2007-12-28 2013-01-23 华为终端有限公司 Multi-visual angle filming and image processing apparatus and system
WO2009131703A2 (en) * 2008-04-25 2009-10-29 Thomson Licensing Coding of depth signal
JP5035195B2 (en) 2008-09-25 2012-09-26 Ｋｄｄｉ株式会社 Image generating apparatus and program
EP2197217A1 (en) * 2008-12-15 2010-06-16 Koninklijke Philips Electronics N.V. Image based 3D video format
JP2010157821A (en) * 2008-12-26 2010-07-15 Victor Co Of Japan Ltd Image encoder, image encoding method, and program of the same
US8750632B2 (en) 2008-12-26 2014-06-10 JVC Kenwood Corporation Apparatus and method for encoding images from multiple viewpoints and associated depth information
JP4821846B2 (en) * 2008-12-26 2011-11-24 日本ビクター株式会社 Image encoding apparatus, image encoding method and program thereof
JP2010157823A (en) 2008-12-26 2010-07-15 Victor Co Of Japan Ltd Image encoder, image encoding method, and program of the same
BRPI1013339B1 (en) * 2009-02-19 2021-09-21 Interdigital Madison Patent Holdings METHOD AND APPARATUS FOR ENCODING VIDEO, METHOD AND APPARATUS FOR DECODING VIDEO, VIDEO SIGNAL FORMATTED TO INCLUDE INFORMATION AND MEDIA READABLE BY PROCESSOR
KR101694821B1 (en) * 2010-01-28 2017-01-11 삼성전자주식회사 Method and apparatus for transmitting digital broadcasting stream using linking information of multi-view video stream, and Method and apparatus for receiving the same
JP2012023488A (en) * 2010-07-13 2012-02-02 Ntt Docomo Inc Image processor, image processing method, display device, and program
HU1000640D0 (en) * 2010-11-29 2011-02-28 Holografika Hologrameloeallito Fejlesztoe Es Forgalmazo Kft Image coding and decoding method and apparatus for efficient encoding and decoding of 3d field content
EP2668634B1 (en) * 2011-01-24 2019-04-24 Intel Corporation Method and system for acquisition, representation, compression, and transmission of three-dimensional data
CN102724520A (en) * 2011-03-29 2012-10-10 青岛海信电器股份有限公司 Method and system for processing videos
US20120314031A1 (en) * 2011-06-07 2012-12-13 Microsoft Corporation Invariant features for computer vision
US9351028B2 (en) * 2011-07-14 2016-05-24 Qualcomm Incorporated Wireless 3D streaming server
JP2013211777A (en) * 2012-03-30 2013-10-10 Sharp Corp Image coding device, image decoding device, image coding method, image decoding method and program
KR102126532B1 (en) * 2013-09-30 2020-06-24 엘지디스플레이 주식회사 Method of multi-view image formation and stereoscopic image display device using the same
GB2525170A (en) 2014-04-07 2015-10-21 Nokia Technologies Oy Stereo viewing
CN107155341B (en) * 2014-07-31 2020-01-10 惠普发展公司，有限责任合伙企业 Three-dimensional scanning system and frame
US20170004647A1 (en) * 2015-06-30 2017-01-05 Microsoft Technology Licensing, Llc Rendering graphics data on demand

Also Published As

Publication number Publication date
JP2018182755A (en) 2018-11-15
ZA201802193B (en) 2020-08-26
US11716487B2 (en) 2023-08-01
CN108353157A (en) 2018-07-31
CN113286137A (en) 2021-08-20
WO2017082076A1 (en) 2017-05-18
JP6384744B2 (en) 2018-09-05
BR112018009070A2 (en) 2018-10-30
RU2018116473A (en) 2019-11-05
CA3004241A1 (en) 2017-05-18
EP3343914A4 (en) 2019-04-10
KR102516992B1 (en) 2023-04-04
CN113286137B (en) 2024-02-02
MX2018005501A (en) 2018-08-01
KR20180081720A (en) 2018-07-17
AU2016352648A1 (en) 2018-05-10
CN108353157B (en) 2021-06-08
JPWO2017082076A1 (en) 2018-07-26
US20180302647A1 (en) 2018-10-18
AU2021203450B2 (en) 2022-11-24
AU2021203450A1 (en) 2021-06-24
JP7143905B2 (en) 2022-09-29
BR112018009070A8 (en) 2019-02-26
PH12018500977A1 (en) 2019-01-28
RU2721678C2 (en) 2020-05-21
RU2018116473A3 (en) 2019-11-05
JP2021072639A (en) 2021-05-06
EP3343914A1 (en) 2018-07-04
JP6872131B2 (en) 2021-05-19

Similar Documents

Publication Publication Date Title
SG11201803682RA (en) Encoding apparatus and encoding method, decoding apparatus and decoding method
MX352224B (en) Image processing device and image processing method.
WO2014134174A3 (en) Neighboring block disparity vector derivation in 3d video coding
KR20180084705A (en) Method and apparatus for video encoding with in-loop filtering based on tree-structured data unit, method and apparatus for video decoding with the same
WO2014165651A3 (en) Advanced merge mode for three-dimensional (3d) video coding
MX2016000538A (en) Image processing device and method.
GB201301955D0 (en) System and method for real time 2D to 3D conversion of video in a Digital Camera
IN2014CN01784A (en)
EP2618303A3 (en) Image processing method and apparatus for generating disparity value
WO2014153340A3 (en) Simplifications on disparity vector derivation and motion vector prediction in 3d video coding
EP2582135A4 (en) 3d video encoding/decoding apparatus and 3d video encoding/decoding method using depth transition data
WO2014026130A3 (en) Transform-domain intra prediction
GB2546861B (en) 3D model generation from 2D images
PH12015501711A1 (en) System for generating intermediate view images
WO2013022401A3 (en) Method and apparatus for creating a disocclusion map used for coding a three-dimensional video
PH12014501683A1 (en) Encoding device and encoding method, and decoding device and decoding method
MX2014015341A (en) Method and device for processing video signal.
PL3813365T3 (en) Rendering wide color gamut, two-dimensional (2d) images on three-dimensional (3d) capable displays
WO2012112142A9 (en) Apparatus and method for generating a disparity map in a receiving device
GB201205758D0 (en) An apparatus and method
MX2015013890A (en) Re-targeting a three-dimensional image signal.
WO2011087279A3 (en) Stereoscopic image conversion method and stereoscopic image conversion device
WO2014084613A3 (en) Method for encoding and decoding image using depth information, and device and image system using same
GB201108037D0 (en) Video processing method and apparatus for use with a sequence of stereoscopic images
EP2469867A3 (en) Image processing apparatus and image processing method