HK1143479A1 - Synthesizing virtual images from texture and depth images - Google Patents

Synthesizing virtual images from texture and depth images

Info

Publication number
HK1143479A1
HK1143479A1 HK10109897.3A HK10109897A HK1143479A1 HK 1143479 A1 HK1143479 A1 HK 1143479A1 HK 10109897 A HK10109897 A HK 10109897A HK 1143479 A1 HK1143479 A1 HK 1143479A1
Authority
HK
Hong Kong
Prior art keywords
images
texture
depth
synthesizing virtual
synthesizing
Prior art date
Application number
HK10109897.3A
Other languages
English (en)
Chinese (zh)
Inventor
Sehoon Yea
Kwan-Jung Oh
Anthony Vetro
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Publication of HK1143479A1 publication Critical patent/HK1143479A1/xx

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration using local operators
    • G06T5/30—Erosion or dilatation, e.g. thinning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/40—Image enhancement or restoration using histogram techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/90—Dynamic range modification of images or parts thereof
    • G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20024—Filtering details
    • G06T2207/20028—Bilateral filtering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20036—Morphological image processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Computing Systems (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Image Analysis (AREA)
  • Image Generation (AREA)
HK10109897.3A 2009-03-17 2010-10-19 Synthesizing virtual images from texture and depth images HK1143479A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US12/405,912 US8395642B2 (en) 2009-03-17 2009-03-17 Method for virtual image synthesis

Publications (1)

Publication Number Publication Date
HK1143479A1 true HK1143479A1 (en) 2010-12-31

Family

ID=42223434

Family Applications (1)

Application Number Title Priority Date Filing Date
HK10109897.3A HK1143479A1 (en) 2009-03-17 2010-10-19 Synthesizing virtual images from texture and depth images

Country Status (4)

Country Link
US (1) US8395642B2 (ja)
EP (1) EP2230855B1 (ja)
JP (1) JP5419744B2 (ja)
HK (1) HK1143479A1 (ja)

Families Citing this family (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120269458A1 (en) * 2007-12-11 2012-10-25 Graziosi Danillo B Method for Generating High Resolution Depth Images from Low Resolution Depth Images Using Edge Layers
US8295546B2 (en) 2009-01-30 2012-10-23 Microsoft Corporation Pose tracking pipeline
US20100195867A1 (en) * 2009-01-30 2010-08-05 Microsoft Corporation Visual target tracking using model fitting and exemplar
US8189943B2 (en) * 2009-03-17 2012-05-29 Mitsubishi Electric Research Laboratories, Inc. Method for up-sampling depth images
US8284237B2 (en) 2009-09-09 2012-10-09 Nokia Corporation Rendering multiview content in a 3D video system
US8643701B2 (en) 2009-11-18 2014-02-04 University Of Illinois At Urbana-Champaign System for executing 3D propagation for depth image-based rendering
JP5150698B2 (ja) * 2010-09-30 2013-02-20 株式会社東芝 デプス補正装置及び方法
JP5858380B2 (ja) * 2010-12-03 2016-02-10 国立大学法人名古屋大学 仮想視点画像合成方法及び仮想視点画像合成システム
WO2012096530A2 (en) * 2011-01-13 2012-07-19 Samsung Electronics Co., Ltd. Multi-view rendering apparatus and method using background pixel expansion and background-first patch matching
US20120206440A1 (en) * 2011-02-14 2012-08-16 Dong Tian Method for Generating Virtual Images of Scenes Using Trellis Structures
US9661301B2 (en) * 2011-02-18 2017-05-23 Sony Corporation Image processing device and image processing method
TWI419078B (zh) * 2011-03-25 2013-12-11 Univ Chung Hua 即時立體影像產生裝置與方法
JP5824896B2 (ja) * 2011-06-17 2015-12-02 ソニー株式会社 画像処理装置および方法、並びにプログラム
US9300946B2 (en) 2011-07-08 2016-03-29 Personify, Inc. System and method for generating a depth map and fusing images from a camera array
WO2013062944A1 (en) * 2011-10-26 2013-05-02 The Regents Of The University Of California Multi view synthesis method and display devices with spatial and inter-view consistency
JP5983935B2 (ja) 2011-11-30 2016-09-06 パナソニックＩｐマネジメント株式会社 新視点画像生成装置および新視点画像生成方法
US8811938B2 (en) 2011-12-16 2014-08-19 Microsoft Corporation Providing a user interface experience based on inferred vehicle state
KR20130073459A (ko) * 2011-12-23 2013-07-03 삼성전자주식회사 멀티-뷰 생성 방법 및 장치
KR101707463B1 (ko) * 2011-12-29 2017-02-16 인텔 코포레이션 가변 깊이 압축
US20130202194A1 (en) * 2012-02-05 2013-08-08 Danillo Bracco Graziosi Method for generating high resolution depth images from low resolution depth images using edge information
TWI478095B (zh) * 2012-02-07 2015-03-21 Nat Univ Chung Cheng Check the depth of mismatch and compensation depth error of the perspective synthesis method
US20130287289A1 (en) * 2012-04-25 2013-10-31 Dong Tian Synthetic Reference Picture Generation
JP5362878B2 (ja) * 2012-05-09 2013-12-11 株式会社日立国際電気 画像処理装置及び画像処理方法
TWI462054B (zh) * 2012-05-15 2014-11-21 Nat Univ Chung Cheng Estimation Method of Image Vagueness and Evaluation Method of Image Quality
US9258562B2 (en) 2012-06-13 2016-02-09 Qualcomm Incorporated Derivation of depth map estimate
WO2014013805A1 (ja) * 2012-07-18 2014-01-23 ソニー株式会社 画像処理装置及び画像処理方法、並びに画像表示装置
JP5493155B2 (ja) * 2012-09-06 2014-05-14 シャープ株式会社 立体画像処理装置、立体画像処理方法、及びプログラム
CN104081768B (zh) * 2012-11-30 2017-03-01 松下知识产权经营株式会社 异视点图像生成装置以及异视点图像生成方法
JP2014143515A (ja) * 2013-01-23 2014-08-07 Nippon Hoso Kyokai <Nhk> 画像処理装置及び画像処理プログラム
US9639748B2 (en) * 2013-05-20 2017-05-02 Mitsubishi Electric Research Laboratories, Inc. Method for detecting persons using 1D depths and 2D texture
CN103402097B (zh) * 2013-08-15 2016-08-10 清华大学深圳研究生院 一种自由视点视频深度图编码方法及其失真预测方法
US9769498B2 (en) 2014-03-28 2017-09-19 University-Industry Cooperation Group Of Kyung Hee University Method and apparatus for encoding of video using depth information
CN103997635B (zh) * 2014-04-11 2015-10-28 清华大学深圳研究生院 自由视点视频的合成视点失真预测方法及编码方法
US9691140B2 (en) * 2014-10-31 2017-06-27 Intel Corporation Global matching of multiple images
US9900583B2 (en) * 2014-12-04 2018-02-20 Futurewei Technologies, Inc. System and method for generalized view morphing over a multi-camera mesh
US10957042B2 (en) 2015-09-22 2021-03-23 Siemens Healthcare Gmbh Auto-referencing in digital holographic microscopy reconstruction
CN108475330B (zh) * 2015-11-09 2022-04-08 港大科桥有限公司 用于有伪像感知的视图合成的辅助数据
US10107617B2 (en) 2016-07-04 2018-10-23 Beijing Qingying Machine Visual Technology Co., Ltd. Feature point matching method of planar array of four-camera group and measuring method based on the same
CN106331728B (zh) * 2016-09-06 2019-05-07 西安电子科技大学 用于多视点深度视频编码的虚拟视点合成失真预测方法
US10694202B2 (en) * 2016-12-01 2020-06-23 Qualcomm Incorporated Indication of bilateral filter usage in video coding
CN106651938B (zh) * 2017-01-17 2019-09-17 湖南优象科技有限公司 一种融合高分辨率彩色图像的深度图增强方法
US10192321B2 (en) * 2017-01-18 2019-01-29 Adobe Inc. Multi-style texture synthesis
CN108573506B (zh) * 2017-03-13 2021-12-17 北京贝塔科技股份有限公司 图像处理方法及***
WO2019001710A1 (en) 2017-06-29 2019-01-03 Huawei Technologies Co., Ltd. APPARATUSES AND METHODS FOR ENCODING AND DECODING A VIDEO CODING BLOCK OF A MULTIVATE VIDEO SIGNAL
CN107301662B (zh) * 2017-06-30 2020-09-08 深圳大学 深度图像的压缩恢复方法、装置、设备及存储介质
EP3462408A1 (en) * 2017-09-29 2019-04-03 Thomson Licensing A method for filtering spurious pixels in a depth-map
CN111713111B (zh) * 2017-12-19 2024-04-09 Vid拓展公司 用于360度视频译码的面不连续性滤波
JP7080688B2 (ja) 2018-03-22 2022-06-06 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、プログラム
US11094088B2 (en) * 2018-08-31 2021-08-17 Mediatek Inc. Method and apparatus of in-loop filtering for virtual boundaries in video coding
US11765349B2 (en) 2018-08-31 2023-09-19 Mediatek Inc. Method and apparatus of in-loop filtering for virtual boundaries
US11089335B2 (en) 2019-01-14 2021-08-10 Mediatek Inc. Method and apparatus of in-loop filtering for virtual boundaries
EP3816942A1 (en) * 2019-10-29 2021-05-05 Koninklijke Philips N.V. An image processing method for setting transparency values and color values of pixels in a virtual image
US11783444B1 (en) * 2019-11-14 2023-10-10 Apple Inc. Warping an input image based on depth and offset information
CN112637582B (zh) * 2020-12-09 2021-10-08 吉林大学 模糊边缘驱动的单目视频虚拟视图三维模糊表面合成方法

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5727080A (en) * 1995-05-03 1998-03-10 Nec Research Institute, Inc. Dynamic histogram warping of image histograms for constant image brightness, histogram matching and histogram specification
US5793886A (en) * 1996-12-19 1998-08-11 Eastman Kodak Company Method of adjusting image pixel values within an image sequence by interpolation of target cumulative histograms for images to be adjusted
US6650774B1 (en) * 1999-10-01 2003-11-18 Microsoft Corporation Locally adapted histogram equalization
US6965379B2 (en) * 2001-05-08 2005-11-15 Koninklijke Philips Electronics N.V. N-view synthesis from monocular video of certain broadcast and stored mass media content
CA2511040A1 (en) * 2004-09-23 2006-03-23 The Governors Of The University Of Alberta Method and system for real time image rendering
US7671894B2 (en) * 2004-12-17 2010-03-02 Mitsubishi Electric Research Laboratories, Inc. Method and system for processing multiview videos for view synthesis using skip and direct modes
US8228994B2 (en) * 2005-05-20 2012-07-24 Microsoft Corporation Multi-view video coding based on temporal and view decomposition
US7471292B2 (en) * 2005-11-15 2008-12-30 Sharp Laboratories Of America, Inc. Virtual view specification and synthesis in free viewpoint
EP1862969A1 (en) * 2006-06-02 2007-12-05 Eidgenössische Technische Hochschule Zürich Method and system for generating a representation of a dynamically changing 3D scene
KR101484487B1 (ko) * 2007-10-11 2015-01-28 코닌클리케 필립스 엔.브이. 깊이-맵을 프로세싱하는 방법 및 디바이스
WO2009111007A1 (en) * 2008-03-04 2009-09-11 Thomson Licensing Virtual reference view

Also Published As

Publication number Publication date
EP2230855A3 (en) 2013-09-04
EP2230855A2 (en) 2010-09-22
JP5419744B2 (ja) 2014-02-19
US8395642B2 (en) 2013-03-12
EP2230855B1 (en) 2014-10-15
JP2010218548A (ja) 2010-09-30
US20100238160A1 (en) 2010-09-23

Similar Documents

Publication Publication Date Title
HK1143479A1 (en) Synthesizing virtual images from texture and depth images
PL2399398T3 (pl) Łączenie obrazu 3d i danych graficznych
EP2409211A4 (en) HANDLING VIRTUAL OBJECTS
GB2483213B8 (en) 3D image generation
EP2348733A4 (en) METHOD AND APPARATUS FOR THE SYNTHESIS OF VIRTUAL VISUALIZATION IMAGES
GB2481099B (en) Tile rendering for image processing
TWI372264B (en) Three-dimensional image displaying apparatus
EP2380353A4 (en) IMAGE PROCESSING
SG10201401708QA (en) Image formation techniques
HK1160747A1 (en) 3d mammography 3d x
EP2484107A4 (en) IMAGING DEVICE FOR CONSTRUCTING COLOR AND DEPTH IMAGES
EP2404452A4 (en) PROCESSING A 3D VIDEO
GB2476140B (en) Image processing techniques
EP2220586A4 (en) IMPROVED PROCESSING OF VIRTUAL SCRATCHES
EP2494516A4 (en) DIGITAL WATERMARK MARKING
EP2559256A4 (en) METHODS AND ARRANGEMENTS FOR 3D SCENE REPRESENTATION
EP2457516A4 (en) THREE DIMENSIONAL ULTRASONIC SCANNER
GB0921212D0 (en) Improvements in or relating to image processing
EP2285531A4 (en) CONTAINER FOR TEXTURES
GB2462851B (en) Image processing
GB201222254D0 (en) Three-dimensional imaging
EP2443613A4 (en) PROCESS AND ARRANGEMENT FOR IMAGE PROCESSING
IL212566A0 (en) Image processing
GB2463724B (en) Forming 3D images
IL238613A0 (en) A method of creating a three-dimensional image inside a stone

Legal Events

Date Code Title Description
PC Patent ceased (i.e. patent has lapsed due to the failure to pay the renewal fee)

Effective date: 20190309