CN106255990B - 用于相机阵列的图像重对焦 - Google Patents

用于相机阵列的图像重对焦 Download PDF

Info

Publication number: CN106255990B
Authority: CN; China
Prior art keywords: image; focus image; reference picture; pyramid; basic
Prior art date: 2014-06-02
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.): Active

Application number

CN201580022261.6A

Other languages

English (en)

Chinese (zh)

Other versions

CN106255990A (zh

Inventor

O·奈斯塔尔司

姜勇

Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)

Intel Corp

Original Assignee

Intel Corp

Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)

2014-06-02

Filing date

2015-04-17

Publication date

2019-10-08

2015-04-17 Application filed by Intel Corp filed Critical Intel Corp

2016-12-21 Publication of CN106255990A publication Critical patent/CN106255990A/zh

2019-10-08 Application granted granted Critical

2019-10-08 Publication of CN106255990B publication Critical patent/CN106255990B/zh

Status Active legal-status Critical Current

2035-04-17 Anticipated expiration legal-status Critical

Links

238000012545 processing Methods 0.000 claims description 55
238000000034 method Methods 0.000 claims description 47
230000000694 effects Effects 0.000 claims description 32
238000006073 displacement reaction Methods 0.000 claims description 19
230000004044 response Effects 0.000 claims description 10
230000002829 reductive effect Effects 0.000 claims description 9
125000004122 cyclic group Chemical group 0.000 claims description 7
238000005516 engineering process Methods 0.000 abstract description 45
239000000047 product Substances 0.000 description 46
238000003860 storage Methods 0.000 description 18
238000010586 diagram Methods 0.000 description 17
230000006870 function Effects 0.000 description 14
238000004891 communication Methods 0.000 description 12
230000008569 process Effects 0.000 description 12
PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 8
239000010931 gold Substances 0.000 description 8
229910052737 gold Inorganic materials 0.000 description 8
239000000463 material Substances 0.000 description 7
230000001413 cellular effect Effects 0.000 description 5
238000001914 filtration Methods 0.000 description 5
239000000872 buffer Substances 0.000 description 4
238000004364 calculation method Methods 0.000 description 4
238000007781 pre-processing Methods 0.000 description 4
230000005540 biological transmission Effects 0.000 description 3
230000008859 change Effects 0.000 description 3
238000004519 manufacturing process Methods 0.000 description 3
238000012986 modification Methods 0.000 description 3
230000004048 modification Effects 0.000 description 3
230000003287 optical effect Effects 0.000 description 3
230000003068 static effect Effects 0.000 description 3
238000012546 transfer Methods 0.000 description 3
230000000007 visual effect Effects 0.000 description 3
241000208340 Araliaceae Species 0.000 description 2
235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 2
235000003140 Panax quinquefolius Nutrition 0.000 description 2
230000003796 beauty Effects 0.000 description 2
230000015572 biosynthetic process Effects 0.000 description 2
238000006243 chemical reaction Methods 0.000 description 2
238000004590 computer program Methods 0.000 description 2
235000008434 ginseng Nutrition 0.000 description 2
230000000670 limiting effect Effects 0.000 description 2
238000010606 normalization Methods 0.000 description 2
239000013307 optical fiber Substances 0.000 description 2
230000011514 reflex Effects 0.000 description 2
238000005070 sampling Methods 0.000 description 2
239000004065 semiconductor Substances 0.000 description 2
238000004088 simulation Methods 0.000 description 2
238000001228 spectrum Methods 0.000 description 2
238000005303 weighing Methods 0.000 description 2
238000012935 Averaging Methods 0.000 description 1
241000282693 Cercopithecidae Species 0.000 description 1
241000282373 Panthera pardus Species 0.000 description 1
238000003491 array Methods 0.000 description 1
230000000712 assembly Effects 0.000 description 1
238000000429 assembly Methods 0.000 description 1
230000003190 augmentative effect Effects 0.000 description 1
239000006227 byproduct Substances 0.000 description 1
239000003990 capacitor Substances 0.000 description 1
230000001149 cognitive effect Effects 0.000 description 1
230000001427 coherent effect Effects 0.000 description 1
239000000571 coke Substances 0.000 description 1
239000003086 colorant Substances 0.000 description 1
238000004883 computer application Methods 0.000 description 1
230000007547 defect Effects 0.000 description 1
230000009977 dual effect Effects 0.000 description 1
235000013399 edible fruits Nutrition 0.000 description 1
230000005611 electricity Effects 0.000 description 1
238000011156 evaluation Methods 0.000 description 1
238000001093 holography Methods 0.000 description 1
238000003384 imaging method Methods 0.000 description 1
230000002452 interceptive effect Effects 0.000 description 1
WABPQHHGFIMREM-UHFFFAOYSA-N lead(0) Chemical compound [Pb] WABPQHHGFIMREM-UHFFFAOYSA-N 0.000 description 1
238000013507 mapping Methods 0.000 description 1
239000003550 marker Substances 0.000 description 1
230000007246 mechanism Effects 0.000 description 1
239000002184 metal Substances 0.000 description 1
229910052751 metal Inorganic materials 0.000 description 1
238000004806 packaging method and process Methods 0.000 description 1
230000002093 peripheral effect Effects 0.000 description 1
210000001747 pupil Anatomy 0.000 description 1
230000003252 repetitive effect Effects 0.000 description 1
230000000717 retained effect Effects 0.000 description 1
238000000926 separation method Methods 0.000 description 1
238000000638 solvent extraction Methods 0.000 description 1
239000012536 storage buffer Substances 0.000 description 1
238000006467 substitution reaction Methods 0.000 description 1
230000001360 synchronised effect Effects 0.000 description 1
230000009466 transformation Effects 0.000 description 1
210000000707 wrist Anatomy 0.000 description 1

Classifications

- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/46—Colour picture communication systems
- H04N1/56—Processing of colour picture signals
- H04N1/60—Colour correction or control
- H04N1/6027—Correction or control of colour gradation or colour contrast
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/20—Image enhancement or restoration using local operators
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/40—Picture signal circuits
- H04N1/409—Edge or detail enhancement; Noise or error suppression
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/957—Light-field or plenoptic cameras or camera modules
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10052—Images from lightfield camera
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20016—Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20224—Image subtraction

Landscapes

Engineering & Computer Science (AREA)
Multimedia (AREA)
Signal Processing (AREA)
Theoretical Computer Science (AREA)
Physics & Mathematics (AREA)
General Physics & Mathematics (AREA)
Computing Systems (AREA)
Image Processing (AREA)
Studio Devices (AREA)

CN201580022261.6A 2014-06-02 2015-04-17 用于相机阵列的图像重对焦 Active CN106255990B (zh)

Applications Claiming Priority (3)

Application Number	Priority Date	Filing Date	Title
US14/293,611 US9712720B2 (en)	2014-06-02	2014-06-02	Image refocusing for camera arrays
US14/293,611		2014-06-02
PCT/US2015/026492 WO2015187250A1 (en)	2014-06-02	2015-04-17	Image refocusing for camera arrays

Publications (2)

Publication Number	Publication Date
CN106255990A CN106255990A (zh)	2016-12-21
CN106255990B true CN106255990B (zh)	2019-10-08

Family

ID=54702392

Family Applications (1)

Application Number	Title	Priority Date	Filing Date
CN201580022261.6A Active CN106255990B (zh)	2014-06-02	2015-04-17	用于相机阵列的图像重对焦

Country Status (5)

Country	Link
US (1)	US9712720B2 (ja)
EP (1)	EP3149706B1 (ja)
CN (1)	CN106255990B (ja)
BR (1)	BR112016025577B1 (ja)
WO (1)	WO2015187250A1 (ja)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
CN103942755B (zh) *	2013-01-23	2017-11-17	深圳市腾讯计算机***有限公司	图像亮度调节方法和装置
JP2014220639A (ja) *	2013-05-08	2014-11-20	ソニー株式会社	撮像装置および撮像方法
US11069038B2 (en) *	2015-03-27	2021-07-20	Sony Corporation	Information processing apparatus, information processing method, and image display apparatus
EP3331236A1 (en) *	2016-11-30	2018-06-06	Thomson Licensing	Method for rendering a final image from initial images acquired by a camera array, corresponding device, computer program product and computer-readable carrier medium
WO2018129692A1 (en)	2017-01-12	2018-07-19	Intel Corporation	Image refocusing
US10636128B2 (en) *	2018-06-18	2020-04-28	Analogic Corporation	Recursive filter for space-variant images
CN110889410B (zh)	2018-09-11	2023-10-03	苹果公司	浅景深渲染中语义分割的稳健用途
JP7263080B2 (ja) *	2019-03-29	2023-04-24	キヤノン株式会社	撮像装置及び信号処理装置
WO2020237644A1 (zh) *	2019-05-31	2020-12-03	深圳市晟视科技有限公司	一种基于fpga架构的实时景深合成算法和***
TWI782280B (zh) *	2020-06-01	2022-11-01	財團法人國家實驗研究院	應用於遙測衛星的自動對焦方法及該遙測衛星
CN117319812A (zh) *	2022-06-20	2023-12-29	北京小米移动软件有限公司	图像处理方法及装置、移动终端、存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
KR20110054196A (ko) *	2009-11-17	2011-05-25	엘지전자 주식회사	이동 단말기에서 터치를 이용한 이미지 편집 방법 및 이를 위한 장치
CN102801910A (zh) *	2011-05-27	2012-11-28	三洋电机株式会社	摄像装置
CN102857686A (zh) *	2011-06-28	2013-01-02	索尼公司	图像处理装置，控制图像处理装置的方法和程序
CN103109304A (zh) *	2010-09-23	2013-05-15	英特尔公司	从用手持拍摄装置采集的多个图像的全对焦成像的***和方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
US8494301B2 (en) *	2010-09-16	2013-07-23	Eastman Kodak Company	Refocusing images using scene captured images
US20120082372A1 (en) *	2010-10-01	2012-04-05	Siemens Corporation	Automatic document image extraction and comparison
US8922707B2 (en) *	2011-01-26	2014-12-30	Aptina Imaging Corporation	Systems and methods for luminance-based scene-change detection for continuous autofocus
US9007441B2 (en) *	2011-08-04	2015-04-14	Semiconductor Components Industries, Llc	Method of depth-based imaging using an automatic trilateral filter for 3D stereo imagers
WO2014014135A1 (ko)	2012-07-17	2014-01-23	인텔 코오퍼레이션	촬영된 이미지의 리포커싱 방법, 장치, 및 컴퓨터 판독 가능한 기록 매체

2014
- 2014-06-02 US US14/293,611 patent/US9712720B2/en active Active
2015
- 2015-04-17 EP EP15802385.3A patent/EP3149706B1/en active Active
- 2015-04-17 WO PCT/US2015/026492 patent/WO2015187250A1/en active Application Filing
- 2015-04-17 CN CN201580022261.6A patent/CN106255990B/zh active Active
- 2015-04-17 BR BR112016025577-1A patent/BR112016025577B1/pt active IP Right Grant

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
KR20110054196A (ko) *	2009-11-17	2011-05-25	엘지전자 주식회사	이동 단말기에서 터치를 이용한 이미지 편집 방법 및 이를 위한 장치
CN103109304A (zh) *	2010-09-23	2013-05-15	英特尔公司	从用手持拍摄装置采集的多个图像的全对焦成像的***和方法
CN102801910A (zh) *	2011-05-27	2012-11-28	三洋电机株式会社	摄像装置
CN102857686A (zh) *	2011-06-28	2013-01-02	索尼公司	图像处理装置，控制图像处理装置的方法和程序

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
An image restoration by fusion;TUAN D.PHAM;《Pattern Recognition》;20011231;第34卷(第12期);第2403-2411页 *
Recovery of blurred video signals using iterative image restoration combined with motion estimation;Sang Hwa Lee 等;《Proceedings of International Conference on Image Processing》;19971029;第755-758页 *
Single-Image Refocusing and Defocusing;Wei Zhang 等;《IEEE Transactions on Image Processing》;20120229;第21卷(第2期);图7 *

Also Published As

Publication number	Publication date
WO2015187250A1 (en)	2015-12-10
EP3149706B1 (en)	2022-08-17
BR112016025577B1 (pt)	2023-03-14
BR112016025577A8 (pt)	2022-12-13
CN106255990A (zh)	2016-12-21
US9712720B2 (en)	2017-07-18
US20150348239A1 (en)	2015-12-03
BR112016025577A2 (ja)	2017-08-15
EP3149706A1 (en)	2017-04-05
EP3149706A4 (en)	2017-11-01

Legal Events

Date	Code	Title
2016-12-21	C06	Publication
2016-12-21	PB01	Publication
2017-01-18	C10	Entry into substantive examination
2017-01-18	SE01	Entry into force of request for substantive examination
2019-10-08	GR01	Patent grant
2019-10-08	GR01	Patent grant

Publication	Publication Date	Title
CN106255990B (zh)	2019-10-08	用于相机阵列的图像重对焦
US11113794B2 (en)	2021-09-07	Systems and methods for generating defocus blur effects
Deschaintre et al.	2018	Single-image svbrdf capture with a rendering-aware deep network
CN109618090A (zh)	2019-04-12	对通过使用广角透镜捕获的图像的图像失真校正的方法和***
CN107925755A (zh)	2018-04-17	针对图像处理进行平面表面检测的方法和***
US20210233210A1 (en)	2021-07-29	Method and system of real-time super-resolution image processing
CN108701359A (zh)	2018-10-23	跨越具有对应深度图的视频帧跟踪兴趣区域
CN111311532B (zh)	2022-11-11	图像处理方法及装置、电子设备、存储介质
CN109660782A (zh)	2019-04-19	减少立体深度传感器成像中的纹理化ir图案
CN107079141A (zh)	2017-08-18	用于三维视频的图像拼接
Wu et al.	2010	Realistic rendering of bokeh effect based on optical aberrations
CN103533228B (zh)	2017-04-12	用于从多个图像产生完美拍摄成像的方法和***
CN108509887A (zh)	2018-09-07	一种获取环境光照信息方法、装置和电子设备
CN110324532A (zh)	2019-10-11	一种图像虚化方法、装置、存储介质及电子设备
McGraw	2015	Fast Bokeh effects using low-rank linear filters
CN106575364A (zh)	2017-04-19	使用定向滤波的目标检测
CN106464800A (zh)	2017-02-22	用于成像设备的自动防眩光曝光
CN108702460A (zh)	2018-10-23	使用显示器光来改善前置相机性能
CN105959593A (zh)	2016-09-21	一种拍照设备的曝光方法及拍照设备
CN106105214A (zh)	2016-11-09	运动估计中的回退检测
CN105989602B (zh)	2019-04-23	有噪图像中的斑点检测
EP4283566A2 (en)	2023-11-29	Single image 3d photography with soft-layering and depth-aware inpainting
CN114782460A (zh)	2022-07-22	图像分割模型的生成方法及图像的分割方法、计算机设备
Li et al.	2016	Penrose high-dynamic-range imaging
US9465212B2 (en)	2016-10-11	Flexible defocus blur for stochastic rasterization