CN112750076A - 一种基于深度学习的光场多视角图像超分辨率重建方法 - Google Patents
一种基于深度学习的光场多视角图像超分辨率重建方法 Download PDFInfo
- Publication number
- CN112750076A CN112750076A CN202010284067.8A CN202010284067A CN112750076A CN 112750076 A CN112750076 A CN 112750076A CN 202010284067 A CN202010284067 A CN 202010284067A CN 112750076 A CN112750076 A CN 112750076A
- Authority
- CN
- China
- Prior art keywords
- light field
- resolution
- feature
- nxn
- view
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000013135 deep learning Methods 0.000 title claims abstract description 12
- 230000004927 fusion Effects 0.000 claims abstract description 39
- 238000012549 training Methods 0.000 claims abstract description 22
- 238000000605 extraction Methods 0.000 claims abstract description 19
- 230000006870 function Effects 0.000 claims abstract description 11
- 238000005070 sampling Methods 0.000 claims abstract description 10
- 238000013507 mapping Methods 0.000 claims abstract description 8
- 230000008569 process Effects 0.000 claims description 14
- 238000010586 diagram Methods 0.000 claims description 11
- 208000037170 Delayed Emergence from Anesthesia Diseases 0.000 claims description 10
- 238000011144 upstream manufacturing Methods 0.000 claims description 6
- 230000004913 activation Effects 0.000 claims description 2
- 230000005540 biological transmission Effects 0.000 claims description 2
- 238000012937 correction Methods 0.000 claims description 2
- 210000002569 neuron Anatomy 0.000 claims description 2
- 101100295091 Arabidopsis thaliana NUDT14 gene Proteins 0.000 claims 3
- 238000010276 construction Methods 0.000 claims 1
- 238000013136 deep learning model Methods 0.000 claims 1
- 238000012545 processing Methods 0.000 description 7
- 239000011159 matrix material Substances 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 238000011156 evaluation Methods 0.000 description 4
- 230000002093 peripheral effect Effects 0.000 description 4
- 230000009466 transformation Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000001537 neural effect Effects 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000011176 pooling Methods 0.000 description 2
- ORILYTVJVMAKLC-UHFFFAOYSA-N Adamantane Natural products C1C(C2)CC3CC1CC2C3 ORILYTVJVMAKLC-UHFFFAOYSA-N 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000010835 comparative analysis Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10052—Images from lightfield camera
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Image Processing (AREA)
Abstract
Description
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010284067.8A CN112750076B (zh) | 2020-04-13 | 2020-04-13 | 一种基于深度学习的光场多视角图像超分辨率重建方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010284067.8A CN112750076B (zh) | 2020-04-13 | 2020-04-13 | 一种基于深度学习的光场多视角图像超分辨率重建方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112750076A true CN112750076A (zh) | 2021-05-04 |
CN112750076B CN112750076B (zh) | 2022-11-15 |
Family
ID=75645165
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010284067.8A Active CN112750076B (zh) | 2020-04-13 | 2020-04-13 | 一种基于深度学习的光场多视角图像超分辨率重建方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112750076B (zh) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113256772A (zh) * | 2021-05-10 | 2021-08-13 | 华中科技大学 | 一种基于视角转换的双角度光场高分辨重构***及方法 |
CN113379602A (zh) * | 2021-06-08 | 2021-09-10 | 中国科学技术大学 | 利用零样本学习的光场超分辨率增强方法 |
CN113506213A (zh) * | 2021-05-24 | 2021-10-15 | 北京航空航天大学 | 适应大视差范围的光场图像视角超分辨方法及装置 |
CN113538307A (zh) * | 2021-06-21 | 2021-10-22 | 陕西师范大学 | 基于多视角超分辨深度网络的合成孔径成像方法 |
CN113938668A (zh) * | 2021-09-07 | 2022-01-14 | 北京邮电大学 | 一种三维光场显示及模型训练方法、装置和存储介质 |
CN114926339A (zh) * | 2022-05-30 | 2022-08-19 | 北京拙河科技有限公司 | 基于深度学习的光场多视角图像超分辨率重建方法及*** |
CN115909255A (zh) * | 2023-01-05 | 2023-04-04 | 北京百度网讯科技有限公司 | 图像生成、图像分割方法、装置、设备、车载终端及介质 |
CN116823602A (zh) * | 2023-05-26 | 2023-09-29 | 天津大学 | 一种视差引导的光场图像的空间超分辨率重建方法 |
WO2023231138A1 (zh) * | 2022-05-30 | 2023-12-07 | 元潼(北京)技术有限公司 | 基于元成像的多视角图像超分辨重建方法及装置 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108734660A (zh) * | 2018-05-25 | 2018-11-02 | 上海通途半导体科技有限公司 | 一种基于深度学习的图像超分辨率重建方法及装置 |
CN109447919A (zh) * | 2018-11-08 | 2019-03-08 | 电子科技大学 | 结合多视角与语义纹理特征的光场超分辨率重建方法 |
CN109767386A (zh) * | 2018-12-22 | 2019-05-17 | 昆明理工大学 | 一种基于深度学习的快速图像超分辨率重建方法 |
CN109829855A (zh) * | 2019-01-23 | 2019-05-31 | 南京航空航天大学 | 一种基于融合多层次特征图的超分辨率重建方法 |
-
2020
- 2020-04-13 CN CN202010284067.8A patent/CN112750076B/zh active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108734660A (zh) * | 2018-05-25 | 2018-11-02 | 上海通途半导体科技有限公司 | 一种基于深度学习的图像超分辨率重建方法及装置 |
CN109447919A (zh) * | 2018-11-08 | 2019-03-08 | 电子科技大学 | 结合多视角与语义纹理特征的光场超分辨率重建方法 |
CN109767386A (zh) * | 2018-12-22 | 2019-05-17 | 昆明理工大学 | 一种基于深度学习的快速图像超分辨率重建方法 |
CN109829855A (zh) * | 2019-01-23 | 2019-05-31 | 南京航空航天大学 | 一种基于融合多层次特征图的超分辨率重建方法 |
Non-Patent Citations (5)
Title |
---|
FERRARI V等: "CrossNet: An End-to-End Reference-Based Super Resolution Network Using Cross-Scale Warping", 《COMPUTER VISION - ECCV 2018》 * |
WANG LG等: "Learning Parallax Attention for Stereo Image Super-Resolution", 《2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019)》 * |
徐亮等: "基于多尺度特征损失函数的图像超分辨率重建", 《光电工程》 * |
李现国等: "基于中间层监督卷积神经网络的图像超分辨率重建", 《中国图象图形学报》 * |
邓武等: "融合全局与局部视角的光场超分辨率重建", 《计算机应用研究》 * |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113256772B (zh) * | 2021-05-10 | 2023-08-01 | 华中科技大学 | 一种基于视角转换的双角度光场高分辨重构***及方法 |
CN113256772A (zh) * | 2021-05-10 | 2021-08-13 | 华中科技大学 | 一种基于视角转换的双角度光场高分辨重构***及方法 |
CN113506213A (zh) * | 2021-05-24 | 2021-10-15 | 北京航空航天大学 | 适应大视差范围的光场图像视角超分辨方法及装置 |
CN113506213B (zh) * | 2021-05-24 | 2024-01-23 | 北京航空航天大学 | 适应大视差范围的光场图像视角超分辨方法及装置 |
CN113379602A (zh) * | 2021-06-08 | 2021-09-10 | 中国科学技术大学 | 利用零样本学习的光场超分辨率增强方法 |
CN113379602B (zh) * | 2021-06-08 | 2024-02-27 | 中国科学技术大学 | 利用零样本学习的光场超分辨率增强方法 |
CN113538307A (zh) * | 2021-06-21 | 2021-10-22 | 陕西师范大学 | 基于多视角超分辨深度网络的合成孔径成像方法 |
CN113938668B (zh) * | 2021-09-07 | 2022-08-05 | 北京邮电大学 | 一种三维光场显示及模型训练方法、装置和存储介质 |
CN113938668A (zh) * | 2021-09-07 | 2022-01-14 | 北京邮电大学 | 一种三维光场显示及模型训练方法、装置和存储介质 |
CN114926339B (zh) * | 2022-05-30 | 2023-02-03 | 北京拙河科技有限公司 | 基于深度学习的光场多视角图像超分辨率重建方法及*** |
CN114926339A (zh) * | 2022-05-30 | 2022-08-19 | 北京拙河科技有限公司 | 基于深度学习的光场多视角图像超分辨率重建方法及*** |
WO2023231138A1 (zh) * | 2022-05-30 | 2023-12-07 | 元潼(北京)技术有限公司 | 基于元成像的多视角图像超分辨重建方法及装置 |
CN115909255A (zh) * | 2023-01-05 | 2023-04-04 | 北京百度网讯科技有限公司 | 图像生成、图像分割方法、装置、设备、车载终端及介质 |
CN116823602A (zh) * | 2023-05-26 | 2023-09-29 | 天津大学 | 一种视差引导的光场图像的空间超分辨率重建方法 |
CN116823602B (zh) * | 2023-05-26 | 2023-12-15 | 天津大学 | 一种视差引导的光场图像的空间超分辨率重建方法 |
Also Published As
Publication number | Publication date |
---|---|
CN112750076B (zh) | 2022-11-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112750076B (zh) | 一种基于深度学习的光场多视角图像超分辨率重建方法 | |
Wu et al. | Light field reconstruction using convolutional network on EPI and extended applications | |
Wu et al. | Learning sheared EPI structure for light field reconstruction | |
Wang et al. | Deformable non-local network for video super-resolution | |
CN105488776B (zh) | 超分辨率图像重建方法和装置 | |
CN109447919B (zh) | 结合多视角与语义纹理特征的光场超分辨率重建方法 | |
Joshi et al. | A learning-based method for image super-resolution from zoomed observations | |
CN112435191B (zh) | 一种基于多个神经网络结构融合的低照度图像增强方法 | |
Narayanan et al. | A computationally efficient super-resolution algorithm for video processing using partition filters | |
CN115311720B (zh) | 一种基于Transformer的deepfake生成方法 | |
CN112102163B (zh) | 基于多尺度运动补偿框架和递归学习的连续多帧图像超分辨率重建方法 | |
CN111626927B (zh) | 采用视差约束的双目图像超分辨率方法、***及装置 | |
Pandey et al. | A compendious study of super-resolution techniques by single image | |
Unger et al. | A convex approach for variational super-resolution | |
CN102024252A (zh) | 基于矩阵秩最小化的恢复水下失真图像的重构方法 | |
CN116681592A (zh) | 基于多尺度自适应非局部注意力网络的图像超分辨率方法 | |
Deng et al. | Multiple frame splicing and degradation learning for hyperspectral imagery super-resolution | |
CN117291808B (zh) | 一种基于流先验与极偏补偿的光场图像超分辨处理方法 | |
CN113793267A (zh) | 基于跨维度注意力机制的自监督单遥感图像超分辨率方法 | |
Lu et al. | Low-rank constrained super-resolution for mixed-resolution multiview video | |
Chen et al. | Guided dual networks for single image super-resolution | |
CN116128722A (zh) | 基于频域-纹理特征融合的图像超分辨率重建方法及*** | |
CN110895790A (zh) | 基于后验降质信息估计的场景图像超分辨方法 | |
CN108921785B (zh) | 基于小波包的超分辨率重建方法 | |
CN110335228B (zh) | 一种图像视差的确定方法、装置及*** |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information |
Address after: 201100 room 1206, building 1, No. 951, Jianchuan Road, Minhang District, Shanghai Applicant after: Yimu (Shanghai) Technology Co.,Ltd. Address before: 201109 room 1103, building 1, 951 Jianchuan Road, Minhang District, Shanghai Applicant before: Yimu (Shanghai) Technology Co.,Ltd. |
|
CB02 | Change of applicant information | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP02 | Change in the address of a patent holder |
Address after: Room 102, 1st Floor, Building 98, No. 1441 Humin Road, Minhang District, Shanghai, 2019; Room 302, 3rd Floor, Building 98; Room 402, 4th Floor, Building 98 Patentee after: Yimu (Shanghai) Technology Co.,Ltd. Address before: 201100 room 1206, building 1, No. 951, Jianchuan Road, Minhang District, Shanghai Patentee before: Yimu (Shanghai) Technology Co.,Ltd. |
|
CP02 | Change in the address of a patent holder |