CN113196334B - 用于生成超分辨率图像的方法和相关设备 - Google Patents
用于生成超分辨率图像的方法和相关设备 Download PDFInfo
- Publication number
- CN113196334B CN113196334B CN201980083059.2A CN201980083059A CN113196334B CN 113196334 B CN113196334 B CN 113196334B CN 201980083059 A CN201980083059 A CN 201980083059A CN 113196334 B CN113196334 B CN 113196334B
- Authority
- CN
- China
- Prior art keywords
- resolution image
- pixel
- image
- super
- low resolution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title abstract description 94
- 230000002708 enhancing effect Effects 0.000 claims abstract description 34
- 239000002131 composite material Substances 0.000 claims abstract description 25
- 238000003491 array Methods 0.000 claims abstract description 19
- 238000013507 mapping Methods 0.000 claims abstract description 10
- 238000002161 passivation Methods 0.000 claims description 74
- 238000012545 processing Methods 0.000 claims description 70
- 230000004044 response Effects 0.000 claims description 32
- 238000011084 recovery Methods 0.000 claims description 13
- 238000009499 grossing Methods 0.000 claims description 10
- 238000012935 Averaging Methods 0.000 claims description 8
- 230000006870 function Effects 0.000 description 21
- 230000008569 process Effects 0.000 description 16
- 238000003384 imaging method Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 238000003708 edge detection Methods 0.000 description 7
- 230000001965 increasing effect Effects 0.000 description 7
- 238000012546 transfer Methods 0.000 description 6
- 238000013461 design Methods 0.000 description 5
- 238000003706 image smoothing Methods 0.000 description 5
- 239000011159 matrix material Substances 0.000 description 5
- 230000008859 change Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 125000001475 halogen functional group Chemical group 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 239000004065 semiconductor Substances 0.000 description 3
- 238000000926 separation method Methods 0.000 description 3
- 230000001629 suppression Effects 0.000 description 3
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000000945 filler Substances 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 229910044991 metal oxide Inorganic materials 0.000 description 2
- 150000004706 metal oxides Chemical class 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 229910052742 iron Inorganic materials 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000000135 prohibitive effect Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
- G06T3/4076—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution using the original low-resolution images to iteratively correct the high-resolution images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
- G06T3/4069—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution by subpixel displacements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201962823591P | 2019-03-25 | 2019-03-25 | |
| US62/823,591 | 2019-03-25 | ||
| PCT/CA2019/051344 WO2020191475A1 (en) | 2019-03-25 | 2019-09-20 | Method for generating a super-resolution image and related device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113196334A CN113196334A (zh) | 2021-07-30 |
| CN113196334B true CN113196334B (zh) | 2024-05-24 |
Family
ID=72609184
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201980083059.2A Active CN113196334B (zh) | 2019-03-25 | 2019-09-20 | 用于生成超分辨率图像的方法和相关设备 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US11688039B2 (ko) |
| KR (1) | KR102619516B1 (ko) |
| CN (1) | CN113196334B (ko) |
| WO (1) | WO2020191475A1 (ko) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112188178B (zh) * | 2020-09-30 | 2022-02-22 | Tcl华星光电技术有限公司 | 图像显示方法和图像显示装置 |
| US11727540B2 (en) * | 2020-12-31 | 2023-08-15 | Samsung Electronics Co., Ltd. | Image sharpening |
| CN114170619B (zh) * | 2021-10-18 | 2022-08-19 | 中标慧安信息技术股份有限公司 | 基于边缘计算的数据核查方法和*** |
| KR20230067759A (ko) * | 2021-11-08 | 2023-05-17 | 삼성디스플레이 주식회사 | 광학 검사 장치 및 이를 이용한 검사 방법 |
| CN114820317B (zh) * | 2022-04-28 | 2023-04-21 | 长光卫星技术股份有限公司 | 一种像素偏移的超分辨时间延迟积分成像方法 |
| KR20230172914A (ko) * | 2022-06-16 | 2023-12-26 | 주식회사 유엑스팩토리 | 이미지 분석을 위한 파생 이미지를 생성하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능한 기록 매체 |
| CN116309067B (zh) * | 2023-03-21 | 2023-09-29 | 安徽易刚信息技术有限公司 | 一种光场图像空间超分辨率方法 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007001820A2 (en) * | 2005-06-23 | 2007-01-04 | Microsoft Corporation | Image superresolution through edge extraction and contrast enhancement |
| CN105339954A (zh) * | 2013-06-19 | 2016-02-17 | 高通科技公司 | 用于数码相机的基于单帧的超分辨率内插的***和方法 |
| US9501683B1 (en) * | 2015-08-05 | 2016-11-22 | Datalogic Automation, Inc. | Multi-frame super-resolution barcode imager |
| KR20180097342A (ko) * | 2017-02-23 | 2018-08-31 | 한국전자통신연구원 | 영상 아티팩트를 최소화하는 초해상도 영상 선명화 방법 및 장치 |
| WO2018170393A2 (en) * | 2017-03-17 | 2018-09-20 | Portland State University | Frame interpolation via adaptive convolution and adaptive separable convolution |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011090790A1 (en) | 2010-01-22 | 2011-07-28 | Thomson Licensing | Methods and apparatus for sampling -based super resolution vido encoding and decoding |
| US9183616B2 (en) * | 2014-01-13 | 2015-11-10 | Arecont Vision, Llc. | System and method for obtaining super image resolution through optical image translation |
| US10830639B2 (en) * | 2014-09-25 | 2020-11-10 | Northwestern University | Devices, methods, and systems relating to super resolution imaging |
| JP6614843B2 (ja) * | 2015-07-30 | 2019-12-04 | キヤノン株式会社 | 画像処理装置、撮像装置および画像処理プログラム |
| CN111242855B (zh) * | 2020-01-04 | 2022-06-07 | 西安交通大学 | 基于rgb-d的ssim结构相似度的迭代深度图结构修复方法 |
| US11831931B2 (en) * | 2021-04-14 | 2023-11-28 | Microsoft Technology Licensing, Llc | Systems and methods for generating high-resolution video or animated surface meshes from low-resolution images |
| US11849220B2 (en) * | 2021-04-14 | 2023-12-19 | Microsoft Technology Licensing, Llc | Systems and methods for generating depth information from low-resolution images |
| US11651506B2 (en) * | 2021-04-20 | 2023-05-16 | Microsoft Technology Licensing, Llc | Systems and methods for low compute high-resolution depth map generation using low-resolution cameras |
| US20220398704A1 (en) * | 2021-06-09 | 2022-12-15 | Apple Inc. | Intelligent Portrait Photography Enhancement System |
-
2019
- 2019-09-20 US US17/290,879 patent/US11688039B2/en active Active
- 2019-09-20 WO PCT/CA2019/051344 patent/WO2020191475A1/en active Application Filing
- 2019-09-20 KR KR1020217008294A patent/KR102619516B1/ko active IP Right Grant
- 2019-09-20 CN CN201980083059.2A patent/CN113196334B/zh active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007001820A2 (en) * | 2005-06-23 | 2007-01-04 | Microsoft Corporation | Image superresolution through edge extraction and contrast enhancement |
| CN105339954A (zh) * | 2013-06-19 | 2016-02-17 | 高通科技公司 | 用于数码相机的基于单帧的超分辨率内插的***和方法 |
| US9501683B1 (en) * | 2015-08-05 | 2016-11-22 | Datalogic Automation, Inc. | Multi-frame super-resolution barcode imager |
| KR20180097342A (ko) * | 2017-02-23 | 2018-08-31 | 한국전자통신연구원 | 영상 아티팩트를 최소화하는 초해상도 영상 선명화 방법 및 장치 |
| WO2018170393A2 (en) * | 2017-03-17 | 2018-09-20 | Portland State University | Frame interpolation via adaptive convolution and adaptive separable convolution |
Non-Patent Citations (1)
| Title |
|---|
| Super-resolution image reconstruction a technical overview;Sung Cheol Park;IEEE Signal Processing Magazine;第20卷(第3期);第21-36页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| KR102619516B1 (ko) | 2023-12-28 |
| US11688039B2 (en) | 2023-06-27 |
| WO2020191475A1 (en) | 2020-10-01 |
| CN113196334A (zh) | 2021-07-30 |
| KR20210090159A (ko) | 2021-07-19 |
| US20220005157A1 (en) | 2022-01-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113196334B (zh) | 用于生成超分辨率图像的方法和相关设备 | |
| CN113228628B (zh) | 用于转换非拜尔图案颜色滤波器阵列图像数据的***和方法 | |
| JP4874904B2 (ja) | 画像処理装置及びその方法 | |
| US8837853B2 (en) | Image processing apparatus, image processing method, information recording medium, and program providing image blur correction | |
| US10491815B2 (en) | Image-processing apparatus, image-processing method, and non-transitory computer readable medium storing image-processing program | |
| KR101612165B1 (ko) | 초고해상도 이미지 생성 방법 및 이를 구현하기 위한 비선형 디지털 필터 | |
| US8792746B2 (en) | Image processing apparatus, image processing method, and program | |
| CN111194458A (zh) | 用于处理图像的图像信号处理器 | |
| JP2008506174A (ja) | 画像モデルにおける色成分の修復のための方法、システム、プログラムモジュールおよびコンピュータプログラム製品 | |
| Chakrabarti et al. | Rethinking color cameras | |
| US8610801B2 (en) | Image processing apparatus including chromatic aberration correcting circuit and image processing method | |
| US20190139189A1 (en) | Image remosaicing | |
| JP2002525722A (ja) | 画像処理方法とシステム | |
| JP2014051212A (ja) | 移動体検出方法 | |
| US20190355105A1 (en) | Method and device for blind correction of lateral chromatic aberration in color images | |
| CN114820581A (zh) | 轴对称光学成像并行仿真方法及装置 | |
| Paul et al. | Maximum accurate medical image demosaicing using WRGB based Newton Gregory interpolation method | |
| US20080002909A1 (en) | Reconstructing Blurred High Resolution Images | |
| KR101585963B1 (ko) | 이미지 센서 노이즈 모델 기반 필터링 방법 및 이를 적용한 영상 시스템 | |
| US12045948B2 (en) | Image processing method and system | |
| Lan et al. | Joint Demosaicking/Rectification Of Fisheye Camera Images Using Multi-Color Graph Laplacian Regularization | |
| US20230032323A1 (en) | Image processing method and system | |
| CN114679542B (zh) | 图像处理方法和电子装置 | |
| JP2013055622A (ja) | 画像処理装置、および画像処理方法、情報記録媒体、並びにプログラム | |
| Heiss-Czedik et al. | Demosaicing algorithms for area-and line-scan cameras in print inspection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |