EP3956863A4 - Apparatus and method for efficient regularized image alignment for multi-frame fusion - Google Patents

Apparatus and method for efficient regularized image alignment for multi-frame fusion Download PDF

Info

Publication number
EP3956863A4
EP3956863A4 EP20849055.7A EP20849055A EP3956863A4 EP 3956863 A4 EP3956863 A4 EP 3956863A4 EP 20849055 A EP20849055 A EP 20849055A EP 3956863 A4 EP3956863 A4 EP 3956863A4
Authority
EP
European Patent Office
Prior art keywords
efficient
image alignment
frame fusion
regularized image
regularized
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20849055.7A
Other languages
German (de)
French (fr)
Other versions
EP3956863A1 (en
Inventor
Ruiwen ZHEN
John W. Glotzbach
Hamid R. Sheikh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/727,751 external-priority patent/US11151731B2/en
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of EP3956863A1 publication Critical patent/EP3956863A1/en
Publication of EP3956863A4 publication Critical patent/EP3956863A4/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/223—Analysis of motion using block-matching
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/32—Determination of transform parameters for the alignment of images, i.e. image registration using correlation-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • H04N9/73—Colour balance circuits, e.g. white balance circuits or colour temperature control
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10141—Special mode during image acquisition
    • G06T2207/10144—Varying exposure
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20016—Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20201—Motion blur correction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20208—High dynamic range [HDR] image processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Image Analysis (AREA)
EP20849055.7A 2019-08-06 2020-07-30 Apparatus and method for efficient regularized image alignment for multi-frame fusion Pending EP3956863A4 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201962883306P 2019-08-06 2019-08-06
US16/727,751 US11151731B2 (en) 2019-08-06 2019-12-26 Apparatus and method for efficient regularized image alignment for multi-frame fusion
KR1020200094683A KR20210018084A (en) 2019-08-06 2020-07-29 Efficient Regularized Image Alignment for Multi-Frame Fusion
PCT/KR2020/010083 WO2021025375A1 (en) 2019-08-06 2020-07-30 Apparatus and method for efficient regularized image alignment for multi-frame fusion

Publications (2)

Publication Number Publication Date
EP3956863A1 EP3956863A1 (en) 2022-02-23
EP3956863A4 true EP3956863A4 (en) 2022-06-08

Family

ID=74503208

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20849055.7A Pending EP3956863A4 (en) 2019-08-06 2020-07-30 Apparatus and method for efficient regularized image alignment for multi-frame fusion

Country Status (3)

Country Link
EP (1) EP3956863A4 (en)
CN (1) CN114503541A (en)
WO (1) WO2021025375A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113344821B (en) * 2021-06-29 2022-10-21 展讯通信（上海）有限公司 Image noise reduction method, device, terminal and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5576772A (en) * 1993-09-09 1996-11-19 Sony Corporation Motion vector detection apparatus and method
US20070242900A1 (en) * 2006-04-13 2007-10-18 Mei Chen Combining multiple exposure images to increase dynamic range
US8711248B2 (en) * 2011-02-25 2014-04-29 Microsoft Corporation Global alignment for high-dynamic range image generation

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6173087B1 (en) * 1996-11-13 2001-01-09 Sarnoff Corporation Multi-view image registration with application to mosaicing and lens distortion correction
US6809758B1 (en) * 1999-12-29 2004-10-26 Eastman Kodak Company Automated stabilization method for digital image sequences
US20100157079A1 (en) * 2008-12-19 2010-06-24 Qualcomm Incorporated System and method to selectively combine images
US8111300B2 (en) * 2009-04-22 2012-02-07 Qualcomm Incorporated System and method to selectively combine video frame image data
EP2826022B1 (en) * 2013-03-18 2015-10-21 FotoNation Limited A method and apparatus for motion estimation
EP3552384B1 (en) * 2016-12-22 2021-03-31 Huawei Technologies Co., Ltd. Generation of ghost-free high dynamic range images

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5576772A (en) * 1993-09-09 1996-11-19 Sony Corporation Motion vector detection apparatus and method
US20070242900A1 (en) * 2006-04-13 2007-10-18 Mei Chen Combining multiple exposure images to increase dynamic range
US8711248B2 (en) * 2011-02-25 2014-04-29 Microsoft Corporation Global alignment for high-dynamic range image generation

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
KARTALOV TOMISLAV ET AL: "Using reduced motion vector set for real time motion registration in HDR imaging", 2013 IEEE 15TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), IEEE, 30 September 2013 (2013-09-30), pages 344 - 349, XP032524313, DOI: 10.1109/MMSP.2013.6659312 *
See also references of WO2021025375A1 *

Also Published As

Publication number Publication date
CN114503541A (en) 2022-05-13
WO2021025375A1 (en) 2021-02-11
EP3956863A1 (en) 2022-02-23

Similar Documents

Publication Publication Date Title
EP3582490A4 (en) Image fusion apparatus and image fusion method
EP3994660A4 (en) Method and system for image generation
EP3867864A4 (en) Method and system for generating a fusion image
EP3780619A4 (en) Method and apparatus for processing video image
EP3979622A4 (en) Image fusion device and image fusion method
EP4024323A4 (en) Image processing method and apparatus
EP3734583A4 (en) Correction method, apparatus, and system for full-screen arbitrary splicing
EP3965054A4 (en) Image distortion correction method and apparatus
EP3923233A4 (en) Image denoising method and apparatus
EP3681143A4 (en) Method and apparatus for improving image fluency
EP3989567A4 (en) Bdpcm-based image decoding method and device for same
EP3852370A4 (en) Video image prediction method and apparatus
EP3827412A4 (en) Method and apparatus for image processing
EP3989569A4 (en) Image decoding method and apparatus
EP4006776A4 (en) Image classification method and apparatus
EP4181506A4 (en) Image fusion method and device
EP3975106A4 (en) Image processing method and apparatus
EP3341914A4 (en) Method and apparatus for modifying a multi-frame image based upon anchor frames
EP3751505A4 (en) Image coloring method and apparatus
EP3794505A4 (en) Method and apparatus for image recognition
EP3836549A4 (en) Video image prediction method and apparatus
EP4024857A4 (en) Apparatus and method for coding image
EP4036841A4 (en) Image processing method and apparatus
EP4138380A4 (en) Method and apparatus for providing image
EP3767955A4 (en) Method for processing image and apparatus therefor

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20211115

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

A4 Supplementary search report drawn up and despatched

Effective date: 20220506

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 5/50 20060101ALI20220429BHEP

Ipc: G06T 7/32 20170101AFI20220429BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)