WO2022185345A2 - Réseau de filtres colorés optimal et son procédé de démosaïquage - Google Patents
Réseau de filtres colorés optimal et son procédé de démosaïquage Download PDFInfo
- Publication number
- WO2022185345A2 WO2022185345A2 PCT/IN2022/050667 IN2022050667W WO2022185345A2 WO 2022185345 A2 WO2022185345 A2 WO 2022185345A2 IN 2022050667 W IN2022050667 W IN 2022050667W WO 2022185345 A2 WO2022185345 A2 WO 2022185345A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- color
- image
- cfa
- color filter
- image sensor
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 239000003086 colorant Substances 0.000 claims description 9
- 230000003595 spectral effect Effects 0.000 claims description 9
- 230000001131 transforming effect Effects 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 claims description 2
- 230000006978 adaptation Effects 0.000 claims 1
- 241001428800 Cell fusing agent virus Species 0.000 abstract description 4
- 208000036971 interstitial lung disease 2 Diseases 0.000 abstract description 4
- 230000003287 optical effect Effects 0.000 abstract description 2
- 206010034960 Photophobia Diseases 0.000 description 5
- 208000013469 light sensitivity Diseases 0.000 description 5
- 238000002834 transmittance Methods 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 4
- 239000011159 matrix material Substances 0.000 description 4
- 238000003491 array Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000010606 normalization Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 206010034972 Photosensitivity reaction Diseases 0.000 description 1
- 238000000205 computational method Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000036211 photosensitivity Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000000153 supplemental effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4015—Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
Definitions
- Optimal color filter array and a demosaicing method thereof [0001] A method for capturing raw image data for a full-color image by a digital image sensor is provided having a color filter array (CFA), the color filter elements of which may transmit a combination of plural colors, unlike conventional CFAs which allow only one color per color filter element.
- CFA color filter array
- An image demosaicing method for demosaicing the color information is described in detail.
- the field of present invention is color filter array (CFA).
- CFA color filter array
- the present invention provides a method to capture accurate color information with improved light sensitivity, and a demosaicing method to generate full color image from the captured color information which exhibit better image quality and lower computational complexity over conventional methods and systems.
- image sensors comprise an array of photosensitive pixels that are often arranged in a regular pattern of minimum repeat units.
- a color filter array pattern is typically fabricated on the pixel array to capture color information, in which case different filter elements are associated with different color-channels.
- the color filters inevitably reduces the amount of light reaching each pixel, thereby reducing the photosensitivity of each pixel.
- Image demosaicing (also color reconstruction) is an image processing stage to convert the raw image data received from image sensor into into full color RGB data by interpolation.
- the semiconductor imaging sensor available in digital color cameras is a grayscale sensor that is not capable of detecting different colors.
- a color filter array is overlaid the semiconductor imaging sensor.
- the CFA is a grid of color filters overlaying the imaging sensor so that each sensor element receives light corresponding to a single color component. In this way a mosaic image is captured where image elements have intensity value for one of three or more color channels (Red, Green and Blue for example).
- Demosaicing is a process whereby intensity values for the other two channels are estimated for each of the image elements.
- the present disclosure relates to color filter arrays. More specifically, and without limitations, this disclosure relates to a method for capturing color information via a digital pixel image sensor equipped with a CFA and demosaicing of the raw image sensor data to obtain a full-color image.
- the method includes a CFA, color filter elements of which may transmit a combination of plural different colors, unlike most conventional CFAs that allow image elements to store intensity values in one of three or more color channels (Red, Green and Blue for example).
- the raw image data captured by the image sensor may be deemed a superposition of arrays of pixel values of plural color components instead of discrete arrays of pixel values, each indicating a raw intensity of one of the component colors.
- the disclosure also describes, inter alia, a demosaicing method, adapted to reconstruct a full color image from the color information obtained via image sensor overlaid with the new CFA.
- the raw image data obtained by described digital image sensor is represented as systems of linear equations inN variables, wherein theN is number of color components in color model being used.
- the demosaicing method for each particular pixel represented in the CFA data, calculates a new value for the particular pixel by passing pixel values of all pixels in the minimum repeat unit through an algorithm.
- an improved version of the Bayer CFA is provided.
- the new CFA has the special feature that each color filter element in the CFA pattern transmits a combination of the three RGB colors. This is unlike Bayer CFA which transmit a single component of RGB colors for each color filter element.
- the light intensity transmitted through the new CFA over underlying pixel group is significantly increased, thereby improving light sensitivity of image sensor.
- a special demosaicing method is provided for transforming the input pixel values to the corresponding output RGB color values.
- this example can be further generalized to all the other known CFA patterns and may be used in further research studies.
- the demosaicing process reconstructs a full-color image from incomplete color samples output from an image sensor overlaid with a CFA by estimating the missing color values for each pixel in a raw capture (see, for example, Guenter US20040001641A1). This is required due to the fact that most raw captures record a single color value for each image pixel.
- demosaicing does not specifically address fundamental undersampling in typical camera designs.
- An object of this invention is to capture color information at a lower expense of intensity of incoming light than conventional CFAs.
- Method presented herein allows for determination of spectral transmittance of each color filter element in the CFA pattern corresponding to maximum intensity of light transmitted through the CFA.
- the supplemental incoming light enhances light sensitivity.
- the centerpiece of this invention is that the increase in incident light intensity as well as the following demosaicing operation requires no additional compromise on image quality, and that the manufacturing can be carried out at no extra cost and complexity.
- a sensor pixel is representable by the matrix equation
- matrices denote intensity of different color components c k of the color model being used in the incident light, color filter transmittance corresponding to each color component c k , the pixel intensity value, respectively; and is the quantization function for transforming the input original image data to quantized image data. Since each photosite produce an electrical charge directly proportional to the light intensity it receives with no wavelength specificity, arc independent variables.
- J axa is also the variable matrix representing color information about the pixel group.
- C 1 xN can be determined by solving Equation (1) using Cramer’s rule (see Azamat, Akhtyamov, et al.) under condition that total number of unique F i,j ⁇ H axb (representing independent linear equations) are equal to or greater than N (total number of unknown variables ) ⁇
- a full-color image can be obtained by applying any known demosaicing method to matrix P axb , which is defined by the conditional statement
- Optimal H aXb corresponding to a desired spectral responses can be formulated through computational methods by substituting the spectral responses into C 1 xN , and then solving Equation (1) for H aXb to maximize ⁇ i,j P i,j .
- R,G,B are desired spectral responses of Bayer filter as shown in FIG. 1, wherein
- F 1,1 the actual spectral transmission characteristic of F 1,1 , defined as , is obtained by applying min-max normalization method to perform [0, 1] norma lization on , as shown in FIG. 2. Therefore, F 1,2 can be calculated by using the following formula:
- the light intensity transmitted through the CFA pattern on underlying pixel group is which is equivalent to about 148% as much light sensitivity as available via the Bayer filter.
- the final RGB color values in C 1 x3 are based on weighted average of RGB pixel values of all pixels of the minimum repeat unit, and thus color accuracy and color consistency in final full-color image is better than when measured by Bayer image sensor, wherein each color component value is measured at a single camera-sensor pixel location, and then interpolated for neighboring pixels.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
L'invention concerne un procédé permettant de capturer des données d'image couleur numérique, un ou plusieurs éléments de filtre coloré dans un motif de réseau de filtres colorés (CFA) constituant un mélange optique d'au moins deux filtres colorés, chacun étant conçu pour transmettre une composante de couleur unique. Les données de capteur d'image brute obtenues comprennent des éléments d'image présentant des valeurs d'intensité dans plusieurs canaux de couleur. Ceci est différent des réseaux CFA classiques, chaque élément d'image dans des données de capteur d'image brute présentant une valeur d'intensité dans l'un des canaux de couleur (rouge, vert ou bleu par exemple). Les données d'image de capteur finales peuvent être considérées comme un compromis entre l'image couleur et l'image d'échelle de gris. Un procédé de démosaïquage d'image de réseau CFA est décrit pour convertir des données de capteur d'image brute où des éléments d'image présentent une valeur d'intensité d'échelle de gris en une image en couleur pleine où des éléments d'image présentent des valeurs d'intensité réelle dans tous les canaux de couleur.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
IN202211041012 | 2022-07-18 | ||
IN202211041012 | 2022-07-18 |
Publications (3)
Publication Number | Publication Date |
---|---|
WO2022185345A2 true WO2022185345A2 (fr) | 2022-09-09 |
WO2022185345A3 WO2022185345A3 (fr) | 2022-11-10 |
WO2022185345A4 WO2022185345A4 (fr) | 2022-12-01 |
Family
ID=83155629
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IN2022/050667 WO2022185345A2 (fr) | 2022-07-18 | 2022-07-25 | Réseau de filtres colorés optimal et son procédé de démosaïquage |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2022185345A2 (fr) |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9071721B1 (en) * | 2012-12-21 | 2015-06-30 | Google Inc. | Camera architecture having a repositionable color filter array |
-
2022
- 2022-07-25 WO PCT/IN2022/050667 patent/WO2022185345A2/fr unknown
Also Published As
Publication number | Publication date |
---|---|
WO2022185345A3 (fr) | 2022-11-10 |
WO2022185345A4 (fr) | 2022-12-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10136107B2 (en) | Imaging systems with visible light sensitive pixels and infrared light sensitive pixels | |
US8723995B2 (en) | Extended dynamic range in color imagers | |
US20070159542A1 (en) | Color filter array with neutral elements and color image formation | |
US11258992B2 (en) | Image processing method and filter array including wideband filter elements and narrowband filter elements | |
US8294797B2 (en) | Apparatus and method of generating a high dynamic range image | |
WO2021212763A1 (fr) | Système et procédé de traitement d'images à plage dynamique élevée, dispositif électronique et support d'informations lisible | |
US8248496B2 (en) | Image processing apparatus, image processing method, and image sensor | |
US9338364B2 (en) | Imaging device and image generation method | |
US7072509B2 (en) | Electronic image color plane reconstruction | |
WO2007145373A2 (fr) | Capteur d'image à semi-conducteur | |
KR20070011429A (ko) | 디지털 이미징 시스템을 이용하여 오브젝트로부터 광의대안적 형태의 재생 | |
CN209345244U (zh) | 成像***和相机模块 | |
US20140307135A1 (en) | Color imaging element | |
US8929682B2 (en) | Calibrating image sensors | |
US8976275B2 (en) | Color imaging element | |
CA2443658C (fr) | Procede et appareil de detection et d'interpolation de donnees d'images couleurs | |
US8692910B2 (en) | Image processing device, image signal correction method, correction matrix calculation method, and imaging device | |
WO2007082289A2 (fr) | Réseau de filtres de couleur avec éléments neutres et formation d’image couleur | |
WO2022185345A2 (fr) | Réseau de filtres colorés optimal et son procédé de démosaïquage | |
JP5036524B2 (ja) | 画像処理装置、画像処理方法、プログラムおよび撮像装置 | |
JP2006211631A (ja) | 固体撮像装置および撮像装置 | |
CN102300099A (zh) | 图像处理装置、图像处理方法以及图像处理程序 | |
US20130038772A1 (en) | Image processing apparatus and image processing method | |
US20230254595A1 (en) | Optimal color filter array and a demosaicing method thereof | |
WO2022198436A1 (fr) | Capteur d'image, procédé d'acquisition de données d'image et dispositif d'imagerie |