WO2021217640A1 - 一种成像装置、成像方法以及相机 - Google Patents
一种成像装置、成像方法以及相机 Download PDFInfo
- Publication number
- WO2021217640A1 WO2021217640A1 PCT/CN2020/088466 CN2020088466W WO2021217640A1 WO 2021217640 A1 WO2021217640 A1 WO 2021217640A1 CN 2020088466 W CN2020088466 W CN 2020088466W WO 2021217640 A1 WO2021217640 A1 WO 2021217640A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- green channel
- channel
- range interval
- signal
- green
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 73
- 230000035945 sensitivity Effects 0.000 claims abstract description 72
- 230000007935 neutral effect Effects 0.000 claims abstract description 21
- 238000013507 mapping Methods 0.000 claims description 45
- 238000012937 correction Methods 0.000 claims description 16
- 238000012886 linear function Methods 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 10
- 230000002238 attenuated effect Effects 0.000 claims description 6
- 230000009467 reduction Effects 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 17
- 230000000694 effects Effects 0.000 description 11
- 239000002184 metal Substances 0.000 description 8
- 238000000034 method Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
Definitions
- the present invention relates to the field of imaging technology, in particular to an imaging device, an imaging method and a camera.
- the invention discloses a novel HDR (high-dynamic range) CIS (COMS IMAGE SENSOR) imaging device and imaging method, which are applied to mobile phone cameras, digital cameras or digital video cameras.
- HDR high-dynamic range
- CIS COMS IMAGE SENSOR
- HDR CIS imaging devices such as SONY's IMX586, which is a QBC (quad bayer coding) CIS
- its principle is to integrate four different exposure pixels of quad bayer to obtain a high dynamic range pixel.
- the disadvantage of the above-mentioned imaging device is that only one of the four pixels can be used to restore the pixels of the highlight part, which reduces the effective utilization area of the sensor, resulting in lower image quality of the overall output.
- the original pixel (raw) tone mapping (tone mapping) design will cause the circuit of the sensor to be more complicated, and the cost and power consumption are very high.
- the first aspect of the present invention provides an imaging device including: an image sensor array of four color channels, the four color channels including a red channel, a blue channel, a first green channel, and a second green channel; A neutral gray filter is provided on a green channel, so that the sensitivity of the first green channel is lower than that of the second green channel; or, the gain of the analog-to-digital converter ADC on the first green channel It is smaller than the gain of the ADC on the second green channel, so that the sensitivity of the first green channel is lower than the sensitivity of the second green channel.
- the embodiment of the present invention also provides an imaging method, which attenuates the first green channel; recovers the highlight information of the pixel by using the attenuated sensitivity of the first green channel; wherein, in the first green channel A neutral gray filter is set on the channel so that the sensitivity of the first green channel is lower than that of the second green channel; or, the gain of the analog-to-digital converter ADC on the first green channel is reduced to make It is smaller than the gain of the ADC on the second green channel, so that the sensitivity of the first green channel is lower than the sensitivity of the second green channel.
- an embodiment of the present invention also provides a camera, which includes: the imaging device described in the first aspect, or adopts the imaging method described in the second aspect.
- the present invention can obtain high dynamic range imaging through a simple circuit and a relatively low cost.
- FIG. 1 is a schematic diagram of the structure of the first bayer array back-illuminated CIS provided by an embodiment of the present invention
- FIG. 2 is a schematic diagram of a second bayer array back-illuminated CIS structure provided by an embodiment of the present invention
- FIG. 3 is a schematic diagram of a brightness mapping curve of a first green channel in a second bayer array back-illuminated CIS structure provided by an embodiment of the present invention
- FIG. 4 is a comparison diagram of sensor effects produced by the first bayer array back-illuminated CIS structure and the second bayer array back-illuminated CIS structure provided by an embodiment of the present invention
- FIG. 5 is a first partial comparison diagram of the sensor effect comparison diagram shown in FIG. 4;
- FIG. 6 is a second partial comparison diagram of the sensor effect comparison diagram shown in FIG. 4.
- FIG. 1 is a schematic diagram of the structure of the first bayer array back-illuminated CIS provided by an embodiment of the present invention.
- the first bayer array back-illuminated CIS structure mainly includes the following main components: microlenses, color filters, metal hoods, metal interconnections, photodiodes, and so on.
- FIG. 1 shows the planar structure of the color filter, and shows a schematic diagram of the bayer array back-illuminated CIS structure, which includes a laminated microlens 1, a color filter 2, and a metal light shield 3.
- the photodiode can be selected as a PIN diode or a PN junction device.
- the color filter 2 is used to separate red, green, and blue (RGB) components of the reflected light.
- the microlens 1 collects light from the inactive part of the CIS and focuses it on the photodiode.
- the micro lens can be selected as a spherical surface or a mesh lens.
- the structure of the color filter 2 is exemplarily shown in FIG. 1, which includes four channels R, Gr, Gb, and B, where R is the red channel, Gr is the first green channel, Gb is the second green channel, and B It is the blue channel. Among them, the sensitivity of the channels Gr and Gb are the same.
- the present application also provides an imaging device including: an image sensor array with four color channels, the four color channels including a red channel, a blue channel, a first green channel, and a second green channel; wherein the first green channel A neutral gray filter is provided on the channel, so that the sensitivity of the first green channel is lower than that of the second green channel; or, the gain of the analog-to-digital converter ADC on the first green channel is smaller than that of the second green channel.
- the gain of the ADC on the second green channel makes the sensitivity of the first green channel lower than the sensitivity of the second green channel.
- an imaging method which attenuates the first green channel; recovers the highlight information of the pixel by using the attenuated sensitivity of the first green channel; wherein, a neutral is set on the first green channel.
- Gray-scale filter to make the sensitivity of the first green channel lower than the sensitivity of the second green channel; or reduce the gain of the analog-to-digital converter ADC on the first green channel to make it smaller than the first green channel.
- the gain of the ADC on the two green channels further makes the sensitivity of the first green channel lower than the sensitivity of the second green channel.
- FIG. 2 is a schematic diagram of a second bayer array back-illuminated CIS structure provided by an embodiment of the present invention.
- the second bayer array back-illuminated CIS structure mainly includes the following main components: microlenses, neutral gray filters, color filters, metal hoods, metal interconnections, photodiodes, and so on.
- FIG. 2 shows the planar structure of the color filter, and shows a schematic diagram of the second bayer array back-illuminated CIS structure, including stacked microlenses 1, neutral gray filter 5 , Color filter 2, metal light shield 3, metal interconnection 4, and photodiode (not shown), where a photodiode (PD) is used to capture light.
- the photodiode can be selected as a PIN diode or a PN junction Device.
- Color filters are used to separate the red, green, and blue (RGB) components of the reflected light.
- the microlens 1 collects light from the inactive part of the CIS and focuses it on the photodiode.
- the micro lens can be selected as a spherical surface or a mesh lens.
- the structure of the color filter 2 is exemplarily shown in FIG. 2, which includes four channels R, Gr, Gb, and B, where R is the red channel, Gr is the first green channel, Gb is the second green channel, and B It is the blue channel.
- an image sensor array with four color channels, the four color channels including a red channel, a blue channel, a first green channel, and a second green channel; wherein a neutral gray scale is set on the first green channel Filter so that the sensitivity of the first green channel is lower than the sensitivity of the second green channel; or, the gain of the analog-to-digital converter ADC on the first green channel is smaller than that of the ADC on the second green channel The gain of, makes the sensitivity of the first green channel lower than the sensitivity of the second green channel.
- the neutral gray filter 5 is set in front of the Gb channel
- the neutral gray filter 5 may also be set at In front of the Gr channel
- the following description explains that the neutral gray filter 5 is set on the Gb channel or the gain of the ADC on the Gb channel is less than the gain of the ADC on the Gr channel, so that the Gb channel
- the sensitivity of is lower than that of the Gr channel, but it is replaced by setting a neutral gray filter 5 on the Gr channel or the gain of the ADC on the Gr channel is less than the gain of the ADC on the Gb channel. Making the sensitivity of the Gr channel lower than that of the Gb channel can also achieve the same effect and achieve the same technical effect.
- the gain of the analog-to-digital converter ADC on the first green channel may be smaller than the gain of the ADC on the second green channel, so that the sensitivity of the first green channel is lower than that of the second green channel.
- the sensitivity of the green channel may be smaller than the gain of the ADC on the second green channel, so that the sensitivity of the first green channel is lower than that of the second green channel.
- each color channel is often set
- the digital-to-analog converter ADC converts analog electrical signals into digital electrical signals.
- the gain of the analog-to-digital converter ADC on the first green channel can be set to be smaller than the ADC gain on the second green channel. In this way, even if the same light is incident on the first green channel and the second green channel, the gain of the ADC on the first green channel is smaller than the gain of the second green channel ADC, so the sensitivity of the first green channel can be increased. Lower than the sensitivity of the second green channel.
- the sensitivity of Gr is relatively high.
- the Gr channel will reach the overexposure before the Gb channel.
- the sensitivity of the Gr channel or the sensitivity of the Gr channel and the Gb channel can be used to restore part of the highlight information.
- the sensitivity of the red channel is the same as the sensitivity of the blue channel.
- the neutral gray filter is not set above the R channel and the B channel, and there is no special setting for the ADC gain of the R channel or the B channel. Therefore, the sensitivity of the R channel is the same as that of the B channel, and It can ensure that the light signals of the red channel and the green channel are fully restored, and on the basis of achieving the aforementioned technical effects, the authenticity of the imaged image is further ensured.
- the sensitivity of the first green channel is less than or equal to 1/2 of the sensitivity of the second green channel.
- the imaging device further includes a first processor, configured to use the sensitivity of the first green channel to restore the highlight information of the imaging device when the overexposure of the second green channel is less than or equal to 1 EV.
- the Gb channel when the Gr channel is over-exposed but not over-exposed by 1 EV, the Gb channel is not over-exposed, and the Gb channel or the signals of the Gr channel and the Gb channel can be used to restore the highlight information of the location area.
- 1EV means that when the sensitivity is ISO 100, the aperture factor is F1, and the exposure time is 1 second, the exposure is defined as 0, and the exposure is reduced by one level (the shutter time is reduced by half or the aperture is increased by one level. ), the EV value increases by 1.
- the Gb channel When the sensitivity of the Gb channel is equal to 1/2 of the sensitivity of the Gr channel, when the Gr channel is overexposed but not overexposed by 1EV, the Gb channel has not been overexposed. At this time, the Gb channel can relatively truly reflect the object to be imaged. 1EV has been overexposed in the Gr channel, and part of the highlight information has been lost. At this time, the Gb channel can be used to recover part of the highlight information of the object to be imaged.
- the Gb channel When the sensitivity of the Gb channel is less than 1/2 of the sensitivity of the Gr channel, even if the Gr channel is overexposed by more than 1EV, the Gb channel may still be in an unexposed state. At this time, the Gb channel can still reflect the object to be imaged relatively truly However, since the Gr channel has been overexposed, some or even all of the highlight information is lost. At this time, all or part of the highlight information of the object to be imaged can be recovered by using the Gb channel.
- the image sensor is in a Raw-Bayer format.
- the sensitivity of one of the green channels can be lower than that of the other green channel.
- the image sensor may also adopt other formats, which is not limited in this application.
- it further includes: a second processor that preprocesses the signals of the red channel, the blue channel, the first green channel, and the second green channel.
- ND filter neutral gray filter
- ISP image signal processor Image Signal Processor
- the pretreatment includes Demosaic treatment.
- using the attenuated sensitivity of the first green channel to restore the highlight information of the pixel includes: Demosaic processing.
- the Demosaic processing can select bilinear interpolation or adaptive interpolation.
- the Demosaic processing includes mapping the signal of the first green channel and the signal of the second green channel to the first green correction signal and the second green correction signal, respectively.
- the signal of the first green channel and the signal of the second green channel are normalized.
- the signals of the first green channel Gb and the second green channel Gr are respectively mapped to Gnew.
- FIG. 3 shows the brightness mapping curve of a green channel.
- the horizontal and vertical coordinates are respectively The environmental brightness and green channel response, Gr and Gb are respectively mapped to the Gnew curve.
- mapping function used when the signal value of the first green channel is in a first range interval and a second range interval is different, the first range interval and the second range interval are different, and the first range interval The value in a range interval is smaller than the value in the second range interval.
- mapping functions are used for the signals of the Gb channel in different range intervals.
- the Gb signal value is divided into two range intervals. In other embodiments, it can also be divided into other number ranges. This application does not limit the interval.
- the mapping function of the signal of the first green channel is a proportional function; when the signal value of the first green channel is in the range In the second range interval, the mapping function of the signal of the first green channel is a linear function that does not exceed the origin of the coordinate system.
- the mapping function used makes the signal of the Gb channel have a proportional relationship with the processed signal Gb'.
- the signal in the second In the range interval a relatively small slope is used to form the processed signal, so that the processed signal Gb' reaches gain saturation or overexposure relatively slowly.
- the second The mapping function used in the range area is a linear function that is not at the origin of the coordinate system.
- the neutral gray filter 5 selects ND2, that is, when the Gb channel sensitivity is 1/2 of the Gr channel sensitivity, the mapping formula of Gb is as follows:
- the first range interval of Gb is (0, 0.375]
- the second range interval is (0.375, 1).
- the mapping function of the signal of the Gb channel is the proportional function 4/3Gb;
- the mapping function of the signal of the Gb channel is a linear function of the origin of the coordinate system 4/5 (Gb-0.375)+0.5.
- Gb' is the first green correction signal.
- the mapping functions used are different, and the third range interval, the fourth range interval and The fifth range interval is different, and the value in the third range interval is smaller than the value in the fourth range interval, and the value in the fourth range interval is smaller than the value in the fifth range interval.
- the mapping function of the signal of the second green channel is a proportional function; when the signal value of the second green channel is in the range In the fourth range interval, the mapping function of the signal of the second green channel is a linear function that does not exceed the origin of the coordinate system; when the signal value of the second green channel is in the fifth range interval, the second green channel The signal of the green channel is the same as the second green correction signal.
- the mapping function adopted makes the signal of the Gr channel and the processed signal Gr' have a proportional relationship.
- the used mapping function is a linear function that does not exceed the origin of the coordinate system.
- the adopted mapping function is a linear function that does not exceed the origin of the coordinate system, Gr' and The first green correction signal is the same. The reason for this choice is that at this time, the Gr channel has reached the overexposed state, and the signal value read by the Gr channel itself cannot reflect the information of the object to be imaged.
- the value is changed Directly select Gb' which is not in the overexposed state. Because at this time, Gb' more accurately reflects the state of the image to be imaged, this processing method enables part or even all of the highlight information to be recovered when a green channel is overexposed.
- the neutral gray filter 5 selects ND2, that is, when the Gb channel sensitivity is 1/2 of the Gr channel sensitivity, the mapping formula of Gr is as follows:
- the third range interval of Gr is (0, 0.75]
- the fourth range interval is (0.75, 1)
- the fifth range interval is 1.
- the mapping function of the Gb channel signal is proportional Function 4/3Gb; in the second range interval, the mapping function of the signal of the Gb channel is the linear function 4/5(Gb-0.375)+0.5 of the origin of the coordinate system, and in the fifth range interval, Gr' is directly follow the value of the first green correction signal.
- Gr' is the second green correction signal.
- mapping relationship shown in FIG. 3 is formed. It should be noted that the graph shown in FIG. 3 only describes the mapping law qualitatively, and does not reflect a quantitative value.
- the method includes: performing processing according to a reduction multiple of the first green correction signal compared to the first green channel signal Scale down accordingly.
- the red channel and the blue channel need to be processed accordingly.
- the R and B channels are corrected.
- R' is the corrected red channel signal
- B' is the corrected green channel signal
- the rest of the ISP module is the same as the traditional ISP module without any difference.
- the above-mentioned imaging device and imaging method can be exemplarily applied to any recording equipment such as cameras and camcorders that can record images and videos. Therefore, high dynamic range scenes such as backlights on a sunny day, clouds on a sunset day, or nights are shot on cameras and other equipment. In the case of LED lights, you can use the principle that the sensitivity of a G channel is relatively low to restore part of the highlight information.
- Fig. 4 is a comparison diagram of the sensor effect produced by the first bayer array back-illuminated CIS structure and the second bayer array back-illuminated CIS structure provided by an embodiment of the present invention
- Fig. 5 is a comparison diagram of the sensor effect shown in Fig. 4 The first partial comparison diagram
- FIG. 6 is the second partial comparison diagram of the sensor effect comparison diagram shown in FIG. 4.
- the same object is imaged under the same environment, and the left and right pictures shown in Fig. 4 are obtained respectively, and the details of the two pictures in Fig. 4 are shown in the figure respectively. 5 and Figure 6.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Power Engineering (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Electromagnetism (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
一种成像装置、成像方法及相机,包括:四个颜色通道的图像传感器阵列,所述四个颜色通道包括红色通道(R)、蓝色通道(B)、第一绿色通道(Gr)和第二绿色通道(Gb);其中,第一绿色通道(Gr)上设置有中性灰度滤波器(5),使得所述第一绿色通道(Gr)的感度低于所述第二绿色通道(Gb)的感度;或者,所述第一绿色通道(Gr)上的模数转换器ADC的增益小于所述第二绿色通道(Gb)上的ADC的增益,使得所述第一绿色通道(Gr)的感度低于所述第二绿色通道(Gb)的感度。通过提供上述成像装置、成像方法以及相机,可通过简单的电路,较小的成本获得高动态范围的成像。
Description
本发明涉及成像技术领域,尤其涉及一种成像装置、成像方法以及相机。
本发明公开了一种新型的HDR(high-dynamic range)CIS(COMS IMAGE SENSOR)的成像装置和成像方法,应用于手机相机,数码相机或者数码摄像机中。
现有的HDR CIS成像装置中,例如SONY的IMX586,这是一款QBC(quad bayer coding)的CIS,其原理是综合quad bayer的四个不同曝光像素,得到一个高动态范围的像素。然而,上述成像装置的缺点在于恢复高光部分的像素只能用到四个像素中的一个,这样一来减少了传感器的有效利用面积,导致整体输出的图像质量较低。另外,原始像素(raw)的色调映射(tone mapping)设计会导致传感器的电路比较复杂,成本和功耗都非常大。
而在非HDR CIS成像装置中,通常通过多张不同曝光的照片融合的方式达到HDR的目的,这种方法的统一缺点是对运动模糊敏感,在有运动物体的场景容易造成瑕疵。并且,多张曝光在夜晚的时候容易因为手抖动造成融合出瑕疵。另外,对于大晴天曝光时间无法继续降低的时候,多张曝光不能恢复高光的信息。最后,这种融合对计算资源占用比较大,没有专用芯片无法用于HDR视频。
因此,有必要提出一种成像装置、成像方法以及相机来解决上述问题。
发明内容
本发明第一方面提供了一种成像装置,包括:四个颜色通道的图像传感器阵列,所述四个颜色通道包括红色通道、蓝色通道、第一绿色通道和第二绿色 通道;其中,第一绿色通道上设置有中性灰度滤波器,使得所述第一绿色通道的感度低于所述第二绿色通道的感度;或者,所述第一绿色通道上的模数转换器ADC的增益小于所述第二绿色通道上的ADC的增益,使得所述第一绿色通道的感度低于所述第二绿色通道的感度。
第二方面,本发明实施例还提供了一种成像方法,对第一绿色通道进行衰减;利用衰减后的所述第一绿色通道的感度恢复像素的高光信息;其中,在所述第一绿色通道上设置中性灰度滤波器,使得所述第一绿色通道的感度低于所述第二绿色通道的感度;或者,降低所述第一绿色通道上的模数转换器ADC的增益,使其小于所述第二绿色通道上的ADC的增益,进而使得所述第一绿色通道的感度低于所述第二绿色通道的感度。
第三方面,本发明实施例还提供了一种相机,包括:第一方面所述的成像装置,或者采用第二方面所述的成像方法。
本发明通过提供上述成像装置、成像方法以及相机,可通过简单的电路,较小的成本获得高动态范围的成像。
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本发明实施例提供的第一种bayer阵列背照式CIS结构示意图;
图2是本发明实施例提供的第二种bayer阵列背照式CIS结构示意图;
图3是本发明实施例提供的第二种种bayer阵列背照式CIS结构中第一绿色通道的亮度映射曲线示意图;
图4是本发明实施例提供的第一种bayer阵列背照式CIS结构和第二种bayer阵列背照式CIS结构产生的传感器效果对比图;
图5是图4所示的传感器效果对比图的第一局部对比图;
图6是图4所示的传感器效果对比图的第二局部对比图。
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
图1是本发明实施例提供的第一种bayer阵列背照式CIS结构示意图。
具体地,第一种bayer阵列背照式CIS结构中,主要包括如下主要组件:微透镜、彩色滤光片、金属遮光罩、金属互联以及光电二极管等。
如图1所示,其示出了彩色滤光片的平面结构,并且示出了bayer阵列背照式CIS结构的示意图,其包括层叠设置的微透镜1、彩色滤光片2、金属遮光罩3、金属互联4以及光电二极管(未示出),其中,光电二极管(PD)用于捕捉光,示例性地,光电二极管可以选择为PIN二极管或PN结器件。彩色滤光片2用于分离反射光的红、绿、蓝(RGB)成分。最后,微透镜1从CIS的非活性部分收集光,并将其聚焦到光电二极管。
示例性的,微透镜可以选择为球形表面或网状透镜。
彩色滤光片2的结构示例性地如图1所示,其中包括R、Gr、Gb、B四个通道,其中R为红色通道,Gr为第一绿色通道,Gb为第二绿色通道,B为蓝色通道。其中,通道Gr,Gb的感度是一样的。
本申请还提供了一种成像装置,包括:四个颜色通道的图像传感器阵列,所述四个颜色通道包括红色通道、蓝色通道、第一绿色通道和第二绿色通道;其中,第一绿色通道上设置有中性灰度滤波器,使得所述第一绿色通道的感度低于所述第二绿色通道的感度;或者,所述第一绿色通道上的模数转换器ADC的增益小于所述第二绿色通道上的ADC的增益,使得所述第一绿色通道的感度低于所述第二绿色通道的感度。
相应地,还提供了一种成像方法,对第一绿色通道进行衰减;利用衰减后的所述第一绿色通道的感度恢复像素的高光信息;其中,在所述第一绿色通道上设置中性灰度滤波器,使得所述第一绿色通道的感度低于所述第二绿色通道 的感度;或者,降低所述第一绿色通道上的模数转换器ADC的增益,使其小于所述第二绿色通道上的ADC的增益,进而使得所述第一绿色通道的感度低于所述第二绿色通道的感度。
图2是本发明实施例提供的第二种bayer阵列背照式CIS结构示意图。
具体地,第二种bayer阵列背照式CIS结构中,主要包括如下主要组件:微透镜、中性灰度滤波器、彩色滤光片、金属遮光罩、金属互联以及光电二极管等。
如图2所示,其示出了彩色滤光片的平面结构,并且示出了第二种bayer阵列背照式CIS结构的示意图,包括层叠设置的微透镜1、中性灰度滤波器5、彩色滤光片2、金属遮光罩3、金属互联4以及光电二极管(未示出),其中,光电二极管(PD)用于捕捉光,示例性地,光电二极管可以选择为PIN二极管或PN结器件。彩色滤光片用于分离反射光的红、绿、蓝(RGB)成分。最后,微透镜1从CIS的非活性部分收集光,并将其聚焦到光电二极管。
示例性的,微透镜可以选择为球形表面或网状透镜。
彩色滤光片2的结构示例性地如图2所示,其中包括R、Gr、Gb、B四个通道,其中R为红色通道,Gr为第一绿色通道,Gb为第二绿色通道,B为蓝色通道。
示例性地,四个颜色通道的图像传感器阵列,所述四个颜色通道包括红色通道、蓝色通道、第一绿色通道和第二绿色通道;其中,第一绿色通道上设置有中性灰度滤波器,使得所述第一绿色通道的感度低于所述第二绿色通道的感度;或者,所述第一绿色通道上的模数转换器ADC的增益小于所述第二绿色通道上的ADC的增益,使得所述第一绿色通道的感度低于所述第二绿色通道的感度。
如图2所示,在第二种bayer阵列背照式CIS结构中,通过在其中一个G通道,比如Gb通道前方加入一个中性灰度滤波器5(ND filter),使Gb通道的感度低于Gr通道。尽管图2中示例性地表示在Gb通道前方设置了中性灰度滤波器5,然而,本领域技术人员可以理解的是,在其他实施方式中,中性灰度滤波器5也可以设置在Gr通道的前方,同样的,以下描述说明描述是以 在Gb通道上设置中性灰度滤波器5或Gb通道上的模数转换器ADC的增益小于Gr通道上的ADC的增益,使得Gb通道的感度低于Gr通道的感度将为例,但是将其替换为在Gr通道上设置中性灰度滤波器5或Gr通道上的模数转换器ADC的增益小于Gb通道上的ADC的增益,使得Gr通道的感度低于Gb通道的感度也可以实现相同的作用,实现相同的技术效果。
示例性地,也可以通过所述第一绿色通道上的模数转换器ADC的增益小于所述第二绿色通道上的ADC的增益,使得所述第一绿色通道的感度低于所述第二绿色通道的感度。
光线经由光电二极管的光电转换后,接收到电信号,光电转换后的电信号通常是模拟信号,因此,为了便于后续处理,在bayer阵列背照式CIS结构中,在各个颜色通道上往往会设置数模转换器ADC,将模拟电信号转换为数字电信号,在进行模数转换的过程中,可以设置第一绿色通道上的模数转换器ADC的增益小于第二绿色通道上的ADC增益,这样,即使相同的光分别入射到第一绿色通道和第二绿色通道上,第一绿色通道上由于其ADC的增益小于第二绿色通道ADC的增益,因而可以使得所述第一绿色通道的感度低于所述第二绿色通道的感度。
在这种情况下,Gr的感度较高,当入射光的通量从较小开始越来越大时,Gr通道会先于Gb通道到达过曝光。在某一个时刻,当Gr通道已经过曝时,Gb通道还没有过曝,因此,可以利用Gr通道的感度,或者结合Gr通道和Gb通道的感度,恢复部分的高光信息。
例如,在相机拍摄高动态范围场景比如大晴天的逆光,夕阳天的云彩或者夜晚的LED灯的时候,可以利用一个G通道的感度比较低的原理,恢复部分高光信息。
由此可见,本申请的技术方案中仅仅通过设置一个中性灰度滤波器或降低一个ADC的增益,在结构上改变很小或者根本就不需要添加新的成像装置的结构,仅对现有的器件进行改动,就能够获得高动态范围的成像。从而以相当简单的电路和较小的成本就获得了高动态范围的成像。
示例性地,所述红色通道的感度与所述蓝色通道的感度相同。如图2所示, R通道和B通道上方未设置中性灰度滤波器,也没有对R通道或B通道的ADC增益进行特别设置,因此,R通道的感度和B通道的感度相同,并且能够保证充分还原红色通道和绿色通道的光信号,在实现前述技术效果的基础上,进一步保证成像图像的真实性。
示例性地,所述第一绿色通道的感度小于或等于所述第二绿色通道的感度的1/2。
示例性地,所述成像装置还包括第一处理器,用于在所述第二绿色通道的过曝小于等于1EV时,利用所述第一绿色通道的感度恢复所述成像装置的高光信息。
示例性地,当在Gr通道过曝但没有过曝1EV时,Gb通道没有过曝,可以利用Gb通道或者结合Gr通道和Gb通道的信号恢复该位置区域的高光信息。
其中,示例性地,1EV是指当感光度为ISO 100、光圈系数为F1、曝光时间为1秒时,曝光量定义为0,曝光量减少一档(快门时间减少一半或者光圈增大一档),EV值增加1。
当Gb通道的感度等于Gr通道感度的1/2时,在Gr通道过曝但没有过曝1EV时,Gb通道还没有过曝,此时,Gb通道能够相对真实地反映待成像对象,而由于Gr通道中已经过曝了1EV,其中丢失了部分的高光信息,此时,可以利用Gb通道对待成像对象的部分高光信息进行恢复。
当Gb通道的感度小于Gr通道感度的1/2时,即使Gr通道过曝超过了1EV,Gb通道仍然可能出于未过曝的状态,此时,Gb通道仍然能够相对真实地反映待成像对象,而由于Gr通道中已经过曝了,其中丢失了部分甚至全部的高光信息,此时,可以利用Gb通道对待成像对象的全部或部分的高光信息进行恢复。
由此可见,通过对Gb通道的在实现前述技术效果的基础上,进一步保证成像图像的真实性,并且能够在更大的过曝范围内,保证待成像对象的成像质量。
示例性地,所述图像传感器为Raw-Bayer格式。
在Raw-Bayer格式中,通过设置第一绿色通道和第二绿色通道Gr和Gb 两个绿色通道,能够实现使得其中一个绿色通道的感度小于另一个绿色通道的感度。
在其他的实施方式中,图像传感器也可以采用其他格式,本申请对此不做限定。
示例性地,还包括:第二处理器,所述第二处理器对红色通道、蓝色通道、第一绿色通道和第二绿色通道的信号进行预处理。
如图2所示的这种加入了中性灰度滤波器(ND filter)5的bayer CIS,为了获得更加优良的成像效果,需要在ISP图像信号处理器(Image Signal Processor)链路中做响应的改变,例如,对四个通道的信号进行预处理。
示例性地,所述预处理包括Demosaic处理。或者,所述利用衰减后的所述第一绿色通道的感度恢复像素的高光信息,包括:Demosaic处理。
其中,所述Demosaic处理可以选择双线性插值法或自适应插值法。
示例性地,所述Demosaic处理包括将所述第一绿色通道的信号和第二绿色通道的信号分别映射到第一绿色修正信号和第二绿色修正信号。
示例性地,在进行所述映射之前,对所述第一绿色通道的信号和所述第二绿色通道的信号进行归一化处理。
如图3所示,第一绿色通道Gb和第二绿色通道Gr的信号分别映射到Gnew。
具体来说,是需要设计一条绿色通道的亮度映射曲线,使得高光和低光部分的Gr,Gb通道能够匹配,图3中示出的是一条绿色通道的亮度映射曲线,横纵坐标分别是归一化的环境亮度和绿色通道响应,Gr和Gb被分别映射到Gnew曲线。
示例性地,所述第一绿色通道的信号数值处于第一范围区间和第二范围区间时所采用的映射函数不同,所述第一范围区间和所述第二范围区间不同,且所述第一范围区间内的数值小于所述第二范围区间内的数值。
具体地,针对不同范围区间内的Gb通道的信号进行采用不同的映射函数,示例性的,将其Gb的信号数值分为两个范围区间,在其他实施方式,还可以分为其他数量的范围区间,本申请对此不做限定。
示例性地,在所述第一绿色通道的信号数值处于所述第一范围区间时,所 述第一绿色通道的信号的映射函数为正比例函数;在所述第一绿色通道的信号数值处于所述第二范围区间时,所述第一绿色通道的信号的映射函数为不过坐标系原点的线性函数。
具体地,在信号数值较小的第一范围区间内,所采用的映射函数使得Gb通道的信号与处理后的信号Gb’之间成正比例关系,当Gb通道的信号增大时,在第二范围区间内,采用相对较小的斜率形成处理后的信号,使得处理后的信号Gb’相对较慢的达到增益饱和或者过曝值,同时,为了保证两个范围区间信号的连续性,第二范围区内所采用的映射函数为不过坐标系原点的线性函数。
示例性地,当中性灰度滤波器5选择ND2,即Gb通道感度为Gr通道感度的1/2时,Gb的映射公式如下:
具体地,Gb的第一范围区间为(0,0.375],第二范围区间为(0.375,1],在第一范围区间内,Gb通道的信号的映射函数为正比例函数4/3Gb;在所述第二范围区间时,Gb通道的信号的映射函数为不过坐标系原点的线性函数4/5(Gb-0.375)+0.5。
其中,Gb’为第一绿色修正信号。
示例性地,所述第二绿色通道的信号数值处于第三范围区间、第四范围区间和第五范围区间时所采用的映射函数不同,所述第三范围区间、所述第四范围区间和所述第五范围区间不同,且所述第三范围区间内的数值小于所述第四范围区间内的数值,所述第四范围区间的数值小于所述第五范围区间的数值。
示例性地,在所述第二绿色通道的信号数值处于所述第三范围区间时,所述第二绿色通道的信号的映射函数为正比例函数;在所述第二绿色通道的信号数值处于所述第四范围区间时,所述第二绿色通道的信号的映射函数为不过坐标系原点的线性函数;在所述第二绿色通道的信号数值处于所述第五范围区间时,所述第二绿色通道的信号与所述第二绿色修正信号相同。
具体地,在信号数值较小的第三范围区间内,所采用的映射函数使得Gr 通道的信号与处理后的信号Gr’之间成正比例关系,当Gr通道的信号增大时,在第四范围区间内,采用的映射函数为不过坐标系原点的线性函数,当Gr通道的信号继续增大时,在第五范围区间内,采用的映射函数为不过坐标系原点的线性函数,Gr’与所述第一绿色修正信号相同,这样的选择的原因在于,此时,Gr通道已经达到过曝状态,根据Gr通道本身读取的信号值已经无法反应待成像对象的信息,因此,将其数值直接选取为未处于过曝状态的Gb’。由于此时,Gb’更加准确地反应了待成像图像的状态,因此,这种处理方式使得在一个绿色通道过曝的情况下,仍然能够恢复部分甚至全部的高光信息。
示例性地,当中性灰度滤波器5选择ND2,即Gb通道感度为Gr通道感度的1/2时,Gr的映射公式如下:
具体地,Gr的第三范围区间为(0,0.75],第四范围区间为(0.75,1),第五范围区间为1。在第一范围区间内,Gb通道的信号的映射函数为正比例函数4/3Gb;在所述第二范围区间时,Gb通道的信号的映射函数为不过坐标系原点的线性函数4/5(Gb-0.375)+0.5,在第五范围区间内,Gr’直接跟随第一绿色修正信号的值。
其中Gr’为第二绿色修正信号。
通过上述映射处理,其形成了附图3所示的映射关系,需要说明的是,附图3中所示出的图形仅为定性描述映射规律,并不体现定量的值。
示例性地,所述第二处理器在对所述红色通道和所述蓝色通道进行预处理时,包括:根据所述第一绿色修正信号相比所述第一绿色通道信号的缩小倍数进行相应缩小。
具体地,在进行上述映射对绿色通道进行处理之后,需要相应的对红色通道和蓝色通道进行处理。
示例性地,R,B通道修正。处理完G通道后,R和B通道可以通过求解整张图各个位置Gr通道的缩小倍数被对应的修正过来,先计算Gr_mesh=Gr’/Gr。
R'=R.*Gr_mesh
B'=B.*Gr_mesh
其中,R’为修正后的红色通道信号,B’为修正后的绿色通道信号。
示例性地,在一个实施方式中,除了demosaic需要做预处理,其余的ISP模块与传统ISP模块相同,没有任何区别。
上述成像装置和成像方法均可以示例性地应用于相机、摄像机等任何能够记录图像、视频等记录设备,因此,在相机等设备拍摄高动态范围场景比如大晴天的逆光,夕阳天的云彩或者夜晚的LED灯的时候,可以利用一个G通道的感度比较低的原理,恢复部分高光信息。
图4是本发明实施例提供的第一种bayer阵列背照式CIS结构和第二种bayer阵列背照式CIS结构产生的传感器效果对比图;图5是图4所示的传感器效果对比图的第一局部对比图;图6是图4所示的传感器效果对比图的第二局部对比图。
根据本发明提供的成像装置和成像方法,在相同的环境下,对相同的对象成像,分别获得了图4所示的左右两张图片,并将图4两张图片的细节分别示出在图5和图6中。
根据图4中所示,右侧的传感器效果图明确得到了改进,对图像中过曝的位置实现了明显的恢复,结合附图5和附图6可以看到,其中右侧图片中显示了更多的细节,保证了图片的真实性、准确性。
本申请的技术方案中仅仅通过设置一个中性灰度滤波器或降低一个ADC的增益,在结构上改变很小或者根本就不同改动结构,仅对现有的器件进行改动,就能够获得高动态范围的成像。以相当简单的电路和较小的成本就获得了高动态范围的成像。
本发明实施例中所使用的技术术语仅用于说明特定实施例而并不旨在限定本发明。在本文中,单数形式“一”、“该”及“所述”用于同时包括复数形式,除非上下文中明确另行说明。进一步地,在说明书中所使用的用于“包括” 和/或“包含”是指存在所述特征、整体、步骤、操作、元件和/或构件,但是并不排除存在或增加一个或多个其它特征、整体、步骤、操作、元件和/或构件。
在所附权利要求中对应结构、材料、动作以及所有装置或者步骤以及功能元件的等同形式(如果存在的话)旨在包括结合其他明确要求的元件用于执行该功能的任何结构、材料或动作。本发明的描述出于实施例和描述的目的被给出,但并不旨在是穷举的或者将被发明限制在所公开的形式。在不偏离本发明的范围和精神的情况下,多种修改和变形对于本领域的一般技术人员而言是显而易见的。本发明中所描述的实施例能够更好地揭示本发明的原理与实际应用,并使本领域的一般技术人员可了解本发明。
本发明中所描述的流程图仅仅为一个实施例,在不偏离本发明的精神的情况下对此图示或者本发明中的步骤可以有多种修改变化。比如,可以不同次序的执行这些步骤,或者可以增加、删除或者修改某些步骤。本领域的一般技术人员可以理解实现上述实施例的全部或部分流程,并依本发明权利要求所作的等同变化,仍属于发明所涵盖的范围。
Claims (29)
- 一种成像装置,其特征在于,包括:四个颜色通道的图像传感器阵列,所述四个颜色通道包括红色通道、蓝色通道、第一绿色通道和第二绿色通道;其中,第一绿色通道上设置有中性灰度滤波器,使得所述第一绿色通道的感度低于所述第二绿色通道的感度;或者,所述第一绿色通道上的模数转换器ADC的增益小于所述第二绿色通道上的ADC的增益,使得所述第一绿色通道的感度低于所述第二绿色通道的感度。
- 根据权利要求1所述的成像装置,其特征在于,所述第一绿色通道的感度小于或等于所述第二绿色通道的感度的1/2。
- 根据权利要求1所述的成像装置,其特征在于,所述红色通道的感度与所述蓝色通道的感度相同。
- 根据权利要求1或2所述的成像装置,其特征在于,所述成像装置还包括第一处理器,用于在所述第二绿色通道的过曝小于等于1EV时,利用所述第一绿色通道的感度恢复所述成像装置的高光信息。
- 根据权利要求1至4任意一项所述的成像装置,其特征在于,所述图像传感器为Raw-Bayer格式。
- 根据权利要求1所述的成像装置,其特征在于,还包括:第二处理器,所述第二处理器对红色通道、蓝色通道、第一绿色通道和第二绿色通道的信号进行预处理。
- 根据权利要求6所述的成像装置,其特征在于,所述预处理包括Demosaic处理。
- 根据权利要求6或7所述的成像装置,其特征在于,所述Demosaic处理包括将所述第一绿色通道的信号和第二绿色通道的信号分别映射到第一绿色修正信号和第二绿色修正信号。
- 根据权利要求8所述的成像装置,其特征在于,所述第一绿色通道的信号数值处于第一范围区间和第二范围区间时所采用的映射函数不同,所述第一范围区间和所述第二范围区间不同,且所述第一范围区间内的数值小于所述 第二范围区间内的数值。
- 根据权利要求9所述的成像装置,其特征在于,在所述第一绿色通道的信号数值处于所述第一范围区间时,所述第一绿色通道的信号的映射函数为正比例函数;在所述第一绿色通道的信号数值处于所述第二范围区间时,所述第一绿色通道的信号的映射函数为不过坐标系原点的线性函数。
- 根据权利要求8所述的成像装置,其特征在于,所述第二绿色通道的信号数值处于第三范围区间、第四范围区间和第五范围区间时所采用的映射函数不同,所述第三范围区间、所述第四范围区间和所述第五范围区间不同,且所述第三范围区间内的数值小于所述第四范围区间内的数值,所述第四范围区间的数值小于所述第五范围区间的数值。
- 根据权利要求11所述的成像装置,其特征在于,在所述第二绿色通道的信号数值处于所述第三范围区间时,所述第二绿色通道的信号的映射函数为正比例函数;在所述第二绿色通道的信号数值处于所述第四范围区间时,所述第二绿色通道的信号的映射函数为不过坐标系原点的线性函数;在所述第二绿色通道的信号数值处于所述第五范围区间时,所述第二绿色通道的信号与所述第二绿色修正信号相同。
- 根据权利要求6所述的成像装置,其特征在于,在进行所述映射之前,对所述第一绿色通道的信号和所述第二绿色通道的信号进行归一化处理。
- 根据权利要求6所述的成像装置,其特征在于,所述第二处理器在对所述红色通道和所述蓝色通道进行预处理时,包括:根据所述第一绿色修正信号相比所述第一绿色通道信号的缩小倍数进行相应缩小。
- 一种成像方法,其特征在于,对第一绿色通道进行衰减;利用衰减后的所述第一绿色通道的感度恢复像素的高光信息;其中,在所述第一绿色通道上设置中性灰度滤波器,使得所述第一绿色通道的感度低于所述第二绿色通道的感度;或者,降低所述第一绿色通道上的模数转换器ADC的增益,使其小于所述第二绿色通道上的ADC的增益,进而使得所述第一绿色通道的感度低于所述第二绿色通道的感度。
- 根据权利要求15所述的成像方法,其特征在于,所述第一绿色通道的感度小于或等于所述第二绿色通道的感度的1/2。
- 根据权利要求15所述的成像方法,其特征在于,还包括红色通道和蓝色通道,其中,所述红色通道的感度与所述蓝色通道的感度相同。
- 根据权利要求15所述的成像方法,其特征在于,在所述第二绿色通道的过曝小于等于1EV时,利用所述第一绿色通道的感度恢复所述成像装置的高光信息。
- 根据权利要求15所述的成像方法,其特征在于,所述成像方法应用于Raw-Bayer格式像素。
- 根据权利要求15所述的成像方法,其特征在于,还包括:对红色通道、蓝色通道、第一绿色通道和第二绿色通道的信号进行预处理。
- 根据权利要求15所述的成像方法,其特征在于,所述利用衰减后的所述第一绿色通道的感度恢复像素的高光信息,包括:Demosaic处理。
- 根据权利要求20所述的成像方法,其特征在于,还包括将所述第一绿色通道的信号和所述第二绿色通道的信号分别映射到第一绿色修正信号和第二绿色修正信号。
- 根据权利要求22所述的成像方法,其特征在于,所述第一绿色通道的信号数值处于第一范围区间和第二范围区间时所采用的映射函数不同,所述第一范围区间和所述第二范围区间不同,且所述第一范围区间内的数值小于所述第二范围区间内的数值。
- 根据权利要求21所述的成像方法,其特征在于,在所述第一绿色通道的信号数值处于所述第一范围区间时,所述第一绿色通道的信号的映射函数为正比例函数;在所述第一绿色通道的信号数值处于所述第二范围区间时,所述第一绿色通道的信号的映射函数为不过坐标系原点的线性函数。
- 根据权利要求22所述的成像方法,其特征在于,所述第二绿色通道的信号数值处于第三范围区间、第四范围区间和第五范围区间时所采用的映射函数不同,所述第三范围区间、所述第四范围区间和所述第五范围区间不同,且所述第三范围区间内的数值小于所述第四范围区间内的数值,所述第四范围区间的数值小于所述第五范围区间的数值。
- 根据权利要求25所述的成像方法,其特征在于,在所述第二绿色通道的信号数值处于所述第三范围区间时,所述第二绿色通道的信号的映射函数为正比例函数;在所述第二绿色通道的信号数值处于所述第四范围区间时,所述第二绿色通道的信号的映射函数为不过坐标系原点的线性函数;在所述第二绿色通道的信号数值处于所述第五范围区间时,所述第二绿色通道的信号与所述第二绿色修正信号相同。
- 根据权利要求18所述的成像方法,其特征在于,在进行所述映射之前,对所述第一绿色通道的信号和所述第二绿色通道的信号进行归一化处理。
- 根据权利要求18所述的成像方法,其特征在于,所述第二处理器在对所述红色通道和所述蓝色通道进行预处理时,包括:根据所述第一绿色修正信号相比所述第一绿色通道信号的缩小倍数进行相应缩小。
- 一种相机,其特征在于,包括:如权利要求1至14任一项所述的成像装置,或者采用权利要求15至28中任一项所述的成像方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202080031334.9A CN114097218A (zh) | 2020-04-30 | 2020-04-30 | 一种成像装置、成像方法以及相机 |
PCT/CN2020/088466 WO2021217640A1 (zh) | 2020-04-30 | 2020-04-30 | 一种成像装置、成像方法以及相机 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2020/088466 WO2021217640A1 (zh) | 2020-04-30 | 2020-04-30 | 一种成像装置、成像方法以及相机 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021217640A1 true WO2021217640A1 (zh) | 2021-11-04 |
Family
ID=78373175
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/088466 WO2021217640A1 (zh) | 2020-04-30 | 2020-04-30 | 一种成像装置、成像方法以及相机 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN114097218A (zh) |
WO (1) | WO2021217640A1 (zh) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000041189A (ja) * | 1998-07-22 | 2000-02-08 | Sony Corp | 撮像装置 |
CN101909157A (zh) * | 2009-06-05 | 2010-12-08 | 比亚迪股份有限公司 | 在图像传感器中获得高动态范围图像的方法及图像传感器 |
CN104780352A (zh) * | 2014-01-14 | 2015-07-15 | 株式会社东芝 | 固态成像器件和照相机*** |
CN108364966A (zh) * | 2018-02-06 | 2018-08-03 | 德淮半导体有限公司 | 图像传感器及其形成方法 |
CN108400143A (zh) * | 2018-02-28 | 2018-08-14 | 德淮半导体有限公司 | 图像传感器及其形成方法 |
-
2020
- 2020-04-30 CN CN202080031334.9A patent/CN114097218A/zh active Pending
- 2020-04-30 WO PCT/CN2020/088466 patent/WO2021217640A1/zh active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000041189A (ja) * | 1998-07-22 | 2000-02-08 | Sony Corp | 撮像装置 |
CN101909157A (zh) * | 2009-06-05 | 2010-12-08 | 比亚迪股份有限公司 | 在图像传感器中获得高动态范围图像的方法及图像传感器 |
CN104780352A (zh) * | 2014-01-14 | 2015-07-15 | 株式会社东芝 | 固态成像器件和照相机*** |
CN108364966A (zh) * | 2018-02-06 | 2018-08-03 | 德淮半导体有限公司 | 图像传感器及其形成方法 |
CN108400143A (zh) * | 2018-02-28 | 2018-08-14 | 德淮半导体有限公司 | 图像传感器及其形成方法 |
Also Published As
Publication number | Publication date |
---|---|
CN114097218A (zh) | 2022-02-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
TWI526068B (zh) | 圖像擷取裝置及影像處理方法 | |
US9883125B2 (en) | Imaging systems and methods for generating motion-compensated high-dynamic-range images | |
TWI511558B (zh) | 具有高動態範圍攝取能力之影像感測器 | |
CN110381263B (zh) | 图像处理方法、装置、存储介质及电子设备 | |
US10810716B2 (en) | Image capturing device, image processing device and display device for setting different exposure conditions | |
JP6455601B2 (ja) | 制御システム、撮像装置、およびプログラム | |
JP2019205177A (ja) | 電子機器 | |
CN110198418B (zh) | 图像处理方法、装置、存储介质及电子设备 | |
CN102970487A (zh) | 图像处理设备、图像处理方法和程序 | |
US20230107373A1 (en) | Imaging unit, imaging apparatus, and computer-readable medium having stored thereon a control program | |
CN112422784A (zh) | 成像方法、成像装置、电子装置和存储介质 | |
CN116416122A (zh) | 图像处理方法及其相关设备 | |
CN110278375B (zh) | 图像处理方法、装置、存储介质及电子设备 | |
JP2022115944A (ja) | 撮像装置 | |
US7400355B2 (en) | Image pickup apparatus and photometer | |
US11496694B2 (en) | Dual sensor imaging system and imaging method thereof | |
JP2016072895A (ja) | 電子機器、再生プログラム、記録プログラム、再生方法、記録方法および記録媒体 | |
US20230388650A1 (en) | Image sensing device and image sensing method thereof | |
CN110266967B (zh) | 图像处理方法、装置、存储介质及电子设备 | |
CN110266965B (zh) | 图像处理方法、装置、存储介质及电子设备 | |
WO2021217640A1 (zh) | 一种成像装置、成像方法以及相机 | |
WO2022073364A1 (zh) | 图像获取方法及装置、终端和计算机可读存储介质 | |
JP2004222183A (ja) | 露出補正機能付きデジタルカメラ | |
JP4015492B2 (ja) | 画像合成方法および撮像装置 | |
JP7447947B2 (ja) | 電子機器 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20933599 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20933599 Country of ref document: EP Kind code of ref document: A1 |