EP4199530A1 - Solid-state imaging device and electronic apparatus - Google Patents
Solid-state imaging device and electronic apparatus Download PDFInfo
- Publication number
- EP4199530A1 EP4199530A1 EP23156683.7A EP23156683A EP4199530A1 EP 4199530 A1 EP4199530 A1 EP 4199530A1 EP 23156683 A EP23156683 A EP 23156683A EP 4199530 A1 EP4199530 A1 EP 4199530A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- pixel
- pixels
- photodiodes
- signal
- photoelectric conversion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 194
- 238000006243 chemical reaction Methods 0.000 claims description 61
- 239000011159 matrix material Substances 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 abstract description 35
- 239000003086 colorant Substances 0.000 abstract description 9
- 238000012546 transfer Methods 0.000 description 77
- 238000001514 detection method Methods 0.000 description 49
- 238000010586 diagram Methods 0.000 description 47
- 238000012545 processing Methods 0.000 description 45
- 239000010410 layer Substances 0.000 description 40
- 230000000875 corresponding effect Effects 0.000 description 26
- 210000003128 head Anatomy 0.000 description 25
- 239000004065 semiconductor Substances 0.000 description 23
- 238000000034 method Methods 0.000 description 21
- 238000012986 modification Methods 0.000 description 21
- 230000004048 modification Effects 0.000 description 21
- 239000000758 substrate Substances 0.000 description 20
- 239000012535 impurity Substances 0.000 description 19
- 238000004891 communication Methods 0.000 description 18
- 230000003321 amplification Effects 0.000 description 16
- 238000003199 nucleic acid amplification method Methods 0.000 description 16
- 238000002674 endoscopic surgery Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 11
- 230000003287 optical effect Effects 0.000 description 11
- 238000005036 potential barrier Methods 0.000 description 8
- 210000001519 tissue Anatomy 0.000 description 8
- 230000001276 controlling effect Effects 0.000 description 7
- 239000002184 metal Substances 0.000 description 7
- 229910052751 metal Inorganic materials 0.000 description 7
- 230000004044 response Effects 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000035945 sensitivity Effects 0.000 description 5
- 238000001356 surgical procedure Methods 0.000 description 5
- 239000000470 constituent Substances 0.000 description 4
- 230000005284 excitation Effects 0.000 description 4
- 230000001678 irradiating effect Effects 0.000 description 4
- 238000005259 measurement Methods 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 229920005989 resin Polymers 0.000 description 4
- 239000011347 resin Substances 0.000 description 4
- PXHVJJICTQNCMI-UHFFFAOYSA-N Nickel Chemical compound [Ni] PXHVJJICTQNCMI-UHFFFAOYSA-N 0.000 description 3
- 208000005646 Pneumoperitoneum Diseases 0.000 description 3
- 210000004204 blood vessel Anatomy 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 239000010949 copper Substances 0.000 description 3
- 238000010336 energy treatment Methods 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000002955 isolation Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 229910021420 polycrystalline silicon Inorganic materials 0.000 description 3
- 229920005591 polysilicon Polymers 0.000 description 3
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 2
- PPBRXRYQALVLMV-UHFFFAOYSA-N Styrene Chemical compound C=CC1=CC=CC=C1 PPBRXRYQALVLMV-UHFFFAOYSA-N 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 239000003153 chemical reaction reagent Substances 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 238000005401 electroluminescence Methods 0.000 description 2
- MOFVSTNWEDAEEK-UHFFFAOYSA-M indocyanine green Chemical compound [Na+].[O-]S(=O)(=O)CCCCN1C2=CC=C3C=CC=CC3=C2C(C)(C)C1=CC=CC=CC=CC1=[N+](CCCCS([O-])(=O)=O)C2=CC=C(C=CC=C3)C3=C2C1(C)C MOFVSTNWEDAEEK-UHFFFAOYSA-M 0.000 description 2
- 229960004657 indocyanine green Drugs 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 229920006395 saturated elastomer Polymers 0.000 description 2
- 229910052710 silicon Inorganic materials 0.000 description 2
- 239000010703 silicon Substances 0.000 description 2
- 239000010936 titanium Substances 0.000 description 2
- 239000004925 Acrylic resin Substances 0.000 description 1
- 229920000178 Acrylic resin Polymers 0.000 description 1
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- ZOKXTWBITQBERF-UHFFFAOYSA-N Molybdenum Chemical compound [Mo] ZOKXTWBITQBERF-UHFFFAOYSA-N 0.000 description 1
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N Silicium dioxide Chemical compound O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 description 1
- BOTDANWDWHJENH-UHFFFAOYSA-N Tetraethyl orthosilicate Chemical compound CCO[Si](OCC)(OCC)OCC BOTDANWDWHJENH-UHFFFAOYSA-N 0.000 description 1
- RTAQQCXQSZGOHL-UHFFFAOYSA-N Titanium Chemical compound [Ti] RTAQQCXQSZGOHL-UHFFFAOYSA-N 0.000 description 1
- 238000002679 ablation Methods 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 229910052782 aluminium Inorganic materials 0.000 description 1
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical compound [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 description 1
- 230000000740 bleeding effect Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 229920006026 co-polymeric resin Polymers 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 238000002485 combustion reaction Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- KPUWHANPEXNPJT-UHFFFAOYSA-N disiloxane Chemical class [SiH3]O[SiH3] KPUWHANPEXNPJT-UHFFFAOYSA-N 0.000 description 1
- 239000000975 dye Substances 0.000 description 1
- 238000005530 etching Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000002073 fluorescence micrograph Methods 0.000 description 1
- 230000004313 glare Effects 0.000 description 1
- 229910052735 hafnium Inorganic materials 0.000 description 1
- VBJZVLUMGGDVMO-UHFFFAOYSA-N hafnium atom Chemical compound [Hf] VBJZVLUMGGDVMO-UHFFFAOYSA-N 0.000 description 1
- 239000011229 interlayer Substances 0.000 description 1
- 238000005468 ion implantation Methods 0.000 description 1
- 230000031700 light absorption Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000002406 microsurgery Methods 0.000 description 1
- 239000003595 mist Substances 0.000 description 1
- 230000000116 mitigating effect Effects 0.000 description 1
- 229910052750 molybdenum Inorganic materials 0.000 description 1
- 239000011733 molybdenum Substances 0.000 description 1
- 210000004400 mucous membrane Anatomy 0.000 description 1
- 229910052759 nickel Inorganic materials 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000010363 phase shift Effects 0.000 description 1
- 239000000049 pigment Substances 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 210000004761 scalp Anatomy 0.000 description 1
- 238000007789 sealing Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 229910052814 silicon oxide Inorganic materials 0.000 description 1
- 238000004528 spin coating Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 229910052719 titanium Inorganic materials 0.000 description 1
- WFKWXMTUELFFGS-UHFFFAOYSA-N tungsten Chemical compound [W] WFKWXMTUELFFGS-UHFFFAOYSA-N 0.000 description 1
- 229910052721 tungsten Inorganic materials 0.000 description 1
- 239000010937 tungsten Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/58—Control of the dynamic range involving two or more exposures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14601—Structural or functional details thereof
- H01L27/14603—Special geometry or disposition of pixel-elements, address-lines or gate-electrodes
- H01L27/14607—Geometry of the photosensitive area
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14601—Structural or functional details thereof
- H01L27/14609—Pixel-elements with integrated switching, control, storage or amplification elements
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14601—Structural or functional details thereof
- H01L27/1462—Coatings
- H01L27/14621—Colour filter arrangements
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14601—Structural or functional details thereof
- H01L27/14625—Optical elements or arrangements associated with the device
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14643—Photodiode arrays; MOS imagers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/42—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by switching between different modes of operation using different resolutions or aspect ratios, e.g. switching between interlaced and non-interlaced mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/46—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by combining or binning pixels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/53—Control of the integration time
- H04N25/533—Control of the integration time by using differing integration times for different sensor regions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/58—Control of the dynamic range involving two or more exposures
- H04N25/581—Control of the dynamic range involving two or more exposures acquired simultaneously
- H04N25/583—Control of the dynamic range involving two or more exposures acquired simultaneously with different integration times
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/58—Control of the dynamic range involving two or more exposures
- H04N25/581—Control of the dynamic range involving two or more exposures acquired simultaneously
- H04N25/585—Control of the dynamic range involving two or more exposures acquired simultaneously with pixels having different sensitivities within the sensor, e.g. fast or slow pixels or pixels having different sizes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/58—Control of the dynamic range involving two or more exposures
- H04N25/587—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields
- H04N25/589—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields with different integration times, e.g. short and long exposures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/703—SSIS architectures incorporating pixels for producing signals other than image signals
- H04N25/704—Pixels specially adapted for focusing, e.g. phase difference pixel sets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
Definitions
- the present technology relates to a solid-state imaging device and an electronic apparatus, and more particularly, relates to a solid-state imaging device and an electronic apparatus configured to be able to simultaneously acquire a signal for generating a high dynamic range image and a signal for detecting a phase difference.
- Patent Document 1 Japanese Patent Application Laid-Open No. 2016-171308
- the present technology has been made in view of such a situation, and is intended to enable simultaneous acquisition of a signal for generating a high dynamic range image and a signal for detecting a phase difference.
- a solid-state imaging device includes a plurality of pixel sets each including color filters of the same color, for a plurality of colors, each pixel set including a plurality of pixels, each pixel including a plurality of photoelectric conversion parts.
- An electronic apparatus includes a solid-state imaging device including a plurality of pixel sets each including color filters of the same color, for a plurality of colors, each pixel set including a plurality of pixels, each pixel including a plurality of photoelectric conversion parts.
- a plurality of pixel sets each including color filters of the same color is provided for a plurality of colors, each pixel set is provided with a plurality of pixels, and each pixel is provided with a plurality of photoelectric conversion parts.
- the solid-state imaging device and the electronic apparatus may be independent devices, or may be modules incorporated into other devices.
- the present technology it is possible to simultaneously acquire a signal for generating a high dynamic range image and a signal for detecting a phase difference.
- Fig. 1 illustrates a schematic configuration of a solid-state imaging device to which the present technology is applied.
- a solid-state imaging device 1 of Fig. 1 includes a pixel array 3 with pixels 2 two-dimensionally arrayed in a matrix, and peripheral circuitry around the pixel array 3 on a semiconductor substrate 12 using, for example, silicon (Si) as a semiconductor.
- the peripheral circuitry includes a vertical drive circuit 4, column signal processing circuits 5, a horizontal drive circuit 6, an output circuit 7, a control circuit 8, and others.
- the pixels 2 each include photodiodes as photoelectric conversion parts and a plurality of pixel transistors. Note that, as described later with reference to Fig. 4 , the pixels 2 are formed in a shared pixel structure in which floating diffusion as a charge holding part that holds charges generated in the photodiodes is shared among a plurality of pixels 2. In the shared pixel structure, photodiodes and transfer transistors are provided for each pixel, and a selection transistor, a reset transistor, and an amplification transistor are shared by a plurality of pixels.
- the control circuit 8 receives an input clock and data instructing an operation mode or the like, and outputs data such as internal information of the solid-state imaging device 1. Specifically, on the basis of a vertical synchronization signal, a horizontal synchronization signal, and a master clock, the control circuit 8 generates a clock signal and a control signal on the basis of which the vertical drive circuit 4, the column signal processing circuits 5, the horizontal drive circuit 6, and others operate. Then, the control circuit 8 outputs the generated clock signal and control signal to the vertical drive circuit 4, the column signal processing circuits 5, the horizontal drive circuit 6, and others.
- the vertical drive circuit 4 is formed, for example, by a shift register, and selects a predetermined pixel drive wire 10, provides a pulse for driving the pixels 2 to the selected pixel drive wire 10, and drives the pixels 2 row by row. That is, the vertical drive circuit 4 performs control to selectively scan the pixels 2 of the pixel array 3 in the vertical direction sequentially row by row, and output pixel signals based on signal charges generated in the photoelectric conversion parts of the pixels 2 depending on the amount of received light, through vertical signal lines 9 to the column signal processing circuits 5.
- the column signal processing circuits 5 are arranged for the corresponding columns of the pixels 2, and perform signal processing such as noise removal on signals output from the pixels 2 in one row for the corresponding pixel columns.
- the column signal processing circuits 5 perform signal processing such as correlated double sampling (CDS) for removing fixed pattern noise peculiar to pixels and AD conversion.
- CDS correlated double sampling
- the horizontal drive circuit 6 is formed, for example, by a shift register, selects each of the column signal processing circuits 5 in order by sequentially outputting a horizontal scanning pulse, and causes each of the column signal processing circuits 5 to output a pixel signal to a horizontal signal line 11.
- the output circuit 7 performs predetermined signal processing on a signal sequentially provided from each of the column signal processing circuits 5 through the horizontal signal line 11, and outputs the signal.
- the output circuit 7 may perform only buffering, or may perform various types of digital signal processing such as black level adjustment and column variation correction.
- An input-output terminal 13 exchanges signals with the outside.
- the solid-state imaging device 1 formed as described above is a CMOS image sensor called a column AD system in which the column signal processing circuits 5 that perform CDS processing and AD conversion processing are arranged for the corresponding pixel columns.
- the solid-state imaging device 1 may be formed by a chip of a stacked structure in which a plurality of substrates is stacked.
- a chip with a plurality of substrates stacked is formed by stacking a lower substrate and an upper substrate in that order from below upward.
- At least one or more of the control circuit 8, the vertical drive circuit 4, the column signal processing circuits 5, the horizontal drive circuit 6, and the output circuit 7 are formed on the lower substrate, and at least the pixel array 3 is formed on the upper substrate.
- Connection portions connect the vertical drive circuit 4 to the pixel array 3, and the column signal processing circuits 5 to the pixel array 3, so that signals are transmitted between the lower substrate and the upper substrate.
- the connection portions are formed, for example, by through silicon vias (TSVs), Cu-Cu, or the like.
- Fig. 2 is a diagram illustrating a first cross-sectional configuration example of the pixel array 3 of the solid-state imaging device 1 in Fig. 1 .
- photodiodes PD are formed by, for example, forming N-type (second conductivity type) semiconductor regions 32 in a P-type (first conductivity type) semiconductor region 31 in the semiconductor substrate 12.
- N-type (second conductivity type) semiconductor regions 32 are formed in each pixel 2 of the pixel array 3, and the two photodiodes PD are formed in such a manner as to be symmetrically disposed in two parts into which a pixel region is divided equally.
- the photodiode PD disposed on the right side in the figure is sometimes referred to as the right photodiode PD, and the photodiode PD disposed on the left side as the left photodiode PD.
- a multilayer wiring layer 35 is formed which includes pixel transistors (not illustrated) for performing reading of charges generated and accumulated in the photodiodes PD of each pixel 2 and the like, a plurality of wiring layers 33, and an interlayer dielectric 34.
- an inter-pixel light-shielding film 36 is formed on pixel boundary portions on the back side of the semiconductor substrate 12 that is the upper side in Fig. 2 .
- the inter-pixel light-shielding film 36 may be of any material that blocks light, and is desirably of a material that has a high light-blocking property and can be processed with high precision by fine processing such as etching.
- the inter-pixel light-shielding film 36 can be formed, for example, by a metal film of tungsten (W), aluminum (Al), copper (Cu), titanium (Ti), molybdenum (Mo), nickel (Ni), or the like.
- an antireflection film formed, for example, by a silicon oxide film or the like may be further formed on a back side interface of the semiconductor substrate 12.
- color filters 37 are formed on the back surface of the semiconductor substrate 12 including the inter-pixel light-shielding film 36 .
- the color filters 37 are formed by spin-coating photosensitive resin containing coloring matters such as pigments or dyes, for example.
- the color array of the color filters 37 will be described later with reference to Fig. 3 .
- Red (R), green (G), and blue (B) colors are arranged in a Bayer array in units of four pixels in 2 x 2 (two rows by two columns).
- on-chip lenses 38 are formed for the individual pixels.
- the on-chip lenses 38 are formed, for example, of a resin material such as a styrene resin, an acrylic resin, a styrene-acryl copolymer resin, or a siloxane resin.
- the solid-state imaging device 1 is a back-side illuminated CMOS solid-state imaging device in which the color filters 37 and the on-chip lenses 38 are formed on the back side of the semiconductor substrate 12 opposite to the front side on which the multilayer wiring layer 35 is formed, so that light enters from the back side.
- Each pixel 2 of the solid-state imaging device 1 has two separate photodiodes PD in the pixel.
- the two photodiodes PD are formed at different positions, so that a shift occurs between images generated from the two photodiodes PD, individually. From this image shift, the amount of phase shift is calculated to calculate the amount of defocus. By adjusting (moving) an imaging lens, autofocus can be achieved.
- the color filters 37 are arranged to be of the same color in each individual pixel set 51. More specifically, the R, G, and B color filters 37 are arranged in a Bayer array in units of the pixel sets 51.
- the pixel set 51 having the R color filters 37 is represented by a pixel set 51R
- the pixel set 51 having the G color filters 37 adjacent to the pixel set 51R is represented by a pixel set 51Gr
- the pixel set 51 having the B color filters 37 is represented by a pixel set 51B
- the pixel set 51 having the G color filters 37 adjacent to the pixel set 51B is represented by a pixel set 51Gb.
- the configuration of the color filters is not limited to RGB primary-colors filters, and various configurations including filters of complementary colors such as cyan, magenta, yellow, and green (CMYG) may be applied.
- orientations of the longitudinal shape of the two photodiodes PD formed in each pixel 2 are the same direction in the pixel set 51, and also, they are formed in the same direction in all the pixel sets 51.
- the on-chip lenses 38 are formed for the individual pixels.
- Fig. 4 is a diagram illustrating a circuit configuration of the pixel set 51.
- Fig. 4 illustrates a circuit configuration of the pixel set 51Gr as an example of the pixel set 51.
- Each pixel 2 of the pixel set 51Gr includes two photodiodes PD and two transfer transistors TG for transferring charges accumulated in them. And one FD 52, one reset transistor 53, one amplification transistor 54, and one selection transistor 55 are provided for the pixel set 51Gr. Each of the reset transistor 53, the amplification transistor 54, and the selection transistor 55 is shared by the four pixels of the pixel set 51Gr. The four pixels sharing the reset transistor 53, the amplification transistor 54, and the selection transistor 5 form a sharing unit.
- the two photodiodes PD and the two transfer transistors TG of each pixel 2 in the pixel set 51Gr are distinguished from each other, of the four pixels in 2 x 2 constituting the pixel set 51Gr, the two photodiodes PD of the upper left pixel 2 are referred to as photodiodes PD_Gr1L and PD_Gr1R, and the two transfer transistors TG that transfer charges accumulated in the photodiodes PD_Gr1L and PD_Gr1R are referred to as transfer transistors TG_Gr1L and TG_Gr1R.
- the two photodiodes PD of the upper right pixel 2 are referred to as photodiodes PD_Gr2L and PD_Gr2R
- the two transfer transistors TG that transfer charges accumulated in the photodiodes PD_Gr2L and PD_Gr2R are referred to as transfer transistors TG_Gr2L and TG_Gr2R.
- the two photodiodes PD of the lower left pixel 2 are referred to as photodiodes PD_Gr3L and PD_Gr3R
- the two transfer transistors TG that transfer charges accumulated in the photodiodes Gr3L and Gr3R are referred to as transfer transistors TG_Gr3L and TG_Gr3R.
- the two photodiodes PD of the lower right pixel 2 are referred to as photodiodes PD_Gr4L and PD_Gr4R, and the two transfer transistors TG that transfer charges accumulated in the photodiodes PD_Gr4L and PD_Gr4R are referred to as transfer transistors TG_Gr4L and TG_Gr4R.
- Each of the photodiodes PD of each pixel 2 in the pixel set 51Gr receives light and generates and accumulates photocharges.
- the FD 52 temporarily holds photocharges provided from each photodiode PD of each pixel 2 in the pixel set 51Gr.
- the reset transistor 53 When a drive signal RST provided to the gate electrode becomes active, the reset transistor 53 becomes conductive in response to this, resetting the potential of the FD 52 to a predetermined level (reset voltage VDD).
- the amplification transistor 54 has a source electrode connected to the vertical signal line 9 via the selection transistor 55, thereby forming a source follower circuit with a load MOS of a constant current source circuit 56 connected to one end of the vertical signal line 9.
- the selection transistor 55 is connected between the source electrode of the amplification transistor 54 and the vertical signal line 9.
- a selection signal SEL provided to the gate electrode becomes active, the selection transistor 55 becomes conductive in response to this, bringing the sharing unit into a selected state and outputting pixel signals of the pixels 2 in the sharing unit output from the amplification transistor 54 to the vertical signal line 9.
- one selection transistor 55 may be provided as illustrated in Fig. 4 , or two or more selection transistors 55 may be provided. In a case where two or more selection transistors 55 are provided for the pixel set 51, the two or more selection transistors 55 are connected to different vertical signal lines 9, so that pixel signals can be read at higher speed.
- the transfer transistors TG of the pixels 2, the reset transistor 53, the amplification transistor 54, and the selection transistor 55 are controlled by the vertical drive circuit 4.
- Fig. 5 illustrates a configuration of signal lines for providing the drive signals TRGGr to the gate electrodes of the eight transfer transistors TG constituting the pixel set 51 as illustrated in Fig. 4 .
- eight signal lines 61-1 to 61-8 are required for a plurality of pixel sets 51 arrayed in the horizontal direction.
- the eight signal lines 61-1 to 61-8 are part of the pixel drive wires 10 in Fig. 1 .
- the signal line 61-1 transmits the drive signal TRGGr1L to be provided to the gate electrode of the transfer transistor TG_Gr1L in the pixel set 51Gr. Furthermore, the signal line 61-1 also transmits the drive signal TRGGr1L to the gate electrode of a transfer transistor TG_R1L (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr1L in the pixel set 51Gr.
- the signal line 61-2 transmits the drive signal TRGGr1R to be provided to the gate electrode of the transfer transistor TG_Gr1R in the pixel set 51Gr. Furthermore, the signal line 61-2 also transmits the drive signal TRGGr1R to the gate electrode of a transfer transistor TG_R1R (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr1R in the pixel set 51Gr.
- the signal line 61-3 transmits the drive signal TRGGr2L to be provided to the gate electrode of the transfer transistor TG_Gr2L in the pixel set 51Gr. Furthermore, the signal line 61-3 also transmits the drive signal TRGGr2L to the gate electrode of a transfer transistor TG_R2L (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor G_Gr2L in the pixel set 51Gr.
- the signal line 61-4 transmits the drive signal TRGGr2R to be provided to the gate electrode of the transfer transistor TG_Gr2R in the pixel set 51Gr. Furthermore, the signal line 61-4 also transmits the drive signal TRGGr2R to the gate electrode of a transfer transistor TG_R2R (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr2R in the pixel set 51Gr.
- the signal line 61-5 transmits the drive signal TRGGr3L to be provided to the gate electrode of the transfer transistor TG_Gr3L in the pixel set 51Gr. Furthermore, the signal line 61-5 also transmits the drive signal TRGGr3L to the gate electrode of a transfer transistor TG_R3L (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr3L in the pixel set 51Gr.
- the signal line 61-6 transmits the drive signal TRGGr3R to be provided to the gate electrode of the transfer transistor TG_Gr3R in the pixel set 51Gr. Furthermore, the signal line 61-6 also transmits the drive signal TRGGr3R to the gate electrode of a transfer transistor TG_R3R (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr3R in the pixel set 51Gr.
- the signal line 61-7 transmits the drive signal TRGGr4L to be provided to the gate electrode of the transfer transistor TG_Gr4L in the pixel set 51Gr. Furthermore, the signal line 61-7 also transmits the drive signal TRGGr4L to the gate electrode of a transfer transistor TG_R4L (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr4L in the pixel set 51Gr.
- the signal line 61-8 transmits the drive signal TRGGr4R to be provided to the gate electrode of the transfer transistor TG_Gr4R in the pixel set 51Gr. Furthermore, the signal line 61-8 also transmits the drive signal TRGGr4R to the gate electrode of a transfer transistor TG_R4R (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr4R in the pixel set 51Gr.
- the signal line 62-1 transmits a drive signal TRGGb1L to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr1L in the pixel set 51Gr.
- the signal line 62-2 transmits a drive signal TRGGb1R to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr1R in the pixel set 51Gr.
- the signal line 62-3 transmits a drive signal TRGGb2L to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr2L in the pixel set 51Gr.
- the signal line 62-4 transmits a drive signal TRGGb2R to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr2R in the pixel set 51Gr.
- the signal line 62-5 transmits a drive signal TRGGb3L to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr3L in the pixel set 51Gr.
- the signal line 62-6 transmits a drive signal TRGGb3R to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr3R in the pixel set 51Gr.
- the signal line 62-7 transmits a drive signal TRGGb4L to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistors TG_Gr4L in the pixel set 51Gr.
- the signal line 62-8 transmits a drive signal TRGGb4R to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr4R in the pixel set 51Gr.
- the pixels 2 in the sharing unit can output a pixel signal for each photodiode PD as a unit, and can output a pixel signal for each pixel as a unit or for a plurality of pixels as a unit, in response to a drive signal from the vertical drive circuit 4.
- a pixel signal is output for each pixel as a unit or for a plurality of pixels as a unit
- a plurality of transfer transistors TG that outputs simultaneously is activated simultaneously.
- the FD 52 adds charges provided from a plurality of photodiodes PD via the transfer transistors TG simultaneously activated. Consequently, a pixel signal of each pixel as a unit or of a plurality of pixels as a unit is output from the FD 52 through the amplification transistor 54 and the selection transistor 55 to the column signal processing circuit 5.
- FIGs. 4 and 5 illustrate a circuit example in which the four pixels in 2 x 2 constituting the pixel set 51 are a sharing unit
- the combination of a plurality of pixels as a sharing unit is not limited to this.
- two pixels in 1 ⁇ 2 (one vertical pixel x two horizontal pixels) or in 2 x 1 (two vertical pixels x one horizontal pixel) may be a sharing unit
- four pixels in 4 x 1 (four vertical pixels x one horizontal pixel) may be a sharing unit.
- Fig. 6 is a diagram illustrating drive (pixel signal output control) of the pixel set 51Gr in a case where the solid-state imaging device 1 operates in the full-resolution mode.
- a photodiode PD hatched in Fig. 6 represents a photodiode PD selected to output a pixel signal.
- the eight photodiodes PD in the pixel set 51Gr are selected sequentially, and pixel signals generated individually by the eight photodiodes PD are output individually.
- the order in which the eight photodiodes PD are selected is the order of the photodiodes PD_Gr1L, PD_Gr1R, PD_Gr2L, PD_Gr2R, PD_Gr3L, PD_Gr3R, PD_Gr4L, and PD_Gr4R.
- the order is not limited to this.
- a pixel signal of one pixel can be obtained, and by comparing the pixel signals of the two photodiodes PD in the same pixel, a phase difference can be detected.
- the other pixel sets 51Gb, 51R, and 51B perform an operation similar to that of the pixel set 51Gr in Fig. 6 .
- all the pixels 2 can output a signal of each pixel as a unit and output signals for detecting a phase difference.
- the color filters 37 of R, G, or B are arranged in units of four pixels (in units of the pixel sets 51) as illustrated in Fig. 3 , but the full-resolution mode also allows re-mosaicing processing to regenerate and output pixel signals in a Bayer array of R, G, B in units of pixels.
- the solid-state imaging device 1 drives the two photodiodes PD in the pixels to read them simultaneously.
- a hatched photodiode PD represents a photodiode PD selected to output a pixel signal.
- Phase difference is detected using pixel signals of the photodiodes PD_Gr1L and PD_Gr1R of the upper left pixel 2 and the photodiodes PD_Gr4L and PD_Gr4R of the lower right pixel 2.
- pixels 2 in which a phase difference can be detected may be changed depending on difference in the amount of light received. For example, in low illumination, the drive in Fig. 6 is performed in which phase difference detection is performed in all the pixels, and in high illumination, the drive in Fig. 7 is performed in which some of the pixels 2 are excluded.
- Fig. 7 is an example in which phase difference detection is performed in two pixels of the four pixels constituting the pixel set 51Gr, but drive to perform phase difference detection in only one pixel may be performed.
- the solid-state imaging device 1 can execute the four-pixel addition phase-difference detection mode in which pixel signals are added and output in each pixel set 51 that is a sharing unit, that is, in units of four pixels in 2 x 2, and a phase difference is detected on the entire surface of the pixel array 3.
- Fig. 8 is a diagram illustrating drive in the four-pixel addition phase-difference detection mode.
- a hatched photodiode PD represents a photodiode PD selected to output a pixel signal.
- the solid-state imaging device 1 adds and outputs pixel signals of photodiodes PD located at the same position in the pixels of the pixel set 51, of the pairs of photodiodes PD of the pixels 2. For example, as illustrated in A of Fig. 8 , the solid-state imaging device 1 first adds and outputs pixel signals of all the left photodiodes PD in the pixel set 51, and then, as illustrated in B of Fig. 8 , adds and outputs pixel signals of all the right photodiodes PD in the pixel set 51. Note that the reading order of the left photodiodes PD and the right photodiodes PD may be reversed.
- a phase difference can be detected from a pixel signal of the left photodiodes PD and a pixel signal of the right photodiodes PD in each individual pixel set 51 read, and by combining the two pixel signals, a pixel signal output of each individual pixel set 51 (a unit of four pixels) can be obtained.
- an entire-surface phase difference can be detected while the advantage of a dynamic range due to increased pixel capacitance Qs is maintained.
- a method of discernably reading a pixel signal of left photodiodes PD and a pixel signal of right photodiodes PD two ways can be adopted: a first reading method of separately reading a pixel signal of left photodiodes PD and a pixel signal of right photodiodes PD, and a second reading method of reading a signal obtained by adding a pixel signal of left photodiodes PD and a pixel signal of right photodiodes PD.
- the first reading method and the second reading method will be briefly described.
- the solid-state imaging device 1 After the elapse of a predetermined exposure time, the solid-state imaging device 1 first reads a pixel signal of one of left and right photodiode PD groups of the pixel set 51, for example, a pixel signal of the left photodiode PD group.
- the reading of a pixel signal of the left photodiode PD group will be described with the example of the pixel set 51Gr illustrated in Fig. 4 .
- the transfer transistors TG_Gr1L, TG_Gr2L, TG_Gr3L, and TG_Gr4L are activated to transfer charges accumulated in the photodiodes PD_Gr1L, PD_Gr2L, PD_Gr3L, and PD_Gr4L to the FD 52, so that a voltage signal corresponding to the accumulated charges in the FD 52 is output through the vertical signal line 9 to the column signal processing circuit 5.
- the voltage signal output to the column signal processing circuit 5 is the sum of the pixel signal of the left photodiode PD group and the dark level signal. Thus, by subtracting the dark level signal from the voltage signal in the column signal processing circuit 5, the pixel signal of the left photodiode PD group is obtained.
- the solid-state imaging device 1 turns on the reset transistor 53 to reset the accumulated charges in the FD 52, and then reads a pixel signal of the other of the left and right photodiode PD groups of the pixel set 51, for example, a pixel signal of the right photodiode PD group.
- a pixel signal of the other of the left and right photodiode PD groups of the pixel set 51 for example, a pixel signal of the right photodiode PD group.
- the transfer transistors TG_Gr1R, TG_Gr2R, TG_Gr3R, and TG_Gr4R are activated to transfer charges accumulated in the photodiodes PD_Gr1R, PD_Gr2R, PD_Gr3R, and PD_Gr4R to the FD 52, so that a voltage signal corresponding to the accumulated charges in the FD 52 is output through the vertical signal line 9 to the column signal processing circuit 5.
- the voltage signal output to the column signal processing circuit 5 is the sum of the pixel signal of the right photodiode PD group and the dark level signal. Thus, by subtracting the dark level signal from the voltage signal in the column signal processing circuit 5, the pixel signal of the right photodiode PD group is obtained.
- a pixel signal of the left photodiodes PD and a pixel signal of the right photodiodes PD are read separately, so that a phase difference signal can be directly obtained. This allows acquisition of a high-quality signal for distance measurement.
- a signal for a captured image can be obtained by digitally adding signals of the left and right photodiodes PD.
- the second reading method is similar to the first reading method up until the acquisition of a dark level signal and the acquisition of a pixel signal of one of the left and right photodiode PD groups in the pixel set 51 (a pixel signal of the left photodiode PD group).
- the solid-state imaging device 1 After acquiring a pixel signal of one of the left and right photodiode PD groups, the solid-state imaging device 1 does not turn on the reset transistor 53 (keeps it off) unlike the first reading method, and reads a pixel signal of the other of the left and right photodiode PD groups of the pixel set 51, for example, a pixel signal of the right photodiode PD group.
- a voltage signal output to the column signal processing circuit 5 is the sum of the signals of the left and right photodiode PD groups and the dark level signal.
- the column signal processing circuit 5 first acquires the pixel signals of the left and right photodiode PD groups by subtracting the dark level signal from the voltage signal, and then acquires the pixel signal of the right photodiode PD group by subtracting the pixel signal of the left photodiode PD group obtained earlier from the pixel signals of the left and right photodiode PD groups.
- the pixel signal of the left photodiodes PD and the pixel signal of the right photodiodes PD can be acquired as above, and a phase difference signal can be obtained indirectly.
- signals for a captured image are added when they are analog, and thus have good signal quality, and also bring advantages in reading time and power consumption as compared with the first reading method.
- the solid-state imaging device 1 can execute the four-pixel addition mode in which pixel signals are added and output in each pixel set 51 that is a sharing unit, that is, in units of four pixels in 2 x 2.
- the first phase difference HDR mode is an output mode that enables detection of a phase difference and generation of a high dynamic range image (hereinafter, referred to as an HDR image).
- At least some of the plurality of pixels 2 constituting the pixel array 3 need to be pixels 2 that output a pixel signal of the left photodiode PD and a pixel signal of the right photodiode PD individually.
- the plurality of pixels 2 constituting the pixel array 3 needs to include pixels 2 different in exposure time.
- the solid-state imaging device 1 sets two types of exposure times for the plurality of pixels 2 constituting the pixel array 3 as illustrated in Fig. 9 .
- Fig. 9 is a diagram illustrating the exposure times set for four (2 x 2) pixel sets 51 in a Bayer array that are a part of the pixel array 3 in the first phase difference HDR mode.
- first phase difference HDR mode one of a first exposure time and a second exposure time is set for each pixel.
- the second exposure time is an exposure time shorter than the first exposure time (first exposure time > second exposure time).
- first exposure time > second exposure time the first exposure time
- Fig. 9 "L” is written in photodiodes PD for which the first exposure time is set, and "S” is written in photodiodes PD for which the second exposure time is set.
- the first exposure time and the second exposure time are set with four pixels 2 constituting one pixel set 51 paired in diagonal directions.
- the first exposure time (L) is set for the two upper right and lower left pixels of the four pixels constituting the pixel set 51
- the second exposure time (S) is set for the two lower right and upper left pixels. Note that the arrangement of the pixels 2 for which the first exposure time (L) and the second exposure time (S) are set may be reversed.
- Fig. 10 is a diagram illustrating a procedure of reading pixel signals in the first phase difference HDR mode. Also in Fig. 10 , a hatched photodiode PD represents a photodiode PD selected to output a pixel signal.
- the solid-state imaging device 1 outputs pixel signals of all the photodiodes PD for the two pixels for which the first exposure time (L) is set, and outputs pixel signals of the left photodiodes PD and pixel signals of the right photodiodes PD separately for the two pixels for which the second exposure time (S) is set.
- the solid-state imaging device 1 simultaneously outputs pixel signals of a plurality of photodiodes PD in the order of pixel signals of all the photodiodes PD of the two upper right and lower left pixels 2, pixel signals of the left photodiodes PD of the upper left and lower right pixels 2, and pixel signals of the upper left and lower right right photodiodes PD.
- the two pixels 2 whose exposure time is set to the second exposure time (S) output pixel signals of the left photodiode PD and the right photodiode PD separately, so that a phase difference can be detected. Furthermore, since the pixels 2 for which the first exposure time (L) is set and the pixels 2 for which the second exposure time (S) is set are included, an HDR image can be generated.
- the pixels 2 that detect a phase difference may be the pixels 2 whose exposure time is set to the first exposure time (L). However, if light intensity is high, the pixels 2 may be saturated. It is thus preferable that the pixels 2 that detect a phase difference are the pixels 2 for which the second exposure time (S) is set. By using the pixels 2 for which the second exposure time (S) is set as phase difference detection pixels, phase difference information can be acquired without causing saturation.
- the first phase difference HDR mode for each pixel set 51, two types of exposure times, the first exposure time (L) and the second exposure time (S), are set, and in some of the pixels 2 of the pixel set 51, specifically, the pixels 2 for which the second exposure time (S) is set, pixel signals of the left and right photodiodes PD are separately output to detect a phase difference, so that signals for phase difference detection and signals of an HDR image with a high dynamic range can be simultaneously acquired.
- the second phase difference HDR mode is an output mode that enables phase difference detection and HDR image generation.
- the second phase difference HDR mode differs from the first phase difference HDR mode in that exposure times set for the pixels 2 in the pixel array 3 are not of the two types in the first phase difference HDR mode but of three types.
- Fig. 11 is a diagram illustrating exposure times set for four (2 x 2) pixel sets 51 in a Bayer array that are a part of the pixel array 3 in the second phase difference HDR mode.
- the second exposure time is an exposure time shorter than the first exposure time
- the third exposure time is an exposure time even shorter than the second exposure time (first exposure time > second exposure time > third exposure time).
- “L” is written in photodiodes PD for which the first exposure time is set
- "M” is written in photodiodes PD for which the second exposure time is set
- "S” is written in photodiodes PD for which the third exposure time is set.
- the second exposure time (M) in the middle is an exposure time suitable for proper exposure at the time of automatic exposure.
- the second exposure time (M) is set for two pixels in a predetermined diagonal direction of four pixels 2 constituting one pixel set 51
- the first exposure time (L) is set for one of two pixels in the other diagonal direction
- the third exposure time (S) is set for the other.
- the diagonal direction in which the second exposure time (M) is set may be a diagonally right direction instead of a diagonally left direction in Fig. 11 .
- the arrangement of the pixels 2 for which the first exposure time (L) and the third exposure time (S) are set may be reversed.
- Fig. 12 is a diagram illustrating a procedure of reading pixel signals in the second phase difference HDR mode. Also in Fig. 12 , a hatched photodiode PD represents a photodiode PD selected to output a pixel signal.
- the solid-state imaging device 1 outputs a pixel signal of the left photodiode PD and a pixel signal of the right photodiode PD separately for the two pixels for which the second exposure time (M) is set, and outputs a pixel signal of the photodiodes PD in each pixel as a unit for the two pixels for which the first exposure time (L) and the third exposure time (S) are set.
- the solid-state imaging device 1 simultaneously outputs pixel signals of a plurality of photodiodes PD in the order of pixel signals of the two photodiodes PD of the upper right pixel 2, pixel signals of the left photodiodes PD of the upper left and lower right pixels 2, pixel signals of the right photodiodes PD of the upper left and lower right pixels 2, and pixel signals of the two photodiodes PD of the lower left pixel 2.
- the two pixels 2 whose exposure time is set to the second exposure time (M) output pixel signals of the left photodiode PD and the right photodiode PD separately, so that a phase difference can be detected. Furthermore, since the pixels 2 for which the different exposure times are set are included, an HDR image can be generated.
- the pixels 2 that detect a phase difference may be the pixels 2 whose exposure time is set to the first exposure time (L) or the third exposure time (S). However, if light intensity is high, the pixels 2 may be saturated, and if light intensity is low, the signal level may be too low. It is thus preferable to use the pixels 2 for which the second exposure time (M) for proper exposure is set. By using the pixels 2 for which the second exposure time (M) is set as phase difference detection pixels, phase difference information can be acquired without causing saturation.
- the second phase difference HDR mode for each pixel set 51, three types of exposure times, the first exposure time (L), the second exposure time (M), and the third exposure time (S), are set, and in some of the pixels 2 of each pixel set 51, specifically, the pixels 2 for which the second exposure time (M) is set, pixel signals of the left and right photodiodes PD are separately output to detect a phase difference, so that signals for phase difference detection and signals of an HDR image with a high dynamic range can be simultaneously acquired.
- the eight signal lines 61-1 to 61-8 or 62-1 to 62-8 as illustrated in Fig. 5 are required for the pixel sets 51 arranged in the horizontal direction.
- the number of signal lines for each pixel set 51 arranged in the horizontal direction can be reduced.
- Fig. 13 illustrates a wiring example of signal lines in a case where operation in only the first phase difference HDR mode is enabled as an output mode that enables phase difference detection and HDR image generation.
- the single signal line 81-1 is disposed to control pixel signals of the left photodiodes PD of the pixels 2 paired in the diagonal direction for which an exposure time of the second exposure time (S) is set, and the single signal line 81-2 is disposed to control pixel signals of the right photodiodes PD.
- the single signal line 81-3 is disposed to control pixel signals of the left photodiodes PD of the pixels 2 paired in the diagonal direction for which an exposure time of the first exposure time (L) is set, and the single signal line 81-4 is disposed to control pixel signals of the right photodiodes PD side.
- Fig. 14 illustrates a wiring example of signal lines in a case where operation in only the second phase difference HDR mode is enabled as an output mode that enables phase difference detection and HDR image generation.
- the single signal line 82-1 is disposed to control pixel signals of the left photodiodes PD of the pixels 2 for which an exposure time of the first exposure time (L) is set, and the single signal line 82-2 is disposed to control pixel signals of the right photodiodes PD.
- the single signal line 82-3 is disposed to control pixel signals of the left photodiodes PD of the pixels 2 paired in the diagonal direction for which an exposure time of the second exposure time (M) is set, and the single signal line 82-4 is disposed to control pixel signals of the right photodiodes PD.
- the single signal line 82-5 is disposed to control pixel signals of the left photodiodes PD of the pixels 2 for which an exposure time of the third exposure time (S) is set, and the single signal line 82-6 is disposed to control pixel signals of the right photodiodes PD.
- the solid-state imaging device 1 can execute, as an output mode, the full-resolution mode in which pixel signals of the photodiodes PD of each pixel 2 are output individually, the four-pixel addition phase-difference detection mode in which pixel signals of the left photodiodes PD or the right photodiodes PD are added and output in units of four pixels, the four-pixel addition mode in which pixel signals of all the photodiodes PD in the pixel set 51 are added and output, and the first phase difference HDR mode and the second phase difference HDR mode that enable phase difference detection and HDR image generation.
- the full-resolution mode enables phase difference detection in all the pixels and high-resolution output by re-mosaicing
- the four-pixel addition phase-difference detection mode enables phase difference detection in the entire surface and high S/N and high dynamic range signal output by four-pixel addition.
- the four-pixel addition mode enables high S/N and high dynamic range signal output by four-pixel addition
- the first phase difference HDR mode and the second phase difference HDR mode enable both HDR image generation and phase difference detection in the entire surface. Note that to achieve HDR, two or more exposure times may be set for pixels with a single sensitivity as described above, or a single exposure time may be set for a plurality of pixels with different sensitivities formed as a pixel set.
- An example of a plurality of pixels with different sensitivities includes a pixel including photodiodes with a large light receiving area as a pixel with a high sensitivity, and a pixel including photodiodes with a small light receiving area as a pixel with a low sensitivity.
- the solid-state imaging device 1 may further be able to execute output modes other than those described above.
- Fig. 15 illustrates a modification of the color array of the color filters.
- the R, G, and B color filters 37 are arranged in the Bayer array in units of the pixel sets 51.
- the R, G, and B color filters 37 are arranged in a Bayer array in units of the pixels 2.
- the color filters 37 may be arranged in a Bayer array in units of pixels.
- the sharing unit of pixel circuits sharing the reset transistor 53, the amplification transistor 54, and the selection transistor 55 may be four pixels in 2 x 2 (two vertical pixels x two horizontal pixels) as in Fig. 4 , or may be four pixels in 4 x 1 (four vertical pixels x one horizontal pixel).
- the color array of the color filters 37 in the Bayer array in units of pixels as illustrated in Fig. 15 allows pixel signals of pixels of the same color to be added if four pixels in 4 x 1 are set as a sharing unit.
- Fig. 16 illustrates a modification of the orientations of the photodiodes PD.
- the pairs of photodiodes PD in the pixels 2 are formed such that the orientations of their longitudinal shape are the same direction in each pixel set 51, and are also the same direction in all the pixel sets 51.
- orientations of the longitudinal shape of the pairs of photodiodes PD in the pixels may be different from pixel to pixel or from pixel set to pixel set.
- a of Fig. 16 illustrates an example in which the pairs of photodiodes PD in the pixels 2 are formed such that the orientations of their longitudinal shape are the same direction in each pixel set 51, but are different from pixel set 51 to pixel set 51.
- the orientations of the longitudinal shape of the pairs of photodiodes PD in the pixel set 51Gr and the pixel set 51Gb including the G color filters 37 are the left-right direction (horizontal direction), and the orientations of the longitudinal shape of the pairs of photodiodes PD in the pixel set 51R including the R color filters 37 and the pixel set 51B including the B color filters 37 are the up-and-down direction (vertical direction).
- the photodiodes PD are formed such that the orientations of the longitudinal shape of the pairs of photodiodes PD in the pixels are at right angles between the pixel set 51Gr and the pixel set 51Gb, and the pixel set 51R and the pixel set 51B.
- the orientations of the longitudinal shape of the photodiodes PD in the pixel sets 51 including the color filters 37 of the same color are the same.
- FIG. 16 illustrates an example in which in each pixel set 51 including the color filters 37 of the same color, pairs of photodiodes PD in two pixels arranged in the horizontal direction are formed such that the orientations of their longitudinal shape are the same direction, and pairs of photodiodes PD in two pixels arranged in the vertical direction are formed such that the orientations of their longitudinal shape are orthogonal directions.
- the photodiodes PD are formed such that the orientations of the longitudinal shape of the pairs of photodiodes PD in the two upper pixels are the left-right direction (horizontal direction), and the orientations of the longitudinal shape of the pairs of photodiodes PD in the two lower pixels are the up-and-down direction (vertical direction).
- C of Fig. 16 illustrates an example in which in each pixel set 51 including the color filters 37 of the same color, pairs of photodiodes PD in two pixels PD arranged in the horizontal direction are formed such that the orientations of their longitudinal shape are orthogonal directions, and pairs of photodiodes PD in two pixels PD arranged in the vertical direction are formed such that the orientations of their longitudinal shape are also orthogonal directions.
- the photodiodes PD are formed such that the orientations of the longitudinal shape of the pairs of photodiodes PD in the two upper pixels are the left-right direction (horizontal direction) and the up-and-down direction (vertical direction), and the orientations of the longitudinal shape of the pairs of photodiodes PD in the two lower pixels are also the left-right direction (horizontal direction) and the up-and-down direction (vertical direction).
- the two photodiodes PD of the longitudinal shape formed in each pixel are arranged symmetrically in the vertical direction or the horizontal direction, and for their orientations in the pixels in the pixel set 51, either the same direction or orthogonal directions can be used.
- Fig. 17 illustrates a modification of the arrangement of the on-chip lenses 38.
- the on-chip lenses 38 are formed for individual pixels.
- one on-chip lens 91 may be disposed for one pixel set 51.
- FIG. 17 illustrates an example in which one on-chip lens 91 is disposed for the pixel set 51Gb including the G color filters 37, and the on-chip lenses 38 for individual pixels are disposed for the other pixel sets 51Gr, 51R, and 51B.
- FIG. 17 illustrates an example in which one on-chip lens 91 is disposed for the pixel set 51R including the R color filters 37, and the on-chip lenses 38 for individual pixels are disposed for the other pixel sets 51Gr, 51Gb, and 51B.
- FIG. 17 illustrates an example in which one on-chip lens 91 is disposed for the pixel set 51B including the B color filters 37, and the on-chip lenses 38 for individual pixels are disposed for the other pixel sets 51Gr, 51R, and 51Gb.
- the on-chip lenses 91 in A to C of Fig. 17 may be disposed at regular intervals or randomly.
- the pixel set 51 with the on-chip lens 91 cannot acquire pixel signals for generating an HDR image, but can detect a phase difference with pixel signals in each pixel, and thus is effective for phase difference detection in low illumination.
- Fig. 18 is a diagram illustrating a second cross-sectional configuration example of the pixel array 3 of the solid-state imaging device 1 in Fig. 1 .
- the second cross-sectional configuration example of Fig. 18 differs from the first cross-sectional configuration example illustrated in Fig. 2 in that an insulating layer 101 is formed in the semiconductor substrate 12.
- the insulating layer 101 is further formed at pixel boundaries between adjacent pixels and between the two photodiodes PD in each pixel.
- the insulating layer 101 is formed, for example, by a deep trench isolation (DTI) in which an oxide film (e.g., a TEOS film) is formed on the inner peripheral surface of deep grooves (trenches) dug from the back side of the semiconductor substrate 12, and the inside thereof is filled with polysilicon.
- DTI deep trench isolation
- the insulating layer 101 is not limited to the configuration using the oxide film and polysilicon, and may be of a configuration using a metal such as hafnium or a configuration using an impurity layer. Furthermore, the insulating layer 101 of different configurations may be applied in different pixels. For example, in an R pixel that transmits relatively long wavelengths, an impurity layer may be applied as the insulating layer 101, and in a B pixel and a G pixel, an oxide film, polysilicon, or a metal may be applied as the insulating layer 101. Furthermore, the insulating layer 101 may be a shallow trench isolation (STI) shallower than DTI, or may be a full trench isolation (FTI) that completely separates pixels from each other.
- STI shallow trench isolation
- FTI full trench isolation
- Fig. 19 is a plan view illustrating regions where the insulating layer 101 is formed in a range of 16 pixels in 4 x 4.
- the insulating layer 101 is formed at the boundaries of the pixels 2 and between the two photodiodes PD in each pixel, and the two photodiodes PD are separated from each other by the insulating layer 101.
- Fig. 20 is a diagram illustrating a third cross-sectional configuration example of the pixel array 3 of the solid-state imaging device 1 in Fig. 1 .
- Fig. 20 parts corresponding to those in the second cross-sectional configuration example illustrated in Fig. 18 are denoted by the same reference numerals, and description of the parts will be omitted as appropriate.
- the insulating layer 101 is formed at the boundaries of the pixels 2 and between the two photodiodes PD in each pixel.
- the insulating layer 101 is formed as in the second cross-sectional configuration example, but between the two photodiodes PD in each pixel, an impurity layer 102 of a conductivity type opposite to that of the N-type semiconductor regions 32, that is, P-type is formed.
- the impurity concentration of the P-type impurity layer 102 is higher than that of the semiconductor region 31.
- the impurity layer 102 can be formed, for example, by ion implantation from the back side of the semiconductor substrate 12.
- Fig. 21 is a plan view illustrating regions where the insulating layer 101 and the impurity layer 102 are formed in a range of 16 pixels in 4 x 4.
- the insulating layer 101 is formed at the boundaries of the pixels 2, and the impurity layer 102 separates the two photodiodes PD in each pixel from each other.
- the potential barrier between the two photodiodes PD in each pixel may be the same as the potential barrier at the pixel boundaries, or may be made lower than the potential barrier at the pixel boundaries as illustrated in B of Fig. 22 .
- a of Fig. 22 is a cross-sectional structural diagram of one pixel in the third cross-sectional configuration example, and B of Fig. 22 is a potential diagram corresponding to A of Fig. 22 .
- the height of the potential barrier between the photodiodes PD can be made lower than the potential barrier at the pixel boundaries by adjusting the impurity concentration in the impurity layer 102.
- the impurity layer 102 may be formed so as to completely isolate a region sandwiched between the two photodiodes PD as illustrated in Fig. 21 , or may be formed so as to isolate only a part of the region sandwiched between the two photodiodes PD as illustrated in Fig. 23 .
- the impurity layer 102 is formed only in a part in and around the pixel center of the region sandwiched between the two photodiodes PD.
- a cross-sectional view of parts where the impurity layer 102 is formed in Fig. 23 is the same as that in Fig. 20
- a cross-sectional view of parts where the impurity layer 102 is not formed in Fig. 23 is the same as that in Fig. 18 .
- the inter-pixel light-shielding film 36 that prevent light from entering adjacent pixels are formed at pixel boundary portions, but no light-shielding film is formed on the photodiodes PD.
- a configuration in which a light-shielding film is disposed on two photodiodes PD in a pixel may be adopted.
- Fig. 24 is a plan view illustrating a first configuration in which a light-shielding film is disposed on photodiodes PD.
- a of Fig. 24 is an example in which the lower halves of the two photodiodes PD in the pixel are shielded from the light by the light-shielding film 121
- B of Fig. 24 is an example in which the upper halves of the two photodiodes PD in the pixel are shielded from the light by the light-shielding film 121.
- the on-chip lenses 38 are formed for the individual pixels as in Fig. 3 .
- phase difference information is acquired.
- Fig. 25 is a plan view illustrating a second configuration in which a light-shielding film is disposed on photodiodes PD.
- a of Fig. 25 is an example in which the left photodiode PD of the two photodiodes PD of each pixel 2 in the pixel set 51Gr is shielded from the light by the light-shielding film 121
- B of Fig. 25 is an example in which the right photodiode PD of the two photodiodes PD of each pixel 2 in the pixel set 51Gr is shielded from the light by the light-shielding film 121.
- the on-chip lenses 38 are formed for the individual pixels as in Fig. 3 .
- phase difference information is acquired.
- Both of the first and second configurations in Figs. 24 and 25 are a configuration in which the light-shielding film 121 partly light-shields all the pixels 2 in the pixel set 51Gr.
- Fig. 26 is a plan view illustrating a third configuration in which a light-shielding film is disposed on photodiodes PD.
- a of Fig. 26 is an example in which all the photodiodes PD of the two lower pixels in the pixel set 51Gb are shielded from the light by the light-shielding film 121
- B of Fig. 26 is an example in which all the photodiodes PD of the two upper pixels in the pixel set 51Gb are shielded from the light by the light-shielding film 121.
- one on-chip lens 91 is formed on the pixel set 51Gb at which the light-shielding film 121 is disposed, as in Fig. 17 .
- the on-chip lenses 38 for the individual pixels are formed on the pixel sets 51Gr, 51R, and 51B at which no light-shielding film 121 is disposed.
- phase difference information is acquired.
- Fig. 27 is a plan view illustrating a fourth configuration in which a light-shielding film is disposed on photodiodes PD.
- a of Fig. 27 is an example in which all the photodiodes PD of the two left pixels in the pixel set 51Gb are shielded from the light by the light-shielding film 121
- B of Fig. 27 is an example in which all the photodiodes PD of the two right pixels in the pixel set 51Gb are shielded from the light by the light-shielding film 121.
- one on-chip lens 91 is formed on the pixel set 51Gb at which the light-shielding film 121 is disposed, as in Fig. 17 .
- the on-chip lenses 38 for the individual pixels are formed on the pixel sets 51Gr, 51R, and 51B at which no light-shielding film 121 is disposed.
- phase difference information is acquired.
- Both of the third and fourth configurations in Figs. 26 and 27 are a configuration in which the light-shielding film 121 entirely shields some of the pixels 2 in the pixel set 51Gr from the light.
- the first to fourth configurations of Fig. 24 to Fig. 27 in which the light-shielding film 121 is disposed allows the pixel sets 51 at which the light-shielding film 121 is disposed to acquire phase difference information.
- the first to fourth configurations in which the light-shielding film 121 is disposed are effective in acquiring phase difference information in a case where the light intensity of incident light is high.
- the first to fourth configurations of Figs. 24 to 27 in which the light-shielding film is disposed are an example in which the light-shielding film 121 is disposed at the pixel set 51Gb or the pixel set 51Gr.
- a similar light-shielding film 121 may be formed for the other pixel set 51R or 51B, or the light-shielding film 121 may be formed at all of the pixel sets 51Gb, 51R, and 51B.
- Fig. 28 illustrates another modification of the solid-state imaging device 1.
- the constituent units of the pixel set 51 is four pixels in 2 x 2 (two vertical pixels x two horizontal pixels).
- the pixel set 51 is not limited to four pixels in 2 x 2, and is only required to include a plurality of pixels 2.
- Fig. 28 illustrates an example in which the constituent units of the pixel set 51 is 16 pixels in 4 x 4 (four vertical pixels x four horizontal pixels).
- the example of Fig. 28 illustrates an example in which an on-chip lens 38 is formed for each pixel, which is not limiting.
- One on-chip lens may be disposed for four pixels in 2 x 2, or one on-chip lens may be disposed for 16 pixels in 4 x 4.
- nine pixels in 3 x 3 may be set as constituent units of the pixel set 51.
- Fig. 29 illustrates still another modification of the solid-state imaging device 1.
- a color filter 37 that allows light of wavelengths of R, G, or B to pass through is formed at each pixel 2 of the solid-state imaging device 1.
- the pixels 2 of the solid-state imaging device 1 can receive light of all wavelengths of R, G, and B to generate and output pixel signals.
- the solid-state imaging device 1 may be provided with infrared filters that transmit infrared light to receive only infrared light to generate and output pixel signals.
- the arrangement of the photodiodes PD and the pixel transistors illustrated in Fig. 30 is repeated in the horizontal direction and the vertical direction.
- Fig. 30 is a plan view illustrating an example of arrangement of the pixel transistors in a pixel region of a total of 16 pixels in which the pixel sets 51 whose constituent units are four pixels in 2 x 2 (two vertical pixels x two horizontal pixels) are arranged 2 x 2.
- a portion indicated by a black circle represents a power supply, a GND, or a contact portion of a signal line. Note that in Fig. 30 , some reference numerals are omitted to prevent the figure from being complicated.
- the photodiodes PD, the color filters 37 (not illustrated in Fig. 30 ), and the on-chip lenses 38 are formed as in the example illustrated in Fig. 3 .
- two photodiodes PD are disposed for one pixel horizontally symmetrically in a longitudinal shape.
- the on-chip lenses 38 are formed for the individual pixels.
- the color filters 37 are arranged in a Bayer array in units of the pixel sets 51.
- the upper left pixel set 51 is the pixel set 51Gr including the G color filters 37
- the upper right pixel set 51 is the pixel set 51R including the R color filters 37
- the lower left pixel set 51 is the pixel set 51B including the B color filters 37
- the lower right pixel set 51 is the pixel set 51Gb including the G color filters 37.
- one pixel set 51 including four pixels is provided with eight photodiodes PD and eight transfer transistors TG, and the FD 52, the reset transistor 53, the amplification transistor 54, and the selection transistor 55 shared by them.
- the eight photodiodes PD included in one pixel set 51 are arrayed in 2 x 4 (vertically two x horizontally four), and the reset transistor 53, the amplification transistor 54, and the selection transistor 55, which are shared by the eight photodiodes PD, are disposed vertically (longitudinally) adjacent to the eight photodiodes PD in 2 x 4.
- the shared pixel transistors are disposed between the eight photodiodes PD and the eight photodiodes PD in 2 x 4 in the two vertically adjacent pixel sets 51.
- the transfer transistors TG provided one-to-one to the photodiodes PD are disposed near the center of the group.
- Four transfer transistors TG are collectively disposed near the center of four photodiodes PD in 2 x 2 in a right group in the pixel set 51, and four transfer transistors TG are collectively disposed near the center of four photodiodes PD in 2 x 2 in a left group in the pixel set 51.
- the FD 52 includes at least metal wiring 52A as a part thereof. As illustrated in Fig. 30 , the metal wiring 52A is routed to electrically connect a middle portion of the four photodiodes PD in 2 x 2 in the right group in the pixel set 51, a middle portion of the four photodiodes PD in 2 x 2 in the left group in the pixel set 51, the gate electrode of the amplification transistor 54, and the source electrode of the reset transistor 53. Charges accumulated in each photodiode PD in the pixel set 51 are transferred to the metal wiring 52A constituting a part of the FD 52 by the corresponding transfer transistor TG, transmitted through the metal wiring 52A, and provided to the gate electrode of the amplification transistor 54. Furthermore, when the reset transistor 53 is turned on, charges in the FD 52 are discharged from the source electrode to the drain electrode of the reset transistor 53.
- the shared pixel transistors (the reset transistor 53, the amplification transistor 54, and the selection transistor 55), a layout can be adopted in which they are disposed between the eight photodiodes PD of one pixel set 51 and the eight photodiodes PD of another pixel set 51 adjacent in the column direction. Note that although not illustrated, a layout in which the shared pixel transistors are disposed between the eight photodiodes PD and the eight photodiodes PD of the pixel sets 51 adjacent to each other in the row direction may be used.
- the present technology is not limited to application to a solid-state imaging device. Specifically, the present technology is applicable to all electronic apparatuses using a solid-state imaging device for an image capturing unit (photoelectric conversion part), such as imaging apparatuses including digital still cameras and video cameras, portable terminal devices having an imaging function, and copying machines using a solid-state imaging device for an image reading unit.
- the solid-state imaging device may be formed as one chip, or may be in a modular form having an imaging function in which an imaging unit and a signal processing unit or an optical system are packaged together.
- Fig. 31 is a block diagram illustrating a configuration example of an imaging apparatus as an electronic apparatus to which the present technology is applied.
- An imaging apparatus 200 in Fig. 31 includes an optical unit 201 including a lens group or the like, a solid-state imaging device (imaging device) 202 in which the configuration of the solid-state imaging device 1 in Fig. 1 is used, and a digital signal processor (DSP) circuit 203 that is a camera signal processing circuit. Furthermore, the imaging apparatus 200 also includes a frame memory 204, a display unit 205, a recording unit 206, an operation unit 207, and a power supply 208. The DSP circuit 203, the frame memory 204, the display unit 205, the recording unit 206, the operation unit 207, and the power supply 208 are mutually connected via a bus line 209.
- the optical unit 201 captures incident light (image light) from a subject, forming an image on an imaging surface of the solid-state imaging device 202.
- the solid-state imaging device 202 converts the amount of incident light formed as the image on the imaging surface by the optical unit 201 into an electric signal pixel by pixel and outputs the electric signal as a pixel signal.
- the solid-state imaging device 1 in Fig. 1 that is, a solid-state imaging device capable of simultaneously acquiring a signal for generating a high dynamic range image and a signal for detecting a phase difference can be used.
- the display unit 205 includes, for example, a thin display such as a liquid crystal display (LCD) or an organic electroluminescence (EL) display, and displays a moving image or a still image captured by the solid-state imaging device 202.
- the recording unit 206 records a moving image or a still image captured by the solid-state imaging device 202 on a recording medium such as a hard disk or a semiconductor memory.
- the operation unit 207 issues operation commands on various functions of the imaging apparatus 200 under user operation.
- the power supply 208 appropriately supplies various power supplies to be operation power supplies for the DSP circuit 203, the frame memory 204, the display unit 205, the recording unit 206, and the operation unit 207, to them to be supplied with.
- the imaging apparatus 200 such as a video camera or a digital still camera, or further a camera module for a mobile device such as a portable phone can also improve the quality of captured images.
- Fig. 32 is a diagram illustrating an example of use of an image sensor using the above-described solid-state imaging device 1.
- the image sensor using the above-described solid-state imaging device 1 can be used in various cases where light such as visible light, infrared light, ultraviolet light, and X-ray are sensed, for example, as below.
- the technology according to the present disclosure (the present technology) can be applied to various products.
- the technology according to the present disclosure may be applied to an endoscopic surgery system.
- Fig. 33 is a diagram illustrating an example of a schematic configuration of an endoscopic surgery system to which the technology according to the present disclosure (the present technology) can be applied.
- Fig. 33 illustrates a state in which an operator (doctor) 11131 is performing an operation on a patient 11132 on a patient bed 11133, using an endoscopic surgery system 11000.
- the endoscopic surgery system 11000 includes an endoscope 11100, other surgical instruments 11110 including a pneumoperitoneum tube 11111 and an energy treatment instrument 11112, a support arm device 11120 that supports the endoscope 11100, and a cart 11200 on which various devices for endoscopic surgery are mounted.
- the endoscope 11100 includes a lens tube 11101 with a region of a predetermined length from the distal end inserted into the body cavity of the patient 11132, and a camera head 11102 connected to the proximal end of the lens tube 11101.
- the endoscope 11100 formed as a so-called rigid scope having a rigid lens tube 11101 is illustrated, but the endoscope 11100 may be formed as a so-called flexible scope having a flexible lens tube.
- An opening in which an objective lens is fitted is provided at the distal end of the lens tube 11101.
- a light source device 11203 is connected to the endoscope 11100. Light generated by the light source device 11203 is guided to the distal end of the lens tube 11101 through a light guide extended inside the lens tube 11101, and is emitted through the objective lens toward an object to be observed in the body cavity of the patient 11132.
- the endoscope 11100 may be a forward-viewing endoscope, an oblique-viewing endoscope, or a side-viewing endoscope.
- An optical system and an imaging device are provided inside the camera head 11102.
- Light reflected from the object being observed (observation light) is concentrated onto the imaging device by the optical system.
- the observation light is photoelectrically converted by the imaging device, and an electric signal corresponding to the observation light, that is, an image signal corresponding to an observation image is generated.
- the image signal is transmitted to a camera control unit (CCU) 11201 as RAW data.
- CCU camera control unit
- the CCU 11201 includes a central processing unit (CPU), a graphics processing unit (GPU), or the like, and performs centralized control on the operations of the endoscope 11100 and a display device 11202. Moreover, the CCU 11201 receives an image signal from the camera head 11102, and performs various types of image processing such as development processing (demosaicing) on the image signal for displaying an image based on the image signal.
- CPU central processing unit
- GPU graphics processing unit
- the display device 11202 displays an image based on an image signal subjected to image processing by the CCU 11201 under the control of the CCU 11201.
- the light source device 11203 includes a light source such as a light emitting diode (LED), and supplies irradiation light when a surgical site or the like is imaged to the endoscope 11100.
- a light source such as a light emitting diode (LED)
- LED light emitting diode
- An input device 11204 is an input interface for the endoscopic surgery system 11000.
- the user can input various types of information and input instructions to the endoscopic surgery system 11000 via the input device 11204.
- the user inputs an instruction to change conditions of imaging by the endoscope 11100 (the type of irradiation light, magnification, focal length, etc.) and the like.
- a treatment instrument control device 11205 controls the drive of the energy treatment instrument 11112 for tissue ablation, incision, blood vessel sealing, or the like.
- a pneumoperitoneum device 11206 feeds gas into the body cavity of the patient 11132 through the pneumoperitoneum tube 11111 to inflate the body cavity for the purpose of providing a field of view by the endoscope 11100 and providing the operator's workspace.
- a recorder 11207 is a device that can record various types of information associated with surgery.
- a printer 11208 is a device that can print various types of information associated with surgery in various forms including text, an image, and a graph.
- the light source device 11203 that supplies irradiation light when a surgical site is imaged to the endoscope 11100 may include a white light source including LEDs, laser light sources, or a combination of them, for example.
- a white light source includes a combination of RGB laser light sources
- the output intensity and output timing of each color (each wavelength) can be controlled with high accuracy.
- the light source device 11203 can adjust the white balance of captured images.
- images corresponding one-to-one to RGB can also be imaged in a time-division manner. According to this method, color images can be obtained without providing color filters at the imaging device.
- the drive of the light source device 11203 may be controlled so as to change the intensity of output light every predetermined time.
- the drive of the imaging device of the camera head 11102 in synchronization with the timing of change of the intensity of light and acquiring images in a time-division manner, and combining the images, a high dynamic range image without so-called underexposure and overexposure can be generated.
- the light source device 11203 may be configured to be able to supply light in a predetermined wavelength band suitable for special light observation.
- special light observation for example, so-called narrow band imaging is performed in which predetermined tissue such as a blood vessel in a superficial portion of a mucous membrane is imaged with high contrast by irradiating it with light in a narrower band than irradiation light at the time of normal observation (that is, white light), utilizing the wavelength dependence of light absorption in body tissue.
- fluorescence observation may be performed in which an image is obtained by fluorescence generated by irradiation with excitation light.
- Fluorescence observation allows observation of fluorescence from body tissue by irradiating the body tissue with excitation light (autofluorescence observation), acquisition of a fluorescence image by locally injecting a reagent such as indocyanine green (ICG) into body tissue and irradiating the body tissue with excitation light corresponding to the fluorescence wavelength of the reagent, and the like.
- the light source device 11203 can be configured to be able to supply narrowband light and/or excitation light suitable for such special light observation.
- Fig. 34 is a block diagram illustrating an example of a functional configuration of the camera head 11102 and the CCU 11201 illustrated in Fig. 33 .
- the camera head 11102 includes a lens unit 11401, an imaging unit 11402, a drive unit 11403, a communication unit 11404, and a camera head control unit 11405.
- the CCU 11201 includes a communication unit 11411, an image processing unit 11412, and a control unit 11413.
- the camera head 11102 and the CCU 11201 are communicably connected to each other by a transmission cable 11400.
- the lens unit 11401 is an optical system provided at a portion connected to the lens tube 11101. Observation light taken in from the distal end of the lens tube 11101 is guided to the camera head 11102 and enters the lens unit 11401.
- the lens unit 11401 includes a combination of a plurality of lenses including a zoom lens and a focus lens.
- the imaging unit 11402 includes an imaging device.
- the imaging unit 11402 may include a single imaging device (be of a so-called single plate type), or may include a plurality of imaging devices (be of a so-called multi-plate type).
- image signals corresponding one-to-one to RGB may be generated by imaging devices, and they may be combined to obtain a color image.
- the imaging unit 11402 may include a pair of imaging devices for acquiring right-eye and left-eye image signals corresponding to a 3D (dimensional) display, individually. By performing 3D display, the operator 11131 can more accurately grasp the depth of living tissue at a surgical site.
- a plurality of lens units 11401 may be provided for the corresponding imaging devices.
- the imaging unit 11402 may not necessarily be provided in the camera head 11102.
- the imaging unit 11402 may be provided inside the lens tube 11101 directly behind the objective lens.
- the drive unit 11403 includes an actuator, and moves the zoom lens and the focus lens of the lens unit 11401 by a predetermined distance along the optical axis under the control of the camera head control unit 11405. With this, the magnification and focus of an image captured by the imaging unit 11402 can be adjusted as appropriate.
- the communication unit 11404 includes a communication device for transmitting and receiving various types of information to and from the CCU 11201.
- the communication unit 11404 transmits an image signal obtained from the imaging unit 11402 as RAW data to the CCU 11201 via the transmission cable 11400.
- the communication unit 11404 receives a control signal for controlling the drive of the camera head 11102 from the CCU 11201, and provides the control signal to the camera head control unit 11405.
- the control signal includes, for example, information regarding imaging conditions such as information specifying the frame rate of captured images, information specifying the exposure value at the time of imaging, and/or information specifying the magnification and focus of captured images.
- the imaging conditions such as the frame rate, the exposure value, the magnification, and the focus described above may be appropriately specified by the user, or may be automatically set by the control unit 11413 of the CCU 11201 on the basis of an acquired image signal.
- so-called an auto exposure (AE) function, an auto focus (AF) function, and an auto white balance (AWB) function are mounted on the endoscope 11100.
- the camera head control unit 11405 controls the drive of the camera head 11102 on the basis of a control signal from the CCU 11201 received via the communication unit 11404.
- the communication unit 11411 includes a communication device for transmitting and receiving various types of information to and from the camera head 11102.
- the communication unit 11411 receives an image signal transmitted from the camera head 11102 via the transmission cable 11400.
- the communication unit 11411 transmits a control signal for controlling the drive of the camera head 11102 to the camera head 11102.
- the image signal and the control signal can be transmitted by electrical communication, optical communication, or the like.
- the image processing unit 11412 performs various types of image processing on an image signal that is RAW data transmitted from the camera head 11102.
- the control unit 11413 performs various types of control for imaging of a surgical site or the like by the endoscope 11100 and display of a captured image obtained by imaging of a surgical site or the like. For example, the control unit 11413 generates a control signal for controlling the drive of the camera head 11102.
- control unit 11413 causes the display device 11202 to display a captured image showing a surgical site or the like, on the basis of an image signal subjected to image processing by the image processing unit 11412.
- the control unit 11413 may recognize various objects in the captured image using various image recognition techniques. For example, by detecting the shape of the edge, the color, or the like of an object included in a captured image, the control unit 11413 can recognize a surgical instrument such as forceps, a specific living body part, bleeding, mist when the energy treatment instrument 11112 is used, and so on.
- the control unit 11413 may superimpose various types of surgery support information on an image of the surgical site for display, using the recognition results. By the surgery support information being superimposed and displayed, and presented to the operator 11131, the load of the operator 11131 can be reduced, and the operator 11131 can reliably proceed with the surgery.
- the transmission cable 11400 that connects the camera head 11102 and the CCU 11201 is an electric signal cable for electric signal communication, an optical fiber for optical communication, or a composite cable for them.
- communication is performed by wire using the transmission cable 11400, but communication between the camera head 11102 and the CCU 11201 may be performed by radio.
- the technology according to the present disclosure can be applied to the imaging unit 11402 in the configuration described above.
- the solid-state imaging device 1 according to the above-described embodiment can be applied as the imaging unit 11402.
- the technology according to the present disclosure it is possible to simultaneously acquire a signal for generating a high dynamic range image and a signal for detecting a phase difference. Consequently, a high-quality captured image and distance information can be acquired, and the degree of safety of the driver and the vehicle can be increased.
- the technology according to the present disclosure can be applied to various products.
- the technology according to the present disclosure may be implemented as a device mounted on any type of mobile object such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, personal mobility, an airplane, a drone, a ship, and a robot.
- Fig. 35 is a block diagram illustrating a schematic configuration example of a vehicle control system that is an example of a mobile object control system to which the technology according to the present disclosure can be applied.
- a vehicle control system 12000 includes a plurality of electronic control units connected via a communication network 12001.
- the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, a vehicle exterior information detection unit 12030, a vehicle interior information detection unit 12040, and an integrated control unit 12050.
- a microcomputer 12051, a sound/image output unit 12052, and an in-vehicle network interface (I/F) 12053 are illustrated.
- the drive system control unit 12010 controls the operation of apparatuses related to the drive system of the vehicle, according to various programs.
- the drive system control unit 12010 functions as a control device for a driving force generation apparatus for generating a driving force of the vehicle such as an internal combustion engine or a drive motor, a driving force transmission mechanism for transmitting the driving force to wheels, a steering mechanism for adjusting the steering angle of the vehicle, a braking device for generating a vehicle braking force, and others.
- the body system control unit 12020 controls the operation of various apparatuses mounted on the vehicle body, according to various programs.
- the body system control unit 12020 functions as a control device for a keyless entry system, a smart key system, power window devices, or various lamps including headlamps, back lamps, brake lamps, indicators, and fog lamps.
- the body system control unit 12020 can receive the input of radio waves transmitted from a portable device that substitutes for a key or signals from various switches.
- the body system control unit 12020 receives the input of these radio waves or signals, and controls door lock devices, the power window devices, the lamps, and others of the vehicle.
- the vehicle exterior information detection unit 12030 detects information regarding the exterior of the vehicle equipped with the vehicle control system 12000.
- an imaging unit 12031 is connected to the vehicle exterior information detection unit 12030.
- the vehicle exterior information detection unit 12030 causes the imaging unit 12031 to capture an image outside the vehicle and receives the captured image.
- the vehicle exterior information detection unit 12030 may perform object detection processing or distance detection processing on a person, a vehicle, an obstacle, a sign, characters on a road surface, or the like, on the basis of the received image.
- the imaging unit 12031 is an optical sensor that receives light and outputs an electric signal corresponding to the amount of the received light.
- the imaging unit 12031 may output an electric signal as an image, or may output it as distance measurement information.
- light received by the imaging unit 12031 may be visible light, or may be invisible light such as infrared rays.
- the vehicle interior information detection unit 12040 detects information of the vehicle interior.
- a driver condition detection unit 12041 that detects a driver's conditions is connected to the vehicle interior information detection unit 12040.
- the driver condition detection unit 12041 includes, for example, a camera that images the driver.
- the vehicle interior information detection unit 12040 may calculate the degree of fatigue or the degree of concentration of the driver, or may determine whether the driver is dozing, on the basis of detected information input from the driver condition detection unit 12041.
- the microcomputer 12051 can calculate a control target value for the driving force generation apparatus, the steering mechanism, or the braking device on the basis of vehicle interior or exterior information acquired by the vehicle exterior information detection unit 12030 or the vehicle interior information detection unit 12040, and output a control command to the drive system control unit 12010.
- the microcomputer 12051 can perform cooperative control for the purpose of implementing the functions of an advanced driver assistance system (ADAS) including vehicle collision avoidance or impact mitigation, following driving based on inter-vehicle distance, vehicle speed-maintaining driving, vehicle collision warning, vehicle lane departure warning, and so on.
- ADAS advanced driver assistance system
- the microcomputer 12051 can perform cooperative control for the purpose of automatic driving for autonomous travelling without a driver's operation, by controlling the driving force generation apparatus, the steering mechanism, the braking device, or others, on the basis of information around the vehicle acquired by the vehicle exterior information detection unit 12030 or the vehicle interior information detection unit 12040.
- the microcomputer 12051 can output a control command to the body system control unit 12020 on the basis of vehicle exterior information acquired by the vehicle exterior information detection unit 12030.
- the microcomputer 12051 can perform cooperative control for the purpose of preventing glare by controlling the headlamps according to the position of a preceding vehicle or an oncoming vehicle detected by the vehicle exterior information detection unit 12030, switching high beam to low beam, or the like.
- the sound/image output unit 12052 transmits an output signal of at least one of a sound or an image to an output device that can visually or auditorily notify a vehicle occupant or the outside of the vehicle of information.
- an audio speaker 12061 as the output device, an audio speaker 12061, a display unit 12062, and an instrument panel 12063 are illustrated.
- the display unit 12062 may include at least one of an on-board display or a head-up display, for example.
- Fig. 36 is a diagram illustrating an example of the installation position of the imaging unit 12031.
- a vehicle 12100 includes imaging units 12101, 12102, 12103, 12104, and 12105 as the imaging unit 12031.
- the imaging units 12101, 12102, 12103, 12104, and 12105 are provided, for example, at positions such as the front nose, the side mirrors, the rear bumper or the back door, and an upper portion of the windshield in the vehicle compartment of the vehicle 12100.
- the imaging unit 12101 provided at the front nose and the imaging unit 12105 provided at the upper portion of the windshield in the vehicle compartment mainly acquire images of the front of the vehicle 12100.
- the imaging units 12102 and 12103 provided at the side mirrors mainly acquire images of the sides of the vehicle 12100.
- the imaging unit 12104 provided at the rear bumper or the back door mainly acquires images of the rear of the vehicle 12100.
- Front images acquired by the imaging units 12101 and 12105 are mainly used for detection of a preceding vehicle, or a pedestrian, an obstacle, a traffic light, or a traffic sign, or a lane, or the like.
- Fig. 36 illustrates an example of imaging ranges of the imaging units 12101 to 12104.
- An imaging range 12111 indicates the imaging range of the imaging unit 12101 provided at the front nose
- imaging ranges 12112 and 12113 indicate the imaging ranges of the imaging units 12102 and 12103 provided at the side mirrors, respectively
- an imaging range 12114 indicates the imaging range of the imaging unit 12104 provided at the rear bumper or the back door.
- At least one of the imaging units 12101 to 12104 may have a function of acquiring distance information.
- at least one of the imaging units 12101 to 12104 may be a stereo camera including a plurality of imaging devices, or may be an imaging device including pixels for phase difference detection.
- the microcomputer 12051 can determine distances to three-dimensional objects in the imaging ranges 12111 to 12114, and temporal changes in the distances (relative speeds to the vehicle 12100), on the basis of distance information obtained from the imaging units 12101 to 12104, thereby extracting, as a preceding vehicle, especially the nearest three-dimensional object located on the traveling path of the vehicle 12100 which is a three-dimensional object traveling at a predetermined speed (e.g., 0 km/h or higher) in substantially the same direction as the vehicle 12100.
- the microcomputer 12051 can perform automatic brake control (including following stop control), automatic acceleration control (including following start control), and the like, setting an inter-vehicle distance to be provided in advance in front of a preceding vehicle.
- cooperative control for the purpose of autonomous driving for autonomous traveling without a driver's operation or the like can be performed.
- the microcomputer 12051 can extract three-dimensional object data regarding three-dimensional objects, classifying them into a two-wheel vehicle, an ordinary vehicle, a large vehicle, a pedestrian, and another three-dimensional object such as a power pole, on the basis of distance information obtained from the imaging units 12101 to 12104, for use in automatic avoidance of obstacles. For example, for obstacles around the vehicle 12100, the microcomputer 12051 distinguishes between obstacles that can be visually identified by the driver of the vehicle 12100 and obstacles that are difficult to visually identify. Then, the microcomputer 12051 determines a collision risk indicating the degree of danger of collision with each obstacle.
- the microcomputer 12051 can perform driving assistance for collision avoidance by outputting a warning to the driver via the audio speaker 12061 or the display unit 12062, or performing forced deceleration or avoidance steering via the drive system control unit 12010.
- At least one of the imaging units 12101 to 12104 may be an infrared camera that detects infrared rays.
- the microcomputer 12051 can recognize a pedestrian by determining whether or not a pedestrian is present in captured images of the imaging units 12101 to 12104. The recognition of a pedestrian is performed, for example, by a procedure of extracting feature points in captured images of the imaging units 12101 to 12104 as infrared cameras, and a procedure of performing pattern matching on a series of feature points indicating the outline of an object to determine whether or not the object is a pedestrian.
- the sound/image output unit 12052 controls the display unit 12062 to superimpose and display a rectangular outline for enhancement on the recognized pedestrian.
- the sound/image output unit 12052 may control the display unit 12062 so as to display an icon or the like indicating the pedestrian at a desired position.
- the technology according to the present disclosure can be applied to the imaging unit 12031 in the configuration described above.
- the solid-state imaging device 1 according to the above-described embodiment can be applied as the imaging unit 12031.
- the solid-state imaging device that uses electrons as signal charges with the first conductivity type as P-type and the second conductivity type as N-type has been described.
- the present technology is also applicable to a solid-state imaging device that uses holes as signal charges. That is, with the first conductivity type as N-type and the second conductivity type as P-type, each semiconductor region described above can be formed by a semiconductor region of the opposite conductivity type.
- Embodiments of the present technology are not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present technology.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Power Engineering (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- Electromagnetism (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Solid State Image Pick-Up Elements (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
Description
- The present technology relates to a solid-state imaging device and an electronic apparatus, and more particularly, relates to a solid-state imaging device and an electronic apparatus configured to be able to simultaneously acquire a signal for generating a high dynamic range image and a signal for detecting a phase difference.
- There has been proposed a solid-state imaging device that achieves simultaneous acquisition of two types of pixel signals, a high-sensitivity signal and a low-sensitivity signal, for generating a high dynamic range image (hereinafter also referred to as an HDR image) and acquisition of a phase difference detection signal for distance measurement (see, for example, Patent Document 1).
- Patent Document 1:
Japanese Patent Application Laid-Open No. 2016-171308 - In a pixel structure of
Patent Document 1, three photodiodes are formed under one on-chip lens. If the curvature of the on-chip lens is increased to increase the refractive power to improve the angle dependence for specialization in phase difference characteristics, it becomes difficult to generate HDR images. Conversely, if the curvature of the on-chip lens is reduced to reduce the refractive power to reduce the angle dependence for specialization in favorable generation of HDR images, the degree of separation of phase difference characteristics is deteriorated. Thus, it is difficult to achieve both phase difference characteristics and HDR characteristics. There has also been proposed a lens structure in which the curvature of one on-chip lens is changed, but it is sensitive to variation in shape, and thus is difficult to produce in large quantities. - The present technology has been made in view of such a situation, and is intended to enable simultaneous acquisition of a signal for generating a high dynamic range image and a signal for detecting a phase difference.
- A solid-state imaging device according to a first aspect of the present technology includes a plurality of pixel sets each including color filters of the same color, for a plurality of colors, each pixel set including a plurality of pixels, each pixel including a plurality of photoelectric conversion parts.
- An electronic apparatus according to a second aspect of the present technology includes a solid-state imaging device including a plurality of pixel sets each including color filters of the same color, for a plurality of colors, each pixel set including a plurality of pixels, each pixel including a plurality of photoelectric conversion parts.
- In the first and second aspects of the present technology, a plurality of pixel sets each including color filters of the same color is provided for a plurality of colors, each pixel set is provided with a plurality of pixels, and each pixel is provided with a plurality of photoelectric conversion parts.
- The solid-state imaging device and the electronic apparatus may be independent devices, or may be modules incorporated into other devices.
- According to the first and second aspects of the present technology, it is possible to simultaneously acquire a signal for generating a high dynamic range image and a signal for detecting a phase difference.
- Note that the effects described here are not necessarily limiting, and any effect described in the present disclosure may be included.
-
-
Fig. 1 is a diagram illustrating a schematic configuration of a solid-state imaging device to which the present technology is applied. -
Fig. 2 is a diagram illustrating a first cross-sectional configuration example of a pixel array of the solid-state imaging device inFig. 1 . -
Fig. 3 is a diagram illustrating a color array of color filters. -
Fig. 4 is a diagram illustrating a circuit configuration of a pixel set. -
Fig. 5 is a diagram illustrating a configuration of signal lines that control transfer transistors of pixel sets. -
Fig. 6 is a diagram illustrating drive in a case where the solid-state imaging device operates in a full-resolution mode. -
Fig. 7 is a diagram illustrating a modification of the full-resolution mode. -
Fig. 8 is a diagram illustrating drive in a case where the solid-state imaging device operates in a four-pixel addition phase-difference detection mode. -
Fig. 9 is a diagram illustrating drive in a case where the solid-state imaging device operates in a first phase difference HDR mode. -
Fig. 10 is a diagram illustrating a procedure of reading pixel signals in the first phase difference HDR mode. -
Fig. 11 is a diagram illustrating drive in a case where the solid-state imaging device operates in a second phase difference HDR mode. -
Fig. 12 is a diagram illustrating a procedure of reading pixel signals in the second phase difference HDR mode. -
Fig. 13 is a diagram illustrating a wiring example of signal lines specialized for the first phase difference HDR mode. -
Fig. 14 is a diagram illustrating a wiring example of signal lines specialized for the second phase difference HDR mode. -
Fig. 15 is a diagram illustrating a modification of the color array of the color filters. -
Fig. 16 is a diagram illustrating a modification of orientations of photodiodes PD. -
Fig. 17 is a diagram illustrating a modification of arrangement of on-chip lenses. -
Fig. 18 is a diagram illustrating a second cross-sectional configuration example of the pixel array of the solid-state imaging device inFig. 1 . -
Fig. 19 is a plan view illustrating regions where an insulating layer inFig. 18 is formed. -
Fig. 20 is a diagram illustrating a third cross-sectional configuration example of the pixel array of the solid-state imaging device inFig. 1 . -
Fig. 21 is a plan view illustrating regions where an insulating layer and an impurity layer inFig. 18 are formed. -
Fig. 22 is a diagram illustrating the potential of the impurity layer inFig. 21 . -
Fig. 23 is a diagram illustrating a modification of the third cross-sectional configuration example inFig. 20 . -
Fig. 24 is a plan view illustrating a first configuration in which a light-shielding film is disposed on photodiodes PD. -
Fig. 25 is a plan view illustrating a second configuration in which the light-shielding film is disposed on photodiodes PD. -
Fig. 26 is a plan view illustrating a third configuration in which the light-shielding film is disposed on photodiodes PD. -
Fig. 27 is a plan view illustrating a fourth configuration in which the light-shielding film is disposed on photodiodes PD. -
Fig. 28 is a diagram illustrating another modification of the solid-state imaging device inFig. 1 . -
Fig. 29 is a diagram illustrating still another modification of the solid-state imaging device inFig. 1 . -
Fig. 30 is a plan view illustrating an example of arrangement of pixel transistors. -
Fig. 31 is a block diagram illustrating a configuration example of an imaging apparatus as an electronic apparatus to which the present technology is applied. -
Fig. 32 is a diagram illustrating an example of use of an image sensor. -
Fig. 33 is a diagram illustrating an example of a schematic configuration of an endoscopic surgery system. -
Fig. 34 is a block diagram illustrating an example of a functional configuration of a camera head and a CCU. -
Fig. 35 is a block diagram illustrating an example of a schematic configuration of a vehicle control system. -
Fig. 36 is an explanatory diagram illustrating an example of installation positions of a vehicle exterior information detection unit and imaging units. - Hereinafter, a mode for carrying out the present technology (hereinafter referred to as an embodiment) will be described. Note that the description will be made in the following order.
- 1. Schematic configuration example of solid-state imaging device
- 2. First cross-sectional configuration example of pixels
- 3. Example of arrangement of color filters
- 4. Circuit configuration example of pixel set
- 5. Explanation of output modes
- 6. Modification of color array of color filters
- 7. Modification of orientations of photodiodes
- 8. Modification of on-chip lens arrangement
- 9. Second cross-sectional configuration example of pixels
- 10. Third cross-sectional configuration example of pixels
- 11. Configuration example in which light-shielding film is added
- 12. Other modifications
- 13. Pixel transistor arrangement example
- 14. Example of application to electronic apparatus
- 15. Example of application to endoscopic surgery system
- 16. Example of application to mobile object
-
Fig. 1 illustrates a schematic configuration of a solid-state imaging device to which the present technology is applied. - A solid-
state imaging device 1 ofFig. 1 includes apixel array 3 withpixels 2 two-dimensionally arrayed in a matrix, and peripheral circuitry around thepixel array 3 on asemiconductor substrate 12 using, for example, silicon (Si) as a semiconductor. The peripheral circuitry includes a vertical drive circuit 4, columnsignal processing circuits 5, a horizontal drive circuit 6, an output circuit 7, acontrol circuit 8, and others. - The
pixels 2 each include photodiodes as photoelectric conversion parts and a plurality of pixel transistors. Note that, as described later with reference toFig. 4 , thepixels 2 are formed in a shared pixel structure in which floating diffusion as a charge holding part that holds charges generated in the photodiodes is shared among a plurality ofpixels 2. In the shared pixel structure, photodiodes and transfer transistors are provided for each pixel, and a selection transistor, a reset transistor, and an amplification transistor are shared by a plurality of pixels. - The
control circuit 8 receives an input clock and data instructing an operation mode or the like, and outputs data such as internal information of the solid-state imaging device 1. Specifically, on the basis of a vertical synchronization signal, a horizontal synchronization signal, and a master clock, thecontrol circuit 8 generates a clock signal and a control signal on the basis of which the vertical drive circuit 4, the columnsignal processing circuits 5, the horizontal drive circuit 6, and others operate. Then, thecontrol circuit 8 outputs the generated clock signal and control signal to the vertical drive circuit 4, the columnsignal processing circuits 5, the horizontal drive circuit 6, and others. - The vertical drive circuit 4 is formed, for example, by a shift register, and selects a predetermined
pixel drive wire 10, provides a pulse for driving thepixels 2 to the selectedpixel drive wire 10, and drives thepixels 2 row by row. That is, the vertical drive circuit 4 performs control to selectively scan thepixels 2 of thepixel array 3 in the vertical direction sequentially row by row, and output pixel signals based on signal charges generated in the photoelectric conversion parts of thepixels 2 depending on the amount of received light, throughvertical signal lines 9 to the columnsignal processing circuits 5. - The column
signal processing circuits 5 are arranged for the corresponding columns of thepixels 2, and perform signal processing such as noise removal on signals output from thepixels 2 in one row for the corresponding pixel columns. For example, the columnsignal processing circuits 5 perform signal processing such as correlated double sampling (CDS) for removing fixed pattern noise peculiar to pixels and AD conversion. - The horizontal drive circuit 6 is formed, for example, by a shift register, selects each of the column
signal processing circuits 5 in order by sequentially outputting a horizontal scanning pulse, and causes each of the columnsignal processing circuits 5 to output a pixel signal to ahorizontal signal line 11. - The output circuit 7 performs predetermined signal processing on a signal sequentially provided from each of the column
signal processing circuits 5 through thehorizontal signal line 11, and outputs the signal. For example, the output circuit 7 may perform only buffering, or may perform various types of digital signal processing such as black level adjustment and column variation correction. An input-output terminal 13 exchanges signals with the outside. - The solid-
state imaging device 1 formed as described above is a CMOS image sensor called a column AD system in which the columnsignal processing circuits 5 that perform CDS processing and AD conversion processing are arranged for the corresponding pixel columns. - Furthermore, the solid-
state imaging device 1 may be formed by a chip of a stacked structure in which a plurality of substrates is stacked. A chip with a plurality of substrates stacked is formed by stacking a lower substrate and an upper substrate in that order from below upward. At least one or more of thecontrol circuit 8, the vertical drive circuit 4, the columnsignal processing circuits 5, the horizontal drive circuit 6, and the output circuit 7 are formed on the lower substrate, and at least thepixel array 3 is formed on the upper substrate. Connection portions connect the vertical drive circuit 4 to thepixel array 3, and the columnsignal processing circuits 5 to thepixel array 3, so that signals are transmitted between the lower substrate and the upper substrate. The connection portions are formed, for example, by through silicon vias (TSVs), Cu-Cu, or the like. -
Fig. 2 is a diagram illustrating a first cross-sectional configuration example of thepixel array 3 of the solid-state imaging device 1 inFig. 1 . - In the
pixel array 3 of the solid-state imaging device 1, photodiodes PD are formed by, for example, forming N-type (second conductivity type)semiconductor regions 32 in a P-type (first conductivity type)semiconductor region 31 in thesemiconductor substrate 12. In eachpixel 2 of thepixel array 3, two photodiodes PD are formed per pixel, and the two photodiodes PD are formed in such a manner as to be symmetrically disposed in two parts into which a pixel region is divided equally. Note that in the following description, of the two photodiodes PD formed in one pixel, the photodiode PD disposed on the right side in the figure is sometimes referred to as the right photodiode PD, and the photodiode PD disposed on the left side as the left photodiode PD. - On the front side of the
semiconductor substrate 12 that is the lower side inFig. 2 , amultilayer wiring layer 35 is formed which includes pixel transistors (not illustrated) for performing reading of charges generated and accumulated in the photodiodes PD of eachpixel 2 and the like, a plurality of wiring layers 33, and aninterlayer dielectric 34. - On the other hand, on pixel boundary portions on the back side of the
semiconductor substrate 12 that is the upper side inFig. 2 , an inter-pixel light-shieldingfilm 36 is formed. The inter-pixel light-shieldingfilm 36 may be of any material that blocks light, and is desirably of a material that has a high light-blocking property and can be processed with high precision by fine processing such as etching. The inter-pixel light-shieldingfilm 36 can be formed, for example, by a metal film of tungsten (W), aluminum (Al), copper (Cu), titanium (Ti), molybdenum (Mo), nickel (Ni), or the like. - In addition, for example, an antireflection film (insulating layer) formed, for example, by a silicon oxide film or the like may be further formed on a back side interface of the
semiconductor substrate 12. - On the back surface of the
semiconductor substrate 12 including the inter-pixel light-shieldingfilm 36,color filters 37 are formed. The color filters 37 are formed by spin-coating photosensitive resin containing coloring matters such as pigments or dyes, for example. The color array of thecolor filters 37 will be described later with reference toFig. 3 . Red (R), green (G), and blue (B) colors are arranged in a Bayer array in units of four pixels in 2 x 2 (two rows by two columns). - On the
color filters 37, on-chip lenses 38 are formed for the individual pixels. The on-chip lenses 38 are formed, for example, of a resin material such as a styrene resin, an acrylic resin, a styrene-acryl copolymer resin, or a siloxane resin. - As described above, the solid-
state imaging device 1 is a back-side illuminated CMOS solid-state imaging device in which thecolor filters 37 and the on-chip lenses 38 are formed on the back side of thesemiconductor substrate 12 opposite to the front side on which themultilayer wiring layer 35 is formed, so that light enters from the back side. - Each
pixel 2 of the solid-state imaging device 1 has two separate photodiodes PD in the pixel. The two photodiodes PD are formed at different positions, so that a shift occurs between images generated from the two photodiodes PD, individually. From this image shift, the amount of phase shift is calculated to calculate the amount of defocus. By adjusting (moving) an imaging lens, autofocus can be achieved. - Next, with reference to
Fig. 3 , the color array of thecolor filters 37 in thepixel array 3 will be described. - In the
pixel array 3 with thepixels 2 two-dimensionally arrayed in a matrix, fourpixels 2 in 2 x 2 (two vertical pixels x two horizontal pixels) constitute one pixel set 51. And thecolor filters 37 are arranged to be of the same color in each individual pixel set 51. More specifically, the R, G, andB color filters 37 are arranged in a Bayer array in units of the pixel sets 51. - In
Fig. 3 , the pixel set 51 having theR color filters 37 is represented by a pixel set 51R, and the pixel set 51 having theG color filters 37 adjacent to the pixel set 51R is represented by a pixel set 51Gr. Furthermore, the pixel set 51 having the B color filters 37 is represented by a pixel set 51B, and the pixel set 51 having theG color filters 37 adjacent to thepixel set 51B is represented by a pixel set 51Gb. Note that the configuration of the color filters is not limited to RGB primary-colors filters, and various configurations including filters of complementary colors such as cyan, magenta, yellow, and green (CMYG) may be applied. - Furthermore, the orientations of the longitudinal shape of the two photodiodes PD formed in each
pixel 2 are the same direction in the pixel set 51, and also, they are formed in the same direction in all the pixel sets 51. - The on-
chip lenses 38 are formed for the individual pixels. - Next,
Fig. 4 is a diagram illustrating a circuit configuration of the pixel set 51. -
Fig. 4 illustrates a circuit configuration of the pixel set 51Gr as an example of the pixel set 51. - Each
pixel 2 of the pixel set 51Gr includes two photodiodes PD and two transfer transistors TG for transferring charges accumulated in them. And oneFD 52, onereset transistor 53, oneamplification transistor 54, and oneselection transistor 55 are provided for the pixel set 51Gr. Each of thereset transistor 53, theamplification transistor 54, and theselection transistor 55 is shared by the four pixels of the pixel set 51Gr. The four pixels sharing thereset transistor 53, theamplification transistor 54, and theselection transistor 5 form a sharing unit. - Note that in the following, in a case where the two photodiodes PD and the two transfer transistors TG of each
pixel 2 in the pixel set 51Gr are distinguished from each other, of the four pixels in 2 x 2 constituting the pixel set 51Gr, the two photodiodes PD of the upperleft pixel 2 are referred to as photodiodes PD_Gr1L and PD_Gr1R, and the two transfer transistors TG that transfer charges accumulated in the photodiodes PD_Gr1L and PD_Gr1R are referred to as transfer transistors TG_Gr1L and TG_Gr1R. - Furthermore, the two photodiodes PD of the upper
right pixel 2 are referred to as photodiodes PD_Gr2L and PD_Gr2R, and the two transfer transistors TG that transfer charges accumulated in the photodiodes PD_Gr2L and PD_Gr2R are referred to as transfer transistors TG_Gr2L and TG_Gr2R. - Likewise, the two photodiodes PD of the lower
left pixel 2 are referred to as photodiodes PD_Gr3L and PD_Gr3R, and the two transfer transistors TG that transfer charges accumulated in the photodiodes Gr3L and Gr3R are referred to as transfer transistors TG_Gr3L and TG_Gr3R. The two photodiodes PD of the lowerright pixel 2 are referred to as photodiodes PD_Gr4L and PD_Gr4R, and the two transfer transistors TG that transfer charges accumulated in the photodiodes PD_Gr4L and PD_Gr4R are referred to as transfer transistors TG_Gr4L and TG_Gr4R. - Each of the photodiodes PD of each
pixel 2 in the pixel set 51Gr receives light and generates and accumulates photocharges. - When a drive signal TRGGr1L provided to the gate electrode becomes active, the transfer transistor TG_Gr1L becomes conductive in response to this, transferring photocharges accumulated in the photodiode PD_Gr1L to the
FD 52. When a drive signal TRGGr1R provided to the gate electrode becomes active, the transfer transistor TG_Gr1R becomes conductive in response to this, transferring photocharges accumulated in the photodiode PD_Gr1R to theFD 52. - When a drive signal TRGGr2L provided to the gate electrode becomes active, the transfer transistor TG_Gr2L becomes conductive in response to this, transferring photocharges accumulated in the photodiode PD_Gr2L to the
FD 52. When a drive signal TRGGr2R provided to the gate electrode becomes active, the transfer transistor TG_Gr2R becomes conductive in response to this, transferring photocharges accumulated in the photodiode PD_Gr2R to theFD 52. The similar applies to the photodiodes PD_Gr3L, PD_Gr3R, PD_Gr4L, and PD_Gr4R, and the transfer transistors TG_Gr3L, TG_Gr3R, TG_Gr4L, and TG_Gr4R. - The
FD 52 temporarily holds photocharges provided from each photodiode PD of eachpixel 2 in the pixel set 51Gr. - When a drive signal RST provided to the gate electrode becomes active, the
reset transistor 53 becomes conductive in response to this, resetting the potential of theFD 52 to a predetermined level (reset voltage VDD). - The
amplification transistor 54 has a source electrode connected to thevertical signal line 9 via theselection transistor 55, thereby forming a source follower circuit with a load MOS of a constantcurrent source circuit 56 connected to one end of thevertical signal line 9. - The
selection transistor 55 is connected between the source electrode of theamplification transistor 54 and thevertical signal line 9. When a selection signal SEL provided to the gate electrode becomes active, theselection transistor 55 becomes conductive in response to this, bringing the sharing unit into a selected state and outputting pixel signals of thepixels 2 in the sharing unit output from theamplification transistor 54 to thevertical signal line 9. Note that for the pixel set 51 (the pixel set 51Gr inFig. 4 ), oneselection transistor 55 may be provided as illustrated inFig. 4 , or two ormore selection transistors 55 may be provided. In a case where two ormore selection transistors 55 are provided for the pixel set 51, the two ormore selection transistors 55 are connected to differentvertical signal lines 9, so that pixel signals can be read at higher speed. - The transfer transistors TG of the
pixels 2, thereset transistor 53, theamplification transistor 54, and theselection transistor 55 are controlled by the vertical drive circuit 4. -
Fig. 5 illustrates a configuration of signal lines for providing the drive signals TRGGr to the gate electrodes of the eight transfer transistors TG constituting the pixel set 51 as illustrated inFig. 4 . - In order to provide the drive signals TRGGr to the gate electrodes of the eight transfer transistors TG constituting the pixel set 51Gr, as illustrated in
Fig. 5 , eight signal lines 61-1 to 61-8 are required for a plurality of pixel sets 51 arrayed in the horizontal direction. The eight signal lines 61-1 to 61-8 are part of thepixel drive wires 10 inFig. 1 . - The signal line 61-1 transmits the drive signal TRGGr1L to be provided to the gate electrode of the transfer transistor TG_Gr1L in the pixel set 51Gr. Furthermore, the signal line 61-1 also transmits the drive signal TRGGr1L to the gate electrode of a transfer transistor TG_R1L (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr1L in the pixel set 51Gr.
- The signal line 61-2 transmits the drive signal TRGGr1R to be provided to the gate electrode of the transfer transistor TG_Gr1R in the pixel set 51Gr. Furthermore, the signal line 61-2 also transmits the drive signal TRGGr1R to the gate electrode of a transfer transistor TG_R1R (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr1R in the pixel set 51Gr.
- The signal line 61-3 transmits the drive signal TRGGr2L to be provided to the gate electrode of the transfer transistor TG_Gr2L in the pixel set 51Gr. Furthermore, the signal line 61-3 also transmits the drive signal TRGGr2L to the gate electrode of a transfer transistor TG_R2L (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor G_Gr2L in the pixel set 51Gr.
- The signal line 61-4 transmits the drive signal TRGGr2R to be provided to the gate electrode of the transfer transistor TG_Gr2R in the pixel set 51Gr. Furthermore, the signal line 61-4 also transmits the drive signal TRGGr2R to the gate electrode of a transfer transistor TG_R2R (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr2R in the pixel set 51Gr.
- The signal line 61-5 transmits the drive signal TRGGr3L to be provided to the gate electrode of the transfer transistor TG_Gr3L in the pixel set 51Gr. Furthermore, the signal line 61-5 also transmits the drive signal TRGGr3L to the gate electrode of a transfer transistor TG_R3L (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr3L in the pixel set 51Gr.
- The signal line 61-6 transmits the drive signal TRGGr3R to be provided to the gate electrode of the transfer transistor TG_Gr3R in the pixel set 51Gr. Furthermore, the signal line 61-6 also transmits the drive signal TRGGr3R to the gate electrode of a transfer transistor TG_R3R (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr3R in the pixel set 51Gr.
- The signal line 61-7 transmits the drive signal TRGGr4L to be provided to the gate electrode of the transfer transistor TG_Gr4L in the pixel set 51Gr. Furthermore, the signal line 61-7 also transmits the drive signal TRGGr4L to the gate electrode of a transfer transistor TG_R4L (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr4L in the pixel set 51Gr.
- The signal line 61-8 transmits the drive signal TRGGr4R to be provided to the gate electrode of the transfer transistor TG_Gr4R in the pixel set 51Gr. Furthermore, the signal line 61-8 also transmits the drive signal TRGGr4R to the gate electrode of a transfer transistor TG_R4R (not illustrated) in the pixel set 51R adjacent to the pixel set 51Gr, located at the same position as the transfer transistor TG_Gr4R in the pixel set 51Gr.
- Likewise, eight signal lines 62-1 to 62-8 are required for the pixel sets 51B and 51Gb arrayed in the horizontal direction.
- The signal line 62-1 transmits a drive signal TRGGb1L to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr1L in the pixel set 51Gr.
- The signal line 62-2 transmits a drive signal TRGGb1R to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr1R in the pixel set 51Gr.
- The signal line 62-3 transmits a drive signal TRGGb2L to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr2L in the pixel set 51Gr.
- The signal line 62-4 transmits a drive signal TRGGb2R to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr2R in the pixel set 51Gr.
- The signal line 62-5 transmits a drive signal TRGGb3L to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr3L in the pixel set 51Gr.
- The signal line 62-6 transmits a drive signal TRGGb3R to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr3R in the pixel set 51Gr.
- The signal line 62-7 transmits a drive signal TRGGb4L to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistors TG_Gr4L in the pixel set 51Gr.
- The signal line 62-8 transmits a drive signal TRGGb4R to the gate electrodes of transfer transistors TG in the pixel sets 51B and 51Gb corresponding to the transfer transistor TG_Gr4R in the pixel set 51Gr.
- By forming the circuit of the plurality of
pixels 2 in the sharing unit as above, thepixels 2 in the sharing unit can output a pixel signal for each photodiode PD as a unit, and can output a pixel signal for each pixel as a unit or for a plurality of pixels as a unit, in response to a drive signal from the vertical drive circuit 4. In a case where a pixel signal is output for each pixel as a unit or for a plurality of pixels as a unit, a plurality of transfer transistors TG that outputs simultaneously is activated simultaneously. TheFD 52 adds charges provided from a plurality of photodiodes PD via the transfer transistors TG simultaneously activated. Consequently, a pixel signal of each pixel as a unit or of a plurality of pixels as a unit is output from theFD 52 through theamplification transistor 54 and theselection transistor 55 to the columnsignal processing circuit 5. - Note that although
Figs. 4 and5 illustrate a circuit example in which the four pixels in 2 x 2 constituting the pixel set 51 are a sharing unit, the combination of a plurality of pixels as a sharing unit is not limited to this. For example, two pixels in 1 × 2 (one vertical pixel x two horizontal pixels) or in 2 x 1 (two vertical pixels x one horizontal pixel) may be a sharing unit, or four pixels in 4 x 1 (four vertical pixels x one horizontal pixel) may be a sharing unit. - Next, a plurality of output modes that can be executed by the solid-
state imaging device 1 will be described. - First, a full-resolution mode in which pixel signals generated in all the photodiodes PD in the
pixel array 3 are output individually will be described. -
Fig. 6 is a diagram illustrating drive (pixel signal output control) of the pixel set 51Gr in a case where the solid-state imaging device 1 operates in the full-resolution mode. - A photodiode PD hatched in
Fig. 6 represents a photodiode PD selected to output a pixel signal. In the full-resolution mode, as illustrated inFig. 6 , the eight photodiodes PD in the pixel set 51Gr are selected sequentially, and pixel signals generated individually by the eight photodiodes PD are output individually. - In the example of
Fig. 6 , the order in which the eight photodiodes PD are selected is the order of the photodiodes PD_Gr1L, PD_Gr1R, PD_Gr2L, PD_Gr2R, PD_Gr3L, PD_Gr3R, PD_Gr4L, and PD_Gr4R. The order is not limited to this. - In the full-resolution mode, by combining pixel signals of the two photodiodes PD in the same pixel, a pixel signal of one pixel can be obtained, and by comparing the pixel signals of the two photodiodes PD in the same pixel, a phase difference can be detected. The other pixel sets 51Gb, 51R, and 51B perform an operation similar to that of the pixel set 51Gr in
Fig. 6 . - Thus, in the full-resolution mode, all the
pixels 2 can output a signal of each pixel as a unit and output signals for detecting a phase difference. - Furthermore, in the solid-
state imaging device 1, thecolor filters 37 of R, G, or B are arranged in units of four pixels (in units of the pixel sets 51) as illustrated inFig. 3 , but the full-resolution mode also allows re-mosaicing processing to regenerate and output pixel signals in a Bayer array of R, G, B in units of pixels. - Note that in the full-resolution mode in which the drive in
Fig. 6 is performed, the frame rate is reduced and the power consumption is increased. Thus, drive without performing phase difference detection on some of thepixels 2 in the pixel set 51Gr may be performed. - For example, as illustrated in
Fig. 7 , for the upperright pixel 2 and the lowerleft pixel 2 of the four pixels constituting the pixel set 51Gr, the solid-state imaging device 1 drives the two photodiodes PD in the pixels to read them simultaneously. Also inFig. 7 , a hatched photodiode PD represents a photodiode PD selected to output a pixel signal. - Phase difference is detected using pixel signals of the photodiodes PD_Gr1L and PD_Gr1R of the upper
left pixel 2 and the photodiodes PD_Gr4L and PD_Gr4R of the lowerright pixel 2. Thus, by reducing the number ofpixels 2 in which a phase difference is detected, the frame rate and the power consumption can be improved. Alternatively,pixels 2 in which a phase difference can be detected may be changed depending on difference in the amount of light received. For example, in low illumination, the drive inFig. 6 is performed in which phase difference detection is performed in all the pixels, and in high illumination, the drive inFig. 7 is performed in which some of thepixels 2 are excluded. - The example of
Fig. 7 is an example in which phase difference detection is performed in two pixels of the four pixels constituting the pixel set 51Gr, but drive to perform phase difference detection in only one pixel may be performed. - Next, a four-pixel addition phase-difference detection mode will be described.
- The solid-
state imaging device 1 can execute the four-pixel addition phase-difference detection mode in which pixel signals are added and output in each pixel set 51 that is a sharing unit, that is, in units of four pixels in 2 x 2, and a phase difference is detected on the entire surface of thepixel array 3. -
Fig. 8 is a diagram illustrating drive in the four-pixel addition phase-difference detection mode. - Also in
Fig 8 , a hatched photodiode PD represents a photodiode PD selected to output a pixel signal. - In the four-pixel addition phase-difference detection mode, the solid-
state imaging device 1 adds and outputs pixel signals of photodiodes PD located at the same position in the pixels of the pixel set 51, of the pairs of photodiodes PD of thepixels 2. For example, as illustrated in A ofFig. 8 , the solid-state imaging device 1 first adds and outputs pixel signals of all the left photodiodes PD in the pixel set 51, and then, as illustrated in B ofFig. 8 , adds and outputs pixel signals of all the right photodiodes PD in the pixel set 51. Note that the reading order of the left photodiodes PD and the right photodiodes PD may be reversed. - By performing such drive, a phase difference can be detected from a pixel signal of the left photodiodes PD and a pixel signal of the right photodiodes PD in each individual pixel set 51 read, and by combining the two pixel signals, a pixel signal output of each individual pixel set 51 (a unit of four pixels) can be obtained. In other words, an entire-surface phase difference can be detected while the advantage of a dynamic range due to increased pixel capacitance Qs is maintained.
- As a method of discernably reading a pixel signal of left photodiodes PD and a pixel signal of right photodiodes PD, two ways can be adopted: a first reading method of separately reading a pixel signal of left photodiodes PD and a pixel signal of right photodiodes PD, and a second reading method of reading a signal obtained by adding a pixel signal of left photodiodes PD and a pixel signal of right photodiodes PD.
- The first reading method and the second reading method will be briefly described.
- First, the first reading method will be described.
- First, while left and right photodiodes PD are receiving light (exposed), a dark level signal for performing correlated double sampling is acquired.
- After the elapse of a predetermined exposure time, the solid-
state imaging device 1 first reads a pixel signal of one of left and right photodiode PD groups of the pixel set 51, for example, a pixel signal of the left photodiode PD group. - For example, the reading of a pixel signal of the left photodiode PD group will be described with the example of the pixel set 51Gr illustrated in
Fig. 4 . After theselection transistor 55 is activated, the transfer transistors TG_Gr1L, TG_Gr2L, TG_Gr3L, and TG_Gr4L are activated to transfer charges accumulated in the photodiodes PD_Gr1L, PD_Gr2L, PD_Gr3L, and PD_Gr4L to theFD 52, so that a voltage signal corresponding to the accumulated charges in theFD 52 is output through thevertical signal line 9 to the columnsignal processing circuit 5. - The voltage signal output to the column
signal processing circuit 5 is the sum of the pixel signal of the left photodiode PD group and the dark level signal. Thus, by subtracting the dark level signal from the voltage signal in the columnsignal processing circuit 5, the pixel signal of the left photodiode PD group is obtained. - Next, the solid-
state imaging device 1 turns on thereset transistor 53 to reset the accumulated charges in theFD 52, and then reads a pixel signal of the other of the left and right photodiode PD groups of the pixel set 51, for example, a pixel signal of the right photodiode PD group. In the example of the pixel set 51Gr illustrated inFig. 4 , after theselection transistor 55 is activated, the transfer transistors TG_Gr1R, TG_Gr2R, TG_Gr3R, and TG_Gr4R are activated to transfer charges accumulated in the photodiodes PD_Gr1R, PD_Gr2R, PD_Gr3R, and PD_Gr4R to theFD 52, so that a voltage signal corresponding to the accumulated charges in theFD 52 is output through thevertical signal line 9 to the columnsignal processing circuit 5. - The voltage signal output to the column
signal processing circuit 5 is the sum of the pixel signal of the right photodiode PD group and the dark level signal. Thus, by subtracting the dark level signal from the voltage signal in the columnsignal processing circuit 5, the pixel signal of the right photodiode PD group is obtained. - In the first reading method, a pixel signal of the left photodiodes PD and a pixel signal of the right photodiodes PD are read separately, so that a phase difference signal can be directly obtained. This allows acquisition of a high-quality signal for distance measurement. On the other hand, a signal for a captured image can be obtained by digitally adding signals of the left and right photodiodes PD.
- Next, the second reading method will be described.
- The second reading method is similar to the first reading method up until the acquisition of a dark level signal and the acquisition of a pixel signal of one of the left and right photodiode PD groups in the pixel set 51 (a pixel signal of the left photodiode PD group).
- After acquiring a pixel signal of one of the left and right photodiode PD groups, the solid-
state imaging device 1 does not turn on the reset transistor 53 (keeps it off) unlike the first reading method, and reads a pixel signal of the other of the left and right photodiode PD groups of the pixel set 51, for example, a pixel signal of the right photodiode PD group. - A voltage signal output to the column
signal processing circuit 5 is the sum of the signals of the left and right photodiode PD groups and the dark level signal. The columnsignal processing circuit 5 first acquires the pixel signals of the left and right photodiode PD groups by subtracting the dark level signal from the voltage signal, and then acquires the pixel signal of the right photodiode PD group by subtracting the pixel signal of the left photodiode PD group obtained earlier from the pixel signals of the left and right photodiode PD groups. - In the second reading method, the pixel signal of the left photodiodes PD and the pixel signal of the right photodiodes PD can be acquired as above, and a phase difference signal can be obtained indirectly. On the other hand, signals for a captured image are added when they are analog, and thus have good signal quality, and also bring advantages in reading time and power consumption as compared with the first reading method.
- Next, a four-pixel addition mode will be described.
- In a case where phase difference information is not required, the solid-
state imaging device 1 can execute the four-pixel addition mode in which pixel signals are added and output in each pixel set 51 that is a sharing unit, that is, in units of four pixels in 2 x 2. - In the four-pixel addition mode, all the (eight) transfer transistors TG in the pixel set 51 that is a sharing unit are simultaneously turned on, and charges in all the photodiodes PD in the pixel set 51 are provided to the
FD 52. TheFD 52 adds the charges of all the photodiodes PD in the pixel set 51. Then, a voltage signal corresponding to the added charges is output to the columnsignal processing circuit 5. By taking the difference between the voltage signal and a dark level signal, a pixel signal of each pixel set 51 can be acquired. - Next, a first phase difference HDR mode will be described.
- The first phase difference HDR mode is an output mode that enables detection of a phase difference and generation of a high dynamic range image (hereinafter, referred to as an HDR image).
- In order to detect phase difference, at least some of the plurality of
pixels 2 constituting thepixel array 3 need to bepixels 2 that output a pixel signal of the left photodiode PD and a pixel signal of the right photodiode PD individually. - Furthermore, in order to generate an HDR image, the plurality of
pixels 2 constituting thepixel array 3 needs to includepixels 2 different in exposure time. - Therefore, in the first phase difference HDR mode, the solid-
state imaging device 1 sets two types of exposure times for the plurality ofpixels 2 constituting thepixel array 3 as illustrated inFig. 9 . -
Fig. 9 is a diagram illustrating the exposure times set for four (2 x 2) pixel sets 51 in a Bayer array that are a part of thepixel array 3 in the first phase difference HDR mode. - In the first phase difference HDR mode, one of a first exposure time and a second exposure time is set for each pixel. The second exposure time is an exposure time shorter than the first exposure time (first exposure time > second exposure time). In
Fig. 9 , "L" is written in photodiodes PD for which the first exposure time is set, and "S" is written in photodiodes PD for which the second exposure time is set. - As illustrated in
Fig. 9 , the first exposure time and the second exposure time are set with fourpixels 2 constituting one pixel set 51 paired in diagonal directions. For example, as in the example ofFig. 9 , the first exposure time (L) is set for the two upper right and lower left pixels of the four pixels constituting the pixel set 51, and the second exposure time (S) is set for the two lower right and upper left pixels. Note that the arrangement of thepixels 2 for which the first exposure time (L) and the second exposure time (S) are set may be reversed. -
Fig. 10 is a diagram illustrating a procedure of reading pixel signals in the first phase difference HDR mode. Also inFig. 10 , a hatched photodiode PD represents a photodiode PD selected to output a pixel signal. - In the first phase difference HDR mode, as illustrated in
Fig. 10 , the solid-state imaging device 1 outputs pixel signals of all the photodiodes PD for the two pixels for which the first exposure time (L) is set, and outputs pixel signals of the left photodiodes PD and pixel signals of the right photodiodes PD separately for the two pixels for which the second exposure time (S) is set. - Specifically, the solid-
state imaging device 1 simultaneously outputs pixel signals of a plurality of photodiodes PD in the order of pixel signals of all the photodiodes PD of the two upper right and lowerleft pixels 2, pixel signals of the left photodiodes PD of the upper left and lowerright pixels 2, and pixel signals of the upper left and lower right right photodiodes PD. - Consequently, the two
pixels 2 whose exposure time is set to the second exposure time (S) output pixel signals of the left photodiode PD and the right photodiode PD separately, so that a phase difference can be detected. Furthermore, since thepixels 2 for which the first exposure time (L) is set and thepixels 2 for which the second exposure time (S) is set are included, an HDR image can be generated. - Note that the
pixels 2 that detect a phase difference may be thepixels 2 whose exposure time is set to the first exposure time (L). However, if light intensity is high, thepixels 2 may be saturated. It is thus preferable that thepixels 2 that detect a phase difference are thepixels 2 for which the second exposure time (S) is set. By using thepixels 2 for which the second exposure time (S) is set as phase difference detection pixels, phase difference information can be acquired without causing saturation. - As described above, in the first phase difference HDR mode, for each pixel set 51, two types of exposure times, the first exposure time (L) and the second exposure time (S), are set, and in some of the
pixels 2 of the pixel set 51, specifically, thepixels 2 for which the second exposure time (S) is set, pixel signals of the left and right photodiodes PD are separately output to detect a phase difference, so that signals for phase difference detection and signals of an HDR image with a high dynamic range can be simultaneously acquired. - Next, a second phase difference HDR mode will be described.
- Like the first phase difference HDR mode, the second phase difference HDR mode is an output mode that enables phase difference detection and HDR image generation. The second phase difference HDR mode differs from the first phase difference HDR mode in that exposure times set for the
pixels 2 in thepixel array 3 are not of the two types in the first phase difference HDR mode but of three types. -
Fig. 11 is a diagram illustrating exposure times set for four (2 x 2) pixel sets 51 in a Bayer array that are a part of thepixel array 3 in the second phase difference HDR mode. - In the second phase difference HDR mode, one of first to third exposure times is set for each pixel. The second exposure time is an exposure time shorter than the first exposure time, and the third exposure time is an exposure time even shorter than the second exposure time (first exposure time > second exposure time > third exposure time). In
Fig. 11 , "L" is written in photodiodes PD for which the first exposure time is set, "M" is written in photodiodes PD for which the second exposure time is set, and "S" is written in photodiodes PD for which the third exposure time is set. Of the first exposure time (L), the second exposure time (M), and the third exposure time (S), the second exposure time (M) in the middle is an exposure time suitable for proper exposure at the time of automatic exposure. - As illustrated in
Fig. 11 , the second exposure time (M) is set for two pixels in a predetermined diagonal direction of fourpixels 2 constituting one pixel set 51, the first exposure time (L) is set for one of two pixels in the other diagonal direction, and the third exposure time (S) is set for the other. Note that the diagonal direction in which the second exposure time (M) is set may be a diagonally right direction instead of a diagonally left direction inFig. 11 . Furthermore, the arrangement of thepixels 2 for which the first exposure time (L) and the third exposure time (S) are set may be reversed. -
Fig. 12 is a diagram illustrating a procedure of reading pixel signals in the second phase difference HDR mode. Also inFig. 12 , a hatched photodiode PD represents a photodiode PD selected to output a pixel signal. - In the second phase difference HDR mode, as illustrated in
Fig. 12 , the solid-state imaging device 1 outputs a pixel signal of the left photodiode PD and a pixel signal of the right photodiode PD separately for the two pixels for which the second exposure time (M) is set, and outputs a pixel signal of the photodiodes PD in each pixel as a unit for the two pixels for which the first exposure time (L) and the third exposure time (S) are set. - Specifically, the solid-
state imaging device 1 simultaneously outputs pixel signals of a plurality of photodiodes PD in the order of pixel signals of the two photodiodes PD of the upperright pixel 2, pixel signals of the left photodiodes PD of the upper left and lowerright pixels 2, pixel signals of the right photodiodes PD of the upper left and lowerright pixels 2, and pixel signals of the two photodiodes PD of the lowerleft pixel 2. - Consequently, the two
pixels 2 whose exposure time is set to the second exposure time (M) output pixel signals of the left photodiode PD and the right photodiode PD separately, so that a phase difference can be detected. Furthermore, since thepixels 2 for which the different exposure times are set are included, an HDR image can be generated. - Note that the
pixels 2 that detect a phase difference may be thepixels 2 whose exposure time is set to the first exposure time (L) or the third exposure time (S). However, if light intensity is high, thepixels 2 may be saturated, and if light intensity is low, the signal level may be too low. It is thus preferable to use thepixels 2 for which the second exposure time (M) for proper exposure is set. By using thepixels 2 for which the second exposure time (M) is set as phase difference detection pixels, phase difference information can be acquired without causing saturation. - As described above, in the second phase difference HDR mode, for each pixel set 51, three types of exposure times, the first exposure time (L), the second exposure time (M), and the third exposure time (S), are set, and in some of the
pixels 2 of each pixel set 51, specifically, thepixels 2 for which the second exposure time (M) is set, pixel signals of the left and right photodiodes PD are separately output to detect a phase difference, so that signals for phase difference detection and signals of an HDR image with a high dynamic range can be simultaneously acquired. - Note that in order to enable operation in both the first phase difference HDR mode and the second phase difference HDR mode, the eight signal lines 61-1 to 61-8 or 62-1 to 62-8 as illustrated in
Fig. 5 are required for the pixel sets 51 arranged in the horizontal direction. However, in a case where it is only required to enable operation in only one of the first phase difference HDR mode and the second phase difference HDR mode, the number of signal lines for each pixel set 51 arranged in the horizontal direction can be reduced. - For example,
Fig. 13 illustrates a wiring example of signal lines in a case where operation in only the first phase difference HDR mode is enabled as an output mode that enables phase difference detection and HDR image generation. - In
Fig. 13 , by disposing four signal lines 81-1 to 81-4 for the pixel sets 51 arranged in the horizontal direction, operation in the first phase difference HDR mode becomes possible. - Specifically, the single signal line 81-1 is disposed to control pixel signals of the left photodiodes PD of the
pixels 2 paired in the diagonal direction for which an exposure time of the second exposure time (S) is set, and the single signal line 81-2 is disposed to control pixel signals of the right photodiodes PD. Furthermore, the single signal line 81-3 is disposed to control pixel signals of the left photodiodes PD of thepixels 2 paired in the diagonal direction for which an exposure time of the first exposure time (L) is set, and the single signal line 81-4 is disposed to control pixel signals of the right photodiodes PD side. -
Fig. 14 illustrates a wiring example of signal lines in a case where operation in only the second phase difference HDR mode is enabled as an output mode that enables phase difference detection and HDR image generation. - In
Fig. 14 , by disposing six signal lines 82-1 to 82-6 for the pixel sets 51 arranged in the horizontal direction, operation in the second phase difference HDR mode becomes possible. - Specifically, the single signal line 82-1 is disposed to control pixel signals of the left photodiodes PD of the
pixels 2 for which an exposure time of the first exposure time (L) is set, and the single signal line 82-2 is disposed to control pixel signals of the right photodiodes PD. Furthermore, the single signal line 82-3 is disposed to control pixel signals of the left photodiodes PD of thepixels 2 paired in the diagonal direction for which an exposure time of the second exposure time (M) is set, and the single signal line 82-4 is disposed to control pixel signals of the right photodiodes PD. The single signal line 82-5 is disposed to control pixel signals of the left photodiodes PD of thepixels 2 for which an exposure time of the third exposure time (S) is set, and the single signal line 82-6 is disposed to control pixel signals of the right photodiodes PD. - As described above, the solid-
state imaging device 1 can execute, as an output mode, the full-resolution mode in which pixel signals of the photodiodes PD of eachpixel 2 are output individually, the four-pixel addition phase-difference detection mode in which pixel signals of the left photodiodes PD or the right photodiodes PD are added and output in units of four pixels, the four-pixel addition mode in which pixel signals of all the photodiodes PD in the pixel set 51 are added and output, and the first phase difference HDR mode and the second phase difference HDR mode that enable phase difference detection and HDR image generation. - The full-resolution mode enables phase difference detection in all the pixels and high-resolution output by re-mosaicing, and the four-pixel addition phase-difference detection mode enables phase difference detection in the entire surface and high S/N and high dynamic range signal output by four-pixel addition. Furthermore, the four-pixel addition mode enables high S/N and high dynamic range signal output by four-pixel addition, and the first phase difference HDR mode and the second phase difference HDR mode enable both HDR image generation and phase difference detection in the entire surface. Note that to achieve HDR, two or more exposure times may be set for pixels with a single sensitivity as described above, or a single exposure time may be set for a plurality of pixels with different sensitivities formed as a pixel set. An example of a plurality of pixels with different sensitivities includes a pixel including photodiodes with a large light receiving area as a pixel with a high sensitivity, and a pixel including photodiodes with a small light receiving area as a pixel with a low sensitivity.
- Note that, of course, the solid-
state imaging device 1 may further be able to execute output modes other than those described above. -
Fig. 15 illustrates a modification of the color array of the color filters. - In the above-described example, as illustrated in
Fig. 3 and others, the R, G, andB color filters 37 are arranged in the Bayer array in units of the pixel sets 51. - In contrast, in
Fig. 15 , the R, G, andB color filters 37 are arranged in a Bayer array in units of thepixels 2. - Thus, the
color filters 37 may be arranged in a Bayer array in units of pixels. - The sharing unit of pixel circuits sharing the
reset transistor 53, theamplification transistor 54, and theselection transistor 55 may be four pixels in 2 x 2 (two vertical pixels x two horizontal pixels) as inFig. 4 , or may be four pixels in 4 x 1 (four vertical pixels x one horizontal pixel). The color array of thecolor filters 37 in the Bayer array in units of pixels as illustrated inFig. 15 allows pixel signals of pixels of the same color to be added if four pixels in 4 x 1 are set as a sharing unit. -
Fig. 16 illustrates a modification of the orientations of the photodiodes PD. - In the above-described example, as illustrated in
Fig. 3 , the pairs of photodiodes PD in thepixels 2 are formed such that the orientations of their longitudinal shape are the same direction in each pixel set 51, and are also the same direction in all the pixel sets 51. - However, the orientations of the longitudinal shape of the pairs of photodiodes PD in the pixels may be different from pixel to pixel or from pixel set to pixel set.
- A of
Fig. 16 illustrates an example in which the pairs of photodiodes PD in thepixels 2 are formed such that the orientations of their longitudinal shape are the same direction in each pixel set 51, but are different from pixel set 51 to pixel set 51. - In A of
Fig. 16 , the orientations of the longitudinal shape of the pairs of photodiodes PD in the pixel set 51Gr and the pixel set 51Gb including theG color filters 37 are the left-right direction (horizontal direction), and the orientations of the longitudinal shape of the pairs of photodiodes PD in the pixel set 51R including theR color filters 37 and the pixel set 51B including theB color filters 37 are the up-and-down direction (vertical direction). In other words, the photodiodes PD are formed such that the orientations of the longitudinal shape of the pairs of photodiodes PD in the pixels are at right angles between the pixel set 51Gr and the pixel set 51Gb, and the pixel set 51R and the pixel set 51B. The orientations of the longitudinal shape of the photodiodes PD in the pixel sets 51 including thecolor filters 37 of the same color are the same. - B of
Fig. 16 illustrates an example in which in each pixel set 51 including thecolor filters 37 of the same color, pairs of photodiodes PD in two pixels arranged in the horizontal direction are formed such that the orientations of their longitudinal shape are the same direction, and pairs of photodiodes PD in two pixels arranged in the vertical direction are formed such that the orientations of their longitudinal shape are orthogonal directions. - In B of
Fig. 16 , in each pixel set 51, the photodiodes PD are formed such that the orientations of the longitudinal shape of the pairs of photodiodes PD in the two upper pixels are the left-right direction (horizontal direction), and the orientations of the longitudinal shape of the pairs of photodiodes PD in the two lower pixels are the up-and-down direction (vertical direction). - C of
Fig. 16 illustrates an example in which in each pixel set 51 including thecolor filters 37 of the same color, pairs of photodiodes PD in two pixels PD arranged in the horizontal direction are formed such that the orientations of their longitudinal shape are orthogonal directions, and pairs of photodiodes PD in two pixels PD arranged in the vertical direction are formed such that the orientations of their longitudinal shape are also orthogonal directions. - In C of
Fig. 16 , in each pixel set 51, the photodiodes PD are formed such that the orientations of the longitudinal shape of the pairs of photodiodes PD in the two upper pixels are the left-right direction (horizontal direction) and the up-and-down direction (vertical direction), and the orientations of the longitudinal shape of the pairs of photodiodes PD in the two lower pixels are also the left-right direction (horizontal direction) and the up-and-down direction (vertical direction). - As above, the two photodiodes PD of the longitudinal shape formed in each pixel are arranged symmetrically in the vertical direction or the horizontal direction, and for their orientations in the pixels in the pixel set 51, either the same direction or orthogonal directions can be used.
-
Fig. 17 illustrates a modification of the arrangement of the on-chip lenses 38. - In the above-described example, as illustrated in
Fig. 3 , the on-chip lenses 38 are formed for individual pixels. - However, as illustrated in
Fig. 17 , for some of the plurality of pixel sets 51 constituting thepixel array 3, one on-chip lens 91 may be disposed for one pixel set 51. - A of
Fig. 17 illustrates an example in which one on-chip lens 91 is disposed for the pixel set 51Gb including theG color filters 37, and the on-chip lenses 38 for individual pixels are disposed for the other pixel sets 51Gr, 51R, and 51B. - B of
Fig. 17 illustrates an example in which one on-chip lens 91 is disposed for the pixel set 51R including theR color filters 37, and the on-chip lenses 38 for individual pixels are disposed for the other pixel sets 51Gr, 51Gb, and 51B. - C of
Fig. 17 illustrates an example in which one on-chip lens 91 is disposed for the pixel set 51B including theB color filters 37, and the on-chip lenses 38 for individual pixels are disposed for the other pixel sets 51Gr, 51R, and 51Gb. - In the
pixel array 3 in which the pixel sets 51 are two-dimensionally arranged, the on-chip lenses 91 in A to C ofFig. 17 may be disposed at regular intervals or randomly. - The pixel set 51 with the on-
chip lens 91 cannot acquire pixel signals for generating an HDR image, but can detect a phase difference with pixel signals in each pixel, and thus is effective for phase difference detection in low illumination. -
Fig. 18 is a diagram illustrating a second cross-sectional configuration example of thepixel array 3 of the solid-state imaging device 1 inFig. 1 . - In
Fig. 18 , parts corresponding to those in the first cross-sectional configuration example illustrated inFig. 2 are denoted by the same reference numerals, and description of the parts will be omitted as appropriate. - The second cross-sectional configuration example of
Fig. 18 differs from the first cross-sectional configuration example illustrated inFig. 2 in that an insulatinglayer 101 is formed in thesemiconductor substrate 12. - Specifically, in the first cross-sectional configuration example illustrated in
Fig. 2 , only the P-type semiconductor region 31 and the N-type semiconductor regions 32 are formed in thesemiconductor substrate 12. In the second cross-sectional configuration example inFig. 18 , the insulatinglayer 101 is further formed at pixel boundaries between adjacent pixels and between the two photodiodes PD in each pixel. The insulatinglayer 101 is formed, for example, by a deep trench isolation (DTI) in which an oxide film (e.g., a TEOS film) is formed on the inner peripheral surface of deep grooves (trenches) dug from the back side of thesemiconductor substrate 12, and the inside thereof is filled with polysilicon. Note that the insulatinglayer 101 is not limited to the configuration using the oxide film and polysilicon, and may be of a configuration using a metal such as hafnium or a configuration using an impurity layer. Furthermore, the insulatinglayer 101 of different configurations may be applied in different pixels. For example, in an R pixel that transmits relatively long wavelengths, an impurity layer may be applied as the insulatinglayer 101, and in a B pixel and a G pixel, an oxide film, polysilicon, or a metal may be applied as the insulatinglayer 101. Furthermore, the insulatinglayer 101 may be a shallow trench isolation (STI) shallower than DTI, or may be a full trench isolation (FTI) that completely separates pixels from each other. -
Fig. 19 is a plan view illustrating regions where the insulatinglayer 101 is formed in a range of 16 pixels in 4 x 4. - As can be seen from the plan view of
Fig. 19 , the insulatinglayer 101 is formed at the boundaries of thepixels 2 and between the two photodiodes PD in each pixel, and the two photodiodes PD are separated from each other by the insulatinglayer 101. -
Fig. 20 is a diagram illustrating a third cross-sectional configuration example of thepixel array 3 of the solid-state imaging device 1 inFig. 1 . - In
Fig. 20 , parts corresponding to those in the second cross-sectional configuration example illustrated inFig. 18 are denoted by the same reference numerals, and description of the parts will be omitted as appropriate. - In the second cross-sectional configuration example of
Fig. 18 , the insulatinglayer 101 is formed at the boundaries of thepixels 2 and between the two photodiodes PD in each pixel. - In the third cross-sectional configuration example of
Fig. 20 , at the boundaries of thepixels 2, the insulatinglayer 101 is formed as in the second cross-sectional configuration example, but between the two photodiodes PD in each pixel, animpurity layer 102 of a conductivity type opposite to that of the N-type semiconductor regions 32, that is, P-type is formed. The impurity concentration of the P-type impurity layer 102 is higher than that of thesemiconductor region 31. Theimpurity layer 102 can be formed, for example, by ion implantation from the back side of thesemiconductor substrate 12. -
Fig. 21 is a plan view illustrating regions where the insulatinglayer 101 and theimpurity layer 102 are formed in a range of 16 pixels in 4 x 4. - As can be seen from the plan view of
Fig. 21 , the insulatinglayer 101 is formed at the boundaries of thepixels 2, and theimpurity layer 102 separates the two photodiodes PD in each pixel from each other. - The potential barrier between the two photodiodes PD in each pixel may be the same as the potential barrier at the pixel boundaries, or may be made lower than the potential barrier at the pixel boundaries as illustrated in B of
Fig. 22 . - A of
Fig. 22 is a cross-sectional structural diagram of one pixel in the third cross-sectional configuration example, and B ofFig. 22 is a potential diagram corresponding to A ofFig. 22 . - As illustrated in B of
Fig. 22 , by making the potential barrier between the two photodiodes PD lower than that at the pixel boundaries, when charges accumulated in one photodiode PD have reached a saturation level, they flow into the other photodiode PD before overflowing into theFD 52. Thus, the linearity of a pixel signal of one pixel obtained by combining the left and right photodiodes PD can be improved. - The height of the potential barrier between the photodiodes PD can be made lower than the potential barrier at the pixel boundaries by adjusting the impurity concentration in the
impurity layer 102. - Note that the
impurity layer 102 may be formed so as to completely isolate a region sandwiched between the two photodiodes PD as illustrated inFig. 21 , or may be formed so as to isolate only a part of the region sandwiched between the two photodiodes PD as illustrated inFig. 23 . InFig. 23 , theimpurity layer 102 is formed only in a part in and around the pixel center of the region sandwiched between the two photodiodes PD. - A cross-sectional view of parts where the
impurity layer 102 is formed inFig. 23 is the same as that inFig. 20 , and a cross-sectional view of parts where theimpurity layer 102 is not formed inFig. 23 is the same as that inFig. 18 . - In the above-described example, the inter-pixel light-shielding
film 36 that prevent light from entering adjacent pixels are formed at pixel boundary portions, but no light-shielding film is formed on the photodiodes PD. - However, for some of the
pixels 2 in thepixel array 3, a configuration in which a light-shielding film is disposed on two photodiodes PD in a pixel may be adopted. -
Fig. 24 is a plan view illustrating a first configuration in which a light-shielding film is disposed on photodiodes PD. - In A and B of
Fig. 24 , in eachpixel 2 of the pixel set 51Gr, the upper halves or the lower halves of the two photodiodes PD in the pixel are shielded from the light by a light-shieldingfilm 121. - A of
Fig. 24 is an example in which the lower halves of the two photodiodes PD in the pixel are shielded from the light by the light-shieldingfilm 121, and B ofFig. 24 is an example in which the upper halves of the two photodiodes PD in the pixel are shielded from the light by the light-shieldingfilm 121. - The on-
chip lenses 38 are formed for the individual pixels as inFig. 3 . - Using a pixel signal of the pixel set 51Gr in A of
Fig. 24 in which pieces of the light-shieldingfilm 121 are symmetrically disposed (an added pixel signal of the four pixels) and a pixel signal of the pixel set 51Gr in B ofFig. 24 (an added pixel signal of the four pixels), phase difference information is acquired. -
Fig. 25 is a plan view illustrating a second configuration in which a light-shielding film is disposed on photodiodes PD. - In A and B of
Fig. 25 , in eachpixel 2 of the pixel set 51Gr, one of the two photodiodes PD in the pixel is shielded from the light by the light-shieldingfilm 121. - A of
Fig. 25 is an example in which the left photodiode PD of the two photodiodes PD of eachpixel 2 in the pixel set 51Gr is shielded from the light by the light-shieldingfilm 121, and B ofFig. 25 is an example in which the right photodiode PD of the two photodiodes PD of eachpixel 2 in the pixel set 51Gr is shielded from the light by the light-shieldingfilm 121. - The on-
chip lenses 38 are formed for the individual pixels as inFig. 3 . - Using a pixel signal of the pixel set 51Gr in A of
Fig. 25 in which pieces of the light-shieldingfilm 121 are symmetrically disposed (an added pixel signal of the four pixels) and a pixel signal of the pixel set 51Gr in B ofFig. 25 (an added pixel signal of the four pixels), phase difference information is acquired. - Both of the first and second configurations in
Figs. 24 and25 are a configuration in which the light-shieldingfilm 121 partly light-shields all thepixels 2 in the pixel set 51Gr. -
Fig. 26 is a plan view illustrating a third configuration in which a light-shielding film is disposed on photodiodes PD. - In A and B of
Fig. 26 , of the four pixels constituting the pixel set 51Gb, all the photodiodes PD of the two upper or lower pixels are shielded from the light by the light-shieldingfilm 121. - A of
Fig. 26 is an example in which all the photodiodes PD of the two lower pixels in the pixel set 51Gb are shielded from the light by the light-shieldingfilm 121, and B ofFig. 26 is an example in which all the photodiodes PD of the two upper pixels in the pixel set 51Gb are shielded from the light by the light-shieldingfilm 121. - In
Fig. 26 , one on-chip lens 91 is formed on the pixel set 51Gb at which the light-shieldingfilm 121 is disposed, as inFig. 17 . On the pixel sets 51Gr, 51R, and 51B at which no light-shieldingfilm 121 is disposed, the on-chip lenses 38 for the individual pixels are formed. - Using a pixel signal of the pixel set 51Gb in A of
Fig. 26 at which pieces of the light-shieldingfilm 121 are symmetrically disposed (an added pixel signal of the four pixels) and a pixel signal of the pixel set 51Gb in B ofFig. 26 (an added pixel signal of the four pixels), phase difference information is acquired. -
Fig. 27 is a plan view illustrating a fourth configuration in which a light-shielding film is disposed on photodiodes PD. - In A and B of
Fig. 27 , of the four pixels constituting the pixel set 51Gb, all the photodiodes PD of the two left or right pixels are shielded from the light by the light-shieldingfilm 121. - A of
Fig. 27 is an example in which all the photodiodes PD of the two left pixels in the pixel set 51Gb are shielded from the light by the light-shieldingfilm 121, and B ofFig. 27 is an example in which all the photodiodes PD of the two right pixels in the pixel set 51Gb are shielded from the light by the light-shieldingfilm 121. - In
Fig. 27 , one on-chip lens 91 is formed on the pixel set 51Gb at which the light-shieldingfilm 121 is disposed, as inFig. 17 . On the pixel sets 51Gr, 51R, and 51B at which no light-shieldingfilm 121 is disposed, the on-chip lenses 38 for the individual pixels are formed. - Using a pixel signal of the pixel set 51Gb in A of
Fig. 27 at which pieces of the light-shieldingfilm 121 are symmetrically disposed (an added pixel signal of the four pixels) and a pixel signal of the pixel set 51Gb in B ofFig. 27 (an added pixel signal of the four pixels), phase difference information is acquired. - Both of the third and fourth configurations in
Figs. 26 and27 are a configuration in which the light-shieldingfilm 121 entirely shields some of thepixels 2 in the pixel set 51Gr from the light. - In a case where the light intensity of incident light is high and phase difference information cannot be acquired in the pixel sets 51 at which no light-shielding
film 121 is disposed, the first to fourth configurations ofFig. 24 to Fig. 27 in which the light-shieldingfilm 121 is disposed allows the pixel sets 51 at which the light-shieldingfilm 121 is disposed to acquire phase difference information. Thus, the first to fourth configurations in which the light-shieldingfilm 121 is disposed are effective in acquiring phase difference information in a case where the light intensity of incident light is high. - The first to fourth configurations of
Figs. 24 to 27 in which the light-shielding film is disposed are an example in which the light-shieldingfilm 121 is disposed at the pixel set 51Gb or the pixel set 51Gr. A similar light-shieldingfilm 121 may be formed for the other pixel set 51R or 51B, or the light-shieldingfilm 121 may be formed at all of the pixel sets 51Gb, 51R, and 51B. -
Fig. 28 illustrates another modification of the solid-state imaging device 1. - In the example described above, the constituent units of the pixel set 51 is four pixels in 2 x 2 (two vertical pixels x two horizontal pixels). However, the pixel set 51 is not limited to four pixels in 2 x 2, and is only required to include a plurality of
pixels 2. -
Fig. 28 illustrates an example in which the constituent units of the pixel set 51 is 16 pixels in 4 x 4 (four vertical pixels x four horizontal pixels). The example ofFig. 28 illustrates an example in which an on-chip lens 38 is formed for each pixel, which is not limiting. One on-chip lens may be disposed for four pixels in 2 x 2, or one on-chip lens may be disposed for 16 pixels in 4 x 4. - In addition, for example, nine pixels in 3 x 3 (three vertical pixels x three horizontal pixels) may be set as constituent units of the pixel set 51.
-
Fig. 29 illustrates still another modification of the solid-state imaging device 1. - In the example described above, a
color filter 37 that allows light of wavelengths of R, G, or B to pass through is formed at eachpixel 2 of the solid-state imaging device 1. - However, as illustrated in
Fig. 29 , a configuration in which thecolor filters 37 are eliminated may be adopted. In this case, thepixels 2 of the solid-state imaging device 1 can receive light of all wavelengths of R, G, and B to generate and output pixel signals. - Alternatively, instead of the
color filters 37, the solid-state imaging device 1 may be provided with infrared filters that transmit infrared light to receive only infrared light to generate and output pixel signals. - An example of arrangement of pixel transistors will be described with reference to
Fig. 30 . - In the
pixel array 3, for example, the arrangement of the photodiodes PD and the pixel transistors illustrated inFig. 30 is repeated in the horizontal direction and the vertical direction. -
Fig. 30 is a plan view illustrating an example of arrangement of the pixel transistors in a pixel region of a total of 16 pixels in which the pixel sets 51 whose constituent units are four pixels in 2 x 2 (two vertical pixels x two horizontal pixels) are arranged 2 x 2. InFig. 30 , a portion indicated by a black circle represents a power supply, a GND, or a contact portion of a signal line. Note that inFig. 30 , some reference numerals are omitted to prevent the figure from being complicated. - In
Fig. 30 , the photodiodes PD, the color filters 37 (not illustrated inFig. 30 ), and the on-chip lenses 38 are formed as in the example illustrated inFig. 3 . Specifically, two photodiodes PD are disposed for one pixel horizontally symmetrically in a longitudinal shape. The on-chip lenses 38 are formed for the individual pixels. The color filters 37 are arranged in a Bayer array in units of the pixel sets 51. The upper left pixel set 51 is the pixel set 51Gr including theG color filters 37, the upper right pixel set 51 is the pixel set 51R including theR color filters 37, the lower left pixel set 51 is the pixel set 51B including theB color filters 37, and the lower right pixel set 51 is the pixel set 51Gb including the G color filters 37. - As described with reference to
Fig. 4 , one pixel set 51 including four pixels is provided with eight photodiodes PD and eight transfer transistors TG, and theFD 52, thereset transistor 53, theamplification transistor 54, and theselection transistor 55 shared by them. - As illustrated in
Fig. 30 , the eight photodiodes PD included in one pixel set 51 are arrayed in 2 x 4 (vertically two x horizontally four), and thereset transistor 53, theamplification transistor 54, and theselection transistor 55, which are shared by the eight photodiodes PD, are disposed vertically (longitudinally) adjacent to the eight photodiodes PD in 2 x 4. If thereset transistor 53, theamplification transistor 54, and theselection transistor 55, which are shared by the eight photodiodes PD, are collectively referred to as shared pixel transistors, the shared pixel transistors are disposed between the eight photodiodes PD and the eight photodiodes PD in 2 x 4 in the two vertically adjacent pixel sets 51. - With four photodiodes PD in 2 x 2 as a group, the transfer transistors TG provided one-to-one to the photodiodes PD are disposed near the center of the group. Four transfer transistors TG are collectively disposed near the center of four photodiodes PD in 2 x 2 in a right group in the pixel set 51, and four transfer transistors TG are collectively disposed near the center of four photodiodes PD in 2 x 2 in a left group in the pixel set 51.
- The
FD 52 includes atleast metal wiring 52A as a part thereof. As illustrated inFig. 30 , themetal wiring 52A is routed to electrically connect a middle portion of the four photodiodes PD in 2 x 2 in the right group in the pixel set 51, a middle portion of the four photodiodes PD in 2 x 2 in the left group in the pixel set 51, the gate electrode of theamplification transistor 54, and the source electrode of thereset transistor 53. Charges accumulated in each photodiode PD in the pixel set 51 are transferred to themetal wiring 52A constituting a part of theFD 52 by the corresponding transfer transistor TG, transmitted through themetal wiring 52A, and provided to the gate electrode of theamplification transistor 54. Furthermore, when thereset transistor 53 is turned on, charges in theFD 52 are discharged from the source electrode to the drain electrode of thereset transistor 53. - Thus, for the shared pixel transistors (the
reset transistor 53, theamplification transistor 54, and the selection transistor 55), a layout can be adopted in which they are disposed between the eight photodiodes PD of one pixel set 51 and the eight photodiodes PD of another pixel set 51 adjacent in the column direction. Note that although not illustrated, a layout in which the shared pixel transistors are disposed between the eight photodiodes PD and the eight photodiodes PD of the pixel sets 51 adjacent to each other in the row direction may be used. - The present technology is not limited to application to a solid-state imaging device. Specifically, the present technology is applicable to all electronic apparatuses using a solid-state imaging device for an image capturing unit (photoelectric conversion part), such as imaging apparatuses including digital still cameras and video cameras, portable terminal devices having an imaging function, and copying machines using a solid-state imaging device for an image reading unit. The solid-state imaging device may be formed as one chip, or may be in a modular form having an imaging function in which an imaging unit and a signal processing unit or an optical system are packaged together.
-
Fig. 31 is a block diagram illustrating a configuration example of an imaging apparatus as an electronic apparatus to which the present technology is applied. - An
imaging apparatus 200 inFig. 31 includes anoptical unit 201 including a lens group or the like, a solid-state imaging device (imaging device) 202 in which the configuration of the solid-state imaging device 1 inFig. 1 is used, and a digital signal processor (DSP)circuit 203 that is a camera signal processing circuit. Furthermore, theimaging apparatus 200 also includes aframe memory 204, adisplay unit 205, arecording unit 206, anoperation unit 207, and apower supply 208. TheDSP circuit 203, theframe memory 204, thedisplay unit 205, therecording unit 206, theoperation unit 207, and thepower supply 208 are mutually connected via abus line 209. - The
optical unit 201 captures incident light (image light) from a subject, forming an image on an imaging surface of the solid-state imaging device 202. The solid-state imaging device 202 converts the amount of incident light formed as the image on the imaging surface by theoptical unit 201 into an electric signal pixel by pixel and outputs the electric signal as a pixel signal. As the solid-state imaging device 202, the solid-state imaging device 1 inFig. 1 , that is, a solid-state imaging device capable of simultaneously acquiring a signal for generating a high dynamic range image and a signal for detecting a phase difference can be used. - The
display unit 205 includes, for example, a thin display such as a liquid crystal display (LCD) or an organic electroluminescence (EL) display, and displays a moving image or a still image captured by the solid-state imaging device 202. Therecording unit 206 records a moving image or a still image captured by the solid-state imaging device 202 on a recording medium such as a hard disk or a semiconductor memory. - The
operation unit 207 issues operation commands on various functions of theimaging apparatus 200 under user operation. Thepower supply 208 appropriately supplies various power supplies to be operation power supplies for theDSP circuit 203, theframe memory 204, thedisplay unit 205, therecording unit 206, and theoperation unit 207, to them to be supplied with. - As described above, by using the solid-
state imaging device 1 to which the above-described embodiment is applied as the solid-state imaging device 202, it is possible to simultaneously acquire a signal for generating a high dynamic range image and a signal for detecting a phase difference. Therefore, theimaging apparatus 200 such as a video camera or a digital still camera, or further a camera module for a mobile device such as a portable phone can also improve the quality of captured images. -
Fig. 32 is a diagram illustrating an example of use of an image sensor using the above-described solid-state imaging device 1. - The image sensor using the above-described solid-
state imaging device 1 can be used in various cases where light such as visible light, infrared light, ultraviolet light, and X-ray are sensed, for example, as below. - · Devices for capturing images for viewing, such as digital cameras and portable devices with a camera function
- ·Devices for transportation use, such as vehicle-mounted sensors for imaging the front, back, surroundings, interior, etc. of a vehicle, surveillance cameras for monitoring running vehicles and roads, and distance measurement sensors for measuring distance between vehicles or the like, for safe driving such as automatic stopping, recognition of drivers' conditions, and the like
- ·Devices used in household appliances such as TVs, refrigerators, and air conditioners, for imaging user gestures and performing apparatus operations in accordance with the gestures
- ·Devices for medical treatment and healthcare use, such as endoscopes and devices that perform blood vessel imaging through reception of infrared light
- ·Devices for security use, such as surveillance cameras for crime prevention applications and cameras for person authentication applications
- ·Devices for beautification use, such as skin measuring instruments for imaging skin and microscopes for imaging scalp
- ·Devices for sports use, such as action cameras and wearable cameras for sports applications and the like
- ·Devices for agriculture use, such as cameras for monitoring the conditions of fields and crops
- The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure may be applied to an endoscopic surgery system.
-
Fig. 33 is a diagram illustrating an example of a schematic configuration of an endoscopic surgery system to which the technology according to the present disclosure (the present technology) can be applied. -
Fig. 33 illustrates a state in which an operator (doctor) 11131 is performing an operation on apatient 11132 on apatient bed 11133, using anendoscopic surgery system 11000. As illustrated in the figure, theendoscopic surgery system 11000 includes anendoscope 11100, othersurgical instruments 11110 including apneumoperitoneum tube 11111 and anenergy treatment instrument 11112, asupport arm device 11120 that supports theendoscope 11100, and acart 11200 on which various devices for endoscopic surgery are mounted. - The
endoscope 11100 includes alens tube 11101 with a region of a predetermined length from the distal end inserted into the body cavity of thepatient 11132, and acamera head 11102 connected to the proximal end of thelens tube 11101. In the illustrated example, theendoscope 11100 formed as a so-called rigid scope having arigid lens tube 11101 is illustrated, but theendoscope 11100 may be formed as a so-called flexible scope having a flexible lens tube. - An opening in which an objective lens is fitted is provided at the distal end of the
lens tube 11101. Alight source device 11203 is connected to theendoscope 11100. Light generated by thelight source device 11203 is guided to the distal end of thelens tube 11101 through a light guide extended inside thelens tube 11101, and is emitted through the objective lens toward an object to be observed in the body cavity of thepatient 11132. Note that theendoscope 11100 may be a forward-viewing endoscope, an oblique-viewing endoscope, or a side-viewing endoscope. - An optical system and an imaging device are provided inside the
camera head 11102. Light reflected from the object being observed (observation light) is concentrated onto the imaging device by the optical system. The observation light is photoelectrically converted by the imaging device, and an electric signal corresponding to the observation light, that is, an image signal corresponding to an observation image is generated. The image signal is transmitted to a camera control unit (CCU) 11201 as RAW data. - The
CCU 11201 includes a central processing unit (CPU), a graphics processing unit (GPU), or the like, and performs centralized control on the operations of theendoscope 11100 and adisplay device 11202. Moreover, theCCU 11201 receives an image signal from thecamera head 11102, and performs various types of image processing such as development processing (demosaicing) on the image signal for displaying an image based on the image signal. - The
display device 11202 displays an image based on an image signal subjected to image processing by theCCU 11201 under the control of theCCU 11201. - The
light source device 11203 includes a light source such as a light emitting diode (LED), and supplies irradiation light when a surgical site or the like is imaged to theendoscope 11100. - An
input device 11204 is an input interface for theendoscopic surgery system 11000. The user can input various types of information and input instructions to theendoscopic surgery system 11000 via theinput device 11204. For example, the user inputs an instruction to change conditions of imaging by the endoscope 11100 (the type of irradiation light, magnification, focal length, etc.) and the like. - A treatment
instrument control device 11205 controls the drive of theenergy treatment instrument 11112 for tissue ablation, incision, blood vessel sealing, or the like. Apneumoperitoneum device 11206 feeds gas into the body cavity of thepatient 11132 through thepneumoperitoneum tube 11111 to inflate the body cavity for the purpose of providing a field of view by theendoscope 11100 and providing the operator's workspace. Arecorder 11207 is a device that can record various types of information associated with surgery. Aprinter 11208 is a device that can print various types of information associated with surgery in various forms including text, an image, and a graph. - Note that the
light source device 11203 that supplies irradiation light when a surgical site is imaged to theendoscope 11100 may include a white light source including LEDs, laser light sources, or a combination of them, for example. In a case where a white light source includes a combination of RGB laser light sources, the output intensity and output timing of each color (each wavelength) can be controlled with high accuracy. Thus, thelight source device 11203 can adjust the white balance of captured images. Furthermore, in this case, by irradiating an object to be observed with laser light from each of the RGB laser light sources in a time-division manner, and controlling the drive of the imaging device of thecamera head 11102 in synchronization with the irradiation timing, images corresponding one-to-one to RGB can also be imaged in a time-division manner. According to this method, color images can be obtained without providing color filters at the imaging device. - Furthermore, the drive of the
light source device 11203 may be controlled so as to change the intensity of output light every predetermined time. By controlling the drive of the imaging device of thecamera head 11102 in synchronization with the timing of change of the intensity of light and acquiring images in a time-division manner, and combining the images, a high dynamic range image without so-called underexposure and overexposure can be generated. - Furthermore, the
light source device 11203 may be configured to be able to supply light in a predetermined wavelength band suitable for special light observation. In special light observation, for example, so-called narrow band imaging is performed in which predetermined tissue such as a blood vessel in a superficial portion of a mucous membrane is imaged with high contrast by irradiating it with light in a narrower band than irradiation light at the time of normal observation (that is, white light), utilizing the wavelength dependence of light absorption in body tissue. Alternatively, in special light observation, fluorescence observation may be performed in which an image is obtained by fluorescence generated by irradiation with excitation light. Fluorescence observation allows observation of fluorescence from body tissue by irradiating the body tissue with excitation light (autofluorescence observation), acquisition of a fluorescence image by locally injecting a reagent such as indocyanine green (ICG) into body tissue and irradiating the body tissue with excitation light corresponding to the fluorescence wavelength of the reagent, and the like. Thelight source device 11203 can be configured to be able to supply narrowband light and/or excitation light suitable for such special light observation. -
Fig. 34 is a block diagram illustrating an example of a functional configuration of thecamera head 11102 and theCCU 11201 illustrated inFig. 33 . - The
camera head 11102 includes alens unit 11401, animaging unit 11402, adrive unit 11403, acommunication unit 11404, and a camerahead control unit 11405. TheCCU 11201 includes acommunication unit 11411, animage processing unit 11412, and acontrol unit 11413. Thecamera head 11102 and theCCU 11201 are communicably connected to each other by atransmission cable 11400. - The
lens unit 11401 is an optical system provided at a portion connected to thelens tube 11101. Observation light taken in from the distal end of thelens tube 11101 is guided to thecamera head 11102 and enters thelens unit 11401. Thelens unit 11401 includes a combination of a plurality of lenses including a zoom lens and a focus lens. - The
imaging unit 11402 includes an imaging device. Theimaging unit 11402 may include a single imaging device (be of a so-called single plate type), or may include a plurality of imaging devices (be of a so-called multi-plate type). In a case where theimaging unit 11402 is of the multi-plate type, for example, image signals corresponding one-to-one to RGB may be generated by imaging devices, and they may be combined to obtain a color image. Alternatively, theimaging unit 11402 may include a pair of imaging devices for acquiring right-eye and left-eye image signals corresponding to a 3D (dimensional) display, individually. By performing 3D display, theoperator 11131 can more accurately grasp the depth of living tissue at a surgical site. Note that in a case where theimaging unit 11402 is of the multi-plate type, a plurality oflens units 11401 may be provided for the corresponding imaging devices. - Furthermore, the
imaging unit 11402 may not necessarily be provided in thecamera head 11102. For example, theimaging unit 11402 may be provided inside thelens tube 11101 directly behind the objective lens. - The
drive unit 11403 includes an actuator, and moves the zoom lens and the focus lens of thelens unit 11401 by a predetermined distance along the optical axis under the control of the camerahead control unit 11405. With this, the magnification and focus of an image captured by theimaging unit 11402 can be adjusted as appropriate. - The
communication unit 11404 includes a communication device for transmitting and receiving various types of information to and from theCCU 11201. Thecommunication unit 11404 transmits an image signal obtained from theimaging unit 11402 as RAW data to theCCU 11201 via thetransmission cable 11400. - Furthermore, the
communication unit 11404 receives a control signal for controlling the drive of thecamera head 11102 from theCCU 11201, and provides the control signal to the camerahead control unit 11405. The control signal includes, for example, information regarding imaging conditions such as information specifying the frame rate of captured images, information specifying the exposure value at the time of imaging, and/or information specifying the magnification and focus of captured images. - Note that the imaging conditions such as the frame rate, the exposure value, the magnification, and the focus described above may be appropriately specified by the user, or may be automatically set by the
control unit 11413 of theCCU 11201 on the basis of an acquired image signal. In the latter case, so-called an auto exposure (AE) function, an auto focus (AF) function, and an auto white balance (AWB) function are mounted on theendoscope 11100. - The camera
head control unit 11405 controls the drive of thecamera head 11102 on the basis of a control signal from theCCU 11201 received via thecommunication unit 11404. - The
communication unit 11411 includes a communication device for transmitting and receiving various types of information to and from thecamera head 11102. Thecommunication unit 11411 receives an image signal transmitted from thecamera head 11102 via thetransmission cable 11400. - Furthermore, the
communication unit 11411 transmits a control signal for controlling the drive of thecamera head 11102 to thecamera head 11102. The image signal and the control signal can be transmitted by electrical communication, optical communication, or the like. - The
image processing unit 11412 performs various types of image processing on an image signal that is RAW data transmitted from thecamera head 11102. - The
control unit 11413 performs various types of control for imaging of a surgical site or the like by theendoscope 11100 and display of a captured image obtained by imaging of a surgical site or the like. For example, thecontrol unit 11413 generates a control signal for controlling the drive of thecamera head 11102. - Furthermore, the
control unit 11413 causes thedisplay device 11202 to display a captured image showing a surgical site or the like, on the basis of an image signal subjected to image processing by theimage processing unit 11412. At this time, thecontrol unit 11413 may recognize various objects in the captured image using various image recognition techniques. For example, by detecting the shape of the edge, the color, or the like of an object included in a captured image, thecontrol unit 11413 can recognize a surgical instrument such as forceps, a specific living body part, bleeding, mist when theenergy treatment instrument 11112 is used, and so on. When causing thedisplay device 11202 to display a captured image, thecontrol unit 11413 may superimpose various types of surgery support information on an image of the surgical site for display, using the recognition results. By the surgery support information being superimposed and displayed, and presented to theoperator 11131, the load of theoperator 11131 can be reduced, and theoperator 11131 can reliably proceed with the surgery. - The
transmission cable 11400 that connects thecamera head 11102 and theCCU 11201 is an electric signal cable for electric signal communication, an optical fiber for optical communication, or a composite cable for them. - Here, in the illustrated example, communication is performed by wire using the
transmission cable 11400, but communication between thecamera head 11102 and theCCU 11201 may be performed by radio. - An example of the endoscopic surgery system to which the technology according to the present disclosure can be applied has so far been described. The technology according to the present disclosure can be applied to the
imaging unit 11402 in the configuration described above. Specifically, the solid-state imaging device 1 according to the above-described embodiment can be applied as theimaging unit 11402. By applying the technology according to the present disclosure to theimaging unit 11402, it is possible to simultaneously acquire a signal for generating a high dynamic range image and a signal for detecting a phase difference. Consequently, a high-quality captured image and distance information can be acquired, and the degree of safety of the driver and the vehicle can be increased. - Note that although the endoscopic surgery system has been described here as an example, the technology according to the present disclosure may be applied, for example, to a microsurgery system and the like.
- The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure may be implemented as a device mounted on any type of mobile object such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, personal mobility, an airplane, a drone, a ship, and a robot.
-
Fig. 35 is a block diagram illustrating a schematic configuration example of a vehicle control system that is an example of a mobile object control system to which the technology according to the present disclosure can be applied. - A
vehicle control system 12000 includes a plurality of electronic control units connected via acommunication network 12001. In the example illustrated inFig. 35 , thevehicle control system 12000 includes a drivesystem control unit 12010, a bodysystem control unit 12020, a vehicle exteriorinformation detection unit 12030, a vehicle interiorinformation detection unit 12040, and anintegrated control unit 12050. Furthermore, as a functional configuration of theintegrated control unit 12050, amicrocomputer 12051, a sound/image output unit 12052, and an in-vehicle network interface (I/F) 12053 are illustrated. - The drive
system control unit 12010 controls the operation of apparatuses related to the drive system of the vehicle, according to various programs. For example, the drivesystem control unit 12010 functions as a control device for a driving force generation apparatus for generating a driving force of the vehicle such as an internal combustion engine or a drive motor, a driving force transmission mechanism for transmitting the driving force to wheels, a steering mechanism for adjusting the steering angle of the vehicle, a braking device for generating a vehicle braking force, and others. - The body
system control unit 12020 controls the operation of various apparatuses mounted on the vehicle body, according to various programs. For example, the bodysystem control unit 12020 functions as a control device for a keyless entry system, a smart key system, power window devices, or various lamps including headlamps, back lamps, brake lamps, indicators, and fog lamps. In this case, the bodysystem control unit 12020 can receive the input of radio waves transmitted from a portable device that substitutes for a key or signals from various switches. The bodysystem control unit 12020 receives the input of these radio waves or signals, and controls door lock devices, the power window devices, the lamps, and others of the vehicle. - The vehicle exterior
information detection unit 12030 detects information regarding the exterior of the vehicle equipped with thevehicle control system 12000. For example, animaging unit 12031 is connected to the vehicle exteriorinformation detection unit 12030. The vehicle exteriorinformation detection unit 12030 causes theimaging unit 12031 to capture an image outside the vehicle and receives the captured image. The vehicle exteriorinformation detection unit 12030 may perform object detection processing or distance detection processing on a person, a vehicle, an obstacle, a sign, characters on a road surface, or the like, on the basis of the received image. - The
imaging unit 12031 is an optical sensor that receives light and outputs an electric signal corresponding to the amount of the received light. Theimaging unit 12031 may output an electric signal as an image, or may output it as distance measurement information. Furthermore, light received by theimaging unit 12031 may be visible light, or may be invisible light such as infrared rays. - The vehicle interior
information detection unit 12040 detects information of the vehicle interior. For example, a drivercondition detection unit 12041 that detects a driver's conditions is connected to the vehicle interiorinformation detection unit 12040. The drivercondition detection unit 12041 includes, for example, a camera that images the driver. The vehicle interiorinformation detection unit 12040 may calculate the degree of fatigue or the degree of concentration of the driver, or may determine whether the driver is dozing, on the basis of detected information input from the drivercondition detection unit 12041. - The
microcomputer 12051 can calculate a control target value for the driving force generation apparatus, the steering mechanism, or the braking device on the basis of vehicle interior or exterior information acquired by the vehicle exteriorinformation detection unit 12030 or the vehicle interiorinformation detection unit 12040, and output a control command to the drivesystem control unit 12010. For example, themicrocomputer 12051 can perform cooperative control for the purpose of implementing the functions of an advanced driver assistance system (ADAS) including vehicle collision avoidance or impact mitigation, following driving based on inter-vehicle distance, vehicle speed-maintaining driving, vehicle collision warning, vehicle lane departure warning, and so on. - Furthermore, the
microcomputer 12051 can perform cooperative control for the purpose of automatic driving for autonomous travelling without a driver's operation, by controlling the driving force generation apparatus, the steering mechanism, the braking device, or others, on the basis of information around the vehicle acquired by the vehicle exteriorinformation detection unit 12030 or the vehicle interiorinformation detection unit 12040. - Moreover, the
microcomputer 12051 can output a control command to the bodysystem control unit 12020 on the basis of vehicle exterior information acquired by the vehicle exteriorinformation detection unit 12030. For example, themicrocomputer 12051 can perform cooperative control for the purpose of preventing glare by controlling the headlamps according to the position of a preceding vehicle or an oncoming vehicle detected by the vehicle exteriorinformation detection unit 12030, switching high beam to low beam, or the like. - The sound/
image output unit 12052 transmits an output signal of at least one of a sound or an image to an output device that can visually or auditorily notify a vehicle occupant or the outside of the vehicle of information. In the example ofFig. 35 , as the output device, anaudio speaker 12061, adisplay unit 12062, and aninstrument panel 12063 are illustrated. Thedisplay unit 12062 may include at least one of an on-board display or a head-up display, for example. -
Fig. 36 is a diagram illustrating an example of the installation position of theimaging unit 12031. - In
Fig. 36 , avehicle 12100 includesimaging units imaging unit 12031. - The
imaging units vehicle 12100. Theimaging unit 12101 provided at the front nose and theimaging unit 12105 provided at the upper portion of the windshield in the vehicle compartment mainly acquire images of the front of thevehicle 12100. Theimaging units vehicle 12100. Theimaging unit 12104 provided at the rear bumper or the back door mainly acquires images of the rear of thevehicle 12100. Front images acquired by theimaging units - Note that
Fig. 36 illustrates an example of imaging ranges of theimaging units 12101 to 12104. Animaging range 12111 indicates the imaging range of theimaging unit 12101 provided at the front nose, imaging ranges 12112 and 12113 indicate the imaging ranges of theimaging units imaging range 12114 indicates the imaging range of theimaging unit 12104 provided at the rear bumper or the back door. For example, by superimposing image data captured by theimaging units 12101 to 12104 on each other, an overhead image of thevehicle 12100 viewed from above is obtained. - At least one of the
imaging units 12101 to 12104 may have a function of acquiring distance information. For example, at least one of theimaging units 12101 to 12104 may be a stereo camera including a plurality of imaging devices, or may be an imaging device including pixels for phase difference detection. - For example, the
microcomputer 12051 can determine distances to three-dimensional objects in the imaging ranges 12111 to 12114, and temporal changes in the distances (relative speeds to the vehicle 12100), on the basis of distance information obtained from theimaging units 12101 to 12104, thereby extracting, as a preceding vehicle, especially the nearest three-dimensional object located on the traveling path of thevehicle 12100 which is a three-dimensional object traveling at a predetermined speed (e.g., 0 km/h or higher) in substantially the same direction as thevehicle 12100. Furthermore, themicrocomputer 12051 can perform automatic brake control (including following stop control), automatic acceleration control (including following start control), and the like, setting an inter-vehicle distance to be provided in advance in front of a preceding vehicle. Thus, cooperative control for the purpose of autonomous driving for autonomous traveling without a driver's operation or the like can be performed. - For example, the
microcomputer 12051 can extract three-dimensional object data regarding three-dimensional objects, classifying them into a two-wheel vehicle, an ordinary vehicle, a large vehicle, a pedestrian, and another three-dimensional object such as a power pole, on the basis of distance information obtained from theimaging units 12101 to 12104, for use in automatic avoidance of obstacles. For example, for obstacles around thevehicle 12100, themicrocomputer 12051 distinguishes between obstacles that can be visually identified by the driver of thevehicle 12100 and obstacles that are difficult to visually identify. Then, themicrocomputer 12051 determines a collision risk indicating the degree of danger of collision with each obstacle. In a situation where the collision risk is equal to or higher than a set value and there is a possibility of collision, themicrocomputer 12051 can perform driving assistance for collision avoidance by outputting a warning to the driver via theaudio speaker 12061 or thedisplay unit 12062, or performing forced deceleration or avoidance steering via the drivesystem control unit 12010. - At least one of the
imaging units 12101 to 12104 may be an infrared camera that detects infrared rays. For example, themicrocomputer 12051 can recognize a pedestrian by determining whether or not a pedestrian is present in captured images of theimaging units 12101 to 12104. The recognition of a pedestrian is performed, for example, by a procedure of extracting feature points in captured images of theimaging units 12101 to 12104 as infrared cameras, and a procedure of performing pattern matching on a series of feature points indicating the outline of an object to determine whether or not the object is a pedestrian. When themicrocomputer 12051 determines that a pedestrian is present in captured images of theimaging units 12101 to 12104 and recognizes the pedestrian, the sound/image output unit 12052 controls thedisplay unit 12062 to superimpose and display a rectangular outline for enhancement on the recognized pedestrian. Alternatively, the sound/image output unit 12052 may control thedisplay unit 12062 so as to display an icon or the like indicating the pedestrian at a desired position. - An example of the vehicle control system to which the technology according to the present disclosure can be applied has so far been described. The technology according to the present disclosure can be applied to the
imaging unit 12031 in the configuration described above. Specifically, the solid-state imaging device 1 according to the above-described embodiment can be applied as theimaging unit 12031. By applying the technology according to the present disclosure to theimaging unit 12031, a signal for generating a high dynamic range image and a signal for detecting a phase difference can be acquired simultaneously. Consequently, a high-quality captured image and distance information can be acquired, and the degree of safety of the driver and the vehicle can be increased. - In the above-described examples, the solid-state imaging device that uses electrons as signal charges with the first conductivity type as P-type and the second conductivity type as N-type has been described. The present technology is also applicable to a solid-state imaging device that uses holes as signal charges. That is, with the first conductivity type as N-type and the second conductivity type as P-type, each semiconductor region described above can be formed by a semiconductor region of the opposite conductivity type.
- Embodiments of the present technology are not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present technology.
- For example, a form combining all of or part of the embodiments described above can be used.
- It should be noted that the effects described in the present description are merely examples and not limiting. Effects other than those described in the present description may be included.
- Note that the present technology can also take the following configurations.
- (1) A solid-state imaging device including:
a plurality of pixel sets each including color filters of the same color, for a plurality of colors, each pixel set including a plurality of pixels, each pixel including a plurality of photoelectric conversion parts. - (2) The solid-state imaging device according to (1) described above, in which
- each pixel includes two photoelectric conversion parts disposed symmetrically in a vertical direction or a horizontal direction, and
- orientations of the photoelectric conversion parts of the pixels are the same direction at least in each individual pixel set.
- (3) The solid-state imaging device according to (2) described above, in which
the orientations of the photoelectric conversion parts of the pixels are the same direction in all the pixel sets. - (4) The solid-state imaging device according to (1) described above, in which
- each pixel includes two photoelectric conversion parts disposed symmetrically in a vertical direction or a horizontal direction, and
- orientations of the photoelectric conversion parts of two of the pixels arranged in the horizontal direction in each pixel set are the same direction.
- (5) The solid-state imaging device according to (1) described above, in which
- each pixel includes two photoelectric conversion parts disposed symmetrically in a vertical direction or a horizontal direction, and
- orientations of the photoelectric conversion parts of two of the pixels arranged in the horizontal direction in each pixel set are orthogonal directions.
- (6) The solid-state imaging device according to any one of (1) to (5) described above, in which
the plurality of photoelectric conversion parts of each pixel is isolated from each other by an insulating layer. - (7) The solid-state imaging device according to any one of (1) to (5) described above, in which
the plurality of photoelectric conversion parts of each pixel is isolated from each other by an impurity layer of a conductivity type opposite to a conductivity type of the photoelectric conversion parts. - (8) The solid-state imaging device according to (7) described above, in which
the impurity layer forms a potential barrier lower than a potential barrier at pixel boundaries. - (9) The solid-state imaging device according to any one of (1) to (8) described above, in which
a light-shielding film is formed at some of the plurality of pixel sets, the light-shielding film partly shielding all the pixels in each pixel set from light. - (10) The solid-state imaging device according to any one of (1) to (8) described above, in which
a light-shielding film is formed at some of the plurality of pixel sets, the light-shielding film entirely shielding some of the pixels in each pixel set from light. - (11) The solid-state imaging device according to any one of (1) to (10) described above, further including:
- a charge holding part that holds charges generated in the photoelectric conversion parts,
- the charge holding part adding and outputting charges generated in the photoelectric conversion parts of the plurality of pixels.
- (12) The solid-state imaging device according to (11) described above, in which
the charge holding part adds and outputs charges generated in the photoelectric conversion parts of all the pixels in each pixel set. - (13) The solid-state imaging device according to (11) described above, in which
the charge holding part adds and outputs charges in the photoelectric conversion parts whose positions in the pixels are the same position, of the photoelectric conversion parts of the plurality of pixels included in each pixel set. - (14) The solid-state imaging device according to any one of (1) to (13) described above, in which
of the photoelectric conversion parts of the plurality of pixels included in each pixel set, a first photoelectric conversion part and a second photoelectric conversion part are exposed for different exposure times. - (15) The solid-state imaging device according to (14) described above, further including:
- a control unit that performs control to output charges of light received by each photoelectric conversion part as a pixel signal,
- the control unit outputting a first pixel signal of the first photoelectric conversion part exposed for a first exposure time, and outputting a second pixel signal of the second photoelectric conversion part exposed for a second exposure time.
- (16) The solid-state imaging device according to any one of (1) to (15) described above, in which
pixel signals generated in the plurality of photoelectric conversion parts of at least some of the plurality of pixels included in each pixel set are output separately. - (17) The solid-state imaging device according to any one of (1) to (16) described above, in which
of the plurality of pixels included in each pixel set, the photoelectric conversion parts of a first pixel are exposed for a first exposure time, the photoelectric conversion parts of a second pixel are exposed for a second exposure time shorter than the first exposure time, and pixel signals generated in the plurality of photoelectric conversion parts of the second pixel exposed for the second exposure time are output separately. - (18) The solid-state imaging device according to any one of (1) to (16) described above, in which
of the plurality of pixels included in each pixel set, the photoelectric conversion parts of a first pixel are exposed for a first exposure time, the photoelectric conversion parts of a second pixel are exposed for a second exposure time shorter than the first exposure time, the photoelectric conversion parts of a third pixel are exposed for a third exposure time shorter than the second exposure time, and pixel signals generated in the plurality of photoelectric conversion parts of the second pixel exposed for the second exposure time are output separately. - (19) The solid-state imaging device according to any one of (1) to (18) described above, in which
the color filters in the pixel sets are arranged in a Bayer array. - (20) An electronic apparatus including:
- a solid-state imaging device including
- a plurality of pixel sets each including color filters of the same color, for a plurality of colors, each pixel set including a plurality of pixels, each pixel including a plurality of photoelectric conversion parts.
-
- 1
- Solid-state imaging device
- 2
- Pixel
- PD
- Photodiode
- TG
- Transfer transistor
- 3
- Pixel array
- 5
- Column signal processing circuit
- 12
- Semiconductor substrate
- 31, 32
- Semiconductor region
- 36
- Inter-pixel light-shielding film
- 37
- Color filter
- 38
- On-chip lens
- 51 (51Gr, 51Gb, 51R, 51B)
- Pixel set
- 91
- On-chip lens
- 101
- Insulating layer
- 102
- Impurity layer
- 121
- Light-shielding film
- 200
- Imaging apparatus
- 202
- Solid-state imaging device
Claims (13)
- A pixel array circuit comprising:first, second, third, and fourth pixel sets arranged in a 2x2 matrix in a plan view, each of the first, second, third and fourth pixel sets including four pixels, each of the pixels including two photoelectric conversion parts, whereinthe first and fourth pixel sets are configured to produce pixel signals corresponding to light in a first range of wavelengths,the second pixel set is configured to produce pixel signals corresponding to light in a second range of wavelengths different than the first range of wavelengths,the third pixel set is configured to produce pixel signals corresponding to light in a third range of wavelengths different than the first and second range of wavelengths,each of the photoelectric conversion parts of the four pixels in the first pixel set are arranged in a first orientation,each of the photoelectric conversion parts of the four pixels in the second pixel set are arranged in a second orientation perpendicular to the first orientation,each of the photoelectric conversion parts of the four pixels in the third pixel set are arranged in the second orientation, and each of the photoelectric conversion parts of the four pixels in the fourth pixel set are arranged in the first orientation.
- The pixel array circuit according to claim 1, wherein the first range of wavelengths corresponds to a green color, the second range of wavelengths corresponds to a red color, and the third range of wavelengths corresponds to a blue color.
- The pixel array circuit according to claim 1, wherein the photoelectric conversion parts are photodiodes.
- The pixel array circuit according to claim 1, wherein the photoelectric conversion parts have a shape with a major axis, the major axis of the photoelectric conversion parts in the first orientation extending in a first direction, and the major axis of the photoelectric conversion parts in the second orientation extending in a second direction perpendicular to the first direction.
- The pixel array circuit according to claim 1, wherein the first and fourth pixel sets respectively include a first color filter to produce a first color corresponding to the first range of wavelengths, the second pixel set includes a second color filter to produce a second color corresponding to the second range of wavelengths, and the third pixel set includes a third color filter to produce a third color corresponding to the third range of pixel wavelengths.
- The pixel array circuit according to claim 1, wherein the photoelectric conversion parts are isolated from each other by an insulating layer.
- The pixel array circuit according to claim 1, further comprising:
a charge holding part that holds charges generated in the photoelectric conversion parts, the charge holding part adding and outputting charges generated in the photoelectric conversion parts. - The pixel array circuit according to claim 7, wherein the charge holding part adds and outputs charges generated in the photoelectric conversion parts of all the pixels in each pixel set.
- An imaging device comprising:
the pixel array circuit according to any one of the preceding claims. - An electronic apparatus comprising:a pixel array; andat least one control circuit configured to drive the pixel array, the pixel array including first, second, third, and fourth pixel sets arranged in a 2x2 matrix in a plan view, each of the first, second, third and fourth pixel sets including four pixels, each of the pixels including two photoelectric conversion parts, whereinthe first and fourth pixel sets are configured to produce pixel signals corresponding to light in a first range of wavelengths,the second pixel set is configured to produce pixel signals corresponding to light in a second range of wavelengths different than the first range of wavelengths,the third pixel set is configured to produce pixel signals corresponding to light in a third range of wavelengths different than the first and second range of wavelengths,each of the photoelectric conversion parts of the four pixels in the first pixel set are arranged in a first orientation,each of the photoelectric conversion parts of the four pixels in the second pixel set are arranged in a second orientation perpendicular to the first orientation,each of the photoelectric conversion parts of the four pixels in the third pixel set are arranged in the second orientation, andeach of the photoelectric conversion parts of the four pixels in the fourth pixel set are arranged in the first orientation.
- The electronic apparatus according to claim 10, wherein the first range of wavelengths corresponds to a green color, the second range of wavelengths corresponds to a red color, and the third range of wavelengths corresponds to a blue color.
- The electronic apparatus according to claim 10, wherein the photoelectric conversion parts are photodiodes.
- The electronic apparatus according to claim 10, wherein the photoelectric conversion parts have a shape with a major axis, the major axis of the photoelectric conversion parts in the first orientation extending in a first direction, and the major axis of the photoelectric conversion parts in the second orientation extending in a second direction perpendicular to the first direction.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017224138 | 2017-11-22 | ||
PCT/JP2018/041820 WO2019102887A1 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging element and electronic device |
EP18880107.0A EP3716618B1 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging element and electronic device |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18880107.0A Division-Into EP3716618B1 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging element and electronic device |
EP18880107.0A Division EP3716618B1 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging element and electronic device |
Publications (1)
Publication Number | Publication Date |
---|---|
EP4199530A1 true EP4199530A1 (en) | 2023-06-21 |
Family
ID=66631899
Family Applications (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP23183088.6A Pending EP4243436A3 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging element and electronic device |
EP23156685.2A Pending EP4203045A1 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging device and electronic apparatus |
EP23156683.7A Pending EP4199530A1 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging device and electronic apparatus |
EP22179064.5A Pending EP4080880A1 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging device and electronic apparatus |
EP18880107.0A Active EP3716618B1 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging element and electronic device |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP23183088.6A Pending EP4243436A3 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging element and electronic device |
EP23156685.2A Pending EP4203045A1 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging device and electronic apparatus |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP22179064.5A Pending EP4080880A1 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging device and electronic apparatus |
EP18880107.0A Active EP3716618B1 (en) | 2017-11-22 | 2018-11-12 | Solid-state imaging element and electronic device |
Country Status (6)
Country | Link |
---|---|
US (6) | US11258993B2 (en) |
EP (5) | EP4243436A3 (en) |
JP (2) | JP7199371B2 (en) |
KR (4) | KR20230028577A (en) |
CN (4) | CN115720298A (en) |
WO (1) | WO2019102887A1 (en) |
Families Citing this family (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2019012968A (en) | 2017-06-30 | 2019-01-24 | ソニーセミコンダクタソリューションズ株式会社 | Solid-state imaging device and electronic device |
JP2019140528A (en) * | 2018-02-09 | 2019-08-22 | ソニーセミコンダクタソリューションズ株式会社 | Imaging apparatus and electronic apparatus |
US11019294B2 (en) | 2018-07-18 | 2021-05-25 | Apple Inc. | Seamless readout mode transitions in image sensors |
US10998365B2 (en) * | 2019-01-30 | 2021-05-04 | Samsung Electronics Co., Ltd. | Image sensor |
WO2021124964A1 (en) * | 2019-12-17 | 2021-06-24 | ソニーセミコンダクタソリューションズ株式会社 | Imaging element, imaging element drive method, and electronic apparatus |
KR20210087809A (en) * | 2020-01-03 | 2021-07-13 | 삼성전자주식회사 | Electronic device comprising image sensor and method of operation thereof |
WO2021145095A1 (en) * | 2020-01-16 | 2021-07-22 | ソニーグループ株式会社 | Imaging device and defocus amount calculation method |
KR102354298B1 (en) * | 2020-05-27 | 2022-01-24 | 주식회사 덱셀리온 | Camera system with complementary pixlet structure in quard bayer coding pattern and operation method thereof |
US11563910B2 (en) * | 2020-08-04 | 2023-01-24 | Apple Inc. | Image capture devices having phase detection auto-focus pixels |
JP2022044285A (en) * | 2020-09-07 | 2022-03-17 | オリンパス株式会社 | Detection device and detection method |
DE112021004185T5 (en) | 2020-10-14 | 2023-06-29 | Hitachi Astemo, Ltd. | VEHICLE MOUNTED CAMERA DEVICE |
CN112616013B (en) * | 2020-12-03 | 2022-03-04 | 上海龙旗科技股份有限公司 | Method and apparatus for implementing automatic HDR |
CN116648923A (en) * | 2020-12-16 | 2023-08-25 | 索尼半导体解决方案公司 | Image forming apparatus |
JP2022107563A (en) * | 2021-01-11 | 2022-07-22 | ソニーセミコンダクタソリューションズ株式会社 | Image capturing device, pixel-signal processing method for image capturing device, and image capturing system |
US11546532B1 (en) | 2021-03-16 | 2023-01-03 | Apple Inc. | Dynamic correlated double sampling for noise rejection in image sensors |
JP2022156633A (en) * | 2021-03-31 | 2022-10-14 | ソニーセミコンダクタソリューションズ株式会社 | Imaging element and imaging device |
KR20220139740A (en) | 2021-04-08 | 2022-10-17 | 삼성전자주식회사 | Image sensor including auto-focus pixel |
KR20220144014A (en) * | 2021-04-16 | 2022-10-26 | 삼성전자주식회사 | Camera module and operating method of camera module |
KR20220147448A (en) * | 2021-04-27 | 2022-11-03 | 삼성전자주식회사 | Image sensor including color separating lens array and electronic apparatus including the image sensor |
KR20220156332A (en) | 2021-05-18 | 2022-11-25 | 삼성전자주식회사 | Image sensor including auto-focus pixel |
US20220384513A1 (en) * | 2021-05-31 | 2022-12-01 | Samsung Electronics Co., Ltd. | Image sensor |
JPWO2023021871A1 (en) * | 2021-08-18 | 2023-02-23 | ||
US20230171491A1 (en) * | 2021-11-26 | 2023-06-01 | Samsung Electronics Co., Ltd. | Image sensor and autofocusing method of the same |
WO2024024464A1 (en) * | 2022-07-25 | 2024-02-01 | ソニーセミコンダクタソリューションズ株式会社 | Solid-state imaging element, and electronic device |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150312461A1 (en) * | 2014-04-28 | 2015-10-29 | Tae Chan Kim | Image sensor including a pixel having photoelectric conversion elements and image processing device having the image sensor |
US20150350583A1 (en) * | 2014-06-03 | 2015-12-03 | Semiconductor Components Industries, Llc | Imaging systems having image sensor pixel arrays with sub-pixel resolution capabilities |
JP2016171308A (en) | 2015-03-11 | 2016-09-23 | キヤノン株式会社 | Solid-state imaging element, and imaging apparatus including the same |
WO2016203974A1 (en) * | 2015-06-15 | 2016-12-22 | ソニー株式会社 | Image sensor and electronic device |
Family Cites Families (40)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007065330A (en) * | 2005-08-31 | 2007-03-15 | Canon Inc | Camera |
JP4710660B2 (en) * | 2006-03-10 | 2011-06-29 | 株式会社ニコン | Solid-state imaging device and electronic camera using the same |
JP5034840B2 (en) * | 2007-10-01 | 2012-09-26 | 株式会社ニコン | Solid-state imaging device and electronic camera using the same |
US7940311B2 (en) * | 2007-10-03 | 2011-05-10 | Nokia Corporation | Multi-exposure pattern for enhancing dynamic range of images |
JP5262180B2 (en) * | 2008-02-26 | 2013-08-14 | ソニー株式会社 | Solid-state imaging device and camera |
FR2955701A1 (en) * | 2010-01-28 | 2011-07-29 | St Microelectronics Sa | COMPACT IMAGE SENSOR STRUCTURE |
JP5585232B2 (en) * | 2010-06-18 | 2014-09-10 | ソニー株式会社 | Solid-state imaging device, electronic equipment |
JP2012182332A (en) * | 2011-03-02 | 2012-09-20 | Sony Corp | Imaging element and imaging device |
JP5967950B2 (en) * | 2011-04-20 | 2016-08-10 | キヤノン株式会社 | Imaging device and imaging apparatus |
JP6003291B2 (en) * | 2011-08-22 | 2016-10-05 | ソニー株式会社 | Solid-state imaging device and electronic apparatus |
JP5995416B2 (en) * | 2011-08-24 | 2016-09-21 | キヤノン株式会社 | Imaging device and imaging apparatus |
JP2013066146A (en) * | 2011-08-31 | 2013-04-11 | Sony Corp | Image processing device, image processing method, and program |
JP5935274B2 (en) * | 2011-09-22 | 2016-06-15 | ソニー株式会社 | Solid-state imaging device, control method for solid-state imaging device, and control program for solid-state imaging device |
CN103828354B (en) * | 2011-09-26 | 2016-01-06 | 富士胶片株式会社 | Color image pickup apparatus |
JP2013084744A (en) * | 2011-10-07 | 2013-05-09 | Sony Corp | Solid-state imaging element and electronic equipment |
JP5970834B2 (en) * | 2012-02-02 | 2016-08-17 | ソニー株式会社 | Solid-state imaging device, method for manufacturing solid-state imaging device, and electronic apparatus |
JP2013172210A (en) * | 2012-02-17 | 2013-09-02 | Canon Inc | Imaging device |
JP6149369B2 (en) * | 2012-09-27 | 2017-06-21 | 株式会社ニコン | Image sensor |
JP2014107596A (en) * | 2012-11-22 | 2014-06-09 | Nikon Corp | Imaging element and imaging unit |
JP2014175832A (en) * | 2013-03-08 | 2014-09-22 | Toshiba Corp | Solid state image pickup device |
JP6289017B2 (en) * | 2013-03-27 | 2018-03-07 | キヤノン株式会社 | Imaging apparatus, control method therefor, program, and storage medium |
JP2015012127A (en) * | 2013-06-28 | 2015-01-19 | ソニー株式会社 | Solid state image sensor and electronic apparatus |
JP6233188B2 (en) * | 2013-12-12 | 2017-11-22 | ソニー株式会社 | Solid-state imaging device, manufacturing method thereof, and electronic device |
JP6075646B2 (en) * | 2014-03-17 | 2017-02-08 | ソニー株式会社 | Solid-state imaging device, driving method thereof, and electronic apparatus |
JP6408372B2 (en) * | 2014-03-31 | 2018-10-17 | ソニーセミコンダクタソリューションズ株式会社 | SOLID-STATE IMAGING DEVICE, ITS DRIVE CONTROL METHOD, AND ELECTRONIC DEVICE |
JP6246076B2 (en) * | 2014-06-05 | 2017-12-13 | ルネサスエレクトロニクス株式会社 | Semiconductor device manufacturing method and semiconductor device |
JP2016015430A (en) | 2014-07-03 | 2016-01-28 | ソニー株式会社 | Solid-state image sensor and electronic apparatus |
JP6369233B2 (en) * | 2014-09-01 | 2018-08-08 | ソニー株式会社 | Solid-state imaging device, signal processing method thereof, and electronic device |
US9332200B1 (en) * | 2014-12-05 | 2016-05-03 | Qualcomm Incorporated | Pixel readout architecture for full well capacity extension |
JP6579756B2 (en) * | 2015-02-10 | 2019-09-25 | キヤノン株式会社 | Solid-state imaging device and imaging apparatus using the same |
CN107211101A (en) * | 2015-02-12 | 2017-09-26 | 索尼公司 | Imaging device and its control method and electronic installation |
US10264197B2 (en) * | 2015-02-13 | 2019-04-16 | Sony Semiconductor Solutions Corporation | Imaging device, driving method, and electronic apparatus |
KR102390836B1 (en) * | 2015-10-05 | 2022-04-26 | 삼성전자주식회사 | Electronic device and method for generating an image data |
KR102541701B1 (en) * | 2016-01-15 | 2023-06-13 | 삼성전자주식회사 | CMOS Image Sensor |
JP6885344B2 (en) | 2016-01-20 | 2021-06-16 | ソニーグループ株式会社 | Solid-state image sensor, its driving method, and electronic devices |
US9893111B2 (en) * | 2016-04-13 | 2018-02-13 | Taiwan Semiconductor Manufacturing Co., Ltd. | Full-PDAF (phase detection autofocus) CMOS image sensor structures |
JP6750852B2 (en) * | 2016-05-11 | 2020-09-02 | キヤノン株式会社 | Imaging device and method for controlling imaging device |
US9883128B2 (en) * | 2016-05-20 | 2018-01-30 | Semiconductor Components Industries, Llc | Imaging systems with high dynamic range and phase detection pixels |
JP6762766B2 (en) * | 2016-06-01 | 2020-09-30 | キヤノン株式会社 | Image sensor, image sensor, and image signal processing method |
KR102354991B1 (en) | 2017-05-24 | 2022-01-24 | 삼성전자주식회사 | Pixel circuit and image sensor including thereof |
-
2018
- 2018-11-12 CN CN202211345588.5A patent/CN115720298A/en active Pending
- 2018-11-12 KR KR1020237005262A patent/KR20230028577A/en not_active Application Discontinuation
- 2018-11-12 US US16/764,474 patent/US11258993B2/en active Active
- 2018-11-12 KR KR1020207013115A patent/KR102423990B1/en active IP Right Grant
- 2018-11-12 EP EP23183088.6A patent/EP4243436A3/en active Pending
- 2018-11-12 EP EP23156685.2A patent/EP4203045A1/en active Pending
- 2018-11-12 EP EP23156683.7A patent/EP4199530A1/en active Pending
- 2018-11-12 WO PCT/JP2018/041820 patent/WO2019102887A1/en unknown
- 2018-11-12 EP EP22179064.5A patent/EP4080880A1/en active Pending
- 2018-11-12 JP JP2019555261A patent/JP7199371B2/en active Active
- 2018-11-12 KR KR1020227038241A patent/KR102501604B1/en active IP Right Grant
- 2018-11-12 KR KR1020227022892A patent/KR102481007B1/en active IP Right Grant
- 2018-11-12 EP EP18880107.0A patent/EP3716618B1/en active Active
- 2018-11-12 CN CN202210633585.5A patent/CN115037888B/en active Active
- 2018-11-12 CN CN201880074140.XA patent/CN111373745B/en active Active
- 2018-11-12 CN CN202211403402.7A patent/CN115767293B/en active Active
-
2021
- 2021-09-09 US US17/470,481 patent/US11483526B2/en active Active
-
2022
- 2022-01-27 US US17/586,230 patent/US11563923B2/en active Active
- 2022-11-04 JP JP2022177150A patent/JP7439214B2/en active Active
- 2022-11-30 US US18/072,252 patent/US11877074B2/en active Active
- 2022-11-30 US US18/072,266 patent/US11936994B2/en active Active
-
2023
- 2023-07-21 US US18/356,469 patent/US12022209B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150312461A1 (en) * | 2014-04-28 | 2015-10-29 | Tae Chan Kim | Image sensor including a pixel having photoelectric conversion elements and image processing device having the image sensor |
US20150350583A1 (en) * | 2014-06-03 | 2015-12-03 | Semiconductor Components Industries, Llc | Imaging systems having image sensor pixel arrays with sub-pixel resolution capabilities |
JP2016171308A (en) | 2015-03-11 | 2016-09-23 | キヤノン株式会社 | Solid-state imaging element, and imaging apparatus including the same |
WO2016203974A1 (en) * | 2015-06-15 | 2016-12-22 | ソニー株式会社 | Image sensor and electronic device |
US20180184036A1 (en) * | 2015-06-15 | 2018-06-28 | Sony Corporation | Image sensor and electronic device |
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3716618B1 (en) | Solid-state imaging element and electronic device | |
EP3509106A1 (en) | Solid-state imaging device and manufacturing method therefor, and electronic apparatus | |
JPWO2017150167A1 (en) | Solid-state image sensor | |
EP3833015A1 (en) | Solid-state imaging device | |
US11756971B2 (en) | Solid-state imaging element and imaging apparatus | |
WO2021002213A1 (en) | Solid-state imaging device, operation method for same, and electronic apparatus | |
US20230025911A1 (en) | Imaging device and electronic device | |
JP7316340B2 (en) | Solid-state imaging device and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20230215 |
|
AC | Divisional application: reference to earlier application |
Ref document number: 3716618 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20240320 |
|
GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
INTC | Intention to grant announced (deleted) | ||
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |