WO2021174529A1 - 图像传感器、成像装置、电子设备、图像处理***及信号处理方法 - Google Patents

图像传感器、成像装置、电子设备、图像处理***及信号处理方法 Download PDF

Info

Publication number
WO2021174529A1
WO2021174529A1 PCT/CN2020/078212 CN2020078212W WO2021174529A1 WO 2021174529 A1 WO2021174529 A1 WO 2021174529A1 CN 2020078212 W CN2020078212 W CN 2020078212W WO 2021174529 A1 WO2021174529 A1 WO 2021174529A1
Authority
WO
WIPO (PCT)
Prior art keywords
filter
color
signal
pixel
filters
Prior art date
Application number
PCT/CN2020/078212
Other languages
English (en)
French (fr)
Inventor
沼田肇
青山千秋
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Priority to CN202080098201.3A priority Critical patent/CN115280766B/zh
Priority to PCT/CN2020/078212 priority patent/WO2021174529A1/zh
Priority to EP20923253.7A priority patent/EP4117282A4/en
Publication of WO2021174529A1 publication Critical patent/WO2021174529A1/zh
Priority to US17/903,872 priority patent/US20230007191A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4015—Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/843—Demosaicing, e.g. interpolating colour pixel values
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/88—Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/46—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by combining or binning pixels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/77—Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase
    • H04N9/78—Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase for separating the brightness signal or the chrominance signal from the colour television signal, e.g. using comb filter

Definitions

  • This application relates to the field of imaging technology, and in particular to an image sensor, imaging device, electronic equipment, image processing system, and signal processing method.
  • An image sensor is provided in the camera.
  • the image sensor In order to realize the collection of color images, the image sensor is usually provided with a filter array arranged in the form of a Bayer array, so that multiple pixels in the image sensor can receive light passing through the corresponding filter, thereby Generate pixel signals with different color channels.
  • the image sensor has poor photosensitivity in a low-light environment, making it difficult to obtain images with higher definition.
  • the embodiments of the present application provide an image sensor, an imaging device, an electronic device, an image processing system, and a signal processing method.
  • the image sensor of the embodiment of the present application includes a filter array, a pixel array, and a processing circuit.
  • the filter array includes a plurality of filter regions, each of the filter regions includes a plurality of filter units, and each of the filter units includes at least one first color filter, at least one The second color filter and at least one third color filter.
  • the pixel array includes a plurality of pixels, each of the pixels corresponds to a filter of the filter array, and the pixel is used to receive light passing through the corresponding filter to generate an electrical signal.
  • the processing circuit is disposed on a substrate with the pixel array, and the processing circuit is used to combine and output the electrical signals generated by the pixels corresponding to each of the filter units as a combined brightness value and form a first intermediate For an image, the combined brightness value is used to characterize the brightness of the light acting on the pixel corresponding to the filter unit.
  • the processing circuit is also used to generate a first color signal, a second color signal, and a third color signal according to the electrical signal generated by the pixel corresponding to each filter area, and the first color signal is used to characterize the effect on
  • the filter area corresponds to the value of the first color channel of the light of the pixel
  • the second color signal is used to characterize the value of the second color channel of the light acting on the pixel corresponding to the filter area.
  • the three-color signal is used to characterize the value of the third color channel of the light acting on the pixel corresponding to the filter area; the processing circuit is also used to process the first color signal, the second color signal, and the The third color signal is used to obtain a plurality of second intermediate images used to characterize the color value of the filter area, and used to fuse the first intermediate image and the second intermediate image to obtain a first target image.
  • the imaging device of the embodiment of the present application includes an image sensor and a processor.
  • the image sensor includes a filter array and a pixel array;
  • the filter array includes a plurality of filter regions, each of the filter regions includes a plurality of filter units, each of the filters
  • the unit includes at least one first color filter, at least one second color filter, and at least one third color filter;
  • the pixel array includes a plurality of pixels, and each pixel corresponds to the filter array
  • One of the filters the pixels are used to receive light passing through the corresponding filters to generate electrical signals; the electrical signals generated by the pixels corresponding to each of the filter units are combined and output as a combined brightness value A first intermediate image is formed, and the combined brightness value is used to characterize the brightness of the light acting on the pixel corresponding to the filter unit.
  • the processor is configured to generate a first color signal, a second color signal, and a third color signal according to the electrical signal generated by the pixel corresponding to each filter area, and the first color signal is used to characterize the effect on the
  • the filter area corresponds to the value of the first color channel of the light of the pixel
  • the second color signal is used to represent the value of the second color channel of the light acting on the pixel corresponding to the filter area
  • the signal is used to characterize the value of the third color channel of the light acting on the pixel corresponding to the filter area
  • the processor is also used to process the first color signal, the second color signal, and the third color signal.
  • the color signal is used to obtain a plurality of second intermediate images used to characterize the color value of the filter area, and the first intermediate image and the second intermediate image are merged to obtain a first target image.
  • the electronic device of the embodiment of the present application includes an imaging device and a processor.
  • the imaging device includes an image sensor, the image sensor includes a filter array and a pixel array; the filter array includes a plurality of filter regions, each of the filter regions includes a plurality of filter units , Each of the filter units includes at least one first color filter, at least one second color filter, and at least one third color filter; the pixel array includes a plurality of pixels, each of the A pixel corresponds to a filter of the filter array, and the pixel is used to receive light passing through the corresponding filter to generate an electrical signal; the electricity generated by the pixel corresponding to each filter unit The signal is combined and output as a combined brightness value to form a first intermediate image, and the combined brightness value is used to characterize the brightness of the light acting on the corresponding pixel of the filter unit.
  • the processor is configured to generate a first color signal, a second color signal, and a third color signal according to the electrical signal generated by the pixel corresponding to each filter area, and the first color signal is used to characterize the effect on the
  • the filter area corresponds to the value of the first color channel of the light of the pixel
  • the second color signal is used to represent the value of the second color channel of the light acting on the pixel corresponding to the filter area
  • the signal is used to characterize the value of the third color channel of the light acting on the pixel corresponding to the filter area
  • the processor is also used to process the first color signal, the second color signal, and the third color signal.
  • the color signal is used to obtain a plurality of second intermediate images used to characterize the color value of the filter area, and the first intermediate image and the second intermediate image are merged to obtain a first target image.
  • the image processing system of the embodiment of the present application includes an electronic device and a processor.
  • the electronic device includes an imaging device, the imaging device includes an image sensor, the image sensor includes a filter array and a pixel array; the filter array includes a plurality of filter regions, each of the filters The area includes a plurality of filter units, each of the filter units includes at least one first color filter, at least one second color filter, and at least one third color filter; the pixel array includes A plurality of pixels, each of the pixels corresponds to one filter of the filter array, and the pixels are used to receive light passing through the corresponding filter to generate an electrical signal; each of the filters The electrical signals generated by the pixels corresponding to the slice unit are combined and output as a combined brightness value to form a first intermediate image, and the combined brightness value is used to characterize the brightness of the light acting on the pixel corresponding to the filter unit.
  • the processor is configured to generate a first color signal, a second color signal, and a third color signal according to the electrical signal generated by the pixel corresponding to each filter area, and the first color signal is used to characterize the effect on the
  • the filter area corresponds to the value of the first color channel of the light of the pixel
  • the second color signal is used to represent the value of the second color channel of the light acting on the pixel corresponding to the filter area
  • the signal is used to characterize the value of the third color channel of the light acting on the pixel corresponding to the filter area
  • the processor is also used to process the first color signal, the second color signal, and the third color signal.
  • the color signal is used to obtain a plurality of second intermediate images used to characterize the color value of the filter area, and the first intermediate image and the second intermediate image are merged to obtain a first target image.
  • the signal processing method of the embodiment of the present application is used in an image sensor, the image sensor includes a filter array and a pixel array; the filter array includes a plurality of filter regions, each of the filter regions includes A plurality of filter units, each of the filter units includes at least one first color filter, at least one second color filter, and at least one third color filter; the pixel array includes a plurality of Pixels, each of the pixels corresponds to a filter of the filter array, and the pixel is used to receive light passing through the corresponding filter to generate an electrical signal.
  • the signal processing method includes: combining and outputting electrical signals generated by pixels corresponding to each of the filter units as a combined brightness value to form a first intermediate image, and the combined brightness value is used to characterize the effect on the filter.
  • the brightness of the light of the pixel corresponding to the light sheet unit; the first color signal, the second color signal, and the third color signal are generated according to the electrical signal generated by the pixel corresponding to each of the filter regions, and the first color signal is used for Characterize the value of the first color channel of the light acting on the pixel corresponding to the filter area, and the second color signal is used to characterize the value of the second color channel of the light acting on the pixel corresponding to the filter area, The third color signal is used to characterize the value of the third color channel of the light acting on the pixel corresponding to the filter area; processing the first color signal, the second color signal, and the third color signal To obtain a plurality of second intermediate images used to characterize the color value of the filter area; fuse the first intermediate image and the second intermediate image to obtain a first target image.
  • Figures 1 and 2 are schematic diagrams of image sensors according to some embodiments of the present application.
  • 3 and 4 are schematic diagrams of the arrangement of some filters of the filter array of some embodiments of the present application.
  • Fig. 5 is a schematic diagram of an image sensor according to some embodiments of the present application.
  • 6 to 8 are schematic diagrams of the arrangement of some filters of the filter array in some embodiments of the present application.
  • FIG. 12 is a schematic diagram of the working principle of an image sensor including a filter array arranged in the form of a Bayer array in the prior art;
  • 13 to 15 are schematic diagrams of the arrangement of some filters of the filter array of some embodiments of the present application.
  • 16 to 19 are schematic diagrams of working principles of image sensors in some embodiments of the present application.
  • FIG. 20 is a schematic diagram of a partial structure of a processing circuit of some embodiments of the present application.
  • FIG. 21 is a schematic diagram of an imaging device according to some embodiments of the present application.
  • FIG. 22 is a schematic diagram of an electronic device according to some embodiments of the present application.
  • FIG. 23 is a schematic diagram of an image processing system according to some embodiments of the present application.
  • FIG. 24 is a schematic flowchart of a signal processing method according to some embodiments of the present application.
  • FIG. 25 is a schematic diagram of an image processing circuit in a computer device according to some embodiments of the present application.
  • the present application provides an image sensor 10.
  • the image sensor 10 includes a filter array 11, a pixel array 12 and a processing circuit 13.
  • the filter array 11 includes a plurality of filter regions 111, and each filter region 111 includes a plurality of filter units 1111.
  • Each filter unit 1111 includes at least one first color filter A, at least one second color filter B, and at least one third color filter C.
  • the pixel array 12 includes a plurality of pixels 120, each pixel 120 corresponds to a filter 110 of the filter array 11, and the pixel 120 is used to receive light passing through the corresponding filter 110 to generate an electrical signal.
  • the processing circuit 13 is provided on the substrate 14 having the pixel array 12.
  • the processing circuit 13 is used to combine and output the electrical signals generated by the pixels 120 corresponding to each filter unit 1111 as a combined brightness value to form a first intermediate image, and the combined brightness value is used to characterize the effect on the pixel corresponding to the filter unit 1111 The brightness of the light of 120.
  • the processing circuit 13 is also used to generate a first color signal, a second color signal, and a third color signal according to the electrical signal generated by the pixel 120 corresponding to each filter area 111.
  • the first color signal is used to characterize the effect on the filter.
  • the area 111 corresponds to the value of the first color channel of the light of the pixel 120
  • the second color signal is used to represent the value of the second color channel of the light that acts on the filter area 111 corresponding to the pixel 120
  • the third color signal is used to represent the effect The value of the third color channel of the light corresponding to the pixel 120 in the filter area 111.
  • the processing circuit 13 is also used to process the first color signal, the second color signal, and the third color signal to obtain a plurality of second intermediate images for characterizing the color value of the filter area 111, and to fuse the first intermediate image And the second intermediate image to obtain the first target image.
  • the combined brightness value is output by combining the electrical signals of all the pixels 120 corresponding to each filter unit 1111, the combined output of the electrical signals of the multiple pixels 120 is equivalent to increasing The light-sensitive area of the pixel can be improved, so that the acquired combined brightness value is more accurate, and the first target image formed by using the combined brightness value is also more accurate.
  • the color signals (the first color signal, the second color signal, and the third color signal) are generated by the pixel 120 corresponding to the filter area 111, the color signal generated by a single pixel 120 (especially low In a bright environment), the color signal of the present application is also more accurate.
  • the number of filter units 1111 in each filter area 111 may be M*M, where M is an integer greater than or equal to 2.
  • M is an integer greater than or equal to 2.
  • the value of M may be 2. , 3, 4, 5, 6, 7, 8, 9, 10, 15, 20, etc., which are not limited here.
  • M is relatively large
  • the first color signal, the second color signal, and the third color signal corresponding to the filter area 111 are more accurate.
  • M is relatively small
  • the number of filters 110 in each filter unit 1111 may be N*N, where N is an integer greater than or equal to 2.
  • the value of N may be 2, 3, 4, 5, 6, 7, 8, 9, 10, 15, 20, etc., are not limited here.
  • N when N is relatively large, the combined brightness value corresponding to the filter unit 1111 is even higher, and when N is relatively small, the resolution of the image that can be acquired by the filter array 11 of the same size is higher.
  • M and N can be the same or different.
  • the number of filter units 1111 in each filter area 111 may be 2*2, and the number of filters 110 in each filter unit 1111 may be 2*2.
  • the first color signal, the second color signal, the third color signal, and the combined brightness value are all relatively accurate, and the resolution of the image is also relatively high.
  • the number of filter units 1111 in each filter area 111 can also be all 3*3 or all 4*4, and so on.
  • the number of filters 110 in each filter unit 1111 can also be all 3*3 or all 4*4, and so on.
  • the number of the first color filter A, the number of the second color filter B, and the number of the third color filter C in each filter unit 1111 have a ratio
  • the ratios of the multiple filter units 1111 are all the same.
  • the ratio of the number of first color filters A, the number of second color filters B, and the number of third color filters C in each filter unit 1111 is 2:1:1.
  • the ratio of the number of first color filters A, the number of second color filters B, and the number of third color filters C in each filter unit 1111 is all 5:2:2 .
  • the first color filter A can be a green filter G
  • the second color filter B can be a red filter R
  • the third color filter C can be a blue filter. ⁇ Bu.
  • the ratio of the number of first color filters A, the number of second color filters B, and the number of third color filters C in each filter unit 1111 is 2:1:1.
  • the filter array 11 includes a plurality of first filter groups 1131 and a plurality of second filter groups 1132, and the first filter group 1131 includes the same number of first color filters.
  • the sub-array formed by the arrangement of the plate group 1131 and all the second filter groups 1132 is a part of the filter array 11; or the sub-array formed by all the filter regions 111 is a part of the filter array 11;
  • the image sensor 10 is used to obtain the first target image; in the texture clear mode, the processing circuit 13 is used to combine the electrical signals generated by the pixels 120 corresponding to the first filter group 1131 to generate the first pixel signal and the third pixel signal.
  • Pixel signal the first pixel signal is used to characterize the value of the first color channel of the light acting on the first filter set 1131 corresponding to the pixel 120
  • the third pixel signal is used to characterize the pixel acting on the first filter set 1131
  • the value of the second color channel of the light of 120, the processing circuit 13 is also used to combine the electrical signals generated by the pixels 120 corresponding to the second filter set 1132 to generate a second pixel signal and a fourth pixel signal.
  • the second pixel signal is used for To characterize the value of the first color channel of the light acting on the second filter set 1132 corresponding to the pixel 120
  • the fourth pixel signal is used to characterize the third color channel of the light acting on the second filter set 1132 corresponding to the pixel 120
  • the processing circuit 13 is also used to obtain the second target image according to the first pixel signal, the second pixel signal, the third pixel signal, and the fourth pixel signal.
  • the filter array 11 is manufactured in units of the filter area 111, then all the first filter groups 1131 and all the second filter groups 1132 are arranged to form a sub The array is part of the filter array 11.
  • the electrical signals generated by all the pixels 120 will be read out.
  • the electrical signals generated by the pixels 120 in the first row and/or the first column are not read out.
  • the filter array 11 of FIG. 3 as an example, when the second target image is acquired, the electrical signals generated by the pixels 120 in the first row and the last row are not read out, or the pixels 120 in the first and last columns are not read. The generated electrical signal is not read out.
  • each filter unit 1111 For example, assuming that the ratio of the number of first color filters A, the number of second color filters B, and the number of third color filters C in each filter unit 1111 is 2:1:1 As an example, one first color filter A, one second color filter B in one filter unit 1111, and one first color filter A and one second color filter in another filter unit 1111 Two color filters B are combined to form a first filter group 1131; in one filter unit 1111, one first color filter A, one third color filter C, and another filter unit 1111 A first color filter A and a second color filter C are combined to form a second filter group 1132.
  • the filter array 11 is manufactured in units of the first filter group 1131 and the second filter group 1132, then all the filter regions 111 are arranged to form a sub-array It is part of the filter array 11.
  • the electrical signals generated by the pixels 120 in the first row and/or the first column are not read out.
  • the electrical signals generated by all the pixels 120 will be read out.
  • the filter array 11 of FIG. 4 as an example, when the first target image is acquired, the electrical signals generated by the pixels 120 in the first row and the last three rows are not read out, or the electrical signals in the first and last three columns are not read out. The electrical signal generated by the pixel 120 is not read out.
  • the user can switch the mode by selecting the desired mode, for example, the display interface displays the low light mode and the texture clear mode, the user selects the low light mode, the first target image is output, and the user selects the texture clear mode. Output the second target image. In this way, the switching between the low light mode and the texture clear mode can be achieved through the same filter array 11 respectively.
  • the low-brightness mode since the combined brightness value is combined and output by the electrical signals of all pixels 120 corresponding to each filter unit 1111, the color signal is generated by the pixel 120 corresponding to the filter area 111, therefore, the low The bright mode can still acquire images accurately and effectively in a low-bright environment, that is, the low-bright mode can be applied to a low-bright environment.
  • the texture clear mode since both the first filter group 1131 and the second filter group 1132 have the first color filter A, the pixels 120 and the second filter corresponding to the first filter group 1131 are The pixels 120 corresponding to the slice group 1132 can all generate pixel signals having the value of the first color channel. Therefore, during the generation process of the second target image, the value of the first color channel does not need to be subjected to interpolation processing, and the color reproduction degree of the color image is more accurate.
  • the image sensor 10 includes a microlens array 15, a filter array 11, and a pixel array 12.
  • the microlens array 15, the filter array 11, and the pixel array 12 are arranged in sequence.
  • the filter array 11 includes a plurality of first filter groups 1131 and a plurality of second filter groups 1132.
  • the first filter group 1131 includes a plurality of first color filters A and a plurality of second color filters B in the same number.
  • the second filter group 1132 includes a plurality of first color filters A and a plurality of third color filters C in the same number.
  • the pixel array 12 includes a plurality of pixels 120, each pixel 120 corresponds to a filter 110 of the filter array 11, and the pixel 120 is used to receive light passing through the corresponding filter 110 to generate an electrical signal.
  • the micro lens array 15 includes a plurality of micro lens groups 151.
  • One microlens group 151 in the microlens array 15 corresponds to one filter group 113 (first filter group 1131 or second filter group 1132), and a plurality of pixels corresponding to the one filter group 113 120 corresponds.
  • each microlens group 151 includes a plurality of microlenses 150, and each microlens 150 corresponds to a filter 110 and a pixel 120.
  • each microlens group 151 includes a microlens 150, and each microlens 150 corresponds to a filter group 113 and corresponds to a plurality of pixels 120 corresponding to the one filter group 113.
  • each filter array 11 includes a plurality of first filter groups 1131 and a plurality of second filter groups 1132.
  • Each first filter group 1131 includes a plurality of first color filters A and a plurality of second color filters B in the same number.
  • Each second filter group 1132 includes a plurality of first color filters A and a plurality of third color filters C in the same number.
  • the first color filter A may be a green filter G
  • the second color filter B may be a red filter R
  • the third color filter C may be a blue filter Bu.
  • a plurality of first filter groups 1131 may be arranged in a first diagonal direction D1, and a plurality of second filter groups 1132 may be arranged in a second diagonal direction D2, and the first diagonal direction D1 may be aligned with The second diagonal direction D2 is different.
  • the first filter The group 1131 and the second filter group 1132 may be arranged adjacently in the vertical direction and the horizontal direction of the image sensor 10.
  • the number of filters 110 in each first filter group 1131 is K*K
  • the number of filters 110 in each second filter group 1132 is K*K
  • K is an integer greater than or equal to 2.
  • the value of K can be 2, 3, 4, 5, 6, 7, 8, 9, 10, 15, 20, etc., which are not limited here.
  • the arrangement of the multiple filters 110 in each first filter group 1131 may be: (1) Please refer to FIG. 4, multiple first color filters A and multiple second color filters The optical sheets B are arranged adjacently in the vertical direction and the horizontal direction of the image sensor 10; (2) Please refer to FIG. 6, a plurality of optical filters 110 are arranged row by row, and the colors of the plurality of optical filters 110 in the same row are the same; (3) Please refer to FIG. 7, the multiple filters 110 are arranged in a row, and the multiple filters 110 in the same row have the same color.
  • the arrangement of the multiple filters 110 in each first filter group 1131 is not limited to this.
  • the arrangement of the multiple filters 110 in each second filter group 1132 may be: (1) Please refer to FIG. 4, multiple first color filters A and multiple third color filters The optical sheets C are arranged adjacently in the vertical direction and the horizontal direction of the image sensor 10; (2) Please refer to FIG. 6, a plurality of optical filters 110 are arranged row by row, and the colors of the plurality of optical filters 110 in the same row are the same; (3) Please refer to FIG. 7, the multiple filters 110 are arranged in a row, and the multiple filters 110 in the same row have the same color.
  • the arrangement of the multiple filters 110 in each second filter group 1132 is not limited to this.
  • FIG. 4 is a schematic diagram of the arrangement of some filters 110 in the filter array 11 according to an embodiment of the present application. Please refer to FIG. 4, the arrangement of some filters 110 is as follows:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the number of filters 110 in each first filter group 1131 is 2*2
  • the number of filters 110 in each second filter group 1132 is 2*2.
  • the multiple first filter groups 1131 are arranged in the first diagonal direction D1 (for example, the direction where the upper left corner and the lower right corner of the filter array 11 in FIG. 4 are connected), and the multiple second filters
  • the light sheet group 1132 is arranged in the second diagonal direction D2 (for example, the direction where the lower left corner and the upper right corner of the filter array 11 in FIG. 4 are connected), and the first diagonal direction D1 is different from the second diagonal direction D2
  • the first diagonal direction D1 is perpendicular to the second diagonal direction D2.
  • first diagonal direction D1 and the second diagonal direction D2 are not limited to the diagonal, but also include directions parallel to the diagonal.
  • the "direction" here is not a single direction, but can be understood as the concept of a "straight line” indicating the arrangement, and there can be two-way directions at both ends of the straight line.
  • the first diagonal direction D1 may also be the direction connecting the lower left corner and the upper right corner of the filter array 11
  • the second diagonal direction D2 may also be the upper left corner of the filter array 11. The direction in which the corner is connected to the lower right corner. At this time, the positions of the first filter group 1131 and the second filter group 1132 are transformed corresponding to the change in the diagonal direction.
  • the first filter group 1131 and the second filter group 1132 are arranged adjacently in the vertical direction V of the image sensor 10 (shown in FIG. 2), and also arranged adjacently in the horizontal direction H . That is, the plurality of filter groups 113 are periodically arranged in the vertical direction V in the order of the first filter group 1131 and the second filter group 1132, and the plurality of filter groups 113 are arranged in the horizontal direction H.
  • the first filter group 1131 and the second filter group 1132 are periodically arranged in the order.
  • first filter group 1131 and the second filter group 1132 are arranged adjacent to each other in the vertical direction V, and are also arranged adjacent to each other in the horizontal direction H. It is not limited to the manner shown in FIG. 4, and may also be :
  • the plurality of filter groups 113 are arranged in the order of the first filter group 1131 and the second filter group 1132 or the order of the second filter group 1132 and the first filter group 1131 in the vertical direction V Periodically arranged (from left to right, from top to bottom, the same below), a plurality of filter groups 113 in the horizontal direction H in the order of the first filter group 1131 and the second filter group 1132 or
  • the order of the second filter group 1132 and the first filter group 1131 is periodically arranged (from left to right, from top to bottom, the same below).
  • a plurality of first color filters A and a plurality of second color filters B are arranged adjacently in the vertical direction V and the horizontal direction H. That is, in the vertical direction V, the first color filter A and the second color filter B are alternately arranged, and in the horizontal direction H, the first color filter A and the second color filter B are alternately arranged arrangement.
  • a plurality of first color filters A and a plurality of third color filters C are arranged adjacently in the vertical direction V and the horizontal direction H. That is, in the vertical direction V, the first color filter A and the third color filter C are alternately arranged, and in the horizontal direction H, the first color filter A and the third color filter C are alternately arranged arrangement.
  • the arrangement of the filters 110 is:
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 2*2 filters 110.
  • Each filter unit 1111 includes two first color filters A, one second color filter B, and one third color filter C.
  • the arrangement of some filters 110 in the filter array 11 can also be:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the number of filters 110 in each first filter group 1131 is 3*3
  • the number of filters 110 in each second filter group 1132 is 3*3.
  • the multiple first filter groups 1131 are arranged in the first diagonal direction D1 (for example, the direction where the upper left corner and the lower right corner of the filter array 11 are connected), and the multiple second filters The group 1132 is arranged in the second diagonal direction D2 (for example, the direction connecting the lower left corner and the upper right corner of the filter array 11).
  • the first diagonal direction D1 is different from the second diagonal direction D2, for example, the first The diagonal direction D1 is perpendicular to the second diagonal direction D2.
  • the first filter group 1131 and the second filter group 1132 are arranged adjacent to each other in the vertical direction V of the image sensor 10 (shown in FIG. 2), and are also adjacent to each other in the horizontal direction H Layout. That is, the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter group 1131 in the vertical direction V. The sequence is periodically arranged, and the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter in the horizontal direction H The order of group 1131 is arranged periodically.
  • a plurality of first color filters A and a plurality of second color filters B are arranged adjacently in the vertical direction V and the horizontal direction H. That is, in the vertical direction V, the first color filter A and the second color filter B are alternately arranged, and in the horizontal direction H, the first color filter A and the second color filter B are alternately arranged arrangement.
  • a plurality of first color filters A and a plurality of third color filters C are arranged adjacently in the vertical direction V and the horizontal direction H. That is, in the vertical direction V, the first color filter A and the third color filter C are alternately arranged, and in the horizontal direction H, the first color filter A and the third color filter C are alternately arranged arrangement.
  • the arrangement of the filters 110 is:
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 3*3 filters 110. Some filter units 1111 may include five first color filters A, three second color filters B, and one third color filter C. Some filter units 1111 may include five first color filters A, one second color filter B, and three third color filters C.
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 3*3 filters 110. Some filter units 1111 may include five first color filters A, three second color filters B, and one third color filter C. Some filter units 1111 may include five first color filters A, one second color filter B, and three third color filters C.
  • the arrangement of some filters 110 in the filter array 11 can also be:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the number of filters 110 in each first filter group 1131 is 4*4
  • the number of filters 110 in each second filter group 1132 is 4*4.
  • the multiple first filter groups 1131 are arranged in the first diagonal direction D1 (for example, the direction where the upper left corner and the lower right corner of the filter array 11 are connected), and the multiple second filters The group 1132 is arranged in the second diagonal direction D2 (for example, the direction connecting the lower left corner and the upper right corner of the filter array 11).
  • the first diagonal direction D1 is different from the second diagonal direction D2, for example, the first The diagonal direction D1 is perpendicular to the second diagonal direction D2.
  • the first filter group 1131 and the second filter group 1132 are arranged adjacent to each other in the vertical direction V of the image sensor 10 (shown in FIG. 2), and are also adjacent to each other in the horizontal direction H Layout. That is, the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter group 1131 in the vertical direction V. The sequence is periodically arranged, and the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter in the horizontal direction H The order of group 1131 is arranged periodically.
  • a plurality of first color filters A and a plurality of second color filters B are arranged adjacently in the vertical direction V and the horizontal direction H. That is, in the vertical direction V, the first color filter A and the second color filter B are alternately arranged, and in the horizontal direction H, the first color filter A and the second color filter B are alternately arranged arrangement.
  • a plurality of first color filters A and a plurality of third color filters C are arranged adjacently in the vertical direction V and the horizontal direction H. That is, in the vertical direction V, the first color filter A and the third color filter C are alternately arranged, and in the horizontal direction H, the first color filter A and the third color filter C are alternately arranged arrangement.
  • the arrangement of the filters 110 is:
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 4*4 filters 110.
  • Some filter units 1111 may include eight first-color filters A, six second-color filters B, and two third-color filters C.
  • Some filter units 1111 may include eight first-color filters A, two second-color filters B, and six third-color filters C.
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 4*4 filters 110.
  • Some filter units 1111 may include eight first-color filters A, six second-color filters B, and two third-color filters C.
  • Some filter units 1111 may include eight first-color filters A, two second-color filters B, and six third-color filters C.
  • FIG. 6 is a schematic diagram of the arrangement of some filters 110 in the filter array 11 according to another embodiment of the present application. Please refer to FIG. 6 for the arrangement of the partial filters 110 as follows:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the number of filters 110 in each first filter group 1131 is 2*2
  • the number of filters 110 in each second filter group 1132 is 2*2.
  • the multiple first filter groups 1131 are arranged in the first diagonal direction D1 (for example, the direction where the upper left corner and the lower right corner of the filter array 11 in FIG. 6 are connected), and the multiple second filters
  • the light sheet group 1132 is arranged in the second diagonal direction D2 (for example, the direction where the lower left corner and the upper right corner of the filter array 11 in FIG. 6 are connected), and the first diagonal direction D1 is different from the second diagonal direction D2
  • the first diagonal direction D1 is perpendicular to the second diagonal direction D2.
  • the first filter group 1131 and the second filter group 1132 are arranged adjacently in the vertical direction V of the image sensor 10 (shown in FIG. 2), and also arranged adjacently in the horizontal direction H . That is, the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter group 1131 in the vertical direction V. The sequence is periodically arranged, and the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter in the horizontal direction H The order of group 1131 is arranged periodically.
  • the multiple filters 110 are arranged row by row, and the multiple filters 110 in the same row have the same color, for example, the multiple filters 110 in the first row
  • the light sheets 110 are all first color filters A
  • the plurality of light filters 110 in the second row are all second color filters B.
  • the multiple filters 110 are arranged row by row, and the multiple filters 110 in the same row have the same color.
  • the multiple filters 110 in the first row are all One color filter A
  • the multiple filters 110 in the second row are all third color filters C.
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 2*2 filters 110.
  • Each filter unit 1111 includes two first color filters A, one second color filter B, and one third color filter C.
  • the arrangement of some filters 110 in the filter array 11 can also be:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the number of filters 110 in each first filter group 1131 is 3*3
  • the number of filters 110 in each second filter group 1132 is 3*3.
  • the multiple first filter groups 1131 are arranged in the first diagonal direction D1 (for example, the direction where the upper left corner and the lower right corner of the filter array 11 are connected), and the multiple second filters The group 1132 is arranged in the second diagonal direction D2 (for example, the direction connecting the lower left corner and the upper right corner of the filter array 11).
  • the first diagonal direction D1 is different from the second diagonal direction D2, for example, the first The diagonal direction D1 is perpendicular to the second diagonal direction D2.
  • the first filter group 1131 and the second filter group 1132 are arranged adjacent to each other in the vertical direction V of the image sensor 10 (shown in FIG. 2), and are also adjacent to each other in the horizontal direction H Layout. That is, the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter group 1131 in the vertical direction V. The sequence is periodically arranged, and the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter in the horizontal direction H The order of group 1131 is arranged periodically.
  • the multiple filters 110 are arranged row by row, and the multiple filters 110 in the same row have the same color, for example, the multiple filters 110 in the first row
  • the filters 110 are all first color filters A
  • the multiple filters 110 in the second row are all second color filters B
  • the multiple filters 110 in the third row are all first color filters.
  • the multiple filters 110 are arranged row by row, and the multiple filters 110 in the same row have the same color.
  • the multiple filters 110 in the first row are all One color filter A
  • the multiple filters 110 in the second row are all third color filters C
  • the multiple filters 110 in the third row are all first color filters A.
  • the arrangement of the filters 110 is:
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 3*3 filters 110. Some filter units 1111 may include five first color filters A, three second color filters B, and one third color filter C. Some filter units 1111 may include five first color filters A, one second color filter B, and three third color filters C.
  • the arrangement of some filters 110 in the filter array 11 can also be:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the number of filters 110 in each first filter group 1131 is 4*4
  • the number of filters 110 in each second filter group 1132 is 4*4.
  • the multiple first filter groups 1131 are arranged in the first diagonal direction D1 (for example, the direction where the upper left corner and the lower right corner of the filter array 11 are connected), and the multiple second filters The group 1132 is arranged in the second diagonal direction D2 (for example, the direction connecting the lower left corner and the upper right corner of the filter array 11).
  • the first diagonal direction D1 is different from the second diagonal direction D2, for example, the first The diagonal direction D1 is perpendicular to the second diagonal direction D2.
  • the first filter group 1131 and the second filter group 1132 are arranged adjacent to each other in the vertical direction V of the image sensor 10 (shown in FIG. 2), and are also adjacent to each other in the horizontal direction H Layout. That is, the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter group 1131 in the vertical direction V. The sequence is periodically arranged, and the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter in the horizontal direction H The order of group 1131 is arranged periodically.
  • the multiple filters 110 are arranged row by row, and the multiple filters 110 in the same row have the same color, for example, the multiple filters 110 in the first row
  • the filters 110 are all first color filters A
  • the multiple filters 110 in the second row are all second color filters B
  • the multiple filters 110 in the third row are all first color filters.
  • the multiple filters 110 in the fourth row are all the second color filters B.
  • the multiple filters 110 are arranged row by row, and the multiple filters 110 in the same row have the same color.
  • the multiple filters 110 in the first row are all One color filter A
  • the multiple filters 110 in the second row are all third color filters C
  • the multiple filters 110 in the third row are all first color filters A
  • the fourth row The plurality of filters 110 are all third color filters C.
  • the arrangement of the filters 110 is:
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 4*4 filters 110.
  • Some filter units 1111 may include eight first-color filters A, six second-color filters B, and two third-color filters C.
  • Some filter units 1111 may include eight first-color filters A, two second-color filters B, and six third-color filters C.
  • FIG. 7 is a schematic diagram of the arrangement of some filters 110 in the filter array 11 according to another embodiment of the present application. Please refer to FIG. 7, the arrangement of some filters 110 is as follows:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the number of filters 110 in each first filter group 1131 is 2*2
  • the number of filters 110 in each second filter group 1132 is 2*2.
  • a plurality of first filter groups 1131 are arranged in a first diagonal direction D1 (for example, the direction connecting the upper left corner and the lower right corner of the filter array 11 in FIG. 7), and the plurality of second filters
  • the light sheet group 1132 is arranged in the second diagonal direction D2 (for example, the direction where the lower left corner and the upper right corner of the filter array 11 in FIG. 7 are connected), the first diagonal direction D1 is different from the second diagonal direction D2
  • the first diagonal direction D1 is perpendicular to the second diagonal direction D2.
  • the first filter group 1131 and the second filter group 1132 are arranged adjacently in the vertical direction V of the image sensor 10 (shown in FIG. 2), and also arranged adjacently in the horizontal direction H . That is, the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter group 1131 in the vertical direction V. The sequence is periodically arranged, and the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter in the horizontal direction H The order of group 1131 is arranged periodically.
  • a plurality of filters 110 are arranged one by one, and the colors of the plurality of filters 110 in the same column are the same, for example, the plurality of filters 110 in the first column
  • the light sheets 110 are all the first color filters A
  • the multiple filters 110 in the second row are all the second color filters B.
  • a plurality of filters 110 are arranged in a row, and the colors of the plurality of filters 110 in the same column are the same.
  • the plurality of filters 110 in the first column are all One color filter A
  • the plurality of filters 110 in the second row are all third color filters C.
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 2*2 filters 110.
  • Each filter unit 1111 includes two first color filters A, one second color filter B, and one third color filter C.
  • the arrangement of some filters 110 in the filter array 11 can also be:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the number of filters 110 in each first filter group 1131 is 3*3
  • the number of filters 110 in each second filter group 1132 is 3*3.
  • the multiple first filter groups 1131 are arranged in the first diagonal direction D1 (for example, the direction where the upper left corner and the lower right corner of the middle filter array 11 are connected), and the multiple second filters
  • the slice group 1132 is arranged in the second diagonal direction D2 (for example, the direction where the lower left corner and the upper right corner of the filter array 11 are connected), and the first diagonal direction D1 is different from the second diagonal direction D2, for example, the first diagonal direction D1 is different from the second diagonal direction D2.
  • the diagonal direction D1 is perpendicular to the second diagonal direction D2.
  • the first filter group 1131 and the second filter group 1132 are arranged adjacent to each other in the vertical direction V of the image sensor 10 (shown in FIG. 2), and are also adjacent to each other in the horizontal direction H Layout. That is, the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter group 1131 in the vertical direction V. The sequence is periodically arranged, and the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter in the horizontal direction H The order of group 1131 is arranged periodically.
  • the multiple filters 110 are arranged one by one, and the multiple filters 110 in the same column have the same color, for example, the multiple filters 110 in the first column have the same color.
  • the filters 110 are all first color filters A
  • the multiple filters 110 in the second row are all second color filters B
  • the multiple filters 110 in the third row are all first color filters.
  • Light sheet A In the second filter group 1132, a plurality of filters 110 are arranged in a row, and the colors of the plurality of filters 110 in the same column are the same.
  • the plurality of filters 110 in the first column are all One color filter A
  • the multiple filters 110 in the second row are all third color filters C
  • the multiple filters 110 in the third row are all first color filters A.
  • the arrangement of the filters 110 is:
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 3*3 filters 110. Some filter units 1111 may include five first color filters A, three second color filters B, and one third color filter C. Some filter units 1111 may include five first color filters A, one second color filter B, and three third color filters C.
  • the arrangement of some filters 110 in the filter array 11 can also be:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the number of filters 110 in each first filter group 1131 is 4*4
  • the number of filters 110 in each second filter group 1132 is 4*4.
  • the multiple first filter groups 1131 are arranged in the first diagonal direction D1 (for example, the direction where the upper left corner and the lower right corner of the filter array 11 are connected), and the multiple second filters The group 1132 is arranged in the second diagonal direction D2 (for example, the direction connecting the lower left corner and the upper right corner of the filter array 11).
  • the first diagonal direction D1 is different from the second diagonal direction D2, for example, the first The diagonal direction D1 is perpendicular to the second diagonal direction D2.
  • the first filter group 1131 and the second filter group 1132 are arranged adjacent to each other in the vertical direction V of the image sensor 10 (shown in FIG. 2), and are also adjacent to each other in the horizontal direction H Layout. That is, the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter group 1131 in the vertical direction V. The sequence is periodically arranged, and the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter in the horizontal direction H The order of group 1131 is arranged periodically.
  • the multiple filters 110 are arranged one by one, and the multiple filters 110 in the same column have the same color, for example, the multiple filters 110 in the first column have the same color.
  • the filters 110 are all first color filters A
  • the multiple filters 110 in the second row are all second color filters B
  • the multiple filters 110 in the third row are all first color filters.
  • the light sheet A and the multiple filters 110 in the fourth row are all the second color filters B.
  • the plurality of filters 110 are arranged in a row, and the colors of the plurality of filters 110 in the same column are the same.
  • the plurality of filters 110 in the first column are all One color filter A
  • the multiple filters 110 in the second row are all the third color filters C
  • the multiple filters 110 in the third row are all the first color filters A
  • the fourth row The plurality of filters 110 are all third color filters C.
  • the arrangement of the filters 110 is:
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 4*4 filters 110.
  • Some filter units 1111 may include eight first-color filters A, six second-color filters B, and two third-color filters C.
  • Some filter units 1111 may include eight first-color filters A, two second-color filters B, and six third-color filters C.
  • FIG. 8 is a schematic diagram of the arrangement of some filters 110 in the filter array 11 according to another embodiment of the present application. Please refer to FIG. 8, the arrangement of some filters 110 is as follows:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the number of filters 110 in each first filter group 1131 is 2*2
  • the number of filters 110 in each second filter group 1132 is 2*2.
  • a plurality of first filter groups 1131 are arranged in a first diagonal direction D1 (for example, the direction connecting the upper left corner and the lower right corner of the filter array 11 in FIG. 8), and the plurality of second filters
  • the light sheet group 1132 is arranged in the second diagonal direction D2 (for example, the direction where the lower left corner and the upper right corner of the filter array 11 in FIG. 8 are connected), and the first diagonal direction D1 is different from the second diagonal direction D2
  • the first diagonal direction D1 is perpendicular to the second diagonal direction D2.
  • the first filter group 1131 and the second filter group 1132 are arranged adjacently in the vertical direction V of the image sensor 10 (shown in FIG. 2), and also arranged adjacently in the horizontal direction H . That is, the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter group 1131 in the vertical direction V. The sequence is periodically arranged, and the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter in the horizontal direction H The order of group 1131 is arranged periodically.
  • a plurality of filters 110 are arranged one by one, and the colors of the plurality of filters 110 in the same column are the same, for example, the plurality of filters 110 in the first column
  • the light sheets 110 are all the first color filters A
  • the multiple filters 110 in the second row are all the second color filters B.
  • the multiple filters 110 are arranged row by row, and the multiple filters 110 in the same row have the same color.
  • the multiple filters 110 in the first row are all One color filter A
  • the multiple filters 110 in the second row are all third color filters C.
  • the arrangement of the filters 110 is:
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 2*2 filters 110.
  • Each filter unit 1111 includes two first color filters A, one second color filter B, and one third color filter C.
  • the arrangement of some filters 110 in the filter array 11 can also be:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the number of filters 110 in each first filter group 1131 is 3*3
  • the number of filters 110 in each second filter group 1132 is 3*3.
  • the multiple first filter groups 1131 are arranged in the first diagonal direction D1 (for example, the direction where the upper left corner and the lower right corner of the middle filter array 11 are connected), and the multiple second filters
  • the sheet group 1132 is arranged in the second diagonal direction D2 (for example, the direction where the lower left corner and the upper right corner of the middle filter array 11 are connected), and the first diagonal direction D1 is different from the second diagonal direction D2, for example,
  • the first diagonal direction D1 is perpendicular to the second diagonal direction D2.
  • the first filter group 1131 and the second filter group 1132 are arranged adjacent to each other in the vertical direction V of the image sensor 10 (shown in FIG. 2), and are also adjacent to each other in the horizontal direction H Layout. That is, the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter group 1131 in the vertical direction V. The sequence is periodically arranged, and the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter in the horizontal direction H The order of group 1131 is arranged periodically.
  • the multiple filters 110 are arranged row by row, and the multiple filters 110 in the same row have the same color, for example, the multiple filters 110 in the first row
  • the filters 110 are all first color filters A
  • the multiple filters 110 in the second row are all second color filters B
  • the multiple filters 110 in the third row are all first color filters.
  • Light sheet A In the second filter group 1132, a plurality of filters 110 are arranged in a row, and the colors of the plurality of filters 110 in the same column are the same.
  • the plurality of filters 110 in the first column are all One color filter A
  • the multiple filters 110 in the second row are all third color filters C
  • the multiple filters 110 in the third row are all first color filters A.
  • the arrangement of the filters 110 is:
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 3*3 filters 110. Some filter units 1111 may include five first color filters A, three second color filters B, and one third color filter C. Some filter units 1111 may include five first color filters A, one second color filter B, and three third color filters C.
  • the arrangement of some filters 110 in the filter array 11 can also be:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the number of filters 110 in each first filter group 1131 is 4*4
  • the number of filters 110 in each second filter group 1132 is 4*4.
  • the multiple first filter groups 1131 are arranged in the first diagonal direction D1 (for example, the direction where the upper left corner and the lower right corner of the filter array 11 are connected), and the multiple second filters The group 1132 is arranged in the second diagonal direction D2 (for example, the direction connecting the lower left corner and the upper right corner of the filter array 11).
  • the first diagonal direction D1 is different from the second diagonal direction D2, for example, the first The diagonal direction D1 is perpendicular to the second diagonal direction D2.
  • the first filter group 1131 and the second filter group 1132 are arranged adjacent to each other in the vertical direction V of the image sensor 10 (shown in FIG. 2), and are also adjacent to each other in the horizontal direction H Layout. That is, the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter group 1131 in the vertical direction V. The sequence is periodically arranged, and the plurality of filter groups 113 are in the order of the first filter group 1131 and the second filter group 1132 or the second filter group 1132 and the first filter in the horizontal direction H The order of group 1131 is arranged periodically.
  • the multiple filters 110 are arranged one by one, and the multiple filters 110 in the same column have the same color, for example, the multiple filters 110 in the first column have the same color.
  • the filters 110 are all first color filters A
  • the multiple filters 110 in the second row are all second color filters B
  • the multiple filters 110 in the third row are all first color filters.
  • the light sheet A and the multiple filters 110 in the fourth row are all the second color filters B.
  • the multiple filters 110 are arranged row by row, and the multiple filters 110 in the same row have the same color.
  • the multiple filters 110 in the first row are all One color filter A
  • the multiple filters 110 in the second row are all third color filters C
  • the multiple filters 110 in the third row are all first color filters A
  • the fourth row The plurality of filters 110 are all third color filters C.
  • the arrangement of the filters 110 is:
  • each filter area 111 may include 2*2 filter units 1111, and each filter unit 1111 includes 4*4 filters 110.
  • Some filter units 1111 may include eight first-color filters A, six second-color filters B, and two third-color filters C.
  • Some filter units 1111 may include eight first-color filters A, two second-color filters B, and six third-color filters C.
  • the electrical signals generated by the multiple pixels 120 corresponding to each first filter set 1131 can be combined to generate the first pixel signal and the third pixel signal .
  • the electrical signals generated by the multiple pixels 120 corresponding to each second filter group 1132 can be combined to generate the second pixel signal and the fourth pixel signal.
  • each filter group 113 shown in FIG. 4 includes 2*2 filters 110
  • each filter group 113 corresponds to four pixels 120.
  • two pixels 120 can receive light passing through the first color filter A to generate two electrical signals.
  • the other two pixels 120 can receive light passing through the second color filter B to generate two electrical signals.
  • the image sensor 10 combines the electrical signals generated by the two pixels 120 that receive the light passing through the first color filter A to obtain the first pixel signal, and will receive two of the light passing through the second color filter B.
  • the electrical signals generated by the pixels 120 are combined to obtain a third pixel signal.
  • the first pixel signal is used to characterize the value of the first color channel of the light acting on the first filter set 1131 corresponding to the pixel 120
  • the third pixel signal is used to characterize the value acting on the first filter set 1131 corresponding to the pixel 120
  • the value of the second color channel of the light is used to characterize the four pixels 120 corresponding to the second filter group 1132.
  • two pixels 120 can receive light passing through the first color filter A to generate two electrical signals
  • the other two pixels 120 can receive light passing through the third color filter A.
  • the light of the color filter C generates two electrical signals.
  • the image sensor 10 combines the electrical signals generated by the two pixels 120 that receive the light passing through the first color filter A to obtain a second pixel signal, and the two pixels that receive the light passing through the third color filter C are combined.
  • the electrical signals generated by 120 are combined to obtain a fourth pixel signal.
  • the second pixel signal is used to characterize the value of the first color channel of the light acting on the second filter set 1132 corresponding to the pixel 120
  • the fourth pixel signal is used to characterize the value of the first color channel acting on the second filter set 1132 corresponding to the pixel 120 The value of the third color channel of the light.
  • each first filter group 1131 can form a first combined pixel, and each first combined pixel can generate a first pixel signal and a third pixel signal.
  • the four pixels 120 corresponding to each second filter group 1132 can form a second combined pixel, and each second combined pixel can generate a second pixel signal and a fourth pixel signal. Since each combined pixel can output the pixel signal (first pixel signal or second pixel signal) with the value of the first color channel, only part of the combined pixel can output the third pixel signal with the value of the second color channel.
  • the partially combined pixels may output the fourth pixel signal having the value of the third color channel.
  • the merged pixels that cannot output the third pixel signal need to be interpolated to calculate the value of the second color channel of the merged pixel; the merged pixels that cannot output the fourth pixel signal also need to be interpolated to calculate the merged pixel.
  • the value of the third color channel of the pixel In this way, each combined pixel can obtain the values of the first color channel, the second color channel, and the third color channel, and a color image can be generated through color space calculation.
  • the pixel corresponding to each filter can only generate a pixel signal with a value of one color channel.
  • the pixel corresponding to the pixel signal in the first row and first column from the left has only the value of the second color channel, and both the value of the first color channel and the value of the third color channel of this pixel need to be obtained by interpolation;
  • the pixel corresponding to the pixel signal in the second column of a row only has the value of the first color channel, and the value of the second color channel and the value of the third color channel of the pixel need to be obtained by interpolation; the second row and second column from the left
  • the pixel corresponding to the pixel signal of has only the value of the third color channel, and both the value of the first color channel and the value of the second color channel of the pixel need to be obtained through interpolation.
  • the values of the remaining multiple color channels of the pixel corresponding to one pixel signal need to be obtained through interpolation processing.
  • the accuracy of the pixel signal obtained through the interpolation method is not high enough, which will cause the color reproduction of the final color image to be inaccurate.
  • the existing filter array arranged in a Bayer array when the pixel signal with the value of the first color channel is generated by interpolation and the pixel signal with the value of the second color channel is generated by interpolation, most of the pixels generated by the interpolation are The signal can only be calculated using two pixel signals. For example, in the image signal of FIG.
  • the pixel corresponding to the pixel signal in the second row and third column from the left does not have the value of the second color channel.
  • the value of the second color channel needs to be obtained from the pixel signal of the pixel with the value of the second color channel adjacent to the pixel, that is, according to the pixel signal with the value of the second color channel in the first row and third column and the third The pixel signal with the value of the second color channel in the third column of the row is obtained; for another example, in the image signal of FIG.
  • the The pixel signal does not have the value of the third color channel, and the value of the third color channel of the pixel corresponding to the pixel signal needs to be obtained from the pixel signal of the pixel with the value of the third color channel adjacent to the pixel, that is, according to the second The pixel signal of the third color channel in the second column of the row and the pixel signal of the third color channel of the fourth row and second column are obtained. In this way, the number of available pixel signals for interpolating to generate pixel signals is small, and the accuracy of the interpolated pixel signals is not high enough.
  • the pixel signal corresponding to the plurality of combined pixels is The resolution of the composed image is reduced, but because each combined pixel has a pixel signal with the value of the first color channel, the value of the first color channel does not need to be interpolated, and the color of the final generated color image The degree of restoration will be more accurate, and since each combined pixel of the pixel array 12 directly obtains the corresponding pixel signal of the first color channel, more information can be obtained in the subsequent signal processing process.
  • the second color channel of most of the combined pixels can be calculated from four third pixel signals with values of the second color channel.
  • the third pixel signal in the second row and third column from the left may be based on the third pixel signal in the first row and third column from the left.
  • the pixel signal, the third pixel signal in the second row and second column from the left, the third pixel signal in the second row and fourth column from the left, and the third pixel signal in the third row and third column from the left are calculated.
  • the value of the third color channel of most of the combined pixels can pass through the four values of the third color channel.
  • the fourth pixel signal is calculated. For example, in the third image signal M3 formed by a plurality of fourth pixel signals shown in FIG. 10, the fourth pixel signal in the third row and third column from the left may be based on the fourth pixel signal in the second row and third column from the left.
  • the pixel signal, the fourth pixel signal in the third row and second column from the left, the fourth pixel signal in the third row and fourth column from the left, and the fourth pixel signal in the fourth row and third column from the left are calculated. Therefore, the number of usable pixel signals for interpolating to generate pixel signals is large, and the accuracy of the pixel signals after interpolation is high.
  • each first filter group 1131 and each second filter group 1132 have a first color filter A, so that the first filter group Both the pixel 120 corresponding to 1131 and the pixel 120 corresponding to the second filter set 1132 can generate a pixel signal having the value of the first color channel. Therefore, in the process of generating the color image, the value of the first color channel does not need to be subjected to interpolation processing, and the color reproduction degree of the color image is more accurate.
  • most of the values of the second color channel to be generated by interpolation can be Borrowing four neighboring pixel signals with the value of the second color channel (or four neighboring pixels with the value of the third color channel), the value of the second color channel (or the third color channel) generated by interpolation
  • the accuracy of the pixel signal is higher, which helps to further improve the accuracy of the color reproduction of the color image.
  • each filter unit 1111 includes two first color filters A, one second color filter B, and one third color filter C .
  • the second color filter B and the third color filter C in each filter unit 1111 are not adjacent to each other, and in each filter area 111, the filters 110 of a plurality of filter units 1111 The order of arrangement is different.
  • the filter array is relatively diverse and relatively random, which can reduce the occurrence of moiré fringes and false colors.
  • the plurality of filter regions 111 include a plurality of first filter regions 1112 and a plurality of second filter regions 1114.
  • the arrangement order of the filter units 1111 in the first filter region 1112 is the same as that of the second filter regions 1112.
  • the arrangement order of the filter units 1111 in the patch area 1114 is different.
  • the arrangement of the first filter area 1112 used in the example of the embodiment of the present application is as follows:
  • the arrangement of the second filter area 1114 used in the example of the embodiment of the present application is as follows:
  • the plurality of first filter regions 1112 may be arranged in the third diagonal direction, and the plurality of second filter regions 1114 may be arranged in the fourth diagonal direction, the third diagonal direction and the fourth diagonal direction The direction is different.
  • the arrangement of the plurality of first filter regions 1112 and the plurality of second filter regions 1114 may be: (1) Please refer to FIG. 13, the first filter region 1112 and the second filter region 1114 are in The vertical direction and the horizontal direction of the image sensor 10 are arranged adjacently; (2) Please refer to FIG. 14, a plurality of first filter regions 1112 are arranged adjacently in the vertical direction of the image sensor 10, and a plurality of second filter regions 1114 Are arranged adjacently in the vertical direction of the image sensor 10; (3) Please refer to FIG. 15, a plurality of first filter regions 1112 are arranged adjacently in the horizontal direction of the image sensor 10, and a plurality of second filter regions 1114 are The sensors 10 are arranged adjacently in the horizontal direction.
  • the arrangement of the plurality of first filter regions 1112 and the plurality of second filter regions 1114 is not limited to this.
  • FIG. 13 is a schematic diagram of the arrangement of some filters 110 in the filter array 11 according to an embodiment of the present application. Please refer to FIG. 13, the arrangement of some filters 110 is:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • the plurality of first filter regions 1112 are arranged in the third diagonal direction D3 (for example, the direction connecting the upper left corner and the lower right corner of the filter array 11 in FIG. 13), and the plurality of second filter regions 1112
  • the light sheet area 1114 is arranged in the fourth diagonal direction D4 (for example, the direction where the lower left corner and the upper right corner of the filter array 11 in FIG. 13 are connected), and the third diagonal direction D3 is different from the fourth diagonal direction D4
  • the third diagonal direction D3 is perpendicular to the fourth diagonal direction D4.
  • the third diagonal direction D3 and the fourth diagonal direction D4 are not limited to the diagonal, but also include directions parallel to the diagonal.
  • the "direction" here is not a single direction, but can be understood as the concept of a "straight line” indicating the arrangement, and there can be two-way directions at both ends of the straight line.
  • the third diagonal direction D3 may also be the direction connecting the lower left corner and the upper right corner of the filter array 11
  • the fourth diagonal direction D4 may also be the upper left corner of the filter array 11. The direction in which the corner is connected to the lower right corner. At this time, the positions of the first filter area 1112 and the second filter area 1114 are transformed corresponding to the change in the diagonal direction.
  • the first filter area 1112 and the second filter area 1114 are arranged adjacently in the vertical direction V of the image sensor 10 (shown in FIG. 13), and also arranged adjacently in the horizontal direction H . That is, the plurality of filter regions 111 are periodically arranged in the order of the first filter region 1112 and the second filter region 1114 in the vertical direction V, and the plurality of filter regions 111 are arranged in the horizontal direction H. The first filter area 1112 and the second filter area 1114 are periodically arranged in the order.
  • first filter area 1112 and the second filter area 1114 are adjacently arranged in the vertical direction V, and also adjacently arranged in the horizontal direction H. It is not limited to the manner shown in FIG. :
  • the plurality of filter areas 111 are arranged in the order of the first filter area 1112 and the second filter area 1114 or the second filter area 1114 and the first filter area 1112 in the vertical direction V Periodically arranged (from left to right, from top to bottom, the same below), the plurality of filter regions 111 in the horizontal direction H follow the order of the first filter region 1112 and the second filter region 1114 or
  • the order of the second filter area 1114 and the first filter area 1112 is periodically arranged (from left to right, from top to bottom, the same below).
  • FIG. 14 is a schematic diagram of the arrangement of some filters 110 in the filter array 11 according to another embodiment of the present application. Please refer to FIG. 14, the arrangement of some filters 110 is as follows:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • a plurality of first filter regions 1112 are arranged adjacently in the vertical direction V of the image sensor 10, and a plurality of second filter regions 1114 are arranged adjacently in the vertical direction V of the image sensor 10.
  • the plurality of filter regions 111 are periodically arranged in the order of the first filter region 1112 and the second filter region 1114.
  • FIG. 15 is a schematic diagram of the arrangement of some filters 110 in the filter array 11 according to another embodiment of the present application. Please refer to FIG. 15, the arrangement of some filters 110 is as follows:
  • A is the first color filter
  • B is the second color filter
  • C is the third color filter.
  • a plurality of first filter regions 1112 are arranged adjacently in the horizontal direction H of the image sensor 10, and a plurality of second filter regions 1114 are arranged adjacently in the horizontal direction H of the image sensor 10.
  • the plurality of filter regions 111 are periodically arranged in the order of the first filter region 1112 and the second filter region 1114.
  • the processing circuit 13 is used to calculate the average value of the electrical signals generated by the pixels 120 corresponding to the first color filter A in each filter area 111 as the first color signal, and calculate each filter area 111.
  • the average value of the electrical signals generated by the pixels 120 corresponding to the second color filter B in the light sheet area 111 is used as the second color signal, and the pixels 120 corresponding to the third color filter C in each filter area 111 are calculated
  • the average value of the generated electrical signals is used as the third color signal.
  • Each filter area 111 includes 2*2 filter units 1111, and each filter unit 1111 includes two first color filters A, one second color filter B, and one third color filter. Taking the filter C as an example, each filter area 111 includes eight first-color filters A, four second-color filters B, and four third-color filters C.
  • the processing circuit 13 may be used to perform gamma correction processing on the first intermediate image.
  • f(I) is the brightness value of the first intermediate image after correction
  • I is the brightness value of the first intermediate image before correction
  • ⁇ is The first correction factor.
  • the dynamic range of the low-brightness area of the first intermediate image can be reduced, the dynamic range of the high-brightness area of the first intermediate image can be increased, and the overall brightness of the first intermediate image is reduced.
  • the user can set the corresponding correction coefficient ⁇ according to his own viewing needs, so that the display effect of the adjusted first intermediate image is better.
  • the processing circuit 13 is used to perform white balance processing, color correction matrix processing, and gamma correction processing on the first color signal, the second color signal, and the third color signal, and the processed first color signal ,
  • the processed second color signal and the processed third color signal are converted to the color and light separation space to obtain a second intermediate image.
  • white balance processing can be realized by gray world method, automatic white balance method based on dynamic threshold, mirror method and other algorithms. Different white balance algorithms can be used according to different shooting scenes or according to the user's choice, so as to make the processed color signal more Accurate and more in line with users' viewing needs.
  • the color correction matrix can be:
  • R′ refers to the second color signal corrected by the color correction matrix
  • G′ refers to the first color signal corrected by the color correction matrix
  • B′ refers to the third color signal corrected by the color correction matrix.
  • CMC11, CMC12, CMC13, CMC21, CMC22, CMC23, CMC31, CMC32, CMC33 together form a correction matrix
  • R refers to the second color signal before the color correction matrix correction
  • G refers to the first color before the color correction matrix correction Signal
  • B refers to the third color signal before correction by the color correction matrix.
  • the correction matrix can be selected according to the color temperature corresponding to the first color signal, the second color signal, and the third color signal before adjustment, so that the first color signal, the second color signal, and the third color signal pass through the color correction matrix. More accurate after processing.
  • the second correction coefficient and the first correction coefficient may be the same or different, which is not specifically limited here.
  • the processed first color signal, the processed second color signal, and the processed third color signal are converted to the color and light separation space to obtain a second intermediate image.
  • the second intermediate image may include two frames, and the two frames of second intermediate images are respectively the second intermediate image corresponding to the blue component and the second intermediate image corresponding to the red component.
  • Y 0.29900*R+0.58700*G+0.11400 *B
  • Cb -0.16874*R-0.33126*G+0.50000*B+128
  • Cr 0.50000*R-0.41869*G-0.08131*B+128, which is not specifically limited here.
  • Each filter area 111 includes 2*2 filter units 1111, and each filter unit 1111 includes two first color filters A, one second color filter B, and one third color
  • each filter unit 1111 can correspond to a combined brightness value
  • each filter area 111 can correspond to 4 combined brightness values
  • each filter area 111 corresponds to only one first color signal , A second color signal and a third color signal.
  • the process of obtaining the combined brightness value L may refer to FIG. 16, the pixels 120 corresponding to each filter unit 1111 are combined and output as the combined brightness value L.
  • the combined brightness value L may be R+2G+B.
  • the process of obtaining the first color signal may refer to FIG.
  • each filter area 111 corresponds to one Cr and one Cb, that is, the resolution of the first intermediate image is the second intermediate image 4 times the resolution.
  • images in Y/Cb/Cr format can allow the resolution of Cb/Cr to be lower than that of Y.
  • the format of Y/Cb/Cr is 4:2:2, or 4:2:0.
  • every four Y corresponds to one Cr and one Cb. Therefore, the first intermediate image representing the brightness Y and the first intermediate image representing the red component Cr in the embodiment of the present application
  • the two intermediate images and the second intermediate image representing the blue component Cb can be merged to form the first target image.
  • the processing circuit 13 is used to perform up-sampling processing on the second intermediate image so that one filter area 111 corresponds to multiple color values and forms a third intermediate image, fusing the first intermediate image and the third intermediate image.
  • Image to get the first target image For example, each filter area 111 includes 2*2 filter units 1111, and each filter unit 1111 includes two first color filters A, one second color filter B, and one first color filter.
  • the resolution of the first intermediate image is 4 times that of the second intermediate image. Therefore, the second intermediate image can be up-sampled, for example, the second intermediate image can be enlarged by four times.
  • the resolution of the third intermediate image is consistent with the resolution of the first intermediate image, and the first intermediate image and the third intermediate image are merged in this way.
  • the color information of the first target image obtained after the image is more abundant.
  • the processing circuit 13 is used to perform high-pass filter processing on the first intermediate image. In this way, by performing high-pass filtering processing on the first intermediate image, the high-pass filtering processing can effectively retain detailed information and remove noise, so that the processed first intermediate image can be made more accurate.
  • the processing circuit 13 includes a readout circuit as shown in FIG.
  • the combined output is used as the combined brightness value.
  • the four pixels PD1, pixel PD2, pixel PD3, and pixel PD4 corresponding to the same filter unit 1111 can be turned on at the same time through the control terminals Tx1, Tx2, Tx3, and Tx4, so that the four pixels corresponding to the same filter unit 1111 can be turned on at the same time.
  • the charge generated after the pixel 120 receives light is transferred to the floating diffusion node FD.
  • V2 is a high level
  • SF is an amplifying circuit.
  • the amplifying circuit SF By inputting a high level V2, the amplifying circuit SF amplifies the electrical signal corresponding to the charge at the floating diffusion node FD.
  • T is the selection signal
  • SEL is the selection circuit.
  • R is a reset signal
  • V1 is a high level
  • RST is a reset circuit. The reset circuit RST can reset the floating diffusion node FD by inputting the reset signal R and the high level V1.
  • the present application also provides an imaging device 100.
  • the imaging device 100 includes the image sensor 10 described in any one of the above embodiments.
  • the imaging device 100 further includes a processor 20.
  • the processor 20 may be configured to generate a first color signal, a second color signal, and a third color signal according to the electrical signal generated by the pixel 120 corresponding to each filter area 111, and the first color signal is used to characterize the effect on the filter.
  • the area 111 corresponds to the value of the first color channel of the light of the pixel 120
  • the second color signal is used to characterize the value of the second color channel of the light that acts on the filter area 111 corresponding to the pixel 120
  • the third color signal is used to characterize the effect The value of the third color channel of the light corresponding to the pixel 120 in the filter area 111.
  • the processor 20 is also used to process the first color signal, the second color signal, and the third color signal to obtain a plurality of second intermediate images for characterizing the color value of the filter region 111, and to fuse the first intermediate image And the second intermediate image to obtain the first target image.
  • the present application also provides an electronic device 1000.
  • the electronic device 1000 may be a mobile phone, a tablet computer, a notebook computer, a smart watch, a smart bracelet, a smart helmet, a smart glasses, an unmanned device (such as a drone, an unmanned vehicle, an unmanned boat), etc., which are not limited here.
  • the electronic device 1000 includes an imaging device 100.
  • the imaging device 100 includes the image sensor 10 described in any one of the above embodiments.
  • the electronic device 1000 further includes a processor 20.
  • the processor 20 of the electronic device 1000 may be the same as the processor 20 in the imaging apparatus 100 shown in FIG. 21, and details are not described herein again.
  • the image processing system 10000 includes an electronic device 1000.
  • the electronic device 1000 includes an imaging device 100.
  • the imaging device 100 includes the image sensor 10 described in any one of the above embodiments.
  • the image processing system 10000 also includes a processor 20.
  • the processor 20 of the image processing system 10000 may be the same as the processor 20 in the imaging device 100 shown in FIG. 21, and will not be repeated here.
  • the processor 20 may be located in a server responsible for cloud computing, or may be located in a server responsible for edge computing. In this way, the subsequent processing of the pixel signal output by the image sensor 10 can be offloaded to the server for execution, which can save the power consumption of the imaging apparatus 100 or the electronic device 1000.
  • the signal processing method can be used for the image sensor 10 described in any one of the above embodiments.
  • Signal processing methods include:
  • the first color signal is used to characterize the pixel corresponding to the filter area 111
  • the value of the first color channel of the light of 120 is used to represent the value of the second color channel of the light acting on the filter area 111 corresponding to the pixel 120
  • the third color signal is used to represent the value of the light acting on the filter
  • the area 111 corresponds to the value of the third color channel of the light of the pixel 120;
  • the filter array 11 includes a plurality of first filter groups 1131 and a plurality of second filter groups 1132, and the first filter group 1131 includes the same number of first color filters.
  • the sub-array formed by the arrangement of the plate group 1131 and all the second filter groups 1132 is a part of the filter array 11; or the sub-array formed by all the filter regions 111 is arranged as a part of the filter array 11.
  • the signal processing method includes: in the low-brightness mode, acquiring the first target image; in the texture clear mode, combining the electrical signals generated by the pixels 120 corresponding to the first filter group 1131 to generate the first pixel signal and the third pixel signal ,
  • the first pixel signal is used to characterize the value of the first color channel of the light acting on the first filter set 1131 corresponding to the pixel 120
  • the third pixel signal is used to characterize the value acting on the first filter set 1131 corresponding to the pixel 120
  • the value of the second color channel of the light is combined with the electrical signals generated by the pixels 120 corresponding to the second filter set 1132 to generate a second pixel signal and a fourth pixel signal.
  • the second pixel signal is used to characterize the effect on the second filter.
  • the slice group 1132 corresponds to the value of the first color channel of the light of the pixel 120
  • the fourth pixel signal is used to represent the value of the third color channel of the light acting on the second filter group 1132 corresponding to the pixel 120, according to the first pixel signal , The second pixel signal, the third pixel signal, and the fourth pixel signal to obtain a second target image.
  • obtaining the second target image according to the first pixel signal, the second pixel signal, the third pixel signal, and the fourth pixel signal includes: calculating the first color filter in each filter area 111
  • the average value of the electrical signals generated by the pixels 120 corresponding to A is used as the first color signal
  • the average value of the electrical signals generated by the pixels 120 corresponding to the second color filter B in each filter area 111 is calculated as the second color signal.
  • the average value of the electrical signal generated by the pixel 120 corresponding to the third color filter C in each filter area 111 is calculated as the third color signal.
  • the signal processing method includes: performing gamma correction processing on the first intermediate image.
  • the signal processing method includes: performing white balance processing, color correction matrix processing, and gamma correction processing on the first color signal, the second color signal, and the third color signal.
  • Step 03 includes: converting the processed first color signal, the processed second color signal, and the processed third color signal to a color and light separation space to obtain a second intermediate image.
  • step 04 includes: performing an up-sampling process on the second intermediate image so that one filter area 111 corresponds to multiple color values and forms a third intermediate image, fusing the first intermediate image and the third intermediate image To get the first target image.
  • the signal processing method includes: performing high-pass filter processing on the first intermediate image.
  • the embodiment of the present application also provides a computer device.
  • the computer device may be the electronic device 100 described in any one of the foregoing implementation manners.
  • the foregoing computer equipment includes an image processing circuit, which can be implemented by hardware and/or software components, and can include various processing units that define an ISP (Image Signal Processing, image signal processing) pipeline.
  • Fig. 25 is a schematic diagram of an image processing circuit in an embodiment. As shown in FIG. 25, for ease of description, only various aspects of the image processing technology related to the embodiments of the present application are shown.
  • the image processing circuit includes an ISP processor 940 and a control logic 950.
  • the ISP processor 940 can be applied to various electronic devices to serve as a processor in the electronic device.
  • one of the various electronic devices may be the electronic device 100 including the image sensor 10.
  • the image data captured by the imaging device 910 is first processed by the ISP processor 940, and the ISP processor 940 analyzes the image data to capture image statistics that can be used to determine and/or one or more control parameters of the imaging device 910.
  • the imaging device 910 may include a camera having one or more lenses 912 and an image sensor 914.
  • the image sensor 914 may be the image sensor 10.
  • the image sensor 914 may include a filter array, and the image sensor 914 may obtain the light intensity and wavelength information captured by each pixel of the image sensor 914, and provide a set of raw image data that can be processed by the ISP processor 940, such as multiple first images.
  • the sensor 920 (such as a gyroscope) can provide the collected image processing parameters (such as anti-shake parameters) to the ISP processor 940 based on the sensor 920 interface type.
  • the sensor 920 interface may use SMIA (Standard Mobile Imaging Architecture) interface, other serial or parallel camera interfaces, or a combination of the above interfaces.
  • the image sensor 914 may also send raw image data to the sensor 920, the sensor 920 may provide the raw image data to the ISP processor 940 based on the sensor 920 interface type, or the sensor 920 may store the raw image data in the image memory 930.
  • the ISP processor 940 processes the original image data pixel by pixel in a variety of formats.
  • each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the ISP processor 940 may perform one or more image processing operations on the original image data, and collect statistical information about the image data. Among them, the image processing operations can be performed with the same or different bit depth accuracy.
  • the ISP processor 940 may also receive image data from the image memory 930.
  • the sensor 920 interface sends the original image data to the image memory 930, and the original image data in the image memory 930 is then provided to the ISP processor 940 for processing.
  • the image memory 930 may be a part of a memory device, a storage device, or an independent dedicated memory in an electronic device, and may include DMA (Direct Memory Access) features.
  • the ISP processor 940 may perform one or more image processing operations, such as temporal filtering; for another example, processing the first pixel Signal, second pixel signal, third pixel signal, fourth pixel signal to obtain color images, etc.
  • the processed image data (for example, a color image) can be sent to the image memory 930 for additional processing before being displayed.
  • the ISP processor 940 receives the processed data from the image memory 930, and performs image data processing in the original domain and in the RGB and YCbCr color spaces on the processed data.
  • the image data processed by the ISP processor 940 may be output to the display 970 for viewing by the user and/or further processed by a graphics engine or a GPU (Graphics Processing Unit, graphics processor).
  • the output of the ISP processor 940 can also be sent to the image memory 930, and the display 970 can read image data from the image memory 930.
  • the image memory 930 may be configured to implement one or more frame buffers.
  • the output of the ISP processor 940 may be sent to the encoder/decoder 960 in order to encode/decode image data.
  • the encoded image data can be saved and decompressed before being displayed on the display 970 device.
  • the encoder/decoder 960 may be implemented by a CPU or GPU or a co-processor.
  • the ISP processor 940 may process image signals including a plurality of image signal units U (shown in FIG. 34) to generate image data of a color image.
  • the ISP processor 940 may send the color image to the encoder/decoder 960 to encode the color image.
  • the encoded color image can be saved in the image memory 930 and can also be displayed on the display 970.
  • the statistical data determined by the ISP processor 940 may be sent to the control logic 950 unit.
  • the statistical data may include image sensor 914 statistical information such as automatic exposure, automatic white balance, automatic focus, flicker detection, black level compensation, and lens 912 shading correction.
  • the control logic 950 may include a processor and/or a microcontroller that executes one or more routines (such as firmware). The one or more routines can determine the control parameters and ISP processing of the imaging device 910 based on the received statistical data. 940 control parameters.
  • the control parameters of the imaging device 910 may include sensor 920 control parameters (such as gain, integration time for exposure control, anti-shake parameters, etc.), camera flash control parameters, lens 912 control parameters (such as focus or zoom focal length), or these The combination of parameters.
  • the ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (for example, during RGB processing), and lens 912 shading correction parameters.
  • first and second are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with “first” and “second” may explicitly or implicitly include at least one of the features. In the description of the present application, "a plurality of” means at least two, for example two, three, unless otherwise specifically defined.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

一种图像传感器(10)、成像装置(100)、电子设备(1000)、图像处理***(10000)及信号处理方法。图像传感器(10)包括滤光片阵列(11)、像素阵列(12)和处理电路(13)。滤光片阵列(11)包括多个滤光片区域(111)，每个滤光片区域(111)包括多个滤光片单元(1111)。处理电路(13)用于将每个滤光片单元(1111)对应的像素(120)产生的电信号合并输出以作为合并亮度值并形成第一中间图像、根据每个滤光片区域(111)对应的像素(120)产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号并处理得到用于表征滤光片区域(111)的色彩值的多个第二中间图像，及融合第一中间图像与第二中间图像以得到第一目标图像。

Description

图像传感器、成像装置、电子设备、图像处理***及信号处理方法 技术领域
本申请涉及影像技术领域，特别涉及一种图像传感器、成像装置、电子设备、图像处理***及信号处理方法。
背景技术
手机等电子设备中往往装配有摄像头，以实现拍照功能。摄像头中设置有图像传感器。为了实现彩色图像的采集，图像传感器中通常会设置以拜耳(Bayer)阵列形式排布的滤光片阵列，以使得图像传感器中的多个像素能够接收穿过对应的滤光片的光线，从而生成具有不同色彩通道的像素信号。图像传感器在低亮环境中的感光能力较差，从而难以获得清晰度较高的图像。
发明内容
本申请实施方式提供一种图像传感器、成像装置、电子设备、图像处理***及信号处理方法。
本申请实施方式的图像传感器包括滤光片阵列、像素阵列和处理电路。所述滤光片阵列包括多个滤光片区域，每个所述滤光片区域包括多个滤光片单元，每个所述滤光片单元包括至少一个第一颜色滤光片、至少一个第二颜色滤光片和至少一个第三颜色滤光片。所述像素阵列包括多个像素，每个所述像素对应所述滤光片阵列的一个滤光片，所述像素用于接收穿过对应的所述滤光片的光线以生成电信号。所述处理电路设置在具有所述像素阵列的衬底上，所述处理电路用于将每个所述滤光片单元对应的像素产生的电信号合并输出以作为合并亮度值并形成第一中间图像，所述合并亮度值用于表征作用于所述滤光片单元对应像素的光线的亮度。所述处理电路还用于根据每个所述滤光片区域对应的像素产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，所述第一颜色信号用于表征作用于所述滤光片区域对应像素的光线的第一颜色通道的值，所述第二颜色信号用于表征作用于所述滤光片区域对应像素的光线的第二颜色通道的值，所述第三颜色信号用于表征作用于所述滤光片区域对应像素的光线的第三颜色通道的值；所述处理电路还用于处理所述第一颜色信号、所述第二颜色信号和所述第三颜色信号以得到用于表征所述滤光片区域的色彩值的多个第二中间图像，及用于融合所述第一中间图像与所述第二中间图像以得到第一目标图像。
本申请实施方式的成像装置包括图像传感器和处理器。所述图像传感器包括滤光片阵列和像素阵列；所述滤光片阵列包括多个滤光片区域，每个所述滤光片区域包括多个滤光片单元，每个所述滤光片单元包括至少一个第一颜色滤光片、至少一个第二颜色滤光片和至少一个第三颜色滤光片；所述像素阵列包括多个像素，每个所述像素对应所述滤光片阵列的一个滤光片，所述像素用于接收穿过对应的所述滤光片的光线以生成电信号；每个所述滤光片单元对应的像素产生的电信号合并输出以作为合并亮度值并形成第一中间图像，所述合并亮度值用于表征作用于所述滤光片单元对应像素的光线的亮度。所述处理器用于根据每个所述滤光片区域对应的像素产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，所述第一颜色信号用于表征作用于所述滤光片区域对应像素的光线的第一颜色通道的值，所述第二颜色信号用于表征作用于所述滤光片区域对应像素的光线的第二颜色通道的值，所述第三颜色信号用于表征作用于所述滤光片区域对应像素的光线的第三颜色通道的值；所述处理器还用于处理所述第一颜色信号、所述第二颜色信号和所述第三颜色信号以得到用于表征所述滤光片区域的色彩值的多个第二中间图像，融合所述第一中间图像与所述第二中间图像以得到第一目标图像。
本申请实施方式的电子设备包括成像装置和处理器。所述成像装置包括图像传感器，所述图像传感器包括滤光片阵列和像素阵列；所述滤光片阵列包括多个滤光片区域，每个所述滤光片区域包括多个滤光片单元，每个所述滤光片单元包括至少一个第一颜色滤光片、至少一个第二颜色滤光片和至少一个第三颜色滤光片；所述像素阵列包括多个像素，每个所述像素对应所述滤光片阵列的一个滤光片，所述像素用于接收穿过对应的所述滤光片的光线以生成电信号；每个所述滤光片单元对应的像素产生的电信号合并输出以作为合并亮度值并形成第一中间图像，所述合并亮度值用于表征作用于所述滤光片单元对应像素的光线的亮度。所述处理器用于根据每个所述滤光片区域对应的像素产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，所述第一颜色信号用于表征作用于所述滤光片区域对应像素的光线 的第一颜色通道的值，所述第二颜色信号用于表征作用于所述滤光片区域对应像素的光线的第二颜色通道的值，所述第三颜色信号用于表征作用于所述滤光片区域对应像素的光线的第三颜色通道的值；所述处理器还用于处理所述第一颜色信号、所述第二颜色信号和所述第三颜色信号以得到用于表征所述滤光片区域的色彩值的多个第二中间图像，融合所述第一中间图像与所述第二中间图像以得到第一目标图像。
本申请实施方式的图像处理***包括电子设备和处理器。所述电子设备包括成像装置，所述成像装置包括图像传感器，所述图像传感器包括滤光片阵列和像素阵列；所述滤光片阵列包括多个滤光片区域，每个所述滤光片区域包括多个滤光片单元，每个所述滤光片单元包括至少一个第一颜色滤光片、至少一个第二颜色滤光片和至少一个第三颜色滤光片；所述像素阵列包括多个像素，每个所述像素对应所述滤光片阵列的一个滤光片，所述像素用于接收穿过对应的所述滤光片的光线以生成电信号；每个所述滤光片单元对应的像素产生的电信号合并输出以作为合并亮度值并形成第一中间图像，所述合并亮度值用于表征作用于所述滤光片单元对应像素的光线的亮度。所述处理器用于根据每个所述滤光片区域对应的像素产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，所述第一颜色信号用于表征作用于所述滤光片区域对应像素的光线的第一颜色通道的值，所述第二颜色信号用于表征作用于所述滤光片区域对应像素的光线的第二颜色通道的值，所述第三颜色信号用于表征作用于所述滤光片区域对应像素的光线的第三颜色通道的值；所述处理器还用于处理所述第一颜色信号、所述第二颜色信号和所述第三颜色信号以得到用于表征所述滤光片区域的色彩值的多个第二中间图像，融合所述第一中间图像与所述第二中间图像以得到第一目标图像。
本申请实施方式的信号处理方法，用于图像传感器，所述图像传感器包括滤光片阵列和像素阵列；所述滤光片阵列包括多个滤光片区域，每个所述滤光片区域包括多个滤光片单元，每个所述滤光片单元包括至少一个第一颜色滤光片、至少一个第二颜色滤光片和至少一个第三颜色滤光片；所述像素阵列包括多个像素，每个所述像素对应所述滤光片阵列的一个滤光片，所述像素用于接收穿过对应的所述滤光片的光线以生成电信号。所述信号处理方法包括：将每个所述滤光片单元对应的像素产生的电信号合并输出以作为合并亮度值并形成第一中间图像，所述合并亮度值用于表征作用于所述滤光片单元对应像素的光线的亮度；根据每个所述滤光片区域对应的像素产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，所述第一颜色信号用于表征作用于所述滤光片区域对应像素的光线的第一颜色通道的值，所述第二颜色信号用于表征作用于所述滤光片区域对应像素的光线的第二颜色通道的值，所述第三颜色信号用于表征作用于所述滤光片区域对应像素的光线的第三颜色通道的值；处理所述第一颜色信号、所述第二颜色信号和所述第三颜色信号以得到用于表征所述滤光片区域的色彩值的多个第二中间图像；融合所述第一中间图像与所述第二中间图像以得到第一目标图像。
本申请实施方式的附加方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本申请的实践了解到。
附图说明
本申请的上述和/或附加的方面和优点可以从结合下面附图对实施方式的描述中将变得明显和容易理解，其中：
图1和图2是本申请某些实施方式的图像传感器的示意图；
图3和图4是本申请某些实施方式的滤光片阵列的部分滤光片的排布示意图；
图5是本申请某些实施方式的图像传感器的示意图；
图6至图8是本申请某些实施方式的滤光片阵列的部分滤光片的排布示意图；
图9至图11是本申请某些实施方式的图像传感器的工作原理示意图；
图12是现有技术中包括以拜耳阵列形式排布的滤光片阵列的图像传感器的工作原理示意图；
图13至图15是本申请某些实施方式的滤光片阵列的部分滤光片的排布示意图；
图16至图19是本申请某些实施方式的图像传感器的工作原理示意图；
图20是本申请某些实施方式的处理电路的部分结构示意图；
图21是本申请某些实施方式的成像装置的示意图；
图22是本申请某些实施方式的电子设备的示意图；
图23是本申请某些实施方式的图像处理***的示意图；
图24是本申请某些实施方式的信号处理方法的流程示意图；
图25是本申请某些实施方式的计算机设备中的图像处理电路的示意图。
具体实施方式
下面详细描述本申请的实施方式，实施方式的示例在附图中示出，其中，相同或类似的标号自始至终表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施方式是示例性的，仅用于解释本申请，而不能理解为对本申请的限制。
请参阅图1至图3，本申请提供一种图像传感器10。图像传感器10包括滤光片阵列11、像素阵列12和处理电路13。滤光片阵列11包括多个滤光片区域111，每个滤光片区域111包括多个滤光片单元1111。每个滤光片单元1111包括至少一个第一颜色滤光片A、至少一个第二颜色滤光片B和至少一个第三颜色滤光片C。像素阵列12包括多个像素120，每个像素120对应滤光片阵列11的一个滤光片110，像素120用于接收穿过对应的滤光片110的光线以生成电信号。处理电路13设置在具有像素阵列12的衬底14上。处理电路13用于将每个滤光片单元1111对应的像素120产生的电信号合并输出以作为合并亮度值并形成第一中间图像，合并亮度值用于表征作用于滤光片单元1111对应像素120的光线的亮度。处理电路13还用于根据每个滤光片区域111对应的像素120产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，第一颜色信号用于表征作用于滤光片区域111对应像素120的光线的第一颜色通道的值，第二颜色信号用于表征作用于滤光片区域111对应像素120的光线的第二颜色通道的值，第三颜色信号用于表征作用于滤光片区域111对应像素120的光线的第三颜色通道的值。处理电路13还用于处理第一颜色信号、第二颜色信号和第三颜色信号以得到用于表征滤光片区域111的色彩值的多个第二中间图像，及用于融合第一中间图像与第二中间图像以得到第一目标图像。
本申请实施方式的图像传感器10中，由于合并亮度值是由每个滤光片单元1111对应的所有像素120的电信号合并输出的，其中，多个像素120的电信号合并输出相当于增大了像素的感光面积，从而能够提高像素的感光能力，因此获取到的合并亮度值更加准确，采用合并亮度值形成的第一目标图像也更加准确。另外，由于颜色信号(第一颜色信号、第二颜色信号和第三颜色信号)是由滤光片区域111对应的像素120产生的，因此，相对于由单个像素120产生颜色信号(尤其是低亮环境下)而言，本申请的颜色信号也更加准确。
请再次参阅图3，每个滤光片区域111中的滤光片单元1111的数量可以均为M*M，其中，M为大于或等于2的整数，示例地，M的取值可以为2、3、4、5、6、7、8、9、10、15、20等等，在此不作限制。其中，在M比较大时，滤光片区域111对应的第一颜色信号、第二颜色信号和第三颜色信号越准确，在M比较小时，同样大小的滤光片阵列11能够获取的图像的分辨率更高。每个滤光片单元1111中的滤光片110的数量可以均为N*N，其中，N为大于或等于2的整数，示例地，N的取值可以为2、3、4、5、6、7、8、9、10、15、20等等，在此不作限制。其中，在N比较大时，滤光片单元1111对应的合并亮度值更加，在N比较小时，同样大小的滤光片阵列11能够获取的图像的分辨率更高。M和N可以相同或不同。例如，每个滤光片区域111中的滤光片单元1111的数量可以均为2*2，每个滤光片单元1111中的滤光片110的数量可以均为2*2，此时第一颜色信号、第二颜色信号、第三颜色信号和合并亮度值均比较准确，图像的分辨率也比较高。当然，每个滤光片区域111中的滤光片单元1111的数量也可以均为3*3或均为4*4等。每个滤光片单元1111中的滤光片110的数量也可以均为3*3或均为4*4等。
本申请实施方式的图像传感器10中，每个滤光片单元1111中的第一颜色滤光片A的数量、第二颜色滤光片B的数量和第三颜色滤光片C的数量具有比值，多个滤光片单元1111的比值均相同。例如，每个滤光片单元1111中的第一颜色滤光片A的数量、第二颜色滤光片B的数量和第三颜色滤光片C的数量的比值均为2：1：1。又例如，每个滤光片单元1111中的第一颜色滤光片A的数量、第二颜色滤光片B的数量和第三颜色滤光片C的数量的比值均为5：2：2。
在本申请实施方式中，第一颜色滤光片A可以为绿色滤光片G，第二颜色滤光片B可以为红色滤光片R，第三颜色滤光片C可以为蓝色滤光片Bu。以每个滤光片单元1111中的第一颜色滤光片A的数量、第二颜色滤光片B的数量和第三颜色滤光片C的数量的比值均为2：1：1为例，此时每个滤光片单元1111中的绿色滤光片G、红色滤光片R和蓝色滤光片Bu的数量比值均为2：1：1，即合并亮度值 为R+2G+B，与亮度信号的计算方式(y＝0.299R+0.586G+0.114B)类似，此时获得的合并亮度值更加准确。
在某些实施方式中，滤光片阵列11包括多个第一滤光片组1131及多个第二滤光片组1132，第一滤光片组1131包括数量相同的多个第一颜色滤光片A和多个第二颜色滤光片B，第二滤光片组1132包括数量相同的多个第一颜色滤光片A和多个第三颜色滤光片C；所有第一滤光片组1131与所有第二滤光片组1132排列形成的子阵列为滤光片阵列11的一部分；或所有滤光片区域111排列形成的子阵列为滤光片阵列11的一部分；在低亮模式下，图像传感器10用于获取第一目标图像；在纹理清晰模式下，处理电路13用于将第一滤光片组1131对应的像素120产生的电信号合并生成第一像素信号和第三像素信号，第一像素信号用于表征作用于第一滤光片组1131对应像素120的光线的第一颜色通道的值，第三像素信号用于表征作用于第一滤光片组1131对应像素120的光线的第二颜色通道的值，处理电路13还用于将第二滤光片组1132对应的像素120产生的电信号合并生成第二像素信号和第四像素信号，第二像素信号用于表征作用于第二滤光片组1132对应像素120的光线的第一颜色通道的值，第四像素信号用于表征作用于第二滤光片组1132对应像素120的光线的第三颜色通道的值，处理电路13还用于根据第一像素信号、第二像素信号、第三像素信号和第四像素信号得到第二目标图像。
在某些实施方式中，若滤光片阵列11制造时是以滤光片区域111为单位进行制造的，则所有第一滤光片组1131与所有第二滤光片组1132排列形成的子阵列为滤光片阵列11的一部分。在获取第一目标图像时，所有像素120所产生的电信号都会被读出。在获取第二目标图像时，第一行和/或第一列的像素120所产生的电信号不被读出。以图3的滤光片阵列11为例，则在获取第二目标图像时，第一行和最后一行的像素120所产生的电信号不被读出，或第一列和最后一列的像素120所产生的电信号不被读出。
例如，以每个滤光片单元1111中的第一颜色滤光片A的数量、第二颜色滤光片B的数量和第三颜色滤光片C的数量的比值均为2：1：1为例，则一个滤光片单元1111中的一个第一颜色滤光片A、一个第二颜色滤光片B和另外一个滤光片单元1111中的一个第一颜色滤光片A、一个第二颜色滤光片B组合形成第一滤光片组1131；一个滤光片单元1111中的一个第一颜色滤光片A、一个第三颜色滤光片C和另外一个滤光片单元1111中的一个第一颜色滤光片A、一个第二颜色滤光片C组合形成第二滤光片组1132。
在某些实施方式中，若滤光片阵列11制造时是以第一滤光片组1131、第二滤光片组1132为单位进行制造的，则所有滤光片区域111排列形成的子阵列为滤光片阵列11的一部分。在获取第一目标图像时，第一行和/或第一列的像素120所产生的电信号不被读出。在获取第二目标图像时，所有像素120所产生的电信号都会被读出。以图4的滤光片阵列11为例，则在获取第一目标图像时，第一行和最后三行的像素120所产生的电信号不被读出，或第一列和最后三列的像素120所产生的电信号不被读出。
在本申请实施方式中，用户可通过选择想要的模式以进行模式切换，例如显示界面显示低亮模式和纹理清晰模式，用户选中低亮模式则输出第一目标图像，用户选中纹理清晰模式则输出第二目标图像。如此，可以通过同一个滤光片阵列11分别实现低亮模式和纹理清晰模式的切换。在低亮模式中，由于合并亮度值是由每个滤光片单元1111对应的所有像素120的电信号合并输出的，颜色信号是由滤光片区域111对应的像素120产生的，因此，低亮模式在低亮环境下仍然能够准确、有效地获取图像，即低亮模式能够适用于低亮环境。在纹理清晰模式中，由于第一滤光片组1131和第二滤光片组1132中均具有第一颜色滤光片A，使得第一滤光片组1131对应的像素120和第二滤光片组1132对应的像素120均能够生成具有第一颜色通道的值的像素信号。由此，在第二目标图像的生成过程中，第一颜色通道的值不需要进行插值处理，彩色图像的色彩还原度更加准确。
请参阅图2和图5，本申请实施方式的图像传感器10包括微透镜阵列15、滤光片阵列11、及像素阵列12。沿图像传感器10的收光方向，微透镜阵列15、滤光片阵列11、及像素阵列12依次设置。
滤光片阵列11包括多个第一滤光片组1131和多个第二滤光片组1132。第一滤光片组1131包括数量相同的多个第一颜色滤光片A和多个第二颜色滤光片B。第二滤光片组1132包括数量相同的多个第一颜色滤光片A和多个第三颜色滤光片C。
像素阵列12包括多个像素120，每个像素120对应滤光片阵列11的一个滤光片110，像素120用于接收穿过对应的滤光片110的光线以生成电信号。
微透镜阵列15包括多个微透镜组151。微透镜阵列15中的一个微透镜组151对应一个滤光片组113(第一滤光片组1131或第二滤光片组1132)，并与该一个滤光片组113对应的多个像素120对应。如图2所示，每个微透镜组151均包括多个微透镜150，每个微透镜150对应一个滤光片110及一个像素120。如图5所示，每个微透镜组151均包括一个微透镜150，每个微透镜150对应一个滤光片组113，并与该一个滤光片组113对应的多个像素120对应。
图4、图6至图8是本申请多个实施例的滤光片阵列11中部分滤光片110的排布示意图。图4、图6至图8所示的滤光片阵列11中，每个滤光片阵列11均包括多个第一滤光片组1131和多个第二滤光片组1132。每个第一滤光片组1131包括数量相同的多个第一颜色滤光片A和多个第二颜色滤光片B。每个第二滤光片组1132包括数量相同的多个第一颜色滤光片A和多个第三颜色滤光片C。
其中，第一颜色滤光片A可以为绿色滤光片G，第二颜色滤光片B可以为红色滤光片R，第三颜色滤光片C可以为蓝色滤光片Bu。
其中，多个第一滤光片组1131可以设置在第一对角线方向D1，多个第二滤光片组1132可以设置在第二对角线方向D2，第一对角线方向D1与第二对角线方向D2不同。在一个例子中，当多个第一滤光片组1131设置在第一对角线方向D1，多个第二滤光片组1132设置在第二对角线方向D2时，第一滤光片组1131与第二滤光片组1132可以在图像传感器10的垂直方向和水平方向相邻布置。
其中，每个第一滤光片组1131中的滤光片110的数量均为K*K，每个第二滤光片组1132中的滤光片110的数量均为K*K，其中，K为大于或等于2的整数。示例地，K的取值可以为2、3、4、5、6、7、8、9、10、15、20等等，在此不作限制。
其中，每个第一滤光片组1131中的多个滤光片110的排布方式可以是：(1)请参阅图4，多个第一颜色滤光片A及多个第二颜色滤光片B在图像传感器10的垂直方向和水平方向相邻布置；(2)请参阅图6，多个滤光片110逐行排列，且同一行中的多个滤光片110的颜色相同；(3)请参阅图7，多个滤光片110逐列排列，且同一列中的多个滤光片110的颜色相同。当然，每个第一滤光片组1131中多个滤光片110的排布方式并不限于此。
其中，每个第二滤光片组1132中的多个滤光片110的排布方式可以是：(1)请参阅图4，多个第一颜色滤光片A及多个第三颜色滤光片C在图像传感器10的垂直方向和水平方向相邻布置；(2)请参阅图6，多个滤光片110逐行排列，且同一行中的多个滤光片110的颜色相同；(3)请参阅图7，多个滤光片110逐列排列，且同一列中的多个滤光片110的颜色相同。当然，每个第二滤光片组1132中多个滤光片110的排布方式并不限于此。
图4是本申请一个实施例的滤光片阵列11中部分滤光片110的排布示意图。请参阅图4，部分滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000001
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。每个第一滤光片组1131中的滤光片110的数量均为2*2，每个第二滤光片组1132中的滤光片110的数量均为2*2。
如图4所示，多个第一滤光片组1131设置在第一对角线方向D1(例如图4中滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片组1132设置在第二对角线方向D2(例如图4中滤光片阵列11的左下角与右上角连接的方向)，第一对角线方向D1与第二对角线方向D2不同，例如，第一对角线方向D1与第二对角线方向D2垂直。
需要说明的是，第一对角线方向D1和第二对角线方向D2并不局限于对角线，还包括平行于对角线的方向。这里的“方向”并非单一指向，可以理解为指示排布的“直线”的概念，可以有直线两端的双向指向。此外，在其他实施例中，第一对角线方向D1也可以是滤光片阵列11的左下角与右上角连接的方向，第二对角线方向D2也可以是滤光片阵列11的左上角与右下角连接的方向，此时，第一滤光片组1131及第二滤光片组1132的位置对应对角线方向的变换做变换。
如图4所示，第一滤光片组1131与第二滤光片组1132在图像传感器10(图2所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片组113在垂直方向V上按照第一滤光 片组1131、第二滤光片组1132的顺序呈周期性排列，多个滤光片组113在水平方向H上按照第一滤光片组1131、第二滤光片组1132的顺序呈周期性排列。
需要说明的是，第一滤光片组1131与第二滤光片组1132在垂直方向V上相邻布置，且在水平方向H上也相邻布置并不限于图4的方式，还可以是：多个滤光片组113在垂直方向V上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列(从左至右，从上至下来看，下同)，多个滤光片组113在水平方向H上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列(从左至右，从上至下来看，下同)。
如图4所示，在第一滤光片组1131中，多个第一颜色滤光片A及多个第二颜色滤光片B在垂直方向V和水平方向H上相邻布置。也即，在垂直方向V上，第一颜色滤光片A和第二颜色滤光片B交替排列，且在水平方向H上，第一颜色滤光片A和第二颜色滤光片B交替排列。在第二滤光片组1132中，多个第一颜色滤光片A及多个第三颜色滤光片C在垂直方向V和水平方向H上相邻布置。也即，在垂直方向V上，第一颜色滤光片A和第三颜色滤光片C交替排列，且在水平方向H上，第一颜色滤光片A和第三颜色滤光片C交替排列。
图4所示的滤光片阵列11中，若缺省第一行或第一列的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000002
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括2*2个滤光片110。每个滤光片单元1111包括两个第一颜色滤光片A、一个第二颜色滤光片B和一个第三颜色滤光片C。
在某些实施方式中，滤光片阵列11中部分滤光片110的排布方式还可以为：
Figure PCTCN2020078212-appb-000003
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。每个第一滤光片组1131中的滤光片110的数量均为3*3，每个第二滤光片组1132中的滤光片110的数量均为3*3。
在此排布方式下，多个第一滤光片组1131设置在第一对角线方向D1(例如滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片组1132设置在第二对角线方向D2(例如滤光片阵列11的左下角与右上角连接的方向)，第一对角线方向D1与第二对角线方向D2不同，例如，第一对角线方向D1与第二对角线方向D2垂直。
在此排布方式下，第一滤光片组1131与第二滤光片组1132在图像传感器10(图2所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片组113在垂直方向V上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列，多个滤光片组113在水平方向H上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列。
在此排布方式下，在第一滤光片组1131中，多个第一颜色滤光片A及多个第二颜色滤光片B在垂直方向V和水平方向H上相邻布置。也即，在垂直方向V上，第一颜色滤光片A和第二颜色滤光片B交替排列，且在水平方向H上，第一颜色滤光片A和第二颜色滤光片B交替排列。在第二滤光片组1132中，多个第一颜色滤光片A及多个第三颜色滤光片C在垂直方向V和水平方向H上相邻布置。也即，在垂直方向V上，第一颜色滤光片A和第三颜色滤光片C交替排列，且在水平方向H上，第一颜色滤光片A和第三颜色滤光片C交替排列。
上述所示的滤光片阵列11中，若缺省第一行的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000004
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括3*3个滤光片110。有些滤光片单元1111可以包括五个第一颜色滤光片A、三个第二颜色滤光片B和一个第三颜色滤光片C。有些滤光片单元1111可以包括五个第一颜色滤光片A、一个第二颜色滤光片B和三个第三颜色滤光片C。
若缺省第一列的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000005
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括3*3个滤光片110。有些滤光片单元1111可以包括五个第一颜色滤光片A、三个第二颜色滤光片B和一个第三颜色滤光片C。有些滤光片单元1111可以包括五个第一颜色滤光片A、一个第二颜色滤光片B和三个第三颜色滤光片C。
在某些实施方式中，滤光片阵列11中部分滤光片110的排布方式还可以为：
Figure PCTCN2020078212-appb-000006
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。每个第一滤光片组1131中的滤光片110的数量均为4*4，每个第二滤光片组1132中的滤光片110的数量均为4*4。
在此排布方式下，多个第一滤光片组1131设置在第一对角线方向D1(例如滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片组1132设置在第二对角线方向D2(例如滤光片阵列11的左下角与右上角连接的方向)，第一对角线方向D1与第二对角线方向D2不同，例如，第一对角线方向D1与第二对角线方向D2垂直。
在此排布方式下，第一滤光片组1131与第二滤光片组1132在图像传感器10(图2所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片组113在垂直方向V上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列，多个滤光片组113在水平方向H上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列。
在此排布方式下，在第一滤光片组1131中，多个第一颜色滤光片A及多个第二颜色滤光片B在垂直方向V和水平方向H上相邻布置。也即，在垂直方向V上，第一颜色滤光片A和第二颜色滤光片B交替排列，且在水平方向H上，第一颜色滤光片A和第二颜色滤光片B交替排列。在第二滤光片组1132中，多个第一颜色滤光片A及多个第三颜色滤光片C在垂直方向V和水平方向H上相邻布置。也即，在垂直方向V上，第一颜色滤光片A和第三颜色滤光片C交替排列，且在水平方向H上，第一颜色滤光片A和第三颜色滤光片C交替排列。
上述所示的滤光片阵列11中，若缺省第一行的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000007
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括4*4个滤光片110。有些滤光片单元1111可以包括八个第一颜色滤光片A、六个第二颜色滤光片B和两个第三颜色滤光片C。有些滤光片单元1111可以包括八个第一颜色滤光片A、两个第二颜色滤光片B和六个第三颜色滤光片C。
若缺省第一列的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000008
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括4*4个滤光片110。有些滤光片单元1111可以包括八个第一颜色滤光片A、六个第二颜色滤光片B和两个第三颜色滤光片C。有些滤光片单元1111可以包括八个第一颜色滤光片A、两个第二颜色滤光片B和六个第三颜色滤光片C。
图6是本申请又一个实施例的滤光片阵列11中部分滤光片110的排布示意图。请参阅图6部分滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000009
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。每个第一滤光片组1131中的滤光片110的数量均为2*2，每个第二滤光片组1132中的滤光片110的数量均为2*2。
如图6所示，多个第一滤光片组1131设置在第一对角线方向D1(例如图6中滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片组1132设置在第二对角线方向D2(例如图6中滤光片阵列11的左下角与右上角连接的方向)，第一对角线方向D1与第二对角线方向D2不同，例如，第一对角线方向D1与第二对角线方向D2垂直。
如图6所示，第一滤光片组1131与第二滤光片组1132在图像传感器10(图2所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片组113在垂直方向V上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列，多个滤光片组113在水平方向H上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列。
如图6所示，在第一滤光片组1131中，多个滤光片110逐行排列，且同一行中的多个滤光片110的颜色相同，例如，第一行的多个滤光片110均为第一颜色滤光片A，第二行的多个滤光片110均为第二颜色滤光片B。在第二滤光片组1132中，多个滤光片110逐行排列，且同一行中的多个滤光片110的颜色相同，例如，第一行的多个滤光片110均为第一颜色滤光片A，第二行的多个滤光片110均为第 三颜色滤光片C。
图6所示的滤光片阵列11中，若缺省第一列的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000010
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括2*2个滤光片110。每个滤光片单元1111包括两个第一颜色滤光片A、一个第二颜色滤光片B和一个第三颜色滤光片C。
在某些实施方式中，滤光片阵列11中部分滤光片110的排布方式还可以为：
Figure PCTCN2020078212-appb-000011
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。每个第一滤光片组1131中的滤光片110的数量均为3*3，每个第二滤光片组1132中的滤光片110的数量均为3*3。
在此排布方式下，多个第一滤光片组1131设置在第一对角线方向D1(例如滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片组1132设置在第二对角线方向D2(例如滤光片阵列11的左下角与右上角连接的方向)，第一对角线方向D1与第二对角线方向D2不同，例如，第一对角线方向D1与第二对角线方向D2垂直。
在此排布方式下，第一滤光片组1131与第二滤光片组1132在图像传感器10(图2所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片组113在垂直方向V上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列，多个滤光片组113在水平方向H上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列。
在此排布方式下，在第一滤光片组1131中，多个滤光片110逐行排列，且同一行中的多个滤光片110的颜色相同，例如，第一行的多个滤光片110均为第一颜色滤光片A，第二行的多个滤光片110均为第二颜色滤光片B，第三行的多个滤光片110均为第一颜色滤光片A。在第二滤光片组1132中，多个滤光片110逐行排列，且同一行中的多个滤光片110的颜色相同，例如，第一行的多个滤光片110均为第一颜色滤光片A，第二行的多个滤光片110均为第三颜色滤光片C，第三行的多个滤光片110均为第一颜色滤光片A。
上述所示的滤光片阵列11中，若缺省第一列的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000012
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括3*3个滤光片110。有些滤光片单元1111可以包括五个第一颜色滤光片A、三个第二颜色滤光片B和一个第三颜色滤光片C。有些滤光片单元1111可以包括五个第一颜色滤光片A、一个第二颜色滤光片B和三个第三颜色滤光片C。
在某些实施方式中，滤光片阵列11中部分滤光片110的的排布方式还可以为：
Figure PCTCN2020078212-appb-000013
Figure PCTCN2020078212-appb-000014
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。每个第一滤光片组1131中的滤光片110的数量均为4*4，每个第二滤光片组1132中的滤光片110的数量均为4*4。
在此排布方式下，多个第一滤光片组1131设置在第一对角线方向D1(例如滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片组1132设置在第二对角线方向D2(例如滤光片阵列11的左下角与右上角连接的方向)，第一对角线方向D1与第二对角线方向D2不同，例如，第一对角线方向D1与第二对角线方向D2垂直。
在此排布方式下，第一滤光片组1131与第二滤光片组1132在图像传感器10(图2所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片组113在垂直方向V上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列，多个滤光片组113在水平方向H上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列。
在此排布方式下，在第一滤光片组1131中，多个滤光片110逐行排列，且同一行中的多个滤光片110的颜色相同，例如，第一行的多个滤光片110均为第一颜色滤光片A，第二行的多个滤光片110均为第二颜色滤光片B，第三行的多个滤光片110均为第一颜色滤光片A，第四行的多个滤光片110均为第二颜色滤光片B。在第二滤光片组1132中，多个滤光片110逐行排列，且同一行中的多个滤光片110的颜色相同，例如，第一行的多个滤光片110均为第一颜色滤光片A，第二行的多个滤光片110均为第三颜色滤光片C，第三行的多个滤光片110均为第一颜色滤光片A，第四行的多个滤光片110均为第三颜色滤光片C。
上述所示的滤光片阵列11中，若缺省第一列的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000015
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括4*4个滤光片110。有些滤光片单元1111可以包括八个第一颜色滤光片A、六个第二颜色滤光片B和两个第三颜色滤光片C。有些滤光片单元1111可以包括八个第一颜色滤光片A、两个第二颜色滤光片B和六个第三颜色滤光片C。
图7是本申请又一个实施例的滤光片阵列11中部分滤光片110的排布示意图。请参阅图7，部分滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000016
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。每个第一滤光片组1131中的滤光片110的数量均为2*2，每个第二滤光片组1132中的滤光片110的数量均为2*2。
如图7所示，多个第一滤光片组1131设置在第一对角线方向D1(例如图7中滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片组1132设置在第二对角线方向D2(例如图7中滤光片阵 列11的左下角与右上角连接的方向)，第一对角线方向D1与第二对角线方向D2不同，例如，第一对角线方向D1与第二对角线方向D2垂直。
如图7所示，第一滤光片组1131与第二滤光片组1132在图像传感器10(图2所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片组113在垂直方向V上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列，多个滤光片组113在水平方向H上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列。
如图7所示，在第一滤光片组1131中，多个滤光片110逐列排列，且同一列中的多个滤光片110的颜色相同，例如，第一列的多个滤光片110均为第一颜色滤光片A，第二列的多个滤光片110均为第二颜色滤光片B。在第二滤光片组1132中，多个滤光片110逐列排列，且同一列中的多个滤光片110的颜色相同，例如，第一列的多个滤光片110均为第一颜色滤光片A，第二列的多个滤光片110均为第三颜色滤光片C。
图7所示的滤光片阵列11中，若缺省第一行的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000017
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括2*2个滤光片110。每个滤光片单元1111包括两个第一颜色滤光片A、一个第二颜色滤光片B和一个第三颜色滤光片C。
在某些实施方式中，滤光片阵列11中部分滤光片110的排布方式还可以为：
Figure PCTCN2020078212-appb-000018
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。每个第一滤光片组1131中的滤光片110的数量均为3*3，每个第二滤光片组1132中的滤光片110的数量均为3*3。
在此排布方式下，多个第一滤光片组1131设置在第一对角线方向D1(例如中滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片组1132设置在第二对角线方向D2(例如滤光片阵列11的左下角与右上角连接的方向)，第一对角线方向D1与第二对角线方向D2不同，例如，第一对角线方向D1与第二对角线方向D2垂直。
在此排布方式下，第一滤光片组1131与第二滤光片组1132在图像传感器10(图2所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片组113在垂直方向V上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列，多个滤光片组113在水平方向H上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列。
在此排布方式下，在第一滤光片组1131中，多个滤光片110逐列排列，且同一列中的多个滤光片110的颜色相同，例如，第一列的多个滤光片110均为第一颜色滤光片A，第二列的多个滤光片110均为第二颜色滤光片B，第三列的多个滤光片110均为第一颜色滤光片A。在第二滤光片组1132中，多个滤光片110逐列排列，且同一列中的多个滤光片110的颜色相同，例如，第一列的多个滤光片110均为第一颜色滤光片A，第二列的多个滤光片110均为第三颜色滤光片C，第三列的多个滤光片110均为第一颜色滤光片A。
上述所示的滤光片阵列11中，若缺省第一行的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000019
Figure PCTCN2020078212-appb-000020
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括3*3个滤光片110。有些滤光片单元1111可以包括五个第一颜色滤光片A、三个第二颜色滤光片B和一个第三颜色滤光片C。有些滤光片单元1111可以包括五个第一颜色滤光片A、一个第二颜色滤光片B和三个第三颜色滤光片C。
在某些实施方式中，滤光片阵列11中部分滤光片110的排布方式还可以为：
Figure PCTCN2020078212-appb-000021
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。每个第一滤光片组1131中的滤光片110的数量均为4*4，每个第二滤光片组1132中的滤光片110的数量均为4*4。
在此排布方式下，多个第一滤光片组1131设置在第一对角线方向D1(例如滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片组1132设置在第二对角线方向D2(例如滤光片阵列11的左下角与右上角连接的方向)，第一对角线方向D1与第二对角线方向D2不同，例如，第一对角线方向D1与第二对角线方向D2垂直。
在此排布方式下，第一滤光片组1131与第二滤光片组1132在图像传感器10(图2所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片组113在垂直方向V上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列，多个滤光片组113在水平方向H上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列。
在此排布方式下，在第一滤光片组1131中，多个滤光片110逐列排列，且同一列中的多个滤光片110的颜色相同，例如，第一列的多个滤光片110均为第一颜色滤光片A，第二列的多个滤光片110均为第二颜色滤光片B，第三列的多个滤光片110均为第一颜色滤光片A，第四列的多个滤光片110均为第二颜色滤光片B。在第二滤光片组1132中，多个滤光片110逐列排列，且同一列中的多个滤光片110的颜色相同，例如，第一列的多个滤光片110均为第一颜色滤光片A，第二列的多个滤光片110均为第三颜色滤光片C，第三列的多个滤光片110均为第一颜色滤光片A，第四列的多个滤光片110均为第三颜色滤光片C。
上述所示的滤光片阵列11中，若缺省第一行的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000022
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括4*4个滤光片110。有些滤光片单元1111可以包括八个第一颜色滤光片A、六个第二颜色滤光片B和两个第三颜色滤光片C。有些滤光片单元1111可以包括八个第一颜色滤光片A、两个第二颜色滤光片B和六个第 三颜色滤光片C。
图8是本申请又一个实施例的滤光片阵列11中部分滤光片110的排布示意图。请参阅图8，部分滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000023
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。每个第一滤光片组1131中的滤光片110的数量均为2*2，每个第二滤光片组1132中的滤光片110的数量均为2*2。
如图8所示，多个第一滤光片组1131设置在第一对角线方向D1(例如图8中滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片组1132设置在第二对角线方向D2(例如图8中滤光片阵列11的左下角与右上角连接的方向)，第一对角线方向D1与第二对角线方向D2不同，例如，第一对角线方向D1与第二对角线方向D2垂直。
如图8所示，第一滤光片组1131与第二滤光片组1132在图像传感器10(图2所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片组113在垂直方向V上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列，多个滤光片组113在水平方向H上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列。
如图8所示，在第一滤光片组1131中，多个滤光片110逐列排列，且同一列中的多个滤光片110的颜色相同，例如，第一列的多个滤光片110均为第一颜色滤光片A，第二列的多个滤光片110均为第二颜色滤光片B。在第二滤光片组1132中，多个滤光片110逐行排列，且同一行中的多个滤光片110的颜色相同，例如，第一行的多个滤光片110均为第一颜色滤光片A，第二行的多个滤光片110均为第三颜色滤光片C。
图8所示的滤光片阵列11中，若缺省第一行和第一列的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000024
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括2*2个滤光片110。每个滤光片单元1111包括两个第一颜色滤光片A、一个第二颜色滤光片B和一个第三颜色滤光片C。
在某些实施方式中，滤光片阵列11中部分滤光片110的排布方式还可以为：
Figure PCTCN2020078212-appb-000025
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。每个第一滤光片组1131中的滤光片110的数量均为3*3，每个第二滤光片组1132中的滤光片110的数量均为3*3。
在此排布方式下，多个第一滤光片组1131设置在第一对角线方向D1(例如中滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片组1132设置在第二对角线方向D2(例如中滤光片阵列11的左下角与右上角连接的方向)，第一对角线方向D1与第二对角线方向D2不同，例如，第一对角线方向D1与第二对角线方向D2垂直。
在此排布方式下，第一滤光片组1131与第二滤光片组1132在图像传感器10(图2所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片组113在垂直方向V上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性 排列，多个滤光片组113在水平方向H上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列。
在此排布方式下，在第一滤光片组1131中，多个滤光片110逐行排列，且同一行中的多个滤光片110的颜色相同，例如，第一行的多个滤光片110均为第一颜色滤光片A，第二行的多个滤光片110均为第二颜色滤光片B，第三行的多个滤光片110均为第一颜色滤光片A。在第二滤光片组1132中，多个滤光片110逐列排列，且同一列中的多个滤光片110的颜色相同，例如，第一列的多个滤光片110均为第一颜色滤光片A，第二列的多个滤光片110均为第三颜色滤光片C，第三列的多个滤光片110均为第一颜色滤光片A。
上述所示的滤光片阵列11中，若缺省第一行和第一列的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000026
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括3*3个滤光片110。有些滤光片单元1111可以包括五个第一颜色滤光片A、三个第二颜色滤光片B和一个第三颜色滤光片C。有些滤光片单元1111可以包括五个第一颜色滤光片A、一个第二颜色滤光片B和三个第三颜色滤光片C。
在某些实施方式中，滤光片阵列11中部分滤光片110的排布方式还可以为：
Figure PCTCN2020078212-appb-000027
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。每个第一滤光片组1131中的滤光片110的数量均为4*4，每个第二滤光片组1132中的滤光片110的数量均为4*4。
在此排布方式下，多个第一滤光片组1131设置在第一对角线方向D1(例如滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片组1132设置在第二对角线方向D2(例如滤光片阵列11的左下角与右上角连接的方向)，第一对角线方向D1与第二对角线方向D2不同，例如，第一对角线方向D1与第二对角线方向D2垂直。
在此排布方式下，第一滤光片组1131与第二滤光片组1132在图像传感器10(图2所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片组113在垂直方向V上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列，多个滤光片组113在水平方向H上按照第一滤光片组1131及第二滤光片组1132的顺序或第二滤光片组1132及第一滤光片组1131的顺序呈周期性排列。
在此排布方式下，在第一滤光片组1131中，多个滤光片110逐列排列，且同一列中的多个滤光片110的颜色相同，例如，第一列的多个滤光片110均为第一颜色滤光片A，第二列的多个滤光片110均为第二颜色滤光片B，第三列的多个滤光片110均为第一颜色滤光片A，第四列的多个滤光片110均为第二颜色滤光片B。在第二滤光片组1132中，多个滤光片110逐行排列，且同一行中的多个滤光片110的颜色相同，例如，第一行的多个滤光片110均为第一颜色滤光片A，第二行的多个滤光片110均为第三颜色滤光片C，第三行的多个滤光片110均为第一颜色滤光片A，第四行的多个滤光片110均为第三颜色滤光片C。
上述所示的滤光片阵列11中，若缺省第一行和第一列的滤光片110，则滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000028
此时，每个滤光片区域111可以包括2*2个滤光片单元1111，每个滤光片单元1111包括4*4个滤光片110。有些滤光片单元1111可以包括八个第一颜色滤光片A、六个第二颜色滤光片B和两个第三颜色滤光片C。有些滤光片单元1111可以包括八个第一颜色滤光片A、两个第二颜色滤光片B和六个第三颜色滤光片C。
请结合图1至图8，本申请实施方式的图像传感器10中，每一个第一滤光片组1131对应的多个像素120产生的电信号均可以合并生成第一像素信号和第三像素信号。每一个第二滤光片组1132对应的多个像素120产生的电信号均可以合并生成第二像素信号和第四像素信号。
以图4所示的每个滤光片组113均包括2*2个滤光片110为例，此时每个滤光片组113对应四个像素120。请结合图2、图4和图9，第一滤光片组1131对应的四个像素120中，两个像素120能够接收穿过第一颜色滤光片A的光线以生成两个电信号，另外两个像素120能够接收穿过第二颜色滤光片B的光线以生成两个电信号。图像传感器10将接收穿过第一颜色滤光片A的光线的两个像素120生成的电信号合并以得到第一像素信号，并将接收穿过第二颜色滤光片B的光线的两个像素120生成的电信号合并以得到第三像素信号。其中，第一像素信号用于表征作用于第一滤光片组1131对应像素120的光线的第一颜色通道的值，第三像素信号用于表征作用于第一滤光片组1131对应像素120的光线的第二颜色通道的值。第二滤光片组1132对应的四个像素120中，两个像素120能够接收穿过第一颜色滤光片A的光线以生成两个电信号，另外两个像素120能够接收穿过第三颜色滤光片C的光线以生成两个电信号。图像传感器10将接收穿过第一颜色滤光片A的光线的两个像素120生成的电信号合并以得到第二像素信号，将接收穿过第三颜色滤光片C的光线的两个像素120生成的电信号合并以得到第四像素信号。其中，第二像素信号用于表征作用于第二滤光片组1132对应像素120的光线的第一颜色通道的值，第四像素信号用于表征作用于第二滤光片组1132对应像素120的光线的第三颜色通道的值。
由此，每个第一滤光片组1131对应的四个像素120可以组成一个第一合并像素，每个第一合并像素均可以生成第一像素信号及第三像素信号。每个第二滤光片组1132对应的四个像素120可以组成一个第二合并像素，每个第二合并像素均可以生成第二像素信号及第四像素信号。由于每个合并像素均可以输出具有第一颜色通道的值的像素信号(第一像素信号或第二像素信号)，仅部分合并像素可以输出具有第二颜色通道的值的第三像素信号，仅部分合并像素可以输出具有第三颜色通道的值的第四像素信号。因此，不能输出第三像素信号的合并像素需要进行插值处理，以计算获得该合并像素的第二颜色通道的值；不能输出第四像素信号的合并像素也需要进行插值处理，以计算获得该合并像素的第三颜色通道的值。如此，每个合并像素均能够获得第一颜色通道、第二颜色通道以及第三颜色通道的值，通过色彩空间计算即可生成彩色图像。
请参阅图12，现有的呈拜耳阵列排布的滤光片阵列中，每个滤光片对应的像素仅能生成具有一个颜色通道的值的像素信号。例如，左起第一行第一列的像素信号对应的像素仅具有第二颜色通道的值，该像素的第一颜色通道的值及第三颜色通道的值均需要通过插值得到；左起第一行第二列的像素信号对应的像素仅具有第一颜色通道的值，该像素的第二颜色通道的值及第三颜色通道的值均需要通过插值得到；左起第二行第二列的像素信号对应的像素仅具有第三颜色通道的值，该像素的第一颜色通道的值及第二颜色通道的值均需要通过插值得到。如此，一个像素信号对应的像素的其余多个颜色通道的值均需要经过插值处理来获取。然而，通过插值方式获取的像素信号的准确度不够高，会导致最终生成的彩色图像的色彩还原度不准确。此外，现有的呈拜耳阵列排布的滤光片阵列中，插值生成具有第一颜色通道的值的像素信号及插值生成具有第二颜色通道的值的像素信号时，大部分插值生成的像素信号仅能利用两个像素信号计算得到。示例地，在图12的仅包含具有第二颜色通道的值的像素信号的图像信号中，左起 第二行第三列的像素信号对应的像素不具有第二颜色通道的值，该像素的第二颜色通道的值需要通过与该像素相邻的具有第二颜色通道的值的像素的像素信号得到，即根据第一行第三列的具有第二颜色通道的值的像素信号及第三行第三列的具有第二颜色通道的值的像素信号得到；再例如，在图12的仅包含具有第三颜色通道的值的像素信号的图像信号中，左起第三行第二列的像素信号不具有第三颜色通道的值，该像素信号对应的像素的第三颜色通道的值需要通过与该像素相邻的具有第三颜色通道的值的像素的像素信号得到，即根据第二行第二列的具有第三颜色通道的值的像素信号及第四行第二列的具有第三颜色通道的值的像素信号得到。如此，用于插值生成像素信号的可以利用的像素信号的个数较少，插值后的像素信号的准确度不够高。
请结合图2、图2、图9至图11，本申请实施方式的图像传感器10中，与由多个像素120组成的像素阵列12的分辨率相比，由多个合并像素对应的像素信号组成的图像的分辨率有所降低，但是由于每个合并像素均具备具有第一颜色通道的值的像素信号，因此，第一颜色通道的值不需要进行插值处理，最终生成的彩色图像的色彩还原度会更加准确，并且由于像素阵列12的每个合并像素都直接获得了对应的第一颜色通道的像素信号，在后续的信号处理过程中可以获得更多的信息。
此外，请结合图2、图4、图9及图10，本申请实施方式的图像传感器10中，对于不能输出第三像素信号的合并像素进行插值处理时，大部分合并像素的第二颜色通道的值均能通过四个具有第二颜色通道的值的第三像素信号计算得到。例如，在图10所示的由多个第三像素信号形成的第二图像信号M2中，左起第二行第三列的第三像素信号可以根据左起第一行第三列的第三像素信号、左起第二行第二列的第三像素信号、左起第二行第四列的第三像素信号、左起第三行第三列的第三像素信号计算得到。在本申请实施方式的图像传感器10中，对于不能输出第四像素信号的合并像素进行插值处理时，大部分合并像素的第三颜色通道的值均能通过四个具有第三颜色通道的值的第四像素信号计算得到。例如，在图10所示的由多个第四像素信号形成的第三图像信号M3中，左起第三行第三列的第四像素信号可以根据左起第二行第三列的第四像素信号、左起第三行第二列的第四像素信号、左起第三行第四列的第四像素信号、左起第四行第三列的第四像素信号计算得到。由此，用于插值生成像素信号的可以利用的像素信号的个数较多，插值后的像素信号的准确度较高。
综上，本申请实施方式的图像传感器10中，每个第一滤光片组1131和每个第二滤光片组1132中均具有第一颜色滤光片A，使得第一滤光片组1131对应的像素120及第二滤光片组1132对应的像素120均能生成具有第一颜色通道的值的像素信号。由此，在彩色图像的生成过程中，第一颜色通道的值不需要进行插值处理，彩色图像的色彩还原度更加准确。并且，对第二颜色通道的值(或第三颜色通道的值)进行插值处理时，大部分待插值生成的第二颜色通道的值(或待插值生成的第三颜色通道的值)均能够借用相邻的四个具有第二颜色通道的值(或相邻的四个具有第三颜色通道的值)的像素信号计算得到，插值生成的具有第二颜色通道的值(或第三颜色通道的值)的像素信号的准确度较高，有利于进一步提升彩色图像的色彩还原的准确性。
图13至图15是本申请多个实施例的滤光片阵列11中部分滤光片110的排布示意图。图13至图15所示的滤光片阵列11中，每个滤光片单元1111包括两个第一颜色滤光片A、一个第二颜色滤光片B和一个第三颜色滤光片C。每个滤光片单元1111中的第二颜色滤光片B和第三颜色滤光片C互不相邻，每个滤光片区域111中，多个滤光片单元1111的滤光片110的排列顺序均不相同。如此，由于第二颜色滤光片B和第三颜色滤光片C互不相邻，并且多个滤光片单元1111的滤光片110的排列顺序均不相同，因此，滤光片阵列的排列顺序比较多样、比较随机，从而能够减少莫尔条纹和错误色彩的产生。
多个滤光片区域111包括多个第一滤光片区域1112和多个第二滤光片区域1114，第一滤光片区1112中的滤光片单元1111的排列顺序与第二滤光片区1114中的滤光片单元1111的排列顺序不同。
例如，本申请实施方式举例时所采用的第一滤光片区域1112的排布方式为：
Figure PCTCN2020078212-appb-000029
本申请实施方式举例时所采用的第二滤光片区域1114的排布方式为：
Figure PCTCN2020078212-appb-000030
Figure PCTCN2020078212-appb-000031
多个第一滤光片区域1112可以设置在第三对角线方向，多个第二滤光片区域1114可以设置在第四对角线方向，第三对角线方向与第四对角线方向不同。
多个第一滤光片区域1112和多个第二滤光片区域1114的排布方式可以是：(1)请参阅图13，第一滤光片区域1112与第二滤光片区域1114在图像传感器10的垂直方向和水平方向相邻布置；(2)请参阅图14，多个第一滤光片区域1112在图像传感器10的垂直方向相邻布置，多个第二滤光片区域1114在图像传感器10的垂直方向相邻布置；(3)请参阅图15，多个第一滤光片区域1112在图像传感器10的水平方向相邻布置，多个第二滤光片区域1114在图像传感器10的水平方向相邻布置。当然，多个第一滤光片区域1112和多个第二滤光片区域1114的排布方式并不限于此。
图13是本申请一个实施例的滤光片阵列11中部分滤光片110的排布示意图。请参阅图13，部分滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000032
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。
如图13所示，多个第一滤光片区域1112设置在第三对角线方向D3(例如图13中滤光片阵列11的左上角与右下角连接的方向)，多个第二滤光片区域1114设置在第四对角线方向D4(例如图13中滤光片阵列11的左下角与右上角连接的方向)，第三对角线方向D3与第四对角线方向D4不同，例如，第三对角线方向D3与第四对角线方向D4垂直。
需要说明的是，第三对角线方向D3和第四对角线方向D4并不局限于对角线，还包括平行于对角线的方向。这里的“方向”并非单一指向，可以理解为指示排布的“直线”的概念，可以有直线两端的双向指向。此外，在其他实施例中，第三对角线方向D3也可以是滤光片阵列11的左下角与右上角连接的方向，第四对角线方向D4也可以是滤光片阵列11的左上角与右下角连接的方向，此时，第一滤光片区域1112及第二滤光片区域1114的位置对应对角线方向的变换做变换。
如图13所示，第一滤光片区域1112与第二滤光片区域1114在图像传感器10(图13所示)的垂直方向V上相邻布置，且在水平方向H上也相邻布置。也即，多个滤光片区域111在垂直方向V上按照第一滤光片区域1112、第二滤光片区域1114的顺序呈周期性排列，多个滤光片区域111在水平方向H上按照第一滤光片区域1112、第二滤光片区域1114的顺序呈周期性排列。
需要说明的是，第一滤光片区域1112与第二滤光片区域1114在垂直方向V上相邻布置，且在水平方向H上也相邻布置并不限于图13的方式，还可以是：多个滤光片区域111在垂直方向V上按照第一滤光片区域1112及第二滤光片区域1114的顺序或第二滤光片区域1114及第一滤光片区域1112的顺序呈周期性排列(从左至右，从上至下来看，下同)，多个滤光片区域111在水平方向H上按照第一滤光片区域1112及第二滤光片区域1114的顺序或第二滤光片区域1114及第一滤光片区域1112的顺序呈周期性排列(从左至右，从上至下来看，下同)。
图14是本申请又一个实施例的滤光片阵列11中部分滤光片110的排布示意图。请参阅图14，部分滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000033
Figure PCTCN2020078212-appb-000034
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。
如图14所示，多个第一滤光片区域1112在图像传感器10的垂直方向V相邻布置，多个第二滤光片区域1114在图像传感器10的垂直方向V相邻布置。在图像传感器10的水平方向H上，多个滤光片区域111按照第一滤光片区域1112、第二滤光片区域1114的顺序呈周期性排列。
图15是本申请又一个实施例的滤光片阵列11中部分滤光片110的排布示意图。请参阅图15，部分滤光片110的排布方式为：
Figure PCTCN2020078212-appb-000035
其中，A为第一颜色滤光片，B为第二颜色滤光片，C为第三颜色滤光片。
如图15所示，多个第一滤光片区域1112在图像传感器10的水平方向H相邻布置，多个第二滤光片区域1114在图像传感器10的水平方向H相邻布置。在图像传感器10的垂直方向V上，多个滤光片区域111按照第一滤光片区域1112、第二滤光片区域1114的顺序呈周期性排列。
在某些实施方式中，处理电路13用于计算每个滤光片区域111中第一颜色滤光片A对应的像素120产生的电信号的平均值以作为第一颜色信号，计算每个滤光片区域111中第二颜色滤光片B对应的像素120产生的电信号的平均值以作为第二颜色信号，计算每个滤光片区域111中第三颜色滤光片C对应的像素120产生的电信号的平均值以作为第三颜色信号。
以每个滤光片区域111包括2*2个滤光片单元1111，每个滤光片单元1111包括两个第一颜色滤光片A、一个第二颜色滤光片B和一个第三颜色滤光片C为例，则每个滤光片区域111包括八个第一颜色滤光片A、四个第二颜色滤光片B和四个第三颜色滤光片C。若八个第一颜色滤光片A对应的像素120产生的电信号对应的像素值分别为41、47、43、37、45、39、35、33，则第一颜色信号为(41+47+43+37+45+39+35+33)/8＝40；若四个第二颜色滤光片B对应的像素120产生的电信号对应的像素值分别为24、26、25、27，则第二颜色信号为(24+26+25+27)/4＝25.5；若四个第三颜色滤光片C对应的像素120产生的电信号对应的像素值分别为52、54、54、52，则第二颜色信号为(52+54+54+52)/4＝53。
在某些实施方式中，处理电路13可用于对第一中间图像进行伽马校正处理。利用伽马校正处理第一中间图像，可以使得处理后的第一中间图像显示出来的亮度更适合用户观看。具体地，伽马校正可以采用f(I)＝I γ进行校正，其中f(I)为校正后的第一中间图像的亮度值，I为校正前的第一中间图像的亮度值，γ为第一校正系数。其中，当γ<1时，能够提高第一中间图像的低亮度区域的动态范围，降低第一中间图像的高亮区域的动态范围，第一中间图像的整体亮度变大。当γ>1时，能够降低第一中间图像的低亮度区域的动态范围，提高第一中间图像的高亮区域的动态范围，第一中间图像的整体亮度变小。用户可根据自身的观看需要，设置对应的校正系数γ，从而使得调整后的第一中间图像的显示效果更佳。
在某些实施方式中，处理电路13用于对第一颜色信号、第二颜色信号和第三颜色信号进行白平衡处理、色彩校正矩阵处理、伽马校正处理，将处理后的第一颜色信号、处理后的第二颜色信号和处理后的第三颜色信号转换至色亮分离空间以得到第二中间图像。通过白平衡处理、色彩校正矩阵处理以及伽马校正处理后，第一颜色信号、第二颜色信号和第三颜色信号更加准确，从而转换至色亮分离空间所得到的第二中间图像也更加准确。白平衡处理可以采用灰色世界法、基于动态阈值的自动白平衡法、镜面法等算法实现，可以根据不同的拍摄场景或根据用户的选择采用不同的白平衡算法，从而使得处理后的 颜色信号更加准确、更加符合用户观看需求。
色彩校正矩阵可以为：
Figure PCTCN2020078212-appb-000036
其中，R′是指经过色彩校正矩阵校正后的第二颜色信号，G′是指经过色彩校正矩阵校正后的第一颜色信号，B′是指经过色彩校正矩阵校正后的第三颜色信号，CMC11、CMC12、CMC13、CMC21、CMC22、CMC23、CMC31、CMC32、CMC33共同形成校正矩阵，R是指经过色彩校正矩阵校正前的第二颜色信号，G是指经过色彩校正矩阵校正前的第一颜色信号，B是指经过色彩校正矩阵校正前的第三颜色信号。其中，校正矩阵可根据调整前的第一颜色信号、第二颜色信号及第三颜色信号所对应的色温进行选取，从而使得第一颜色信号、第二颜色信号及第三颜色信号经过色彩校正矩阵处理后更加准确。
伽马校正也可以采用f(I)＝I γ进行校正，其中f(I)为校正后的第一颜色信号、第二颜色信号及第三颜色信号，I为校正前的第一颜色信号、第二颜色信号及第三颜色信号，γ为第二校正系数。第二校正系数与第一校正系数可以相同或不同，在此不做具体限定。
将处理后的第一颜色信号、处理后的第二颜色信号和处理后的第三颜色信号转换至色亮分离空间以得到第二中间图像。具体地，可以采用以下计算公式进行转换：Y＝0.257*R+0.564*G+0.098*B+16，Cb＝-0.148*R-0.291*G+0.439*B+128，Cr＝0.439*R-0.368*G-0.071*B+128，其中，Y为亮度值，Cb为蓝色分量，Cr为红色分量，R为处理后的第二颜色信号，G为处理后的第一颜色信号，B为处理后的第三颜色信号。其中，第二中间图像可以包括两帧，两帧第二中间图像分别为蓝色分量对应的第二中间图像和红色分量对应的第二中间图像。
当然，也可以采用以下计算公式将处理后的第一颜色信号、处理后的第二颜色信号和处理后的第三颜色信号转换至色亮分离空间：Y＝0.29900*R+0.58700*G+0.11400*B，Cb＝-0.16874*R-0.33126*G+0.50000*B+128，Cr＝0.50000*R-0.41869*G-0.08131*B+128，在此不做具体限定。
在每个滤光片区域111包括2*2个滤光片单元1111，每个滤光片单元1111包括两个第一颜色滤光片A、一个第二颜色滤光片B和一个第三颜色滤光片C时，每个滤光片单元1111可以对应一个合并亮度值，每个滤光片区域111即可对应4个合并亮度值，每个滤光片区域111只对应一个第一颜色信号、一个第二颜色信号和一个第三颜色信号。以图3的滤光片阵列11为例。获取合并亮度值L的过程可参图16，每个滤光片单元1111对应的像素120合并输出以作为合并亮度值L。例如合并亮度值L可以为R+2G+B。获取第一颜色信号的过程可参图17，每个滤光片区域111中的第一颜色滤光片A对应的像素120用于生成第一颜色信号。获取第二颜色信号的过程可参图18，每个滤光片区域111中的第二颜色滤光片B对应的像素120用于生成第二颜色信号。获取第三颜色信号的过程可参图19，每个滤光片区域111中的第三颜色滤光片C对应的像素120用于生成第三颜色信号。第一颜色信号、第二颜色信号和第三颜色信号在转换至色亮分离空间后，每个滤光片区域111对应一个Cr和一个Cb，即第一中间图像的分辨率是第二中间图像的分辨率的4倍。
通常Y/Cb/Cr格式的图像可以允许Cb/Cr的分辨率低于Y的分辨率，例如Y/Cb/Cr的格式为4：2：2，或4：2：0。格式为4：2：0的Y/Cb/Cr的图像中，每四个Y对应一个Cr和一个Cb，因此，本申请实施方式的代表亮度Y的第一中间图像、代表红色分量Cr的第二中间图像和代表蓝色分量Cb的第二中间图像可以融合形成第一目标图像。
在某些实施方式中，处理电路13用于对第二中间图像进行上采样处理以使得一个滤光片区域111对应多个色彩值并形成第三中间图像，融合第一中间图像和第三中间图像以得到第一目标图像。例如，在每个滤光片区域111包括2*2个滤光片单元1111，每个滤光片单元1111包括两个第一颜色滤光片A、一个第二颜色滤光片B和一个第三颜色滤光片C时，第一中间图像的分辨率是第二中间图像的分辨率的4倍，因此，可以将第二中间图像进行上采样处理，例如将第二中间图像放大四倍，从而使得一个滤光片区域111对应四个Cr和四个Cb以获得第三中间图像，第三中间图像的分辨率与第一中间图像的分辨率一致，如此融合第一中间图像和第三中间图像后获得的第一目标图像的色彩信息更加丰富。
在某些实施方式中，处理电路13用于对第一中间图像进行高通滤波处理。如此，通过对第一中间图像进行高通滤波处理，利用高通滤波处理能够有效地保留细节信息、去除噪声，从而可以使得处理后 的第一中间图像更加准确。
请参阅图20，在某些实施方式中，处理电路13包括如图20所示的读出电路，利用该读出电路，能够实现将每个滤光片单元1111对应的像素120产生的电信号合并输出以作为合并亮度值。具体地，同一滤光片单元1111对应的四个像素PD1、像素PD2、像素PD3、像素PD4可以通过控制端Tx1、Tx2、Tx3、Tx4同时开启，以将同一滤光片单元1111对应的四个像素120接收光线后产生的电荷转移到浮动扩散节点FD。V2为高电平，SF为放大电路，通过输入高电平V2以使得放大电路SF对浮动扩散节点FD处的电荷对应的电信号进行放大。T为选择信号，SEL为选择电路，通过输入选择信号T可以将选择电路SEL对应的经过放大电路SF放大后的电信号输出出来。R为复位信号，V1为高电平，RST为复位电路，可以通过输入复位信号R以及高电平V1以使得复位电路RST对浮动扩散节点FD进行复位。
请参阅图21，本申请还提供一种成像装置100。成像装置100包括上述任意一个实施方式所述的图像传感器10。
在某些实施方式中，成像装置100还包括处理器20。处理器20可以用于根据每个滤光片区域111对应的像素120产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，第一颜色信号用于表征作用于滤光片区域111对应像素120的光线的第一颜色通道的值，第二颜色信号用于表征作用于滤光片区域111对应像素120的光线的第二颜色通道的值，第三颜色信号用于表征作用于滤光片区域111对应像素120的光线的第三颜色通道的值。处理器20还用于处理第一颜色信号、第二颜色信号和第三颜色信号以得到用于表征滤光片区域111的色彩值的多个第二中间图像，及用于融合第一中间图像与第二中间图像以得到第一目标图像。
本申请上述实施方式中，由处理电路13实现的功能均可以由处理器20实现，在此不再赘述。
请参阅图22，本申请还提供一种电子设备1000。电子设备1000可以是手机、平板电脑、笔记本电脑、智能手表、智能手环、智能头盔、智能眼镜、无人设备(例如无人机、无人车、无人船)等，在此不作限制。电子设备1000包括成像装置100。成像装置100包括上述任意一个实施方式所述的图像传感器10。电子设备1000还包括处理器20。电子设备1000的处理器20可以与图21所示成像装置100中的处理器20相同，在此不再赘述。
请参阅图23，本申请还提供一种图像处理***10000。图像处理***10000包括电子设备1000。电子设备1000包括成像装置100。成像装置100包括上述任意一个实施方式所述的图像传感器10。图像处理***10000还包括处理器20。图像处理***10000的处理器20可以与图21所示成像装置100中的处理器20相同，在此不再赘述。
其中，处理器20可以位于负责云计算的服务器中，也可以位于负责边缘计算的服务器中。如此，图像传感器10输出的像素信号的后续处理可以卸载到服务器中执行，可以节约成像装置100或电子设备1000的功耗。
请参阅图24，本申请还提供一种信号处理方法。信号处理方法可以用于上述任意一个实施方式所述的图像传感器10。信号处理方法包括：
01：将每个滤光片单元1111对应的像素120产生的电信号合并输出以作为合并亮度值并形成第一中间图像，合并亮度值用于表征作用于滤光片单元1111对应像素120的光线的亮度；
02：根据每个滤光片区域111对应的像素120产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，第一颜色信号用于表征作用于滤光片区域111对应像素120的光线的第一颜色通道的值，第二颜色信号用于表征作用于滤光片区域111对应像素120的光线的第二颜色通道的值，第三颜色信号用于表征作用于滤光片区域111对应像素120的光线的第三颜色通道的值；
03：处理第一颜色信号、第二颜色信号和第三颜色信号以得到用于表征滤光片区域111的色彩值的多个第二中间图像；
04：融合第一中间图像与第二中间图像以得到第一目标图像。
在某些实施方式中，滤光片阵列11包括多个第一滤光片组1131及多个第二滤光片组1132，第一滤光片组1131包括数量相同的多个第一颜色滤光片A和多个第二颜色滤光片B，第二滤光片组1132包括数量相同的多个第一颜色滤光片A和多个第三颜色滤光片C；所有第一滤光片组1131与所有第二滤光片组1132排列形成的子阵列为滤光片阵列11的一部分；或所有滤光片区域111排列形成的子阵列为滤光片阵列11的一部分。信号处理方法包括：在低亮模式下，获取第一目标图像；在纹理清晰模式下， 将第一滤光片组1131对应的像素120产生的电信号合并生成第一像素信号和第三像素信号，第一像素信号用于表征作用于第一滤光片组1131对应像素120的光线的第一颜色通道的值，第三像素信号用于表征作用于第一滤光片组1131对应像素120的光线的第二颜色通道的值，将第二滤光片组1132对应的像素120产生的电信号合并生成第二像素信号和第四像素信号，第二像素信号用于表征作用于第二滤光片组1132对应像素120的光线的第一颜色通道的值，第四像素信号用于表征作用于第二滤光片组1132对应像素120的光线的第三颜色通道的值，根据第一像素信号、第二像素信号、第三像素信号和第四像素信号得到第二目标图像。
在某些实施方式中，根据第一像素信号、第二像素信号、第三像素信号和第四像素信号得到第二目标图像，包括：计算每个滤光片区域111中第一颜色滤光片A对应的像素120产生的电信号的平均值以作为第一颜色信号，计算每个滤光片区域111中第二颜色滤光片B对应的像素120产生的电信号的平均值以作为第二颜色信号，计算每个滤光片区域111中第三颜色滤光片C对应的像素120产生的电信号的平均值以作为第三颜色信号。
在某些实施方式中，信号处理方法包括：对第一中间图像进行伽马校正处理。
在某些实施方式中，信号处理方法包括：对第一颜色信号、第二颜色信号和第三颜色信号进行白平衡处理、色彩校正矩阵处理、伽马校正处理。步骤03包括：将处理后的第一颜色信号、处理后的第二颜色信号和处理后的第三颜色信号转换至色亮分离空间以得到第二中间图像。
在某些实施方式中，步骤04包括：对第二中间图像进行上采样处理以使得一个滤光片区域111对应多个色彩值并形成第三中间图像，融合第一中间图像和第三中间图像以得到第一目标图像。
在某些实施方式中，信号处理方法包括：对第一中间图像进行高通滤波处理。
本申请实施方式还提供一种计算机设备。计算机设备可以是上述任意一项实施方式所述的电子设备100。
上述计算机设备中包括图像处理电路，图像处理电路可以利用硬件和/或软件组件实现，可包括定义ISP(Image Signal Processing，图像信号处理)管线的各种处理单元。图25为一个实施例中图像处理电路的示意图。如图25所示，为便于说明，仅示出与本申请实施例相关的图像处理技术的各个方面。
如图25所示，图像处理电路包括ISP处理器940和控制逻辑器950。其中，ISP处理器940可以应用在多种电子设备中，以作为电子设备中的处理器。其中，多种电子设备中的一种电子设备可以是包括图像传感器10的电子设备100。
成像装置910捕捉的图像数据首先由ISP处理器940处理，ISP处理器940对图像数据进行分析以捕捉可用于确定和/或成像装置910的一个或多个控制参数的图像统计信息。成像装置910可包括具有一个或多个透镜912和图像传感器914的照相机。其中，图像传感器914可以是图像传感器10。图像传感器914可包括滤光片阵列，图像传感器914可获取由图像传感器914的每个像素捕捉的光强度和波长信息，并提供可由ISP处理器940处理的一组原始图像数据，例如多个第一像素信号、多个第二像素信号、多个第三像素信号、及多个第四像素信号组成的原始图像数据。传感器920(如陀螺仪)可基于传感器920接口类型把采集的图像处理的参数(如防抖参数)提供给ISP处理器940。传感器920接口可以利用SMIA(Standard Mobile Imaging Architecture，标准移动成像架构)接口、其它串行或并行照相机接口或上述接口的组合。
此外，图像传感器914也可将原始图像数据发送给传感器920，传感器920可基于传感器920接口类型把原始图像数据提供给ISP处理器940，或者传感器920将原始图像数据存储到图像存储器930中。
ISP处理器940按多种格式逐个像素地处理原始图像数据。例如，每个图像像素可具有8、10、12或14比特的位深度，ISP处理器940可对原始图像数据进行一个或多个图像处理操作、收集关于图像数据的统计信息。其中，图像处理操作可按相同或不同的位深度精度进行。
ISP处理器940还可从图像存储器930接收图像数据。例如，传感器920接口将原始图像数据发送给图像存储器930，图像存储器930中的原始图像数据再提供给ISP处理器940以供处理。图像存储器930可为存储器装置的一部分、存储设备、或电子设备内的独立的专用存储器，并可包括DMA(Direct Memory Access，直接直接存储器存取)特征。
当接收到来自图像传感器914接口或来自传感器920接口或来自图像存储器930的原始图像数据时，ISP处理器940可进行一个或多个图像处理操作，例如时域滤波；再例如，处理第一像素信号、第二像 素信号、第三像素信号、第四像素信号获取彩色图像等。处理后的图像数据(例如彩色图像)可发送给图像存储器930，以便在被显示之前进行另外的处理。ISP处理器940从图像存储器930接收处理数据，并对所述处理数据进行原始域中以及RGB和YCbCr颜色空间中的图像数据处理。ISP处理器940处理后的图像数据可输出给显示器970，以供用户观看和/或由图形引擎或GPU(Graphics Processing Unit，图形处理器)进一步处理。此外，ISP处理器940的输出还可发送给图像存储器930，且显示器970可从图像存储器930读取图像数据。在一个实施例中，图像存储器930可被配置为实现一个或多个帧缓冲器。此外，ISP处理器940的输出可发送给编码器/解码器960，以便编码/解码图像数据。编码的图像数据可被保存，并在显示于显示器970设备上之前解压缩。编码器/解码器960可由CPU或GPU或协处理器实现。示例地，当计算机设备处于预览模式或录像模式下时，ISP处理器940可以处理包括多个图像信号单元U(图34所示)的图像信号以生成彩色图像这一图像数据。ISP处理器940可以将彩色图像发送给编码器/解码器960以编码彩色图像。编码的彩色图像可以被保存到图像存储器930中，还可以在显示器970上显示。
ISP处理器940确定的统计数据可发送给控制逻辑器950单元。例如，统计数据可包括自动曝光、自动白平衡、自动聚焦、闪烁检测、黑电平补偿、透镜912阴影校正等图像传感器914统计信息。控制逻辑器950可包括执行一个或多个例程(如固件)的处理器和/或微控制器，一个或多个例程可根据接收的统计数据，确定成像装置910的控制参数及ISP处理器940的控制参数。例如，成像装置910的控制参数可包括传感器920控制参数(例如增益、曝光控制的积分时间、防抖参数等)、照相机闪光控制参数、透镜912控制参数(例如聚焦或变焦用焦距)、或这些参数的组合。ISP控制参数可包括用于自动白平衡和颜色调整(例如，在RGB处理期间)的增益水平和色彩校正矩阵，以及透镜912阴影校正参数。
在本说明书的描述中，参考术语“一个实施方式”、“一些实施方式”、“示意性实施方式”、“示例”、“具体示例”或“一些示例”等的描述意指结合所述实施方式或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施方式或示例中。在本说明书中，对上述术语的示意性表述不一定指的是相同的实施方式或示例。而且，描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施方式或示例中以合适的方式结合。此外，在不相互矛盾的情况下，本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。
此外，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个所述特征。在本申请的描述中，“多个”的含义是至少两个，例如两个，三个，除非另有明确具体的限定。
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为，表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分，并且本申请的优选实施方式的范围包括另外的实现，其中可以不按所示出或讨论的顺序，包括根据所涉及的功能按基本同时的方式或按相反的顺序，来执行功能，这应被本申请的实施例所属技术领域的技术人员所理解。
尽管上面已经示出和描述了本申请的实施方式，可以理解的是，上述实施方式是示例性的，不能理解为对本申请的限制，本领域的普通技术人员在本申请的范围内可以对上述实施方式进行变化、修改、替换和变型。

Claims (54)

  1. 一种图像传感器，其特征在于，包括：
    滤光片阵列，所述滤光片阵列包括多个滤光片区域，每个所述滤光片区域包括多个滤光片单元，每个所述滤光片单元包括至少一个第一颜色滤光片、至少一个第二颜色滤光片和至少一个第三颜色滤光片；
    像素阵列，所述像素阵列包括多个像素，每个所述像素对应所述滤光片阵列的一个滤光片，所述像素用于接收穿过对应的所述滤光片的光线以生成电信号；
    处理电路，所述处理电路设置在具有所述像素阵列的衬底上，所述处理电路用于将每个所述滤光片单元对应的像素产生的电信号合并输出以作为合并亮度值并形成第一中间图像，所述合并亮度值用于表征作用于所述滤光片单元对应像素的光线的亮度；所述处理电路还用于根据每个所述滤光片区域对应的像素产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，所述第一颜色信号用于表征作用于所述滤光片区域对应像素的光线的第一颜色通道的值，所述第二颜色信号用于表征作用于所述滤光片区域对应像素的光线的第二颜色通道的值，所述第三颜色信号用于表征作用于所述滤光片区域对应像素的光线的第三颜色通道的值；所述处理电路还用于处理所述第一颜色信号、所述第二颜色信号和所述第三颜色信号以得到用于表征所述滤光片区域的色彩值的多个第二中间图像，及用于融合所述第一中间图像与所述第二中间图像以得到第一目标图像。
  2. 根据权利要求1所述的图像传感器，其特征在于，每个所述滤光片区域中的所述滤光片单元的数量均为M*M，其中，M为大于或等于2的整数；每个所述滤光片单元中的所述滤光片的数量均为N*N，其中，N为大于或等于2的整数。
  3. 根据权利要求1或2所述的图像传感器，其特征在于，每个所述滤光片单元中的所述第一颜色滤光片的数量、所述第二颜色滤光片的数量和所述第三颜色滤光片的数量具有比值，多个所述滤光片单元的所述比值均相同。
  4. 根据权利要求1-3任意一项所述的图像传感器，其特征在于，所述第一颜色滤光片为绿色滤光片，所述第二颜色滤光片为红色滤光片，所述第三颜色滤光片为蓝色滤光片。
  5. 根据权利要求1-4任意一项所述的图像传感器，其特征在于，所述滤光片阵列包括多个第一滤光片组及多个第二滤光片组，所述第一滤光片组包括数量相同的多个所述第一颜色滤光片和多个所述第二颜色滤光片，所述第二滤光片组包括数量相同的多个所述第一颜色滤光片和多个所述第三颜色滤光片；
    所有所述第一滤光片组与所有所述第二滤光片组排列形成的子阵列为所述滤光片阵列的一部分；或所有所述滤光片区域排列形成的子阵列为所述滤光片阵列的一部分；
    在低亮模式下，所述图像传感器用于获取所述第一目标图像；
    在纹理清晰模式下，所述处理电路用于将所述第一滤光片组对应的像素产生的电信号合并生成第一像素信号和第三像素信号，所述第一像素信号用于表征作用于所述第一滤光片组对应像素的光线的第一颜色通道的值，所述第三像素信号用于表征作用于所述第一滤光片组对应像素的光线的第二颜色通道的值，所述处理电路还用于将所述第二滤光片组对应的像素产生的电信号合并生成第二像素信号和第四像素信号，所述第二像素信号用于表征作用于所述第二滤光片组对应像素的光线的第一颜色通道的值，所述第四像素信号用于表征作用于所述第二滤光片组对应像素的光线的第三颜色通道的值，所述处理电路还用于根据所述第一像素信号、所述第二像素信号、所述第三像素信号和所述第四像素信号得到第二目标图像。
  6. 根据权利要求5所述的图像传感器，其特征在于，多个所述第一滤光片组设置在第一对角线方向，多个所述第二滤光片组设置在第二对角线方向，所述第一对角线方向与所述第二对角线方向不同。
  7. 根据权利要求6所述的图像传感器，其特征在于，所述第一滤光片组与所述第二滤光片组在所述图像传感器的垂直方向和水平方向相邻布置。
  8. 根据权利要求5-7任意一项所述的图像传感器，其特征在于，在每个所述第一滤光片组中，多个所述第一颜色滤光片及多个所述第二颜色滤光片在所述图像传感器的垂直方向和水平方向相邻布置；
    在每个所述第二滤光片组中，多个所述第一颜色滤光片及多个所述第三颜色滤光片在所述图像传感器的垂直方向和水平方向相邻布置。
  9. 根据权利要求5-7任意一项所述的图像传感器，其特征在于，在每个所述第一滤光片组中，多个所述滤光片逐行排列，且同一行中的多个所述滤光片的颜色相同；或
    在每个所述第一滤光片组中，多个所述滤光片逐列排列，且同一列中的多个所述滤光片的颜色相同；
    在每个所述第二滤光片组中，多个所述滤光片逐行排列，且同一行中的多个所述滤光片的颜色相同；或
    在每个所述第二滤光片组中，多个所述滤光片逐列排列，且同一列中的多个所述滤光片的颜色相同。
  10. 根据权利要求5-9任意一项所述的图像传感器，其特征在于，所述图像传感器还包括微透镜阵列，所述微透镜阵列包括多个微透镜组，一个所述微透镜组对应一个滤光片组，并与该一个所述滤光片组对应的多个所述像素对应。
  11. 根据权利要求10所述的图像传感器，其特征在于，每个所述微透镜组均包括多个微透镜，每个所述微透镜对应一个所述滤光片及一个所述像素。
  12. 根据权利要求10所述的图像传感器，其特征在于，每个所述微透镜组均包括一个微透镜，一个所述微透镜对应一个所述滤光片组，并与该一个所述滤光片组对应的多个所述像素对应。
  13. 根据权利要求1-4任意一项所述的图像传感器，其特征在于，每个所述滤光片单元包括两个第一颜色滤光片、一个第二颜色滤光片和一个第三颜色滤光片；每个所述滤光片单元中的所述第二颜色滤光片和所述第三颜色滤光片互不相邻，每个所述滤光片区域中，多个所述滤光片单元的所述滤光片的排列顺序均不相同。
  14. 根据权利要求13所述的图像传感器，其特征在于，多个所述滤光片区域包括多个第一滤光片区域和多个第二滤光片区域，所述第一滤光片区中的所述滤光片单元的排列顺序与所述第二滤光片区中的所述滤光片单元的排列顺序不同。
  15. 根据权利要求14所述的图像传感器，其特征在于，多个所述第一滤光片区域设置在第三对角线方向，多个所述第二滤光片区域设置在第四对角线方向，所述第三对角线方向与所述第四对角线方向不同。
  16. 根据权利要求15所述的图像传感器，其特征在于，所述第一滤光片区域与所述第二滤光片区域在所述图像传感器的垂直方向和水平方向相邻布置。
  17. 根据权利要求14所述的图像传感器，其特征在于，多个所述第一滤光片区域在所述图像传感器的垂直方向相邻布置，多个所述第二滤光片区域在所述图像传感器的垂直方向相邻布置；或
    多个所述第一滤光片区域在所述图像传感器的水平方向相邻布置，多个所述第二滤光片区域在所述图像传感器的水平方向相邻布置。
  18. 根据权利要求1-17任意一项所述的图像传感器，其特征在于，所述处理电路用于计算每个所述滤光片区域中所述第一颜色滤光片对应的像素产生的电信号的平均值以作为所述第一颜色信号，计算每个所述滤光片区域中所述第二颜色滤光片对应的像素产生的电信号的平均值以作为所述第二颜色信号，计算每个所述滤光片区域中所述第三颜色滤光片对应的像素产生的电信号的平均值以作为所述第三颜色信号。
  19. 根据权利要求1-18任意一项所述的图像传感器，其特征在于，所述处理电路用于对所述第一中间图像进行伽马校正处理。
  20. 根据权利要求1-19所述的图像传感器，其特征在于，所述处理电路用于对所述第一颜色信号、所述第二颜色信号和所述第三颜色信号进行白平衡处理、色彩校正矩阵处理、伽马校正处理，将处理后的所述第一颜色信号、处理后的所述第二颜色信号和处理后的所述第三颜色信号转换至色亮分离空间以得到所述第二中间图像。
  21. 根据权利要求1-20所述的图像传感器，其特征在于，所述处理电路用于对所述第二中间图像进行上采样处理以使得一个所述滤光片区域对应多个色彩值并形成第三中间图像，融合所述第一中间图像和所述第三中间图像以得到所述第一目标图像。
  22. 根据权利要求1-21所述的图像传感器，其特征在于，所述处理电路用于对所述第一中间图像进行高通滤波处理。
  23. 一种成像装置，其特征在于，所述成像装置包括：
    图像传感器，所述图像传感器包括滤光片阵列和像素阵列；所述滤光片阵列包括多个滤光片区域，每个所述滤光片区域包括多个滤光片单元，每个所述滤光片单元包括至少一个第一颜色滤光片、至少一个第二颜色滤光片和至少一个第三颜色滤光片；所述像素阵列包括多个像素，每个所述像素对应所述滤 光片阵列的一个滤光片，所述像素用于接收穿过对应的所述滤光片的光线以生成电信号；每个所述滤光片单元对应的像素产生的电信号合并输出以作为合并亮度值并形成第一中间图像，所述合并亮度值用于表征作用于所述滤光片单元对应像素的光线的亮度；
    处理器，所述处理器用于根据每个所述滤光片区域对应的像素产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，所述第一颜色信号用于表征作用于所述滤光片区域对应像素的光线的第一颜色通道的值，所述第二颜色信号用于表征作用于所述滤光片区域对应像素的光线的第二颜色通道的值，所述第三颜色信号用于表征作用于所述滤光片区域对应像素的光线的第三颜色通道的值；所述处理器还用于处理所述第一颜色信号、所述第二颜色信号和所述第三颜色信号以得到用于表征所述滤光片区域的色彩值的多个第二中间图像，融合所述第一中间图像与所述第二中间图像以得到第一目标图像。
  24. 根据权利要求23所述的成像装置，其特征在于，每个所述滤光片区域中的所述滤光片单元的数量均为M*M，其中，M为大于或等于2的整数；每个所述滤光片单元中的所述滤光片的数量均为N*N，其中，N为大于或等于2的整数。
  25. 根据权利要求23或24所述的成像装置，其特征在于，每个所述滤光片单元中的所述第一颜色滤光片的数量、所述第二颜色滤光片的数量和所述第三颜色滤光片的数量具有比值，多个所述滤光片单元的所述比值均相同。
  26. 根据权利要求23-25任意一项所述的成像装置，其特征在于，所述第一颜色滤光片为绿色滤光片，所述第二颜色滤光片为红色滤光片，所述第三颜色滤光片为蓝色滤光片。
  27. 根据权利要求23-26任意一项所述的成像装置，其特征在于，所述滤光片阵列包括多个第一滤光片组及多个第二滤光片组，所述第一滤光片组包括数量相同的多个所述第一颜色滤光片和多个所述第二颜色滤光片，所述第二滤光片组包括数量相同的多个所述第一颜色滤光片和多个所述第三颜色滤光片；
    所有所述第一滤光片组与所有所述第二滤光片组排列形成的子阵列为所述滤光片阵列的一部分；或所有所述滤光片区域排列形成的子阵列为所述滤光片阵列的一部分；
    在低亮模式下，所述成像装置用于获取所述第一目标图像；
    在纹理清晰模式下，所述第一滤光片组对应的像素产生的电信号合并生成第一像素信号和第三像素信号，所述第一像素信号用于表征作用于所述第一滤光片组对应像素的光线的第一颜色通道的值，所述第三像素信号用于表征作用于所述第一滤光片组对应像素的光线的第二颜色通道的值，所述第二滤光片组对应的像素产生的电信号合并生成第二像素信号和第四像素信号，所述第二像素信号用于表征作用于所述第二滤光片组对应像素的光线的第一颜色通道的值，所述第四像素信号用于表征作用于所述第二滤光片组对应像素的光线的第三颜色通道的值，所述处理器用于根据所述第一像素信号、所述第二像素信号、所述第三像素信号和所述第四像素信号得到第二目标图像。
  28. 根据权利要求27所述的成像装置，其特征在于，多个所述第一滤光片组设置在第一对角线方向，多个所述第二滤光片组设置在第二对角线方向，所述第一对角线方向与所述第二对角线方向不同。
  29. 根据权利要求28所述的成像装置，其特征在于，所述第一滤光片组与所述第二滤光片组在所述图像传感器的垂直方向和水平方向相邻布置。
  30. 根据权利要求27-29任意一项所述的成像装置，其特征在于，在每个所述第一滤光片组中，多个所述第一颜色滤光片及多个所述第二颜色滤光片在所述图像传感器的垂直方向和水平方向相邻布置；
    在每个所述第二滤光片组中，多个所述第一颜色滤光片及多个所述第三颜色滤光片在所述图像传感器的垂直方向和水平方向相邻布置。
  31. 根据权利要求27-29任意一项所述的成像装置，其特征在于，在每个所述第一滤光片组中，多个所述滤光片逐行排列，且同一行中的多个所述滤光片的颜色相同；或
    在每个所述第一滤光片组中，多个所述滤光片逐列排列，且同一列中的多个所述滤光片的颜色相同；
    在每个所述第二滤光片组中，多个所述滤光片逐行排列，且同一行中的多个所述滤光片的颜色相同；或
    在每个所述第二滤光片组中，多个所述滤光片逐列排列，且同一列中的多个所述滤光片的颜色相同。
  32. 根据权利要求27-31任意一项所述的成像装置，其特征在于，所述图像传感器还包括微透镜阵列，所述微透镜阵列包括多个微透镜组，一个所述微透镜组对应一个滤光片组，并与该一个所述滤光片组对应的多个所述像素对应。
  33. 根据权利要求32所述的成像装置，其特征在于，每个所述微透镜组均包括多个微透镜，每个所述微透镜对应一个所述滤光片及一个所述像素。
  34. 根据权利要求32所述的成像装置，其特征在于，每个所述微透镜组均包括一个微透镜，一个所述微透镜对应一个所述滤光片组，并与该一个所述滤光片组对应的多个所述像素对应。
  35. 根据权利要求23-26任意一项所述的成像装置，其特征在于，每个所述滤光片单元包括两个第一颜色滤光片、一个第二颜色滤光片和一个第三颜色滤光片；每个所述滤光片单元中的所述第二颜色滤光片和所述第三颜色滤光片互不相邻，每个所述滤光片区域中，多个所述滤光片单元的所述滤光片的排列顺序均不相同。
  36. 根据权利要求35所述的成像装置，其特征在于，多个所述滤光片区域包括多个第一滤光片区域和多个第二滤光片区域，所述第一滤光片区中的所述滤光片单元的排列顺序与所述第二滤光片区中的所述滤光片单元的排列顺序不同。
  37. 根据权利要求36所述的成像装置，其特征在于，多个所述第一滤光片区域设置在第三对角线方向，多个所述第二滤光片区域设置在第四对角线方向，所述第三对角线方向与所述第四对角线方向不同。
  38. 根据权利要求37所述的成像装置，其特征在于，所述第一滤光片区域与所述第二滤光片区域在所述图像传感器的垂直方向和水平方向相邻布置。
  39. 根据权利要求36所述的成像装置，其特征在于，多个所述第一滤光片区域在所述图像传感器的垂直方向相邻布置，多个所述第二滤光片区域在所述图像传感器的垂直方向相邻布置；或
    多个所述第一滤光片区域在所述图像传感器的水平方向相邻布置，多个所述第二滤光片区域在所述图像传感器的水平方向相邻布置。
  40. 根据权利要求23-39任意一项所述的成像装置，其特征在于，所述处理器用于计算每个所述滤光片区域中所述第一颜色滤光片对应的像素产生的电信号的平均值以作为所述第一颜色信号，计算每个所述滤光片区域中所述第二颜色滤光片对应的像素产生的电信号的平均值以作为所述第二颜色信号，计算每个所述滤光片区域中所述第三颜色滤光片对应的像素产生的电信号的平均值以作为所述第三颜色信号。
  41. 根据权利要求23-40任意一项所述的成像装置，其特征在于，所述处理器用于对所述第一中间图像进行伽马校正处理。
  42. 根据权利要求23-41所述的成像装置，其特征在于，所述处理器用于对所述第一颜色信号、所述第二颜色信号和所述第三颜色信号进行白平衡处理、色彩校正矩阵处理、伽马校正处理，将处理后的所述第一颜色信号、处理后的所述第二颜色信号和处理后的所述第三颜色信号转换至色亮分离空间以得到所述第二中间图像。
  43. 根据权利要求23-42所述的成像装置，其特征在于，所述处理器用于对所述第二中间图像进行上采样处理以使得一个所述滤光片区域对应多个色彩值并形成第三中间图像，融合所述第一中间图像和所述第三中间图像以得到所述第一目标图像。
  44. 根据权利要求23-43所述的成像装置，其特征在于，所述处理器用于对所述第一中间图像进行高通滤波处理。
  45. 一种电子设备，其特征在于，包括：
    成像装置，所述成像装置包括图像传感器，所述图像传感器包括滤光片阵列和像素阵列；所述滤光片阵列包括多个滤光片区域，每个所述滤光片区域包括多个滤光片单元，每个所述滤光片单元包括至少一个第一颜色滤光片、至少一个第二颜色滤光片和至少一个第三颜色滤光片；所述像素阵列包括多个像素，每个所述像素对应所述滤光片阵列的一个滤光片，所述像素用于接收穿过对应的所述滤光片的光线以生成电信号；每个所述滤光片单元对应的像素产生的电信号合并输出以作为合并亮度值并形成第一中间图像，所述合并亮度值用于表征作用于所述滤光片单元对应像素的光线的亮度；
    处理器，所述处理器用于根据每个所述滤光片区域对应的像素产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，所述第一颜色信号用于表征作用于所述滤光片区域对应像素的光线的第一颜色通道的值，所述第二颜色信号用于表征作用于所述滤光片区域对应像素的光线的第二颜色通道的值，所述第三颜色信号用于表征作用于所述滤光片区域对应像素的光线的第三颜色通道的值；所述处理器还用于处理所述第一颜色信号、所述第二颜色信号和所述第三颜色信号以得到用于表征所述滤光片区域的 色彩值的多个第二中间图像，融合所述第一中间图像与所述第二中间图像以得到第一目标图像。
  46. 一种图像处理***，其特征在于，包括：
    电子设备，所述电子设备包括成像装置，所述成像装置包括图像传感器，所述图像传感器包括滤光片阵列和像素阵列；所述滤光片阵列包括多个滤光片区域，每个所述滤光片区域包括多个滤光片单元，每个所述滤光片单元包括至少一个第一颜色滤光片、至少一个第二颜色滤光片和至少一个第三颜色滤光片；所述像素阵列包括多个像素，每个所述像素对应所述滤光片阵列的一个滤光片，所述像素用于接收穿过对应的所述滤光片的光线以生成电信号；每个所述滤光片单元对应的像素产生的电信号合并输出以作为合并亮度值并形成第一中间图像，所述合并亮度值用于表征作用于所述滤光片单元对应像素的光线的亮度；
    处理器，所述处理器用于根据每个所述滤光片区域对应的像素产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，所述第一颜色信号用于表征作用于所述滤光片区域对应像素的光线的第一颜色通道的值，所述第二颜色信号用于表征作用于所述滤光片区域对应像素的光线的第二颜色通道的值，所述第三颜色信号用于表征作用于所述滤光片区域对应像素的光线的第三颜色通道的值；所述处理器还用于处理所述第一颜色信号、所述第二颜色信号和所述第三颜色信号以得到用于表征所述滤光片区域的色彩值的多个第二中间图像，融合所述第一中间图像与所述第二中间图像以得到第一目标图像。
  47. 根据权利要求46所述的图像处理***，其特征在于，所述处理器位于负责云计算的服务器或负责边缘计算的服务器中。
  48. 一种信号处理方法，用于图像传感器，其特征在于，所述图像传感器包括滤光片阵列和像素阵列；所述滤光片阵列包括多个滤光片区域，每个所述滤光片区域包括多个滤光片单元，每个所述滤光片单元包括至少一个第一颜色滤光片、至少一个第二颜色滤光片和至少一个第三颜色滤光片；所述像素阵列包括多个像素，每个所述像素对应所述滤光片阵列的一个滤光片，所述像素用于接收穿过对应的所述滤光片的光线以生成电信号；所述信号处理方法包括：
    将每个所述滤光片单元对应的像素产生的电信号合并输出以作为合并亮度值并形成第一中间图像，所述合并亮度值用于表征作用于所述滤光片单元对应像素的光线的亮度；
    根据每个所述滤光片区域对应的像素产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，所述第一颜色信号用于表征作用于所述滤光片区域对应像素的光线的第一颜色通道的值，所述第二颜色信号用于表征作用于所述滤光片区域对应像素的光线的第二颜色通道的值，所述第三颜色信号用于表征作用于所述滤光片区域对应像素的光线的第三颜色通道的值；
    处理所述第一颜色信号、所述第二颜色信号和所述第三颜色信号以得到用于表征所述滤光片区域的色彩值的多个第二中间图像；
    融合所述第一中间图像与所述第二中间图像以得到第一目标图像。
  49. 根据权利要求48所述的信号处理方法，其特征在于，每个所述滤光片单元包括两个第一颜色滤光片、一个第二颜色滤光片和一个第三颜色滤光片；一个所述滤光片单元中的一个所述第一颜色滤光片、一个所述第二颜色滤光片和另外一个所述滤光片单元中的一个所述第一颜色滤光片、一个所述第二颜色滤光片组合形成第一滤光片组，一个所述滤光片单元中的一个所述第一颜色滤光片、一个所述第三颜色滤光片和另外一个所述滤光片单元中的一个所述第一颜色滤光片、一个所述第三颜色滤光片组合形成第二滤光片组，所述滤光片阵列包括多个所述第一滤光片组和多个所述第二滤光片组；所述信号处理方法包括：
    在低亮模式下，获取所述第一目标图像；
    在纹理清晰模式下，将所述第一滤光片组对应的像素产生的电信号合并生成第一像素信号和第三像素信号，所述第一像素信号用于表征作用于所述第一滤光片组对应像素的光线的第一颜色通道的值，所述第三像素信号用于表征作用于所述第一滤光片组对应像素的光线的第二颜色通道的值，将所述第二滤光片组对应的像素产生的电信号合并生成第二像素信号和第四像素信号，所述第二像素信号用于表征作用于所述第二滤光片组对应像素的光线的第一颜色通道的值，所述第四像素信号用于表征作用于所述第二滤光片组对应像素的光线的第三颜色通道的值，根据所述第一像素信号、所述第二像素信号、所述第三像素信号和所述第四像素信号得到第二目标图像。
  50. 根据权利要求48或49所述的信号处理方法，其特征在于，所述根据每个所述滤光片区域对应 的像素产生的电信号生成第一颜色信号、第二颜色信号和第三颜色信号，包括：
    计算每个所述滤光片区域中所述第一颜色滤光片对应的像素产生的电信号的平均值以作为所述第一颜色信号；
    计算每个所述滤光片区域中所述第二颜色滤光片对应的像素产生的电信号的平均值以作为所述第二颜色信号；
    计算每个所述滤光片区域中所述第三颜色滤光片对应的像素产生的电信号的平均值以作为所述第三颜色信号。
  51. 根据权利要求48-50任意一项所述的信号处理方法，其特征在于，所述信号处理方法包括：
    对所述第一中间图像进行伽马校正处理。
  52. 根据权利要求48-51所述的信号处理方法，其特征在于，所述信号处理方法包括：
    对所述第一颜色信号、所述第二颜色信号和所述第三颜色信号进行白平衡处理、色彩校正矩阵处理、伽马校正处理；
    所述处理所述第一颜色信号、所述第二颜色信号和所述第三颜色信号以得到用于表征所述滤光片区域的色彩值的多个第二中间图像，包括：
    将处理后的所述第一颜色信号、处理后的所述第二颜色信号和处理后的所述第三颜色信号转换至色亮分离空间以得到所述第二中间图像。
  53. 根据权利要求48-52所述的信号处理方法，其特征在于，所述融合所述第一中间图像与所述第二中间图像以得到第一目标图像，包括：
    对所述第二中间图像进行上采样处理以使得一个所述滤光片区域对应多个色彩值并形成第三中间图像；
    融合所述第一中间图像和所述第三中间图像以得到所述第一目标图像。
  54. 根据权利要求48-53所述的信号处理方法，其特征在于，所述信号处理方法包括：
    对所述第一中间图像进行高通滤波处理。
PCT/CN2020/078212 2020-03-06 2020-03-06 图像传感器、成像装置、电子设备、图像处理***及信号处理方法 WO2021174529A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN202080098201.3A CN115280766B (zh) 2020-03-06 2020-03-06 图像传感器、成像装置、电子设备、图像处理***及信号处理方法
PCT/CN2020/078212 WO2021174529A1 (zh) 2020-03-06 2020-03-06 图像传感器、成像装置、电子设备、图像处理***及信号处理方法
EP20923253.7A EP4117282A4 (en) 2020-03-06 2020-03-06 IMAGE SENSOR, IMAGING APPARATUS, ELECTRONIC DEVICE, IMAGE PROCESSING SYSTEM AND SIGNAL PROCESSING METHOD
US17/903,872 US20230007191A1 (en) 2020-03-06 2022-09-06 Image sensor, imaging apparatus, electronic device, image processing system, and signal processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/078212 WO2021174529A1 (zh) 2020-03-06 2020-03-06 图像传感器、成像装置、电子设备、图像处理***及信号处理方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/903,872 Continuation US20230007191A1 (en) 2020-03-06 2022-09-06 Image sensor, imaging apparatus, electronic device, image processing system, and signal processing method

Publications (1)

Publication Number Publication Date
WO2021174529A1 true WO2021174529A1 (zh) 2021-09-10

Family

ID=77613790

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/078212 WO2021174529A1 (zh) 2020-03-06 2020-03-06 图像传感器、成像装置、电子设备、图像处理***及信号处理方法

Country Status (4)

Country Link
US (1) US20230007191A1 (zh)
EP (1) EP4117282A4 (zh)
CN (1) CN115280766B (zh)
WO (1) WO2021174529A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114125237A (zh) * 2021-11-30 2022-03-01 维沃移动通信有限公司 图像传感器、摄像模组、电子设备、图像获取方法及介质
WO2023082766A1 (zh) * 2021-11-12 2023-05-19 Oppo广东移动通信有限公司 图像传感器、摄像模组、电子设备、图像生成方法和装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101106641A (zh) * 2006-06-26 2008-01-16 三星电机株式会社 用于图像处理的方法和设备
US20090200451A1 (en) * 2008-02-08 2009-08-13 Micron Technology, Inc. Color pixel arrays having common color filters for multiple adjacent pixels for use in cmos imagers
CN102857708A (zh) * 2011-10-17 2013-01-02 北京瑞澜联合通信技术有限公司 图像传感器、摄像装置及图像数据生成方法
CN105430359A (zh) * 2015-12-18 2016-03-23 广东欧珀移动通信有限公司 成像方法、图像传感器、成像装置及电子装置
CN105430360A (zh) * 2015-12-18 2016-03-23 广东欧珀移动通信有限公司 成像方法、图像传感器、成像装置及电子装置
CN106456272A (zh) * 2014-03-17 2017-02-22 直观外科手术操作公司 包括非白光总体照明器的外科手术***

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6809765B1 (en) * 1999-10-05 2004-10-26 Sony Corporation Demosaicing for digital imaging device using perceptually uniform color space
JP5591261B2 (ja) * 2009-12-04 2014-09-17 キヤノン株式会社 画像処理装置
JP2012023137A (ja) * 2010-07-13 2012-02-02 Panasonic Corp 固体撮像装置およびその製造方法
JP2012023620A (ja) * 2010-07-15 2012-02-02 Panasonic Corp 撮像装置及び信号処理方法
JP2012023670A (ja) * 2010-07-16 2012-02-02 Japan Radio Co Ltd Ｏｆｄｍ伝送方式における受信機
JP5696513B2 (ja) * 2011-02-08 2015-04-08 ソニー株式会社 固体撮像装置とその製造方法、及び電子機器
EP2762943B1 (en) * 2011-09-29 2017-01-11 Fujifilm Corporation Solid state image capture element, image capture device, and focus control method
EP2835965B1 (en) * 2012-03-30 2017-05-03 Nikon Corporation Imaging device and image sensor
CN104221365B (zh) * 2012-03-30 2018-11-06 株式会社尼康 拍摄元件、摄影方法及拍摄装置
US9338380B2 (en) * 2014-06-30 2016-05-10 Semiconductor Components Industries, Llc Image processing methods for image sensors with phase detection pixels
KR102469426B1 (ko) * 2015-10-27 2022-11-22 삼성전자주식회사 이미지 처리 장치 및 이의 동작 방법
KR20170055112A (ko) * 2015-11-11 2017-05-19 엠텍비젼 주식회사 영상처리장치
JP7182907B2 (ja) * 2017-06-15 2022-12-05 ブラックマジック デザイン ピーティーワイ リミテッド カメラの画像データ処理方法およびカメラ

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101106641A (zh) * 2006-06-26 2008-01-16 三星电机株式会社 用于图像处理的方法和设备
US20090200451A1 (en) * 2008-02-08 2009-08-13 Micron Technology, Inc. Color pixel arrays having common color filters for multiple adjacent pixels for use in cmos imagers
CN102857708A (zh) * 2011-10-17 2013-01-02 北京瑞澜联合通信技术有限公司 图像传感器、摄像装置及图像数据生成方法
CN106456272A (zh) * 2014-03-17 2017-02-22 直观外科手术操作公司 包括非白光总体照明器的外科手术***
CN105430359A (zh) * 2015-12-18 2016-03-23 广东欧珀移动通信有限公司 成像方法、图像传感器、成像装置及电子装置
CN105430360A (zh) * 2015-12-18 2016-03-23 广东欧珀移动通信有限公司 成像方法、图像传感器、成像装置及电子装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4117282A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023082766A1 (zh) * 2021-11-12 2023-05-19 Oppo广东移动通信有限公司 图像传感器、摄像模组、电子设备、图像生成方法和装置
CN114125237A (zh) * 2021-11-30 2022-03-01 维沃移动通信有限公司 图像传感器、摄像模组、电子设备、图像获取方法及介质

Also Published As

Publication number Publication date
CN115280766B (zh) 2024-05-03
EP4117282A4 (en) 2023-04-05
US20230007191A1 (en) 2023-01-05
CN115280766A (zh) 2022-11-01
EP4117282A1 (en) 2023-01-11

Similar Documents

Publication Publication Date Title
WO2021208593A1 (zh) 高动态范围图像处理***及方法、电子设备和存储介质
CN213279832U (zh) 图像传感器、相机和终端
WO2021196554A1 (zh) 图像传感器、处理***及方法、电子设备和存储介质
WO2021179806A1 (zh) 图像获取方法、成像装置、电子设备及可读存储介质
US8310573B2 (en) Solid-state imaging device, signal processing method thereof and image capturing apparatus
WO2021223590A1 (zh) 图像传感器、控制方法、摄像头组件和移动终端
CN113170061B (zh) 图像传感器、成像装置、电子设备、图像处理***及信号处理方法
WO2021212763A1 (zh) 高动态范围图像处理***及方法、电子设备和可读存储介质
CN111629140A (zh) 图像传感器和电子设备
US20070159542A1 (en) Color filter array with neutral elements and color image formation
CN111711755B (zh) 图像处理方法及装置、终端和计算机可读存储介质
JP2013198160A (ja) 透明フィルタピクセルを備えるイメージングシステム
JP4253634B2 (ja) デジタルカメラ
US20230007191A1 (en) Image sensor, imaging apparatus, electronic device, image processing system, and signal processing method
TW201545556A (zh) 在產生數位影像中曝光像素群組
US11758289B2 (en) Image processing method, image processing system, electronic device, and readable storage medium
JPWO2019078340A1 (ja) 撮像装置および方法、並びに、画像処理装置および方法
CN113840067B (zh) 图像传感器、图像生成方法、装置和电子设备
WO2023082766A1 (zh) 图像传感器、摄像模组、电子设备、图像生成方法和装置
WO2023124607A1 (zh) 图像生成方法、装置、电子设备和计算机可读存储介质
KR20110030328A (ko) 고체 촬상 장치 및 전자 기기
JP2019161577A (ja) 撮像装置、画素補正処理回路、及び、画素補正処理方法
WO2022073364A1 (zh) 图像获取方法及装置、终端和计算机可读存储介质
JPWO2014091706A1 (ja) 撮像装置
CN113132692B (zh) 图像传感器、成像装置、电子设备、图像处理***及信号处理方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20923253

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020923253

Country of ref document: EP

Effective date: 20221006

NENP Non-entry into the national phase

Ref country code: DE