WO2022247387A1 - Image sensor, a camera device, electronic device, and imaging method - Google Patents

Image sensor, a camera device, electronic device, and imaging method Download PDF

Info

Publication number
WO2022247387A1
WO2022247387A1 PCT/CN2022/079867 CN2022079867W WO2022247387A1 WO 2022247387 A1 WO2022247387 A1 WO 2022247387A1 CN 2022079867 W CN2022079867 W CN 2022079867W WO 2022247387 A1 WO2022247387 A1 WO 2022247387A1
Authority
WO
WIPO (PCT)
Prior art keywords
pixel
light
polarization
filter
polarization angle
Prior art date
Application number
PCT/CN2022/079867
Other languages
French (fr)
Chinese (zh)
Inventor
杨鑫
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2022247387A1 publication Critical patent/WO2022247387A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled

Definitions

  • the present application relates to the technical field of consumer electronics, and more specifically, to an image sensor, camera device, electronic equipment and imaging method.
  • a polarization element In order to obtain polarization images with polarization information, a polarization element is usually set in the image sensor to generate different polarization images according to polarized light with different polarization angles.
  • the polarizing element allows light with the same polarization angle as its own to pass through, it also reflects light with a different polarization angle from its own, so that after the light is polarized, half of the light will be lost.
  • Embodiments of the present application provide an image sensor, an imaging device, electronic equipment, and an imaging method.
  • the image sensor in the embodiment of the present application includes a pixel array and a microlens array.
  • the pixel array includes a plurality of pixel subunits, each of the pixel subunits includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization angle, the The second pixel has a second polarization angle different from the first polarization angle, the first pixel is capable of converting light having the first polarization angle into an electrical signal, and reflecting light having a polarization angle different from the first polarization angle to the The second pixel is capable of converting light with a second polarization angle into an electrical signal.
  • the microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to transmit light focusing to the first pixel covered by the microlens.
  • the camera device in the embodiment of the present application includes an image sensor and a lens module, and the image sensor is arranged on an image side of the lens module.
  • the image sensor includes a pixel array and a microlens array.
  • the pixel array includes a plurality of pixel subunits, each of the pixel subunits includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization angle, the The second pixel has a second polarization angle different from the first polarization angle, the first pixel is capable of converting light having the first polarization angle into an electrical signal, and converting light having a polarization angle different from the first polarization angle Reflected to the second pixel, the second pixel is capable of converting light having a second polarization angle into an electrical signal.
  • the microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to transmit light focusing to the first pixel covered by the microlens.
  • the electronic equipment in the embodiment of the present application includes a housing and a camera device, the camera device is installed on the housing; the camera device includes an image sensor and a lens module, and the image sensor is arranged on the lens module like side.
  • the image sensor includes a pixel array and a microlens array.
  • the pixel array includes a plurality of pixel subunits, each of the pixel subunits includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization angle, the The second pixel has a second polarization angle different from the first polarization angle, the first pixel is capable of converting light having the first polarization angle into an electrical signal, and reflecting light having a polarization angle different from the first polarization angle to the second pixel capable of converting light having a second polarization angle into an electrical signal.
  • the microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to transmit light focusing to the first pixel covered by the microlens.
  • the imaging method is used in an image sensor, and the image sensor includes a pixel array and a microlens array.
  • the pixel array includes a plurality of pixel subunits, each of the pixel subunits includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization angle, the The second pixel has a second polarization angle different from the first polarization angle, the first pixel is capable of converting light having the first polarization angle into an electrical signal, and reflecting light having a polarization angle different from the first polarization angle to the The second pixel is capable of converting light with a second polarization angle into an electrical signal.
  • the microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to transmit light focusing to the first pixel covered by the microlens.
  • the imaging method includes: obtaining the pixel value of the pixel according to the electrical signal converted by each pixel; selecting the polarization angle of at least one pixel in the pixel array as the target polarization angle; The pixel values generate a polarized image.
  • FIG. 1 is a schematic plan view of an electronic device in some embodiments of the present application.
  • FIG. 2 is a schematic structural diagram of an imaging device in some embodiments of the present application.
  • FIG. 3 is an exploded schematic diagram of an image sensor in some embodiments of the present application.
  • FIG. 4 is a schematic diagram of an image sensor in some embodiments of the present application.
  • FIG. 5 is an exploded schematic diagram of an image sensor in some embodiments of the present application.
  • FIG. 6 is a schematic plan view of a polarizing element of an image sensor in some embodiments of the present application.
  • FIG. 7 is a schematic plan view of a polarizing element of an image sensor in some embodiments of the present application.
  • FIG. 8 is a schematic plan view of the filter unit group in the filter array of the image sensor in some embodiments of the present application.
  • FIG. 9 is a schematic plan view of the filter unit group in the filter array of the image sensor in some embodiments of the present application.
  • FIG. 10 is an exploded schematic diagram of an image sensor in some embodiments of the present application.
  • FIG. 11 is a schematic diagram of an image sensor in some embodiments of the present application.
  • FIG. 12 is a schematic diagram of a pixel unit in a pixel array of an image sensor according to some embodiments of the present application.
  • FIG. 13 is a schematic diagram of an image sensor in some embodiments of the present application.
  • Fig. 14 is a schematic diagram of connection between a pixel reading circuit and a pixel in some embodiments of the present application.
  • FIG. 15 is a schematic flowchart of an imaging method in some embodiments of the present application.
  • a first feature being "on” or “under” a second feature may mean that the first and second features are in direct contact, or that the first and second features are indirect through an intermediary. touch.
  • “above”, “above” and “above” the first feature on the second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is horizontally higher than the second feature.
  • “Below”, “beneath” and “beneath” the first feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is less horizontally than the second feature.
  • An embodiment of the present application provides an image sensor, and the image sensor includes a pixel array and a microlens array.
  • the pixel array includes a plurality of pixel subunits, and each pixel subunit includes a first pixel and a second pixel.
  • the first pixel has a first polarization angle
  • the second pixel has a polarization angle different from the first polarization angle.
  • the second polarization angle, the first pixel can convert the light with the first polarization angle into an electrical signal, and reflect the light with a polarization angle different from the first polarization angle to the second pixel, and the second pixel can convert the light with the second polarization angle
  • the light at the polarization angle is converted into an electrical signal.
  • the microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to focus light to the first pixel covered by the microlens.
  • the first polarization angle is orthogonal to the second polarization angle.
  • the first pixel or the second pixel includes a photoelectric conversion element and a polarizing element.
  • the photoelectric conversion element includes a light-receiving surface, the polarizing element is arranged on the light-receiving surface and is inclined, and the polarizing element is used to allow light rays parallel to the angle of the polarization axis of the polarizing element to pass through, and to reflect light rays that are not parallel to the angle of the polarization axis,
  • the angle of the polarization axis of the polarization element in the first pixel is the first polarization angle
  • the angle of the polarization axis of the polarization element in the second pixel is the second polarization angle.
  • the photoelectric conversion element includes an inclined light-receiving surface.
  • both the first pixel and the second pixel include opposite first sides and second sides, and in the same pixel subunit, the first side of the first pixel and the first side of the second pixel connect.
  • the height of the first side of the first pixel is lower than the height of the second side of the first pixel
  • the height of the first side of the second pixel is lower than the height of the second side of the second pixel
  • the included angle between the light-receiving surfaces of the two first pixels and the light-receiving surface of the second pixel in the same pixel sub-unit is within a preset range.
  • the maximum thickness of the area where the microlens covers the first pixel is greater than the maximum thickness of the area that covers the second pixel; or the maximum thickness of the area where the microlens covers the second pixel is greater than The maximum thickness of the area covering the first pixel.
  • the pixel array includes a plurality of pixel units, the pixel unit includes at least two pixel sub-units, and in the same pixel unit, each pixel has a different polarization angle.
  • the image sensor further includes a filter array
  • the filter array includes a plurality of filter units, each filter unit includes at least two filter subunits, and each filter subunit includes two filter units Multiple filter areas of the same filter unit allow the same color of light to pass through, and each filter area corresponds to a pixel.
  • the filter array is disposed between the pixel array and the microlens array.
  • the image sensor further includes a planarization layer disposed between the filter array and the polarizing elements of the pixel array.
  • the pixel array includes minimum repeating units, each minimum repeating unit includes four pixel units, the filter array includes a plurality of filter unit groups, and each filter unit group is arranged by four filter units It forms a matrix of two rows and two columns, and the filter units correspond to the pixel units one by one.
  • the two filter units distributed along the first diagonal direction of the matrix are used to transmit the first color light
  • the two filter units distributed along the second diagonal direction of the matrix are used to transmit the second color light respectively.
  • light and the third color light; or two filter units distributed along the first diagonal direction of the matrix are used to pass through the second color light and the third color light respectively, distributed along the second diagonal direction of the matrix
  • Both filter units are used to transmit the first color light.
  • An embodiment of the present application provides an imaging device, the imaging device includes an image sensor and a lens module, and the image sensor is arranged on an image side of the lens module.
  • the image sensor includes a pixel array and a microlens array
  • the pixel array includes a plurality of pixel subunits, each pixel subunit includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization Angle, the second pixel has a second polarization angle different from the first polarization angle, the first pixel can convert the light with the first polarization angle into an electrical signal, and reflect the light with a polarization angle different from the first polarization angle to The second pixel, the second pixel can convert light with a second polarization angle into an electrical signal;
  • the microlens array includes a plurality of microlenses, and the first pixel and the second pixel in the same pixel subunit are covered by the same microlens , each microlen
  • the first polarization angle is orthogonal to the second polarization angle.
  • the first pixel or the second pixel includes a photoelectric conversion element and a polarizing element.
  • the photoelectric conversion element includes a light-receiving surface, the polarizing element is arranged on the light-receiving surface and is inclined, and the polarizing element is used to allow light rays parallel to the angle of the polarization axis of the polarizing element to pass through, and to reflect light rays that are not parallel to the angle of the polarization axis,
  • the angle of the polarization axis of the polarization element in the first pixel is the first polarization angle
  • the angle of the polarization axis of the polarization element in the second pixel is the second polarization angle.
  • the photoelectric conversion element includes an inclined light-receiving surface.
  • both the first pixel and the second pixel include opposite first sides and second sides, and in the same pixel subunit, the first side of the first pixel and the first side of the second pixel connect.
  • the height of the first side of the first pixel is lower than the height of the second side of the first pixel
  • the height of the first side of the second pixel is lower than the height of the second side of the second pixel
  • the included angle between the light-receiving surfaces of the two first pixels and the light-receiving surface of the second pixel in the same pixel sub-unit is within a preset range.
  • the maximum thickness of the area where the microlens covers the first pixel is greater than the maximum thickness of the area that covers the second pixel; or the maximum thickness of the area where the microlens covers the second pixel is greater than The maximum thickness of the area covering the first pixel.
  • the pixel array includes a plurality of pixel units, the pixel unit includes at least two pixel sub-units, and in the same pixel unit, each pixel has a different polarization angle.
  • the image sensor further includes a filter array
  • the filter array includes a plurality of filter units, each filter unit includes at least two filter subunits, and each filter subunit includes two filter units Multiple filter areas of the same filter unit allow the same color of light to pass through, and each filter area corresponds to a pixel.
  • the filter array is disposed between the pixel array and the microlens array.
  • the image sensor further includes a planarization layer disposed between the filter array and the polarizing elements of the pixel array.
  • the pixel array includes minimum repeating units, each minimum repeating unit includes four pixel units, the filter array includes a plurality of filter unit groups, and each filter unit group is arranged by four filter units It forms a matrix of two rows and two columns, and the filter units correspond to the pixel units one by one.
  • the two filter units distributed along the first diagonal direction of the matrix are used to transmit the first color light
  • the two filter units distributed along the second diagonal direction of the matrix are used to transmit the second color light respectively.
  • light and the third color light; or two filter units distributed along the first diagonal direction of the matrix are used to pass through the second color light and the third color light respectively, distributed along the second diagonal direction of the matrix
  • Both filter units are used to transmit the first color light.
  • An embodiment of the present application provides an electronic device, which includes a casing and the imaging device in any one of the above embodiments.
  • the camera device is mounted on the housing.
  • An embodiment of the present application provides an imaging method for an image sensor.
  • the image sensor includes a pixel array and a microlens array, the pixel array includes a plurality of pixel subunits, each pixel subunit includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization angle, The second pixel has a second polarization angle different from the first polarization angle, the first pixel can convert the light with the first polarization angle into an electrical signal, and reflect the light with a polarization angle different from the first polarization angle to the second pixel.
  • the second pixel is capable of converting light with a second polarization angle into an electrical signal.
  • the microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to focus light to the first pixel covered by the microlens.
  • the imaging method includes: obtaining the pixel value of the pixel according to the electrical signal converted by each pixel; selecting the polarization angle of at least one pixel in the pixel array as the target polarization angle; and generating a polarized image according to the pixel value of the pixel corresponding to the target polarization angle .
  • an electronic device 1000 includes a casing 200 and a camera device 100 .
  • the imaging device 100 is mounted on the casing 200 .
  • the camera device 100 includes an image sensor 10 and a lens module 20 .
  • the image sensor 10 is disposed on the image side of the lens module 20 .
  • the image sensor 10 includes a pixel array 11 and a microlens array 12 .
  • the pixel array 11 includes a plurality of pixel subunits 111, and each pixel subunit 111 includes a first pixel 112a and a second pixel 112b.
  • the first pixel 112a has a first polarization angle
  • the second pixel 112b Having a second polarization angle different from the first polarization angle
  • the first pixel 112a can convert light having the first polarization angle into an electrical signal, and reflect light having a polarization angle different from the first polarization angle to the second pixel 112b .
  • the second pixel 112b is capable of converting the light with the second polarization angle into an electrical signal.
  • the microlens array 12 includes a plurality of microlenses 121 , and the first pixel 112 a and the second pixel 112 b in the same pixel subunit 111 are covered by the same microlens 121 .
  • Each microlens 121 is used to focus light to the first pixel 112 a covered by the microlens 121 .
  • the first pixel 112a can convert the light with the first polarization angle into an electrical signal, and convert the light with the The light with a different polarization angle is reflected to the second pixel 112b, and the second pixel 112b can convert the light with the second polarization angle into an electrical signal.
  • the microlens 121 covering both the first pixel 112 a and the second pixel 112 b can focus the light onto the first pixel 112 a of the two pixels 112 covered by it.
  • the two pixels 112 in the same pixel sub-unit 111 are covered by the same microlens 121, and the light passing through the microlens 121 can all be focused on one of the pixels 112 (the first pixel 112a), this can Increase the light-receiving area of the pixel 112 to increase the amount of light entering the pixel 112; on the other hand, due to the light reflected by the pixel 112 (first pixel 112a), it can be incident on another pixel 112 in the same pixel subunit 111, so The utilization rate of the light reflected by the pixel 112 can be improved, thereby improving the quantum efficiency of the image sensor.
  • the electronic device 1000 may be a mobile phone, a tablet computer, a display, a notebook computer, a teller machine, a gate, a smart watch, a head-mounted display device, a game console, and the like.
  • the embodiment of the present application is described by taking the electronic device 1000 as an example of a mobile phone. It can be understood that the specific form of the electronic device 1000 is not limited to the mobile phone.
  • the casing 200 can be used to install the camera device 100 , or in other words, the casing 200 can be used as an installation carrier of the camera device 100 .
  • the casing 200 can also be used to install functional modules such as the camera device 100 , the power supply device, and the communication device of the electronic device 1000 , so that the casing 200 can provide protection against dust, drop, and water for the functional modules.
  • the image sensor 10 is provided with a microlens array 12 and a pixel array 11 in sequence.
  • the pixel array 11 includes a plurality of pixel subunits 111, and each pixel subunit 111 includes a first pixel 112a and a second pixel 112b.
  • the first pixel 112a has a first polarization angle
  • the second pixel 112b has a second polarization angle different from the first polarization angle
  • the first pixel 112a can convert the light with the first polarization angle into an electrical signal, and will have Different light rays are reflected to the second pixel 112b.
  • the second pixel 112b is capable of converting the light with the second polarization angle into an electrical signal. For example, as shown in FIG.
  • the same pixel subunit 111 includes a first pixel 112 a and a second pixel 112 b. Assume that the first polarization angle of the first pixel 112a is 90°, and the second polarization angle of the second pixel 112b is 45°.
  • the first pixel 112a After the first pixel 112a receives the light, it can polarize the light to convert the light with the first polarization angle (90°) into an electrical signal, and convert the light with the polarization angle different from the first polarization angle (90°) Reflected to the second pixel 112b, the second pixel 112b polarizes the light again after receiving the light, and converts only the light whose polarization angle is the second polarization angle (45°) among the light into electrical signals. In this way, the utilization rate of light reflected by the pixels 112 can be improved, thereby improving the quantum efficiency of the image sensor.
  • the first polarization angle is orthogonal to the second polarization angle (that is, when the angle between the first polarization angle and the second polarization angle is 90°, the first polarization angle can be regarded as Orthogonal to the second polarization angle.
  • the first polarization angle is 0° and the second polarization angle is 90°; or, in one example, the first polarization angle is 45° and the second polarization angle is 135°
  • the first pixel 112a converts the light of the first polarization angle into an electrical signal, and reflects the light of the second polarization angle orthogonal to the first polarization angle to the second pixel 112 .
  • the same pixel subunit 111 includes a first pixel 112 a and a second pixel 112 b.
  • the first polarization angle of the first pixel 112a is 90°
  • the second polarization angle of the second pixel 112b is 0°.
  • the first pixel 112a receives the light and can polarize the light to convert the light with the first polarization angle (90°) into an electrical signal, and convert the light with the second polarization angle orthogonal to the first polarization angle (90°)
  • the light with the polarization angle (0°) is reflected to the second pixel 112b, and the second pixel 112b converts the light with the second polarization angle (0°) into an electrical signal after receiving the light.
  • the second pixel can convert all the light reflected by the first pixel into an electrical signal, which can further improve the utilization rate of the light reflected by the pixel 112, thereby improving the quantum efficiency of the image sensor.
  • the following embodiments are described by taking the first polarization angle and the second polarization angle as an example that are orthogonal to each other.
  • the second pixel 112b after the second pixel 112b receives the light reflected by the first pixel 112a, it can convert the light with the second polarization angle into an electrical signal, and will have a signal different from the second polarization angle.
  • the light with the polarization angle is reflected to the first pixel 112a. That is to say, the second pixel 112 b can also reflect the light that it cannot receive to another pixel (the first pixel 112 a ) in the same pixel sub-unit 111 . In this way, the utilization rate of light reflected by the pixels 112 can be further improved, thereby improving the quantum efficiency of the image sensor.
  • each pixel 112 includes a photoelectric conversion element 1121 and an inclined polarization element 1122 , that is, the first pixel 112 a and the second pixel 112 b both include a photoelectric conversion element 1121 and an inclined polarization element 1122 .
  • the photoelectric conversion element 1121 includes a light-receiving surface 11211, and the photoelectric conversion element 1121 is used to convert light received on the light-receiving surface 11211 into an electrical signal.
  • each polarizing element 1122 there is an included angle between the central axis L of each polarizing element 1122 (the central axis L is a straight line passing through the center of the polarizing element 1122 and perpendicular to the surface of the polarizing element 1122) and the optical axis direction D of the image sensor 10 , that is, the polarizing element 1122 is arranged obliquely, so that the light reflected by the polarizing element 1122 can be incident on another pixel in the same pixel sub-unit 111 .
  • the photoelectric conversion element 1121 includes an inclined light-receiving surface 11211 , that is, the light-receiving surface 11211 is also inclined, so that the polarizing element 1122 is better arranged on the light-receiving surface 11211 .
  • the polarizing element 1122 is disposed on the light receiving surface 11211 of the photoelectric conversion element 1121 .
  • the polarizing element 1122 is used to allow light rays parallel to the angle of the polarization axis of the polarizing element 1122 to pass through, and to reflect light rays not parallel to the angle of the polarization axis.
  • the polarizing element 1122 is used to allow light rays parallel to the angle of the polarization axis of the polarizing element 1122 to pass through, and to reflect light rays perpendicular to the angle of the polarization axis.
  • the angle of the polarization axis of the polarization element 1122 in the first pixel 112a is the first polarization angle
  • the angle of the polarization axis of the polarization element 1122 in the second pixel 112b is the second polarization angle.
  • first polarization angle and the second polarization angle are orthogonal to each other, that is, the angle of the polarization axis of the polarization element 1122 in the first pixel 112a is orthogonal to the angle of the polarization axis of the polarization element 1122 in the second pixel 112b.
  • the angle of the polarization axis of the polarization element 1122 of the first pixel 112a in the same pixel subunit 111 may be 90°, and the angle of the polarization axis of the polarization element 1122 of the second pixel 112b may be 0°;
  • the angle of the polarization axis of the polarization element 1122 of the first pixel 112a in the same pixel subunit 111 may be 45°, and the angle of the polarization axis of the polarization element 1122 of the second pixel 112b may be 135°, which are not described herein. limit.
  • the polarizing element 1122 only allows light rays parallel to the angle of the polarization axis of the polarizing element 1122 to pass through, and can also reflect light rays perpendicular to the angle of the polarization axis. In this way, only light rays (first polarization angle) parallel to the angle of the polarization axis of the polarization element 1222 of the first pixel 112a can pass through the polarization element 1122 and reach the light receiving surface 11211 of the photoelectric conversion element 1121 of the first pixel 112a, and The first pixel 112a can also reflect the light rays (second polarization angle) perpendicular to the angle of the polarization axis of the polarization element 1222 of the first pixel 112a; only the rays parallel to the angle of the polarization axis of the polarization element 1222 of the second pixel 112b ( The second polarization angle) can pass through the polarization element 1122 to reach the light-recei
  • each polarizing element 1122 may include a plurality of microstructure units 11221 arranged in parallel and at intervals, and the microstructure units 11221 may be cuboids or the like.
  • the angle of the arrangement of the microstructure units 11221 the angle of the polarization axis of the corresponding polarizing element 1122 can be determined. Light rays at an angle are completely reflected, thereby achieving polarization of the light.
  • the distance between the microstructure units 11221 can be determined according to the wavelength of the light to be received, and it is only necessary to ensure that the distance between adjacent microstructure units 11221 is smaller than the wavelength of the light to be received. For example, when imaging with visible light, the distance between adjacent microstructure units 11221 needs to be smaller than the minimum wavelength of visible light (such as 380 nanometers), so as to ensure that the polarizing element 1122 can effectively polarize the received light.
  • the material of the microstructure unit 11221 can be metal. Specifically, the material of the microstructure unit 11221 is at least one of gold, silver, copper and aluminum.
  • the material of the microstructure unit 11221 is gold, or the material of the microstructure unit 11221 is silver, or the material of the microstructure unit 11221 is copper, or the material of the microstructure unit 11221 is iron, or the material of the microstructure unit 11221 is gold
  • the alloy with silver, or the material of the microstructure unit 11221 is an alloy of gold and copper, or the material of the microstructure unit 11221 is an alloy of gold and iron, etc., which are not listed here.
  • the polarizing element 1122 may also include a liquid crystal unit 11222 .
  • the number of liquid crystal cells 11222 in each polarizing element 1122 is one or more, which can be set according to the size of the polarizing element 1122 and the size of the liquid crystal cells 11222 .
  • the number of liquid crystal cells 11222 in each polarizing element 1122 is one, two, three, and so on.
  • the liquid crystal unit 11222 can be deflected under the action of an electric field, thereby changing the angle of the polarization axis of the polarization element 1122, so that the angle of the polarization axis of the polarization element 1122 can be changed within a predetermined angle range.
  • the predetermined angle range may be [0°, 180°]. It should be noted that, in some embodiments, the angles of the polarization axes of the polarizing elements 1122 of the two pixels 112 (the first pixel 112a and the second pixel 112b) in the same pixel sub-unit 111 need to be changed at the same time, so that The angle of the polarization axis of the polarization element 1122 of the first pixel 112a in a pixel subunit 111 and the angle of the polarization axis of the polarization element 1122 of the second pixel 112b are always kept orthogonal, that is, so that in the same pixel subunit 111 The first polarization angle of the first pixel 112a and the second polarization angle of the second pixel 112b are always orthogonal to each other.
  • the angle of the polarization axis of the polarization element 1122 of the first pixel 112a is 90°
  • the angle of the polarization axis of the polarization element 1122 of the second pixel 112b may be 0°
  • the pixel subunit 111 can be exposed at the angle of the polarization axis of the polarization element 122 in the initial state to obtain polarization at two polarization angles (90° and 0°).
  • the angle of the polarization axis of the polarizing element 1122 of the two pixels 112 (the first pixel 112a and the second pixel 112b) in the pixel subunit 111 is changed through the liquid crystal unit 11222 (such as the polarizing element 1122 of the first pixel 112a
  • the angle of the polarization axis is changed to 45°
  • the angle of the polarization axis of the polarization element 1122 of the second pixel 112b is changed to 135°)
  • the polarization information of the polarized light of 45° and 135° can be obtained by performing another exposure.
  • the angle of the polarization axis of the polarizing element 122 can be changed again for exposure.
  • the image sensor 10 can acquire polarization information of polarized light at any polarization angle within the predetermined angle range according to requirements, so as to obtain a polarization image at any polarization angle within the predetermined angle range.
  • the angles of the polarization axes of the polarizing elements 1122 of the two pixels 112 (the first pixel 112 a and the second pixel 112 b ) in the same pixel sub-unit 111 may not need to be changed at the same time, and there is no limitation here.
  • the light-receiving surface 11211 of a pixel 112 is inclined to another pixel 112 in the same pixel subunit 111, so that the light reflected by the polarizing element 1122 of the pixel 112 can be incident on the same pixel subunit.
  • the utilization rate of light reflected by the pixels 112 can be improved, thereby improving the quantum efficiency of the image sensor 10 .
  • the pixel 112 also includes opposite first sides 11201 and second sides 11202, that is, the first pixel 112a and the second pixel 112b both include opposite first sides 11201 and second sides 11202, and in the same pixel
  • the first side 11201a of the first pixel 112a is in contact with the first side 11201b of the second pixel 112b.
  • the height of the first side 11201a of the first pixel 112a is lower than the height of the second side 11202a of the first pixel 112a
  • the height of the first side 11201b of the second pixel 112b is lower than that of the second pixel
  • the height of the second side 11202b of 112b is lower than that of the second pixel The height of the second side 11202b of 112b.
  • the angle ⁇ between the light receiving surface 11211 of the first pixel 112a and the light receiving surface 11211 of the second pixel 112b is within a preset range. In this way, the light reflected by any pixel 112 can be incident on the light receiving surface 11211 of another pixel 112 in the same pixel sub-unit 111 . In this way, the utilization rate of light reflected by the pixels 112 can be improved, thereby improving the quantum efficiency of the image sensor 10 .
  • the preset range may be [85°, 95°], that is, the angle between the light-receiving surfaces 11211 of two pixels 112 in the same pixel subunit 111 is approximately 90° .
  • the included angle between the light receiving surfaces 11211 of two pixels 112 in the same pixel sub-unit 111 is 90°. This is more favorable for the light reflected by any pixel 112 to smoothly enter the light receiving surface 11211 of another pixel 112 in the same pixel sub-unit 111 .
  • the microlens array 12 includes a plurality of microlenses 121 , and the first pixel 112 a and the second pixel 112 b in the same pixel subunit 111 are covered by the same microlens 121 .
  • the microlens 121 is used to focus light to the first pixel 112 a or the second pixel 112 b covered by the microlens 121 .
  • the microlens 121 is used to focus the light to the first pixel 112 a covered by the microlens 121 ; or, the microlens 121 is used to focus the light to the second pixel 112 b covered by the microlens 121 .
  • the two pixels 112 (the first pixel 112a and the second pixel 112b) in the same subunit 111 are covered by the same microlens 121, and the light from the light-transmitting microlens 121 can all be focused to one of the pixels 112 (the first pixel 112).
  • the light rays originally respectively entering two adjacent pixels 112 enter one of the pixels 112 . In this way, the light-receiving area of the pixel 112 can be increased, and the amount of light entering can be increased, thereby improving the quantum efficiency of the image sensor 10 .
  • the pixel subunit 111 includes a first pixel 112 a and a second pixel 112 b, and the first pixel 112 a and the second pixel 112 b are covered by the same microlens 121 .
  • the maximum thickness H1 of the area of the microlens 121 covering the first pixel 112 a is greater than the maximum thickness H2 of the area covering the second pixel 112 b.
  • the microlens 121 includes a first surface 1211 and a second surface 1212 opposite to each other, and the second surface 1212 is closer to the pixel array 11 than the first surface 1211 .
  • the distance between the first surface 1211 and the second surface 1212 is the thickness of the microlens 121 .
  • the maximum thickness H1 of the area where the microlens 121 covers the first pixel 112a is, in the area where the microlens 121 covers the first pixel 112a, the maximum distance between the first surface 1211 and the second surface 1212; similarly, the microlens 121
  • the maximum thickness H2 of the area covering the second pixel 112b is the maximum distance between the first surface 1211 and the second surface 1212 in the area where the microlens 121 covers the second pixel 112b.
  • the microlens 121 Due to the asymmetric structure of the microlens 121 , all light rays of the light-transmitting microlens 121 can be focused on the first pixel 112 a covered by the microlens 121 .
  • the maximum thickness H1 of the area of the microlens 121 covering the first pixel 112a may also be smaller than the maximum thickness H2 of the area covering the second pixel 112b so that the transparent All the light from the optical microlens 121 can be focused onto the second pixel 112b covered by it.
  • the microlens 121 can also adopt other structures, as long as the light passing through the light-transmitting microlens 121 can be focused on one of the pixels 112 covered by it, and there is no limitation here.
  • the parallel light first enters the microlens 121, and the microlens 121 can converge all the incoming light to the first pixel 112a.
  • the polarizing element 1122 in the first pixel 112a polarizes the received light, that is, only light of the first polarization angle is allowed to pass through and reach the photoelectric conversion element 1121 of the first pixel 112a for conversion; at the same time, the second polarization angle ( That is, the light rays perpendicular to the first polarization angle are reflected to the second pixel 112b.
  • the polarizing element 1122 on the second pixel 112b can allow the light reflected by the first pixel 112a (light with the second polarization angle) to pass through and reach the photoelectric conversion element 1121 of the second pixel 112b for conversion. In this way, the light-receiving area of the pixel can be increased, the amount of incoming light can be increased, and the utilization rate of light can be improved, thereby improving the quantum efficiency of the image sensor.
  • the image sensor 10 further includes a filter array 13 .
  • the filter array 13 is disposed between the pixel array 11 and the microlens array 12 . That is to say, along the light incident direction of the image sensor 10 , the image sensor 10 sequentially includes a microlens array 12 , a filter array 13 and a pixel array 11 .
  • the filter array 13 includes at least two filter subunits 131, and each filter subunit 131 includes two filter regions 1311, and the two filter regions of the same filter unit allow the transmitted light to have the same color, and Each filter area 1311 corresponds to one pixel 112 . That is to say, the pixel sub-unit 111 is used to receive the light filtered by the corresponding filter sub-unit 131 .
  • each filter subunit 131 includes two filter regions 1311 .
  • Each filter area 1311 corresponds to a pixel 112 , and each pixel 112 is used to receive the light filtered by the corresponding filter area 1311 .
  • first pixel 112a corresponds to one filter area 1311
  • second pixel 112b corresponds to one filter area
  • the first pixel 112a is used to receive the light filtered by the corresponding filter area 1311
  • the second pixel 112b It is used to receive the light filtered by the corresponding filter area 1311 .
  • the two filter regions 1311 of each filter subunit 131 allow the same color of light to pass through (the filter regions marked with the same letter in the figure allow the same color of light to pass through). For example, both filter areas 1311 pass through red light; or, both filter areas 1311 pass through green light; or, both filter areas 1311 pass through blue light; or, both filter areas 1311 Through white light.
  • the two filter regions 1311 can be integrally formed to form a filter sub-unit 131 .
  • the two filter areas 1311 can also be molded separately and combined by gluing or other connection methods to form a filter sub-unit 131 .
  • the two filter regions 1311 in the embodiment of the present application can be integrally formed to form a filter sub-unit 131 , and the two filter regions 1311 are closely combined.
  • the image sensor 10 further includes a flat layer 15 disposed between the filter array 13 and the polarizing element 1122 of the pixel array 11 . Since the light-receiving surfaces 11211 of a plurality of pixels 111 in the pixel array 11 are inclined, a flat surface 15 for flattening the pixels 112 is provided in the filter array 13 and the pixel array 11, which is beneficial to the pixel array 11. The color filter array 13 is covered.
  • the pixel array 11 includes a plurality of pixel units 113 , and the pixel unit 113 includes at least two pixel sub-units 111 .
  • each pixel 112 has different polarization angles. That is, in the same pixel unit 113 , each pixel 112 can convert light with different polarization angles into electrical signals. In this way, polarized light information of at least four polarization angles can be obtained after the pixel unit 113 is exposed, which is beneficial to increase the application scenarios of the image sensor 10 .
  • the polarization angle of the pixel 112 represents the polarization angle of light that the pixel 112 can convert into an electrical signal.
  • the polarization angle of the first pixel 112a is the first polarization angle; similarly, for the second pixel 112b
  • the polarization angle of the second pixel 112b is the second polarization angle. The same is true for the polarization angle of the pixel 112 mentioned below, which will not be repeated here.
  • the pixel unit 113 includes a first pixel sub-unit 111 a and a second pixel sub-unit 111 b.
  • the first pixel subunit 111a includes a first pixel 112a and a second pixel 112b
  • the second pixel subunit 111b includes a first pixel 112c and a second pixel 112d.
  • the first polarization angle of the first pixel 112a in the first pixel subunit 111a is 90°
  • the second polarization angle of the second pixel 112b in the first pixel subunit 111a is 90°
  • the second pixel subunit 111b The first polarization angle of the first pixel 112c in the sub-unit 111b is 135°
  • the second polarization angle of the second pixel 112d in the second pixel sub-unit 111b is 45°.
  • each pixel 112 has a different polarization angle
  • the polarization angles of two pixels 112 in the same pixel sub-unit 111 are orthogonal to each other.
  • the number of pixel sub-units 113 in the same pixel unit 113 may also be three, four, five or even more, which is not limited here.
  • the filter array 13 also includes a plurality of filter units 132, and the filter units 132 correspond to the pixel units 113 one-to-one (as shown in FIG. 11 ), and the color of light that is allowed to pass through all the filter areas 1311 in the same filter unit 132 is the same.
  • the filter unit 132 includes the same number of filter subunits 131 as the number of pixel subunits in the corresponding pixel unit 113 , and the filter subunits 131 correspond to the pixel units 113 one by one (as shown in FIG. 11 ). For example, if the number of pixel sub-units 111 in the pixel unit 113 is two, then the number of filter sub-units 131 in the filter unit 132 is also two.
  • the obtained electrical signals of multiple pixels 112 in the same pixel unit 111 are associated with different polarization angle information, and the obtained electrical signals of multiple pixels 112 are associated with the same color information.
  • the pixel unit 113 includes a first pixel subunit 111a and a second pixel subunit 111b, and the first pixel 112a and the second pixel 112b in the first pixel subunit 111a are arranged along the row direction (X-axis direction). ), the first pixel 112c and the second pixel 112d in the second pixel sub-unit 111b are also arranged along the row direction (X-axis direction).
  • the pixel unit 113 includes a first pixel subunit 111a and a second pixel subunit 111b, and the first pixel 112a and the second pixel 112b in the first pixel subunit 111a are aligned along the column direction (Y-axis direction). ), the first pixel 112c and the second pixel 112d in the second pixel sub-unit 111b are also arranged along the column direction (Y-axis direction).
  • the two pixels 112 in some pixel subunits 112 can also be arranged along the row direction (X-axis direction), and the two pixels 112 in some pixel subunits 112 (
  • the arrangement along the column direction (Y-axis direction) is not limited here.
  • the pixel array 11 includes a minimum repeating unit.
  • the pixel array 11 is composed of a plurality of minimal repeating units 114 which are replicated and arranged in rows and columns.
  • Each minimum repeating unit 114 includes four pixel units 113 .
  • the filter array 13 includes a plurality of filter unit groups 133 , and each filter unit group 133 consists of four filter units 132 arranged in a matrix of two rows and two columns, and the filter units 132 correspond to the pixel units 113 one by one.
  • each filter unit group 133 the four filter units 132 in each filter unit group 133 are used for the first color light A, the second color light B and the third color light C respectively.
  • Each pixel unit 111 receives the light filtered by the corresponding filter unit 132 and transmits the first color light A, the second color light B and the third color light C.
  • the light received by the pixel unit 111 corresponding to the filter unit 132 passing through the first color light A is the first color light A
  • the light received by the pixel unit 111 corresponding to the filter unit 132 of the second color light B is
  • the light received by the pixel unit 111 corresponding to the filter unit 132 of the third color light C is the third color light C.
  • the light received by the pixels 112 in the pixel unit 111 is associated with color information, which can be used to generate a color image.
  • the first color light A can be green light
  • the second color light B can be red light
  • the third color light C can be blue light
  • the first color light A can be yellow light.
  • the light, the second color light B may be red light, and the third color light C may be blue light.
  • the four filter units 132 in each filter unit group 133 can also be used to transmit red light R, green light G, blue light B and white light W respectively, thereby improving the efficiency of dark light environment. The shooting effect below.
  • the aforementioned matrix of two rows and two columns formed by four filter units 132 may have a first diagonal direction D1 and a second diagonal direction D2, and the first diagonal direction D1 and the second diagonal direction D2 different.
  • the first diagonal direction D1 and the second diagonal direction D2 may be perpendicular to each other.
  • the two filter units 132 distributed along the first diagonal direction D1 of the matrix are both used to transmit the first color light A, along the second diagonal direction D2 of the matrix
  • the distributed two filter units 132 are used to transmit the second color light B and the third color light C respectively.
  • two filter units 132 distributed along the first diagonal direction D1 of the matrix are respectively used to transmit the second color light B and the third color light C, along the matrix
  • the two filter units 132 distributed in the second diagonal direction D2 are both used to transmit the light A of the first color.
  • the first color light A can be green light
  • the second color light B can be red light
  • the third color light C can be blue light
  • the first color light A can be yellow light
  • the second color light B can be is red light
  • the third color light C may be blue light.
  • two pixels 112 in all pixel subunits 112 can be arranged along the row direction (X-axis direction) (as shown in FIG. 4 ); or, all pixel subunits 112
  • the two pixels 112 in the center can be arranged along the column direction (Y-axis direction); or, the two pixels 112 in some pixel subunits 112 are arranged along the row direction (X-axis direction) (as shown in Figure 13 left four pixel sub-units 112), some of the two pixels 112 in the pixel sub-units 112 are arranged along the direction of the column (Y-axis direction) (as shown in the four pixel sub-units 112 on the right side of Figure 13), which will not be described here. limit.
  • the pixels 112 arranged at corresponding positions of the four pixel units 113 have the same polarization angle. That is, in the smallest repeating unit 113 , the pixels 112 arranged at the corresponding positions of the four pixel units 113 can convert the light with the same polarization angle into electrical signals.
  • the minimum repeating unit 114 includes a first pixel unit 113a, a second pixel unit 113b, a third pixel unit 113c and a fourth pixel unit 113c. Pixel unit 113d.
  • the first pixel unit 113 a , the second pixel unit 113 b , the third pixel unit 113 c and the fourth pixel unit 113 d each include four pixels 112 arranged in two rows and two columns. Among them, the pixel 112 arranged in the upper left corner of the first pixel unit 113a, the pixel 112 arranged in the upper left corner of the second pixel unit 113a, the pixel 112 arranged in the upper left corner of the third pixel unit 113a, and the pixel 112 arranged in the upper left corner of the fourth pixel unit 113a
  • the pixel 112 at the corner has a polarization angle of 90°; the pixel 112 arranged at the upper right corner of the first pixel unit 113a, the pixel 112 arranged at the upper right corner of the second pixel unit 113a, the pixel 112 arranged at the upper right corner of the third pixel unit 113a , and the pixel 112 arranged in the upper right corner of the fourth pixel
  • the pixels 112 arranged at the corresponding positions of the four pixel units 113 have the same polarization angle, that is, in the minimum repeating unit 113, the pixels 112 arranged at the corresponding positions of the four pixel units 113 can convert light rays with the same polarization angle into electric signal. This facilitates subsequent processing of the acquired image after the pixel array 11 is exposed.
  • the polarization angles of the pixels 112 arranged at the corresponding positions of the four pixel units 113 may also be different, that is, in the smallest repeating unit 113, the pixels 112 arranged at the corresponding positions of the four pixel units 113 Light rays with different polarization angles can also be converted into electrical signals, which is not limited here.
  • the image sensor 10 further includes a metal wiring layer 14 .
  • the metal wiring layer 14 is connected to the pixel array 11 and located on a side away from the light receiving surface 11211 .
  • the metal wiring layer 14 is used to obtain the pixel value of each pixel 112 according to the electrical signal converted when each pixel 112 is exposed.
  • the metal wiring layer 14 includes a plurality of pixel reading circuits 141 , and each pixel reading circuit 141 is connected to a pixel 112 for reading the pixel value of the pixel 112 .
  • the pixel reading circuit 141 includes a floating diffusion region 1411 and a transfer transistor 1412 .
  • the floating diffusion region 1411 is used to store charges
  • the transfer transistor 1412 is used to connect the photodiode of the pixel 112 and the floating diffusion region 1411 to transfer the charge generated by the photoelectric conversion element 1121 (that is, the electrical signal converted by the pixel 112 into light) to the floating Diffusion zone 1411 .
  • the pixel reading circuit 141 is used for determining the pixel value of the corresponding pixel 112 according to the charge of the floating diffusion region 1411 .
  • the photoelectric conversion element 1121 undergoes a photoelectric effect, and the electron-hole pairs generated by light irradiation will be caused by The existence of the electric field of the photoelectric conversion element 1121 is separated, the electrons move to the n region, and the holes move to the p region.
  • the RST is activated, and then the pixel reading circuit 141 is reset so that the readout region is reset to a high level , after the reset is completed, read the reset level, then the transfer transistor 1412 transfers the charge in the n region to the floating diffusion region 1411, then reads the level of the floating diffusion region 1411 as the signal level, and finally according to the signal level and reset level to calculate the pixel value of the pixel 112 (such as the difference between the signal level and the reset level as the level corresponding to the pixel value of the pixel 112, and then the pixel value of the pixel 112 can be calculated according to the level), each The pixel values of the pixels 112 are associated with the corresponding polarization angle information of the polarizing element 1122 and the color information of the filter area 1311 .
  • each pixel subunit 111 includes a first pixel 112a and a second pixel 112b, in the same pixel subunit, the first pixel 112a has a first polarization angle, and the second pixel 112b has a
  • the first pixel 112a can convert the light with the first polarization angle into an electrical signal, and reflect the light with a polarization angle different from the first polarization angle to the second pixel 112b.
  • the second pixel 112b is capable of converting the light with the second polarization angle into an electrical signal.
  • the microlens array 12 includes a plurality of microlenses 121 , and the first pixel 112 a and the second pixel 112 b in the same pixel subunit 111 are covered by the same microlens 121 .
  • Each microlens 121 is used to focus light to one of the first pixels 112 a covered by the microlens 121 .
  • the microlens array 12 includes a plurality of microlenses 121 , and the first pixel 112 a and the second pixel 112 b in the same pixel subunit 111 are covered by the same microlens 121 .
  • the microlens 121 is used to focus light to the first pixel 112 a or the second pixel 112 b covered by the microlens 121 .
  • Imaging methods include:
  • multiple pixel reading circuits 141 in the metal wiring layer 14 can obtain the pixel value of the pixel 112 according to the electrical signal converted by the pixel 112, and the pixel value of each pixel 112 is associated with a corresponding Polarization angle information of the polarizing element 1122 .
  • the specific implementation manner of obtaining the pixel value of the pixel according to the electrical signal converted by the pixel is the same as that in the above-mentioned embodiment, and will not be repeated here.
  • the electronic device 1000 may include a processor 300 , and the processor 300 selects the polarization angle of at least one pixel 112 in the pixel array 11 as the target polarization angle.
  • the pixel array 11 includes the first type of pixels 112 (the textures in Figure 11 are all pixels 112 parallel to the y-axis), the second type of pixels 112 (the textures in Figure 11 are all parallel to the x-axis pixel 112), the third type of pixel 112 (the textures are all pixels 112 from top left to bottom right in FIG. 11 ), and the fourth type of pixels 112 (the textures are all pixels 112 from top right to bottom left in FIG. 11).
  • the processor 300 can select at least one polarization angle among 90°, 0°, 135° or 45° as the target polarization angle.
  • the target polarization angle can be 0°; or, the target polarization angle can also be 90°, 0°; or, the target polarization angle can also be 90°, 0°, 135°, which is not limited here.
  • the processor 300 can select the target polarization angle according to user preference, which is not limited here.
  • the processor 300 may generate a polarization image according to pixel values of pixels corresponding to the target angle. For example, in the embodiment shown in FIG. 11, assuming that the target polarization angle is 0°, the processor 300 generates polarized image.
  • references to the terms “certain embodiments,” “one embodiment,” “some embodiments,” “exemplary embodiments,” “examples,” “specific examples,” or “some examples” To describe means that a specific feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples.
  • first and second are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features.
  • the features defined as “first” and “second” may explicitly or implicitly include at least one of said features.
  • “plurality” means at least two, such as two, three, unless otherwise specifically defined.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Solid State Image Pick-Up Elements (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

An image sensor (10), a camera device (100), an electronic device (1000), and an imaging method. The image sensor (10) comprises a pixel array (11) and a microlens array (12). Each pixel sub-unit of the pixel array (11) comprises a first pixel (112a) and a second pixel (112b) which are covered by a same microlens (121). The first pixel (112a) has a first polarization angle, and the second pixel (112b) has a second polarization angle different from the first polarization angle.

Description

图像传感器、摄像装置、电子设备及成像方法Image sensor, imaging device, electronic device, and imaging method
优先权信息priority information
本申请请求2021年5月25日向中国国家知识产权局提交的、专利申请号为202110571645.0的专利申请的优先权和权益,并且通过参照将其全文并入此处。This application claims the priority and benefit of the patent application No. 202110571645.0 filed with the State Intellectual Property Office of China on May 25, 2021, which is hereby incorporated by reference in its entirety.
技术领域technical field
本申请涉及消费性电子技术领域,更具体而言,涉及一种图像传感器、摄像装置、电子设备及成像方法。The present application relates to the technical field of consumer electronics, and more specifically, to an image sensor, camera device, electronic equipment and imaging method.
背景技术Background technique
为了获取具有偏振信息的偏振图像,通常会在图像传感器中设置偏振元件,以根据不同偏振角度的偏振光生成不同的偏振图像。然而,偏振元件在允许与自身偏振角度相同的光通过的同时,还会将与自身偏振角度不同的光反射出去,如此光经过偏振后,一半的光线都会损失掉。In order to obtain polarization images with polarization information, a polarization element is usually set in the image sensor to generate different polarization images according to polarized light with different polarization angles. However, while the polarizing element allows light with the same polarization angle as its own to pass through, it also reflects light with a different polarization angle from its own, so that after the light is polarized, half of the light will be lost.
发明内容Contents of the invention
本申请实施方式提供一种图像传感器、摄像装置、电子设备及成像方法。Embodiments of the present application provide an image sensor, an imaging device, electronic equipment, and an imaging method.
本申请实施方式的图像传感器包括像素阵列及微透镜阵列。所述像素阵列包括多个像素子单元,每个所述像素子单元包括第一像素和第二像素,在同一个所述像素子单元中,所述第一像素具有第一偏振角度,所述第二像素具有与第一偏振角度不同的第二偏振角度,所述第一像素能够将具有第一偏振角度的光线转换成电信号,并将具有与第一偏振角度不同偏振角度的光线反射至所述第二像素,所述第二像素能够将具有第二偏振角度的光线转换成电信号。所述微透镜阵列包括多个微透镜,同一个所述像素子单元中的所述第一像素和所述第二像素被同一个所述微透镜覆盖,每个所述微透镜用于将光线聚焦至被所述微透镜覆盖的所述第一像素。The image sensor in the embodiment of the present application includes a pixel array and a microlens array. The pixel array includes a plurality of pixel subunits, each of the pixel subunits includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization angle, the The second pixel has a second polarization angle different from the first polarization angle, the first pixel is capable of converting light having the first polarization angle into an electrical signal, and reflecting light having a polarization angle different from the first polarization angle to the The second pixel is capable of converting light with a second polarization angle into an electrical signal. The microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to transmit light focusing to the first pixel covered by the microlens.
本申请实施方式的摄像装置包括图像传感器和镜头模组,所述图像传感器设置在所述镜头模组的像侧。图像传感器包括像素阵列及微透镜阵列。所述像素阵列包括多个像素子单元,每个所述像素子单元包括第一像素和第二像素,在同一个所述像素子单元中,所述第一像素具有第一偏振角度,所述第二像素具有与第一偏振角度不同的第二偏振角度,所述第一像素能够将具有第一偏振角度的光线转换成电信号,并将具有与所述第一偏振角度不同偏振角度的光线反射至所述第二像素,所述第二像素能够将具有第二偏振角度的光线转换成电信号。所述微透镜阵列包括多个微透镜,同一个所述像素子单元中的所述第一像素和所述第二像素被同一个所述微透镜覆盖,每个所述微透镜用于将光线聚焦至被所述微透镜覆盖的所述第一像素。The camera device in the embodiment of the present application includes an image sensor and a lens module, and the image sensor is arranged on an image side of the lens module. The image sensor includes a pixel array and a microlens array. The pixel array includes a plurality of pixel subunits, each of the pixel subunits includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization angle, the The second pixel has a second polarization angle different from the first polarization angle, the first pixel is capable of converting light having the first polarization angle into an electrical signal, and converting light having a polarization angle different from the first polarization angle Reflected to the second pixel, the second pixel is capable of converting light having a second polarization angle into an electrical signal. The microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to transmit light focusing to the first pixel covered by the microlens.
本申请实施方式的电子设备包括壳体和摄像装置,所述摄像装置安装在所述壳体上;所述摄像装置包括图像传感器和镜头模组,所述图像传感器设置在所述镜头模组的像侧。图像传感器包括像素阵列及微透镜阵列。所述像素阵列包括多个像素子单元,每个所述像素子单元包括第一像素和第二像素,在同一个所述像素子单元中,所述第一像素具有第一偏振角度,所述第二像素具有与第一偏振角度不同的第二偏振角度,所述第一像素能够将具有第一偏振角度的光线转换成电信号,并将具有与所述第一偏振角度不同的的光线反射至所述第二像素,所述第二像素能够将具有第二偏振角度的光线转换成电信号。所述微透镜阵列包括多个微透镜,同一个所述像素子单元中的所述第一像素和所述第二像素被同一个所述微透镜覆盖,每个所述微透镜用于将光线聚焦至被所述微透镜覆盖的所述第一像素。The electronic equipment in the embodiment of the present application includes a housing and a camera device, the camera device is installed on the housing; the camera device includes an image sensor and a lens module, and the image sensor is arranged on the lens module like side. The image sensor includes a pixel array and a microlens array. The pixel array includes a plurality of pixel subunits, each of the pixel subunits includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization angle, the The second pixel has a second polarization angle different from the first polarization angle, the first pixel is capable of converting light having the first polarization angle into an electrical signal, and reflecting light having a polarization angle different from the first polarization angle to the second pixel capable of converting light having a second polarization angle into an electrical signal. The microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to transmit light focusing to the first pixel covered by the microlens.
本申请实施方式的成像方法用于图像传感器,图像传感器包括像素阵列及微透镜阵列。所述像素阵列包括多个像素子单元,每个所述像素子单元包括第一像素和第二像素,在同一个所述像素子单元中,所述第一像素具有第一偏振角度,所述第二像素具有与第一偏振角度不同的第二偏振角度,所述第一像素能够将具有第一偏振角度的光线转换成电信号,并将具有与第一偏振角度不同偏振角度的光线反射至所述第二像素,所述第二像素能够将具有第二偏振角度的光线转换成电信号。所述微透镜阵列包括多个微透镜,同一个所述像素子单元中的所述第一像素和所述第二像素被同一个所述微透镜覆盖,每个所述微透镜用于将光线聚焦至被所述微透镜覆盖的所述第一像素。所述成像方法包括:根据每个像素转换的电信号获取所述像素的像素值;选取所述像素阵列中的至少一个像素的偏振角度为目标偏振角度;及根据与目标偏振角度对应的像素的像素值生成偏振图像。The imaging method according to the embodiment of the present application is used in an image sensor, and the image sensor includes a pixel array and a microlens array. The pixel array includes a plurality of pixel subunits, each of the pixel subunits includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization angle, the The second pixel has a second polarization angle different from the first polarization angle, the first pixel is capable of converting light having the first polarization angle into an electrical signal, and reflecting light having a polarization angle different from the first polarization angle to the The second pixel is capable of converting light with a second polarization angle into an electrical signal. The microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to transmit light focusing to the first pixel covered by the microlens. The imaging method includes: obtaining the pixel value of the pixel according to the electrical signal converted by each pixel; selecting the polarization angle of at least one pixel in the pixel array as the target polarization angle; The pixel values generate a polarized image.
本申请的实施方式的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本申请的实施方式的实践了解到。Additional aspects and advantages of the embodiments of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the embodiments of the application.
附图说明Description of drawings
本申请的上述和/或附加的方面和优点从结合下面附图对实施方式的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present application will become apparent and understandable from the description of the embodiments in conjunction with the following drawings, wherein:
图1是本申请某些实施方式的电子设备的平面示意图;FIG. 1 is a schematic plan view of an electronic device in some embodiments of the present application;
图2是本申请某些实施方式的摄像装置的结构示意图;FIG. 2 is a schematic structural diagram of an imaging device in some embodiments of the present application;
图3是本申请某些实施方式的图像传感器的分解示意图;FIG. 3 is an exploded schematic diagram of an image sensor in some embodiments of the present application;
图4是本申请某些实施方式的图像传感器的示意图;4 is a schematic diagram of an image sensor in some embodiments of the present application;
图5是本申请某些实施方式的图像传感器的分解示意图;FIG. 5 is an exploded schematic diagram of an image sensor in some embodiments of the present application;
图6是本申请某些实施方式的图像传感器的偏振元件的平面示意图;6 is a schematic plan view of a polarizing element of an image sensor in some embodiments of the present application;
图7是本申请某些实施方式的图像传感器的偏振元件的平面示意图;7 is a schematic plan view of a polarizing element of an image sensor in some embodiments of the present application;
图8是本申请某些实施方式的图像传感器的滤光片阵列中滤光单元组的平面示意图;8 is a schematic plan view of the filter unit group in the filter array of the image sensor in some embodiments of the present application;
图9是本申请某些实施方式的图像传感器的滤光片阵列中滤光单元组的平面示意图;9 is a schematic plan view of the filter unit group in the filter array of the image sensor in some embodiments of the present application;
图10是本申请某些实施方式的图像传感器的分解示意图;FIG. 10 is an exploded schematic diagram of an image sensor in some embodiments of the present application;
图11是本申请某些实施方式的图像传感器的示意图;11 is a schematic diagram of an image sensor in some embodiments of the present application;
图12是本申请某些实施方式的图像传感器的像素阵列中像素单元的示意图;12 is a schematic diagram of a pixel unit in a pixel array of an image sensor according to some embodiments of the present application;
图13是本申请某些实施方式的图像传感器的示意图;13 is a schematic diagram of an image sensor in some embodiments of the present application;
图14是本申请某些实施方式的像素读取电路和像素的连接示意图;Fig. 14 is a schematic diagram of connection between a pixel reading circuit and a pixel in some embodiments of the present application;
图15是本申请某些实施方式的成像方法的流程示意图。FIG. 15 is a schematic flowchart of an imaging method in some embodiments of the present application.
具体实施方式Detailed ways
以下结合附图对本申请的实施方式作进一步说明。附图中相同或类似的标号自始至终表示相同或类似的元件或具有相同或类似功能的元件。Embodiments of the present application will be further described below in conjunction with the accompanying drawings. The same or similar reference numerals in the drawings represent the same or similar elements or elements having the same or similar functions throughout.
另外,下面结合附图描述的本申请的实施方式是示例性的,仅用于解释本申请的实施方式,而不能理解为对本申请的限制。In addition, the embodiments of the present application described below in conjunction with the accompanying drawings are exemplary, and are only used to explain the embodiments of the present application, and should not be construed as limiting the present application.
在本申请中,除非另有明确的规定和限定,第一特征在第二特征“上”或“下”可以是第一和第二特征直接接触,或第一和第二特征通过中间媒介间接接触。而且,第一特征在第二特征“之上”、“上方”和“上面”可是第一特征在第二特征正上方或斜上方,或仅仅表示第一特征水平 高度高于第二特征。第一特征在第二特征“之下”、“下方”和“下面”可以是第一特征在第二特征正下方或斜下方,或仅仅表示第一特征水平高度小于第二特征。In the present application, unless otherwise clearly specified and limited, a first feature being "on" or "under" a second feature may mean that the first and second features are in direct contact, or that the first and second features are indirect through an intermediary. touch. Moreover, "above", "above" and "above" the first feature on the second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is horizontally higher than the second feature. "Below", "beneath" and "beneath" the first feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is less horizontally than the second feature.
本申请实施方式提供一种图像传感器,图像传感器包括像素阵列及微透镜阵列。像素阵列包括多个像素子单元,每个像素子单元包括第一像素和第二像素,在同一个像素子单元中,第一像素具有第一偏振角度,第二像素具有与第一偏振角度不同的第二偏振角度,第一像素能够将具有第一偏振角度的光线转换成电信号,并将具有与第一偏振角度不同偏振角度的光线反射至第二像素,第二像素能够将具有第二偏振角度的光线转换成电信号。微透镜阵列包括多个微透镜,同一个像素子单元中的第一像素和第二像素被同一个微透镜覆盖,每个微透镜用于将光线聚焦至被微透镜覆盖的第一像素。An embodiment of the present application provides an image sensor, and the image sensor includes a pixel array and a microlens array. The pixel array includes a plurality of pixel subunits, and each pixel subunit includes a first pixel and a second pixel. In the same pixel subunit, the first pixel has a first polarization angle, and the second pixel has a polarization angle different from the first polarization angle. The second polarization angle, the first pixel can convert the light with the first polarization angle into an electrical signal, and reflect the light with a polarization angle different from the first polarization angle to the second pixel, and the second pixel can convert the light with the second polarization angle The light at the polarization angle is converted into an electrical signal. The microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to focus light to the first pixel covered by the microlens.
在某些实施方式中,第一偏振角度与第二偏振角度正交。In some embodiments, the first polarization angle is orthogonal to the second polarization angle.
在某些实施方式中,第一像素或第二像素包括光电转换元件及偏振元件。光电转换元件包括收光面,偏振元件设置于收光面上并倾斜,偏振元件用于允许与偏振元件的偏振轴的角度平行的光线通过,并用于反射与偏振轴的角度不平行的光线,第一像素中的偏振元件的偏振轴的角度为第一偏振角度,第二像素中的偏振元件的偏振轴的角度为第二偏振角度。In some embodiments, the first pixel or the second pixel includes a photoelectric conversion element and a polarizing element. The photoelectric conversion element includes a light-receiving surface, the polarizing element is arranged on the light-receiving surface and is inclined, and the polarizing element is used to allow light rays parallel to the angle of the polarization axis of the polarizing element to pass through, and to reflect light rays that are not parallel to the angle of the polarization axis, The angle of the polarization axis of the polarization element in the first pixel is the first polarization angle, and the angle of the polarization axis of the polarization element in the second pixel is the second polarization angle.
在某些实施方式中,光电转换元件包括倾斜的收光面。In some embodiments, the photoelectric conversion element includes an inclined light-receiving surface.
在某些实施方式中,第一像素和第二像素均包括相背的第一侧及第二侧,在同一个像素子单元中,第一像素的第一侧与第二像素的第一侧相接。在图像传感器的光轴方向,第一像素的第一侧的高度低于第一像素的第二侧的高度,第二像素的第一侧的高度低于第二像素的第二侧的高度;并且在同一像素子单元中的两个第一像素的收光面与第二像素的收光面之间的夹角在预设范围内。In some embodiments, both the first pixel and the second pixel include opposite first sides and second sides, and in the same pixel subunit, the first side of the first pixel and the first side of the second pixel connect. In the direction of the optical axis of the image sensor, the height of the first side of the first pixel is lower than the height of the second side of the first pixel, and the height of the first side of the second pixel is lower than the height of the second side of the second pixel; And the included angle between the light-receiving surfaces of the two first pixels and the light-receiving surface of the second pixel in the same pixel sub-unit is within a preset range.
在某些实施方式中,在图像传感器的光轴方向,微透镜覆盖第一像素的区域的最大厚度大于覆盖第二像素的区域的最大厚度;或微透镜覆盖第二像素的区域的最大厚度大于覆盖第一像素的区域的最大厚度。In some embodiments, in the direction of the optical axis of the image sensor, the maximum thickness of the area where the microlens covers the first pixel is greater than the maximum thickness of the area that covers the second pixel; or the maximum thickness of the area where the microlens covers the second pixel is greater than The maximum thickness of the area covering the first pixel.
在某些实施方式中,像素阵列包括多个像素单元,像素单元包括至少两个像素子单元,在同一像素单元中,每个像素具有的偏振角度均不相同。In some embodiments, the pixel array includes a plurality of pixel units, the pixel unit includes at least two pixel sub-units, and in the same pixel unit, each pixel has a different polarization angle.
在某些实施方式中,图像传感器还包括滤光片阵列,滤光片阵列包括多个滤光单元,每个滤光单元包括至少两个滤光子单元,每个滤光子单元包括两个滤光区,同一个滤光单元的多个滤光区允许透过的光线颜色相同,每个滤光区对应一个像素。In some embodiments, the image sensor further includes a filter array, the filter array includes a plurality of filter units, each filter unit includes at least two filter subunits, and each filter subunit includes two filter units Multiple filter areas of the same filter unit allow the same color of light to pass through, and each filter area corresponds to a pixel.
在某些实施方式中,滤光片阵列设置在像素阵列与微透镜阵列之间。In some embodiments, the filter array is disposed between the pixel array and the microlens array.
在某些实施方式中,图像传感器还包括平坦层,平坦层设置在滤光片阵列与像素阵列的偏振元件之间。In some embodiments, the image sensor further includes a planarization layer disposed between the filter array and the polarizing elements of the pixel array.
在某些实施方式中,像素阵列包括最小重复单元,每个最小重复单元包括四个像素单元,滤光片阵列包括多个滤光单元组,每个滤光单元组由四个滤光单元排列成二行二列的矩阵,滤光单元与像素单元一一对应。沿矩阵的第一对角线方向分布的两个滤光单元均用于透过第一颜色光,沿矩阵的第二对角线方向分布的两个滤光单元分别用于透过第二颜色光和第三颜色光;或沿矩阵的第一对角线方向分布的两个滤光单元分别用于透过第二颜色光和第三颜色光,沿矩阵的第二对角线方向分布的两个滤光单元均用于透过第一颜色光。In some embodiments, the pixel array includes minimum repeating units, each minimum repeating unit includes four pixel units, the filter array includes a plurality of filter unit groups, and each filter unit group is arranged by four filter units It forms a matrix of two rows and two columns, and the filter units correspond to the pixel units one by one. The two filter units distributed along the first diagonal direction of the matrix are used to transmit the first color light, and the two filter units distributed along the second diagonal direction of the matrix are used to transmit the second color light respectively. light and the third color light; or two filter units distributed along the first diagonal direction of the matrix are used to pass through the second color light and the third color light respectively, distributed along the second diagonal direction of the matrix Both filter units are used to transmit the first color light.
本申请实施方式提供一种摄像装置,摄像装置包括图像传感器及镜头模组,图像传感器设置在镜头模组的像侧。其中,图像传感器包括像素阵列及微透镜阵列,像素阵列包括多个像素子单元,每个像素子单元包括第一像素和第二像素,在同一个像素子单元中,第一像素具有第一偏振角度,第二像素具有与第一偏振角度不同的第二偏振角度,第一像素能够将具有第一偏振角度的光线转换成电信号, 并将具有与第一偏振角度不同偏振角度的光线反射至第二像素,第二像素能够将具有第二偏振角度的光线转换成电信号;微透镜阵列包括多个微透镜,同一个像素子单元中的第一像素和第二像素被同一个微透镜覆盖,每个微透镜用于将光线聚焦至被微透镜覆盖的第一像素。An embodiment of the present application provides an imaging device, the imaging device includes an image sensor and a lens module, and the image sensor is arranged on an image side of the lens module. Wherein, the image sensor includes a pixel array and a microlens array, the pixel array includes a plurality of pixel subunits, each pixel subunit includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization Angle, the second pixel has a second polarization angle different from the first polarization angle, the first pixel can convert the light with the first polarization angle into an electrical signal, and reflect the light with a polarization angle different from the first polarization angle to The second pixel, the second pixel can convert light with a second polarization angle into an electrical signal; the microlens array includes a plurality of microlenses, and the first pixel and the second pixel in the same pixel subunit are covered by the same microlens , each microlens is used to focus light to the first pixel covered by the microlens.
在某些实施方式中,第一偏振角度与第二偏振角度正交。In some embodiments, the first polarization angle is orthogonal to the second polarization angle.
在某些实施方式中,第一像素或第二像素包括光电转换元件及偏振元件。光电转换元件包括收光面,偏振元件设置于收光面上并倾斜,偏振元件用于允许与偏振元件的偏振轴的角度平行的光线通过,并用于反射与偏振轴的角度不平行的光线,第一像素中的偏振元件的偏振轴的角度为第一偏振角度,第二像素中的偏振元件的偏振轴的角度为第二偏振角度。In some embodiments, the first pixel or the second pixel includes a photoelectric conversion element and a polarizing element. The photoelectric conversion element includes a light-receiving surface, the polarizing element is arranged on the light-receiving surface and is inclined, and the polarizing element is used to allow light rays parallel to the angle of the polarization axis of the polarizing element to pass through, and to reflect light rays that are not parallel to the angle of the polarization axis, The angle of the polarization axis of the polarization element in the first pixel is the first polarization angle, and the angle of the polarization axis of the polarization element in the second pixel is the second polarization angle.
在某些实施方式中,光电转换元件包括倾斜的收光面。In some embodiments, the photoelectric conversion element includes an inclined light-receiving surface.
在某些实施方式中,第一像素和第二像素均包括相背的第一侧及第二侧,在同一个像素子单元中,第一像素的第一侧与第二像素的第一侧相接。在图像传感器的光轴方向,第一像素的第一侧的高度低于第一像素的第二侧的高度,第二像素的第一侧的高度低于第二像素的第二侧的高度;并且在同一像素子单元中的两个第一像素的收光面与第二像素的收光面之间的夹角在预设范围内。In some embodiments, both the first pixel and the second pixel include opposite first sides and second sides, and in the same pixel subunit, the first side of the first pixel and the first side of the second pixel connect. In the direction of the optical axis of the image sensor, the height of the first side of the first pixel is lower than the height of the second side of the first pixel, and the height of the first side of the second pixel is lower than the height of the second side of the second pixel; And the included angle between the light-receiving surfaces of the two first pixels and the light-receiving surface of the second pixel in the same pixel sub-unit is within a preset range.
在某些实施方式中,在图像传感器的光轴方向,微透镜覆盖第一像素的区域的最大厚度大于覆盖第二像素的区域的最大厚度;或微透镜覆盖第二像素的区域的最大厚度大于覆盖第一像素的区域的最大厚度。In some embodiments, in the direction of the optical axis of the image sensor, the maximum thickness of the area where the microlens covers the first pixel is greater than the maximum thickness of the area that covers the second pixel; or the maximum thickness of the area where the microlens covers the second pixel is greater than The maximum thickness of the area covering the first pixel.
在某些实施方式中,像素阵列包括多个像素单元,像素单元包括至少两个像素子单元,在同一像素单元中,每个像素具有的偏振角度均不相同。In some embodiments, the pixel array includes a plurality of pixel units, the pixel unit includes at least two pixel sub-units, and in the same pixel unit, each pixel has a different polarization angle.
在某些实施方式中,图像传感器还包括滤光片阵列,滤光片阵列包括多个滤光单元,每个滤光单元包括至少两个滤光子单元,每个滤光子单元包括两个滤光区,同一个滤光单元的多个滤光区允许透过的光线颜色相同,每个滤光区对应一个像素。In some embodiments, the image sensor further includes a filter array, the filter array includes a plurality of filter units, each filter unit includes at least two filter subunits, and each filter subunit includes two filter units Multiple filter areas of the same filter unit allow the same color of light to pass through, and each filter area corresponds to a pixel.
在某些实施方式中,滤光片阵列设置在像素阵列与微透镜阵列之间。In some embodiments, the filter array is disposed between the pixel array and the microlens array.
在某些实施方式中,图像传感器还包括平坦层,平坦层设置在滤光片阵列与像素阵列的偏振元件之间。In some embodiments, the image sensor further includes a planarization layer disposed between the filter array and the polarizing elements of the pixel array.
在某些实施方式中,像素阵列包括最小重复单元,每个最小重复单元包括四个像素单元,滤光片阵列包括多个滤光单元组,每个滤光单元组由四个滤光单元排列成二行二列的矩阵,滤光单元与像素单元一一对应。沿矩阵的第一对角线方向分布的两个滤光单元均用于透过第一颜色光,沿矩阵的第二对角线方向分布的两个滤光单元分别用于透过第二颜色光和第三颜色光;或沿矩阵的第一对角线方向分布的两个滤光单元分别用于透过第二颜色光和第三颜色光,沿矩阵的第二对角线方向分布的两个滤光单元均用于透过第一颜色光。In some embodiments, the pixel array includes minimum repeating units, each minimum repeating unit includes four pixel units, the filter array includes a plurality of filter unit groups, and each filter unit group is arranged by four filter units It forms a matrix of two rows and two columns, and the filter units correspond to the pixel units one by one. The two filter units distributed along the first diagonal direction of the matrix are used to transmit the first color light, and the two filter units distributed along the second diagonal direction of the matrix are used to transmit the second color light respectively. light and the third color light; or two filter units distributed along the first diagonal direction of the matrix are used to pass through the second color light and the third color light respectively, distributed along the second diagonal direction of the matrix Both filter units are used to transmit the first color light.
本申请实施方式提供一种电子设备,电子设备包括壳体及上述任意一项实施方式中的摄像装置。摄像装置安装在壳体上。An embodiment of the present application provides an electronic device, which includes a casing and the imaging device in any one of the above embodiments. The camera device is mounted on the housing.
本申请实施方式提供一种成像方法,用于图像传感器。图像传感器包括像素阵列及微透镜阵列,像素阵列包括多个像素子单元,每个像素子单元包括第一像素和第二像素,在同一个像素子单元中,第一像素具有第一偏振角度,第二像素具有与第一偏振角度不同的第二偏振角度,第一像素能够将具有第一偏振角度的光线转换成电信号,并将具有与第一偏振角度不同偏振角度的光线反射至第二像素,第二像素能够将具有第二偏振角度的光线转换成电信号。微透镜阵列包括多个微透镜,同一个像素子单元中的第一像素和第二像素被同一个微透镜覆盖,每个微透镜用于将光线聚焦至被微透镜覆盖的第一像素。成像方法包括:根据每个像素转换的电信号获取像素的像素值;选取像素阵列中的至少一个像素具有的 偏振角度为目标偏振角度;及根据与目标偏振角度对应的像素的像素值生成偏振图像。An embodiment of the present application provides an imaging method for an image sensor. The image sensor includes a pixel array and a microlens array, the pixel array includes a plurality of pixel subunits, each pixel subunit includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization angle, The second pixel has a second polarization angle different from the first polarization angle, the first pixel can convert the light with the first polarization angle into an electrical signal, and reflect the light with a polarization angle different from the first polarization angle to the second pixel. The second pixel is capable of converting light with a second polarization angle into an electrical signal. The microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to focus light to the first pixel covered by the microlens. The imaging method includes: obtaining the pixel value of the pixel according to the electrical signal converted by each pixel; selecting the polarization angle of at least one pixel in the pixel array as the target polarization angle; and generating a polarized image according to the pixel value of the pixel corresponding to the target polarization angle .
请参阅图1,本申请实施方式的电子设备1000包括壳体200和摄像装置100。摄像装置100安装在壳体200上。Referring to FIG. 1 , an electronic device 1000 according to an embodiment of the present application includes a casing 200 and a camera device 100 . The imaging device 100 is mounted on the casing 200 .
请参阅图2,本申请实施方式的摄像装置100包括图像传感器10和镜头模组20。图像传感器10设置在镜头模组20的像侧。Referring to FIG. 2 , the camera device 100 according to the embodiment of the present application includes an image sensor 10 and a lens module 20 . The image sensor 10 is disposed on the image side of the lens module 20 .
请参阅图3及图4,本申请实施方式的图像传感器10包括像素阵列11及微透镜阵列12。像素阵列11包括多个像素子单元111,每个像素子单元111包括第一像素112a及第二像素112b,在同一个像素子单元中,第一像素112a具有第一偏振角度,第二像素112b具有与第一偏振角度不同的第二偏振角度,第一像素112a能够将具有第一偏振角度的光线转换成电信号,并将具有与第一偏振角度不同偏振角度的光线反射至第二像素112b。第二像素112b能够将具有第二偏振角度的光线转换成电信号。微透镜阵列12包括多个微透镜121,同一个像素子单元111中的第一像素112a及第二像素112b被同一个微透镜121覆盖。每个微透镜121用于将光线聚焦至被微透镜121覆盖的第一像素112a。Referring to FIG. 3 and FIG. 4 , the image sensor 10 according to the embodiment of the present application includes a pixel array 11 and a microlens array 12 . The pixel array 11 includes a plurality of pixel subunits 111, and each pixel subunit 111 includes a first pixel 112a and a second pixel 112b. In the same pixel subunit, the first pixel 112a has a first polarization angle, and the second pixel 112b Having a second polarization angle different from the first polarization angle, the first pixel 112a can convert light having the first polarization angle into an electrical signal, and reflect light having a polarization angle different from the first polarization angle to the second pixel 112b . The second pixel 112b is capable of converting the light with the second polarization angle into an electrical signal. The microlens array 12 includes a plurality of microlenses 121 , and the first pixel 112 a and the second pixel 112 b in the same pixel subunit 111 are covered by the same microlens 121 . Each microlens 121 is used to focus light to the first pixel 112 a covered by the microlens 121 .
本申请实施方式的图像传感器10、摄像装置100和电子设备1000中,在同一个像素子单元111中,第一像素112a能够将具有第一偏振角度的光线转换成电信号,并将具有与第一偏振角度不同偏振角度的光线反射至第二像素112b,第二像素112b能够将具有第二偏振角度的光线转换成电信号。并且同时覆盖第一像素112a及第二像素112b的微透镜121能够将光线聚焦至被其覆盖的两个像素112中的第一像素112a上。一方面,由于同一个像素子单元111中的两个像素112被同一个微透镜121覆盖,且穿过微透镜121的光线能够全部聚焦至其中一个像素112(第一像素112a)上,如此能够增大像素112的受光面积,增加进入像素112的光量;另一方面,由于像素112(第一像素112a)反射的光线,能够入射至同个像素子单元111中的另一个像素112上,如此能够提高被像素112反射的光线的利用率,从而提高图像传感器的量子效率。In the image sensor 10, the imaging device 100, and the electronic device 1000 according to the embodiments of the present application, in the same pixel subunit 111, the first pixel 112a can convert the light with the first polarization angle into an electrical signal, and convert the light with the The light with a different polarization angle is reflected to the second pixel 112b, and the second pixel 112b can convert the light with the second polarization angle into an electrical signal. And the microlens 121 covering both the first pixel 112 a and the second pixel 112 b can focus the light onto the first pixel 112 a of the two pixels 112 covered by it. On the one hand, since the two pixels 112 in the same pixel sub-unit 111 are covered by the same microlens 121, and the light passing through the microlens 121 can all be focused on one of the pixels 112 (the first pixel 112a), this can Increase the light-receiving area of the pixel 112 to increase the amount of light entering the pixel 112; on the other hand, due to the light reflected by the pixel 112 (first pixel 112a), it can be incident on another pixel 112 in the same pixel subunit 111, so The utilization rate of the light reflected by the pixel 112 can be improved, thereby improving the quantum efficiency of the image sensor.
请再次参阅图1,更具体地,电子设备1000可以是手机、平板电脑、显示器、笔记本电脑、柜员机、闸机、智能手表、头显设备、游戏机等。本申请实施方式以电子设备1000是手机为例进行说明,可以理解,电子设备1000的具体形式并不限于手机。Please refer to FIG. 1 again. More specifically, the electronic device 1000 may be a mobile phone, a tablet computer, a display, a notebook computer, a teller machine, a gate, a smart watch, a head-mounted display device, a game console, and the like. The embodiment of the present application is described by taking the electronic device 1000 as an example of a mobile phone. It can be understood that the specific form of the electronic device 1000 is not limited to the mobile phone.
壳体200可用于安装摄像装置100,或者说,壳体200可作为摄像装置100的安装载体。壳体200还可用于安装电子设备1000的摄像装置100、供电装置、通信装置等功能模块,以使壳体200为功能模块提供防尘、防摔、防水等保护。The casing 200 can be used to install the camera device 100 , or in other words, the casing 200 can be used as an installation carrier of the camera device 100 . The casing 200 can also be used to install functional modules such as the camera device 100 , the power supply device, and the communication device of the electronic device 1000 , so that the casing 200 can provide protection against dust, drop, and water for the functional modules.
下面结合附图作进一步说明。Further description will be made below in conjunction with the accompanying drawings.
请参阅图3,沿图像传感器10的入光方向,图像传感器10依次设置有微透镜阵列12及像素阵列11。Referring to FIG. 3 , along the incident direction of the image sensor 10 , the image sensor 10 is provided with a microlens array 12 and a pixel array 11 in sequence.
具体地,请参阅图3及图4,像素阵列11包括多个像素子单元111,每个像素子单元111包括第一像素112a及第二像素112b,在同一个像素子单元中,第一像素112a具有第一偏振角度,第二像素112b具有与第一偏振角度不同的第二偏振角度,第一像素112a能够将具有第一偏振角度的光线转换成电信号,并将具有与第一偏振角度不同的光线反射至第二像素112b。第二像素112b能够将具有第二偏振角度的光线转换成电信号。例如,如图4,同一个像素子单元111包括第一像素112a及第二像素112b。假设第一像素112a的第一偏振角度为90°,第二像素112b的第二偏振角为45°。第一像素112a接收到光线后,可以对光线进行偏振,以将具有第一偏振角度(90°)的光线转换成电信号,并将与第一偏振角度(90°)不同的偏振角度的光线反射至第二像素112b, 第二像素112b接收到光线后对光线再次进行偏振,仅将光线中偏振角度为第二偏振角度(45°)的光线转换成电信号。如此能够提高像素112反射光线的利用率,从而提高图像传感器的量子效率。Specifically, referring to FIG. 3 and FIG. 4, the pixel array 11 includes a plurality of pixel subunits 111, and each pixel subunit 111 includes a first pixel 112a and a second pixel 112b. In the same pixel subunit, the first pixel 112a has a first polarization angle, the second pixel 112b has a second polarization angle different from the first polarization angle, the first pixel 112a can convert the light with the first polarization angle into an electrical signal, and will have Different light rays are reflected to the second pixel 112b. The second pixel 112b is capable of converting the light with the second polarization angle into an electrical signal. For example, as shown in FIG. 4 , the same pixel subunit 111 includes a first pixel 112 a and a second pixel 112 b. Assume that the first polarization angle of the first pixel 112a is 90°, and the second polarization angle of the second pixel 112b is 45°. After the first pixel 112a receives the light, it can polarize the light to convert the light with the first polarization angle (90°) into an electrical signal, and convert the light with the polarization angle different from the first polarization angle (90°) Reflected to the second pixel 112b, the second pixel 112b polarizes the light again after receiving the light, and converts only the light whose polarization angle is the second polarization angle (45°) among the light into electrical signals. In this way, the utilization rate of light reflected by the pixels 112 can be improved, thereby improving the quantum efficiency of the image sensor.
特别地,在一些实施例中,第一偏振角度与第二偏振角度正交(也即,当第一偏振角度与第二偏振角度之间的夹角为90°,则可认为第一偏振角度与第二偏振角度正交。例如,在一个例子中,第一偏振角度为0°,第二偏振角度为90°;或者,在一个例子中,第一偏振角度为45°,第二偏振角度为135°),且第一像素112a将的第一偏振角度的光线转换成电信号,将与第一偏振角度正交的第二偏振角度的光线反射至第二像素112。在一个例子中,如图4,同一个像素子单元111包括第一像素112a及第二像素112b。假设第一像素112a的第一偏振角度为90°,第二像素112b的第二偏振角为0°。第一像素112a接收到光线,可以对光线进行偏振,以将具有第一偏振角度(90°)的光线转换成电信号,并将与第一偏振角度(90°)正交的第二偏振角度(0°)的偏振角度的光线反射至第二像素112b,第二像素112b接收到光线后将第二偏振角度(0°)的光线转换成电信号。如此,第二像素能够将第一像素反射的光线全部转换成电信号,能够更进一步的提高像素112反射光线的利用率,从而提高图像传感器的量子效率。为了方便说明,以下实施例,均以第一偏振角度与第二偏振角度相互正交为例进行说明。In particular, in some embodiments, the first polarization angle is orthogonal to the second polarization angle (that is, when the angle between the first polarization angle and the second polarization angle is 90°, the first polarization angle can be regarded as Orthogonal to the second polarization angle. For example, in one example, the first polarization angle is 0° and the second polarization angle is 90°; or, in one example, the first polarization angle is 45° and the second polarization angle is 135°), and the first pixel 112a converts the light of the first polarization angle into an electrical signal, and reflects the light of the second polarization angle orthogonal to the first polarization angle to the second pixel 112 . In one example, as shown in FIG. 4 , the same pixel subunit 111 includes a first pixel 112 a and a second pixel 112 b. Assume that the first polarization angle of the first pixel 112a is 90°, and the second polarization angle of the second pixel 112b is 0°. The first pixel 112a receives the light and can polarize the light to convert the light with the first polarization angle (90°) into an electrical signal, and convert the light with the second polarization angle orthogonal to the first polarization angle (90°) The light with the polarization angle (0°) is reflected to the second pixel 112b, and the second pixel 112b converts the light with the second polarization angle (0°) into an electrical signal after receiving the light. In this way, the second pixel can convert all the light reflected by the first pixel into an electrical signal, which can further improve the utilization rate of the light reflected by the pixel 112, thereby improving the quantum efficiency of the image sensor. For convenience of description, the following embodiments are described by taking the first polarization angle and the second polarization angle as an example that are orthogonal to each other.
需要说明的是,在一些实施例中,第二像素112b接收到第一像素112a反射的光线后,能够将具有第二偏振角度的光线转换成电信号,并将具有与第二偏振角度不同的偏振角度的光线反射至第一像素112a。也即,第二像素112b也能够将其不能接收的光线反射至同一像素子单元111中的另一个像素(第一像素112a)上。如此能够更进一步的提高像素112反射光线的利用率,从而提高图像传感器的量子效率。It should be noted that, in some embodiments, after the second pixel 112b receives the light reflected by the first pixel 112a, it can convert the light with the second polarization angle into an electrical signal, and will have a signal different from the second polarization angle. The light with the polarization angle is reflected to the first pixel 112a. That is to say, the second pixel 112 b can also reflect the light that it cannot receive to another pixel (the first pixel 112 a ) in the same pixel sub-unit 111 . In this way, the utilization rate of light reflected by the pixels 112 can be further improved, thereby improving the quantum efficiency of the image sensor.
示例地,如图5所示,每个像素112包括光电转换元件1121及倾斜的偏振元件1122,也即,第一像素112a及第二像素112b均包括光电转换元件1121及倾斜的偏振元件1122。其中,光电转换元件1121包括收光面11211,光电转换元件1121用于将收光面11211上接收到的光线转换为电信号。需要说明的是,每个偏振元件1122的中心轴L(中心轴L为过偏振元件1122的中心且与偏振元件1122表面垂直的直线),与图像传感器10的光轴方向D之间存在夹角,也即偏振元件1122倾斜设置,如此有利于被偏振元件1122反射的光线能够入射至同一像素子单元111中的另一个像素上。在一些实施例中,光电转换元件1121包括倾斜的收光面11211,也即收光面11211也是倾斜设置的,如此有利于偏振元件1122更好的设置在收光面11211上。For example, as shown in FIG. 5 , each pixel 112 includes a photoelectric conversion element 1121 and an inclined polarization element 1122 , that is, the first pixel 112 a and the second pixel 112 b both include a photoelectric conversion element 1121 and an inclined polarization element 1122 . Wherein, the photoelectric conversion element 1121 includes a light-receiving surface 11211, and the photoelectric conversion element 1121 is used to convert light received on the light-receiving surface 11211 into an electrical signal. It should be noted that there is an included angle between the central axis L of each polarizing element 1122 (the central axis L is a straight line passing through the center of the polarizing element 1122 and perpendicular to the surface of the polarizing element 1122) and the optical axis direction D of the image sensor 10 , that is, the polarizing element 1122 is arranged obliquely, so that the light reflected by the polarizing element 1122 can be incident on another pixel in the same pixel sub-unit 111 . In some embodiments, the photoelectric conversion element 1121 includes an inclined light-receiving surface 11211 , that is, the light-receiving surface 11211 is also inclined, so that the polarizing element 1122 is better arranged on the light-receiving surface 11211 .
偏振元件1122设置于光电转换元件1121的收光面11211上。偏振元件1122用于允许与偏振元件1122偏振轴的角度平行的光线通过,并用于反射与偏振轴的角度不平行的光线。The polarizing element 1122 is disposed on the light receiving surface 11211 of the photoelectric conversion element 1121 . The polarizing element 1122 is used to allow light rays parallel to the angle of the polarization axis of the polarizing element 1122 to pass through, and to reflect light rays not parallel to the angle of the polarization axis.
需要说明的是,在一些实施例中,偏振元件1122用于允许与偏振元件1122偏振轴的角度平行的光线通过,并用于反射与偏振轴的角度正交的光线。示例地,第一像素112a中的偏振元件1122的偏振轴的角度为第一偏振角度,第二像素112b中的偏振元件1122的偏振轴的角度为第二偏振角度。并且第一偏振角度与第二偏振角度相互正交,也即,第一像素112a中的偏振元件1122的偏振轴的角度与第二像素112b中的偏振元件1122的偏振轴的角度相互正交。例如,在一个例子中,同一个像素子单元111中的第一像素112a的偏振元件1122偏振轴的角度可以是90°、第二像素112b的偏振元件1122偏振轴的角度可以是0°;再另一个例子中,同一个像素子单元111中的第一像素112a的偏振元件1122偏振轴的角度可以是45°、第二像素112b的偏振元件1122偏振轴的角度可以是135°,在此不作限制。由于偏振元件1122仅允许与偏振元件1122偏振轴的角 度平行的光线通过,并且还能够反射与偏振轴的角度正交的光线。如此,只有与第一像素112a的偏振元件1222偏振轴的角度平行的光线(第一偏振角度)才能够透过偏振元件1122到达第一像素112a的光电转换元件1121的收光面11211上,并且第一像素112a还能够将与第一像素112a的偏振元件1222偏振轴的角度正交的光线(第二偏振角度)反射;只有与第二像素112b的偏振元件1222偏振轴的角度平行的光线(第二偏振角度)才能够透过偏振元件1122到达第二像素112b的光电转换元件1121的收光面11211上,并且第二像素112b还能够将与第二像素112b的偏振元件1222偏振轴的角度正交的光线(第一偏振角度)反射。It should be noted that, in some embodiments, the polarizing element 1122 is used to allow light rays parallel to the angle of the polarization axis of the polarizing element 1122 to pass through, and to reflect light rays perpendicular to the angle of the polarization axis. Exemplarily, the angle of the polarization axis of the polarization element 1122 in the first pixel 112a is the first polarization angle, and the angle of the polarization axis of the polarization element 1122 in the second pixel 112b is the second polarization angle. And the first polarization angle and the second polarization angle are orthogonal to each other, that is, the angle of the polarization axis of the polarization element 1122 in the first pixel 112a is orthogonal to the angle of the polarization axis of the polarization element 1122 in the second pixel 112b. For example, in one example, the angle of the polarization axis of the polarization element 1122 of the first pixel 112a in the same pixel subunit 111 may be 90°, and the angle of the polarization axis of the polarization element 1122 of the second pixel 112b may be 0°; In another example, the angle of the polarization axis of the polarization element 1122 of the first pixel 112a in the same pixel subunit 111 may be 45°, and the angle of the polarization axis of the polarization element 1122 of the second pixel 112b may be 135°, which are not described herein. limit. Because the polarizing element 1122 only allows light rays parallel to the angle of the polarization axis of the polarizing element 1122 to pass through, and can also reflect light rays perpendicular to the angle of the polarization axis. In this way, only light rays (first polarization angle) parallel to the angle of the polarization axis of the polarization element 1222 of the first pixel 112a can pass through the polarization element 1122 and reach the light receiving surface 11211 of the photoelectric conversion element 1121 of the first pixel 112a, and The first pixel 112a can also reflect the light rays (second polarization angle) perpendicular to the angle of the polarization axis of the polarization element 1222 of the first pixel 112a; only the rays parallel to the angle of the polarization axis of the polarization element 1222 of the second pixel 112b ( The second polarization angle) can pass through the polarization element 1122 to reach the light-receiving surface 11211 of the photoelectric conversion element 1121 of the second pixel 112b, and the second pixel 112b can also use the angle of the polarization axis of the polarization element 1222 of the second pixel 112b Orthogonal rays (first polarization angle) are reflected.
具体地,请参阅图6,在一些实施例中,每个偏振元件1122可包括多个平行且间隔排列的微结构单元11221,微结构单元11221可为长方体等。通过设置微结构单元11221排列的角度,可确定对应的偏振元件1122的偏振轴的角度,与该微结构单元11221的排列的角度平行的光线可以通过微结构单元11221,而正交于该排列的角度的光线会被完全反射,从而实现光的偏振。Specifically, referring to FIG. 6 , in some embodiments, each polarizing element 1122 may include a plurality of microstructure units 11221 arranged in parallel and at intervals, and the microstructure units 11221 may be cuboids or the like. By setting the angle of the arrangement of the microstructure units 11221, the angle of the polarization axis of the corresponding polarizing element 1122 can be determined. Light rays at an angle are completely reflected, thereby achieving polarization of the light.
微结构单元11221的间距可根据需要接收的光线的波长确定,只需要保证相邻微结构单元11221的间距小于需要接收的光线的波长即可。例如,在可见光成像时,相邻微结构单元11221的间距需要小于可见光的最小波长(如380纳米),以保证偏振元件1122能够对接收的光线进行有效的偏振。微结构单元11221的材料可为金属。具体地,微结构单元11221的材料为金,银,铜,铝中至少一种。例如,微结构单元11221的材料为金,或微结构单元11221的材料为银,或微结构单元11221的材料为铜,或微结构单元11221的材料为铁,或微结构单元11221的材料为金和银的合金,或微结构单元11221的材料为金和铜的合金,或微结构单元11221的材料为金和铁的合金等等,在此不一一列举。The distance between the microstructure units 11221 can be determined according to the wavelength of the light to be received, and it is only necessary to ensure that the distance between adjacent microstructure units 11221 is smaller than the wavelength of the light to be received. For example, when imaging with visible light, the distance between adjacent microstructure units 11221 needs to be smaller than the minimum wavelength of visible light (such as 380 nanometers), so as to ensure that the polarizing element 1122 can effectively polarize the received light. The material of the microstructure unit 11221 can be metal. Specifically, the material of the microstructure unit 11221 is at least one of gold, silver, copper and aluminum. For example, the material of the microstructure unit 11221 is gold, or the material of the microstructure unit 11221 is silver, or the material of the microstructure unit 11221 is copper, or the material of the microstructure unit 11221 is iron, or the material of the microstructure unit 11221 is gold The alloy with silver, or the material of the microstructure unit 11221 is an alloy of gold and copper, or the material of the microstructure unit 11221 is an alloy of gold and iron, etc., which are not listed here.
请参阅图7,在一些实施例中,偏振元件1122还可以包括液晶单元11222。每个偏振元件1122内的液晶单元11222的数量为一个或多个,可根据偏振元件1122的大小及液晶单元的11222大小设置。例如,每个偏振元件1122内的液晶单元11222的数量为一个、两个、三个等。液晶单元11222可在电场的作用下进行偏转,从而改变偏振元件1122的偏振轴的角度,以使得偏振元件1122的偏振轴的角度可在预定角度范围内变化。例如,预定角度范围可为[0°,180°]。需要说明的是,在一些实施例中,同一个像素子单元111中的两个像素112(第一像素112a及第二像素112b)的偏振元件1122的偏振轴的角度需要同时改变,以使同一个像素子单元111中第一像素112a的偏振元件1122的偏振轴的角度与第二像素112b的偏振元件1122的偏振轴的角度始终保持正交,也即,以使同一个像素子单元111中的第一像素112a的第一偏振角度与第二像素112b的第二偏振角度始终相互正交。例如,在初始状态下,其中一个像素子单元111中,第一像素112a的偏振元件1122偏振轴的角度是90°、第二像素112b的偏振元件1122偏振轴的角度可以是0°,该像素子单元111在以初始状态的偏振元件122的偏振轴的角度进行曝光后可得到两个偏振角度(90°和0°)的偏振光的偏振信息。若想要获取更多偏振角度的偏振光的偏振信息,该像素子单元111可以在以初始状态的偏振元件122的偏振轴的角度进行曝光获得两个偏振角度(90°和0°)的偏振光之后,再过液晶单元11222将该像素子单元111中两个像素112(第一像素112a及第二像素112b)的偏振元件1122的偏振轴的角度改变(如第一像素112a的偏振元件1122偏振轴的角度改变为45°、第二像素112b的偏振元件1122偏振轴的角度改变为135°)后再进行一次曝光即可获取45°和135°的偏振光的偏振信息,若还想获取更多偏振角度的偏振光的偏振信息,则可再次改变偏振元件122的偏振轴的角度并进行曝光。如此,图像传感器10可根据需求获取预定角度范围内任意偏振角度的偏振光的偏振信息,从而得到预定角度范围内任意偏振角度的偏振图像。 当然,同一个像素子单元111中的两个像素112(第一像素112a及第二像素112b)的偏振元件1122的偏振轴的角度也可以不需要同时改变,在此不作限制。Please refer to FIG. 7 , in some embodiments, the polarizing element 1122 may also include a liquid crystal unit 11222 . The number of liquid crystal cells 11222 in each polarizing element 1122 is one or more, which can be set according to the size of the polarizing element 1122 and the size of the liquid crystal cells 11222 . For example, the number of liquid crystal cells 11222 in each polarizing element 1122 is one, two, three, and so on. The liquid crystal unit 11222 can be deflected under the action of an electric field, thereby changing the angle of the polarization axis of the polarization element 1122, so that the angle of the polarization axis of the polarization element 1122 can be changed within a predetermined angle range. For example, the predetermined angle range may be [0°, 180°]. It should be noted that, in some embodiments, the angles of the polarization axes of the polarizing elements 1122 of the two pixels 112 (the first pixel 112a and the second pixel 112b) in the same pixel sub-unit 111 need to be changed at the same time, so that The angle of the polarization axis of the polarization element 1122 of the first pixel 112a in a pixel subunit 111 and the angle of the polarization axis of the polarization element 1122 of the second pixel 112b are always kept orthogonal, that is, so that in the same pixel subunit 111 The first polarization angle of the first pixel 112a and the second polarization angle of the second pixel 112b are always orthogonal to each other. For example, in the initial state, in one of the pixel subunits 111, the angle of the polarization axis of the polarization element 1122 of the first pixel 112a is 90°, and the angle of the polarization axis of the polarization element 1122 of the second pixel 112b may be 0°, the pixel After the subunit 111 is exposed at the angle of the polarization axis of the polarization element 122 in the initial state, polarization information of polarized light at two polarization angles (90° and 0°) can be obtained. If it is desired to obtain the polarization information of polarized light with more polarization angles, the pixel subunit 111 can be exposed at the angle of the polarization axis of the polarization element 122 in the initial state to obtain polarization at two polarization angles (90° and 0°). After light, the angle of the polarization axis of the polarizing element 1122 of the two pixels 112 (the first pixel 112a and the second pixel 112b) in the pixel subunit 111 is changed through the liquid crystal unit 11222 (such as the polarizing element 1122 of the first pixel 112a The angle of the polarization axis is changed to 45°, the angle of the polarization axis of the polarization element 1122 of the second pixel 112b is changed to 135°), and then the polarization information of the polarized light of 45° and 135° can be obtained by performing another exposure. For the polarization information of the polarized light with more polarization angles, the angle of the polarization axis of the polarizing element 122 can be changed again for exposure. In this way, the image sensor 10 can acquire polarization information of polarized light at any polarization angle within the predetermined angle range according to requirements, so as to obtain a polarization image at any polarization angle within the predetermined angle range. Of course, the angles of the polarization axes of the polarizing elements 1122 of the two pixels 112 (the first pixel 112 a and the second pixel 112 b ) in the same pixel sub-unit 111 may not need to be changed at the same time, and there is no limitation here.
请参阅图5,像素112的收光面11211向与其在同一个像素子单元111中的另一个像素112倾斜,以使被该像素112的偏振元件1122反射的光线,能够入射至同个像素子单元111中的另一个像素112的收光面11211上。如此能够提高被像素112反射的光线的利用率,从而提高图像传感器10的量子效率。Please refer to FIG. 5 , the light-receiving surface 11211 of a pixel 112 is inclined to another pixel 112 in the same pixel subunit 111, so that the light reflected by the polarizing element 1122 of the pixel 112 can be incident on the same pixel subunit. On the light receiving surface 11211 of another pixel 112 in the unit 111. In this way, the utilization rate of light reflected by the pixels 112 can be improved, thereby improving the quantum efficiency of the image sensor 10 .
具体地,像素112还包括相背的第一侧11201及第二侧11202,也即第一像素112a及第二像素112b均包括相背的第一侧11201及第二侧11202,在同一个像素子单元111中,第一像素112a的第一侧11201a与第二像素112b的第一侧11201b相接。在图像传感器10的光轴方向,第一像素112a的第一侧11201a的高度低于第一像素112a的第二侧11202a的高度,第二像素112b的第一侧11201b的高度低于第二像素112b的第二侧11202b的高度。第一像素112a的收光面11211与第二像素112b的收光面11211的夹角α在预设范围内。如此,被任意一个像素112反射的光线,能够入射至同个像素子单元111中的另一个像素112的收光面11211上。如此能够提高被像素112反射的光线的利用率,从而提高图像传感器10的量子效率。Specifically, the pixel 112 also includes opposite first sides 11201 and second sides 11202, that is, the first pixel 112a and the second pixel 112b both include opposite first sides 11201 and second sides 11202, and in the same pixel In the subunit 111, the first side 11201a of the first pixel 112a is in contact with the first side 11201b of the second pixel 112b. In the direction of the optical axis of the image sensor 10, the height of the first side 11201a of the first pixel 112a is lower than the height of the second side 11202a of the first pixel 112a, and the height of the first side 11201b of the second pixel 112b is lower than that of the second pixel The height of the second side 11202b of 112b. The angle α between the light receiving surface 11211 of the first pixel 112a and the light receiving surface 11211 of the second pixel 112b is within a preset range. In this way, the light reflected by any pixel 112 can be incident on the light receiving surface 11211 of another pixel 112 in the same pixel sub-unit 111 . In this way, the utilization rate of light reflected by the pixels 112 can be improved, thereby improving the quantum efficiency of the image sensor 10 .
需要说明的是,在一些实施例中,预设范围可以为[85°,95°],也即,同一个像素子单元111中的两个像素112收光面11211的夹角大致在90°。如此有利于被任意一个像素112反射的光线,能够顺利入射至同个像素子单元111中的另一个像素112的收光面11211上。例如,在一个例子中,同一个像素子单元111中的两个像素112收光面11211的夹角为90°。如此更有利于被任意一个像素112反射的光线,能够顺利入射至同个像素子单元111中的另一个像素112的收光面11211上。It should be noted that, in some embodiments, the preset range may be [85°, 95°], that is, the angle between the light-receiving surfaces 11211 of two pixels 112 in the same pixel subunit 111 is approximately 90° . This is beneficial for the light reflected by any pixel 112 to smoothly enter the light receiving surface 11211 of another pixel 112 in the same pixel sub-unit 111 . For example, in one example, the included angle between the light receiving surfaces 11211 of two pixels 112 in the same pixel sub-unit 111 is 90°. This is more favorable for the light reflected by any pixel 112 to smoothly enter the light receiving surface 11211 of another pixel 112 in the same pixel sub-unit 111 .
请参阅图1及图4,微透镜阵列12包括多个微透镜121,同一个像素子单元111中的第一像素112a和第二像素112b被同一个微透镜121覆盖。微透镜121用于将光线聚焦至被微透镜121覆盖的第一像素112a或第二像素112b。例如,微透镜121用于将光线聚焦至被微透镜121覆盖的第一像素112a;或者,微透镜121用于将光线聚焦至被微透镜121覆盖的第二像素112b。由于同一子单元111中的两个像素112(第一像素112a和第二像素112b)被同一个微透镜121覆盖,且透光微透镜121的光线能够全部聚焦至其中的一个像素112(第一像素112a或第二像素112b)上,使原来分别进入两个相邻像素112的光线,均进入其中一个像素112中。如此能够提高像素112的受光面积,增加进光量,从而提高图像传感器10的量子效率。Referring to FIG. 1 and FIG. 4 , the microlens array 12 includes a plurality of microlenses 121 , and the first pixel 112 a and the second pixel 112 b in the same pixel subunit 111 are covered by the same microlens 121 . The microlens 121 is used to focus light to the first pixel 112 a or the second pixel 112 b covered by the microlens 121 . For example, the microlens 121 is used to focus the light to the first pixel 112 a covered by the microlens 121 ; or, the microlens 121 is used to focus the light to the second pixel 112 b covered by the microlens 121 . Since the two pixels 112 (the first pixel 112a and the second pixel 112b) in the same subunit 111 are covered by the same microlens 121, and the light from the light-transmitting microlens 121 can all be focused to one of the pixels 112 (the first pixel 112). On the pixel 112 a or the second pixel 112 b ), the light rays originally respectively entering two adjacent pixels 112 enter one of the pixels 112 . In this way, the light-receiving area of the pixel 112 can be increased, and the amount of light entering can be increased, thereby improving the quantum efficiency of the image sensor 10 .
具体地,请参阅图5,在一些实施例中,像素子单元111包括第一像素112a及第二像素112b,并且第一像素112a及第二像素112b被同一个微透镜121覆盖。在图像传感器10的光轴方向,微透镜121覆盖第一像素112a的区域的最大厚度H1大于覆盖第二像素112b的区域的最大厚度H2。需要说明的是,微透镜121包括相背的第一表面1211及第二表面1212,第二表面1212相较于第一表面1211更靠近像素阵列11。在图像传感器10的光轴方向上,第一表面1211与第二表面1212之间的距离为微透镜121的厚度。微透镜121覆盖第一像素112a的区域的最大厚度H1为,在微透镜121覆盖第一像素112a的区域中,第一表面1211与第二表面1212之间的最大距离;同样地,微透镜121覆盖第二像素112b的区域的最大厚度H2为,在微透镜121覆盖第二像素112b的区域中,第一表面1211与第二表面1212之间的最大距离。Specifically, referring to FIG. 5 , in some embodiments, the pixel subunit 111 includes a first pixel 112 a and a second pixel 112 b, and the first pixel 112 a and the second pixel 112 b are covered by the same microlens 121 . In the optical axis direction of the image sensor 10 , the maximum thickness H1 of the area of the microlens 121 covering the first pixel 112 a is greater than the maximum thickness H2 of the area covering the second pixel 112 b. It should be noted that the microlens 121 includes a first surface 1211 and a second surface 1212 opposite to each other, and the second surface 1212 is closer to the pixel array 11 than the first surface 1211 . In the direction of the optical axis of the image sensor 10 , the distance between the first surface 1211 and the second surface 1212 is the thickness of the microlens 121 . The maximum thickness H1 of the area where the microlens 121 covers the first pixel 112a is, in the area where the microlens 121 covers the first pixel 112a, the maximum distance between the first surface 1211 and the second surface 1212; similarly, the microlens 121 The maximum thickness H2 of the area covering the second pixel 112b is the maximum distance between the first surface 1211 and the second surface 1212 in the area where the microlens 121 covers the second pixel 112b.
由于微透镜121的非对称的结构,如此能够使透光微透镜121的光线能够全部聚焦至被其覆盖的第一像素112a上。同样地,在一些实施例中,在图像传感器10的光轴方向,微透镜121覆 盖第一像素112a的区域的最大厚度H1也可以小于覆盖第二像素112b的区域的最大厚度H2如此能够使透光微透镜121的光线能够全部聚焦至被其覆盖的第二像素112b上。当然,微透镜121也可以采用其他结构,只需要满足能够使透过透光微透镜121的光线能够全部聚焦至被其覆盖的其中一个像素112上即可,在此不做限制。Due to the asymmetric structure of the microlens 121 , all light rays of the light-transmitting microlens 121 can be focused on the first pixel 112 a covered by the microlens 121 . Similarly, in some embodiments, in the direction of the optical axis of the image sensor 10, the maximum thickness H1 of the area of the microlens 121 covering the first pixel 112a may also be smaller than the maximum thickness H2 of the area covering the second pixel 112b so that the transparent All the light from the optical microlens 121 can be focused onto the second pixel 112b covered by it. Of course, the microlens 121 can also adopt other structures, as long as the light passing through the light-transmitting microlens 121 can be focused on one of the pixels 112 covered by it, and there is no limitation here.
请结合图5(右侧的光路图示意图),在本申请实施例中,平行的光线首先进入微透镜121,微透镜121能够将进入的光线全部汇聚至第一像素112a。第一像素112a中的偏振元件1122对接收到的光线进行偏振,即仅允许第一偏振角度的光线通过并到达至第一像素112a的光电转换元件1121内进行转换;同时将第二偏振角度(即与第一偏振角度正交的)光线反射至第二像素112b。第二像素112b上的偏振元件1122能够允许由第一像素112a反射的光线(第二偏振角度的光线)通过并到达至第二像素112b的光电转换元件1121内进行转换。如此能提高像素的受光面积,增加进光量,提高光线的利用率,从而提高图像传感器的量子效率。Please refer to FIG. 5 (the schematic diagram of the light path diagram on the right), in the embodiment of the present application, the parallel light first enters the microlens 121, and the microlens 121 can converge all the incoming light to the first pixel 112a. The polarizing element 1122 in the first pixel 112a polarizes the received light, that is, only light of the first polarization angle is allowed to pass through and reach the photoelectric conversion element 1121 of the first pixel 112a for conversion; at the same time, the second polarization angle ( That is, the light rays perpendicular to the first polarization angle are reflected to the second pixel 112b. The polarizing element 1122 on the second pixel 112b can allow the light reflected by the first pixel 112a (light with the second polarization angle) to pass through and reach the photoelectric conversion element 1121 of the second pixel 112b for conversion. In this way, the light-receiving area of the pixel can be increased, the amount of incoming light can be increased, and the utilization rate of light can be improved, thereby improving the quantum efficiency of the image sensor.
请参阅图3,在一些实施例中,图像传感器10还包括滤光片阵列13。滤光片阵列13设置在像素阵列11及微透镜阵列12之间。也即是说,沿图像传感器10的入光方向,图像传感器10依次包括微透镜阵列12、滤光片阵列13及像素阵列11。Referring to FIG. 3 , in some embodiments, the image sensor 10 further includes a filter array 13 . The filter array 13 is disposed between the pixel array 11 and the microlens array 12 . That is to say, along the light incident direction of the image sensor 10 , the image sensor 10 sequentially includes a microlens array 12 , a filter array 13 and a pixel array 11 .
滤光片阵列13包括至少两个滤光子单元131,每个滤光子单元131包括两个滤光区1311,同一个所述滤光单元的两个滤光区允许透光的光线颜色相同,并且每个滤光区1311对应一个像素112。也即是说,像素子单元111用于接收经过对应的滤光子单元131过滤的光线。请结合图8及图9,每个滤光子单元131包括两个滤光区1311。每个滤光区1311分别对应一个像素112对应,每个像素112用于接收经过对应的滤光区1311过滤的光线。也即,一个第一像素112a与一个滤光区1311对应,一个第二像素112b与一个滤光区对应,第一像素112a用于接收经过对应的滤光区1311过滤的光线,第二像素112b用于接收经过对应的滤光区1311过滤的光线。每个滤光子单元131的两个滤光区1311允许透过的光线颜色相同(图中标有相同字母的滤光区允许透光的光线颜色相同)。例如,两个滤光区1311均透过红光;或者,两个滤光区1311均透过绿光;或者,两个滤光区1311均透过蓝光;或者,两个滤光区1311均透过白光。两个滤光区1311可一体成型以形成一个滤光子单元131。两个滤光区1311还可分体成型并通过胶合等连接方式组合在一起,以形成一个滤光子单元131。本申请实施方式的两个滤光区1311可一体成型以形成一个滤光子单元131,两个滤光区1311的结合较为紧密。The filter array 13 includes at least two filter subunits 131, and each filter subunit 131 includes two filter regions 1311, and the two filter regions of the same filter unit allow the transmitted light to have the same color, and Each filter area 1311 corresponds to one pixel 112 . That is to say, the pixel sub-unit 111 is used to receive the light filtered by the corresponding filter sub-unit 131 . Please refer to FIG. 8 and FIG. 9 , each filter subunit 131 includes two filter regions 1311 . Each filter area 1311 corresponds to a pixel 112 , and each pixel 112 is used to receive the light filtered by the corresponding filter area 1311 . That is, one first pixel 112a corresponds to one filter area 1311, one second pixel 112b corresponds to one filter area, the first pixel 112a is used to receive the light filtered by the corresponding filter area 1311, and the second pixel 112b It is used to receive the light filtered by the corresponding filter area 1311 . The two filter regions 1311 of each filter subunit 131 allow the same color of light to pass through (the filter regions marked with the same letter in the figure allow the same color of light to pass through). For example, both filter areas 1311 pass through red light; or, both filter areas 1311 pass through green light; or, both filter areas 1311 pass through blue light; or, both filter areas 1311 Through white light. The two filter regions 1311 can be integrally formed to form a filter sub-unit 131 . The two filter areas 1311 can also be molded separately and combined by gluing or other connection methods to form a filter sub-unit 131 . The two filter regions 1311 in the embodiment of the present application can be integrally formed to form a filter sub-unit 131 , and the two filter regions 1311 are closely combined.
请参阅图5及图10,在一些实施例中,图像传感器10还包括平坦层15,平坦层15设置在滤光片阵列13及像素阵列11的偏振元件1122之间。由于像素阵列11中的多个像素111的收光面11211是倾斜的,在滤光片阵列13及像素阵列11中设置用于将像素112平坦化的平坦呈15,有利于在像素阵列11上覆盖滤色片阵列13。Referring to FIG. 5 and FIG. 10 , in some embodiments, the image sensor 10 further includes a flat layer 15 disposed between the filter array 13 and the polarizing element 1122 of the pixel array 11 . Since the light-receiving surfaces 11211 of a plurality of pixels 111 in the pixel array 11 are inclined, a flat surface 15 for flattening the pixels 112 is provided in the filter array 13 and the pixel array 11, which is beneficial to the pixel array 11. The color filter array 13 is covered.
请参阅图3及图4,在一些实施例中,像素阵列11包括多个像素单元113,像素单元113包括至少两个像素子单元111。在同一个像素单元113中,每个像素112具有的偏振角度均不相同。也即,在同一个像素单元113中,每个像素112能够将不同偏振角度的光线转换成电信号。如此在该像素单元113曝光后能够获得至少四个偏振角度的偏振光信息,有利于增加图像传感器10的使用场景。Referring to FIG. 3 and FIG. 4 , in some embodiments, the pixel array 11 includes a plurality of pixel units 113 , and the pixel unit 113 includes at least two pixel sub-units 111 . In the same pixel unit 113 , each pixel 112 has different polarization angles. That is, in the same pixel unit 113 , each pixel 112 can convert light with different polarization angles into electrical signals. In this way, polarized light information of at least four polarization angles can be obtained after the pixel unit 113 is exposed, which is beneficial to increase the application scenarios of the image sensor 10 .
需要说明的是,像素112具有的偏振角度表征像素112能够转换成电信号的光线的偏振角度。对于第一像素112a而言,由于第一像素112a能够将第一偏振角度的光线转换成电信号,因此第一像素112a具有的偏振角度即为第一偏振角度;同样地,对于第二像素112b而言,由于第二像 素112b能够将第二偏振角度的光线转换成电信号,因此第二像素112b具有的偏振角度即为第二偏振角度。下文中所提及的像素112具有的偏振角度也是如此,不再赘述。It should be noted that the polarization angle of the pixel 112 represents the polarization angle of light that the pixel 112 can convert into an electrical signal. For the first pixel 112a, since the first pixel 112a can convert the light of the first polarization angle into an electrical signal, the polarization angle of the first pixel 112a is the first polarization angle; similarly, for the second pixel 112b In other words, since the second pixel 112b can convert the light of the second polarization angle into an electrical signal, the polarization angle of the second pixel 112b is the second polarization angle. The same is true for the polarization angle of the pixel 112 mentioned below, which will not be repeated here.
例如,如图4所示,像素单元113包括第一像素子单元111a及第二像素子单元111b。第一像素子单元111a包括第一像素112a及第二像素112b,第二像素子单元111b包括第一像素112c及第二像素112d。其中,第一像素子单元111a中的第一像素112a的第一偏振角度为90°,第一像素子单元111a中的第二像素112b的第二偏振角度为90°,第二像素子单元111b中的第一像素112c的第一偏振角度为135°,第二像素子单元111b中的第二像素112d的第二偏振角度为45°。如此,在像素单元113中,每个像素112具有的偏振角均不相同,并且在同一个像素子单元111中的两个像素112具有的偏振角相互正交。当然,在一些实施例中,同一个像素单元113中像素子单元113的数量还可以是三个、四个、五个甚至更多,在此不作限制。同样地,在一些实施例中,如图3及图8所示,滤光片阵列13也包括多个滤光片单元132,并且滤光片单元132与像素单元113一一对应(如图11),并且同一个滤光片单元132中所有滤光区1311允许透光的光线颜色相同。滤光片单元132中包括与其对应的像素单元113中的像素子单元数量相同的滤光片子单元131,并且滤光片子单元131与像素单元113一一对应(如图11)。例如,像素单元113中像素子单元111的数量为两个,则滤光片单元132中的滤光片子单元131的数量也为两个。由于与像素单元113对应的滤光片单元132中所有滤光区1311允许透光的光线颜色相同,且在同一个像素单元113中个像素112具有的偏振角度均不相同,如此在像素单元113曝光后,同一个像素单元111中的多个像素112的获得的电信号关联互不相同的偏振角度信息,且多个像素112的获得电信号关联有相同的颜色信息。For example, as shown in FIG. 4 , the pixel unit 113 includes a first pixel sub-unit 111 a and a second pixel sub-unit 111 b. The first pixel subunit 111a includes a first pixel 112a and a second pixel 112b, and the second pixel subunit 111b includes a first pixel 112c and a second pixel 112d. Wherein, the first polarization angle of the first pixel 112a in the first pixel subunit 111a is 90°, the second polarization angle of the second pixel 112b in the first pixel subunit 111a is 90°, and the second pixel subunit 111b The first polarization angle of the first pixel 112c in the sub-unit 111b is 135°, and the second polarization angle of the second pixel 112d in the second pixel sub-unit 111b is 45°. In this way, in the pixel unit 113 , each pixel 112 has a different polarization angle, and the polarization angles of two pixels 112 in the same pixel sub-unit 111 are orthogonal to each other. Of course, in some embodiments, the number of pixel sub-units 113 in the same pixel unit 113 may also be three, four, five or even more, which is not limited here. Similarly, in some embodiments, as shown in FIG. 3 and FIG. 8 , the filter array 13 also includes a plurality of filter units 132, and the filter units 132 correspond to the pixel units 113 one-to-one (as shown in FIG. 11 ), and the color of light that is allowed to pass through all the filter areas 1311 in the same filter unit 132 is the same. The filter unit 132 includes the same number of filter subunits 131 as the number of pixel subunits in the corresponding pixel unit 113 , and the filter subunits 131 correspond to the pixel units 113 one by one (as shown in FIG. 11 ). For example, if the number of pixel sub-units 111 in the pixel unit 113 is two, then the number of filter sub-units 131 in the filter unit 132 is also two. Since all the filter areas 1311 in the filter unit 132 corresponding to the pixel unit 113 allow the light to pass through the same color, and the polarization angles of the pixels 112 in the same pixel unit 113 are different, so in the pixel unit 113 After exposure, the obtained electrical signals of multiple pixels 112 in the same pixel unit 111 are associated with different polarization angle information, and the obtained electrical signals of multiple pixels 112 are associated with the same color information.
需要说明的是,在一个例子中,在同一个像素单元113内,每个像素子单元112中两个像素112均沿行的方向(X轴方向)的排列。例如,如图4所示,像素单元113包括第一像素子单元111a及第二像素子单元111b,第一像素子单元111a中的第一像素112a及第二像素112b沿行方向(X轴方向)排列,第二像素子单元111b中的第一像素112c及第二像素112d也沿行方向(X轴方向)排列。在另一个例子中,在同一个像素单元113内,每个像素子单元112中两个像素112均沿列的方向(Y轴方向)的排列。例如,如图12所示,像素单元113包括第一像素子单元111a及第二像素子单元111b,第一像素子单元111a中的第一像素112a及第二像素112b沿列方向(Y轴方向)排列,第二像素子单元111b中的第一像素112c及第二像素112d也沿列方向(Y轴方向)排列。当然,在一些例子中,在同一个像素单元113内,还可以部分像素子单元112中两个像素112沿行的方向(X轴方向)的排列,部分像素子单元112中两个像素112(沿列的方向(Y轴方向)的排列,在此不做限制。It should be noted that, in an example, in the same pixel unit 113 , two pixels 112 in each pixel sub-unit 112 are arranged along the row direction (X-axis direction). For example, as shown in FIG. 4, the pixel unit 113 includes a first pixel subunit 111a and a second pixel subunit 111b, and the first pixel 112a and the second pixel 112b in the first pixel subunit 111a are arranged along the row direction (X-axis direction). ), the first pixel 112c and the second pixel 112d in the second pixel sub-unit 111b are also arranged along the row direction (X-axis direction). In another example, in the same pixel unit 113 , two pixels 112 in each pixel sub-unit 112 are arranged along the column direction (Y-axis direction). For example, as shown in FIG. 12, the pixel unit 113 includes a first pixel subunit 111a and a second pixel subunit 111b, and the first pixel 112a and the second pixel 112b in the first pixel subunit 111a are aligned along the column direction (Y-axis direction). ), the first pixel 112c and the second pixel 112d in the second pixel sub-unit 111b are also arranged along the column direction (Y-axis direction). Of course, in some examples, in the same pixel unit 113, the two pixels 112 in some pixel subunits 112 can also be arranged along the row direction (X-axis direction), and the two pixels 112 in some pixel subunits 112 ( The arrangement along the column direction (Y-axis direction) is not limited here.
请参阅图3、图4及图8,在一个实施例中,像素阵列11包括最小重复单元。像素阵列11由多个最小重复单元114组成,最小重复单元114在行和列上复制并排列。每个最小重复单元114包括四个像素单元113。滤光片阵列13包括多个滤光单元组133,每个滤光单元组133由四个滤光单元132排列成二行二列的矩阵,滤光单元132与像素单元113一一对应。Referring to FIG. 3 , FIG. 4 and FIG. 8 , in one embodiment, the pixel array 11 includes a minimum repeating unit. The pixel array 11 is composed of a plurality of minimal repeating units 114 which are replicated and arranged in rows and columns. Each minimum repeating unit 114 includes four pixel units 113 . The filter array 13 includes a plurality of filter unit groups 133 , and each filter unit group 133 consists of four filter units 132 arranged in a matrix of two rows and two columns, and the filter units 132 correspond to the pixel units 113 one by one.
示例地,请参阅图8、图9及图11,每个滤光单元组133内的四个滤光单元132分别用于第一颜色光A、第二颜色光B及第三颜色光C。每个像素单元111接收经过对应的滤光单元132过滤的光线,透过第一颜色光A、第二颜色光B及第三颜色光C。例如,与透过第一颜色光A的滤光单元132对应的像素单元111接收的光线为第一颜色光A,与第二颜色光B的滤光单元132对应的像素单元111接收的光线为第二颜色光B,与第三颜色光C的滤光单元132对应的像素单元 111接收的光线为第三颜色光C。如此,像素单元111内的像素112接收的光线关联有色彩信息,可用于生成彩色图像。在一个实施例中,第一颜色光A可以为绿光、第二颜色光B可以为红光、第三颜色光C可以为蓝光;在另一个实施例中,第一颜色光A可以为黄光、第二颜色光B可以为红光、第三颜色光C可以为蓝光。当然,在其他一些实施方式中,每个滤光单元组133内的四个滤光单元132还可分别用于透过红光R、绿光G、蓝光B和白光W,从而提高暗光环境下的拍摄效果。For example, referring to FIG. 8 , FIG. 9 and FIG. 11 , the four filter units 132 in each filter unit group 133 are used for the first color light A, the second color light B and the third color light C respectively. Each pixel unit 111 receives the light filtered by the corresponding filter unit 132 and transmits the first color light A, the second color light B and the third color light C. For example, the light received by the pixel unit 111 corresponding to the filter unit 132 passing through the first color light A is the first color light A, and the light received by the pixel unit 111 corresponding to the filter unit 132 of the second color light B is For the second color light B, the light received by the pixel unit 111 corresponding to the filter unit 132 of the third color light C is the third color light C. In this way, the light received by the pixels 112 in the pixel unit 111 is associated with color information, which can be used to generate a color image. In one embodiment, the first color light A can be green light, the second color light B can be red light, and the third color light C can be blue light; in another embodiment, the first color light A can be yellow light. The light, the second color light B may be red light, and the third color light C may be blue light. Certainly, in some other implementation manners, the four filter units 132 in each filter unit group 133 can also be used to transmit red light R, green light G, blue light B and white light W respectively, thereby improving the efficiency of dark light environment. The shooting effect below.
上述由四个滤光单元132排列成的二行二列的矩阵可具有第一对角线方向D1和第二对角线方向D2,第一对角线方向D1与第二对角线方向D2不同。例如,第一对角线方向D1与第二对角线方向D2可以是相互垂直的。The aforementioned matrix of two rows and two columns formed by four filter units 132 may have a first diagonal direction D1 and a second diagonal direction D2, and the first diagonal direction D1 and the second diagonal direction D2 different. For example, the first diagonal direction D1 and the second diagonal direction D2 may be perpendicular to each other.
请参阅图8,在一个实施例中,沿矩阵的第一对角线方向D1分布的两个滤光单元132均用于透过第一颜色光A,沿矩阵的第二对角线方向D2分布的两个滤光单元132分别用于透过第二颜色光B和第三颜色光C。请参阅图9,在另一个实施例中,沿矩阵的第一对角线方向D1分布的两个滤光单元132分别用于透过过第二颜色光B和第三颜色光C,沿矩阵的第二对角线方向D2分布的两个滤光单元132均用于透过第一颜色光A。同样地,第一颜色光A可以为绿光、第二颜色光B可以为红光、第三颜色光C可以为蓝光;或者,第一颜色光A可以为黄光、第二颜色光B可以为红光、第三颜色光C可以为蓝光。Please refer to FIG. 8 , in one embodiment, the two filter units 132 distributed along the first diagonal direction D1 of the matrix are both used to transmit the first color light A, along the second diagonal direction D2 of the matrix The distributed two filter units 132 are used to transmit the second color light B and the third color light C respectively. Please refer to FIG. 9 , in another embodiment, two filter units 132 distributed along the first diagonal direction D1 of the matrix are respectively used to transmit the second color light B and the third color light C, along the matrix The two filter units 132 distributed in the second diagonal direction D2 are both used to transmit the light A of the first color. Similarly, the first color light A can be green light, the second color light B can be red light, and the third color light C can be blue light; or, the first color light A can be yellow light, and the second color light B can be is red light, and the third color light C may be blue light.
需要说明的是,在最小重复单元113内,所有像素子单元112中两个像素112可以均沿行的方向(X轴方向)的排列(如图4所示);或者,所有像素子单元112中两个像素112可以均沿列的方向(Y轴方向)的排列;或者,部分像素子单元112中两个像素112均沿行的方向(X轴方向)的排列(如图13左侧四个像素子单元112所示),部分像素子单元112中两个像素112均沿列的方向(Y轴方向)的排列(如图13右侧四个像素子单元112所示),在此不作限制。It should be noted that, in the smallest repeating unit 113, two pixels 112 in all pixel subunits 112 can be arranged along the row direction (X-axis direction) (as shown in FIG. 4 ); or, all pixel subunits 112 The two pixels 112 in the center can be arranged along the column direction (Y-axis direction); or, the two pixels 112 in some pixel subunits 112 are arranged along the row direction (X-axis direction) (as shown in Figure 13 left four pixel sub-units 112), some of the two pixels 112 in the pixel sub-units 112 are arranged along the direction of the column (Y-axis direction) (as shown in the four pixel sub-units 112 on the right side of Figure 13), which will not be described here. limit.
此外,在一些实施例中,在最小重复单元113内,排列在四个像素单元113对应位置的像素112具有的偏振角度相同。也即,在最小重复单元113内,排列在四个像素单元113对应位置的像素112能够将相同偏振角度的光线转换成电信号。例如,如图4所示(图中具有相同纹理的像素,表示其具有的偏振角度相同),最小重复单元114包括第一像素单元113a、第二像素单元113b、第三像素单元113c及第四像素单元113d。第一像素单元113a、第二像素单元113b、第三像素单元113c及第四像素单元113d均包括四个呈二行二列排列的像素112。其中,排列在第一像素单元113a左上角的像素112、排列在第二像素单元113a左上角的像素112、排列在第三像素单元113a左上角的像素112、及排列在第四像素单元113a左上角的像素112具有的偏振角度为90°;排列在第一像素单元113a右上角的像素112、排列在第二像素单元113a右上角的像素112、排列在第三像素单元113a右上角的像素112、及排列在第四像素单元113a右上角的像素112对应的具有的偏振角度为0°;排列在第一像素单元113a左下角的像素112、排列在第二像素单元113a左下角的像素112、排列在第三像素单元113a左下角的像素112、及排列在第四像素单元113a左下角的像素112具有的偏振角度为135°;排列在第一像素单元113a右下角的像素112、排列在第二像素单元113a右下角的像素112、排列在第三像素单元113a右下角的像素112、及排列在第四像素单元113a右下角的像素112具有的偏振角度为45°。由于排列在四个像素单元113对应位置的像素112具有的偏振角度相同,也即,在最小重复单元113内,排列在四个像素单元113对应位置的像素112能够将相同偏振角度的光线转换成电信号。如此有利于对像素阵列11曝光后的获取图像进行后续处理。当然,在最小重复单元113内,排列在四个像素单元113对应位置的像素112具有的偏振 角度也可以不相同,即在最小重复单元113内,排列在四个像素单元113对应位置的像素112也能够将不同偏振角度的光线转换成电信号,在此不作限制。In addition, in some embodiments, within the minimum repeating unit 113 , the pixels 112 arranged at corresponding positions of the four pixel units 113 have the same polarization angle. That is, in the smallest repeating unit 113 , the pixels 112 arranged at the corresponding positions of the four pixel units 113 can convert the light with the same polarization angle into electrical signals. For example, as shown in FIG. 4 (the pixels with the same texture in the figure indicate that they have the same polarization angle), the minimum repeating unit 114 includes a first pixel unit 113a, a second pixel unit 113b, a third pixel unit 113c and a fourth pixel unit 113c. Pixel unit 113d. The first pixel unit 113 a , the second pixel unit 113 b , the third pixel unit 113 c and the fourth pixel unit 113 d each include four pixels 112 arranged in two rows and two columns. Among them, the pixel 112 arranged in the upper left corner of the first pixel unit 113a, the pixel 112 arranged in the upper left corner of the second pixel unit 113a, the pixel 112 arranged in the upper left corner of the third pixel unit 113a, and the pixel 112 arranged in the upper left corner of the fourth pixel unit 113a The pixel 112 at the corner has a polarization angle of 90°; the pixel 112 arranged at the upper right corner of the first pixel unit 113a, the pixel 112 arranged at the upper right corner of the second pixel unit 113a, the pixel 112 arranged at the upper right corner of the third pixel unit 113a , and the pixel 112 arranged in the upper right corner of the fourth pixel unit 113a has a corresponding polarization angle of 0°; the pixel 112 arranged in the lower left corner of the first pixel unit 113a, the pixel 112 arranged in the lower left corner of the second pixel unit 113a, The pixels 112 arranged in the lower left corner of the third pixel unit 113a and the pixels 112 arranged in the lower left corner of the fourth pixel unit 113a have a polarization angle of 135°; the pixels 112 arranged in the lower right corner of the first pixel unit 113a are arranged in the second The pixel 112 at the lower right corner of the second pixel unit 113a, the pixel 112 arranged at the lower right corner of the third pixel unit 113a, and the pixel 112 arranged at the lower right corner of the fourth pixel unit 113a have a polarization angle of 45°. Since the pixels 112 arranged at the corresponding positions of the four pixel units 113 have the same polarization angle, that is, in the minimum repeating unit 113, the pixels 112 arranged at the corresponding positions of the four pixel units 113 can convert light rays with the same polarization angle into electric signal. This facilitates subsequent processing of the acquired image after the pixel array 11 is exposed. Certainly, in the smallest repeating unit 113, the polarization angles of the pixels 112 arranged at the corresponding positions of the four pixel units 113 may also be different, that is, in the smallest repeating unit 113, the pixels 112 arranged at the corresponding positions of the four pixel units 113 Light rays with different polarization angles can also be converted into electrical signals, which is not limited here.
请参阅图5和图14,图像传感器10还包括金属连线层14。金属连线层14和像素阵列11连接并位于远离收光面11211的一侧。金属连线层14用于根据每个像素112曝光时转换的电信号获取每个像素112的像素值。Please refer to FIG. 5 and FIG. 14 , the image sensor 10 further includes a metal wiring layer 14 . The metal wiring layer 14 is connected to the pixel array 11 and located on a side away from the light receiving surface 11211 . The metal wiring layer 14 is used to obtain the pixel value of each pixel 112 according to the electrical signal converted when each pixel 112 is exposed.
金属连线层14包括多个像素读取电路141,每个像素读取电路141与一个像素112连接,以用于读取该像素112的像素值。The metal wiring layer 14 includes a plurality of pixel reading circuits 141 , and each pixel reading circuit 141 is connected to a pixel 112 for reading the pixel value of the pixel 112 .
请参阅图14,像素读取电路141包括浮动扩散区1411和传递晶体管1412。浮动扩散区1411用于存储电荷,传递晶体管1412用于连接像素112的光电二极管和浮动扩散区1411,以将光电转换元件1121产生的电荷(即像素112将光线转换成的电信号)传递到浮动扩散区1411。像素读取电路141用于根据浮动扩散区1411的电荷确定对应的像素112的像素值。Referring to FIG. 14 , the pixel reading circuit 141 includes a floating diffusion region 1411 and a transfer transistor 1412 . The floating diffusion region 1411 is used to store charges, and the transfer transistor 1412 is used to connect the photodiode of the pixel 112 and the floating diffusion region 1411 to transfer the charge generated by the photoelectric conversion element 1121 (that is, the electrical signal converted by the pixel 112 into light) to the floating Diffusion zone 1411 . The pixel reading circuit 141 is used for determining the pixel value of the corresponding pixel 112 according to the charge of the floating diffusion region 1411 .
具体地,像素112的收光面11211在接收到对应的滤光区1311及与其对应的第一偏振角度的光线后,光电转换元件1121发生光电效应,光照射产生的电子-空穴对会因光电转换元件1121的电场的存在而分开,电子移向n区,空穴移向p区,在曝光结束时,激活RST,然后像素读取电路141进行复位以使得读出区复位到高电平,复位完成后,读取复位电平,然后传递晶体管1412将n区的电荷转移到浮动扩散区1411,然后读出浮动扩散区1411的电平以作为信号电平,最后根据信号电平以及复位电平计算出像素112的像素值(如将信号电平和复位电平的差值作为像素112的像素值对应的电平,然后根据该电平即可计算得到像素112的像素值),每个像素112的像素值均关联有对应的偏振元件1122的偏振角度信息及滤光区1311的颜色信息。Specifically, after the light-receiving surface 11211 of the pixel 112 receives the corresponding filter area 1311 and the corresponding light of the first polarization angle, the photoelectric conversion element 1121 undergoes a photoelectric effect, and the electron-hole pairs generated by light irradiation will be caused by The existence of the electric field of the photoelectric conversion element 1121 is separated, the electrons move to the n region, and the holes move to the p region. At the end of the exposure, the RST is activated, and then the pixel reading circuit 141 is reset so that the readout region is reset to a high level , after the reset is completed, read the reset level, then the transfer transistor 1412 transfers the charge in the n region to the floating diffusion region 1411, then reads the level of the floating diffusion region 1411 as the signal level, and finally according to the signal level and reset level to calculate the pixel value of the pixel 112 (such as the difference between the signal level and the reset level as the level corresponding to the pixel value of the pixel 112, and then the pixel value of the pixel 112 can be calculated according to the level), each The pixel values of the pixels 112 are associated with the corresponding polarization angle information of the polarizing element 1122 and the color information of the filter area 1311 .
请参阅图3、图4及图15,本申请实施方式的成像方法可用于图像传感器10。多个像素子单元111,每个像素子单元111包括第一像素112a及第二像素112b,在同一个像素子单元中,第一像素112a具有第一偏振角度,第二像素112b具有与第一偏振角度不同的第二偏振角度,第一像素112a能够将具有第一偏振角度的光线转换成电信号,并将具有与第一偏振角度不同偏振角度的光线反射至第二像素112b。第二像素112b能够将具有第二偏振角度的光线转换成电信号。微透镜阵列12包括多个微透镜121,同一个像素子单元111中的第一像素112a及第二像素112b被同一个微透镜121覆盖。每个微透镜121用于将光线聚焦至被微透镜121覆盖的其中一个第一像素112a。微透镜阵列12包括多个微透镜121,同一个像素子单元111中的第一像素112a和第二像素112b被同一个微透镜121覆盖。微透镜121用于将光线聚焦至被微透镜121覆盖的第一像素112a或第二像素112b。成像方法包括:Referring to FIG. 3 , FIG. 4 and FIG. 15 , the imaging method according to the embodiment of the present application can be used in the image sensor 10 . A plurality of pixel subunits 111, each pixel subunit 111 includes a first pixel 112a and a second pixel 112b, in the same pixel subunit, the first pixel 112a has a first polarization angle, and the second pixel 112b has a For the second polarization angle different from the polarization angle, the first pixel 112a can convert the light with the first polarization angle into an electrical signal, and reflect the light with a polarization angle different from the first polarization angle to the second pixel 112b. The second pixel 112b is capable of converting the light with the second polarization angle into an electrical signal. The microlens array 12 includes a plurality of microlenses 121 , and the first pixel 112 a and the second pixel 112 b in the same pixel subunit 111 are covered by the same microlens 121 . Each microlens 121 is used to focus light to one of the first pixels 112 a covered by the microlens 121 . The microlens array 12 includes a plurality of microlenses 121 , and the first pixel 112 a and the second pixel 112 b in the same pixel subunit 111 are covered by the same microlens 121 . The microlens 121 is used to focus light to the first pixel 112 a or the second pixel 112 b covered by the microlens 121 . Imaging methods include:
01:根据每个像素转换的电信号获取像素的像素值;01: Obtain the pixel value of the pixel according to the electrical signal converted by each pixel;
02:选取像素阵列中的至少一个像素具有的偏振角度为目标偏振角度;及02: selecting the polarization angle of at least one pixel in the pixel array as the target polarization angle; and
03:根据与目标偏振角度对应的像素的像素值生成偏振图像。03: Generate a polarization image based on the pixel value of the pixel corresponding to the target polarization angle.
具体地,在曝光完成后,金属连线层14中的多个像素读取电路141能够根据像素112转换的电信号获取该像素112的像素值,每个像素112的像素值均关联有对应的偏振元件1122的偏振角度信息。根据像素转换的电信号获取像素的像素值的具体实施方式与上述实施例中相同,在此不再赘述。Specifically, after the exposure is completed, multiple pixel reading circuits 141 in the metal wiring layer 14 can obtain the pixel value of the pixel 112 according to the electrical signal converted by the pixel 112, and the pixel value of each pixel 112 is associated with a corresponding Polarization angle information of the polarizing element 1122 . The specific implementation manner of obtaining the pixel value of the pixel according to the electrical signal converted by the pixel is the same as that in the above-mentioned embodiment, and will not be repeated here.
请结合图1,电子设备1000可包括处理器300,处理器300选取像素阵列11中的至少一个像素112具有的偏振角度为目标偏振角度。例如,如图11所示,像素阵列11包括第一类像素112(图11中纹理均为与y轴平行的像素112)、第二类像素112(图11中纹理均为与x轴平行的像素112)、 第三类像素112(图11中纹理均为从左上至右下的像素112)及第四类像素112(图11中纹理均为从右上至左下的像素112)。假设第一类像素112具有的偏振角度为90°,第二类像素112具有的偏振角度为0°,第三类像素112具有的偏振角度为135°,第四类像素112具有的偏振角度为45°。则处理器300能够在90°、0°、135°或45°中选择至少一个偏振角度作为目标偏振角度。例如,目标偏振角度可以为0°;或者,目标偏振角度还可以为90°、0°;或者,目标偏振角度还可以为90°、0°、135°,在此不作限制。在一些实施例中,处理器300能够根据用户偏好选择目标偏振角度,在此不作限制。Referring to FIG. 1 , the electronic device 1000 may include a processor 300 , and the processor 300 selects the polarization angle of at least one pixel 112 in the pixel array 11 as the target polarization angle. For example, as shown in Figure 11, the pixel array 11 includes the first type of pixels 112 (the textures in Figure 11 are all pixels 112 parallel to the y-axis), the second type of pixels 112 (the textures in Figure 11 are all parallel to the x-axis pixel 112), the third type of pixel 112 (the textures are all pixels 112 from top left to bottom right in FIG. 11 ), and the fourth type of pixels 112 (the textures are all pixels 112 from top right to bottom left in FIG. 11). Assume that the first type of pixel 112 has a polarization angle of 90°, the second type of pixel 112 has a polarization angle of 0°, the third type of pixel 112 has a polarization angle of 135°, and the fourth type of pixel 112 has a polarization angle of 45°. Then the processor 300 can select at least one polarization angle among 90°, 0°, 135° or 45° as the target polarization angle. For example, the target polarization angle can be 0°; or, the target polarization angle can also be 90°, 0°; or, the target polarization angle can also be 90°, 0°, 135°, which is not limited here. In some embodiments, the processor 300 can select the target polarization angle according to user preference, which is not limited here.
在获取目标偏振角度后,处理器300可根据与目标角度对应的像素的像素值生成偏振图像。例如,如图11所示的实施例中,假设目标偏振角为0°,则处理器300根据所有第二类像素112(图11中纹理均为与x轴平行的像素112)的像素值生成偏振图像。After acquiring the target polarization angle, the processor 300 may generate a polarization image according to pixel values of pixels corresponding to the target angle. For example, in the embodiment shown in FIG. 11, assuming that the target polarization angle is 0°, the processor 300 generates polarized image.
在本说明书的描述中,参考术语“某些实施方式”、“一个实施方式”、“一些实施方式”、“示意性实施方式”、“示例”、“具体示例”、或“一些示例”的描述意指结合所述实施方式或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施方式或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施方式或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施方式或示例中以合适的方式结合。In the description of this specification, references to the terms "certain embodiments," "one embodiment," "some embodiments," "exemplary embodiments," "examples," "specific examples," or "some examples" To describe means that a specific feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples.
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个所述特征。在本申请的描述中,“多个”的含义是至少两个,例如两个,三个,除非另有明确具体的限定。In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of said features. In the description of the present application, "plurality" means at least two, such as two, three, unless otherwise specifically defined.
尽管上面已经示出和描述了本申请的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本申请的限制,本领域的普通技术人员在本申请的范围内可以对上述实施例进行变化、修改、替换和变型,本申请的范围由权利要求及其等同物限定。Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present application, and those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations, the scope of the present application is defined by the claims and their equivalents.

Claims (24)

  1. 一种图像传感器,其特征在于,包括像素阵列及微透镜阵列,An image sensor, characterized in that it includes a pixel array and a microlens array,
    所述像素阵列包括多个像素子单元,每个所述像素子单元包括第一像素和第二像素,在同一个所述像素子单元中,所述第一像素具有第一偏振角度,所述第二像素具有与第一偏振角度不同的第二偏振角度,所述第一像素能够将具有第一偏振角度的光线转换成电信号,并将具有与所述第一偏振角度不同偏振角度的光线反射至所述第二像素,所述第二像素能够将具有第二偏振角度的光线转换成电信号;The pixel array includes a plurality of pixel subunits, each of the pixel subunits includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization angle, the The second pixel has a second polarization angle different from the first polarization angle, the first pixel is capable of converting light having the first polarization angle into an electrical signal, and converting light having a polarization angle different from the first polarization angle reflected to the second pixel, the second pixel is capable of converting light having a second polarization angle into an electrical signal;
    所述微透镜阵列包括多个微透镜,同一个所述像素子单元中的所述第一像素和所述第二像素被同一个所述微透镜覆盖,每个所述微透镜用于将光线聚焦至被所述微透镜覆盖的所述第一像素。The microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to transmit light focusing to the first pixel covered by the microlens.
  2. 根据权利要求1所述的图像传感器,其特征在于,所述第一偏振角度与所述第二偏振角度正交。The image sensor according to claim 1, wherein the first polarization angle is orthogonal to the second polarization angle.
  3. 根据权利要求1所述的图像传感器,其特征在于,所述第一像素或所述第二像素包括:The image sensor according to claim 1, wherein the first pixel or the second pixel comprises:
    光电转换元件,所述光电转换元件包括收光面;及a photoelectric conversion element including a light-receiving surface; and
    设置于所述收光面上的倾斜的偏振元件,所述偏振元件用于允许与所述偏振元件的偏振轴的角度平行的光线通过,并用于反射与所述偏振轴的角度不平行的光线,所述第一像素中的偏振元件的偏振轴的角度为第一偏振角度,所述第二像素中的偏振元件的偏振轴的角度为第二偏振角度。an inclined polarizing element arranged on the light-receiving surface, the polarizing element is used to allow light rays parallel to the angle of the polarization axis of the polarizing element to pass through, and is used to reflect light rays not parallel to the angle of the polarization axis , the angle of the polarization axis of the polarization element in the first pixel is the first polarization angle, and the angle of the polarization axis of the polarization element in the second pixel is the second polarization angle.
  4. 根据权利要求3所述的图像传感器,其特征在于,所述光电转换元件包括倾斜的所述收光面。The image sensor according to claim 3, wherein the photoelectric conversion element includes the inclined light receiving surface.
  5. 根据权利要求4所述的图像传感器,其特征在于,所述第一像素和所述第二像素均包括相背的第一侧及第二侧,在同一个所述像素子单元中,所述第一像素的第一侧与所述第二像素的第一侧相接;The image sensor according to claim 4, wherein the first pixel and the second pixel both include opposite first sides and second sides, and in the same pixel subunit, the the first side of the first pixel adjoins the first side of the second pixel;
    在所述图像传感器的光轴方向,所述第一像素的第一侧的高度低于所述第一像素的第二侧的高度,所述第二像素的第一侧的高度低于所述第二像素的第二侧的高度;并且在同一所述像素子单元中的两个所述第一像素的收光面与所述第二像素的收光面之间的夹角在预设范围内。In the optical axis direction of the image sensor, the height of the first side of the first pixel is lower than the height of the second side of the first pixel, and the height of the first side of the second pixel is lower than that of the The height of the second side of the second pixel; and the included angle between the light-receiving surfaces of two first pixels and the light-receiving surface of the second pixel in the same pixel subunit is within a preset range Inside.
  6. 根据权利要求1所述的图像传感器,其特征在于,在所述图像传感器的光轴方向,所述微透镜覆盖所述第一像素的区域的最大厚度大于覆盖所述第二像素的区域的最大厚度;或The image sensor according to claim 1, characterized in that, in the direction of the optical axis of the image sensor, the maximum thickness of the area where the microlens covers the first pixel is greater than the maximum thickness of the area where the microlens covers the second pixel. thickness; or
    所述微透镜覆盖所述第二像素的区域的最大厚度大于覆盖所述第一像素的区域的最大厚度。The maximum thickness of the area where the microlens covers the second pixel is greater than the maximum thickness of the area where the microlens covers the first pixel.
  7. 根据权利要求1所述的图像传感器,其特征在于,所述像素阵列包括多个像素单元,所述像素单元包括至少两个所述像素子单元,在同一像素单元中,每个像素具有的偏振角度均不相同。The image sensor according to claim 1, wherein the pixel array includes a plurality of pixel units, and the pixel unit includes at least two pixel subunits, and in the same pixel unit, each pixel has a polarization The angles are all different.
  8. 根据权利要求1所述的图像传感器,其特征在于,所述图像传感器还包括滤光片阵列,所述滤光片阵列包括多个滤光单元,每个所述滤光单元包括至少两个滤光子单元,每个滤光子单元包括两个滤光区,同一个所述滤光单元的多个所述滤光区允许透过的光线颜色相同,每个所述滤光区对应一个像素。The image sensor according to claim 1, wherein the image sensor further comprises a filter array, the filter array comprises a plurality of filter units, and each filter unit comprises at least two filter units. In the photon unit, each filter sub-unit includes two filter areas, the multiple filter areas of the same filter unit allow the same color of light to pass through, and each filter area corresponds to a pixel.
  9. 根据权利要求8所述的图像传感器,其特征在于,所述滤光片阵列设置在所述像素阵列与所述微透镜阵列之间。The image sensor according to claim 8, wherein the filter array is disposed between the pixel array and the microlens array.
  10. 根据权利要求8所述的图像传感器,其特征在于,所述图像传感器还包括平坦层,所述平坦层设置在所述滤光片阵列与所述像素阵列的偏振元件之间。The image sensor according to claim 8, characterized in that the image sensor further comprises a flat layer disposed between the filter array and the polarizing elements of the pixel array.
  11. 根据权利要求8所述的图像传感器,其特征在于,所述像素阵列包括最小重复单元,每个最小重复单元包括四个所述像素单元,所述滤光片阵列包括多个滤光单元组,每个所述滤光单元组由四个所述滤光单元排列成二行二列的矩阵,所述滤光单元与所述像素单元一一对应;The image sensor according to claim 8, wherein the pixel array includes minimum repeating units, each minimum repeating unit includes four pixel units, and the filter array includes a plurality of filter unit groups, Each of the filter unit groups is composed of four filter units arranged in a matrix of two rows and two columns, and the filter units are in one-to-one correspondence with the pixel units;
    沿所述矩阵的第一对角线方向分布的两个所述滤光单元均用于透过第一颜色光,沿所述矩阵的第二对角线方向分布的两个所述滤光单元分别用于透过第二颜色光和第三颜色光;或The two filter units distributed along the first diagonal direction of the matrix are used to transmit the first color light, and the two filter units distributed along the second diagonal direction of the matrix for transmitting light of the second color and light of the third color, respectively; or
    沿所述矩阵的第一对角线方向分布的两个所述滤光单元分别用于透过第二颜色光和第三颜色光,沿所述矩阵的第二对角线方向分布的两个所述滤光单元均用于透过第一颜色光。The two filter units distributed along the first diagonal direction of the matrix are respectively used to transmit the second color light and the third color light, and the two filter units distributed along the second diagonal direction of the matrix The filter units are all used to transmit the light of the first color.
  12. 一种摄像装置,其特征在于,包括:A camera device, characterized in that it comprises:
    图像传感器;和image sensor; and
    镜头模组,所述图像传感器设置在所述镜头模组的像侧;A lens module, the image sensor is arranged on the image side of the lens module;
    其中,所述图像传感器包括像素阵列及微透镜阵列,Wherein, the image sensor includes a pixel array and a microlens array,
    所述像素阵列包括多个像素子单元,每个所述像素子单元包括第一像素和第二像素,在同一个所述像素子单元中,所述第一像素具有第一偏振角度,所述第二像素具有与第一偏振角度不同的第二偏振角度,所述第一像素能够将具有第一偏振角度的光线转换成电信号,并将具有与所述第一偏振角度不同偏振角度的光线反射至所述第二像素,所述第二像素能够将具有第二偏振角度的光线转换成电信号;The pixel array includes a plurality of pixel subunits, each of the pixel subunits includes a first pixel and a second pixel, and in the same pixel subunit, the first pixel has a first polarization angle, the The second pixel has a second polarization angle different from the first polarization angle, the first pixel is capable of converting light having the first polarization angle into an electrical signal, and converting light having a polarization angle different from the first polarization angle reflected to the second pixel, the second pixel is capable of converting light having a second polarization angle into an electrical signal;
    所述微透镜阵列包括多个微透镜,同一个所述像素子单元中的所述第一像素和所述第二像素被同一个所述微透镜覆盖,每个所述微透镜用于将光线聚焦至被所述微透镜覆盖的所述第一像素。The microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to transmit light focusing to the first pixel covered by the microlens.
  13. 根据权利要求12所述的摄像装置,其特征在于,所述第一偏振角度与所述第二偏振角度正交。The imaging device according to claim 12, wherein the first polarization angle is orthogonal to the second polarization angle.
  14. 根据权利要求12所述的摄像装置,其特征在于,所述第一像素或所述第二像素包括:The imaging device according to claim 12, wherein the first pixel or the second pixel comprises:
    光电转换元件,所述光电转换元件包括收光面;及a photoelectric conversion element including a light-receiving surface; and
    设置于所述收光面上的倾斜的偏振元件,所述偏振元件用于允许与所述偏振元件的偏振轴的角度平行的光线通过,并用于反射与所述偏振轴的角度不平行的光线,所述第一像素中的偏振元件的偏振轴的角度为第一偏振角度,所述第二像素中的偏振元件的偏振轴的角度为第二偏振角度。an inclined polarizing element arranged on the light-receiving surface, the polarizing element is used to allow light rays parallel to the angle of the polarization axis of the polarizing element to pass through, and is used to reflect light rays not parallel to the angle of the polarization axis , the angle of the polarization axis of the polarization element in the first pixel is the first polarization angle, and the angle of the polarization axis of the polarization element in the second pixel is the second polarization angle.
  15. 根据权利要求14所述的摄像装置,其特征在于,所述光电转换元件包括倾斜的所述收光面。The imaging device according to claim 14, wherein the photoelectric conversion element includes the inclined light receiving surface.
  16. 根据权利要求15所述的摄像装置,其特征在于,所述第一像素和所述第二像素均包括相背的第一侧及第二侧,在同一个所述像素子单元中,所述第一像素的第一侧与所述第二像素的第一侧相接;The imaging device according to claim 15, wherein the first pixel and the second pixel both include opposite first sides and second sides, and in the same pixel subunit, the the first side of the first pixel adjoins the first side of the second pixel;
    在所述图像传感器的光轴方向,所述第一像素的第一侧的高度低于所述第一像素的第二侧的高度,所述第二像素的第一侧的高度低于所述第二像素的第二侧的高度;并且在同一所述像素子单元中的两个所述第一像素的收光面与所述第二像素的收光面之间的夹角在预设范围内。In the optical axis direction of the image sensor, the height of the first side of the first pixel is lower than the height of the second side of the first pixel, and the height of the first side of the second pixel is lower than that of the The height of the second side of the second pixel; and the included angle between the light-receiving surfaces of two first pixels and the light-receiving surface of the second pixel in the same pixel subunit is within a preset range Inside.
  17. 根据权利要求12所述的摄像装置,其特征在于,在所述图像传感器的光轴方向,所述微透镜覆盖所述第一像素的区域的最大厚度大于覆盖所述第二像素的区域的最大厚度;或The imaging device according to claim 12, wherein, in the direction of the optical axis of the image sensor, the maximum thickness of the area where the microlens covers the first pixel is greater than the maximum thickness of the area where the microlens covers the second pixel. thickness; or
    所述微透镜覆盖所述第二像素的区域的最大厚度大于覆盖所述第一像素的区域的最大厚度。The maximum thickness of the area where the microlens covers the second pixel is greater than the maximum thickness of the area where the microlens covers the first pixel.
  18. 根据权利要求12所述的摄像装置,其特征在于,所述像素阵列包括多个像素单元,所述像素单元包括至少两个所述像素子单元,在同一像素单元中,每个像素具有的偏振角度均不相同。The imaging device according to claim 12, wherein the pixel array includes a plurality of pixel units, and the pixel unit includes at least two pixel subunits, and in the same pixel unit, each pixel has a polarization The angles are all different.
  19. 根据权利要求12所述的摄像装置,其特征在于,所述图像传感器还包括滤光片阵列,所述滤光片阵列包括多个滤光单元,每个所述滤光单元包括至少两个滤光子单元,每个滤光子单元包括两个滤光区,同一个所述滤光单元的多个所述滤光区允许透过的光线颜色相同,每个所述滤光区对应一个像素。The camera device according to claim 12, wherein the image sensor further includes a filter array, the filter array includes a plurality of filter units, and each filter unit includes at least two filter units. In the photon unit, each filter sub-unit includes two filter areas, the color of the light that is allowed to pass through the multiple filter areas of the same filter unit is the same, and each filter area corresponds to a pixel.
  20. 根据权利要求19所述的摄像装置,其特征在于,所述滤光片阵列设置在所述像素阵列与所述微透镜阵列之间。The imaging device according to claim 19, wherein the filter array is disposed between the pixel array and the microlens array.
  21. 根据权利要求19所述的摄像装置,其特征在于,所述图像传感器还包括平坦层,所述平坦层设置在所述滤光片阵列与所述像素阵列的偏振元件之间。The camera device according to claim 19, wherein the image sensor further comprises a flat layer, and the flat layer is disposed between the filter array and the polarizing element of the pixel array.
  22. 根据权利要求19所述的摄像装置,其特征在于,所述像素阵列包括最小重复单元,每个最小重复单元包括四个所述像素单元,所述滤光片阵列包括多个滤光单元组,每个所述滤光单元组由四个所述滤光单元排列成二行二列的矩阵,所述滤光单元与所述像素单元一一对应;The imaging device according to claim 19, wherein the pixel array includes minimum repeating units, each minimum repeating unit includes four pixel units, and the filter array includes a plurality of filter unit groups, Each of the filter unit groups is composed of four filter units arranged in a matrix of two rows and two columns, and the filter units are in one-to-one correspondence with the pixel units;
    沿所述矩阵的第一对角线方向分布的两个所述滤光单元均用于透过第一颜色光,沿所述矩阵的第二对角线方向分布的两个所述滤光单元分别用于透过第二颜色光和第三颜色光;或The two filter units distributed along the first diagonal direction of the matrix are used to transmit the first color light, and the two filter units distributed along the second diagonal direction of the matrix for transmitting light of the second color and light of the third color, respectively; or
    沿所述矩阵的第一对角线方向分布的两个所述滤光单元分别用于透过第二颜色光和第三颜色光,沿所述矩阵的第二对角线方向分布的两个所述滤光单元均用于透过第一颜色光。The two filter units distributed along the first diagonal direction of the matrix are respectively used to transmit the second color light and the third color light, and the two filter units distributed along the second diagonal direction of the matrix The filter units are all used to transmit the light of the first color.
  23. 一种电子设备,其特征在于,包括:An electronic device, characterized in that it comprises:
    权利要求12至22任意一项所述的摄像装置;和The imaging device according to any one of claims 12 to 22; and
    壳体,所述摄像装置安装在所述壳体上。a housing, on which the imaging device is mounted.
  24. 一种成像方法,用于图像传感器,其特征在于,所述图像传感器包括像素阵列及微透镜阵列,所述像素阵列包括多个像素子单元,每个所述像素子单元包括第一像素和第二像素,在同一个所述像素子单元中,所述第一像素具有第一偏振角度,所述第二像素具有与第一偏振角度不同的第二偏振角度,所述第一像素能够将具有第一偏振角度的光线转换成电信号,并将具有与所述第一偏振角度不同偏振角度的光线反射至所述第二像素,所述第二像素能够将具有第二偏振角度的光线转换成电信号;An imaging method for an image sensor, wherein the image sensor includes a pixel array and a microlens array, the pixel array includes a plurality of pixel subunits, and each of the pixel subunits includes a first pixel and a second pixel Two pixels, in the same pixel subunit, the first pixel has a first polarization angle, the second pixel has a second polarization angle different from the first polarization angle, and the first pixel can have The light of the first polarization angle is converted into an electrical signal, and the light with a polarization angle different from the first polarization angle is reflected to the second pixel, and the second pixel is capable of converting the light with the second polarization angle into electric signal;
    所述微透镜阵列包括多个微透镜,同一个所述像素子单元中的所述第一像素和所述第二像素被同一个所述微透镜覆盖,每个所述微透镜用于将光线聚焦至被所述微透镜覆盖的所述第一像素;所述成像方法包括:The microlens array includes a plurality of microlenses, the first pixel and the second pixel in the same pixel subunit are covered by the same microlens, and each microlens is used to transmit light focusing to the first pixel covered by the microlens; the imaging method includes:
    根据每个像素转换的电信号获取所述像素的像素值;obtaining the pixel value of the pixel according to the converted electrical signal of each pixel;
    选取所述像素阵列中的至少一个像素具有的偏振角度为目标偏振角度;及selecting the polarization angle of at least one pixel in the pixel array as the target polarization angle; and
    根据与目标偏振角度对应的像素的像素值生成偏振图像。A polarization image is generated from pixel values of pixels corresponding to the target polarization angle.
PCT/CN2022/079867 2021-05-25 2022-03-09 Image sensor, a camera device, electronic device, and imaging method WO2022247387A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110571645.0 2021-05-25
CN202110571645.0A CN113286067B (en) 2021-05-25 2021-05-25 Image sensor, image pickup apparatus, electronic device, and imaging method

Publications (1)

Publication Number Publication Date
WO2022247387A1 true WO2022247387A1 (en) 2022-12-01

Family

ID=77281440

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/079867 WO2022247387A1 (en) 2021-05-25 2022-03-09 Image sensor, a camera device, electronic device, and imaging method

Country Status (2)

Country Link
CN (1) CN113286067B (en)
WO (1) WO2022247387A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113286067B (en) * 2021-05-25 2023-05-26 Oppo广东移动通信有限公司 Image sensor, image pickup apparatus, electronic device, and imaging method
CN114222047A (en) * 2021-12-27 2022-03-22 Oppo广东移动通信有限公司 Focus control method, apparatus, image sensor, electronic device, and computer-readable storage medium
CN116528069A (en) * 2022-01-21 2023-08-01 华为技术有限公司 Image sensor and electronic device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107251553A (en) * 2015-02-27 2017-10-13 索尼公司 Image processing apparatus, image processing method and image pick-up element
CN107615485A (en) * 2015-06-10 2018-01-19 索尼公司 Solid state image pickup device and electronic equipment
CN110708453A (en) * 2019-11-12 2020-01-17 Oppo广东移动通信有限公司 Image sensor, camera module, terminal and imaging method
WO2020066738A1 (en) * 2018-09-26 2020-04-02 日本電信電話株式会社 Polarization imaging system
CN110995968A (en) * 2019-11-25 2020-04-10 Oppo广东移动通信有限公司 Image sensor, image pickup apparatus, electronic device, and imaging method
CN111627946A (en) * 2019-02-28 2020-09-04 三星电子株式会社 Image sensor with a plurality of pixels
CN113286067A (en) * 2021-05-25 2021-08-20 Oppo广东移动通信有限公司 Image sensor, image pickup apparatus, electronic device, and imaging method

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010058545A1 (en) * 2008-11-19 2010-05-27 パナソニック株式会社 Imaging device
FR2945666B1 (en) * 2009-05-15 2011-12-16 St Microelectronics Sa IMAGE SENSOR.
JP2013242480A (en) * 2012-05-22 2013-12-05 Panasonic Corp Color polarization imaging element and imaging apparatus
JP2017059589A (en) * 2015-09-14 2017-03-23 キヤノン株式会社 Solid-state image pickup element and imaging device
CN110854145A (en) * 2019-11-01 2020-02-28 Oppo广东移动通信有限公司 Pixel structure, image sensor and terminal
CN110784633B (en) * 2019-11-12 2021-07-16 Oppo广东移动通信有限公司 Image sensor, camera module, terminal and imaging method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107251553A (en) * 2015-02-27 2017-10-13 索尼公司 Image processing apparatus, image processing method and image pick-up element
CN107615485A (en) * 2015-06-10 2018-01-19 索尼公司 Solid state image pickup device and electronic equipment
WO2020066738A1 (en) * 2018-09-26 2020-04-02 日本電信電話株式会社 Polarization imaging system
CN111627946A (en) * 2019-02-28 2020-09-04 三星电子株式会社 Image sensor with a plurality of pixels
CN110708453A (en) * 2019-11-12 2020-01-17 Oppo广东移动通信有限公司 Image sensor, camera module, terminal and imaging method
CN110995968A (en) * 2019-11-25 2020-04-10 Oppo广东移动通信有限公司 Image sensor, image pickup apparatus, electronic device, and imaging method
CN113286067A (en) * 2021-05-25 2021-08-20 Oppo广东移动通信有限公司 Image sensor, image pickup apparatus, electronic device, and imaging method

Also Published As

Publication number Publication date
CN113286067B (en) 2023-05-26
CN113286067A (en) 2021-08-20

Similar Documents

Publication Publication Date Title
WO2022247387A1 (en) Image sensor, a camera device, electronic device, and imaging method
US11211410B2 (en) Solid-state image-capturing device and production method thereof, and electronic appliance
US10498990B2 (en) Imaging systems with high dynamic range and phase detection pixels
JP5538553B2 (en) Solid-state imaging device and imaging apparatus
US20180301484A1 (en) Image sensors with high dynamic range and autofocusing hexagonal pixels
WO2021103872A1 (en) Image sensor, camera apparatus, electronic device, and imaging method
TW201025583A (en) Image sensor having multiple sensing layers
TW201013910A (en) Image sensor having multiple sensing layers
CN110784633B (en) Image sensor, camera module, terminal and imaging method
CN108174068A (en) Optical field imaging module
CN104183612B (en) A kind of pel array of the inclined cmos image sensor of light path
CN207691912U (en) The optical field imaging module of small size
CN110677575B (en) Image sensor, camera module and terminal
KR20220078355A (en) Image sensor including auto focusing pixels
WO2022206112A1 (en) Image sensor, camera module and electronic device
JP2012211942A (en) Solid-state image sensor and image pickup apparatus
CN110708453A (en) Image sensor, camera module, terminal and imaging method
KR102587961B1 (en) Image sensor including color separating lens array and electronic apparatus including the same
CN207691911U (en) Optical field imaging module
US20210280623A1 (en) Phase detection pixels with stacked microlenses
KR102680239B1 (en) Image sensor and electronic apparatus including same
US20220406836A1 (en) Image sensor
US20230115006A1 (en) Image sensor including color separating lens array and electronic apparatus including the image sensor
KR20060131508A (en) Pixel array with mirror symmetry
KR20240095399A (en) Image sensor and electronic apparatus including same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22810121

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22810121

Country of ref document: EP

Kind code of ref document: A1