WO2023045764A1

WO2023045764A1 - Image sensor, camera module, electronic device, and image processing method

Info

Publication number: WO2023045764A1
Application number: PCT/CN2022/117649
Authority: WO
Inventors: 代郁峰; 邹松; 汪立
Original assignee: 华为技术有限公司
Priority date: 2021-09-22
Filing date: 2022-09-07
Publication date: 2023-03-30
Also published as: CN115866423A

Abstract

The present application provides an image sensor, a camera module, an electronic device, and an image processing method. The image sensor comprises: a plurality of pixel units arranged in an array in the horizontal direction and the vertical direction. The plurality of pixel units comprise: a plurality of white pixel units, a plurality of first color pixel units, a plurality of second color pixel units, and a plurality of third color pixel units. By configuring the white pixel units, the light incident amount of light can be increased, thereby improving the brightness of the image acquired by the image sensor. The shape of each pixel unit is a polygon, and an included angle between at least one edge thereof and the horizontal direction is an acute angle. Any two adjacent pixel unit rows are arranged in a staggered manner, and any two adjacent pixel unit columns are arranged in a staggered manner. In this way, the arrangement of the plurality of pixel units in the image sensor is relatively compact, so that the resolution of the image acquired by the image sensor is relatively high, thereby improving the quality of the image acquired by the image sensor.

Description

一种图像传感器、摄像头模组、电子设备及图像处理方法Image sensor, camera module, electronic device and image processing method

相关申请的交叉引用Cross References to Related Applications

本申请要求在2021年09月22日提交中国专利局、申请号为202111106599.3、申请名称为“一种图像传感器、摄像头模组、电子设备及图像处理方法”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application submitted to the China Patent Office on September 22, 2021, with the application number 202111106599.3 and the application name "An Image Sensor, Camera Module, Electronic Equipment, and Image Processing Method", all of which The contents are incorporated by reference in this application.

技术领域technical field

本申请涉及图像处理技术领域，尤其涉及一种图像传感器、摄像头模组、电子设备及图像处理方法。The present application relates to the technical field of image processing, in particular to an image sensor, a camera module, electronic equipment and an image processing method.

背景技术Background technique

图像传感器是一种能够实现光电转换功能的器件，广泛应用于摄像设备中，例如可以应用于照相机、摄像头及安防监控器等摄像设备中。图像传感器中设有彩膜层，彩膜层可以对环境光进行过滤，以将环境光按照对应色彩进行区分，便于后续图像的彩色信息还原。图像传感器还可以将彩膜层过滤得到的光信号转换为电信号，从而实现图像信息的存储，便于后续通过图像处理得到图像。An image sensor is a device capable of realizing a photoelectric conversion function, and is widely used in imaging equipment, for example, in imaging equipment such as cameras, cameras, and security monitors. The image sensor is provided with a color filter layer, and the color filter layer can filter the ambient light to distinguish the ambient light according to the corresponding color, so as to facilitate the restoration of the color information of the subsequent image. The image sensor can also convert the optical signal filtered by the color filter layer into an electrical signal, so as to realize the storage of image information and facilitate subsequent image processing.

在相关技术中，图像传感器最大的挑战在于夜间拍摄，由于夜间环境光太暗，被拍摄目标没有足够的反射光射向图像传感器，使得图像传感器接收到的光信号较微弱，并且，图像传感器接收到的光信号容易被噪声掩盖，导致图像传感器无法获取被拍摄目标的清晰的图像。例如，安防监控器在夜间无补光的情况下，无法清晰的拍摄到人脸。又如，在夜间高速路的拍摄场景中，由于光线弱、车辆的行驶速度快等原因，安防监控器很难获取清晰的车牌图像，并且，红外补光灯对蓝底白字的车牌补光效果不明显，可见光的补光灯对司机的安全驾驶有干扰。此外，图像传感器中的像素单元采用正方形横纵排列的排列方式，在水平方向和竖直方向上相邻像素单元之间的间距较大，导致图像传感器获取的图像的分辨率较低。因此，由于图像传感器获取的图像的清晰度较差、分辨率较低，使得图像传感器获取的图像质量较差。In related technologies, the biggest challenge of the image sensor is nighttime shooting. Because the ambient light at night is too dark, the object to be photographed does not have enough reflected light to reach the image sensor, so that the light signal received by the image sensor is relatively weak, and the image sensor receives The optical signal is easily covered by noise, which makes the image sensor unable to obtain a clear image of the object being photographed. For example, security monitors cannot clearly capture human faces at night without supplementary light. Another example is that in the shooting scene of the expressway at night, due to the weak light and the fast speed of the vehicle, it is difficult for the security monitor to obtain a clear image of the license plate. It is not obvious that the supplementary light of visible light interferes with the safe driving of the driver. In addition, the pixel units in the image sensor are arranged horizontally and vertically in a square, and the distance between adjacent pixel units in the horizontal and vertical directions is relatively large, resulting in a low resolution of the image captured by the image sensor. Therefore, due to poor definition and low resolution of the image acquired by the image sensor, the quality of the image acquired by the image sensor is poor.

发明内容Contents of the invention

本申请实施例提供了一种图像传感器、摄像头模组、电子设备及图像处理方法，用于提高图像传感器获取的图像质量。Embodiments of the present application provide an image sensor, a camera module, an electronic device, and an image processing method, which are used to improve the image quality acquired by the image sensor.

第一方面，本申请实施例提供了一种图像传感器。该图像传感器可以包括：沿水平方向和竖直方向呈阵列排布的多个像素单元，水平方向与竖直方向可以相互垂直，在具体实施时，水平方向可以与图像传感器的边缘的方向一致。In a first aspect, the embodiment of the present application provides an image sensor. The image sensor may include: a plurality of pixel units arranged in an array along a horizontal direction and a vertical direction, the horizontal direction and the vertical direction may be perpendicular to each other, and in specific implementation, the horizontal direction may be consistent with the direction of the edge of the image sensor.

上述图像传感器中的多个像素单元可以包括：多个白色像素单元、多个第一彩色像素单元、多个第二彩色像素单元及多个第三彩色像素单元。白色像素单元中的滤光层为透明滤光层，因而白色像素单元对光线的损失较小。所以，通过在图像传感器中设置白色像素单元，可以提高图像传感器的光线的入光量，提升图像传感器获取的图像的亮度，尤其可以提升图像传感器在低照度下的灵敏度，从而可以改善图像传感器获取的图像的质量。The plurality of pixel units in the image sensor may include: a plurality of white pixel units, a plurality of first color pixel units, a plurality of second color pixel units, and a plurality of third color pixel units. The filter layer in the white pixel unit is a transparent filter layer, so the loss of light to the white pixel unit is small. Therefore, by arranging white pixel units in the image sensor, the amount of light incident on the image sensor can be increased, and the brightness of the image captured by the image sensor can be increased, especially the sensitivity of the image sensor under low illumination can be improved, thereby improving the image sensor. Image quality.

上述图像传感器中的每一个像素单元的形状可以为多边形，且每一个像素单元的至少一个边与水平方向之间的夹角为锐角。上述图像传感器中的多个像素单元可以构成多个像素单元行，每一个像素单元行包括沿水平方向排列的多个像素单元，任意相邻两个像素单元行错位设置。上述图像传感器中的多个像素单元构成多个像素单元列，每一个像素单元列包括沿竖直方向排列的多个像素单元，任意相邻两个像素单元列错位设置。这样，可以将图像传感器中的多个像素单元排列的更加紧凑，使得图像传感器获取的图像的分辨率较高。The shape of each pixel unit in the above image sensor may be polygonal, and the angle between at least one side of each pixel unit and the horizontal direction is an acute angle. A plurality of pixel units in the above image sensor may constitute a plurality of pixel unit rows, each pixel unit row includes a plurality of pixel units arranged in the horizontal direction, and any two adjacent pixel unit rows are arranged in a staggered position. A plurality of pixel units in the above image sensor constitute a plurality of pixel unit columns, each pixel unit column includes a plurality of pixel units arranged in a vertical direction, and any two adjacent pixel unit columns are arranged in a staggered position. In this way, multiple pixel units in the image sensor can be arranged more compactly, so that the resolution of the image acquired by the image sensor is higher.

在具体实施时，在设置上述图像传感器中的多个像素单元的排布方式时，白色像素单元的数量与多个像素单元的总数量的比值大于或等于50％。也就是说，图像传感器中的大部分像素单元为白色像素单元，从而可以使图像传感器中的光线的入光量较大，使得图像传感器获取的图像的亮度较高。In a specific implementation, when setting the arrangement of the plurality of pixel units in the above image sensor, the ratio of the number of white pixel units to the total number of the plurality of pixel units is greater than or equal to 50%. That is to say, most of the pixel units in the image sensor are white pixel units, so that the amount of light entering the image sensor can be increased, so that the brightness of the image acquired by the image sensor is relatively high.

可选地，在上述图像传感器中的多个像素单元中，第一彩色像素单元的数量、第二彩色像素单元的数量、第三彩色像素单元的数量的比值为1:1:1。也就是说，图像传感器中第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的分布较均匀，使得图像传感器能够均匀地采集到第一颜色、第二颜色和第三颜色对应的彩色信息，图像传感器获取的图像的色彩更接近被拍摄目标的真实色彩。或者，第二彩色像素单元的数量、第一彩色像素单元的数量、第三彩色像素单元的数量的比值也可以为2:1:1，第二彩色像素单元可以为绿色像素单元，由于人眼对绿色光线更敏感，通过增加第二彩色像素单元的数量，可以使图像传感器获取的图像更接近人眼观看到的被拍摄目标的真实色彩，使人眼感知的图像的质量较好。Optionally, among the plurality of pixel units in the above image sensor, the ratio of the number of first color pixel units, the number of second color pixel units, and the number of third color pixel units is 1:1:1. That is to say, the distribution of the first color pixel unit, the second color pixel unit and the third color pixel unit in the image sensor is relatively uniform, so that the image sensor can uniformly collect the pixels corresponding to the first color, the second color and the third color Color information, the color of the image captured by the image sensor is closer to the real color of the object being photographed. Or, the ratio of the quantity of the second color pixel unit, the quantity of the first color pixel unit, and the quantity of the third color pixel unit can also be 2:1:1, and the second color pixel unit can be a green pixel unit, because human eyes It is more sensitive to green light, and by increasing the number of second color pixel units, the image captured by the image sensor can be closer to the real color of the object seen by the human eye, so that the quality of the image perceived by the human eye is better.

可选地，第一彩色像素单元可以为红色像素单元，第二彩色像素单元可以为绿色像素单元，第三彩色像素单元可以为蓝色像素单元；或者，第一彩色像素单元可以为品红色像素单元，第二彩色像素单元可以为黄色像素单元，第三彩色像素单元可以为青色像素单元。当然，第一彩色像素单元、第二彩色像素单元、第三彩色像素单元也可以为其他颜色的像素单元，此处不做限定。Optionally, the first color pixel unit can be a red pixel unit, the second color pixel unit can be a green pixel unit, and the third color pixel unit can be a blue pixel unit; or, the first color pixel unit can be a magenta pixel The second color pixel unit may be a yellow pixel unit, and the third color pixel unit may be a cyan pixel unit. Certainly, the first color pixel unit, the second color pixel unit, and the third color pixel unit may also be pixel units of other colors, which are not limited here.

在本申请的一些实施例中，上述图像传感器中的多个像素单元中的每一个像素单元的形状可以为六边形。In some embodiments of the present application, the shape of each of the plurality of pixel units in the image sensor may be hexagonal.

在一种可能的实现方式中，上述图像传感器中的每一个像素单元包括：与水平方向平行的第一侧边和第二侧边、与第一侧边相连的第三侧边和第四侧边，以及与第二侧边相连的第五侧边和第六侧边；第三侧边与第五侧边相连，第四侧边与第六侧边相连。第三侧边与第五侧边之间的夹角为90°，第四侧边与第六侧边之间的夹角为90°；第一侧边与第三侧边之间的夹角为135°，第一侧边与第四侧边之间的夹角为135°，第二侧边与第五侧边之间的夹角为135°，第二侧边与第六侧边之间的夹角为135°。在实际版图设计过程中，像素单元之间的信号线一般相对于水平方向F1呈0°、45°、90°和135°等方向延伸，因而，本申请实施例中的像素单元设置方式，更符合版图设计规则，便于半导体工艺加工。In a possible implementation manner, each pixel unit in the image sensor includes: a first side and a second side parallel to the horizontal direction, a third side and a fourth side connected to the first side side, and the fifth side and the sixth side connected to the second side; the third side is connected to the fifth side, and the fourth side is connected to the sixth side. The angle between the third side and the fifth side is 90°, the angle between the fourth side and the sixth side is 90°; the angle between the first side and the third side is 135°, the angle between the first side and the fourth side is 135°, the angle between the second side and the fifth side is 135°, the angle between the second side and the sixth side The angle between them is 135°. In the actual layout design process, the signal lines between the pixel units generally extend in directions of 0°, 45°, 90° and 135° relative to the horizontal direction F1. It complies with layout design rules and is convenient for semiconductor process processing.

在一种可能的实现方式中，上述图像传感器中的多个像素单元行包括：多个第一像素单元行和多个第二像素单元行，任意相邻两个第一像素单元行之间间隔两个第二像素单元行。每一个第一像素单元行包括：多个第一彩色像素单元，多个第二彩色像素单元和多个第三彩色像素单元，每一个第一像素单元行中的像素单元按照第一彩色像素单元、第三彩色像素单元、第二彩色像素单元的顺序重复排列。上述图像传感器中的多个像素单元列包括：多个第一像素单元列，多个第二像素单元列和多个第三像素单元列，多个像素单元列按照第一像素单元列、第二像素单元列、第三像素单元列的顺序重复排列。第一像素单元列包括：多个第一彩色像素单元和多个白色像素单元；在第一像素单元列中，相邻两个第一彩色像素单元之间间隔两个白色像素单元。第二像素单元列包括：多个第二彩色像素单元和多个白色像素单元；在第二像素单元列中，相邻两个第二彩色像素单元之间间隔两个白色像素单元。第三像素单元列包括：多个第三彩色像素单元和多个白色像素单元；在第三像素单元列中，相邻两个第三彩色像素单元之间间隔两个白色像素单元。In a possible implementation manner, the plurality of pixel unit rows in the image sensor includes: a plurality of first pixel unit rows and a plurality of second pixel unit rows, and the interval between any two adjacent first pixel unit rows is Two second pixel cell rows. Each first pixel unit row includes: a plurality of first color pixel units, a plurality of second color pixel units and a plurality of third color pixel units, and the pixel units in each first pixel unit row are arranged according to the first color pixel unit , the third color pixel unit, and the second color pixel unit are arranged repeatedly. The plurality of pixel unit columns in the image sensor includes: a plurality of first pixel unit columns, a plurality of second pixel unit columns and a plurality of third pixel unit columns, and the plurality of pixel unit columns are arranged according to the first pixel unit column, the second pixel unit column The sequence of the pixel unit column and the third pixel unit column is arranged repeatedly. The first pixel unit row includes: a plurality of first color pixel units and a plurality of white pixel units; in the first pixel unit row, two adjacent first color pixel units are separated by two white pixel units. The second pixel unit column includes: a plurality of second color pixel units and a plurality of white pixel units; in the second pixel unit column, two adjacent second color pixel units are separated by two white pixel units. The third pixel unit column includes: a plurality of third color pixel units and a plurality of white pixel units; in the third pixel unit column, two adjacent third color pixel units are separated by two white pixel units.

在一种可能的实现方式中，上述图像传感器中的多个像素单元包括多个重复单元，每一个重复单元包括：分布于相邻的两个像素单元列和相邻的五个像素单元行的五个像素单元；重复单元中的其中一个像素单元列包括：一个第一彩色像素单元、一个第二彩色像素单元和一个第三彩色像素单元，另一个像素单元列包括：两个白色像素单元。In a possible implementation manner, the plurality of pixel units in the above image sensor includes a plurality of repeating units, and each repeating unit includes: Five pixel units; one of the pixel unit columns in the repeating unit includes: a first color pixel unit, a second color pixel unit and a third color pixel unit, and the other pixel unit column includes: two white pixel units.

在一种可能的实现方式中，上述图像传感器中的多个像素单元包括多个重复单元，每一个重复单元包括：分布于相邻的五个像素单元行和相邻的五个像素单元列的九个像素单元。重复单元包括：位于中间的像素单元行的三个白色像素单元，以及分布于其余的四个像素单元行的两个第一彩色像素单元、两个第二彩色像素单元和两个第三彩色像素单元，其中，两个第一彩色像素单元、两个第二彩色像素单元和两个第三彩色像素单元围绕位于中间的白色像素单元排列为环状。In a possible implementation manner, the plurality of pixel units in the above image sensor includes a plurality of repeating units, and each repeating unit includes: Nine pixel units. The repeating unit includes: three white pixel units in the middle pixel unit row, and two first color pixel units, two second color pixel units and two third color pixel units distributed in the remaining four pixel unit rows unit, wherein two first color pixel units, two second color pixel units and two third color pixel units are arranged in a ring around the white pixel unit located in the middle.

在一种可能的实现方式中，上述图像传感器中的多个像素单元包括多个重复单元，每一个重复单元包括：分布于相邻的五个像素单元行和相邻的三个像素单元列的七个像素单元。在每一个重复单元中，位于中间的像素单元列包括：一个第一彩色像素单元、一个第二彩色像素单元和一个第三彩色像素单元，其余的两个像素单元列均包括两个白色像素单元。In a possible implementation manner, the plurality of pixel units in the above image sensor includes a plurality of repeating units, and each repeating unit includes: Seven pixel units. In each repeating unit, the pixel unit column in the middle includes: a first color pixel unit, a second color pixel unit and a third color pixel unit, and the remaining two pixel unit columns each include two white pixel units .

在一种可能的实现方式中，上述图像传感器中的多个像素单元包括多个重复单元，每一个重复单元包括：分布于相邻的五个像素单元行和相邻的三个像素单元列的七个像素单元。在每一个重复单元中，其中一个像素单元位于中间，其余的六个像素单元围绕位于中间的像素单元排列为环状；重复单元包括：一个第一彩色像素单元、一个第二彩色像素单元、一个第三彩色像素单元和四个白色像素单元，其中，第一彩色像素单元、第二彩色像素单元和第三彩色像素单元分布于两个像素单元列和三个像素单元行中。In a possible implementation manner, the plurality of pixel units in the above image sensor includes a plurality of repeating units, and each repeating unit includes: Seven pixel units. In each repeating unit, one of the pixel units is located in the middle, and the remaining six pixel units are arranged in a ring around the pixel unit located in the middle; the repeating unit includes: a first color pixel unit, a second color pixel unit, a A third color pixel unit and four white pixel units, wherein the first color pixel unit, the second color pixel unit and the third color pixel unit are distributed in two pixel unit columns and three pixel unit rows.

本申请实施中的像素单元排布方式中，第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的数量比值约为1:1:1，并且，第一彩色像素单元、第二彩色像素单元和第三彩色像素单元均匀分布，从而，可以使图像传感器采集的图像的彩色信息较均匀，得到的图像的色彩效果较好。并且，白色像素单元的数量较多，且白色像素单元均匀分布，从而使图像传感器获取的图像的亮度较高，且该图像的亮度较均匀，因此，该图像的清晰度较高。In the pixel unit arrangement in the implementation of the present application, the ratio of the number of the first color pixel unit, the second color pixel unit, and the third color pixel unit is about 1:1:1, and the first color pixel unit, the second color pixel unit The color pixel units and the third color pixel units are evenly distributed, so that the color information of the image collected by the image sensor can be more uniform, and the color effect of the obtained image is better. In addition, the number of white pixel units is relatively large, and the white pixel units are evenly distributed, so that the brightness of the image acquired by the image sensor is relatively high, and the brightness of the image is relatively uniform, so the definition of the image is relatively high.

在本申请的另一些实施例中，上述图像传感器中的多个像素单元中的每一个像素单元的形状可以为矩形，且每一个像素单元的至少一个边与水平方向之间的夹角为锐角；可选地，每一个像素单元的形状可以为正方形，且每一个像素单元的至少一个边与水平方向之间的夹角可以为45°。In other embodiments of the present application, the shape of each pixel unit among the plurality of pixel units in the image sensor may be rectangular, and the angle between at least one side of each pixel unit and the horizontal direction is an acute angle ; Optionally, the shape of each pixel unit may be a square, and the angle between at least one side of each pixel unit and the horizontal direction may be 45°.

在本申请实施例中，上述图像传感器中的多个像素单元行可以包括至少一个白色像素单元行，白色像素单元行中的每一个像素单元均为白色像素单元。通过在图像传感器中设置白色像素单元行，可以提高图像传感器的光线的如光亮，提升图像传感器获取的图像的亮度。In the embodiment of the present application, the plurality of pixel unit rows in the above image sensor may include at least one white pixel unit row, and each pixel unit in the white pixel unit row is a white pixel unit. By arranging white pixel unit rows in the image sensor, the brightness of the light of the image sensor can be improved, and the brightness of the image acquired by the image sensor can be improved.

上述图像传感器中的多个像素单元行还可以包括多个彩色像素单元行，彩色像素单元行包括第一彩色像素单元、第二彩色像素单元及第三彩色像素单元中的至少一个，任意相邻两个彩色像素单元行之间间隔至少一个白色像素单元行。上述图像传感器中的多个像素单元列可以包括多个彩色像素单元列，彩色像素单元列包括第一彩色像素单元、第二彩色像素单元及第三彩色像素单元中的至少一个。The plurality of pixel unit rows in the above-mentioned image sensor may also include a plurality of color pixel unit rows, and the color pixel unit rows include at least one of the first color pixel unit, the second color pixel unit and the third color pixel unit, any adjacent There is at least one white pixel unit row between two colored pixel unit rows. The plurality of pixel unit columns in the image sensor may include a plurality of color pixel unit columns, and the color pixel unit columns include at least one of a first color pixel unit, a second color pixel unit, and a third color pixel unit.

在一种可能的实现方式中，上述图像传感器中的多个像素单元行中的白色像素单元行与彩色像素单元行交替排布，这样设置可以使白色像素单元均匀分布，使图像传感器获取的图像的亮度较均匀，图像的清晰度更好。上述图像传感器中的多个彩色像素单元行包括：交替排布的多个第一彩色像素单元行和多个第二彩色像素单元行，第一彩色像素单元行包括：交替排列的多个第一彩色像素单元和多个第二彩色像素单元，第二彩色像素单元行包括：交替排列的多个第二彩色像素单元和多个第三彩色像素单元，第一彩色像素单元行中的第二彩色像素单元，与第二彩色像素单元行中的第二彩色像素单元位于不同的彩色像素单元列。采用这种像素单元排布方式，第二彩色像素单元、第一彩色像素单元、第三彩色像素单元的数量比值可以为2:1:1，第二彩色像素单元可以为绿色像素单元，绿色像素单元的数量较多，且绿色像素单元均匀分布，由于人眼对绿色光线更敏感，可以使图像传感器获取的图像更接近人眼观看到的被拍摄目标的真实色彩，使人眼感知的图像的质量较好。In a possible implementation manner, the white pixel unit rows and the colored pixel unit rows in the plurality of pixel unit rows in the image sensor are arranged alternately, so that the white pixel units can be evenly distributed, and the image captured by the image sensor The brightness is more uniform, and the definition of the image is better. The plurality of color pixel unit rows in the image sensor includes: a plurality of first color pixel unit rows and a plurality of second color pixel unit rows arranged alternately, and the first color pixel unit row includes: a plurality of alternately arranged first color pixel unit rows A color pixel unit and a plurality of second color pixel units, the second color pixel unit row includes: a plurality of second color pixel units and a plurality of third color pixel units arranged alternately, the second color pixel unit in the first color pixel unit row The pixel unit is located in a different color pixel unit column than the second color pixel unit in the second color pixel unit row. With this pixel unit arrangement, the ratio of the number of the second color pixel unit, the first color pixel unit, and the third color pixel unit can be 2:1:1, the second color pixel unit can be a green pixel unit, and the green pixel unit The number of units is large, and the green pixel units are evenly distributed. Since the human eye is more sensitive to green light, the image acquired by the image sensor can be closer to the real color of the object seen by the human eye, making the image perceived by the human eye more accurate. The quality is better.

在一种可能的实现方式中，上述图像传感器中的多个像素单元行中的白色像素单元行与彩色像素单元行交替排布，这样设置可以使白色像素单元均匀分布，使图像传感器获取的图像的亮度较均匀，图像的清晰度更好。每一个彩色像素单元行中的像素单元按照第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的顺序重复排列，每一个彩色像素单元列中的像素单元按照第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的顺序重复排列。这样，可以使第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的数量比值约为1:1:1，并且，第一彩色像素单元、第二彩色像素单元和第三彩色像素单元均匀分布，从而，可以使图像传感器采集的图像的彩色信息较均匀，得到的图像的色彩效果较好。In a possible implementation manner, the white pixel unit rows and the colored pixel unit rows in the plurality of pixel unit rows in the image sensor are arranged alternately, so that the white pixel units can be evenly distributed, and the image captured by the image sensor The brightness is more uniform, and the definition of the image is better. The pixel units in each color pixel unit row are repeatedly arranged in the order of the first color pixel unit, the second color pixel unit, and the third color pixel unit, and the pixel units in each color pixel unit column are arranged in the order of the first color pixel unit, the second color pixel unit, and the third color pixel unit. The order of the second color pixel unit and the third color pixel unit is repeatedly arranged. In this way, the number ratio of the first color pixel unit, the second color pixel unit and the third color pixel unit can be about 1:1:1, and the first color pixel unit, the second color pixel unit and the third color pixel unit The units are evenly distributed, so that the color information of the image collected by the image sensor can be more uniform, and the color effect of the obtained image is better.

在一种可能的实现方式中，上述图像传感器中的多个像素单元行中的白色像素单元行与彩色像素单元行交替排布，这样设置可以使白色像素单元均匀分布，使图像传感器获取的图像的亮度较均匀，图像的清晰度更好。上述图像传感器中的多个彩色像素单元行包括：多个第一彩色像素单元行、多个第二彩色像素单元行、多个第三彩色像素单元行及多个第四彩色像素单元行，且多个彩色像素单元行中的彩色像素单元行按照第一彩色像素单元行、第二彩色像素单元行、第三彩色像素单元行、第四彩色像素单元行的顺序重复排列，第一彩色像素单元行包括：多个白色像素单元、多个第一彩色像素单元及多个第三彩色像素单元，第一彩色像素单元行中的像素单元按照白色像素单元、第一彩色像素单元、白色像素单元、第三彩色像素单元的顺序重复排列。第二彩色像素单元行包括：交替排列的多个白色像素单元和多个第二彩色像素单元。第三彩色像素单元行包括：多个白色像素单元、多个第一彩色像素单元及多个第三彩色像素单元，第三彩色像素单元行中的像素单元按照白色像素单元、第三彩色像素单元、白色像素单元、第一彩色像素单元的顺序重复排列；第一彩色像素单元行中的第一彩色像素单元，与第三彩色像素单元行中的第一彩色像素单元位于不同的彩色像素单元列。第四彩色像素单元行包括：交替排列的多个白色像素单元和多个第二彩色像素单元；第四彩色像素单元行中多个像素单元的排列顺序，与第二彩色像素单元行中的多个像素单元的排列顺序相同。采用这种像素单元排布方式，第二彩色像素单元、第一彩色像素单元、第三彩色像素单元的数量比值可以为2:1:1，第二彩色像素单元可以为绿色像素单元，绿色像素单元的数量较多，且绿色像素单元均匀分布，由于人眼对绿色光线更敏感，可以使图像传感器获取的图像更接近人眼观看到的被拍摄目标的真实色彩，使人眼感知的图像的质量较好。并且，白色像素单元较多，可以使图像传感器中的光线的入光量较大，使得图像传感器获取的图像的亮度较高。In a possible implementation manner, the white pixel unit rows and the colored pixel unit rows in the plurality of pixel unit rows in the image sensor are arranged alternately, so that the white pixel units can be evenly distributed, and the image captured by the image sensor The brightness is more uniform, and the definition of the image is better. The plurality of color pixel unit rows in the image sensor includes: a plurality of first color pixel unit rows, a plurality of second color pixel unit rows, a plurality of third color pixel unit rows, and a plurality of fourth color pixel unit rows, and The color pixel unit rows in the plurality of color pixel unit rows are repeatedly arranged in the order of the first color pixel unit row, the second color pixel unit row, the third color pixel unit row, and the fourth color pixel unit row, and the first color pixel unit row A row includes: a plurality of white pixel units, a plurality of first color pixel units and a plurality of third color pixel units. The sequence of the pixel units of the third color is arranged repeatedly. The second color pixel unit row includes: a plurality of white pixel units and a plurality of second color pixel units arranged alternately. The third color pixel unit row includes: a plurality of white pixel units, a plurality of first color pixel units and a plurality of third color pixel units, and the pixel units in the third color pixel unit row are divided into white pixel units, third color pixel units , white pixel unit, and first color pixel unit are arranged repeatedly; the first color pixel unit in the first color pixel unit row is located in a different color pixel unit column than the first color pixel unit in the third color pixel unit row . The fourth color pixel unit row includes: a plurality of white pixel units and a plurality of second color pixel units arranged alternately; the arrangement order of the plurality of pixel units in the fourth color pixel unit row is the same as that of the second color pixel unit row. The pixel units are arranged in the same order. With this pixel unit arrangement, the ratio of the number of the second color pixel unit, the first color pixel unit, and the third color pixel unit can be 2:1:1, the second color pixel unit can be a green pixel unit, and the green pixel unit The number of units is large, and the green pixel units are evenly distributed. Since the human eye is more sensitive to green light, the image acquired by the image sensor can be closer to the real color of the object seen by the human eye, making the image perceived by the human eye more accurate. The quality is better. Moreover, there are more white pixel units, which can increase the amount of incident light in the image sensor, so that the brightness of the image acquired by the image sensor is higher.

在一种可能的实现方式中，上述图像传感器中的多个彩色像素单元行中的任意相邻两个彩色像素单元行之间间隔两个白色像素单元行，这样设置可以使图像传感器中的白色像素单元的数量较多，且白色像素单元均匀分布，从而使图像传感器获取的图像的亮度较高，且该图像的亮度较均匀，因此，该图像的清晰度较高。每一个彩色像素单元行中的像素单元按照第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的顺序重复排列。上述图像传感器中的多个彩色像素单元列包括：多个第一彩色像素单元列，多个第二彩色像素单元列和多个第三彩色像素单元列，多个彩色像素单元列按照第一彩色像素单元列、第二彩色像素单元列、第三彩色像素单元列的顺序重复排列。第一彩色像素单元列包括：多个第一彩色像素单元和多个白色像素单元；在第一彩色像素单元列中，相邻两个第一彩色像素单元之间间隔两个白色像素单元。第二彩色像素单元列包括：多个第三彩色像素单元和多个白色像素单元；在第二彩色像素单元列中，相邻两个第三彩色像素单元之间间隔两个白色像素单元。第三彩色像素单元列包括：多个第二彩色像素单元和多个白色像素单元；在第三彩色像素单元列中，相邻两个第二彩色像素单元之间间隔两个白色像素单元。这样，第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的数量比值约为1:1:1，并且，第一彩色像素单元、第二彩色像素单元和第三彩色像素单元均匀分布，从而，可以使图像传感器采集的图像的彩色信息较均匀，得到的图像的色彩效果较好。In a possible implementation manner, there are two white pixel unit rows between any two adjacent color pixel unit rows in the plurality of color pixel unit rows in the image sensor, so that the white pixel unit rows in the image sensor can The number of pixel units is large, and the white pixel units are uniformly distributed, so that the brightness of the image acquired by the image sensor is relatively high, and the brightness of the image is relatively uniform, so the definition of the image is relatively high. The pixel units in each color pixel unit row are repeatedly arranged in the order of the first color pixel unit, the second color pixel unit, and the third color pixel unit. The plurality of color pixel unit columns in the image sensor includes: a plurality of first color pixel unit columns, a plurality of second color pixel unit columns and a plurality of third color pixel unit columns, and the plurality of color pixel unit columns are arranged according to the first color The order of the pixel unit column, the second color pixel unit column, and the third color pixel unit column is repeatedly arranged. The first color pixel unit column includes: a plurality of first color pixel units and a plurality of white pixel units; in the first color pixel unit column, two adjacent first color pixel units are separated by two white pixel units. The second color pixel unit column includes: a plurality of third color pixel units and a plurality of white pixel units; in the second color pixel unit column, two white pixel units are separated between two adjacent third color pixel units. The third color pixel unit column includes: a plurality of second color pixel units and a plurality of white pixel units; in the third color pixel unit column, two white pixel units are separated between two adjacent second color pixel units. In this way, the quantity ratio of the first color pixel unit, the second color pixel unit and the third color pixel unit is about 1:1:1, and the first color pixel unit, the second color pixel unit and the third color pixel unit are uniform Therefore, the color information of the image collected by the image sensor can be more uniform, and the color effect of the obtained image is better.

在一种可能的实现方式中，上述图像传感器中的多个像素单元行包括：多个第一像素单元行、多个第二像素单元行及多个第三像素单元行。第一像素单元行包括：多个白色像素单元和多个第一彩色像素单元，在第一像素单元行中，相邻两个第一彩色像素单元之间间隔三个白色像素单元，第二像素单元行包括：多个白色像素单元和多个第二彩色像素单元，在第二像素单元行中，相邻两个第二彩色像素单元之间间隔三个白色像素单元，第三像素单元行包括：多个白色像素单元和多个第三彩色像素单元，在第三像素单元行中，相邻两个第三彩色像素单元之间间隔三个白色像素单元。在多个第一像素单元行中，相对于第m个第一像素单元行中的各像素单元，第m+1个第一像素单元行中的各像素单元，沿水平方向错位半个像素单元的距离；其中，第m+1个第一像素单元行为第m个第一像素单元行在竖直方向上的下一个第一像素单元行，其中，m为大于零且小于第一像素单元行的总数量的正整数。在多个第二像素单元行中，相对于第n个第二像素单元行中的各像素单元，第n+1个第二像素单元行中的各像素单元，沿水平方向错位半个像素单元的距离；其中，第n+1个第二像素单元行为第n个第二像素单元行在竖直方向上的下一个第二像素单元行，其中，n为大于零且小于第二像素单元行的总数量的正整数。在多个第三像素单元行中，相对于第k个第三像素单元行中的各像素单元，第k+1个第三像素单元行中的各像素单元，沿水平方向错位半个像素单元的距离；其中，第k+1个第三像素单元行为第k个第三像素单元行在竖直方向上的下一个第三像素单元行，其中，k为大于零且小于第三像素单元行的总数量的正整数。采用这样的像素单元排布方式，第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的数量比值约为1:1:1，并且，第一彩色像素单元、第二彩色像素单元和第三彩色像素单元均匀分布，从而，可以使图像传感器采集的图像的彩色信息较均匀，得到的图像的色彩效果较好。并且，该像素单元排布方式中白色像素单元的数量较多，且白色像素单元均匀分布，从而使图像传感器获取的图像的亮度较高，且该图像的亮度较均匀，因此，该图像的清晰度较高。In a possible implementation manner, the plurality of pixel unit rows in the image sensor includes: a plurality of first pixel unit rows, a plurality of second pixel unit rows, and a plurality of third pixel unit rows. The first pixel unit row includes: a plurality of white pixel units and a plurality of first color pixel units, in the first pixel unit row, three white pixel units are separated between two adjacent first color pixel units, and the second pixel unit The unit row includes: a plurality of white pixel units and a plurality of second color pixel units, in the second pixel unit row, three white pixel units are separated between two adjacent second color pixel units, and the third pixel unit row includes : a plurality of white pixel units and a plurality of third color pixel units, in the third pixel unit row, three white pixel units are separated between two adjacent third color pixel units. Among the plurality of first pixel unit rows, relative to each pixel unit in the m-th first pixel unit row, each pixel unit in the (m+1)-th first pixel unit row is displaced by half a pixel unit in the horizontal direction distance; wherein, the m+1th first pixel unit row is the next first pixel unit row in the vertical direction of the mth first pixel unit row, where m is greater than zero and less than the first pixel unit row A positive integer of the total number of . Among the plurality of second pixel unit rows, relative to each pixel unit in the nth second pixel unit row, each pixel unit in the (n+1)th second pixel unit row is displaced by half a pixel unit in the horizontal direction distance; wherein, the n+1th second pixel unit row is the next second pixel unit row in the vertical direction of the nth second pixel unit row, where n is greater than zero and less than the second pixel unit row A positive integer of the total number of . Among the plurality of third pixel unit rows, relative to each pixel unit in the kth third pixel unit row, each pixel unit in the k+1th third pixel unit row is displaced by half a pixel unit in the horizontal direction distance; wherein, the k+1th third pixel unit row is the next third pixel unit row in the vertical direction of the kth third pixel unit row, where k is greater than zero and less than the third pixel unit row A positive integer of the total number of . With such an arrangement of pixel units, the number ratio of the first color pixel unit, the second color pixel unit, and the third color pixel unit is about 1:1:1, and the first color pixel unit, the second color pixel unit and the third color pixel units are evenly distributed, so that the color information of the image collected by the image sensor can be more uniform, and the color effect of the obtained image is better. Moreover, the number of white pixel units in the pixel unit arrangement is large, and the white pixel units are evenly distributed, so that the brightness of the image acquired by the image sensor is relatively high, and the brightness of the image is relatively uniform, so the clarity of the image higher degree.

本申请实施例中，以像素单元的形状为六边形或矩形为例进行举例，在具体实施时，像素单元也可以为其他形状，例如八边形，此处不做限定。In the embodiment of the present application, the shape of the pixel unit is hexagonal or rectangular as an example. In actual implementation, the pixel unit may also be in other shapes, such as octagonal, which is not limited here.

在一种可能的实现方式中，上述图像传感器中的每一个像素单元包括：光电转换器，位于光电转换器的感光面一侧的滤光层，以及位于滤光层背离光电转换器一侧的透镜。在图像采集的过程中，入射光射向透镜，该入射光可以为被拍摄目标的反射光，透镜用于汇聚入射光，并将汇聚后的光线射向滤光层。通过设置透镜可以提升图像传感器的光接收量和光信号强度。滤光层可以对光线进行过滤，从而，将光线按照滤光层的颜色进行区分，使得环境光和图像信息分别按照不同颜色进行存储，便于后续图像处理过程中的彩色信息还原。光电转换器可以为光电二极管等感光器件，光电转换器用于将穿过滤光层后的入射光转换为电信号，从而实现图像信息的存储。In a possible implementation manner, each pixel unit in the image sensor includes: a photoelectric converter, a filter layer on the side of the photosensitive surface of the photoelectric converter, and a filter layer on the side away from the photoelectric converter. lens. In the process of image acquisition, the incident light is incident on the lens, and the incident light may be the reflected light of the object to be photographed. The lens is used to converge the incident light, and direct the converged light to the filter layer. The amount of light received by the image sensor and the intensity of light signals can be increased by setting the lens. The filter layer can filter the light, thereby distinguishing the light according to the color of the filter layer, so that the ambient light and image information are stored in different colors, which facilitates the restoration of color information in the subsequent image processing process. The photoelectric converter can be a photosensitive device such as a photodiode, and the photoelectric converter is used to convert the incident light after passing through the filter layer into an electrical signal, so as to realize the storage of image information.

在本申请实施例中，图像传感器中的多个像素单元包括：多个白色像素单元、多个第一彩色像素单元、多个第二彩色像素单元及多个第三彩色像素单元；白色像素单元中的滤光层为透明滤光层，第一彩色像素单元中的滤光层用于滤除第一颜色外的光线，第二彩色像素单元中的滤光层用于滤除第二颜色外的光线，第三彩色像素单元中的滤光层用于滤除第三颜色外的光线。In the embodiment of the present application, the plurality of pixel units in the image sensor includes: a plurality of white pixel units, a plurality of first color pixel units, a plurality of second color pixel units, and a plurality of third color pixel units; the white pixel unit The filter layer in is a transparent filter layer, the filter layer in the first color pixel unit is used to filter out the light of the first color, and the filter layer in the second color pixel unit is used to filter out the light of the second color light, the filter layer in the third color pixel unit is used to filter out the light of the third color.

在一种可能的实现方式中，上述像素单元还可以包括：传输晶体管、复位晶体管、源跟随晶体管以及行选择晶体管。传输晶体管的源极与光电转换器电连接，传输晶体管的漏极通过浮动扩散节点与复位晶体管的源极电连接，复位晶体管的漏极与电源信号线电连接，源跟随晶体管的栅极与浮动扩散节点电连接，源跟随晶体管的源极与电源信号线电连接，行选择晶体管的源极与源跟随晶体管的漏极电连接，行选择晶体管的漏极与信号输出端电连接。在图像采集过程中，光电转换器可以将接收到的光线转换为电荷，传输晶体管可以控制光电转换器是否将电荷传输至浮动扩散节点，当传输晶体管导通时，光电转换器将电荷传输至浮动扩散节点，当传输晶体管关闭时，光电转换器无法将电荷传输至浮动扩散节点，则电荷在光电转换器中积累。复位晶体管可以清空浮动扩散节点和光电转换器中的电荷，即复位晶体管可以复位浮动扩散节点和光电转换器。源跟随晶体管可以将浮动扩散节点的电荷转换为电压。每一个像素单元行中的各像素单元中的行选择晶体管与同一条控制信号线电连接，该控制信号线的作用是选通对应像素单元中的行选择晶体管，当该控制信号线控制该像素单元行中的行选择晶体管导通时，则电压从源跟随晶体管传输至输出端，当该控制信号线控制该像素单元行中的行选择晶体管关闭时，则该像素单元行中的像素单元不选通，该像素单元行中的各像素单元无法输出图像信号。In a possible implementation manner, the above pixel unit may further include: a transfer transistor, a reset transistor, a source follower transistor, and a row selection transistor. The source of the transfer transistor is electrically connected to the photoelectric converter, the drain of the transfer transistor is electrically connected to the source of the reset transistor through the floating diffusion node, the drain of the reset transistor is electrically connected to the power signal line, and the gate of the source follower transistor is connected to the floating The diffusion node is electrically connected, the source of the source follower transistor is electrically connected to the power signal line, the source of the row selection transistor is electrically connected to the drain of the source follower transistor, and the drain of the row selection transistor is electrically connected to the signal output terminal. During the image acquisition process, the photoelectric converter can convert the received light into electric charge, and the transfer transistor can control whether the photoelectric converter transfers the charge to the floating diffusion node. When the transfer transistor is turned on, the photoelectric converter transfers the charge to the floating diffusion node. Diffusion node, when the transfer transistor is off, the photoelectric converter cannot transfer charge to the floating diffusion node, and charge accumulates in the photoelectric converter. The reset transistor can empty the charge in the floating diffusion node and the photoelectric converter, that is, the reset transistor can reset the floating diffusion node and the photoelectric converter. A source-follower transistor can convert the charge on a floating diffusion node into a voltage. The row selection transistors in each pixel unit in each pixel unit row are electrically connected to the same control signal line. The function of the control signal line is to gate the row selection transistor in the corresponding pixel unit. When the control signal line controls the pixel When the row selection transistor in the cell row is turned on, the voltage is transmitted from the source follower transistor to the output terminal, and when the control signal line controls the row selection transistor in the pixel cell row to be turned off, the pixel cells in the pixel cell row are not Each pixel unit in the pixel unit row cannot output an image signal.

在一种可能的实现方式中，像素单元内设有半导体层，半导体层包括：光电传感器的 PN结、传输晶体管的有源层、复位晶体管的有源层、源跟随晶体管的有源层及行选择晶体管的有源层。此外，为了形成晶体管结构，像素单元内还可以设置栅极层，栅极层包括各晶体管的栅极。白色像素单元中浮动扩散节点的面积，大于第一彩色像素单元、第二彩色像素单元和第三彩色像素单元中浮动扩散节点的面积；其中，浮动扩散节点的面积为半导体层中传输晶体管的有源层与复位晶体管的有源层之间的区域的面积。通过调整像素单元的浮动扩散节点的面积，增大了第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的灵敏度，可以使第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的灵敏度，接近白色像素单元的灵敏度，防止设置白色像素单元后出现色彩偏淡的问题，改善图像的颜色效果。In a possible implementation, a semiconductor layer is provided in the pixel unit, and the semiconductor layer includes: the PN junction of the photosensor, the active layer of the transfer transistor, the active layer of the reset transistor, the active layer of the source follower transistor, and the row Select the active layer of the transistor. In addition, in order to form a transistor structure, a gate layer may also be provided in the pixel unit, and the gate layer includes the gates of each transistor. The area of the floating diffusion node in the white pixel unit is larger than the area of the floating diffusion node in the first color pixel unit, the second color pixel unit and the third color pixel unit; wherein, the area of the floating diffusion node is equal to the area of the transfer transistor in the semiconductor layer The area of the region between the source layer and the active layer of the reset transistor. By adjusting the area of the floating diffusion node of the pixel unit, the sensitivity of the first color pixel unit, the second color pixel unit and the third color pixel unit can be increased, and the first color pixel unit, the second color pixel unit and the third color pixel unit can be made The sensitivity of the color pixel unit is close to the sensitivity of the white pixel unit, which prevents the problem of light color after setting the white pixel unit, and improves the color effect of the image.

在一种可能的实现方式中，第一彩色像素单元、第二彩色像素单元和第三彩色像素单元中的透镜的面积，均大于白色像素单元中的透镜的面积。第一彩色像素单元、第二彩色像素单元和第三彩色像素单元中的滤光层的面积，均大于白色像素单元中的滤光层的面积。通过增大第一彩色像素单元、第二彩色像素单元和第三彩色像素单元中透镜和滤光层的面积，或者减小白色像素单元中透镜和滤光层的面积，可以提升第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的灵敏度，并使白色像素单元的灵敏度略微减小，从而提高图像分辨率的基础上，进一步提高了图像的色彩效果。In a possible implementation manner, the areas of the lenses in the first color pixel unit, the second color pixel unit and the third color pixel unit are all larger than the areas of the lenses in the white pixel unit. The area of the filter layer in the first color pixel unit, the second color pixel unit and the third color pixel unit is larger than the area of the filter layer in the white pixel unit. By increasing the area of the lens and filter layer in the first color pixel unit, the second color pixel unit and the third color pixel unit, or reducing the area of the lens and filter layer in the white pixel unit, the first color pixel can be improved. unit, the sensitivity of the second color pixel unit and the third color pixel unit, and slightly reduce the sensitivity of the white pixel unit, so as to improve the image resolution and further improve the color effect of the image.

在一种可能的实现方式中，白色像素单元中的光电转换器的面积，大于第一彩色像素单元、第二彩色像素单元和第三彩色像素单元中的光电转换器的面积。其中，各像素单元中光电转换器的面积可以理解为光电转换器的PN结的面积。通过增大白色像素单元中光电转换器的面积，例如可以增大为1～4倍，减小第一彩色像素单元、第二彩色像素单元、第三彩色像素单元中光电转换器的面积，可以使得白色像素单元的满阱容量增加，白色像素单元更晚进入饱和，而第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的输出值可以继续增长，达到很高的输出值，从而提升了第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的输出值，防止出现图像色彩偏淡的问题，在提高图像分辨率的基础上，进一步提高了图像的色彩效果。In a possible implementation manner, the area of the photoelectric converter in the white pixel unit is larger than the area of the photoelectric converter in the first color pixel unit, the second color pixel unit and the third color pixel unit. Wherein, the area of the photoelectric converter in each pixel unit can be understood as the area of the PN junction of the photoelectric converter. By increasing the area of the photoelectric converter in the white pixel unit, for example, it can be increased by 1 to 4 times, and the area of the photoelectric converter in the first color pixel unit, the second color pixel unit, and the third color pixel unit can be reduced. The full well capacity of the white pixel unit increases, and the white pixel unit enters saturation later, while the output values of the first color pixel unit, the second color pixel unit, and the third color pixel unit can continue to grow, reaching a very high output value, Thus, the output values of the first color pixel unit, the second color pixel unit, and the third color pixel unit are improved, the problem of light color of the image is prevented, and the color effect of the image is further improved on the basis of improving the image resolution.

在本申请的另一实现方式中，上述光电转换器为光电二极管，白色像素单元中的光电二极管中的N型半导体杂质注入浓度，大于第一彩色像素单元、第二彩色像素单元和第三彩色像素单元中的光电二极管中的N型半导体杂质注入浓度。通过增加白色像素单元中的光电二极管中的N型半导体杂质注入浓度，例如，可以增大为1～4倍，浓度范围可以为每平方厘米1e11至1e13个原子，杂质类型可以为磷原子或砷原子，也可以提升了白色像素单元的满阱容量，使白色像素单元更晚进入饱和，而第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的输出值可以继续增长，达到很高的输出值，从而提升了第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的输出值，防止出现图像色彩偏淡的问题，在提高图像分辨率的基础上，进一步提高了图像的色彩效果。In another implementation of the present application, the above-mentioned photoelectric converter is a photodiode, and the implantation concentration of N-type semiconductor impurities in the photodiode in the white pixel unit is greater than that of the first color pixel unit, the second color pixel unit, and the third color pixel unit. Implantation concentration of N-type semiconductor impurities in the photodiode in the pixel unit. By increasing the N-type semiconductor impurity implantation concentration in the photodiode in the white pixel unit, for example, it can be increased by 1 to 4 times, the concentration range can be 1e11 to 1e13 atoms per square centimeter, and the impurity type can be phosphorus atoms or arsenic Atoms can also increase the full well capacity of the white pixel unit, so that the white pixel unit enters saturation later, while the output values of the first color pixel unit, the second color pixel unit, and the third color pixel unit can continue to grow, reaching a very high level. High output value, thereby improving the output value of the first color pixel unit, the second color pixel unit, and the third color pixel unit, preventing the problem of light color of the image, and further improving the image resolution on the basis of The color effect of the image.

此外，在本申请实施例中，上述图像传感器还可以包括：图像处理模块；In addition, in the embodiment of the present application, the above-mentioned image sensor may further include: an image processing module;

图像处理模块用于：获取多个像素单元接收到的第一图像信息；根据第一图像信息确定各白色像素单元的白色输出值、各第一彩色像素单元的第一彩色输出值、各第二彩色像素单元的第二彩色输出值以及各第三彩色图像的第三彩色输出值，以得到第二图像信息；根据第二图像信息形成多个虚拟像素单元，并确定各虚拟像素单元的输出值，以得到第三图像信息。The image processing module is used to: obtain the first image information received by a plurality of pixel units; determine the white output value of each white pixel unit, the first color output value of each first color pixel unit, and each second color output value according to the first image information. The second color output value of the color pixel unit and the third color output value of each third color image to obtain the second image information; form a plurality of virtual pixel units according to the second image information, and determine the output value of each virtual pixel unit , to get the third image information.

本申请实施例中，由于图像传感器中设有白色像素单元，增加了图像传感器的入光量，在图像处理过程中，可以将各白色像素单元的白色输出值作为图像的亮度信息，从而使图像处理得到的图像的亮度较高。并且，通过计算虚拟像素单元，并确定各虚拟像素单元的输出值，可以提升图像的分辨率，从而使图像的质量较高。In the embodiment of the present application, since the image sensor is provided with white pixel units, which increases the amount of light incident on the image sensor, in the image processing process, the white output value of each white pixel unit can be used as the brightness information of the image, so that the image processing The brightness of the resulting image is higher. Moreover, by calculating the virtual pixel units and determining the output value of each virtual pixel unit, the resolution of the image can be improved, so that the quality of the image is higher.

在一种可能的实现方式中，上述图像处理模块，可以具体用于：In a possible implementation, the above image processing module may be specifically used for:

在第一图像信息中提取各白色像素单元的白色输出值，对于除各白色像素单元外的每一个第一缺失像素单元，采用第一缺失像素单元周围的各白色输出值的平均值作为该第一缺失像素单元的白色输出值，以得到所有像素单元的白色输出值；Extract the white output value of each white pixel unit in the first image information, and for each first missing pixel unit except each white pixel unit, adopt the average value of each white output value around the first missing pixel unit as the first missing pixel unit A white output value of missing pixel units to obtain white output values of all pixel units;

在第一图像信息中提取第一彩色像素单元的第一彩色输出值，将每一个第一彩色像素单元的第一彩色输出值作为周围各第二缺失像素单元的第一彩色输出值，以得到所有像素单元的第一彩色输出值，其中，第二缺失像素单元为除各第一彩色像素单元外的像素单元；The first color output value of the first color pixel unit is extracted from the first image information, and the first color output value of each first color pixel unit is used as the first color output value of each second missing pixel unit around, to obtain The first color output values of all pixel units, wherein the second missing pixel unit is a pixel unit other than each first color pixel unit;

在第一图像信息中提取第二彩色像素单元的第二彩色输出值，将每一个第二彩色像素单元的第二彩色输出值作为周围各第三缺失像素单元的第二彩色输出值，以得到所有像素单元的第二彩色输出值，其中，第三缺失像素单元为除各第二彩色像素单元外的像素单元；The second color output value of the second color pixel unit is extracted from the first image information, and the second color output value of each second color pixel unit is used as the second color output value of each third missing pixel unit around, to obtain Second color output values of all pixel units, wherein the third missing pixel unit is a pixel unit except each second color pixel unit;

在第一图像信息中提取第三彩色像素单元的第三彩色输出值，将每一个第三彩色像素单元的第三彩色输出值作为周围各第四缺失像素单元的第三彩色输出值，以得到所有像素单元的第三彩色输出值，其中，第四缺失像素单元为除各第二彩色像素单元外的像素单元；The third color output value of the third color pixel unit is extracted from the first image information, and the third color output value of each third color pixel unit is used as the third color output value of each fourth missing pixel unit around, to obtain The third color output values of all pixel units, wherein, the fourth missing pixel unit is a pixel unit except each second color pixel unit;

将所有像素单元的白色输出值、第一彩色输出值、第二彩色输出值及第三彩色输出值进行融合，得到第二图像信息。The white output value, the first color output value, the second color output value and the third color output value of all pixel units are fused to obtain the second image information.

多个虚拟像素单元分别排布于像素单元行和像素单元列中，虚拟像素单元的输出值为周围的各像素单元的输出值的平均值；其中，像素单元的输出值为白色输出值、第一彩色输出值、第二彩色输出值或第三彩色输出值。A plurality of virtual pixel units are respectively arranged in the pixel unit row and the pixel unit column, and the output value of the virtual pixel unit is the average value of the output values of the surrounding pixel units; wherein, the output value of the pixel unit is the white output value, the first A color output value, a second color output value or a third color output value.

本申请实施例中，上述图像传感器的图像分辨率大于上述多个像素单元的总数量。其中，上述图像传感器中的上述多个像素单元为物理像素。本申请实施例中，通过图像处理模块计算虚拟像素单元，并确定各虚拟像素单元的输出值，可以提升图像分辨率，从而使图像的质量较高。In the embodiment of the present application, the image resolution of the above-mentioned image sensor is greater than the total number of the above-mentioned plurality of pixel units. Wherein, the plurality of pixel units in the image sensor are physical pixels. In the embodiment of the present application, the image processing module calculates the virtual pixel units and determines the output value of each virtual pixel unit, so that the image resolution can be improved, so that the image quality is higher.

第二方面，本申请实施例还提供了一种摄像头模组，该摄像头模组可以包括：镜头模组，以及上述任一图像传感器。其中，镜头模组用于接收入射光，并将入射光传输至图像传感器。In a second aspect, the embodiment of the present application further provides a camera module, which may include: a lens module, and any one of the above-mentioned image sensors. Wherein, the lens module is used to receive incident light and transmit the incident light to the image sensor.

上述图像传感器中，通过设有多个白色像素单元，可以提高图像传感器的入光量，提升图像传感器获取的图像的亮度，尤其可以提升图像传感器在低照度下的灵敏度，从而可以改善图像传感器获取的图像的质量。并且，将多个像素单元排列的比较紧凑，使得图像采集器获取的图像的分辨率较高。因而，本申请实施例中的摄像头模组拍摄的图像的画质较好。In the above-mentioned image sensor, by providing a plurality of white pixel units, the amount of light incident on the image sensor can be increased, the brightness of the image acquired by the image sensor can be improved, especially the sensitivity of the image sensor under low illumination can be improved, thereby improving the brightness of the image sensor. Image quality. Moreover, the arrangement of multiple pixel units is relatively compact, so that the resolution of the image acquired by the image collector is relatively high. Therefore, the image quality of the image captured by the camera module in the embodiment of the present application is better.

第三方面，本申请实施例还提供了一种电子设备，该电子设备可以包括：电源，以及与电源电连接的上述任一摄像头模组。由于上述摄像头模组拍摄的图像的画质较好，可以使本申请实施例中的电子设备的用户体验较好。该电子设备可以为手机、电脑、数码相机等各种类型的设备。In a third aspect, the embodiment of the present application further provides an electronic device, which may include: a power supply, and any one of the above camera modules electrically connected to the power supply. Since the picture quality of the image captured by the above-mentioned camera module is better, the user experience of the electronic device in the embodiment of the present application can be better. The electronic device may be various types of devices such as a mobile phone, a computer, and a digital camera.

第四方面，本申请实施例还提供了上述任一图像传感器的图像处理方法，该图像处理方法可以包括：In a fourth aspect, the embodiment of the present application also provides an image processing method for any of the above image sensors, the image processing method may include:

获取图像传感器接收到的第一图像信息；Acquiring first image information received by the image sensor;

根据第一图像信息确定各白色像素单元的白色输出值、各第一彩色像素单元的第一彩色输出值、各第二彩色像素单元的第二彩色输出值以及各第三彩色图像的第三彩色输出值，以得到第二图像信息；Determine the white output value of each white pixel unit, the first color output value of each first color pixel unit, the second color output value of each second color pixel unit, and the third color of each third color image according to the first image information Output a value to obtain the second image information;

根据第二图像信息形成多个虚拟像素单元，并确定各虚拟像素单元的输出值，以得到第三图像信息。A plurality of virtual pixel units are formed according to the second image information, and an output value of each virtual pixel unit is determined to obtain third image information.

在一种可能的实现方式中，上述根据第一图像信息确定各白色像素单元的白色输出值、各第一彩色像素单元的第一彩色输出值、各第二彩色像素单元的第二彩色输出值以及各第三彩色图像的第三彩色输出值，以得到第二图像信息，可以包括：In a possible implementation manner, the white output value of each white pixel unit, the first color output value of each first color pixel unit, and the second color output value of each second color pixel unit are determined according to the first image information. And the third color output value of each third color image, to obtain the second image information, may include:

在一种可能的实现方式中，上述根据第二图像信息形成多个虚拟像素单元，并确定各虚拟像素单元的输出值，以得到第三图像信息，可以包括：In a possible implementation manner, the above-mentioned forming a plurality of virtual pixel units according to the second image information, and determining the output value of each virtual pixel unit to obtain the third image information may include:

附图说明Description of drawings

图1为本申请实施例中的一种图像传感器的结构示意图；FIG. 1 is a schematic structural diagram of an image sensor in an embodiment of the present application;

图2a为本申请实施例提供的图像传感器中像素单元的另一排布示意图；FIG. 2a is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application;

图2b为图2a中靠下的三行像素单元的局部放大示意图；Fig. 2b is a partially enlarged schematic diagram of the lower three rows of pixel units in Fig. 2a;

图3为本申请实施例中一个像素单元的放大示意图；FIG. 3 is an enlarged schematic diagram of a pixel unit in the embodiment of the present application;

图4为本申请实施例提供的图像传感器中像素单元的另一排布示意图；FIG. 4 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application;

图5为本申请实施例提供的图像传感器中像素单元的另一排布示意图；FIG. 5 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application;

图6为本申请实施例提供的图像传感器中像素单元的另一排布示意图；FIG. 6 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application;

图7为本申请实施例提供的图像传感器中像素单元的另一排布示意图；FIG. 7 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application;

图8为本申请实施例提供的图像传感器中像素单元的排布示意图；FIG. 8 is a schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application;

图9为相关技术中的像素单元排布方式与本申请实施例中的像素单元排布方式的对比示意图；FIG. 9 is a schematic diagram of a comparison between the arrangement of pixel units in the related art and the arrangement of pixel units in the embodiment of the present application;

图10为本申请实施例提供的图像传感器中像素单元的另一排布示意图；FIG. 10 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application;

图11为本申请实施例提供的图像传感器中像素单元的另一排布示意图；FIG. 11 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application;

图12为本申请实施例提供的图像传感器中像素单元的另一排布示意图；FIG. 12 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application;

图13为本申请实施例提供的图像传感器中像素单元的另一排布示意图；FIG. 13 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application;

图14为本申请实施例中的像素单元电路的结构示意图；FIG. 14 is a schematic structural diagram of a pixel unit circuit in an embodiment of the present application;

图15为本申请实施例中图像传感器中像素单元版图的结构示意图；FIG. 15 is a schematic structural diagram of a pixel unit layout in an image sensor in an embodiment of the present application;

图16为本申请实施例中图像传感器中像素单元版图的另一结构示意图；FIG. 16 is another structural schematic diagram of the pixel unit layout in the image sensor in the embodiment of the present application;

图17为本申请实施例中图像传感器中像素单元版图的另一结构示意图；FIG. 17 is another structural schematic diagram of the pixel unit layout in the image sensor in the embodiment of the present application;

图18为本申请实施例中图像传感器中像素单元版图的另一结构示意图；FIG. 18 is another structural schematic diagram of the pixel unit layout in the image sensor in the embodiment of the present application;

图19为图15中一个像素单元的局部放大示意图；FIG. 19 is a partially enlarged schematic diagram of a pixel unit in FIG. 15;

图20为像素单元的输出值与曝光时间的关系曲线示意图；FIG. 20 is a schematic diagram of the relationship curve between the output value of the pixel unit and the exposure time;

图21为本申请实施例中图像传感器的另一结构示意图；FIG. 21 is another schematic structural diagram of the image sensor in the embodiment of the present application;

图22为与图21对应的图像传感器的平面结构示意图；FIG. 22 is a schematic plan view of the image sensor corresponding to FIG. 21;

图23为调整像素单元的透镜和滤光层的面积的前后对比示意图；23 is a schematic diagram of before and after adjusting the area of the lens and the filter layer of the pixel unit;

图24为与图21对应的图像传感器的另一平面结构示意图；FIG. 24 is a schematic diagram of another planar structure of the image sensor corresponding to FIG. 21;

图25为与图21对应的图像传感器的另一平面结构示意图；FIG. 25 is a schematic diagram of another planar structure of the image sensor corresponding to FIG. 21;

图26为本申请实施例中图像传感器的另一结构示意图；FIG. 26 is another structural schematic diagram of the image sensor in the embodiment of the present application;

图27为与图26对应的图像传感器的平面结构示意图；FIG. 27 is a schematic plan view of the image sensor corresponding to FIG. 26;

图28为像素单元的输出值与曝光时间的关系曲线示意图；Fig. 28 is a schematic diagram of the relationship curve between the output value of the pixel unit and the exposure time;

图29为本申请实施例提供的图像处理方法的流程图；FIG. 29 is a flow chart of the image processing method provided by the embodiment of the present application;

图30为本申请实施例提供的图像处理方法的另一流程图；FIG. 30 is another flow chart of the image processing method provided by the embodiment of the present application;

图31a至图31c为采用上述实现方式一中的像素单元排布方式时确定第二图像信息的过程示意图；31a to 31c are schematic diagrams of the process of determining the second image information when the arrangement of pixel units in the above-mentioned implementation mode 1 is adopted;

图32a至图32c为采用上述实现方式二中的像素单元排布方式时确定第二图像信息的过程示意图；32a to 32c are schematic diagrams of the process of determining the second image information when the arrangement of pixel units in the second implementation mode is adopted;

图33为在上述实现方式一中的像素单元排布方式中形成多个虚拟像素单元的示意图；FIG. 33 is a schematic diagram of forming a plurality of virtual pixel units in the arrangement of pixel units in the first implementation mode;

图34为在上述实现方式二中的像素单元排布方式中形成多个虚拟像素单元的示意图。FIG. 34 is a schematic diagram of forming a plurality of virtual pixel units in the arrangement of pixel units in the second implementation manner.

附图标记：Reference signs:

101-光电转换器；102-滤光层；103-透镜；104-输出总线；105-第一控制信号线；106-第二控制信号线；107-第三控制信号线；P-像素单元；Pw-白色像素单元；P1-第一彩色像素单元；P2-第二彩色像素单元；P3-第三彩色像素单元；Px1-第一缺失像素单元；Px2-第二缺失像素单元；Py-虚拟像素单元；F1-水平方向；F2-竖直方向；TX-传输晶体管；RST-复位晶体管；SF-源跟随晶体管；SEL-行选择晶体管；FD-浮动扩散节点；Ot-输出端。101-photoelectric converter; 102-filter layer; 103-lens; 104-output bus; 105-first control signal line; 106-second control signal line; 107-third control signal line; P-pixel unit; Pw-white pixel unit; P1-first color pixel unit; P2-second color pixel unit; P3-third color pixel unit; Px1-first missing pixel unit; Px2-second missing pixel unit; Py-dummy pixel Unit; F1-horizontal direction; F2-vertical direction; TX-transfer transistor; RST-reset transistor; SF-source follower transistor; SEL-row selection transistor; FD-floating diffusion node; Ot-output terminal.

具体实施方式Detailed ways

为了使本申请的目的、技术方案和优点更加清楚，下面将结合附图对本申请作进一步地详细描述。In order to make the purpose, technical solution and advantages of the application clearer, the application will be further described in detail below in conjunction with the accompanying drawings.

应注意的是，本申请的附图中相同的附图标记表示相同或类似的结构，因而将省略对它们的重复描述。本申请中所描述的表达位置与方向的词，均是以附图为例进行的说明，但根据需要也可以做出改变，所做改变均包含在本申请保护范围内。本申请的附图仅用于示意相对位置关系不代表真实比例。It should be noted that the same reference numerals in the drawings of the present application denote the same or similar structures, and thus repeated descriptions thereof will be omitted. The words expressing position and direction described in this application are all described by taking the accompanying drawings as an example, but changes can also be made according to needs, and all changes are included in the protection scope of this application. The drawings in this application are only used to illustrate the relative positional relationship and do not represent the true scale.

本申请实施例提供的图像传感器可以应用于各种摄像头模组中，例如可以应用于照相机、摄像头及安防监控器等摄像设备中。该图像传感器可以为以电耦合器件(charge coupled device，CCD)构成的CCD图像传感器，或以互补金属氧化物半导体(complementary metal oxide semiconductor，CMOS)构成的CMOS图像传感器。该图像传感器的结构可以为正照式结构，或者，该图像传感器的结构也可以为被照式结构。The image sensor provided by the embodiment of the present application can be applied to various camera modules, for example, it can be applied to camera equipment such as cameras, video cameras, and security monitors. The image sensor may be a CCD image sensor composed of a charge coupled device (CCD), or a CMOS image sensor composed of a complementary metal oxide semiconductor (CMOS). The structure of the image sensor may be a front-illuminated structure, or the structure of the image sensor may also be an illuminated structure.

图1为本申请实施例中的一种图像传感器的结构示意图，如图1所示，本申请实施例中的图像传感器可以包括多个像素单元P，每一个像素单元P可以包括：光电转换器101，位于光电转换器101的感光面一侧的滤光层102，以及位于滤光层102背离光电转换器一侧的透镜103，其中，该透镜103可以为微透镜。在图像采集的过程中，入射光S1射向透镜103，该入射光S1可以为被拍摄目标的反射光，透镜103用于汇聚入射光S1，并将汇聚后的光线S2射向滤光层102。通过设置透镜103可以提升图像传感器的光接收量和光信号强度。滤光层102可以对光线S2进行过滤，从而，将光线S2按照滤光层102的颜色进行区分，使得环境光和图像信息分别按照不同颜色进行存储，便于后续图像处理过程中的彩色信息还原。光电转换器101用于将穿过滤光层102后的入射光转换为电信号，从而实现图像信息的存储。Fig. 1 is a schematic structural diagram of an image sensor in the embodiment of the present application. As shown in Fig. 1, the image sensor in the embodiment of the present application may include a plurality of pixel units P, and each pixel unit P may include: a photoelectric converter 101, a filter layer 102 located on the photosensitive surface side of the photoelectric converter 101, and a lens 103 located on the side of the filter layer 102 away from the photoelectric converter, wherein the lens 103 may be a micro lens. In the process of image acquisition, the incident light S1 is incident on the lens 103, the incident light S1 may be the reflected light of the object to be photographed, the lens 103 is used to converge the incident light S1, and direct the converged light S2 to the filter layer 102 . The amount of light received by the image sensor and the intensity of light signals can be improved by setting the lens 103 . The filter layer 102 can filter the light S2, thereby distinguishing the light S2 according to the color of the filter layer 102, so that the ambient light and image information are stored in different colors, which facilitates the restoration of color information in the subsequent image processing process. The photoelectric converter 101 is used to convert the incident light passing through the filter layer 102 into electrical signals, so as to realize the storage of image information.

下面结合附图对本申请提供的图像传感器、摄像头模组、电子设备及图像处理方法进行详细说明。The image sensor, camera module, electronic equipment and image processing method provided by the present application will be described in detail below with reference to the accompanying drawings.

第一方面，本申请实施例提供了一种图像传感器。图2a为本申请实施例提供的图像传感器中像素单元的排布示意图，如图2a所示，本申请实施例提供的图像传感器可以包括：沿水平方向F1和竖直方向F2呈阵列排布的多个像素单元(图2a中每一个六边形表示一个像素单元)，水平方向F1与竖直方向F2可以相互垂直，当然，水平方向F1与竖直方向F2之间的夹角也可以稍大于或稍小于90°，此处不做限定。图2b为图2a中靠下的三行像素单元的局部放大示意图，结合图2a和图2b，图中粗直线J表示图像传感器的一个边缘，在具体实施时，水平方向F1可以与图像传感器的边缘J的方向一致。In a first aspect, the embodiment of the present application provides an image sensor. Figure 2a is a schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application. As shown in Figure 2a, the image sensor provided by the embodiment of the present application may include: arrays arranged in the horizontal direction F1 and the vertical direction F2 Multiple pixel units (each hexagon in Figure 2a represents a pixel unit), the horizontal direction F1 and the vertical direction F2 can be perpendicular to each other, of course, the angle between the horizontal direction F1 and the vertical direction F2 can also be slightly larger than Or slightly less than 90°, which is not limited here. Fig. 2b is a partially enlarged schematic diagram of the lower three rows of pixel units in Fig. 2a. Combining Fig. 2a and Fig. 2b, the thick line J in the figure represents an edge of the image sensor. In specific implementation, the horizontal direction F1 can be aligned with the image sensor Edge J is in the same direction.

上述图像传感器中的多个像素单元可以包括：多个白色像素单元Pw、多个第一彩色像素单元P1、多个第二彩色像素单元P2及多个第三彩色像素单元P3。图中以白色填充表示白色像素单元Pw，“R”表示第一彩色像素单元P1，“G”表示第二彩色像素单元P2，“B”表示第三彩色像素单元P3。其中，白色像素单元Pw中的滤光层为透明滤光层，第一彩色像素单元P1中的滤光层用于滤除第一颜色外的光线，第二彩色像素单元P2中的滤光层用于滤除第二颜色外的光线，第三彩色像素单元P3中的滤光层用于滤除第三颜色外的光线。可选地，第一彩色像素单元P1可以为红色像素单元，第二彩色像素单元P2可以为绿色像素单元，第三彩色像素单元P3可以为蓝色像素单元；或者，第一彩色像素单元P1可以为品红色像素单元，第二彩色像素单元P2可以为黄色像素单元，第三彩色像素单元P3可以为青色像素单元。当然，第一彩色像素单元P1、第二彩色像素单元P2、第三彩色像素单元P3也可以为其他颜色的像素单元，此处不做限定。The plurality of pixel units in the image sensor may include: a plurality of white pixel units Pw, a plurality of first color pixel units P1, a plurality of second color pixel units P2, and a plurality of third color pixel units P3. In the figure, white filling represents the white pixel unit Pw, “R” represents the first color pixel unit P1, “G” represents the second color pixel unit P2, and “B” represents the third color pixel unit P3. Wherein, the filter layer in the white pixel unit Pw is a transparent filter layer, the filter layer in the first color pixel unit P1 is used to filter out light rays other than the first color, and the filter layer in the second color pixel unit P2 The filter layer in the third color pixel unit P3 is used to filter out the light of the third color. Optionally, the first color pixel unit P1 may be a red pixel unit, the second color pixel unit P2 may be a green pixel unit, and the third color pixel unit P3 may be a blue pixel unit; or, the first color pixel unit P1 may be The second color pixel unit P2 may be a yellow pixel unit, and the third color pixel unit P3 may be a cyan pixel unit. Of course, the first color pixel unit P1 , the second color pixel unit P2 , and the third color pixel unit P3 may also be pixel units of other colors, which are not limited here.

在图像传感器中的每一个像素单元中，光电转换器接收滤光层过滤后的光线，并将接收到的光信号转换为电信号，该电信号用于后续图像处理得到图像。其中，图像的亮度与光电转换器接收到的光线的多少有关，若光电转换器接收到的光线较少，会导致采集到的图像由于亮度较低而模糊不清。为了采集到被拍摄目标的图像信息，在图像传感器中需要设置第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3。第一彩色像素单元P1中的滤光层只能使第一颜色的光线通过，约三分之二的光线被滤光层吸收，同理，第二彩色像素单元P2和第三彩色像素单元P3中也有约三分之二的光线被滤光层吸收，也就是说，第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3损失了约三分之二的入射光能量。本申请实施例中，在图像传感器中设置白色像素单元Pw，白色像素单元Pw中的滤光层为透明滤光层，因而白色像素单元Pw对光线的损失较小。所以，通过在图像传感器中设置白色像素单元Pw，可以提高图像传感器的光线的入光量，提升图像传感器获取的图像的亮度，尤其可以提升图像传感器在低照度下的灵敏度，从而可以改善图像传感器获取的图像的质量。In each pixel unit of the image sensor, a photoelectric converter receives the light filtered by the filter layer and converts the received light signal into an electrical signal, which is used for subsequent image processing to obtain an image. The brightness of the image is related to the amount of light received by the photoelectric converter. If the photoelectric converter receives less light, the collected image will be blurred due to low brightness. In order to collect the image information of the object to be photographed, a first color pixel unit P1 , a second color pixel unit P2 and a third color pixel unit P3 need to be provided in the image sensor. The filter layer in the first color pixel unit P1 can only pass the light of the first color, and about two-thirds of the light is absorbed by the filter layer. Similarly, the second color pixel unit P2 and the third color pixel unit P3 About two-thirds of the light is absorbed by the filter layer, that is, the first color pixel unit P1, the second color pixel unit P2 and the third color pixel unit P3 lose about two-thirds of the incident light energy . In the embodiment of the present application, a white pixel unit Pw is provided in the image sensor, and the filter layer in the white pixel unit Pw is a transparent filter layer, so the loss of light to the white pixel unit Pw is small. Therefore, by arranging the white pixel unit Pw in the image sensor, the amount of light incident on the image sensor can be increased, the brightness of the image captured by the image sensor can be increased, especially the sensitivity of the image sensor under low illumination can be improved, thereby improving the acquisition of the image sensor. image quality.

继续参照图2a，上述图像传感器中的每一个像素单元的形状为多边形，且每一个像素单元的至少一个边与水平方向F1之间的夹角为锐角。上述图像传感器可以构成多个像素单元行，例如图2a中的图像传感器包括像素单元行H1、H2……H12，每一个像素单元行可以包括沿水平方向F1排列的多个像素单元，并且，任意相邻两个像素单元行错位设置，例如像素单元行H2与像素单元行H1错位半个像素单元。上述图像传感器可以构成多个像素单元列，例如图2a中的图像传感器包括像素单元列L1、L2、L3、L4、L5、L6，每一个像素单元列可以包括沿竖直方向F2排列的多个像素单元，并且，任意相邻两个像素单元列错位设置，例如像素单元列L2与像素单元列L1错位半个像素单元。这样，可以将图像传感器中的多个像素单元排列的更加紧凑，使得图像传感器获取的图像的分辨率较高。Continuing to refer to FIG. 2 a , the shape of each pixel unit in the image sensor is polygonal, and the angle between at least one side of each pixel unit and the horizontal direction F1 is an acute angle. The above-mentioned image sensor can constitute a plurality of pixel unit rows. For example, the image sensor in FIG. Two adjacent pixel unit rows are misaligned, for example, the pixel unit row H2 and the pixel unit row H1 are misaligned by half a pixel unit. The above-mentioned image sensor can form a plurality of pixel unit columns, for example, the image sensor in FIG. pixel units, and any two adjacent pixel unit columns are misaligned, for example, the pixel unit column L2 and the pixel unit column L1 are misaligned by half a pixel unit. In this way, multiple pixel units in the image sensor can be arranged more compactly, so that the resolution of the image acquired by the image sensor is higher.

本申请实施例中，上述图像传感器中的像素单元的形状可以为六边形、矩形等多边形，以下结合附图，对像素单元的形状为六边形或矩形的两种实现方式进行详细说明。In the embodiment of the present application, the shape of the pixel unit in the above-mentioned image sensor may be polygonal such as hexagon, rectangle, etc., and the following two implementations in which the shape of the pixel unit is hexagon or rectangle will be described in detail with reference to the accompanying drawings.

实现方式一：Implementation method one:

图3为本申请实施例中一个像素单元的放大示意图，如图3所示，上述图像传感器中的每一个像素单元可以包括：与水平方向F1平行的第一侧边Q1和第二侧边Q2、与第一侧边Q1相连的第三侧边Q3和第四侧边Q4，以及与第二侧边Q2相连的第五侧边Q5和第六侧边Q6，第三侧边Q3与第五侧边Q5相连，第四侧边Q4与第六侧边Q6相连。第三侧边Q3与第五侧边Q5之间的夹角α1为90°，第四侧边Q4与第六侧边Q6之间的夹角α2为90°，第一侧边Q1与第三侧边Q3之间的夹角α3为135°，第一侧边Q1与第四侧边Q4之间的夹角α4为135°，第二侧边Q2与第五侧边Q5之间的夹角α5为135°，第二侧边Q2与第六侧边Q6之间的夹角α6为135°。在实际版图设计过程中，像素单元之间的信号线一般相对于水平方向F1呈0°、45°、90°和135°等方向延伸，因而，将本申请实施例中的像素单元设置为图3所示的形状，更符合版图设计规则，便于半导体工艺加工。FIG. 3 is an enlarged schematic diagram of a pixel unit in the embodiment of the present application. As shown in FIG. 3 , each pixel unit in the above-mentioned image sensor may include: a first side Q1 and a second side Q2 parallel to the horizontal direction F1 , the third side Q3 and the fourth side Q4 connected with the first side Q1, and the fifth side Q5 and the sixth side Q6 connected with the second side Q2, the third side Q3 and the fifth side The sides Q5 are connected, and the fourth side Q4 is connected to the sixth side Q6. The included angle α1 between the third side Q3 and the fifth side Q5 is 90°, the included angle α2 between the fourth side Q4 and the sixth side Q6 is 90°, and the first side Q1 and the third side The included angle α3 between the sides Q3 is 135°, the included angle α4 between the first side Q1 and the fourth side Q4 is 135°, and the included angle between the second side Q2 and the fifth side Q5 α5 is 135°, and the angle α6 between the second side Q2 and the sixth side Q6 is 135°. In the actual layout design process, the signal lines between the pixel units generally extend in directions of 0°, 45°, 90° and 135° relative to the horizontal direction F1. Therefore, the pixel units in the embodiment of the present application are set as The shape shown in 3 is more in line with the layout design rules and is convenient for semiconductor process processing.

如图2a所示，在本申请实施例中，上述图像传感器中的多个像素单元行可以包括：多个第一像素单元行和多个第二像素单元行，任意相邻两个第一像素单元行之间间隔两个第二像素单元行，例如图2a中，像素单元行H3、H6、H9、H12可以为第二像素单元行，其余的像素单元行可以为第一像素单元行，第一像素单元行H3与H6之间间隔两个第二像素单元行H4和H5，第一像素单元行H6与H9之间间隔两个第二像素单元行H7和H8，第一像素单元行H9与H12之间间隔两个第二像素单元行H10和H11。其中，每一个第一像素单元行可以包括：多个第一彩色像素单元P1，多个第二彩色像素单元P2和多个第三彩色像素单元P3，每一个第一像素单元行中的像素单元按照第一彩色像素单元P1、第三彩色像素单元P3、第二彩色像素单元P2的顺序重复排列。As shown in Figure 2a, in the embodiment of the present application, the plurality of pixel unit rows in the above-mentioned image sensor may include: a plurality of first pixel unit rows and a plurality of second pixel unit rows, any two adjacent first pixel rows Two second pixel unit rows are spaced between the unit rows. For example, in FIG. Two second pixel unit rows H4 and H5 are separated between one pixel unit row H3 and H6, two second pixel unit rows H7 and H8 are separated between the first pixel unit row H6 and H9, and the first pixel unit row H9 and Two second pixel unit rows H10 and H11 are separated from each other by H12. Wherein, each first pixel unit row may include: a plurality of first color pixel units P1, a plurality of second color pixel units P2 and a plurality of third color pixel units P3, and each pixel unit in the first pixel unit row The arrangement is repeated in the order of the first color pixel unit P1, the third color pixel unit P3, and the second color pixel unit P2.

上述图像传感器中的多个像素单元列可以包括：多个第一像素单元列(例如图2a中的L2和L5)，多个第二像素单元列(例如图2a中的L3和L6)和多个第三像素单元列(例如图2a中的L1和L4)，多个像素单元列按照第一像素单元列、第二像素单元列、第三像素单元列的顺序重复排列。其中，第一像素单元列可以包括：多个第一彩色像素单元P1和多个白色像素单元Pw，在第一像素单元列中，相邻两个第一彩色像素单元P1之间间隔两个白色像素单元Pw。第二像素单元列可以包括：多个第二彩色像素单元P2和多个白色像素单元Pw，在第二像素单元列中，相邻两个第二彩色像素单元P2之间间隔两个白色像素单元Pw。第三像素单元列可以包括：多个第三彩色像素单元P3和多个白色像素单元Pw，在第三像素单元列中，相邻两个第三彩色像素单元P3之间间隔两个白色像素单元Pw。The plurality of pixel unit columns in the above image sensor may include: a plurality of first pixel unit columns (such as L2 and L5 in FIG. 2a), a plurality of second pixel unit columns (such as L3 and L6 in FIG. 2a) and a plurality of A third pixel unit column (such as L1 and L4 in FIG. 2a), a plurality of pixel unit columns are repeatedly arranged in the order of the first pixel unit column, the second pixel unit column, and the third pixel unit column. Wherein, the first pixel unit column may include: a plurality of first color pixel units P1 and a plurality of white pixel units Pw, and in the first pixel unit column, two adjacent first color pixel units P1 are separated by two white pixel units. Pixel unit Pw. The second pixel unit column may include: a plurality of second color pixel units P2 and a plurality of white pixel units Pw, in the second pixel unit column, two adjacent second color pixel units P2 are separated by two white pixel units Pw. The third pixel unit column may include: a plurality of third color pixel units P3 and a plurality of white pixel units Pw, in the third pixel unit column, two adjacent third color pixel units P3 are separated by two white pixel units Pw.

图4为本申请实施例提供的图像传感器中像素单元的另一排布示意图，如图4所示，上述图像传感器中的多个像素单元可以包括多个重复单元T1，每一个重复单元T1可以包括：分布于相邻的两个像素单元列和相邻的五个像素单元行的五个像素单元，例如图4中左上角的重复单元T1包括：分布于像素单元列L1、L2和像素单元行H1、H2、H3、H4、H5中的五个像素单元。重复单元I1中的其中一个像素单元列(例如像素单元列L1)可以包括：一个第一彩色像素单元P1、一个第二彩色像素单元P2和一个第三彩色像素单元P3，另一个像素单元列(例如像素单元列L2)可以包括：两个白色像素单元Pw。图4中以重复单元T1中的各彩色像素单元按照第一彩色像素单元P1、第二彩色像素单元P2、第三彩色像素单元P3的顺序进行排列为例，在具体实施时，重复单元T1中的彩色像素单元也可以采用其他顺序排列，此处不做限定。FIG. 4 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application. As shown in FIG. Including: five pixel units distributed in two adjacent pixel unit columns and five adjacent pixel unit rows, for example, the repeating unit T1 in the upper left corner in Figure 4 includes: distributed in pixel unit columns L1, L2 and pixel units Five pixel cells in rows H1, H2, H3, H4, H5. One of the pixel unit columns (for example, pixel unit column L1) in the repeating unit I1 may include: a first color pixel unit P1, a second color pixel unit P2, and a third color pixel unit P3, and another pixel unit column ( For example, the pixel unit column L2) may include: two white pixel units Pw. In Fig. 4, the color pixel units in the repeating unit T1 are arranged in the order of the first color pixel unit P1, the second color pixel unit P2, and the third color pixel unit P3 as an example. During specific implementation, in the repeating unit T1 The color pixel units can also be arranged in other order, which is not limited here.

图5为本申请实施例提供的图像传感器中像素单元的另一排布示意图，如图5所示，上述图像传感器中的多个像素单元可以包括多个重复单元T2，每一个重复单元T2可以包括：分布于相邻的五个像素单元行和相邻的五个像素单元列的九个像素单元，例如图5中右上角的重复单元T2包括：分布于像素单元行H1、H2、H3、H4、H5和像素单元列L1、L2、L3、L4、L5中的九个像素单元。重复单元T2可以包括：位于中间的像素单元行(例如像素单元行H3)的三个白色像素单元Pw，以及分布于其余的四个像素单元行(例如像素单元行H1、H2、H4、H5)的两个第一彩色像素单元P1、两个第二彩色像素单元P2和两个第三彩色像素单元P3，其中，两个第一彩色像素单元P1、两个第二彩色像素单元P2和两个第三彩色像素单元P3围绕位于中间的白色像素单元Pw排列为环状。重复单元T2中的各彩色像素单元按照顺时针的排列顺序为：第一彩色像素单元P1、第一彩色像素单元P1、第二彩色像素单元P2、第二彩色像素单元P2、第三彩色像素单元P3、第三彩色像素单元P3，在具体实施时，重复单元T2中的彩色像素单元也可以采用其他顺序排列，此处不做限定。FIG. 5 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application. As shown in FIG. Including: nine pixel units distributed in five adjacent pixel unit rows and five adjacent pixel unit columns, for example, the repeating unit T2 in the upper right corner in Figure 5 includes: distributed in pixel unit rows H1, H2, H3, H4, H5 and nine pixel cells in pixel cell columns L1, L2, L3, L4, L5. Repeating unit T2 may include: three white pixel units Pw located in the middle pixel unit row (for example, pixel unit row H3), and distributed in the remaining four pixel unit rows (for example, pixel unit rows H1, H2, H4, H5) Two first color pixel units P1, two second color pixel units P2 and two third color pixel units P3, wherein two first color pixel units P1, two second color pixel units P2 and two The third color pixel units P3 are arranged in a ring around the white pixel unit Pw located in the middle. The color pixel units in the repeating unit T2 are arranged clockwise: the first color pixel unit P1, the first color pixel unit P1, the second color pixel unit P2, the second color pixel unit P2, and the third color pixel unit P3. The third color pixel unit P3. During specific implementation, the color pixel units in the repeating unit T2 may also be arranged in other order, which is not limited here.

图6为本申请实施例提供的图像传感器中像素单元的另一排布示意图，如图6所示，上述图像传感器中的多个像素单元包括多个重复单元T3，每一个重复单元T3可以包括：分布于相邻的五个像素单元行和相邻的三个像素单元列的七个像素单元，例如图6中左上角的重复单元T3包括：分布于像素单元行H2、H3、H4、H5、H6和像素单元列L1、L2、L3中的七个像素单元。在每一个重复单元T3中，位于中间的像素单元列(例如像素单元列L2)可以包括：一个第一彩色像素单元P1、一个第二彩色像素单元P2和一个第三彩色像素单元P3，其余的两个像素单元列(例如像素单元列L1和L3)均包括两个白色像素单元Pw。图6中的重复单元T3中，各彩色像素单元按照第一彩色像素单元P1、第三彩色像素单元P3、第二彩色像素单元P2的顺序排列，在具体实施时，可以根据实际情况设置重复单元T3中各彩色像素单元的顺序，此处不做限定。Fig. 6 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application. As shown in Fig. 6, the plurality of pixel units in the above-mentioned image sensor includes a plurality of repeating units T3, and each repeating unit T3 may include : Seven pixel units distributed in five adjacent pixel unit rows and three adjacent pixel unit columns, for example, the repeating unit T3 in the upper left corner in Figure 6 includes: distributed in pixel unit rows H2, H3, H4, H5 , H6 and seven pixel units in the pixel unit columns L1, L2, L3. In each repeating unit T3, the pixel unit column (such as pixel unit column L2) in the middle may include: a first color pixel unit P1, a second color pixel unit P2 and a third color pixel unit P3, and the rest Two pixel unit columns (for example, pixel unit columns L1 and L3 ) each include two white pixel units Pw. In the repeating unit T3 in Figure 6, each color pixel unit is arranged in the order of the first color pixel unit P1, the third color pixel unit P3, and the second color pixel unit P2. In specific implementation, the repeating unit can be set according to the actual situation The order of the color pixel units in T3 is not limited here.

图7为本申请实施例提供的图像传感器中像素单元的另一排布示意图，如图7所示，上述图像传感器中的多个像素单元包括多个重复单元T4，每一个重复单元T4可以包括：分布于相邻的五个像素单元行和相邻的三个像素单元列的七个像素单元，例如图7中左上角的重复单元T3包括：分布于像素单元行H2、H3、H4、H5、H6和像素单元列L1、L2、L3中的七个像素单元。在每一个重复单元T4中，其中一个像素单元位于中间，其余的六个像素单元围绕位于中间的像素单元排列为环状，重复单元T4可以包括：一个第一彩色像素单元P1、一个第二彩色像素单元P2、一个第三彩色像素单元P3和四个白色像素单元Pw，其中，第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3分布于两个像素单元列(例像素单元列L1和L2)和三个像素单元行(例如像素单元行H3、H4、H5)中。图7中以第二彩色像素单元P2位于重复单元T4的中间为例，在具体实施时，也可以将第一彩色像素单元P1或第三彩色像素单元P3设置在重复单元T4的中间，并且，第一彩色像素单元P1和第三彩色像素单元P3均位于重复单元T4中的同一列为例，在实际设置时，也可以将第一彩色像素单元P1和第三彩色像素单元P3设置在除中间位置外的其他位置，此处不做限定。FIG. 7 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application. As shown in FIG. : Seven pixel units distributed in five adjacent pixel unit rows and three adjacent pixel unit columns, for example, the repeating unit T3 in the upper left corner in Figure 7 includes: distributed in pixel unit rows H2, H3, H4, H5 , H6 and seven pixel units in the pixel unit columns L1, L2, L3. In each repeating unit T4, one of the pixel units is located in the middle, and the remaining six pixel units are arranged in a ring around the pixel unit located in the middle. The repeating unit T4 may include: a first color pixel unit P1, a second color pixel unit Pixel unit P2, a third color pixel unit P3 and four white pixel units Pw, wherein the first color pixel unit P1, the second color pixel unit P2 and the third color pixel unit P3 are distributed in two pixel unit columns (for example Pixel unit columns L1 and L2) and three pixel unit rows (eg, pixel unit rows H3, H4, H5). In FIG. 7, the second color pixel unit P2 is located in the middle of the repeating unit T4 as an example. In specific implementation, the first color pixel unit P1 or the third color pixel unit P3 can also be arranged in the middle of the repeating unit T4, and, The first color pixel unit P1 and the third color pixel unit P3 are both located in the same column in the repeating unit T4 as an example, in actual setting, the first color pixel unit P1 and the third color pixel unit P3 can also be arranged in the Locations other than the location are not limited here.

在图2a及图4～7所示的像素单元排布方式中，第一彩色像素单元P1、第二彩色像素单元P2、第三彩色像素单元P3的数量比值约为1:1:1，并且，第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3均匀分布，从而，可以使图像传感器采集的图像的彩色信息较均匀，得到的图像的色彩效果较好。并且，白色像素单元Pw的数量较多，且白色像素单元Pw均匀分布，从而使图像传感器获取的图像的亮度较高，且该图像的亮度较均匀，因此，该图像的清晰度较高。In the arrangement of pixel units shown in Figure 2a and Figures 4-7, the ratio of the number of the first color pixel unit P1, the second color pixel unit P2, and the third color pixel unit P3 is about 1:1:1, and The first color pixel unit P1, the second color pixel unit P2 and the third color pixel unit P3 are evenly distributed, so that the color information of the image collected by the image sensor can be made more uniform, and the color effect of the obtained image is better. Moreover, the number of white pixel units Pw is large, and the white pixel units Pw are evenly distributed, so that the brightness of the image captured by the image sensor is higher, and the brightness of the image is more uniform, so the definition of the image is higher.

本申请实施例中，以图2a及图4～7中所示的像素单元排布方式，对本申请实施例中图像传感器的像素单元排布方式进行举例说明。在实际应用中，本申请实施例中的图像传感器也可以采用其他排布方式，此处不做限定。并且，在图2a及图4～7中，以“R”表示第一彩色像素单元，“G”表示第二彩色像素单元，“B”表示第三彩色像素单元，并不对第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的颜色进行限定，在具体实施时，可以根据实际情况设置第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的颜色进行设置。In the embodiment of the present application, the arrangement of the pixel units of the image sensor in the embodiment of the present application is illustrated by taking the arrangement of the pixel units shown in FIG. 2 a and FIGS. 4 to 7 as examples. In practical applications, the image sensors in the embodiment of the present application may also adopt other arrangements, which are not limited here. Moreover, in Figure 2a and Figures 4-7, "R" represents the first color pixel unit, "G" represents the second color pixel unit, "B" represents the third color pixel unit, and does not refer to the first color pixel unit , the colors of the second color pixel unit and the third color pixel unit, and in specific implementation, the colors of the first color pixel unit, the second color pixel unit and the third color pixel unit can be set according to the actual situation.

实现方式二：Implementation method two:

图8为本申请实施例提供的图像传感器中像素单元的另一排布示意图，如图8所示，在本申请的另一些实施例中，上述图像传感器中的多个像素单元中的每一个像素单元的形状可以为矩形。图8中每一个方框可以表示一个像素单元。可选地，每一个像素单元的形状可以为正方形，且每一个像素单元的至少一个边与水平方向F1之间的夹角可以为45°。上述图像传感器中的多个像素单元可以构成多个像素单元行，例如图8中的图像传感器包括像素单元行H1、H2、H3、H4、H5、H6、H7、H8、H9，每一个像素单元行包括沿水平方向F1排列的多个像素单元，并且，任意相邻两个像素单元行错位设置，例如像素单元行H2与像素单元行H1错位半个像素单元。上述彩色像素单元阵列可以构成多个像素单元列，例如图8中的图像传感器包括像素单元列L1、L2、L3、L4、L5、L6、L7、L8、L9，每一个像素单元列包括沿竖直方向F2排列的多个像素单元，并且，任意相邻两个像素单元列错位设置，例如，像素单元列L2与像素单元列L1错位半个像素单元。这样，可以将图像传感器中的多个像素单元排列的更加紧凑，使得图像传感器获取的图像的分辨率较高。Fig. 8 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application. As shown in Fig. 8, in other embodiments of the present application, each of the plurality of pixel units in the above-mentioned image sensor The shape of the pixel unit may be a rectangle. Each block in FIG. 8 may represent a pixel unit. Optionally, the shape of each pixel unit may be a square, and the angle between at least one side of each pixel unit and the horizontal direction F1 may be 45°. A plurality of pixel units in the above-mentioned image sensor can constitute a plurality of pixel unit rows, for example, the image sensor in FIG. 8 includes pixel unit rows H1, H2, H3, H4, H5, H6, H7, H8, H9, each pixel unit A row includes a plurality of pixel units arranged along the horizontal direction F1, and any two adjacent pixel unit rows are misaligned, for example, the pixel unit row H2 and the pixel unit row H1 are misaligned by half a pixel unit. The above-mentioned color pixel unit array can form a plurality of pixel unit columns. For example, the image sensor in FIG. 8 includes pixel unit columns L1, L2, L3, L4, L5, L6, L7, L8, and L9. A plurality of pixel units arranged in the vertical direction F2, and any two adjacent pixel unit columns are misaligned, for example, the pixel unit column L2 and the pixel unit column L1 are misaligned by half a pixel unit. In this way, multiple pixel units in the image sensor can be arranged more compactly, so that the resolution of the image acquired by the image sensor is higher.

图9为相关技术中的像素单元排布方式与本申请实施例中的像素单元排布方式的对比示意图，如图9所示，图9中的(1)为相关技术中的像素单元排布示意图，相关技术中的像素单元采用正方形横纵排列的排列方式，以像素单元P的边长为a为例，相邻像素单元P的几何中心之间的水平距离和竖直距离均为a，其中，水平距离可以为水平方向F1上的距离，竖直距离可以为竖直方向F2上的距离。图9中的(2)为本申请实施例中的像素单元排布示意图，本申请实施例中，像素单元P的至少一个边与水平方向F1之间的夹角为锐角，图9中的(2)中以像素单元P的边与水平方向F1之间的夹角为45°为例，这样，相邻像素单元P的几何中心之间的水平距离和竖直距离均为b，

即b＜a，因此，相比于相关技术中的像素单元排布方式，本申请实施例中的像素单元排布方式中，相邻像素单元P的几何中心之间的水平距离和竖直距离更小。由于人眼对图像的感知能力在水平方向和竖直方向上更灵敏，并且，经过对大量图像的统计，水平方向和竖直方向上的图像信息更多，本申请实施例中的像素单元排布方式中，像素单元P在水平方向和竖直方向更加密集，因此，人眼感觉分辨率会增强，从而，可以进一步改善图像传感器获取的图像的质量。 Figure 9 is a schematic diagram of the comparison between the pixel unit arrangement in the related art and the pixel unit arrangement in the embodiment of the present application, as shown in Figure 9, (1) in Figure 9 is the pixel unit arrangement in the related art Schematic diagram, the pixel units in the related art are arranged in a square horizontal and vertical arrangement, taking the side length of the pixel unit P as an example, the horizontal distance and the vertical distance between the geometric centers of adjacent pixel units P are both a, Wherein, the horizontal distance may be the distance in the horizontal direction F1, and the vertical distance may be the distance in the vertical direction F2. (2) in FIG. 9 is a schematic diagram of the arrangement of pixel units in the embodiment of the present application. In the embodiment of the present application, the angle between at least one side of the pixel unit P and the horizontal direction F1 is an acute angle, and ( in FIG. 9 2) Take the angle between the side of the pixel unit P and the horizontal direction F1 as an example of 45°, so that the horizontal distance and the vertical distance between the geometric centers of adjacent pixel units P are both b,

That is, b<a, therefore, compared with the arrangement of pixel units in the related art, in the arrangement of pixel units in the embodiment of the present application, the horizontal and vertical distances between the geometric centers of adjacent pixel units P smaller. Since human eyes are more sensitive to images in the horizontal and vertical directions, and after statistics on a large number of images, the image information in the horizontal and vertical directions is more, the pixel unit arrangement in the embodiment of the present application In the layout mode, the pixel units P are denser in the horizontal direction and the vertical direction, so the resolution perceived by the human eye will be enhanced, thereby further improving the quality of the image acquired by the image sensor.

如图8所示，在本申请实施例中，上述图像传感器中的多个像素单元行可以包括至少一个白色像素单元行，白色像素单元行中的每一个像素单元均为白色像素单元Pw，例如，图8中像素单元行H1、H3、H5、H7及H9为白色像素单元行。通过在图像传感器中设置白色像素单元行，可以提高图像传感器的光线的如光亮，提升图像传感器获取的图像的亮度。As shown in FIG. 8, in the embodiment of the present application, the plurality of pixel unit rows in the above-mentioned image sensor may include at least one white pixel unit row, and each pixel unit in the white pixel unit row is a white pixel unit Pw, for example , the pixel unit rows H1, H3, H5, H7 and H9 in FIG. 8 are white pixel unit rows. By arranging white pixel unit rows in the image sensor, the brightness of the light of the image sensor can be improved, and the brightness of the image acquired by the image sensor can be improved.

继续参照图8，上述图像传感器中的多个像素单元行还可以包括多个彩色像素单元行，彩色像素单元行包括第一彩色像素单元P1、第二彩色像素单元P2及第三彩色像素单元P3中的至少一个，例如，图8中像素单元行H2、H4、H6及H8为彩色像素单元行，其中，彩色像素单元行H2包括第一彩色像素单元P1和第二彩色像素单元P2，彩色像素单元行H4包括第二彩色像素单元P2和第三彩色像素单元P3，彩色像素单元行H6包括第一彩色像素单元P1和第二彩色像素单元P2，彩色像素单元行H8包括第二彩色像素单元P2和第三彩色像素单元P3。任意相邻两个彩色像素单元行之间间隔至少一个白色像素单元行，例如，图8中彩色像素单元行H2与H4之间间隔一个白色像素单元行H3，彩色像素单元行H4与H6之间间隔一个白色像素单元行H5，彩色像素单元行H6与H8之间间隔一个白色像素单元行H7。Continuing to refer to FIG. 8, the plurality of pixel unit rows in the above-mentioned image sensor may also include a plurality of color pixel unit rows, and the color pixel unit row includes a first color pixel unit P1, a second color pixel unit P2, and a third color pixel unit P3 At least one of them, for example, the pixel unit rows H2, H4, H6 and H8 in FIG. The unit row H4 includes the second color pixel unit P2 and the third color pixel unit P3, the color pixel unit row H6 includes the first color pixel unit P1 and the second color pixel unit P2, and the color pixel unit row H8 includes the second color pixel unit P2 and the third color pixel unit P3. There is at least one white pixel unit row between any adjacent two color pixel unit rows, for example, there is a white pixel unit row H3 between the color pixel unit rows H2 and H4 in Figure 8, and a white pixel unit row H3 between the color pixel unit rows H4 and H6. There is one white pixel unit row H5 apart, and one white pixel unit row H7 is separated between the color pixel unit rows H6 and H8.

上述图像传感器中的多个像素单元列可以包括多个彩色像素单元列，彩色像素单元列包括第一彩色像素单元P1、第二彩色像素单元P2及第三彩色像素单元P3中的至少一个，例如图8中像素单元列L2、L4、L6及L8为彩色像素单元列，其中，彩色像素单元列L2包括第一彩色像素单元P1和第二彩色像素单元P2，彩色像素单元列L4包括第二彩色像素单元P2和第三彩色像素单元P3，彩色像素单元列L6包括第一彩色像素单元P1和第二彩色像素单元P2，彩色像素单元列L8包括第二彩色像素单元P2和第三彩色像素单元P3。The plurality of pixel unit columns in the above image sensor may include a plurality of color pixel unit columns, and the color pixel unit columns include at least one of the first color pixel unit P1, the second color pixel unit P2 and the third color pixel unit P3, for example The pixel unit columns L2, L4, L6 and L8 in FIG. 8 are color pixel unit columns, wherein the color pixel unit column L2 includes the first color pixel unit P1 and the second color pixel unit P2, and the color pixel unit column L4 includes the second color pixel unit column. The pixel unit P2 and the third color pixel unit P3, the color pixel unit column L6 includes the first color pixel unit P1 and the second color pixel unit P2, and the color pixel unit column L8 includes the second color pixel unit P2 and the third color pixel unit P3 .

在本申请的一种可能的实现方式中，上述图像传感器中的多个像素单元行中的白色像素单元行与彩色像素单元行交替排布，例如图8中白色像素单元行H1、H3、H5、H7、H9，与彩色像素单元行H2、H4、H6、H8交替排布。这样设置可以使白色像素单元Pw均匀分布，使图像传感器获取的图像的亮度较均匀，图像的清晰度更好。In a possible implementation of the present application, the white pixel unit rows and the colored pixel unit rows in the plurality of pixel unit rows in the image sensor are alternately arranged, for example, the white pixel unit rows H1, H3, and H5 in FIG. 8 , H7, H9 are alternately arranged with the color pixel unit rows H2, H4, H6, H8. Such setting can make the white pixel units Pw evenly distributed, so that the brightness of the image acquired by the image sensor is relatively uniform, and the definition of the image is better.

继续参照图8，上述图像传感器中的多个彩色像素单元行可以包括：交替排布的多个第一彩色像素单元行和多个第二彩色像素单元行，例如，彩色像素单元行H2和H6可以为第一彩色像素单元行，彩色像素单元行H4和H8可以为第二彩色像素单元行。第一彩色像素单元行(H2或H6)可以包括：交替排列的多个第一彩色像素单元P1和多个第二彩色像素单元P2，第二彩色像素单元行(H4或H8)可以包括：交替排列的多个第二彩色像素单元P2和多个第三彩色像素单元P3。并且，第一彩色像素单元行中的第二彩色像素单元，与第二彩色像素单元行中的第二彩色像素单元位于不同的彩色像素单元列，例如，第一彩色像素单元行H2中的第二彩色像素单元P2分别位于彩色像素单元列L4和L8中，第二彩色像素单元行H4中的第二彩色像素单元P2分别位于彩色像素单元列L2和L6中。在图8所示的像素单元排列方式中，第二彩色像素单元P2、第一彩色像素单元P1、第三彩色像素单元P3的数量比值可以为2:1:1，第二彩色像素单元P2可以为绿色像素单元，绿色像素单元的数量较多，且绿色像素单元均匀分布，由于人眼对绿色光线更敏感，图8所示的像素单元排布方式可以使图像传感器获取的图像更接近人眼观看到的被拍摄目标的真实色彩，使人眼感知的图像的质量较好。Continuing to refer to FIG. 8, the plurality of color pixel unit rows in the above-mentioned image sensor may include: a plurality of first color pixel unit rows and a plurality of second color pixel unit rows arranged alternately, for example, color pixel unit rows H2 and H6 It may be the first color pixel unit row, and the color pixel unit rows H4 and H8 may be the second color pixel unit row. The first color pixel unit row (H2 or H6) may include: a plurality of first color pixel units P1 and a plurality of second color pixel units P2 arranged alternately, and the second color pixel unit row (H4 or H8) may include: alternating A plurality of second color pixel units P2 and a plurality of third color pixel units P3 are arranged. Moreover, the second color pixel unit in the first color pixel unit row is located in a different color pixel unit column from the second color pixel unit in the second color pixel unit row, for example, the first color pixel unit row H2 The two-color pixel units P2 are respectively located in the color pixel unit columns L4 and L8, and the second color pixel units P2 in the second color pixel unit row H4 are respectively located in the color pixel unit columns L2 and L6. In the pixel unit arrangement shown in Figure 8, the ratio of the number of the second color pixel unit P2, the first color pixel unit P1, and the third color pixel unit P3 can be 2:1:1, and the second color pixel unit P2 can be The number of green pixel units is large, and the green pixel units are evenly distributed. Since the human eye is more sensitive to green light, the pixel unit arrangement shown in Figure 8 can make the image acquired by the image sensor closer to the human eye. The real color of the object to be photographed is viewed, so that the quality of the image perceived by the human eye is better.

图10为本申请实施例提供的图像传感器中像素单元的另一排布示意图，如图10所示，上述图像传感器中的多个像素单元行中的白色像素单元行与彩色像素单元行交替排布，例如图10中白色像素单元行H1、H3、H5、H7、H9，与彩色像素单元行H2、H4、H6、H8交替排布。这样设置可以使白色像素单元Pw均匀分布，使图像传感器获取的图像的亮度较均匀，图像的清晰度更好。Fig. 10 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application. As shown in Fig. 10, the white pixel unit rows and the colored pixel unit rows in the plurality of pixel unit rows in the image sensor are alternately arranged For example, the white pixel unit rows H1, H3, H5, H7, H9 in FIG. 10 are alternately arranged with the color pixel unit rows H2, H4, H6, H8. Such setting can make the white pixel units Pw evenly distributed, so that the brightness of the image acquired by the image sensor is relatively uniform, and the definition of the image is better.

继续参照图10，每一个彩色像素单元行(H2、H4、H6或H8)中的像素单元按照第一彩色像素单元P1、第二彩色像素单元P2、第三彩色像素单元P3的顺序重复排列，每一个彩色像素单元列(L2、L4、L6或L8)中的像素单元按照第一彩色像素单元P1、第二彩色像素单元P2、第三彩色像素单元P3的顺序重复排列。这样，可以使第一彩色像素单元P1、第二彩色像素单元P2、第三彩色像素单元P3的数量比值约为1:1:1，并且，第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3均匀分布，从而，可以使图像传感器采集的图像的彩色信息较均匀，得到的图像的色彩效果较好。Continuing to refer to FIG. 10, the pixel units in each color pixel unit row (H2, H4, H6 or H8) are repeatedly arranged in the order of the first color pixel unit P1, the second color pixel unit P2, and the third color pixel unit P3, The pixel units in each color pixel unit column ( L2 , L4 , L6 or L8 ) are repeatedly arranged in the order of the first color pixel unit P1 , the second color pixel unit P2 and the third color pixel unit P3 . In this way, the number ratio of the first color pixel unit P1, the second color pixel unit P2, and the third color pixel unit P3 can be about 1:1:1, and the first color pixel unit P1, the second color pixel unit P2 and the third color pixel units P3 are evenly distributed, so that the color information of the image collected by the image sensor can be more uniform, and the color effect of the obtained image is better.

图11为本申请实施例提供的图像传感器中像素单元的另一排布示意图，如图11所示，上述图像传感器中的多个像素单元行中的白色像素单元行与彩色像素单元行交替排布，在图11中像素单元行H2、H4、H6和H8可以为白色像素单元行，像素单元行H1、H3、H5和H7可以为彩色像素单元行，白色像素单元行H2、H4、H6、H8，与彩色像素单元行H1、H3、H5、H7交替排布，这样设置可以使白色像素单元Pw均匀分布，使图像传感器获取的图像的亮度较均匀，图像的清晰度更好。Figure 11 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application. As shown in Figure 11 , the white pixel unit rows and the colored pixel unit rows in the plurality of pixel unit rows in the image sensor are alternately arranged Cloth, in Figure 11, the pixel unit rows H2, H4, H6 and H8 can be white pixel unit rows, the pixel unit rows H1, H3, H5 and H7 can be color pixel unit rows, and the white pixel unit rows H2, H4, H6, H8 is alternately arranged with the color pixel unit rows H1, H3, H5, and H7, so that the white pixel units Pw can be evenly distributed, so that the brightness of the image acquired by the image sensor is more uniform, and the image definition is better.

继续参照图11，上述图像传感器中的多个彩色像素单元行可以包括：多个第一彩色像素单元行(例如图11中的像素单元行H1)、多个第二彩色像素单元行(例如图11中的像素单元行H3)、多个第三彩色像素单元行(例如图11中的像素单元行H5)及多个第四彩色像素单元行(例如图11中的像素单元行H7)，且多个彩色像素单元行中的彩色像素单元行按照第一彩色像素单元行、第二彩色像素单元行、第三彩色像素单元行、第四彩色像素单元行的顺序重复排列。第一彩色像素单元行可以包括：多个白色像素单元Pw、多个第一彩色像素单元P1及多个第三彩色像素单元P3，第一彩色像素单元行中的像素单元按照白色像素单元Pw、第一彩色像素单元P1、白色像素单元Pw、第三彩色像素单元P3的顺序重复排列。第二彩色像素单元行可以包括：交替排列的多个白色像素单元Pw和多个第二彩色像素单元P2。第三彩色像素单元行包括：多个白色像素单元Pw、多个第一彩色像素单元P1及多个第三彩色像素单元P3，第三彩色像素单元行中的像素单元按照白色像素单元Pw、第三彩色像素单元P3、白色像素单元Pw、第一彩色像素单元P1的顺序重复排列；第一彩色像素单元行中的第一彩色像素单元P1，与第三彩色像素单元行中的第一彩色像素单元P1位于不同的彩色像素单元列，例如图11中，像素单元行H1中的第一彩色像素单元P1位于像素单元列L3中，像素单元行H5中的第一彩色像素单元P1位于像素单元列L7中。第四彩色像素单元行包括：交替排列的多个白色像素单元Pw和多个第二彩色像素单元P2，第四彩色像素单元行中多个像素单元的排列顺序，与第二彩色像素单元行中的多个像素单元的排列顺序相同，例如图11中，像素单元行H7中多个像素单元的排列顺序，与像素单元行H3中多个像素单元的排列顺序相同。Continuing to refer to FIG. 11 , the plurality of color pixel unit rows in the above-mentioned image sensor may include: a plurality of first color pixel unit rows (for example, pixel unit row H1 in FIG. 11 ), a plurality of second color pixel unit rows (for example, in FIG. 11 in the pixel unit row H3), a plurality of third color pixel unit rows (such as the pixel unit row H5 in FIG. 11 ) and a plurality of fourth color pixel unit rows (such as the pixel unit row H7 in FIG. 11 ), and The color pixel unit rows in the plurality of color pixel unit rows are repeatedly arranged in the order of the first color pixel unit row, the second color pixel unit row, the third color pixel unit row, and the fourth color pixel unit row. The first color pixel unit row may include: a plurality of white pixel units Pw, a plurality of first color pixel units P1 and a plurality of third color pixel units P3, and the pixel units in the first color pixel unit row are arranged according to the white pixel unit Pw, The order of the first color pixel unit P1, the white pixel unit Pw, and the third color pixel unit P3 is arranged repeatedly. The second color pixel unit row may include: a plurality of white pixel units Pw and a plurality of second color pixel units P2 arranged alternately. The third color pixel unit row includes: a plurality of white pixel units Pw, a plurality of first color pixel units P1 and a plurality of third color pixel units P3, and the pixel units in the third color pixel unit row are according to the white pixel unit Pw, the first color pixel unit The order of the three-color pixel unit P3, the white pixel unit Pw, and the first color pixel unit P1 is repeatedly arranged; the first color pixel unit P1 in the first color pixel unit row, and the first color pixel unit in the third color pixel unit row The unit P1 is located in a different color pixel unit column. For example, in FIG. 11, the first color pixel unit P1 in the pixel unit row H1 is located in the pixel unit column L3, and the first color pixel unit P1 in the pixel unit row H5 is located in the pixel unit column L7. The fourth color pixel unit row includes: a plurality of white pixel units Pw and a plurality of second color pixel units P2 arranged alternately, the arrangement order of the plurality of pixel units in the fourth color pixel unit row is the same as that in the second color pixel unit row The arrangement order of the plurality of pixel units is the same, for example, in FIG. 11 , the arrangement order of the plurality of pixel units in the pixel unit row H7 is the same as the arrangement order of the plurality of pixel units in the pixel unit row H3.

在图11所示的像素单元排列方式中，第二彩色像素单元P2、第一彩色像素单元P1、第三彩色像素单元P3的数量比值可以为2:1:1，第二彩色像素单元P2可以为绿色像素单元，绿色像素单元的数量较多，且绿色像素单元均匀分布，由于人眼对绿色光线更敏感，图11所示的像素单元排布方式可以使图像传感器获取的图像更接近人眼观看到的被拍摄目标的真实色彩，使人眼感知的图像的质量较好。并且，图11所示的像素单元排列方式中，白色像素单元Pw较多，可以使图像传感器中的光线的入光量较大，使得图像传感器获取的图像的亮度较高。In the pixel unit arrangement shown in Figure 11, the ratio of the number of the second color pixel unit P2, the first color pixel unit P1, and the third color pixel unit P3 can be 2:1:1, and the second color pixel unit P2 can be The number of green pixel units is large, and the green pixel units are evenly distributed. Since the human eye is more sensitive to green light, the pixel unit arrangement shown in Figure 11 can make the image acquired by the image sensor closer to the human eye. The real color of the object to be photographed is viewed, so that the quality of the image perceived by the human eye is better. Moreover, in the arrangement of pixel units shown in FIG. 11 , there are more white pixel units Pw, which can increase the amount of incident light in the image sensor, so that the brightness of the image captured by the image sensor is higher.

图12为本申请实施例提供的图像传感器中像素单元的另一排布示意图，如图12所示，上述图像传感器中的多个彩色像素单元行中的任意相邻两个彩色像素单元行之间间隔两个白色像素单元行，例如图12中，像素单元行H1为彩色像素单元行，像素单元行H2和H3为白色像素单元行，像素单元行H4为彩色像素单元行，像素单元行H5和H6为白色像素单元行，像素单元行H7为彩色像素单元行，像素单元行H8和H9为白色像素单元行，相邻的彩色像素单元行H1与H4之间间隔两个白色像素单元行H2和H3，相邻的彩色像素单元行H4与H7之间间隔两个白色像素单元行H5和H6。这样设置可以使图像传感器中的白色像素单元Pw的数量较多，且白色像素单元Pw均匀分布，从而使图像传感器获取的图像的亮度较高，且该图像的亮度较均匀，因此，该图像的清晰度较高。Figure 12 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application. There are two white pixel unit rows at intervals. For example, in Figure 12, pixel unit row H1 is a color pixel unit row, pixel unit rows H2 and H3 are white pixel unit rows, pixel unit row H4 is a color pixel unit row, and pixel unit row H5 and H6 are white pixel unit rows, pixel unit row H7 is a color pixel unit row, pixel unit rows H8 and H9 are white pixel unit rows, and two white pixel unit rows H2 are separated between adjacent color pixel unit rows H1 and H4 and H3, two white pixel unit rows H5 and H6 are separated between adjacent color pixel unit rows H4 and H7. This setting can make the number of white pixel units Pw in the image sensor more, and the white pixel units Pw are evenly distributed, so that the brightness of the image captured by the image sensor is higher, and the brightness of the image is relatively uniform, therefore, the brightness of the image Higher definition.

继续参照图12，每一个彩色像素单元行(例如像素单元行H1、H4或H7)中的像素单元按照第一彩色像素单元P1、第二彩色像素单元P2、第三彩色像素单元P3的顺序重复排列。上述图像传感器中的多个彩色像素单元列可以包括：多个第一彩色像素单元列(例如像素单元列L2、L5或L8)，多个第二彩色像素单元列(例如像素单元列L3、L6或L9)和多个第三彩色像素单元列(例如像素单元列L1、L4或L7)，多个彩色像素单元列按照第一彩色像素单元列、第二彩色像素单元列、第三彩色像素单元列的顺序重复排列。其中，第一彩色像素单元列包括：多个第一彩色像素单元P1和多个白色像素单元Pw，在第一彩色像素单元列中，相邻两个第一彩色像素单元P1之间间隔两个白色像素单元Pw。第二彩色像素单元列包括：多个第三彩色像素单元P3和多个白色像素单元Pw，在第二彩色像素单元列中，相邻两个第三彩色像素单元P3之间间隔两个白色像素单元Pw。第三彩色像素单元列包括：多个第二彩色像素单元P2和多个白色像素单元Pw，在第三彩色像素单元列中，相邻两个第二彩色像素单元P2之间间隔两个白色像素单元Pw。Continuing to refer to FIG. 12 , the pixel units in each color pixel unit row (such as pixel unit row H1, H4 or H7) are repeated in the order of the first color pixel unit P1, the second color pixel unit P2, and the third color pixel unit P3 arrangement. The plurality of color pixel unit columns in the image sensor may include: a plurality of first color pixel unit columns (such as pixel unit columns L2, L5 or L8), a plurality of second color pixel unit columns (such as pixel unit columns L3, L6 or L9) and a plurality of third color pixel unit columns (such as pixel unit columns L1, L4 or L7), a plurality of color pixel unit columns according to the first color pixel unit column, the second color pixel unit column, the third color pixel unit column The order of the columns is repeated. Wherein, the first color pixel unit column includes: a plurality of first color pixel units P1 and a plurality of white pixel units Pw, in the first color pixel unit column, two adjacent first color pixel units P1 are separated by two White pixel unit Pw. The second color pixel unit column includes: a plurality of third color pixel units P3 and a plurality of white pixel units Pw, in the second color pixel unit column, two adjacent third color pixel units P3 are separated by two white pixels Unit Pw. The third color pixel unit column includes: a plurality of second color pixel units P2 and a plurality of white pixel units Pw, in the third color pixel unit column, two white pixels are separated between two adjacent second color pixel units P2 Unit Pw.

在图12所示的像素单元排布方式中，第一彩色像素单元P1、第二彩色像素单元P2、第三彩色像素单元P3的数量比值约为1:1:1，并且，第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3均匀分布，从而，可以使图像传感器采集的图像的彩色信息较均匀，得到的图像的色彩效果较好。In the arrangement of pixel units shown in Figure 12, the number ratio of the first color pixel unit P1, the second color pixel unit P2, and the third color pixel unit P3 is about 1:1:1, and the first color pixel unit The unit P1 , the second color pixel unit P2 and the third color pixel unit P3 are evenly distributed, so that the color information of the image collected by the image sensor can be more uniform, and the color effect of the obtained image is better.

图13为本申请实施例提供的图像传感器中像素单元的另一排布示意图，如图13所示，上述图像传感器中的多个像素单元行可以包括：多个第一像素单元行h1、多个第二像素单元行h2及多个第三像素单元行h3。第一像素单元行h2可以包括：多个白色像素单元Pw和多个第一彩色像素单元P1，在第一像素单元行P1中，相邻两个第一彩色像素单元P1之间间隔三个白色像素单元。第二像素单元行h2可以包括：多个白色像素单元Pw和多个第二彩色像素单元P2，在第二像素单元行P2中，相邻两个第二彩色像素单元P2之间间隔三个白色像素单元Pw。第三像素单元行h3可以包括：多个白色像素单元Pw和多个第三彩色像素单元P3，在第三像素单元行h3中，相邻两个第三彩色像素单元P3之间间隔三个白色像素单元Pw。Figure 13 is another schematic diagram of the arrangement of pixel units in the image sensor provided by the embodiment of the present application. a second pixel unit row h2 and a plurality of third pixel unit rows h3. The first pixel unit row h2 may include: a plurality of white pixel units Pw and a plurality of first color pixel units P1, in the first pixel unit row P1, three white pixel units are separated between two adjacent first color pixel units P1 pixel unit. The second pixel unit row h2 may include: a plurality of white pixel units Pw and a plurality of second color pixel units P2, in the second pixel unit row P2, three white pixel units are separated between two adjacent second color pixel units P2 Pixel unit Pw. The third pixel unit row h3 may include: a plurality of white pixel units Pw and a plurality of third color pixel units P3, in the third pixel unit row h3, three white pixel units are separated between two adjacent third color pixel units P3 Pixel unit Pw.

在图像传感器中的多个第一像素单元行h1中，相对于第m个第一像素单元行h1中的各像素单元，第m+1个第一像素单元行h1中的各像素单元，沿水平方向F1错位半个像素单元的距离；其中，第m+1个第一像素单元行为第m个第一像素单元行在竖直方向F2上的下一个第一像素单元行h1，其中，m为大于零且小于第一像素单元行h1的总数量的正整数。例如图13中，相对于中间的第一像素单元行h1，靠上的第一像素单元行h1中的第一彩色像素单元P1向右错位半个像素单元的距离。Among the plurality of first pixel unit rows h1 in the image sensor, relative to each pixel unit in the m-th first pixel unit row h1, each pixel unit in the (m+1)th first pixel unit row h1, along the The horizontal direction F1 is displaced by half a pixel unit distance; wherein, the m+1th first pixel unit row is the next first pixel unit row h1 of the mth first pixel unit row in the vertical direction F2, where m is a positive integer greater than zero and less than the total number of the first pixel unit row h1. For example, in FIG. 13 , relative to the first pixel unit row h1 in the middle, the first color pixel unit P1 in the upper first pixel unit row h1 is shifted to the right by a distance of half a pixel unit.

在图像传感器中的多个第二像素单元行h2中，相对于第n个第二像素单元行h2中的各像素单元，第n+1个第二像素单元行h2中的各像素单元，沿水平方向F1错位半个像素单元的距离；其中，第n+1个第二像素单元行h2为第n个第二像素单元行h2在竖直方向F2上的下一个第二像素单元行h2，其中，n为大于零且小于第二像素单元行h2的总数量的正整数。例如图13中，相对于中间的第二像素单元行h2，靠上的第二像素单元行h2中的第二彩色像素单元P2向右错位半个像素单元的距离。Among the plurality of second pixel unit rows h2 in the image sensor, relative to each pixel unit in the nth second pixel unit row h2, each pixel unit in the n+1th second pixel unit row h2, along The horizontal direction F1 is displaced by half a pixel unit distance; wherein, the n+1th second pixel unit row h2 is the next second pixel unit row h2 of the nth second pixel unit row h2 in the vertical direction F2, Wherein, n is a positive integer greater than zero and less than the total number of the second pixel unit row h2. For example, in FIG. 13 , relative to the middle second pixel unit row h2 , the second color pixel unit P2 in the upper second pixel unit row h2 is shifted to the right by half a pixel unit distance.

在图像传感器中的多个第三像素单元行h3中，相对于第k个第三像素单元行h3中的各像素单元，第k+1个第三像素单元行h3中的各像素单元，沿水平方向F1错位一个像素单元；其中，第k+1个第三像素单元行h3为第k个第三像素单元行h3在竖直方向F2上的下一个第三像素单元行h3，其中，k为大于零且小于第三像素单元行h3的总数量的正整数。例如图13中，相对于中间的第三像素单元行h3，靠上的第三像素单元行h3中的第三彩色像素单元P3向右错位半个像素单元的距离。Among the plurality of third pixel unit rows h3 in the image sensor, relative to each pixel unit in the kth third pixel unit row h3, each pixel unit in the k+1th third pixel unit row h3, along One pixel unit is misplaced in the horizontal direction F1; wherein, the k+1th third pixel unit row h3 is the next third pixel unit row h3 of the kth third pixel unit row h3 in the vertical direction F2, wherein, k is a positive integer greater than zero and less than the total number of the third pixel unit row h3. For example, in FIG. 13 , relative to the third pixel unit row h3 in the middle, the third color pixel unit P3 in the upper third pixel unit row h3 is shifted to the right by a distance of half a pixel unit.

在图13所示的像素单元排布方式中，第一彩色像素单元P1、第二彩色像素单元P2、第三彩色像素单元P3的数量比值约为1:1:1，并且，第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3均匀分布，从而，可以使图像传感器采集的图像的彩色信息较均匀，得到的图像的色彩效果较好。并且，图13所示的像素单元排布方式中白色像素单元Pw的数量较多，且白色像素单元Pw均匀分布，从而使图像传感器获取的图像的亮度较高，且该图像的亮度较均匀，因此，该图像的清晰度较高。In the arrangement of pixel units shown in Figure 13, the number ratio of the first color pixel unit P1, the second color pixel unit P2, and the third color pixel unit P3 is about 1:1:1, and the first color pixel unit The unit P1 , the second color pixel unit P2 and the third color pixel unit P3 are evenly distributed, so that the color information of the image collected by the image sensor can be more uniform, and the color effect of the obtained image is better. Moreover, in the arrangement of pixel units shown in FIG. 13 , the number of white pixel units Pw is large, and the white pixel units Pw are evenly distributed, so that the brightness of the image acquired by the image sensor is relatively high, and the brightness of the image is relatively uniform. Therefore, the definition of the image is high.

本申请实施例中，以图8、图10、图11、图12和图13中所示的像素单元排布方式，对本申请实施例中图像传感器的像素单元排布方式进行举例说明。在实际应用中，本申请实施例中的图像传感器中的像素单元也可以采用其他排布方式，此处不做限定。并且，在图8、图10、图11、图12和图13中，以“R”表示第一彩色像素单元，“G”表示第二彩色像素单元，“B”表示第三彩色像素单元，并不对第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的颜色进行限定，在具体实施时，可以根据实际情况设置第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的颜色进行设置。In the embodiment of the present application, the pixel unit arrangement of the image sensor in the embodiment of the present application is illustrated by taking the pixel unit arrangement shown in FIG. 8 , FIG. 10 , FIG. 11 , FIG. 12 and FIG. 13 . In practical applications, the pixel units in the image sensor in the embodiment of the present application may also adopt other arrangements, which are not limited here. Moreover, in Fig. 8, Fig. 10, Fig. 11, Fig. 12 and Fig. 13, "R" represents the first color pixel unit, "G" represents the second color pixel unit, and "B" represents the third color pixel unit, The colors of the first color pixel unit, the second color pixel unit and the third color pixel unit are not limited. During specific implementation, the first color pixel unit, the second color pixel unit and the third color pixel unit can be set according to the actual situation. The color of the cell is set.

本申请实施例提供的图像传感器中，通过设有多个白色像素单元，可以提高图像传感器的入光量，提升图像传感器获取的图像的亮度，尤其可以提升图像传感器在低照度下的灵敏度，从而可以改善图像传感器获取的图像的质量。并且，将多个像素单元排列的比较紧凑，使得图像采集器获取的图像的分辨率较高。In the image sensor provided by the embodiment of the present application, by providing a plurality of white pixel units, the amount of light incident on the image sensor can be increased, the brightness of the image acquired by the image sensor can be improved, and the sensitivity of the image sensor under low illumination can be improved in particular, so that Improve the quality of images acquired by the image sensor. Moreover, the arrangement of multiple pixel units is relatively compact, so that the resolution of the image acquired by the image collector is relatively high.

如图1所示，图像传感器中的每一个像素单元P可以包括：光电转换器101，位于光电转换器101的感光面一侧的滤光层102，以及位于滤光层102背离光电转换器101一侧的透镜103，其中透镜103可以为微透镜。在图像采集的过程中，入射光S1射向透镜103，该入射光S1可以为被拍摄目标的反射光，透镜103用于汇聚入射光S1，并将汇聚后的光线S2射向滤光层102。通过设置透镜103可以提升图像传感器的光接收量和光信号强度。滤光层102可以对光线S2进行过滤，从而，将光线S2按照滤光层102的颜色进行区分，使得环境光和图像信息分别按照不同颜色进行存储，便于后续图像处理过程中的彩色信息还原。光电转换器101可以为光电二极管等感光器件，光电转换器101用于将穿过滤光层102后的入射光转换为电信号，从而实现图像信息的存储。As shown in FIG. 1 , each pixel unit P in the image sensor may include: a photoelectric converter 101, a filter layer 102 located on the photosensitive surface side of the photoelectric converter 101, and a filter layer 102 located on the side of the photoelectric converter 101 away from the photoelectric converter 101. The lens 103 on one side, wherein the lens 103 may be a micro lens. In the process of image acquisition, the incident light S1 is incident on the lens 103, the incident light S1 may be the reflected light of the object to be photographed, the lens 103 is used to converge the incident light S1, and direct the converged light S2 to the filter layer 102 . The amount of light received by the image sensor and the intensity of light signals can be improved by setting the lens 103 . The filter layer 102 can filter the light S2, thereby distinguishing the light S2 according to the color of the filter layer 102, so that the ambient light and image information are stored in different colors, which facilitates the restoration of color information in the subsequent image processing process. The photoelectric converter 101 may be a photosensitive device such as a photodiode, and the photoelectric converter 101 is used to convert incident light passing through the filter layer 102 into an electrical signal, thereby realizing the storage of image information.

如图8所示，图像传感器中的多个像素单元可以包括：多个白色像素单元Pw、多个第一彩色像素单元P1、多个第二彩色像素单元P2及多个第三彩色像素单元P3。白色像素单元Pw中的滤光层为透明滤光层，第一彩色像素单元P1中的滤光层用于滤除第一颜色外的光线，第二彩色像素单元P2中的滤光层用于滤除第二颜色外的光线，第三彩色像素单元P3中的滤光层用于滤除第三颜色外的光线。可选地，第一彩色像素单元P1可以为红色像素单元，第二彩色像素单元P2可以为绿色像素单元，第三彩色像素单元P3可以为蓝色像素单元；或者，第一彩色像素单元P1可以为品红色像素单元，第二彩色像素单元P2可以为黄色像素单元，第三彩色像素单元P3可以为青色像素单元。当然，第一彩色像素单元P1、第二彩色像素单元P2、第三彩色像素单元P3也可以为其他颜色的像素单元，此处不做限定。As shown in Figure 8, the plurality of pixel units in the image sensor may include: a plurality of white pixel units Pw, a plurality of first color pixel units P1, a plurality of second color pixel units P2 and a plurality of third color pixel units P3 . The filter layer in the white pixel unit Pw is a transparent filter layer, the filter layer in the first color pixel unit P1 is used to filter light other than the first color, and the filter layer in the second color pixel unit P2 is used to Light rays other than the second color are filtered out, and the filter layer in the third color pixel unit P3 is used to filter out light rays other than the third color. Optionally, the first color pixel unit P1 may be a red pixel unit, the second color pixel unit P2 may be a green pixel unit, and the third color pixel unit P3 may be a blue pixel unit; or, the first color pixel unit P1 may be The second color pixel unit P2 may be a yellow pixel unit, and the third color pixel unit P3 may be a cyan pixel unit. Of course, the first color pixel unit P1 , the second color pixel unit P2 , and the third color pixel unit P3 may also be pixel units of other colors, which are not limited here.

图14为本申请实施例中的像素单元电路的结构示意图，如图14所示，上述图像传感器中的每一个像素单元还可以包括：传输晶体管TX、复位晶体管RST、源跟随晶体管SF以及行选择晶体管SEL。传输晶体管TX的源极与光电转换器101电连接，传输晶体管TX的漏极通过浮动扩散节点FD与复位晶体管RST的源极电连接，复位晶体管RST的漏极与电源信号线VDD电连接，源跟随晶体管SF的栅极与浮动扩散节点FD电连接，源跟随晶体管SF的源极与电源信号线VDD电连接，行选择晶体管SEL的源极与源跟随晶体管SF的漏极电连接，行选择晶体管SEL的漏极与信号输出端Ot电连接。Fig. 14 is a schematic structural diagram of the pixel unit circuit in the embodiment of the present application. As shown in Fig. 14, each pixel unit in the above-mentioned image sensor may further include: a transmission transistor TX, a reset transistor RST, a source follower transistor SF and a row selection Transistor SEL. The source of the transfer transistor TX is electrically connected to the photoelectric converter 101, the drain of the transfer transistor TX is electrically connected to the source of the reset transistor RST through the floating diffusion node FD, the drain of the reset transistor RST is electrically connected to the power signal line VDD, and the source The gate of the following transistor SF is electrically connected to the floating diffusion node FD, the source of the source following transistor SF is electrically connected to the power signal line VDD, the source of the row selection transistor SEL is electrically connected to the drain of the source following transistor SF, and the row selection transistor The drain of SEL is electrically connected to the signal output terminal Ot.

在图像采集过程中，光电转换器101可以将接收到的光线转换为电荷，传输晶体管TX可以控制光电转换器101是否将电荷传输至浮动扩散节点FD，当传输晶体管TX导通时，光电转换器101将电荷传输至浮动扩散节点FD，当传输晶体管TX关闭时，光电转换器101无法将电荷传输至浮动扩散节点FD，则电荷在光电转换器101中积累。复位晶体管RST可以清空浮动扩散节点FD和光电转换器101中的电荷，即复位晶体管RST可以复位浮动扩散节点FD和光电转换器101。源跟随晶体管SF可以将浮动扩散节点FD的电荷转换为电压。每一个像素单元行中的各像素单元中的行选择晶体管SEL与同一条控制信号线电连接，该控制信号线的作用是选通对应像素单元中的行选择晶体管SEL，当该控制信号线控制该像素单元行中的行选择晶体管SEL导通时，则电压从源跟随晶体管SF传输至输出端Ot，当该控制信号线控制该像素单元行中的行选择晶体管SEL关闭时，则该像素单元行中的像素单元不选通，该像素单元行中的各像素单元无法输出图像信号。During the image acquisition process, the photoelectric converter 101 can convert the received light into charges, and the transfer transistor TX can control whether the photoelectric converter 101 transfers the charges to the floating diffusion node FD. When the transfer transistor TX is turned on, the photoelectric converter 101 transfers the charges to the floating diffusion node FD. When the transfer transistor TX is turned off, the photoelectric converter 101 cannot transfer the charges to the floating diffusion node FD, and the charges are accumulated in the photoelectric converter 101 . The reset transistor RST can clear the charges in the floating diffusion node FD and the photoelectric converter 101 , that is, the reset transistor RST can reset the floating diffusion node FD and the photoelectric converter 101 . The source follower transistor SF may convert the charge of the floating diffusion node FD into a voltage. The row selection transistor SEL in each pixel unit in each pixel unit row is electrically connected to the same control signal line. The function of the control signal line is to select the row selection transistor SEL in the corresponding pixel unit. When the control signal line controls When the row selection transistor SEL in the pixel unit row is turned on, the voltage is transmitted from the source follower transistor SF to the output terminal Ot. When the control signal line controls the row selection transistor SEL in the pixel unit row to be turned off, the pixel unit If the pixel unit in the row is not strobed, each pixel unit in the row of the pixel unit cannot output an image signal.

图15为本申请实施例中图像传感器中像素单元版图的结构示意图，图16为本申请实施例中图像传感器中像素单元版图的另一结构示意图，其中，图15中的像素单元版图采用上述实现方式二中的像素单元排布方式，图16中的像素单元版图采用上述实现方式一中的像素单元排布方式。应该说明的是，图16所示的结构除像素单元排布方式与图15所示的结构不同外，其余结构与图15所示的结构类似，在后续实施例中，均以图像传感器采用上述实现方式二中的像素排布方式进行示意，重复之处不再赘述。如图15和图16所示，像素单元内设有半导体层(如图中白色填充的图形)，半导体层可以包括：光电传感器101的PN结、传输晶体管TX的有源层、复位晶体管RST的有源层、源跟随晶体管SF的有源层及行选择晶体管SEL的有源层。此外，为了形成晶体管结构，像素单元内还可以设置栅极层，如图中深色填充的各图形，图中每一个深色填充的图像表示该晶体管内的栅极。Fig. 15 is a schematic structural diagram of the pixel unit layout in the image sensor in the embodiment of the present application, and Fig. 16 is another structural schematic diagram of the pixel unit layout in the image sensor in the embodiment of the present application, wherein the pixel unit layout in Fig. 15 adopts the above-mentioned implementation For the arrangement of pixel units in the second way, the layout of the pixel units in FIG. 16 adopts the arrangement of the pixel units in the first implementation way above. It should be noted that the structure shown in FIG. 16 is similar to the structure shown in FIG. 15 except that the arrangement of pixel units is different from that shown in FIG. 15 . The arrangement of pixels in the implementation mode 2 is illustrated, and repeated descriptions will not be repeated. As shown in Figure 15 and Figure 16, a semiconductor layer is provided in the pixel unit (as shown in the figure filled with white), and the semiconductor layer may include: the PN junction of the photosensor 101, the active layer of the transmission transistor TX, the reset transistor RST The active layer, the active layer of the source follower transistor SF and the active layer of the row selection transistor SEL. In addition, in order to form a transistor structure, a gate layer can also be provided in the pixel unit, as shown in the figures filled in dark colors, and each image filled in dark colors in the figure represents the gate in the transistor.

图17为本申请实施例中图像传感器中像素单元版图的另一结构示意图，如图17所示，上述图像传感器还可以包括：第一金属层，第一金属层包括：多条输出总线104，每一条输出总线104与一个像素单元列中的各像素单元的输出端电连接，当像素单元中的行选择晶体管SEL导通时，像素单元的图像信号可以通过输出总线104输出。输出总线104整体上沿竖直方向F2延伸，并且，输出总线104在相邻像素单元P之间的间隙中延伸，从而避免输出总线影响光电转换器101接收光线。FIG. 17 is another structural schematic diagram of the pixel unit layout in the image sensor in the embodiment of the present application. As shown in FIG. 17, the above-mentioned image sensor may further include: a first metal layer, and the first metal layer includes: a plurality of output buses 104, Each output bus 104 is electrically connected to the output terminal of each pixel unit in a pixel unit column. When the row selection transistor SEL in the pixel unit is turned on, the image signal of the pixel unit can be output through the output bus 104 . The output bus 104 extends along the vertical direction F2 as a whole, and the output bus 104 extends in the gap between adjacent pixel units P, so as to prevent the output bus from affecting the light received by the photoelectric converter 101 .

图18为本申请实施例中图像传感器中像素单元版图的另一结构示意图，如图18所示，上述图像传感器还可以包括：第二金属层，为了清楚地示意第二金属层的结构，图18中省略了第一金属层的图形，并将栅极层中各图形的填充改为白色填充。第二金属层可以包括：多条第一控制信号线105、多条第二控制信号线106及多条第三控制信号线107，第一控制信号线105与一个像素单元行中的各行选择晶体管SEL的栅极电连接，第二控制信号线106与一个像素单元行中的各源跟随晶体管SF的栅极电连接，第三控制信号线107与一个像素单元行中的各复位晶体管RST电连接。第一控制信号线105、第二控制信号线106及第三控制信号线107整体上沿水平方向F1延伸，并且，第一控制信号线105、第二控制信号线106及第三控制信号线107在相邻像素单元P之间的间隙中延伸，从而避免输出总线影响光电转换器101接收光线。Fig. 18 is another structural schematic diagram of the layout of the pixel unit in the image sensor in the embodiment of the present application. As shown in Fig. 18, the above-mentioned image sensor may further include: a second metal layer. In order to clearly illustrate the structure of the second metal layer, the figure In 18, the pattern of the first metal layer is omitted, and the filling of each pattern in the gate layer is changed to white filling. The second metal layer may include: a plurality of first control signal lines 105, a plurality of second control signal lines 106 and a plurality of third control signal lines 107, the first control signal lines 105 and the row selection transistors in a row of pixel units The gate of SEL is electrically connected, the second control signal line 106 is electrically connected to the gate of each source follower transistor SF in a pixel unit row, and the third control signal line 107 is electrically connected to each reset transistor RST in a pixel unit row . The first control signal line 105, the second control signal line 106 and the third control signal line 107 extend along the horizontal direction F1 as a whole, and the first control signal line 105, the second control signal line 106 and the third control signal line 107 Extending in the gap between adjacent pixel units P, so as to prevent the output bus from affecting the light received by the photoelectric converter 101 .

图19为图15中一个像素单元的局部放大示意图，为了更清楚的示意像素单元的内部结构，将图15中的像素单元旋转45°进行示意，如图19所示，浮动扩散节点FD的面积为半导体层中传输晶体管TX的有源层与复位晶体管RST的有源层之间的区域的面积。浮动扩散节点FD的电容由传输晶体管TX的栅极与源极的交叠电容，复位晶体管RST的栅极与源极的交叠电容，源跟随晶体管SF的栅极电容，浮动扩散节点FD的PN结电容，浮动扩散节点FD连线与周围金属走线的寄生电容等部分组成，可通过调整浮动扩散节点FD的面积来调整浮动扩散节点FD的电容，即通过调整图19中斜线填充区域的面积，来调整浮动扩散节点FD的电容，从而可以调整像素单元的转换增益。可选地，可以将白色像素单元中浮动扩散节点FD的面积，设置为大于第一彩色像素单元、第二彩色像素单元和第三彩色像素单元中浮动扩散节点FD的面积。Figure 19 is a partially enlarged schematic diagram of a pixel unit in Figure 15. In order to illustrate the internal structure of the pixel unit more clearly, the pixel unit in Figure 15 is rotated by 45° for illustration. As shown in Figure 19, the area of the floating diffusion node FD is the area of the region between the active layer of the transfer transistor TX and the active layer of the reset transistor RST in the semiconductor layer. The capacitance of the floating diffusion node FD is composed of the overlap capacitance of the gate and source of the transfer transistor TX, the overlap capacitance of the gate and source of the reset transistor RST, the gate capacitance of the source follower transistor SF, and the PN of the floating diffusion node FD The junction capacitance is composed of the parasitic capacitance of the connection line of the floating diffusion node FD and the surrounding metal traces. The capacitance of the floating diffusion node FD can be adjusted by adjusting the area of the floating diffusion node FD, that is, by adjusting The area is used to adjust the capacitance of the floating diffusion node FD, so that the conversion gain of the pixel unit can be adjusted. Optionally, the area of the floating diffusion node FD in the white pixel unit may be set to be larger than the areas of the floating diffusion node FD in the first color pixel unit, the second color pixel unit and the third color pixel unit.

以第一彩色像素单元为红色像素单元、第二彩色像素单元为绿色像素单元，第三彩色像素单元为蓝色为例，一般白色像素单元的灵敏度较高，白色像素单元的灵敏度约为红色像素单元的灵敏度的2.5倍，约为绿色像素单元的灵敏度的2倍，约为蓝色像素单元的灵敏度的3.3倍。本申请实施例中，通过缩小第一彩色像素单元、第二彩色像素单元和第三彩色像素单元中的浮动扩散节点FD的面积，或者增大白色像素单元中浮动扩散节点FD的面积，可以使第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的转换增益增大，从而可以提升第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的灵敏度，图20为像素单元的输出值与曝光时间的关系曲线示意图，如图20所示，图中曲线Yw表示白色像素单元的输出值与曝光时间的关系曲线，曲线Y1表示第一彩色像素单元的输出值与曝光时间的关系曲线，曲线Y2表示第二彩色像素单元的输出值与曝光时间的关系曲线，曲线Y3表示第三彩色像素单元的输出值与曝光时间的关系曲线。图中曲线的斜率可以反映像素单元的灵敏度，曲线的斜率越大表示像素单元的灵敏度越高，从图20可以明显看出，通过调整像素单元的浮动扩散节点FD的面积，增大了第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的灵敏度，可以使第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的灵敏度，接近白色像素单元的灵敏度，防止设置白色像素单元后出现色彩偏淡的问题，改善图像的颜色效果。Taking the first color pixel unit as a red pixel unit, the second color pixel unit as a green pixel unit, and the third color pixel unit as blue as an example, the sensitivity of a white pixel unit is generally higher, and the sensitivity of a white pixel unit is about the same as that of a red pixel unit. 2.5 times the sensitivity of the green pixel unit, about 2 times the sensitivity of the green pixel unit, and about 3.3 times the sensitivity of the blue pixel unit. In the embodiment of the present application, by reducing the area of the floating diffusion node FD in the first color pixel unit, the second color pixel unit and the third color pixel unit, or increasing the area of the floating diffusion node FD in the white pixel unit, the The conversion gain of the first color pixel unit, the second color pixel unit and the third color pixel unit is increased, so that the sensitivity of the first color pixel unit, the second color pixel unit and the third color pixel unit can be improved. Figure 20 is a pixel The schematic diagram of the relational curve between the output value of the unit and the exposure time, as shown in Figure 20, the curve Yw in the figure represents the relational curve between the output value of the white pixel unit and the exposure time, and the curve Y1 represents the output value and the exposure time of the first color pixel unit The curve Y2 represents the relationship curve between the output value of the second color pixel unit and the exposure time, and the curve Y3 represents the relationship curve between the output value of the third color pixel unit and the exposure time. The slope of the curve in the figure can reflect the sensitivity of the pixel unit. The larger the slope of the curve, the higher the sensitivity of the pixel unit. It can be clearly seen from Figure 20 that by adjusting the area of the floating diffusion node FD of the pixel unit, the first The sensitivity of the color pixel unit, the second color pixel unit and the third color pixel unit can make the sensitivity of the first color pixel unit, the second color pixel unit and the third color pixel unit close to the sensitivity of the white pixel unit, preventing setting white The problem of light color after the pixel unit improves the color effect of the image.

图21为本申请实施例中图像传感器的另一结构示意图，图22为与图21对应的图像传感器的平面结构示意图，在图22中，为了更清楚的示意，将像素单元中的透镜和滤光层用一个图形示意。如图21和图22所示，第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3中的透镜103的面积，均大于白色像素单元Pw中的透镜103的面积，第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3中的滤光层102的面积，均大于白色像素单元Pw中的滤光层102的面积。Fig. 21 is another schematic structural view of the image sensor in the embodiment of the present application, and Fig. 22 is a schematic plan view of the image sensor corresponding to Fig. 21. In Fig. 22, for a clearer illustration, the lens and filter in the pixel unit are The optical layer is represented by a figure. As shown in Figure 21 and Figure 22, the area of the lens 103 in the first color pixel unit P1, the second color pixel unit P2 and the third color pixel unit P3 is larger than the area of the lens 103 in the white pixel unit Pw. The area of the filter layer 102 in the first color pixel unit P1 , the second color pixel unit P2 and the third color pixel unit P3 is larger than the area of the filter layer 102 in the white pixel unit Pw.

以第一彩色像素单元P1为红色像素单元、第二彩色像素单元P2为绿色像素单元，第三彩色像素单元P3为蓝色为例，一般白色像素单元Pw的灵敏度较高，白色像素单元的灵敏度约为红色像素单元的灵敏度的2.5倍，约为绿色像素单元的灵敏度的2倍，约为蓝色像素单元的灵敏度的3.3倍。并且，白色像素单元Pw的输出值用于作为图像的亮度输出，因而，如果第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3的输出值都较低，容易造成图像色彩偏淡的问题。本申请实施例中，通过增大第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3中透镜103和滤光层102的面积，或者减小白色像素单元Pw中透镜103和滤光层102的面积，可以提升第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3的灵敏度，并使白色像素单元Pw的灵敏度略微减小，从而提高图像分辨率的基础上，进一步提高了图像的色彩效果。Taking the first color pixel unit P1 as a red pixel unit, the second color pixel unit P2 as a green pixel unit, and the third color pixel unit P3 as an example, the sensitivity of the white pixel unit Pw is generally higher, and the sensitivity of the white pixel unit It is about 2.5 times of the sensitivity of the red pixel unit, about 2 times of the sensitivity of the green pixel unit, and about 3.3 times of the sensitivity of the blue pixel unit. Moreover, the output value of the white pixel unit Pw is used as the brightness output of the image, therefore, if the output values of the first color pixel unit P1, the second color pixel unit P2 and the third color pixel unit P3 are all low, it is easy to cause the image The problem of tinted colors. In the embodiment of the present application, by increasing the area of the lens 103 and the filter layer 102 in the first color pixel unit P1, the second color pixel unit P2 and the third color pixel unit P3, or reducing the area of the lens 103 in the white pixel unit Pw and the area of the filter layer 102 can increase the sensitivity of the first color pixel unit P1, the second color pixel unit P2 and the third color pixel unit P3, and slightly reduce the sensitivity of the white pixel unit Pw, thereby improving the image resolution On the basis of this, the color effect of the image is further improved.

图23为调整像素单元的透镜和滤光层的面积的前后对比示意图，其中，图23中的(1)为各像素单元中的透镜和滤光层的面积相同时，各像素单元的输出值与曝光时间的关系曲线示意图，图23中的(2)为调整像素单元的透镜和滤光层的面积后，各像素单元的输出值与曝光时间的关系曲线示意图。对比图23中的(1)和(2)，图23中的(2)中第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的灵敏度，均高于图23中的(1)中第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的灵敏度。图23中的(2)中白色像素单元的灵敏度稍低于图23中的(1)中白色像素单元的灵敏度。Figure 23 is a schematic diagram of before and after adjusting the area of the lens and filter layer of the pixel unit, wherein (1) in Figure 23 is the output value of each pixel unit when the area of the lens and filter layer in each pixel unit is the same The schematic diagram of the relationship curve with the exposure time, (2) in FIG. 23 is a schematic diagram of the relationship curve between the output value of each pixel unit and the exposure time after adjusting the area of the lens and the filter layer of the pixel unit. Comparing (1) and (2) in Figure 23, the sensitivities of the first color pixel unit, the second color pixel unit and the third color pixel unit in (2) in Figure 23 are all higher than (1) in Figure 23 ) in the sensitivity of the first color pixel unit, the second color pixel unit and the third color pixel unit. The sensitivity of the white pixel unit in (2) in FIG. 23 is slightly lower than the sensitivity of the white pixel unit in (1) in FIG. 23 .

由于白色像素单元的灵敏度本身较高，因而，虽然白色像素单元的灵敏度稍有降低(例如降低为原来的0.8倍)，白色像素单元Pw的灵敏度仍然较高。通过提升第一彩色像素单元、第二彩色像素单元和第三彩色像素单元的灵敏度(例如可以将灵敏度提升为原来的1.2倍)，可以改善图像的颜色效果，防止出现色彩偏淡的问题。Since the sensitivity of the white pixel unit itself is relatively high, the sensitivity of the white pixel unit Pw is still relatively high even though the sensitivity of the white pixel unit is slightly reduced (for example, by 0.8 times the original value). By increasing the sensitivity of the first color pixel unit, the second color pixel unit and the third color pixel unit (for example, the sensitivity can be increased to 1.2 times the original), the color effect of the image can be improved and the problem of light color can be prevented.

图24为与图21对应的图像传感器的另一平面结构示意图，如图24所示，在对白色像素单元进行设置时，不同白色像素单元Pw中透镜103(或滤光层102)的面积可以不同。图25为与图21对应的图像传感器的另一平面结构示意图，如图25所示，白色像素单元中透镜103(或滤光层102)的形状可以为正方形，也可以为长方形，或者，白色像素单元中透镜103(或滤光层102)也可以为其他形状，此处不做限定。FIG. 24 is another schematic diagram of the planar structure of the image sensor corresponding to FIG. 21. As shown in FIG. 24, when the white pixel unit is set, the area of the lens 103 (or filter layer 102) in different white pixel units Pw can be different. FIG. 25 is another schematic diagram of the planar structure of the image sensor corresponding to FIG. 21. As shown in FIG. The lens 103 (or filter layer 102 ) in the pixel unit can also be in other shapes, which is not limited here.

图26为本申请实施例中图像传感器的另一结构示意图，图27为与图26对应的图像传感器的平面结构示意图，图27中省略了像素单元中透镜和滤光层等结构。如图26和图27所示，白色像素单元Pw中的光电转换器101的面积，大于第一彩色像素单元P1、第二彩色像素单元P2和第三彩色像素单元P3中的光电转换器101的面积，其中，各像素单元中光电转换器101的面积可以理解为光电转换器101的PN结的面积。图28为像素单元的输出值与曝光时间的关系曲线示意图，如图28所示，本申请实施例中，通过增大白色像素单元中光电转换器的面积，例如可以增大为1～4倍，减小第一彩色像素单元、第二彩色像素单元、第三彩色像素单元中光电转换器的面积，可以使得白色像素单元的满阱容量增加，白色像素单元更晚进入饱和，而第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的输出值可以继续增长，达到很高的输出值，从而提升了第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的输出值，防止出现图像色彩偏淡的问题，在提高图像分辨率的基础上，进一步提高了图像的色彩效果。FIG. 26 is another schematic structural diagram of the image sensor in the embodiment of the present application, and FIG. 27 is a schematic planar structural schematic diagram of the image sensor corresponding to FIG. 26 . In FIG. 27 , structures such as lenses and filter layers in the pixel unit are omitted. As shown in Figure 26 and Figure 27, the area of the photoelectric converter 101 in the white pixel unit Pw is larger than that of the photoelectric converter 101 in the first color pixel unit P1, the second color pixel unit P2 and the third color pixel unit P3 Area, wherein, the area of the photoelectric converter 101 in each pixel unit can be understood as the area of the PN junction of the photoelectric converter 101 . Figure 28 is a schematic diagram of the relationship curve between the output value of the pixel unit and the exposure time, as shown in Figure 28, in the embodiment of the present application, by increasing the area of the photoelectric converter in the white pixel unit, for example, it can be increased by 1 to 4 times , reducing the area of photoelectric converters in the first color pixel unit, the second color pixel unit, and the third color pixel unit can increase the full well capacity of the white pixel unit, and the white pixel unit enters saturation later, while the first color pixel unit The output value of the pixel unit, the second color pixel unit, and the third color pixel unit can continue to grow, reaching a very high output value, thereby improving the output of the first color pixel unit, the second color pixel unit, and the third color pixel unit value, to prevent the problem of light color of the image, and further improve the color effect of the image on the basis of improving the image resolution.

在本申请的另一实现方式中，上述光电转换器可以为光电二极管，可以将白色像素单元中的光电二极管中的N型半导体杂质注入浓度，设置为大于第一彩色像素单元、第二彩色像素单元和第三彩色像素单元中的光电二极管中的N型半导体杂质注入浓度。也就是说，本申请实施例中，通过增加白色像素单元中的光电二极管中的N型半导体杂质注入浓度，例如，可以增大为1～4倍，浓度范围可以为每平方厘米1e11至1e13个原子，杂质类型可以为磷原子或砷原子，也可以提升了白色像素单元的满阱容量，使白色像素单元更晚进入饱和，而第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的输出值可以继续增长，达到很高的输出值，从而提升了第一彩色像素单元、第二彩色像素单元、第三彩色像素单元的输出值，防止出现图像色彩偏淡的问题，在提高图像分辨率的基础上，进一步提高了图像的色彩效果。In another implementation of the present application, the above-mentioned photoelectric converter can be a photodiode, and the implantation concentration of N-type semiconductor impurities in the photodiode in the white pixel unit can be set to be greater than that of the first color pixel unit and the second color pixel unit. N-type semiconductor impurity implantation concentration in the photodiode in the unit and the third color pixel unit. That is to say, in the embodiment of the present application, by increasing the implantation concentration of N-type semiconductor impurities in the photodiode in the white pixel unit, for example, it can be increased by 1 to 4 times, and the concentration range can be 1e11 to 1e13 per square centimeter Atoms, impurity types can be phosphorus atoms or arsenic atoms, and can also increase the full well capacity of the white pixel unit, making the white pixel unit enter saturation later, while the first color pixel unit, the second color pixel unit, and the third color pixel unit The output value of the unit can continue to grow and reach a very high output value, thereby increasing the output value of the first color pixel unit, the second color pixel unit, and the third color pixel unit, preventing the problem of light color of the image. On the basis of the image resolution, the color effect of the image is further improved.

第二方面，基于同一技术构思，本申请实施例还提供了一种摄像头模组，该摄像头模组可以包括：镜头模组，以及上述任一图像传感器。其中，镜头模组用于接收入射光，并将入射光传输至图像传感器。In the second aspect, based on the same technical concept, the embodiment of the present application also provides a camera module, which may include: a lens module, and any one of the above-mentioned image sensors. Wherein, the lens module is used to receive incident light and transmit the incident light to the image sensor.

第三方面，基于同一技术构思，本申请实施例还提供了一种电子设备，该电子设备可以包括：电源，以及与电源电连接的上述任一摄像头模组。由于上述摄像头模组拍摄的图像的画质较好，可以使本申请实施例中的电子设备的用户体验较好。该电子设备可以为手机、电脑、数码相机等各种类型的设备。In a third aspect, based on the same technical concept, the embodiment of the present application further provides an electronic device, which may include: a power supply, and any one of the above camera modules electrically connected to the power supply. Since the picture quality of the image captured by the above-mentioned camera module is better, the user experience of the electronic device in the embodiment of the present application can be better. The electronic device may be various types of devices such as a mobile phone, a computer, and a digital camera.

第四方面，基于同一技术构思，本申请实施例还提供了上述任一图像传感器的图像处理方法，图29为本申请实施例提供的图像处理方法的流程图，如图29所示，该图像处理方法可以包括：In the fourth aspect, based on the same technical concept, the embodiment of the present application also provides an image processing method for any of the above-mentioned image sensors. FIG. 29 is a flow chart of the image processing method provided in the embodiment of the present application. As shown in FIG. 29 , the image Treatment methods can include:

S201、获取图像传感器接收到的第一图像信息；S201. Acquire first image information received by an image sensor;

S202、根据第一图像信息确定各白色像素单元的白色输出值、各第一彩色像素单元的第一彩色输出值、各第二彩色像素单元的第二彩色输出值以及各第三彩色图像的第三彩色输出值，以得到第二图像信息；S202. Determine the white output value of each white pixel unit, the first color output value of each first color pixel unit, the second color output value of each second color pixel unit, and the third color output value of each third color image according to the first image information Three color output values to obtain the second image information;

S203、根据第二图像信息形成多个虚拟像素单元，并确定各虚拟像素单元的输出值，以得到第三图像信息。S203. Form a plurality of virtual pixel units according to the second image information, and determine an output value of each virtual pixel unit, so as to obtain third image information.

在上述步骤S201中，可以通过读取各像素单元中的输出端输出的图像信号，从而得到图像传感器接收到的第一图像信息。In the above step S201, the first image information received by the image sensor can be obtained by reading the image signal output from the output terminal of each pixel unit.

图30为本申请实施例提供的图像处理方法的另一流程图，如图30所示，上述步骤S202可以包括：FIG. 30 is another flow chart of the image processing method provided by the embodiment of the present application. As shown in FIG. 30, the above step S202 may include:

S2021、图31a至图31c为采用上述实现方式一中的像素单元排布方式时确定第二图像信息的过程示意图，图32a至图32c为采用上述实现方式二中的像素单元排布方式时确定第二图像信息的过程示意图，如图31a和图32a所示，在第一图像信息中提取各白色像素单元的白色输出值，例如，提取图31a中的(1)中的第一图像信息中白色像素单元Pw的白色输出值，得到图31a中的(2)中的图像信息，又如，提取图32a中的(1)中的第一图像信息中白色像素单元Pw的白色输出值，得到图32a中的(2)中的图像信息。其中，在图31a中的(2)和图32a中的(2)中，有填充图案的部分表示白色像素单元Pw的白色输出值，无填充图案的部分表示第一缺失像素单元Px1，第一缺失像素单元Px1为除各白色像素单元Pw外的像素单元。S2021, Figure 31a to Figure 31c are schematic diagrams of the process of determining the second image information when the pixel unit arrangement in the above-mentioned implementation mode 1 is adopted, and Figure 32a to Figure 32c are determinations when the pixel unit arrangement in the above-mentioned implementation mode 2 is adopted Schematic diagram of the process of the second image information, as shown in Figure 31a and Figure 32a, extract the white output value of each white pixel unit in the first image information, for example, extract the first image information in (1) in Figure 31a The white output value of the white pixel unit Pw is obtained from the image information in (2) in Figure 31a, and for another example, the white output value of the white pixel unit Pw in the first image information in (1) in Figure 32a is extracted to obtain Image information in (2) in Fig. 32a. Among them, in (2) in FIG. 31a and (2) in FIG. 32a , the part with the filling pattern represents the white output value of the white pixel unit Pw, the part without the filling pattern represents the first missing pixel unit Px1, and the first The missing pixel unit Px1 is a pixel unit other than each white pixel unit Pw.

对于除各白色像素单元Px1外的每一个第一缺失像素单元Px1，采用第一缺失像素单元Px1周围的各白色输出值的平均值作为该第一缺失像素单元Px1的白色输出值，以得到所有像素单元的白色输出值，每一个像素单元的白色输出值可以作为该像素单元的亮度输出值。例如，对于图31a中的(2)中的每一个第一缺失像素单元Px1，第一缺失像素单元Px1的白色输出值可以通过周围四个白色像素单元Pw的白色输出值取平均得到，如果第一缺失像素单元Px1的数量较多，对于剩余的各第一缺失像素单元Px1，第一缺失像素单元Px1的白色输出值可以通过周围四个像素单元的白色输出值取平均得到，以此类推，最终得到如图31a中的(3)所示的所有像素单元的白色输出值。又如，对于图32a中的(2)中的每一个第一缺失像素单元Px1，第一缺失像素单元Px1的白色输出值可以通过周围六个白色像素单元Pw的白色输出值取平均得到，如果第一缺失像素单元Px1的数量较多，对于剩余的各第一缺失像素单元Px1，第一缺失像素单元Px1的白色输出值可以通过周围六个像素单元的白色输出值取平均得到，以此类推，最终得到如图32a中的(3)所示的所有像素单元的白色输出值。For each first missing pixel unit Px1 except each white pixel unit Px1, the average value of the white output values around the first missing pixel unit Px1 is used as the white output value of the first missing pixel unit Px1 to obtain all The white output value of the pixel unit, the white output value of each pixel unit may be used as the brightness output value of the pixel unit. For example, for each first missing pixel unit Px1 in (2) in Figure 31a, the white output value of the first missing pixel unit Px1 can be obtained by averaging the white output values of the surrounding four white pixel units Pw, if The number of missing pixel units Px1 is large, and for the remaining first missing pixel units Px1, the white output value of the first missing pixel unit Px1 can be obtained by averaging the white output values of the surrounding four pixel units, and so on, Finally, the white output values of all pixel units as shown in (3) in Fig. 31a are obtained. As another example, for each first missing pixel unit Px1 in (2) in FIG. 32a, the white output value of the first missing pixel unit Px1 can be obtained by averaging the white output values of the surrounding six white pixel units Pw, if The number of the first missing pixel unit Px1 is large, and for the remaining first missing pixel units Px1, the white output value of the first missing pixel unit Px1 can be obtained by averaging the white output values of the surrounding six pixel units, and so on , and finally obtain the white output values of all pixel units as shown in (3) in FIG. 32a.

S2022、在第一图像信息中提取第一彩色像素单元的第一彩色输出值，例如，提取图31b中的(1)中的第一图像信息中第一彩色像素单元P1的第一彩色输出值，得到图31b中的(2)中的图像信息，又如，提取图32b中的(1)中的第一图像信息中第一彩色像素单元P1第一彩色输出值，得到图32b中的(2)中的图像信息。其中，在图31b中的(2)和图32b中的(2)中，有填充图案的部分表示第一彩色像素单元P1的第一彩色输出值，无填充图案的部分表示第二缺失像素单元Px2，第二缺失像素单元Px2为除各第一彩色像素单元P1外的像素单元。S2022. Extract the first color output value of the first color pixel unit in the first image information, for example, extract the first color output value of the first color pixel unit P1 in the first image information in (1) in FIG. 31b , to obtain the image information in (2) in Figure 31b, and for another example, extract the first color output value of the first color pixel unit P1 in the first image information in (1) in Figure 32b, and obtain the ( 2) Image information in. Among them, in (2) in FIG. 31b and (2) in FIG. 32b, the part with the filling pattern represents the first color output value of the first color pixel unit P1, and the part without the filling pattern represents the second missing pixel unit Px2, the second missing pixel unit Px2 is a pixel unit other than each first color pixel unit P1.

将每一个第一彩色像素单元的第一彩色输出值作为周围各第二缺失像素单元的第一彩色输出值，以得到所有像素单元的第一彩色输出值。例如，对于图31b中的(2)中的每一个第一彩色像素单元P1，该第一彩色像素单元P1的第一彩色输出值可以作为周围八个第二缺失像素单元Px2的第一彩色输出值，如果第二缺失像素单元Px2的数量较多，剩余的第二缺失像素单元Px2的第一彩色输出值可以通过周围的四个像素单元的第一彩色输出值取平均得到，以此类推，最终得到如图31b中的(3)所示的所有像素单元的第一彩色输出值。又如，对于图32b中的(2)中的每一个第一彩色像素单元P1，该第一彩色像素单元P1的第一彩色输出值可以作为周围六个第二缺失像素单元Px2的第一彩色输出值，如图32b中的(3)，如果第二缺失像素单元Px2的数量较多，剩余的第二缺失像素单元Px2的第一彩色输出值可以通过周围的六个像素单元的第一彩色输出值取平均得到，以此类推，最终得到如图32b中的(4)所示的所有像素单元的第一彩色输出值。The first color output value of each first color pixel unit is used as the first color output value of the surrounding second missing pixel units, so as to obtain the first color output values of all pixel units. For example, for each first color pixel unit P1 in (2) in FIG. value, if the number of the second missing pixel unit Px2 is large, the first color output value of the remaining second missing pixel unit Px2 can be obtained by averaging the first color output values of the surrounding four pixel units, and so on, Finally, the first color output values of all pixel units as shown in (3) in FIG. 31b are obtained. As another example, for each first color pixel unit P1 in (2) in FIG. The output value is as shown in (3) in Figure 32b. If the number of the second missing pixel unit Px2 is large, the first color output value of the remaining second missing pixel unit Px2 can pass through the first color of the surrounding six pixel units. The output values are averaged, and so on, to finally obtain the first color output values of all pixel units as shown in (4) in FIG. 32b.

S2023、在第一图像信息中提取第二彩色像素单元的第二彩色输出值，将每一个第二彩色像素单元的第二彩色输出值作为周围各第三缺失像素单元的第二彩色输出值，以得到所有像素单元的第二彩色输出值，其中，第三缺失像素单元为除各第二彩色像素单元外的像素单元；S2023. Extract the second color output value of the second color pixel unit from the first image information, and use the second color output value of each second color pixel unit as the second color output value of each third missing pixel unit around, to obtain the second color output values of all pixel units, wherein the third missing pixel unit is a pixel unit other than each second color pixel unit;

S2024、在第一图像信息中提取第三彩色像素单元的第三彩色输出值，将每一个第三彩色像素单元的第三彩色输出值作为周围各第四缺失像素单元的第三彩色输出值，以得到所有像素单元的第三彩色输出值，其中，第四缺失像素单元为除各第二彩色像素单元外的像素单元；S2024. Extract the third color output value of the third color pixel unit from the first image information, and use the third color output value of each third color pixel unit as the third color output value of each surrounding fourth missing pixel unit, to obtain the third color output values of all pixel units, wherein the fourth missing pixel unit is a pixel unit except each second color pixel unit;

步骤S2023和步骤S2024的过程，与步骤S2022的过程类似，步骤S2023和步骤S2024可以参照步骤S2022执行，重复之处不再赘述。The process of step S2023 and step S2024 is similar to the process of step S2022. Step S2023 and step S2024 can be executed with reference to step S2022, and the repeated description will not be repeated.

S2025、如图31c和图32c所示，将所有像素单元的白色输出值、第一彩色输出值、第二彩色输出值及第三彩色输出值进行融合，得到第二图像信息。例如，可以对计算得到的各像素单元的输出值进行整理，使得每一个像素单元均具有白色输出值、第一彩色输出值、第二彩色输出值、第三彩色输出值。S2025. As shown in FIG. 31c and FIG. 32c , fuse the white output value, first color output value, second color output value and third color output value of all pixel units to obtain second image information. For example, the calculated output values of each pixel unit may be arranged so that each pixel unit has a white output value, a first color output value, a second color output value, and a third color output value.

可以理解的是，图31a至图31c以实现方式一中的其中一种像素单元排布方式为例，对确定第二图像信息的过程进行示意，对于实现方式一中其余像素单元排布方式，也可以采用上述步骤S202中的方式确定第二图像信息，此处不再一一赘述。同样的，图32a至图32c以实现方式二中的像素单元排布方式为例，对确定第二图像信息的过程进行示意，对于实现方式二中其余像素单元排布方式，也可以采用上述步骤S202中的方式确定第二图像信息，也不再一一赘述。It can be understood that, Fig. 31a to Fig. 31c take one of the arrangement of pixel units in the first implementation as an example to illustrate the process of determining the second image information, and for the arrangement of other pixel units in the first implementation, The second image information may also be determined in the manner in step S202 above, which will not be repeated here. Similarly, Fig. 32a to Fig. 32c take the arrangement of pixel units in the implementation mode 2 as an example to illustrate the process of determining the second image information. For the arrangement of other pixel units in the implementation mode 2, the above steps can also be adopted The manner in S202 is to determine the second image information, which will not be described one by one.

在本申请实施例中，上述步骤S203可以包括：In the embodiment of this application, the above step S203 may include:

图33为在上述实现方式一中的像素单元排布方式中形成多个虚拟像素单元的示意图，图34为在上述实现方式二中的像素单元排布方式中形成多个虚拟像素单元的示意图。如图33和图34所示，多个虚拟像素单元Py分别排布于像素单元行和像素单元列中(图中用虚线标示像素单元行和像素单元列)，这样，可以使图像的分辨率提升两倍。虚拟像素单元Py的输出值为周围的各像素单元P的输出值的平均值；其中，像素单元P的输出值为白色输出值、第一彩色输出值、第二彩色输出值或第三彩色输出值。可选地，虚拟像素单元Py的输出值可以为同一像素单元行中相邻的两个像素单元P的输出值的平均值；或者，虚拟像素单元Py的输出值可以为同一像素单元列中相邻的两个像素单元P的输出值的平均值；或者，虚拟像素单元Py的输出值可以为周围相邻的四个像素单元P的输出值的平均值。FIG. 33 is a schematic diagram of forming a plurality of virtual pixel units in the arrangement of pixel units in the first implementation, and FIG. 34 is a schematic diagram of forming a plurality of virtual pixel units in the arrangement of pixel units in the second implementation. As shown in Figure 33 and Figure 34, a plurality of virtual pixel units Py are respectively arranged in the pixel unit rows and pixel unit columns (dotted lines are used to mark the pixel unit rows and pixel unit columns in the figure), so that the resolution of the image can be improved. Boost twice. The output value of the virtual pixel unit Py is the average value of the output values of the surrounding pixel units P; wherein, the output value of the pixel unit P is the white output value, the first color output value, the second color output value or the third color output value value. Optionally, the output value of the virtual pixel unit Py can be the average value of the output values of two adjacent pixel units P in the same pixel unit row; or, the output value of the virtual pixel unit Py can be the same pixel unit row. The average value of the output values of two adjacent pixel units P; or, the output value of the virtual pixel unit Py may be the average value of the output values of the surrounding four adjacent pixel units P.

尽管已描述了本申请的优选实施例，但本领域内的技术人员一旦得知了基本创造性概念，则可对这些实施例作出另外的变更和修改。所以，所附权利要求意欲解释为包括优选实施例以及落入本申请范围的所有变更和修改。While preferred embodiments of the present application have been described, additional changes and modifications to these embodiments can be made by those skilled in the art once the basic inventive concept is appreciated. Therefore, the appended claims are intended to be construed to cover the preferred embodiment and all changes and modifications which fall within the scope of the application.

显然，本领域的技术人员可以对本申请实施例进行各种改动和变型而不脱离本申请实施例的精神和范围。这样，倘若本申请实施例的这些修改和变型属于本申请权利要求及其等同技术的范围之内，则本申请也意图包含这些改动和变型在内。Apparently, those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. In this way, if the modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and equivalent technologies, the present application also intends to include these modifications and variations.

Claims

一种图像传感器，其特征在于，包括：沿水平方向和竖直方向呈阵列排布的多个像素单元；An image sensor, characterized in that it includes: a plurality of pixel units arranged in an array along a horizontal direction and a vertical direction;

所述多个像素单元包括：多个白色像素单元、多个第一彩色像素单元、多个第二彩色像素单元及多个第三彩色像素单元；The plurality of pixel units include: a plurality of white pixel units, a plurality of first color pixel units, a plurality of second color pixel units, and a plurality of third color pixel units;

所述多个像素单元中的每一个所述像素单元的形状为多边形，且每一个所述像素单元的至少一个边与所述水平方向之间的夹角为锐角；Each of the plurality of pixel units has a polygonal shape, and an angle between at least one side of each of the pixel units and the horizontal direction is an acute angle;

所述多个像素单元构成多个像素单元行，每一个所述像素单元行包括沿所述水平方向排列的多个所述像素单元；所述多个像素单元行中任意相邻两个所述像素单元行错位设置；The plurality of pixel units constitute a plurality of pixel unit rows, and each pixel unit row includes a plurality of pixel units arranged along the horizontal direction; any two adjacent pixel unit rows in the plurality of pixel unit rows Pixel unit line misalignment setting;

所述多个像素单元构成多个像素单元列，每一个所述像素单元列包括沿所述竖直方向排列的多个所述像素单元；所述多个像素单元行中任意相邻两个所述像素单元列错位设置。The plurality of pixel units form a plurality of pixel unit columns, and each of the pixel unit columns includes a plurality of pixel units arranged along the vertical direction; any two adjacent pixel unit rows in the plurality of pixel unit rows The above-mentioned pixel unit columns are set in dislocation.
如权利要求1所述的图像传感器，其特征在于，所述多个像素单元中的每一个所述像素单元的形状为六边形。The image sensor according to claim 1, wherein each of the plurality of pixel units is hexagonal in shape.
如权利要求2所述的图像传感器，其特征在于，所述多个像素单元中的每一个所述像素单元包括：与所述水平方向平行的第一侧边和第二侧边、与所述第一侧边相连的第三侧边和第四侧边，以及与所述第二侧边相连的第五侧边和第六侧边；所述第三侧边与所述第五侧边相连，所述第四侧边与所述第六侧边相连；The image sensor according to claim 2, wherein each of the plurality of pixel units includes: a first side and a second side parallel to the horizontal direction, and the The third side and the fourth side connected to the first side, and the fifth side and the sixth side connected to the second side; the third side is connected to the fifth side , the fourth side is connected to the sixth side;

所述第三侧边与所述第五侧边之间的夹角为90°，所述第四侧边与所述第六侧边之间的夹角为90°；所述第一侧边与所述第三侧边之间的夹角为135°，所述第一侧边与所述第四侧边之间的夹角为135°，所述第二侧边与所述第五侧边之间的夹角为135°，所述第二侧边与所述第六侧边之间的夹角为135°。The angle between the third side and the fifth side is 90°, the angle between the fourth side and the sixth side is 90°; the first side The angle between the third side and the third side is 135°, the angle between the first side and the fourth side is 135°, and the second side and the fifth side The included angle between the sides is 135°, and the included angle between the second side and the sixth side is 135°.
如权利要求2或3所述的图像传感器，其特征在于，所述多个像素单元行包括：多个第一像素单元行和多个第二像素单元行；所述多个像素单元行中的任意相邻两个所述第一像素单元行之间间隔两个所述第二像素单元行；The image sensor according to claim 2 or 3, wherein the plurality of pixel unit rows comprises: a plurality of first pixel unit rows and a plurality of second pixel unit rows; Any two adjacent rows of first pixel units are separated by two rows of second pixel units;

每一个所述第一像素单元行包括：多个所述第一彩色像素单元，多个所述第二彩色像素单元和多个所述第三彩色像素单元，每一个所述第一像素单元行中的所述像素单元按照所述第一彩色像素单元、所述第三彩色像素单元、所述第二彩色像素单元的顺序重复排列；Each of the first pixel unit rows includes: a plurality of the first color pixel units, a plurality of the second color pixel units and a plurality of the third color pixel units, each of the first pixel unit rows The pixel units in the array are repeatedly arranged in the order of the first color pixel unit, the third color pixel unit, and the second color pixel unit;

所述多个像素单元列包括：多个第一像素单元列，多个第二像素单元列和多个第三像素单元列，所述多个像素单元列按照所述第一像素单元列、所述第二像素单元列、所述第三像素单元列的顺序重复排列；The plurality of pixel unit rows include: a plurality of first pixel unit rows, a plurality of second pixel unit rows and a plurality of third pixel unit rows, and the plurality of pixel unit rows are arranged according to the first pixel unit row, the plurality of pixel unit rows The order of the second pixel unit column and the third pixel unit column is repeatedly arranged;

所述第一像素单元列包括：多个所述第一彩色像素单元和多个所述白色像素单元；在所述第一像素单元列中，相邻两个所述第一彩色像素单元之间间隔两个所述白色像素单元；The first pixel unit column includes: a plurality of the first color pixel units and a plurality of the white pixel units; in the first pixel unit column, between two adjacent first color pixel units two white pixel units are spaced apart;

所述第二像素单元列包括：多个所述第二彩色像素单元和多个所述白色像素单元；在所述第二像素单元列中，相邻两个所述第二彩色像素单元之间间隔两个所述白色像素单元；The second pixel unit column includes: a plurality of the second color pixel units and a plurality of the white pixel units; in the second pixel unit column, between two adjacent second color pixel units two white pixel units are spaced apart;

所述第三像素单元列包括：多个所述第三彩色像素单元和多个所述白色像素单元；在所述第三像素单元列中，相邻两个所述第三彩色像素单元之间间隔两个所述白色像素单元。The third pixel unit column includes: a plurality of the third color pixel units and a plurality of the white pixel units; in the third pixel unit column, between two adjacent third color pixel units Two white pixel units are spaced apart.
如权利要求2或3所述的图像传感器，其特征在于，所述多个像素单元包括多个重复单元；The image sensor according to claim 2 or 3, wherein the plurality of pixel units comprises a plurality of repeating units;

每一个所述重复单元包括：分布于相邻的两个所述像素单元列和相邻的五个所述像素单元行的五个所述像素单元；所述重复单元中的其中一个所述像素单元列包括：一个所述第一彩色像素单元、一个所述第二彩色像素单元和一个所述第三彩色像素单元，另一个所述像素单元列包括：两个所述白色像素单元。Each of the repeating units includes: five pixel units distributed in two adjacent pixel unit columns and five adjacent pixel unit rows; one of the pixels in the repeating unit The unit column includes: one first color pixel unit, one second color pixel unit, and one third color pixel unit, and the other pixel unit column includes: two white pixel units.
如权利要求2或3所述的图像传感器，其特征在于，所述多个像素单元包括多个重复单元；The image sensor according to claim 2 or 3, wherein the plurality of pixel units comprises a plurality of repeating units;

每一个所述重复单元包括：分布于相邻的五个所述像素单元行和相邻的五个所述像素单元列的九个所述像素单元；Each of the repeating units includes: nine pixel units distributed in five adjacent pixel unit rows and five adjacent pixel unit columns;

所述重复单元包括：位于中间的所述像素单元行的三个所述白色像素单元，以及分布于其余的四个所述像素单元行的两个所述第一彩色像素单元、两个所述第二彩色像素单元和两个所述第三彩色像素单元，其中，两个所述第一彩色像素单元、两个所述第二彩色像素单元和两个所述第三彩色像素单元围绕位于中间的所述白色像素单元排列为环状。The repeating unit includes: three white pixel units located in the middle pixel unit row, and two first color pixel units and two pixel unit rows distributed in the remaining four pixel unit rows. The second color pixel unit and the two third color pixel units, wherein the two first color pixel units, the two second color pixel units and the two third color pixel units are located in the middle The white pixel units are arranged in a ring shape.
如权利要求2或3所述的图像传感器，其特征在于，所述多个像素单元包括多个重复单元；The image sensor according to claim 2 or 3, wherein the plurality of pixel units comprises a plurality of repeating units;

每一个所述重复单元包括：分布于相邻的五个所述像素单元行和相邻的三个所述像素单元列的七个所述像素单元；Each of the repeating units includes: seven pixel units distributed in five adjacent pixel unit rows and three adjacent pixel unit columns;

在每一个所述重复单元中，位于中间的所述像素单元列包括：一个所述第一彩色像素单元、一个所述第二彩色像素单元和一个所述第三彩色像素单元，其余的两个所述像素单元列均包括两个所述白色像素单元。In each of the repeating units, the pixel unit column in the middle includes: one pixel unit of the first color, one pixel unit of the second color and one pixel unit of the third color, and the remaining two The pixel unit columns each include two white pixel units.
如权利要求2或3所述的图像传感器，其特征在于，所述多个像素单元包括多个重复单元；The image sensor according to claim 2 or 3, wherein the plurality of pixel units comprises a plurality of repeating units;

每一个所述重复单元包括：分布于相邻的五个所述像素单元行和相邻的三个所述像素单元列的七个所述像素单元；Each of the repeating units includes: seven pixel units distributed in five adjacent pixel unit rows and three adjacent pixel unit columns;

在每一个所述重复单元中，其中一个所述像素单元位于中间，其余的六个像素单元围绕位于中间的所述像素单元排列为环状；所述重复单元包括：一个所述第一彩色像素单元、一个所述第二彩色像素单元、一个所述第三彩色像素单元和四个所述白色像素单元，其中，所述第一彩色像素单元、所述第二彩色像素单元和所述第三彩色像素单元分布于两个所述像素单元列和三个所述像素单元行中。In each of the repeating units, one of the pixel units is located in the middle, and the remaining six pixel units are arranged in a ring around the pixel unit located in the middle; the repeating unit includes: one of the first color pixels unit, one second color pixel unit, one third color pixel unit and four white pixel units, wherein the first color pixel unit, the second color pixel unit and the third color pixel unit The color pixel units are distributed in two pixel unit columns and three pixel unit rows.
如权利要求1所述的图像传感器，其特征在于，所述多个像素单元中的每一个所述像素单元的形状为矩形。The image sensor according to claim 1, wherein each of the plurality of pixel units is rectangular in shape.
如权利要求9所述的图像传感器，其特征在于，所述多个像素单元中的每一个所述像素单元的形状为正方形，且每一个所述像素单元的至少一个边与所述水平方向之间的夹角为45°。The image sensor according to claim 9, wherein the shape of each of the plurality of pixel units is a square, and the distance between at least one side of each of the pixel units and the horizontal direction is The angle between them is 45°.
如权利要求9或10所述的图像传感器，其特征在于，所述多个像素单元行包括至少一个白色像素单元行，所述白色像素单元行中的每一个所述像素单元均为所述白色像素单元。The image sensor according to claim 9 or 10, wherein the plurality of pixel unit rows include at least one white pixel unit row, and each of the pixel units in the white pixel unit row is the white color pixel unit.
如权利要求11所述的图像传感器，其特征在于，所述多个像素单元行还包括多个彩色像素单元行，所述彩色像素单元行包括所述第一彩色像素单元、所述第二彩色像素单元及所述第三彩色像素单元中的至少一个；The image sensor according to claim 11, wherein the plurality of pixel unit rows further include a plurality of color pixel unit rows, and the color pixel unit rows include the first color pixel unit, the second color pixel unit, and the second color pixel unit row. at least one of a pixel unit and the third color pixel unit;

所述多个彩色像素单元行中的任意相邻两个所述彩色像素单元行之间间隔至少一个所述白色像素单元行；There is at least one white pixel unit row between any two adjacent color pixel unit rows among the plurality of color pixel unit rows;

所述多个像素单元列包括多个彩色像素单元列，所述彩色像素单元列包括所述第一彩色像素单元、所述第二彩色像素单元及所述第三彩色像素单元中的至少一个。The plurality of pixel unit columns include a plurality of color pixel unit columns, and the color pixel unit columns include at least one of the first color pixel unit, the second color pixel unit, and the third color pixel unit.
如权利要求12所述的图像传感器，其特征在于，所述多个像素单元行中的所述白色像素单元行与所述彩色像素单元行交替排布；The image sensor according to claim 12, wherein the white pixel unit rows and the color pixel unit rows in the plurality of pixel unit rows are arranged alternately;

所述多个彩色像素单元行包括：交替排布的多个第一彩色像素单元行和多个第二彩色像素单元行；The plurality of color pixel unit rows include: a plurality of first color pixel unit rows and a plurality of second color pixel unit rows arranged alternately;

所述第一彩色像素单元行包括：交替排列的多个所述第一彩色像素单元和多个所述第二彩色像素单元；The first color pixel unit row includes: a plurality of the first color pixel units and a plurality of the second color pixel units arranged alternately;

所述第二彩色像素单元行包括：交替排列的多个所述第二彩色像素单元和多个所述第三彩色像素单元；The second color pixel unit row includes: a plurality of the second color pixel units and a plurality of the third color pixel units arranged alternately;

所述第一彩色像素单元行中的所述第二彩色像素单元，与所述第二彩色像素单元行中的所述第二彩色像素单元位于不同的彩色像素单元列。The second color pixel unit in the first color pixel unit row is located in a different color pixel unit column than the second color pixel unit in the second color pixel unit row.
如权利要求12所述的图像传感器，其特征在于，所述多个像素单元行中的所述白色像素单元行与所述彩色像素单元行交替排布；The image sensor according to claim 12, wherein the white pixel unit rows and the color pixel unit rows in the plurality of pixel unit rows are arranged alternately;

每一个所述彩色像素单元行中的所述像素单元按照所述第一彩色像素单元、所述第二彩色像素单元、所述第三彩色像素单元的顺序重复排列；The pixel units in each color pixel unit row are repeatedly arranged in the order of the first color pixel unit, the second color pixel unit, and the third color pixel unit;

每一个所述彩色像素单元列中的所述像素单元按照所述第一彩色像素单元、所述第二彩色像素单元、所述第三彩色像素单元的顺序重复排列。The pixel units in each column of color pixel units are repeatedly arranged in the order of the first color pixel unit, the second color pixel unit, and the third color pixel unit.
如权利要求12所述的图像传感器，其特征在于，所述多个像素单元行中的所述白色像素单元行与所述彩色像素单元行交替排布；The image sensor according to claim 12, wherein the white pixel unit rows and the color pixel unit rows in the plurality of pixel unit rows are arranged alternately;

所述多个彩色像素单元行包括：多个第一彩色像素单元行、多个第二彩色像素单元行、多个第三彩色像素单元行及多个第四彩色像素单元行，且所述多个彩色像素单元行中的所述彩色像素单元行按照所述第一彩色像素单元行、所述第二彩色像素单元行、所述第三彩色像素单元行、所述第四彩色像素单元行的顺序重复排列；The plurality of color pixel unit rows includes: a plurality of first color pixel unit rows, a plurality of second color pixel unit rows, a plurality of third color pixel unit rows and a plurality of fourth color pixel unit rows, and the plurality of The color pixel unit row in the color pixel unit row according to the first color pixel unit row, the second color pixel unit row, the third color pixel unit row, and the fourth color pixel unit row repeat sequence;

所述第一彩色像素单元行包括：多个所述白色像素单元、多个所述第一彩色像素单元及多个所述第三彩色像素单元，所述第一彩色像素单元行中的所述像素单元按照所述白色像素单元、所述第一彩色像素单元、所述白色像素单元、所述第三彩色像素单元的顺序重复排列；The first color pixel unit row includes: a plurality of the white pixel units, a plurality of the first color pixel units and a plurality of the third color pixel units, the first color pixel unit row The pixel units are repeatedly arranged in the order of the white pixel unit, the first color pixel unit, the white pixel unit, and the third color pixel unit;

所述第二彩色像素单元行包括：交替排列的多个所述白色像素单元和多个所述第二彩色像素单元；The second color pixel unit row includes: a plurality of the white pixel units and a plurality of the second color pixel units arranged alternately;

所述第三彩色像素单元行包括：多个所述白色像素单元、多个所述第一彩色像素单元及多个所述第三彩色像素单元，所述第三彩色像素单元行中的像素单元按照所述白色像素单元、所述第三彩色像素单元、所述白色像素单元、所述第一彩色像素单元的顺序重复排列；所述第一彩色像素单元行中的所述第一彩色像素单元，与所述第三彩色像素单元行中的所述第一彩色像素单元位于不同的所述彩色像素单元列；The third color pixel unit row includes: a plurality of the white pixel units, a plurality of the first color pixel units and a plurality of the third color pixel units, and the pixel units in the third color pixel unit row Repeatedly arranged in the order of the white pixel unit, the third color pixel unit, the white pixel unit, and the first color pixel unit; the first color pixel unit in the row of the first color pixel unit , being located in a column of color pixel units different from that of the first color pixel unit in the third color pixel unit row;

所述第四彩色像素单元行包括：交替排列的多个所述白色像素单元和多个所述第二彩色像素单元；所述第四彩色像素单元行中多个所述像素单元的排列顺序，与所述第二彩色像素单元行中的多个所述像素单元的排列顺序相同。The fourth color pixel unit row includes: a plurality of white pixel units and a plurality of second color pixel units arranged alternately; the arrangement order of the plurality of pixel units in the fourth color pixel unit row, The arrangement order of the plurality of pixel units in the second color pixel unit row is the same.
如权利要求12所述的图像传感器，其特征在于，所述多个彩色像素单元行中的任意相邻两个所述彩色像素单元行之间间隔两个所述白色像素单元行；The image sensor according to claim 12, characterized in that, any two adjacent color pixel unit rows in the plurality of color pixel unit rows are separated by two white pixel unit rows;

每一个所述彩色像素单元行中的所述像素单元按照所述第一彩色像素单元、所述第二彩色像素单元、所述第三彩色像素单元的顺序重复排列；The pixel units in each color pixel unit row are repeatedly arranged in the order of the first color pixel unit, the second color pixel unit, and the third color pixel unit;

所述多个彩色像素单元列包括：多个第一彩色像素单元列，多个第二彩色像素单元列和多个第三彩色像素单元列，所述多个彩色像素单元列按照所述第一彩色像素单元列、所述第二彩色像素单元列、所述第三彩色像素单元列的顺序重复排列；The plurality of color pixel unit columns include: a plurality of first color pixel unit columns, a plurality of second color pixel unit columns and a plurality of third color pixel unit columns, and the plurality of color pixel unit columns according to the first The order of the color pixel unit column, the second color pixel unit column, and the third color pixel unit column is repeatedly arranged;

所述第一彩色像素单元列包括：多个所述第一彩色像素单元和多个白色像素单元；在所述第一彩色像素单元列中，相邻两个所述第一彩色像素单元之间间隔两个所述白色像素单元；The first color pixel unit column includes: a plurality of the first color pixel units and a plurality of white pixel units; in the first color pixel unit column, between two adjacent first color pixel units two white pixel units are spaced apart;

所述第二彩色像素单元列包括：多个所述第三彩色像素单元和多个白色像素单元；在所述第二彩色像素单元列中，相邻两个所述第三彩色像素单元之间间隔两个所述白色像素单元；The second color pixel unit column includes: a plurality of the third color pixel units and a plurality of white pixel units; in the second color pixel unit column, between two adjacent third color pixel units two white pixel units are spaced apart;

所述第三彩色像素单元列包括：多个所述第二彩色像素单元和多个白色像素单元；在所述第三彩色像素单元列中，相邻两个所述第二彩色像素单元之间间隔两个所述白色像素单元。The third color pixel unit column includes: a plurality of the second color pixel units and a plurality of white pixel units; in the third color pixel unit column, between two adjacent second color pixel units Two white pixel units are spaced apart.
如权利要求9或10所述的图像传感器，其特征在于，所述多个像素单元行包括：多个第一像素单元行、多个第二像素单元行及多个第三像素单元行；The image sensor according to claim 9 or 10, wherein the plurality of pixel unit rows comprises: a plurality of first pixel unit rows, a plurality of second pixel unit rows, and a plurality of third pixel unit rows;

所述第一像素单元行包括：多个所述白色像素单元和多个所述第一彩色像素单元，在所述第一像素单元行中，相邻两个所述第一彩色像素单元之间间隔三个所述白色像素单元；The first pixel unit row includes: a plurality of the white pixel units and a plurality of the first color pixel units, in the first pixel unit row, between two adjacent first color pixel units spaced by three white pixel units;

所述第二像素单元行包括：多个所述白色像素单元和多个所述第二彩色像素单元，在所述第二像素单元行中，相邻两个所述第二彩色像素单元之间间隔三个所述白色像素单元；The second pixel unit row includes: a plurality of the white pixel units and a plurality of the second color pixel units, in the second pixel unit row, between two adjacent second color pixel units spaced by three white pixel units;

所述第三像素单元行包括：多个所述白色像素单元和多个所述第三彩色像素单元，在所述第三像素单元行中，相邻两个所述第三彩色像素单元之间间隔三个所述白色像素单元；The third pixel unit row includes: a plurality of the white pixel units and a plurality of the third color pixel units, in the third pixel unit row, between two adjacent third color pixel units spaced by three white pixel units;

在所述多个第一像素单元行中，相对于第m个所述第一像素单元行中的各所述像素单元，第m+1个所述第一像素单元行中的各所述像素单元，沿所述水平方向错位半个所述像素单元的距离；其中，第m+1个所述第一像素单元行为第m个所述第一像素单元行在所述竖直方向上的下一个第一像素单元行，其中，m为大于零且小于所述第一像素单元行的总数量的正整数；In the plurality of first pixel unit rows, relative to each pixel unit in the mth first pixel unit row, each of the pixels in the (m+1)th first pixel unit row The unit is displaced along the horizontal direction by half the distance of the pixel unit; wherein, the m+1th row of the first pixel unit is below the mth row of the first pixel unit in the vertical direction A first pixel unit row, wherein m is a positive integer greater than zero and less than the total number of the first pixel unit row;

在所述多个第二像素单元行中，相对于第n个所述第二像素单元行中的各所述像素单元，第n+1个所述第二像素单元行中的各所述像素单元，沿所述水平方向错位半个所述像素单元的距离；其中，第n+1个所述第二像素单元行为第n个所述第二像素单元行在所述竖直方向上的下一个第二像素单元行，其中，n为大于零且小于所述第二像素单元行的总数量的正整数；In the plurality of second pixel unit rows, relative to each pixel unit in the nth second pixel unit row, each of the pixels in the (n+1)th second pixel unit row The unit is displaced along the horizontal direction by half the distance of the pixel unit; wherein, the n+1th second pixel unit row is below the nth second pixel unit row in the vertical direction A second pixel unit row, wherein n is a positive integer greater than zero and less than the total number of the second pixel unit row;

在所述多个第三像素单元行中，相对于第k个所述第三像素单元行中的各所述像素单元，第k+1个所述第三像素单元行中的各所述像素单元，沿所述水平方向错位半个所述像素单元的距离；其中，第k+1个所述第三像素单元行为第k个所述第三像素单元行在所述竖直方向上的下一个第三像素单元行，其中，k为大于零且小于所述第三像素单元行的总数量的正整数。In the plurality of third pixel unit rows, relative to each pixel unit in the kth third pixel unit row, each pixel in the k+1th third pixel unit row The unit is displaced along the horizontal direction by half the distance of the pixel unit; wherein, the k+1th third pixel unit row is below the kth third pixel unit row in the vertical direction A third pixel unit row, wherein k is a positive integer greater than zero and less than the total number of the third pixel unit row.
如权利要求1所述的图像传感器，其特征在于，所述白色像素单元的数量与所述多个像素单元的总数量的比值大于或等于50％。The image sensor according to claim 1, wherein the ratio of the number of the white pixel units to the total number of the plurality of pixel units is greater than or equal to 50%.
如权利要求1所述的图像传感器，其特征在于，在所述多个像素单元中，所述第二彩色像素单元的数量、所述第一彩色像素单元的数量、所述第三彩色像素单元的数量的比值为2:1:1或1:1:1。The image sensor according to claim 1, wherein in the plurality of pixel units, the number of the second color pixel units, the number of the first color pixel units, the number of the third color pixel units The ratio of the quantity is 2:1:1 or 1:1:1.
如权利要求1～19任一项所述的图像传感器，其特征在于，所述多个像素单元中的每一个所述像素单元包括：光电转换器，以及位于所述光电转换器的感光面一侧的滤光层；The image sensor according to any one of claims 1 to 19, wherein each of the plurality of pixel units includes: a photoelectric converter, and a photoelectric converter located on a photosensitive surface of the photoelectric converter side filter layer;

所述白色像素单元中的所述滤光层为透明滤光层，所述第一彩色像素单元中的所述滤光层用于滤除第一颜色外的光线，所述第二彩色像素单元中的所述滤光层用于滤除第二颜色外的光线，所述第三彩色像素单元中的所述滤光层用于滤除第三颜色外的光线；The filter layer in the white pixel unit is a transparent filter layer, the filter layer in the first color pixel unit is used to filter out the light of the first color, and the second color pixel unit The filter layer in the pixel unit is used to filter out light rays other than the second color, and the filter layer in the third color pixel unit is used to filter out light rays other than the third color;

所述光电转换器用于将穿过所述滤光层后的入射光转换为电信号。The photoelectric converter is used to convert the incident light passing through the filter layer into an electrical signal.
如权利要求20所述的图像传感器，其特征在于，所述第一彩色像素单元、所述第二彩色像素单元和所述第三彩色像素单元中的所述透镜的面积，均大于所述白色像素单元中的所述透镜的面积；The image sensor according to claim 20, wherein the areas of the lenses in the first color pixel unit, the second color pixel unit and the third color pixel unit are all larger than the white the area of the lens in the pixel unit;

所述第一彩色像素单元、所述第二彩色像素单元和所述第三彩色像素单元中的所述滤光层的面积，均大于所述白色像素单元中的所述滤光层的面积。The area of the filter layer in the first color pixel unit, the second color pixel unit and the third color pixel unit is larger than the area of the filter layer in the white pixel unit.
如权利要求20所述的图像传感器，其特征在于，所述白色像素单元中的所述光电转换器的面积，大于所述第一彩色像素单元、所述第二彩色像素单元和所述第三彩色像素单元中的所述光电转换器的面积。The image sensor according to claim 20, wherein the area of the photoelectric converter in the white pixel unit is larger than that of the first color pixel unit, the second color pixel unit and the third color pixel unit. The area of the photoelectric converter in the color pixel unit.
如权利要求20所述的图像传感器，其特征在于，所述光电转换器为光电二极管；The image sensor according to claim 20, wherein the photoelectric converter is a photodiode;

所述白色像素单元中的所述光电二极管中的N型半导体杂质注入浓度，大于所述第一彩色像素单元、所述第二彩色像素单元和所述第三彩色像素单元中的所述光电二极管中的N型半导体杂质注入浓度。The implantation concentration of N-type semiconductor impurities in the photodiode in the white pixel unit is greater than that of the photodiode in the first color pixel unit, the second color pixel unit and the third color pixel unit The N-type semiconductor impurity implantation concentration in.
如权利要求20～23任一项所述的图像传感器，其特征在于，所述像素单元还包括：传输晶体管、复位晶体管、源跟随晶体管以及行选择晶体管；The image sensor according to any one of claims 20-23, wherein the pixel unit further comprises: a transfer transistor, a reset transistor, a source follower transistor, and a row selection transistor;

所述传输晶体管的源极与所述光电转换器电连接，所述传输晶体管的漏极通过浮动扩散节点与所述复位晶体管的源极电连接，所述源跟随晶体管的栅极与所述浮动扩散节点电连接，所述行选择晶体管的源极与所述源跟随晶体管的漏极电连接；The source of the transfer transistor is electrically connected to the photoelectric converter, the drain of the transfer transistor is electrically connected to the source of the reset transistor through a floating diffusion node, and the gate of the source follower transistor is connected to the floating The diffusion node is electrically connected, and the source of the row selection transistor is electrically connected to the drain of the source follower transistor;

所述像素单元内设有半导体层，所述半导体层包括：所述光电传感器的PN结、所述传输晶体管的有源层、所述复位晶体管的有源层、所述源跟随晶体管的有源层及所述行选择晶体管的有源层；A semiconductor layer is provided in the pixel unit, and the semiconductor layer includes: the PN junction of the photosensor, the active layer of the transfer transistor, the active layer of the reset transistor, and the active layer of the source follower transistor. layer and the active layer of the row select transistor;

所述白色像素单元中浮动扩散节点的面积，大于所述第一彩色像素单元、所述第二彩色像素单元和所述第三彩色像素单元中所述浮动扩散节点的面积；其中，所述浮动扩散节点的面积为所述半导体层中所述传输晶体管的有源层与所述复位晶体管的有源层之间的区域的面积。The area of the floating diffusion node in the white pixel unit is larger than the area of the floating diffusion node in the first color pixel unit, the second color pixel unit, and the third color pixel unit; wherein, the floating The area of the diffusion node is the area of a region between the active layer of the transfer transistor and the active layer of the reset transistor in the semiconductor layer.
如权利要求1～24任一项所述的图像传感器，其特征在于，还包括：图像处理模块；The image sensor according to any one of claims 1-24, further comprising: an image processing module;

所述图像处理模块用于：获取所述多个像素单元接收到的第一图像信息；根据所述第一图像信息确定各白色像素单元的白色输出值、各第一彩色像素单元的第一彩色输出值、各第二彩色像素单元的第二彩色输出值以及各第三彩色图像的第三彩色输出值，以得到第二图像信息；根据所述第二图像信息形成多个虚拟像素单元，并确定各所述虚拟像素单元的输出值，以得到第三图像信息。The image processing module is used to: acquire the first image information received by the plurality of pixel units; determine the white output value of each white pixel unit, the first color of each first color pixel unit according to the first image information output value, the second color output value of each second color pixel unit, and the third color output value of each third color image to obtain second image information; form a plurality of virtual pixel units according to the second image information, and The output value of each virtual pixel unit is determined to obtain third image information.
如权利要求25所述的图像传感器，其特征在于，所述图像处理模块，具体用于：The image sensor according to claim 25, wherein the image processing module is specifically used for:

在所述第一图像信息中提取各所述白色像素单元的白色输出值，对于除各所述白色像素单元外的每一个第一缺失像素单元，采用所述第一缺失像素单元周围的各所述白色输出值的平均值作为该第一缺失像素单元的白色输出值，以得到所有像素单元的白色输出值；Extract the white output value of each of the white pixel units in the first image information, and for each of the first missing pixel units except each of the white pixel units, use each of the surrounding first missing pixel units The average value of the white output value is used as the white output value of the first missing pixel unit to obtain the white output value of all pixel units;

在所述第一图像信息中提取所述第一彩色像素单元的第一彩色输出值，将每一个所述第一彩色像素单元的第一彩色输出值作为周围各第二缺失像素单元的第一彩色输出值，以得到所有所述像素单元的第一彩色输出值，其中，所述第二缺失像素单元为除各所述第一彩色像素单元外的像素单元；The first color output value of the first color pixel unit is extracted from the first image information, and the first color output value of each first color pixel unit is used as the first color output value of each surrounding second missing pixel unit. Color output values to obtain first color output values of all the pixel units, wherein the second missing pixel unit is a pixel unit other than each of the first color pixel units;

在所述第一图像信息中提取所述第二彩色像素单元的第二彩色输出值，将每一个所述第二彩色像素单元的第二彩色输出值作为周围各第三缺失像素单元的第二彩色输出值，以得到所有所述像素单元的第二彩色输出值，其中，所述第三缺失像素单元为除各所述第二彩色像素单元外的像素单元；The second color output value of the second color pixel unit is extracted from the first image information, and the second color output value of each second color pixel unit is used as the second color output value of each of the surrounding third missing pixel units. Color output values to obtain second color output values of all the pixel units, wherein the third missing pixel unit is a pixel unit other than each of the second color pixel units;

在所述第一图像信息中提取所述第三彩色像素单元的第三彩色输出值，将每一个所述第三彩色像素单元的第三彩色输出值作为周围各第四缺失像素单元的第三彩色输出值，以得到所有所述像素单元的第三彩色输出值，其中，所述第四缺失像素单元为除各所述第二彩色像素单元外的像素单元；The third color output value of the third color pixel unit is extracted from the first image information, and the third color output value of each third color pixel unit is used as the third color output value of each surrounding fourth missing pixel unit. a color output value to obtain a third color output value of all the pixel units, wherein the fourth missing pixel unit is a pixel unit except each of the second color pixel units;

将所有所述像素单元的白色输出值、第一彩色输出值、第二彩色输出值及第三彩色输出值进行融合，得到所述第二图像信息。The white output value, the first color output value, the second color output value and the third color output value of all the pixel units are fused to obtain the second image information.
如权利要求26所述的图像传感器，其特征在于，所述图像处理模块，具体用于：The image sensor according to claim 26, wherein the image processing module is specifically used for:

所述多个虚拟像素单元分别排布于像素单元行和像素单元列中，所述虚拟像素单元的输出值为周围的各所述像素单元的输出值的平均值；其中，所述像素单元的输出值为白色输出值、第一彩色输出值、第二彩色输出值或第三彩色输出值。The plurality of virtual pixel units are respectively arranged in the pixel unit row and the pixel unit column, and the output value of the virtual pixel unit is the average value of the output values of the surrounding pixel units; wherein, the pixel unit The output value is a white output value, a first color output value, a second color output value or a third color output value.
如权利要求25～27任一项所述的图像传感器，其特征在于，所述图像传感器的图像分辨率大于所述多个像素单元的总数量。The image sensor according to any one of claims 25-27, wherein the image resolution of the image sensor is greater than the total number of the plurality of pixel units.
一种摄像头模组，其特征在于，包括：镜头模组，以及如权利要求1～28任一项所述的图像传感器；A camera module, characterized by comprising: a lens module, and the image sensor according to any one of claims 1-28;

所述镜头模组，用于接收入射光，并将所述入射光传输至所述图像传感器。The lens module is used to receive incident light and transmit the incident light to the image sensor.
一种电子设备，其特征在于，包括：电源，以及与所述电源电连接的如权利要求29所述的摄像头模组。An electronic device, characterized by comprising: a power supply, and the camera module according to claim 29 electrically connected to the power supply.
一种如权利要求1～28任一项所述的图像传感器的图像处理方法，其特征在于，包括：An image processing method for an image sensor according to any one of claims 1 to 28, characterized in that it comprises:

获取所述图像传感器接收到的第一图像信息；acquiring first image information received by the image sensor;

根据所述第一图像信息确定各白色像素单元的白色输出值、各第一彩色像素单元的第一彩色输出值、各第二彩色像素单元的第二彩色输出值以及各第三彩色图像的第三彩色输出值，以得到第二图像信息；Determine the white output value of each white pixel unit, the first color output value of each first color pixel unit, the second color output value of each second color pixel unit, and the first color output value of each third color image according to the first image information. Three color output values to obtain the second image information;

根据所述第二图像信息形成多个虚拟像素单元，并确定各所述虚拟像素单元的输出值，以得到第三图像信息。A plurality of virtual pixel units are formed according to the second image information, and an output value of each of the virtual pixel units is determined to obtain third image information.
如权利要求31所述的图像处理方法，其特征在于，所述根据所述第一图像信息确定各白色像素单元的白色输出值、各第一彩色像素单元的第一彩色输出值、各第二彩色像素单元的第二彩色输出值以及各第三彩色图像的第三彩色输出值，以得到第二图像信息，包括：The image processing method according to claim 31, wherein, according to the first image information, determining the white output value of each white pixel unit, the first color output value of each first color pixel unit, and the second The second color output value of the color pixel unit and the third color output value of each third color image to obtain the second image information, including:

在所述第一图像信息中提取各所述白色像素单元的白色输出值，对于除各所述白色像素单元外的每一个第一缺失像素单元，采用所述第一缺失像素单元周围的各所述白色输出值的平均值作为该第一缺失像素单元的白色输出值，以得到所有像素单元的白色输出值；Extract the white output value of each of the white pixel units in the first image information, and for each of the first missing pixel units except each of the white pixel units, use each of the surrounding first missing pixel units The average value of the white output value is used as the white output value of the first missing pixel unit to obtain the white output value of all pixel units;

在所述第一图像信息中提取所述第一彩色像素单元的第一彩色输出值，将每一个所述第一彩色像素单元的第一彩色输出值作为周围各第二缺失像素单元的第一彩色输出值，以得到所有所述像素单元的第一彩色输出值，其中，所述第二缺失像素单元为除各所述第一彩色像素单元外的像素单元；The first color output value of the first color pixel unit is extracted from the first image information, and the first color output value of each first color pixel unit is used as the first color output value of each surrounding second missing pixel unit. Color output values to obtain first color output values of all the pixel units, wherein the second missing pixel unit is a pixel unit other than each of the first color pixel units;

在所述第一图像信息中提取所述第二彩色像素单元的第二彩色输出值，将每一个所述第二彩色像素单元的第二彩色输出值作为周围各第三缺失像素单元的第二彩色输出值，以得到所有所述像素单元的第二彩色输出值，其中，所述第三缺失像素单元为除各所述第二彩色像素单元外的像素单元；The second color output value of the second color pixel unit is extracted from the first image information, and the second color output value of each second color pixel unit is used as the second color output value of each of the surrounding third missing pixel units. Color output values to obtain second color output values of all the pixel units, wherein the third missing pixel unit is a pixel unit other than each of the second color pixel units;

在所述第一图像信息中提取所述第三彩色像素单元的第三彩色输出值，将每一个所述第三彩色像素单元的第三彩色输出值作为周围各第四缺失像素单元的第三彩色输出值，以得到所有所述像素单元的第三彩色输出值，其中，所述第四缺失像素单元为除各所述第二彩色像素单元外的像素单元；The third color output value of the third color pixel unit is extracted from the first image information, and the third color output value of each third color pixel unit is used as the third color output value of each surrounding fourth missing pixel unit. a color output value to obtain a third color output value of all the pixel units, wherein the fourth missing pixel unit is a pixel unit except each of the second color pixel units;

将所有所述像素单元的白色输出值、第一彩色输出值、第二彩色输出值及第三彩色输出值进行融合，得到所述第二图像信息。The white output value, the first color output value, the second color output value and the third color output value of all the pixel units are fused to obtain the second image information.
如权利要求32所述的图像处理方法，其特征在于，所述根据所述第二图像信息形成多个虚拟像素单元，并确定各所述虚拟像素单元的输出值，以得到第三图像信息，包括：The image processing method according to claim 32, wherein said forming a plurality of virtual pixel units according to said second image information, and determining the output value of each said virtual pixel unit, so as to obtain third image information, include:

所述多个虚拟像素单元分别排布于像素单元行和像素单元列中，所述虚拟像素单元的输出值为周围的各所述像素单元的输出值的平均值；其中，所述像素单元的输出值为白色输出值、第一彩色输出值、第二彩色输出值或第三彩色输出值。The plurality of virtual pixel units are respectively arranged in the pixel unit row and the pixel unit column, and the output value of the virtual pixel unit is the average value of the output values of the surrounding pixel units; wherein, the pixel unit The output value is a white output value, a first color output value, a second color output value or a third color output value.