CN211296854U - Pixel array and bionic vision sensor - Google Patents
Pixel array and bionic vision sensor Download PDFInfo
- Publication number
- CN211296854U CN211296854U CN201922360390.4U CN201922360390U CN211296854U CN 211296854 U CN211296854 U CN 211296854U CN 201922360390 U CN201922360390 U CN 201922360390U CN 211296854 U CN211296854 U CN 211296854U
- Authority
- CN
- China
- Prior art keywords
- pixel array
- type
- frequency band
- optical signals
- row
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000004438 eyesight Effects 0.000 title claims abstract description 42
- 239000011664 nicotinic acid Substances 0.000 title abstract description 32
- 230000003287 optical effect Effects 0.000 claims abstract description 99
- 239000000284 extract Substances 0.000 claims description 16
- 230000003592 biomimetic effect Effects 0.000 claims 1
- 230000008447 perception Effects 0.000 abstract description 18
- 230000006870 function Effects 0.000 abstract description 16
- 230000007547 defect Effects 0.000 abstract description 4
- 230000000007 visual effect Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000004044 response Effects 0.000 description 5
- 210000001525 retina Anatomy 0.000 description 5
- 206010070834 Sensitisation Diseases 0.000 description 3
- 230000008313 sensitization Effects 0.000 description 3
- 238000000605 extraction Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The embodiment of the utility model provides a pixel array and bionic vision sensor, pixel array includes: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for extracting optical signals of a specified frequency band and converting the optical signals of the specified frequency band into second-class current signals; in each row of the pixel array, each first photosensitive device and each second photosensitive device are arranged alternately, and each second photosensitive device is used for extracting optical signals of the same designated frequency band. The embodiment of the utility model provides an in the pixel array that provides can be arranged in bionical vision sensor to make bionical vision sensor have perception colour information and absolute light intensity information's function and perception light intensity gradient information's function simultaneously, compensatied prior art not can with the bionical vision sensor assorted pixel array's of two perception modes defect.
Description
Technical Field
The utility model relates to an integrated circuit technical field, more specifically relates to pixel array and bionical vision sensor.
Background
At present, with the continuous and deep research on image sensors and image processing and recognition algorithms, the bionic vision sensor plays an increasingly important role in a plurality of application fields such as industrial manufacturing, intelligent transportation, intelligent robots and the like.
The bionic vision sensor mainly simulates the mode of human retina, and the human retina mainly comprises two visual perception cells, namely cone cells and rod cells, which respectively correspond to two different modes. The mode of the cone cells is mainly sensitive to absolute light intensity information and color information, and the cone cells have high image restoration precision but low restoration speed; in contrast to the mode of the cone cells, the rod cells mainly sense light intensity gradient information, have a fast sensing speed and a large dynamic range of sensing, but cannot sense absolute light intensity information and color information.
However, all the bionic visual sensors in the prior art can only simulate one mode of the retina of the human eye to form a single perception mode, and thus can only perceive a certain kind of information. Like conventional cameras, color information is mainly perceived, similar to cone cells. Such as Dynamic Vision Sensor (DVS), which is similar to rod cells, primarily senses intensity gradient information. And the single-modality visual sensor application scenarios are limited. For example, for a bionic visual sensor similar to a cone cell, since absolute light intensity information rather than light intensity gradient information is obtained by shooting, although the bionic visual sensor is widely applied to household entertainment electronic equipment, in the field of industrial control, the bionic visual sensor is often faced with the problems of insufficient speed, too small dynamic range and the like, and is difficult to apply. For the bionic visual sensor similar to the rod cell, although the sensing speed is high, the bionic visual sensor is only sensitive to a moving object, so that an image is difficult to shoot, or the quality of the shot image is poor, and the requirement of entertainment electronic equipment is difficult to meet. Moreover, the bionic vision sensor only comprises a single perception mode, and the bionic vision sensor fails when the perception mode fails, so that the bionic vision sensor has great limitation on unmanned driving, unmanned aerial vehicles and other robots with high requirements on stability. In addition, the main indexes for evaluating the performance of the bionic vision sensor at present comprise image quality, dynamic range and shooting speed. From the above, under the framework of the traditional bionic visual sensor, the three indexes are often mutually exclusive: if the shooting speed is increased, the dynamic range of the bionic vision sensor is reduced; the shooting speed generally decreases as the image quality improves, and it is difficult to achieve both.
Therefore, there is a need to provide a bionic visual sensor with dual sensing modes, which can sense the absolute light intensity information, the color information and the light intensity gradient information at the same time, and further provide a pixel array matched with the sensor. However, the prior art pixel array usually adopts a BAYER pattern, and as shown in fig. 1, the plane of the pixels in the column direction is illustrated as: RGRGRG … (0, 2, 4 … columns, respectively) and GBGBGB … (1, 3, 5 … columns, respectively) are spread and tiled, and a light-shielding layer is used between every two pixels to shield light, so that only one color image can be acquired at a time, and the sensor is not suitable for a bionic visual sensor having a dual-sensing mode.
SUMMERY OF THE UTILITY MODEL
To overcome the above problems or at least partially solve the above problems, embodiments of the present invention provide a pixel array and a bionic vision sensor.
In a first aspect, an embodiment of the present invention provides a pixel array, including: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring the target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array;
in each row of the pixel array, each first photosensitive device and each second photosensitive device are arranged alternately, and each second photosensitive device is used for extracting the same optical signal of the specified frequency band.
Preferably, every two adjacent rows in the pixel array are a repeating unit, and a second type photosensitive device for extracting the optical signal in the red light frequency band, a second type photosensitive device for sensing the optical signal in the blue light frequency band, and a second type photosensitive device for sensing the optical signal in the green light frequency band are simultaneously arranged in each repeating unit.
Preferably, two second-type photosensitive devices for extracting light signals in the red light band are arranged around each first-type photosensitive device except for the first row, the first column, the last row and the last column in the pixel array.
Preferably, two second-type photosensitive devices for extracting optical signals of the blue light band are arranged around each first-type photosensitive device except for the first row, the first column, the last row and the last column in the pixel array.
Preferably, two second-type photosensitive devices for extracting optical signals of the green light band are arranged around each first-type photosensitive device except for the first row, the first column, the last row and the last column in the pixel array.
Preferably, each of the first type and the second type of photosensitive devices includes a photodiode therein.
In a second aspect, an embodiment of the present invention provides a pixel array, including: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring the target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array;
in every two adjacent rows of the pixel array, one row only comprises the first type photosensitive devices, every first type photosensitive device and every second type photosensitive device in the other row are arranged alternately, and every three adjacent second type photosensitive devices extract optical signals of different specified frequency bands.
Preferably, each adjacent six rows in the pixel array are a repeating unit.
Preferably, each of the first type and the second type of photosensitive devices includes a photodiode therein.
In a third aspect, an embodiment of the present invention provides a bionic vision sensor, including: a pixel array as described in the first or second aspect.
The embodiment of the utility model provides a pair of pixel array and bionic vision sensor, pixel array includes: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array; in each row of the pixel array, each first photosensitive device and each second photosensitive device are arranged alternately, and each second photosensitive device is used for extracting optical signals of the same designated frequency band. The embodiment of the utility model provides an in the pixel array that provides can be arranged in bionical vision sensor to make bionical vision sensor have perception colour information and absolute light intensity information's function and perception light intensity gradient information's function simultaneously, compensatied not can with the bionical vision sensor assorted pixel array's of two perception modes defect among the prior art.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a pixel array in the prior art;
fig. 2 is a schematic structural diagram of a pixel array according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a pixel array according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a pixel array according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a pixel array according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a voltage mode active pixel sensor circuit in a bionic vision sensor according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a current mode active pixel sensor circuit in a bionic vision sensor according to an embodiment of the present invention;
fig. 8 is a schematic circuit structure diagram for associating a current mode active pixel sensor circuit with other current mode active pixel sensor circuits in a bionic vision sensor provided in an embodiment of the present invention;
fig. 9 is a schematic diagram of a variation form of a specific digital signal input to a digital-to-analog converter in a current mode active pixel sensor circuit in a bionic vision sensor according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. Based on the embodiments in the present invention, all other embodiments obtained by a person skilled in the art without creative efforts belong to the protection scope of the present invention.
An embodiment of the utility model provides a pixel array, include: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring the target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array;
in each row of the pixel array, each first photosensitive device and each second photosensitive device are arranged alternately, and each second photosensitive device is used for extracting the same optical signal of the specified frequency band.
Specifically, the embodiment of the utility model provides an in for the bionical vision sensor that the matching has two perception modes, provide one kind and can be applied to the pixel array of above-mentioned bionical vision sensor. The pixel array is formed by arranging a plurality of first photosensitive devices and a plurality of second photosensitive devices, and specifically, the pixel array may be formed by alternately arranging the first photosensitive devices and the second photosensitive devices. Each first type of photosensitive device and each second type of photosensitive device are respectively used as a pixel. Wherein, the quantity of first type photosensitive device and second type photosensitive device can be set for according to pixel array's size, can be the same also can be different, the embodiment of the utility model provides an in this not specifically limit. The first photosensitive device and the second photosensitive device are used for acquiring a target optical signal, the first photosensitive device is also used for converting the target optical signal into a first current signal, and the second photosensitive device is also used for extracting an optical signal of a specified frequency band from the target optical signal and converting the optical signal of the specified frequency band into a second current signal. The first type of photosensitive device may be photodiodes with the same response curve, the second type of photosensitive device may be photodiodes with different response curves, the response frequency band of the second type of photosensitive device may be a specific frequency band, and the specific frequency band may be a red frequency band, a blue frequency band, or a green frequency band. The second type of photosensitive device may also be composed of a photodiode and a Color Filter (CF) with the same response curve, where the color Filter may specifically be a red color Filter, a blue color Filter, or a green color Filter, and is used to extract optical signals in a red light band, a blue light band, or a green light band from the target optical signal, respectively. It should be noted that the color filter may specifically be a filter or a lens, and when the color filter is a lens, a bayer lens may be specifically selected, and other types of lenses may also be selected.
In the following embodiments, only the second type of photosensitive device is exemplified by a photodiode and a color filter having the same response curve.
As shown in fig. 2, only a 7 × 7 pixel array is shown in fig. 2, and is formed by arranging 25 first-type photo- sensing devices 11 and 24 second-type photo-sensing devices 12 alternately. Reference numeral R, G, B in fig. 2 denotes a second type of photosensitive device, and denotes a second type of photosensitive device that extracts an optical signal in a red frequency band, a second type of photosensitive device that extracts an optical signal in a green frequency band, and a second type of photosensitive device that extracts an optical signal in a blue frequency band, respectively. For example, a second type of photosensitive device with a red color filter, a second type of photosensitive device with a green color filter, and a second type of photosensitive device with a blue color filter, respectively.
In each row of the pixel array formed by arranging all the first type photosensitive devices and all the second type photosensitive devices, each first type photosensitive device and each second type photosensitive device are arranged alternately, and each second type photosensitive device is used for extracting optical signals of the same appointed frequency band. That is, as shown in fig. 2, each of the second type of photo-sensing devices in the first row includes a green color filter, denoted G, each of the second type of photo-sensing devices in the second row includes a red color filter, denoted R, each of the second type of photo-sensing devices in the third row includes a blue color filter, denoted B, each of the second type of photo-sensing devices in the fourth row includes a red color filter, denoted R, each of the second type of photo-sensing devices in the fifth row includes a green color filter, denoted G, each of the second type of photo-sensing devices in the sixth row includes a red color filter, denoted R, and each of the second type of photo-sensing devices in the seventh row includes a blue color filter, denoted B. The first type of photosensitive devices in the first to seventh rows are not labeled.
When the pixel array is applied to the bionic vision sensor, the function of sensing light intensity gradient information can be realized by combining all first-class photosensitive devices of the pixel array with corresponding control circuits, each first-class photosensitive device directly converts a target light signal into a first-class current signal, wherein the light signal of a specified frequency band is not required to be extracted, each first-class photosensitive device can be compared with electric signals obtained by four surrounding first-class photosensitive devices, and finally an image generated by the first-class photosensitive devices is a gray image representing edge information; the function of sensing color information and absolute light intensity information is realized by combining all the second-class photosensitive devices of the pixel array with corresponding control circuits, and because each second-class photosensitive device is used for acquiring a target light signal, extracting a light signal of a specified frequency band from the target light signal and converting the light signal of the specified frequency band into a second-class current signal, an image generated by the second-class photosensitive devices is a color image.
The embodiment of the utility model provides an in provide a pixel array, include: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array; in each row of the pixel array, each first photosensitive device and each second photosensitive device are arranged alternately, and each second photosensitive device is used for extracting optical signals of the same designated frequency band. The embodiment of the utility model provides an in the pixel array that provides can be arranged in bionical vision sensor to make bionical vision sensor have perception colour information and absolute light intensity information's function and perception light intensity gradient information's function simultaneously, compensatied not can with the bionical vision sensor assorted pixel array's of two perception modes defect among the prior art.
On the basis of the embodiment, the utility model provides a pixel array, every adjacent four rows is a repeating unit in the pixel array, and exists simultaneously in every repeating unit and draw the light signal's of ruddiness frequency channel second type photosensitive element, the extraction the light signal's of blue light frequency channel second type photosensitive element and the extraction the light signal's of green light frequency channel second type photosensitive element.
Specifically, as shown in fig. 2, in the embodiment of the present invention, in the pixel array formed by arranging all the first type of photosensitive devices and all the second type of photosensitive devices, the first line to the fourth line are a repeating unit, and there are the second type of photosensitive devices for extracting the optical signals of the red light frequency band, the second type of photosensitive devices for extracting the optical signals of the blue light frequency band, and the second type of photosensitive devices for extracting the optical signals of the green light frequency band in the repeating unit. For example, a second type of photosensitive device including a red color filter, a blue color filter, and a green color filter is simultaneously present in each repeating unit. The fifth row is the same as the first row, the sixth row is the same as the second row, and the seventh row is the same as the third row. If the pixel array shown in fig. 2 has an eighth row, the eighth row is the same as the fourth row, and the fifth to eighth rows constitute one repeating unit.
The pixel array obtained by the arrangement can enable the first type of photosensitive devices and the second type of photosensitive devices to be arranged relatively uniformly, so that color information, absolute light intensity information and light intensity gradient information sensed by the matched bionic vision sensor are more comprehensive and accurate, and the obtained image effect is better.
On the basis of the above-mentioned embodiment, the utility model provides a pixel array, except first line, first row, last line and last column every in the pixel array all have two around the first type photosensitive device and extract the second type photosensitive device of the light signal of ruddiness frequency channel.
Specifically, as shown in fig. 2, in the embodiment of the present invention, in the pixel array formed by arranging all the first type photosensitive devices and all the second type photosensitive devices, the first type photosensitive devices in the second row and the second column are taken as an example for explanation, and the four second type photosensitive devices around the first type photosensitive devices are respectively marked as G, R, R, B, that is, there are two second type photosensitive devices for extracting the light signals in the red light frequency band. For example, there may be two photosensitive devices of the second type that include red color filters. As another example, the first photosensitive device in the third row and the third column, four second photosensitive devices around the first photosensitive device are respectively labeled R, B, B, R, and there are also two second photosensitive devices for extracting light signals in the red light band. In the pixel array obtained by the arrangement, the pixel color-to-intensity ratio is as follows: 50% red, 25% blue, 25% green.
At this time, the second type of photosensitive devices existing in the first to fourth rows in one repeating unit include a green color filter, a red color filter, a blue color filter, and a red color filter, respectively.
On the basis of the above-mentioned embodiment, the utility model provides a pixel array, except first line, first row, last line and last column every in the pixel array all have two around the first type photosensitive device and extract the second type photosensitive device of the light signal of blue light frequency channel.
Specifically, as shown in fig. 3, in the embodiment of the present invention, in the pixel array formed by arranging all the first type photosensitive devices and all the second type photosensitive devices, the first type photosensitive devices in the second row and the second column are taken as an example for explanation, and the four second type photosensitive devices around the first type photosensitive devices are respectively marked as G, B, B, R, that is, there are two second type photosensitive devices for extracting the optical signals in the blue light frequency band. For example, there may be two photosensitive devices of the second type that include blue filters. As another example, the first photosensitive device in the third row and the third column, four second photosensitive devices around the first photosensitive device are respectively labeled B, R, R, B, and there are also two second photosensitive devices for extracting light signals in the blue light band. In the pixel array obtained by the arrangement, the pixel color-to-intensity ratio is as follows: 25% red, 50% blue, 25% green.
At this time, the second type of photosensitive devices existing in the first to fourth rows in one repeating unit include a green color filter, a blue color filter, a red color filter, and a blue color filter, respectively.
On the basis of the above-mentioned embodiment, the utility model provides a pixel array, except first line, first row, last line and last column every in the pixel array all have two around the first type photosensitive device and extract the second type photosensitive device of the light signal of green glow frequency channel.
Specifically, as shown in fig. 4, in the embodiment of the present invention, in the pixel array formed by arranging all the first type photosensitive devices and all the second type photosensitive devices, the first type photosensitive devices in the second row and the second column are taken as an example for explanation, and the four second type photosensitive devices around the first type photosensitive devices are respectively marked as R, G, G, B, that is, there are two second type photosensitive devices for extracting the optical signal in the green light band. For example, there may be two photosensitive devices of the second type that include green filters. As another example, the first photosensitive device in the third row and the third column, four second photosensitive devices around the first photosensitive device are respectively labeled G, B, B, G, and there are also two second photosensitive devices for extracting light signals in the green light band. In the pixel array obtained by the arrangement, the pixel color-to-intensity ratio is as follows: 25% red, 25% blue, 50% green.
At this time, the second type of photosensitive devices existing in the first to fourth rows in one repeating unit include red, green, blue, and green color filters, respectively.
Since the arrangement of all the first type photosensitive devices and all the second type photosensitive devices in the pixel array are different, mainly different prior (prior) to a reverse mosaic transformation (Demosaicing) algorithm, and since human eyes are most sensitive to green, in practical applications, the array arrangement shown in fig. 4 is usually selected as a preferred scheme.
On the basis of the above-mentioned embodiment, the embodiment of the utility model provides a pixel array, every first type photosensitive device with all include photodiode in the second type photosensitive device.
On the basis of the above embodiments, the embodiment of the present invention provides a pixel array, including: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring the target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array;
in every two adjacent rows of the pixel array, one row only comprises the first type photosensitive devices, every first type photosensitive device and every second type photosensitive device in the other row are arranged alternately, and every three adjacent second type photosensitive devices extract optical signals of different specified frequency bands.
Specifically, the embodiment of the utility model provides an in for the bionical vision sensor that the matching has two perception modes, provide one kind and can be applied to the pixel array of above-mentioned bionical vision sensor. The pixel array is formed by arranging a plurality of first photosensitive devices and a plurality of second photosensitive devices, and specifically, the pixel array may be formed by alternately arranging the first photosensitive devices and the second photosensitive devices. Wherein, the quantity of first type photosensitive device and second type photosensitive device can be set for according to pixel array's size, can be the same also can be different, the embodiment of the utility model provides an in this not specifically limit.
As shown in fig. 5, only a 7 × 7 pixel array is shown in fig. 5, consisting of 33 first type photo-sensitive devices 22 and 16 second type photo-sensitive devices 21. In fig. 5, the photosensitive devices not marked are all the first type photosensitive devices, the photosensitive devices marked R, G, B are all the second type photosensitive devices, and respectively represent the second type photosensitive devices for extracting the optical signals in the red frequency band, the second type photosensitive devices for extracting the optical signals in the green frequency band, and the second type photosensitive devices for extracting the optical signals in the blue frequency band. For example, a second type of photosensitive device with a red color filter, a second type of photosensitive device with a green color filter, and a second type of photosensitive device with a blue color filter, respectively.
In a pixel array formed by all the first type photosensitive devices and all the second type photosensitive devices, in every two adjacent rows, taking a first row and a second row as an example, the second row only comprises the first type photosensitive devices, each first type photosensitive device and each second type photosensitive device in the first row are arranged alternately, and every three adjacent second type photosensitive devices extract optical signals of different specified frequency bands. Similarly, every two adjacent columns take a first column and a second column as an example, the second column only comprises the first type photosensitive devices, every first type photosensitive device and every second type photosensitive device in the first column are arranged alternately, and every three adjacent second type photosensitive devices extract optical signals of different specified frequency bands.
In fig. 5, the second photosensitive devices in the first row and the first column, the first row and the third column, and the first row and the fifth column are three adjacent second photosensitive devices, where the second photosensitive devices in the first row and the first column extract optical signals in a red frequency band, which is denoted as R, the second photosensitive devices in the first row and the third column extract optical signals in a green frequency band, which is denoted as G, and the second photosensitive devices in the first row and the fifth column extract optical signals in a blue frequency band, which is denoted as B.
When the pixel array is applied to the bionic vision sensor, the function of sensing light intensity gradient information can be realized by combining all first-class photosensitive devices of the pixel array with corresponding control circuits, each first-class photosensitive device directly converts a target light signal into a first-class current signal, wherein the light signal of a specified frequency band is not required to be extracted, each first-class photosensitive device can be compared with electric signals obtained by four surrounding first-class photosensitive devices, and finally an image generated by the first-class photosensitive devices is a gray image representing edge information; the function of sensing color information and absolute light intensity information is realized by combining all the second-class photosensitive devices of the pixel array with corresponding control circuits, and because each second-class photosensitive device is used for acquiring a target light signal, extracting a light signal of a specified frequency band from the target light signal and converting the light signal of the specified frequency band into a second-class current signal, an image generated by the second-class photosensitive devices is a color image.
The embodiment of the utility model provides an in provide a pixel array, include: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array; in every two adjacent rows of the pixel array, one row only comprises the first type photosensitive devices, every first type photosensitive device and every second type photosensitive device in the other row are arranged alternately, and every three adjacent second type photosensitive devices extract optical signals of different specified frequency bands. The embodiment of the utility model provides an in the pixel array that provides can be arranged in bionical vision sensor to make bionical vision sensor have perception colour information and absolute light intensity information's function and perception light intensity gradient information's function simultaneously, compensatied not can with the bionical vision sensor assorted pixel array's of two perception modes defect among the prior art.
On the basis of the above embodiments, the present invention provides a pixel array, in which every adjacent six rows are a repeating unit.
Specifically, as shown in fig. 5, in the embodiment of the present invention, in the pixel array formed by arranging all the first type photosensitive devices and all the second type photosensitive devices, the first row to the sixth row are a repeating unit, and three adjacent second type photosensitive devices in each row in the repeating unit extract optical signals of different specified frequency bands. For example, color filters different from each other exist in every adjacent three second-type photosensitive devices of each row in the repeating unit. The seventh row is the same as the first row. If the pixel array shown in fig. 2 has eighth to twelfth rows, the eighth row is the same as the second row, the ninth row is the same as the third row, the tenth row is the same as the fourth row, the eleventh row is the same as the fifth row, the twelfth row is the same as the sixth row, and the seventh to twelfth rows constitute one repeating unit.
The pixel array obtained by the arrangement can enable the light intensity gradient information sensed by the matched bionic vision sensor to be more comprehensive and accurate, and more accurate edge information can be obtained.
On the basis of the above-mentioned embodiment, the embodiment of the utility model provides a pixel array, every first type photosensitive device with all include photodiode in the second type photosensitive device.
On the basis of the above embodiment, the embodiment of the utility model provides a bionic vision sensor is provided, include: an array of pixels as described in the previous embodiments.
Specifically, the embodiment of the utility model provides an in the bionic vision sensor that provides, every first type photosensitive device and every second type photosensitive device in the pixel array equally divide and do not correspond a control circuit. The control circuit corresponding to the first type of light sensing device may be a current mode active pixel sensor circuit and the control circuit corresponding to the second type of light sensing device may be a voltage mode active pixel sensor circuit. The voltage mode active pixel sensor circuit is shown in fig. 6, which corresponds to the cone cells of the retina of a human eye. Vcc1 in fig. 6 is the power supply for the voltage mode active pixel sensor circuit, Vcc1 may be 3.3V. The second type of photosensitive device 12 is respectively connected with MOS tubes 13 and 14, and the MOS tube 14 is connected with the MOS tube 15. The MOS transistor 13 is used for performing a bias function, the MOS transistor 14 is used for performing a switching function, and the MOS transistor 15 is used for performing current integration on the electrical signal converted by the second type photosensitive device 12 to obtain a voltage signal, and represent light intensity information and color information in the optical signal.
The current mode active pixel sensor circuit is shown in fig. 7, which corresponds to a rod cell of the retina of a human eye. In fig. 7, Vcc2 is the power supply for the current mode active pixel sensor circuit, and Vcc2 may be 3.3V. The first photosensitive device 11 is connected with the MOS tube 23, the MOS tube 23 is connected with the MOS tube 24 and forms a current mirror, and the current signal I converted by the first photosensitive device 11 can be obtained by changing the channel width of the MOS tube 24cThe current signal magnitude of the end of the MOS transistor 24 corresponding to the mirror image of the first type photosensitive device 11 has a P-fold relationship, that is, the current of the end of the MOS transistor 24 corresponding to the mirror image of the first type photosensitive device 11 is P × Ic。
The association between a certain current mode active pixel sensor circuit and other current mode active pixel sensor circuits is by a circuit as shown in fig. 8. In fig. 8, Vcc3 is a power supply for the circuit, and Vcc3 may be 3.3V. A Digital to Analog Converter (DAC) 31 is connected to the comparator 32, and the electrical signal converted by the first type of photo-sensing device is IcThe electrical signals converted by 4 other first-type photosensitive devices around the first-type photosensitive device are I1、I2、I3、I4After 4 times of reduction, the ratio is I1/4、I2/4、I3/4、I4/4. The comparator 32 is connected to the addressing unit 33 and the addressing unit 33 is connected to the DAC31 and the memory unit 34, respectively. It should be noted that the input of DAC31 may be a periodic digital signal input by human, and is used by addressing unit 33 to address storage unit 34 to store the output result of the current mode active pixel sensor circuit when the output of comparator 32 outputs the event pulse signal, i.e. comparator 32 is in an edge triggered state. The embodiment of the utility model provides an in realize the control to the output action of current mode active pixel sensor circuit through comparator 32, when the output event pulse signal of comparator 32, comparator 32 is in border trigger state promptly, and the appointed digit of current mode active pixel sensor circuit output this momentAnd the specified digital signal at this time is used for representing the light intensity gradient information in the target light signal. The storage unit 34 may specifically be a register, a latch, an SRAM, a DRAM, a memristor, or the like. Taking a register as an example, the bit number of the register is related to the precision of the DAC31, and a 4-bit register may be selected in the embodiment of the present invention.
Specifically, the change form of the designated digital signal input to the DAC31 is as shown in fig. 9, the designated digital signal is specifically increased in a step-like manner with time, and when a certain time N × step occurs, the designated digital signal takes a value of Δ I, the comparator 32 outputs an event pulse signal, that is, the comparator 32 is in an edge triggered state, and then Δ I at this time is used as the output of the current mode active pixel sensor circuit. Wherein, N is the number of steps passed before, and step is the time length of each step.
The embodiment of the utility model provides an in, can regard as a pixel group with every nine pixels in the pixel array, and the central pixel in this pixel group is first type sensitization device, compares central pixel in every pixel group and the signal of telecommunication that four first type sensitization devices obtained on every side through control circuit, and the image that finally produces via first type sensitization device is for the grey level image that shows marginal information, realizes the function of perception light intensity gradient information. And the function of sensing color information and absolute light intensity information is realized by combining all the second type photosensitive devices of the pixel array with corresponding control circuits.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it should be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention in its corresponding aspects.
Claims (10)
1. An array of pixels, comprising: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring the target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array;
in each row of the pixel array, each first photosensitive device and each second photosensitive device are arranged alternately, and each second photosensitive device is used for extracting the same optical signal of the specified frequency band.
2. The pixel array of claim 1, wherein every adjacent four rows of the pixel array are a repeating unit, and a second photosensitive device for extracting the light signal in the red light band, a second photosensitive device for extracting the light signal in the blue light band, and a second photosensitive device for extracting the light signal in the green light band are simultaneously present in each repeating unit.
3. The pixel array of claim 2, wherein each of the first type of photo-sensing devices in the pixel array except for the first row, the first column, the last row and the last column has two second type photo-sensing devices for extracting the light signals in the red light band.
4. The pixel array of claim 2, wherein each of the first type of photo-sensing devices in the pixel array except for the first row, the first column, the last row and the last column has two second type photo-sensing devices around it for extracting the light signal in the blue light band.
5. The pixel array of claim 2, wherein each of the first type of photo-sensing devices in the pixel array except for the first row, the first column, the last row and the last column has two second type photo-sensing devices around it for extracting the light signal in the green band.
6. The pixel array of any of claims 1-5, wherein each of the first type of photo-sensing device and the second type of photo-sensing device comprises a photodiode.
7. An array of pixels, comprising: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring the target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array;
in every two adjacent rows of the pixel array, one row only comprises the first type photosensitive devices, every first type photosensitive device and every second type photosensitive device in the other row are arranged alternately, and every three adjacent second type photosensitive devices extract optical signals of different specified frequency bands.
8. The pixel array of claim 7, wherein each adjacent six rows of the pixel array are a repeating unit.
9. The pixel array of claim 7 or 8, wherein each of the first type of photo-sensing device and the second type of photo-sensing device comprises a photodiode.
10. A biomimetic vision sensor, comprising: the pixel array of any one of claims 1-9.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201922360390.4U CN211296854U (en) | 2019-12-24 | 2019-12-24 | Pixel array and bionic vision sensor |
PCT/CN2020/073543 WO2021128536A1 (en) | 2019-12-24 | 2020-01-21 | Pixel array and bionic vision sensor |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201922360390.4U CN211296854U (en) | 2019-12-24 | 2019-12-24 | Pixel array and bionic vision sensor |
Publications (1)
Publication Number | Publication Date |
---|---|
CN211296854U true CN211296854U (en) | 2020-08-18 |
Family
ID=72022687
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201922360390.4U Active CN211296854U (en) | 2019-12-24 | 2019-12-24 | Pixel array and bionic vision sensor |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN211296854U (en) |
WO (1) | WO2021128536A1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112543271A (en) * | 2020-12-03 | 2021-03-23 | 清华大学 | Bimodal ultraviolet bionic vision sensor |
CN112584016A (en) * | 2020-12-03 | 2021-03-30 | 北京灵汐科技有限公司 | Infrared bionic vision sensor |
CN112702588A (en) * | 2020-12-21 | 2021-04-23 | 北京灵汐科技有限公司 | Dual-mode image signal processor and dual-mode image signal processing system |
CN113038046A (en) * | 2021-03-23 | 2021-06-25 | 北京灵汐科技有限公司 | Pixel sensing array and vision sensor |
WO2022199413A1 (en) * | 2021-03-23 | 2022-09-29 | 北京灵汐科技有限公司 | Pixel sensing array and visual sensor |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102623475B (en) * | 2012-04-17 | 2014-12-31 | 中国科学院上海高等研究院 | Stacked CMOS (Complementary Metal Oxide Semiconductor) image sensor |
US20150062347A1 (en) * | 2013-08-27 | 2015-03-05 | Semiconductor Components Industries, Llc | Image processing methods for visible and infrared imaging |
KR102409389B1 (en) * | 2015-10-06 | 2022-06-15 | 삼성전자주식회사 | Image sensor including color separation element |
CN105611136B (en) * | 2016-02-26 | 2019-04-23 | 联想(北京)有限公司 | A kind of imaging sensor and electronic equipment |
KR102549621B1 (en) * | 2016-09-02 | 2023-06-28 | 삼성전자주식회사 | Semiconductor device |
US10444415B2 (en) * | 2017-02-14 | 2019-10-15 | Cista System Corp. | Multispectral sensing system and method |
-
2019
- 2019-12-24 CN CN201922360390.4U patent/CN211296854U/en active Active
-
2020
- 2020-01-21 WO PCT/CN2020/073543 patent/WO2021128536A1/en active Application Filing
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112543271A (en) * | 2020-12-03 | 2021-03-23 | 清华大学 | Bimodal ultraviolet bionic vision sensor |
CN112584016A (en) * | 2020-12-03 | 2021-03-30 | 北京灵汐科技有限公司 | Infrared bionic vision sensor |
CN112584016B (en) * | 2020-12-03 | 2022-07-19 | 北京灵汐科技有限公司 | Infrared bionic vision sensor |
CN112702588A (en) * | 2020-12-21 | 2021-04-23 | 北京灵汐科技有限公司 | Dual-mode image signal processor and dual-mode image signal processing system |
CN113038046A (en) * | 2021-03-23 | 2021-06-25 | 北京灵汐科技有限公司 | Pixel sensing array and vision sensor |
WO2022199413A1 (en) * | 2021-03-23 | 2022-09-29 | 北京灵汐科技有限公司 | Pixel sensing array and visual sensor |
Also Published As
Publication number | Publication date |
---|---|
WO2021128536A1 (en) | 2021-07-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN211296854U (en) | Pixel array and bionic vision sensor | |
CN111083402B (en) | Bimodal bionic vision sensor | |
CN111083404B (en) | Viewing cone and rod bimodal bionic vision sensor | |
CN102970493B (en) | Many level resetting voltage of multiple conversion gain image sensor | |
CN102625060B (en) | Dynamic range expansion for the cmos image sensor of movable application | |
CN111106807B (en) | Viewing cone and rod multiplexing bionic vision sensor | |
WO2011106461A1 (en) | Increasing the resolution of color sub-pixel arrays | |
CN112532898B (en) | Bimodal infrared bionic vision sensor | |
CN109496426A (en) | Sensor, driving method and electronic device | |
CN102801984B (en) | The method of color image sensor and acquisition color digital image | |
CN111031267B (en) | Optic rod bionic vision sensor | |
US9368530B2 (en) | Image sensor and color filter array including multiple selectable meshed filter sets | |
CN111083405B (en) | Bimodal bionic vision sensor pixel reading system | |
CN106791507A (en) | High dynamic cmos pixel unit and its signal acquisition method | |
US11317063B2 (en) | Calibration module of image sensor, image sensor and method of calibrating crosstalk in image sensor | |
CN207251823U (en) | Imaging device and imaging system | |
CN112543271B (en) | Bimodal ultraviolet bionic vision sensor | |
WO2022116991A1 (en) | Bionic vision sensor | |
CN104967763B (en) | A kind of image acquisition device, image-pickup method and electronic equipment | |
CN103002292A (en) | Colorful image sensor and colorful color-filtering cell array | |
US11696041B2 (en) | Image sensor, control method, camera component and mobile terminal with raised event adaptability and phase detection auto focus | |
EP3846463A1 (en) | Image generation device and image generation method | |
CN113301280A (en) | Pixel circuit of photosensitive block, image processing method and device and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
GR01 | Patent grant | ||
GR01 | Patent grant |