CN114650377A - Camera module, control method of camera module and electronic equipment - Google Patents
Camera module, control method of camera module and electronic equipment Download PDFInfo
- Publication number
- CN114650377A CN114650377A CN202210291667.6A CN202210291667A CN114650377A CN 114650377 A CN114650377 A CN 114650377A CN 202210291667 A CN202210291667 A CN 202210291667A CN 114650377 A CN114650377 A CN 114650377A
- Authority
- CN
- China
- Prior art keywords
- color filter
- light
- image
- filter unit
- camera module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 28
- 238000001914 filtration Methods 0.000 claims abstract description 37
- 230000005540 biological transmission Effects 0.000 claims abstract description 8
- 239000000463 material Substances 0.000 claims description 7
- 238000003384 imaging method Methods 0.000 description 7
- 150000002500 ions Chemical class 0.000 description 7
- 238000002834 transmittance Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 239000003086 colorant Substances 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 206010034960 Photophobia Diseases 0.000 description 3
- 206010070834 Sensitisation Diseases 0.000 description 3
- 208000013469 light sensitivity Diseases 0.000 description 3
- 230000035515 penetration Effects 0.000 description 3
- 230000008313 sensitization Effects 0.000 description 3
- 230000003595 spectral effect Effects 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 2
- 239000003792 electrolyte Substances 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- QGLKJKCYBOYXKC-UHFFFAOYSA-N nonaoxidotritungsten Chemical compound O=[W]1(=O)O[W](=O)(=O)O[W](=O)(=O)O1 QGLKJKCYBOYXKC-UHFFFAOYSA-N 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 101100248200 Arabidopsis thaliana RGGB gene Proteins 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 238000004042 decolorization Methods 0.000 description 1
- 230000031700 light absorption Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 108091008695 photoreceptors Proteins 0.000 description 1
- 238000006479 redox reaction Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 239000002210 silicon-based material Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 229910001930 tungsten oxide Inorganic materials 0.000 description 1
- 230000004304 visual acuity Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/79—Arrangements of circuitry being divided between different or multiple substrates, chips or circuit boards, e.g. stacked image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
- Blocking Light For Cameras (AREA)
Abstract
The embodiment of the application discloses a camera module, a control method of the camera module and electronic equipment; the camera module comprises a pixel unit and a color filter unit; the pixel unit comprises at least two photosensitive devices which are arranged in a stacked mode, and each photosensitive device is used for receiving light with a wave band corresponding to the photosensitive device; the color filter unit is arranged above the pixel unit and is switchable between a light filtering state and a full light transmission state; when the color filter unit is in the filtering state, the light filter unit is used for transmitting light with a wave band corresponding to the color filter unit, and the transmitted light can be received by the photosensitive device with the corresponding wave band; when the color filter unit is in the full light-transmitting state, the color filter unit is used for transmitting light of different wavebands, and the transmitted light of different wavebands can be received by the photosensitive devices of corresponding wavebands in a one-to-one correspondence manner.
Description
Technical Field
The application belongs to the technical field of terminal equipment, and particularly relates to a camera module, a control method of the camera module and electronic equipment.
Background
The camera in the electronic equipment mostly adopts an RGB Bayer arrangement sensor, each pixel is composed of a micro lens, an optical filter, a photodiode and the like, one pixel can only present one color information, the pixels of the optical filters with three different colors are arranged on a plane, and a color pixel is formed by 'demosaicing' treatment after signals are collected. However, in the application, it is found that the RGB bayer arrangement has a significant disadvantage, because each pixel can capture only one color, if the normal color is to be displayed, four pixels RGGB are required to complete the process, and when the pixel area needs to be made large, the size of the whole Sensor (Sensor) will be increased, which will not be applicable to electronic devices that are required to be light and thin.
Taking a common smart phone as an example, the size of the photosensitive sensor cannot be increased due to the requirement of the thickness of the body. Under the condition that the size of the photosensitive sensor is limited, the number of photosensitive pixels needs to be increased to achieve higher resolution, but the size of each photosensitive pixel is reduced, so that the photosensitive performance is reduced, and the imaging quality is affected. In particular, the imaging quality in a dark light environment or a highlight environment is not good.
Disclosure of Invention
The application aims at providing a camera module, a control method of the camera module and electronic equipment, and solves the problem that the existing camera module is limited by photosensitive performance and causes poor imaging quality in a dark light shooting environment or a high light shooting environment.
First aspect, this application embodiment provides a module of making a video recording, the module of making a video recording includes:
the pixel unit comprises at least two photosensitive devices which are arranged in a stacked mode, wherein each photosensitive device is used for receiving light with a wave band corresponding to the photosensitive device; and
a color filter unit disposed over the pixel unit, the color filter unit being switchable between a filtering state and a full-transmission state;
when the color filter unit is in the filtering state, the light filter unit is used for transmitting light with a wavelength band corresponding to the color filter unit, and the transmitted light can be received by the photosensitive device with the corresponding wavelength band;
when the color filter unit is in the full light-transmitting state, the color filter unit is used for transmitting light of different wavebands, and the transmitted light of different wavebands can be received by the photosensitive devices of corresponding wavebands in a one-to-one correspondence manner.
In a second aspect, an embodiment of the present application provides a method for controlling a camera module, where the method includes:
acquiring a first image when all the color filter units are in the filtering state;
acquiring brightness data of all pixel points in the first image according to the first image;
under the condition that the brightness data of all pixel points in the first image are larger than a first brightness threshold value, all the color filter units are adjusted to be in a full-light-transmitting state;
acquiring a second image;
and outputting a target image according to the second image.
A third aspect and an embodiment of the present application provide a method for controlling a camera module, where the method includes:
acquiring a first image when all the color filter units are in the filtering state;
acquiring brightness data of all pixel points in the first image according to the first image;
acquiring a high-brightness area and a low-brightness area on the first image according to the brightness data of all pixels in the first image;
adjusting each color filter unit corresponding to the highlight region to the full-transmission state and each color filter unit corresponding to the low-brightness region to the filtering state when the brightness data of the highlight region is greater than a second brightness threshold;
acquiring a second image;
and outputting a target image according to the second image.
In a fourth aspect, an embodiment of the present application provides an electronic device, which includes the camera module described above.
In the embodiment of the application, the pixel units with the laminated structure are combined with the color filter unit capable of performing spectral transmittance adjustment, and under a dark light environment, a single large-size pixel unit is used for realizing higher light sensitivity, so that the shooting image quality under a dark light scene is ensured; under the highlight environment, single pixel unit is laminated structure for each pixel unit has contained the sensitization colour of a plurality of wave bands, makes the light signal that gets into each pixel unit can be torn open into a plurality of wave bands and read by different photosensitive device respectively, avoids the too much and overflow problem that produces of photoproduction electron, has avoided the highlight to overexpose the risk, has improved the image quality under the highlight environment.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The above and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic structural diagram of a pixel array of a camera module according to an embodiment of the present disclosure;
fig. 2 is a schematic structural diagram of a camera module according to an embodiment of the present disclosure;
fig. 3 is a second schematic structural diagram of a camera module according to an embodiment of the present disclosure;
fig. 4 is a schematic view illustrating an operating principle of a camera module according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a color filter unit of a camera module according to an embodiment of the present application;
fig. 6 is a flowchart of a control method of a camera module according to an embodiment of the present disclosure;
fig. 7 is a second flowchart of a control method of a camera module according to an embodiment of the present disclosure;
fig. 8 is a third flowchart of a control method for a camera module according to an embodiment of the present disclosure;
fig. 9 is a fourth flowchart of a control method of a camera module according to an embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The features of the terms first and second in the description and in the claims of the present application may explicitly or implicitly include one or more of such features. In the description of the present application, "a plurality" means two or more unless otherwise specified. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
In the description of the present application, it is to be understood that the terms "central," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," "circumferential," and the like are used in the orientations and positional relationships indicated in the drawings for convenience in describing the present application and to simplify the description, and are not intended to indicate or imply that the referenced devices or elements must have a particular orientation, be constructed and operated in a particular orientation, and are therefore not to be considered limiting of the present application.
In the description of the present application, it should be noted that, unless otherwise explicitly stated or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be, for example, a fixed connection, a detachable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present application can be understood in a specific case by those of ordinary skill in the art.
The following describes the camera module, the control method of the camera module, and the electronic device provided in the embodiments of the present application in detail through specific embodiments and application scenarios thereof with reference to the accompanying drawings.
With reference to fig. 1 to 3, the camera module provided by the embodiment of the present application includes a pixel unit 1 and a color filter unit 2; the pixel unit 1 comprises at least two photosensitive devices which are arranged in a stacked mode, and each photosensitive device can be used for receiving light with a wave band corresponding to the photosensitive device; the color filter unit 2 is arranged above the pixel unit 1, and the color filter unit 2 is switchable between a filtering state and a full light transmission state; when the color filter unit 2 is in the filtering state, the light filter unit is used for transmitting light with a wavelength band corresponding to the color filter unit 2, and the transmitted light can be received by a photosensitive device with a corresponding wavelength band; when the color filter unit is in the full light-transmitting state, the color filter unit is used for transmitting light of different wavebands, and the transmitted light of different wavebands can be received by the photosensitive devices of corresponding wavebands in a one-to-one correspondence manner.
In the embodiment of the application, the pixel unit 1 with the laminated structure design is combined with the color filter unit 2 capable of performing spectral transmittance adjustment, and under a dark light environment, a single large-size pixel unit 1 is used for realizing higher light sensitivity, so that the shooting image quality under a dark light scene is ensured; under the highlight environment, single pixel unit 1 itself is laminated structure for each pixel unit 1 has contained the sensitization colour of a plurality of wave bands, makes the light signal that gets into each pixel unit 1 can be torn open into a plurality of wave bands and read by different photosensitive device respectively, avoids the too much and overflow problem that produces of photogenic electron, has avoided the high light overexposure risk, has improved the image quality under the highlight environment.
In the embodiment of the present application, a plurality of color pixel (e.g. commonly used red, green, and blue, RGB) photoreceptors with different wavelength bands are sequentially stacked, so as to form a pixel unit 1 with a stacked structure. This is quite different from the conventional one pixel unit which can present only one color information.
For example, referring to fig. 1, a plurality of pixel units 1 are arranged in a matrix to form a set pixel array 100, each pixel unit 1 includes three different photosensitive devices, respectively a first photosensitive device, a second photosensitive device, and a third photosensitive device, such that the set pixel array 100 forms three photosensitive layers, respectively a first photosensitive layer 10, a second photosensitive layer 11, and a third photosensitive layer 12 from bottom to top, the first photosensitive layer 10 includes a plurality of first photosensitive devices, the second photosensitive layer 11 includes a plurality of second photosensitive devices, and the third photosensitive layer 12 includes a plurality of third photosensitive devices. The design can realize the consideration of large quantity of single pixel units and large area of the single pixel units under the condition that the size of the photosensitive sensor is limited; meanwhile, the design of a single large pixel unit is realized, which is beneficial to improving the photosensitive performance.
That is, the pixel unit 1 provided in the embodiment of the present application may include a plurality of wavelength bands of colors, which form a plurality of wavelength bands of spectrum of color sensing channels. Therefore, when the color information at the pixel unit 1 is restored, i.e. three-color synthesis is performed, algorithm filtering interpolation is not needed, false colors can be reduced, and the real color information at the pixel unit 1 can be shown. Compared with the conventional RGB pixel structure, the pixel structure has better resolving power.
It can be understood that, in the pixel unit 1 of the embodiment of the present application, since a color difference is not required, a more real color can be obtained, the difference calculation is reduced, and the power consumption is greatly reduced; on the other hand, the design of the laminated structure does not need to be interpolated by an algorithm, so that the analysis force is obviously improved.
Referring to fig. 4, which shows a schematic circuit diagram of an internal circuit of a pixel unit 14T according to an embodiment of the present application, the pixel unit 1 includes, for example, three stacked light-sensing devices (for sensing red light, green light, and blue light in visible light, respectively), and four transistors; the four transistors are respectively a Reset tube Reset, a switch TG (including TG1, TG2 and TG3 for respectively controlling each photosensitive device), a Row selector Row SEL and a signal amplifier SF.
In the embodiment of the present application, a color filter unit 2 capable of spectral transmittance adjustment is also employed.
For example, the color filter units 2 may be provided in plural and arranged in an array to form a setting filter array 200 (or referred to as a filter layer). Each Filter unit 2 can be switched between a Filter state and a full-transmission state under the control of voltage, for example, which makes the formed set Filter array 200 different from a Color Filter (CF) used in a conventional camera module.
The filter setting array 200 formed in the embodiment of the present application is a dynamically changing filter layer, and the filter band can be adjusted as needed to meet the shooting requirements of the highlight environment and the dark environment, so that the better imaging quality can be obtained in both the highlight environment and the dark environment.
Referring to fig. 2, on the setting filter array 200, when all the filter units 2 are in a filtering state, each filter unit 2 thereon may be configured to transmit light of a wavelength band corresponding to the filter unit 2.
For example, the filter array 200 has a plurality of first filter units 20, a plurality of second filter units 21, and a plurality of third filter units 22, the first filter units 20 can only transmit red light of visible light, the second filter units 22 can only transmit green light of visible light, and the third filter units 23 can only transmit blue light of visible light.
Referring to fig. 3, at least a portion of the color filter units 2 on the set filter array 200 may be decolored and changed to be transparent, and thus, the color filter units 2 changed to be transparent may be used as full-transmission sheets.
For example, referring to fig. 3, all the color filter units 2 are all adjusted to a full-transmission state, and at this time, each color filter unit 2 may transmit visible light.
When the color filter unit 2 is in the full-transmission state, it is cancelled that it can have a function of filtering light. For example, the visible light can penetrate through the color filter unit 2 to reach the pixel units 1 located below, so that the light signal entering each pixel unit 1 is split into a plurality of different wavelength bands and then is read by the corresponding photosensitive devices, thereby avoiding the overflow problem caused by excessive photo-generated electrons and avoiding the overexposure risk of high-light regions.
In some examples of the present application, the camera module further includes a controller electrically connected to the color filter unit 2, and the controller is configured to apply different voltages to the color filter unit 2 to drive the color filter unit 2 to be switchable between the filtering state and the full light transmittance state.
That is, selective transmission of a spectrum of light by the color filter unit 2 can be achieved by controlling a voltage applied to the color filter unit 2. The color filter unit 2 is designed differently from a conventional color filter based on the electro-characteristics, and requires a controller to be connected to drive it to change its state.
Wherein, the controller may be directly provided on the color filter unit 2 for supplying different driving voltages to the electrically connected color filter unit 2 so that the color filter unit 2 can be adjusted from a filtering state to a full-transmission state or from the full-transmission state to the filtering state.
Of course, the controller may be installed at another position within the camera module and then electrically connected to the color filter unit 2.
Further, in the embodiment of the present application, one controller may be provided for each color filter unit 2. Of course, a plurality of color filter units 2 having the same filter wavelength band may share one controller. Those skilled in the art can flexibly adjust the method according to specific situations, and the embodiments of the present application are not limited herein.
In some examples of the present application, the pixel unit 1 is provided in plurality, and a plurality of the pixel units 1 are arranged to set the pixel array 100; the color filter units 2 are arranged in a plurality, and the color filter units 2 are arranged to set a filter array 200; wherein, the pixel units 1 and the color filter units 2 are arranged in a one-to-one correspondence manner.
In the embodiment of the present application, a certain voltage may be applied to the color filter units 2 in a partial region of the setting filter array 200, so that the color filter units 2 in the partial region to which the voltage is applied are converted into a full-transmission state, and visible light may be transmitted, while the other color filter units 2 in the setting filter array 200 may be in a filtering state. Thus, a part of the full light transmission region and a part of the color filter region are formed on the setting filter array 200.
In some examples of the present application, the pixel unit 1 includes three photosensitive devices arranged in a stack;
when the color filter unit 2 is in the filtering state, the light source is used for transmitting light with a wavelength range corresponding to the color filter unit 2, and the transmitted light can be received by a photosensitive device with a corresponding wavelength range below the color filter unit 2;
when the color filter unit 2 is in the full light transmission state, the color filter unit is used for transmitting visible light, and red light, green light and blue light in the transmitted visible light can be respectively received by the three light sensing devices in a one-to-one correspondence manner.
That is, the pixel unit 1 of the embodiment of the present application may include three stacked photosensitive devices, each of which is, for example, a photosensitive diode of a silicon material. That is, each pixel cell 1 includes three different photosensitive channels.
For example, each pixel unit 1 is constituted by a red light-sensitive device located in the bottom layer, a green light-sensitive device located in the middle layer, and a blue light-sensitive device located in the upper layer. The stacking sequence utilizes the principle that different wavelengths of light have different penetration forces, and the longer the wavelength, the greater the penetration depth. According to the penetration depth: red > green > blue, which allows each pixel cell 1 to simultaneously capture the true red, green and blue light intensities at that pixel cell. Therefore, when the color information of the sub-pixel point is restored, namely three-color synthesis is carried out, algorithm filtering interpolation is not needed, false color can be reduced, and real color information at the pixel unit can be shown.
When the color filter unit 2 is in the full-transmission state, visible light may be directly transmitted through the color filter unit 2 to be incident into the pixel unit 1 below. At this time, red light in the visible light may be received by the red light sensing device located at the bottom layer in the pixel unit 1, green light in the visible light may be received by the green light sensing device located at the middle layer in the pixel unit 1, and blue light in the visible light may be received by the blue light sensing device located at the upper layer in the pixel unit 1. The visible light entering each pixel unit 1 is divided into a plurality of wave bands and is read by the photosensitive devices of different layers respectively, so that the overflow problem caused by excessive photo-generated electrons is avoided, the high light overexposure risk is avoided, and the imaging quality in a high-brightness shooting environment can be improved.
In some examples of the present application, the color filter unit 2 is made of an electrochromic material.
Referring to fig. 5, the color filter unit 2 of the embodiment of the present application is a multi-layered structure including an electrolyte layer 211, an electrochromic layer 212, an ion storage layer 213, and two transparent conductive layers 214; an electrochromic layer 212 and an ion storage layer 213 are separately provided on both surfaces of the electrolyte layer 211, and two transparent conductive layers 214 are respectively covered on the electrochromic layer 212 and the ion storage layer 213.
The color filter unit 2 is an electrochromic material, and can perform an oxidation-reduction reaction under the driving of an external voltage, so that the color of the material is changed, and the color is stable and stable after the reaction is balanced.
Alternatively, the material of the color filter unit 2 is tungsten oxide (WO)3)。
The process of color filter unit 2 coloring to the filter state is as follows:
when a negative voltage is applied to the color filter unit 2, ions and electrons in the ion storage layer 213 enter the electrochromic layer 212, and the chemical valence of part W is changed from +6 to +5, causing light absorption, thereby darkening the color and rendering the color on the color filter unit 2, thereby putting the color filter unit 2 in a filtered state.
The process of converting the color filter unit 2 into the full light transmission state is as follows:
when a positive voltage is applied to the color filter unit 2, ions and electrons in the ion storage layer 213 migrate out of the electrochromic layer 212, and the chemical valence of a portion W changes from +5 to +6, thereby lightening the color and allowing the color to be removed to form a transparent state on the color filter unit 2, thereby allowing the color filter unit 2 to be in a fully transmissive state.
The control of the operating state of the color filter unit 2 may be performed by applying a positive voltage or a negative voltage thereto by a controller.
In some examples of the present application, referring to fig. 2 and 3, the camera module further includes a microlens layer 300, an infrared filter 400, and an image processor; the microlens layer 300 covers the set filter array 200; the infrared filter 400 is disposed on the microlens layer 300; the image processor is electrically connected to the set pixel array 100.
The Micro Lens layer (Micro Lens)300 is used to collect light to obtain more light input.
For example, the microlens layer 300 includes a plurality of microlens units 3. The microlens units 3 are arranged in one-to-one pairing with the color filter units 2. Thus, the color filter unit 2 and the microlens unit 3 are sequentially stacked on each pixel unit 1.
The infrared filter 400 may be used to filter incident light to filter infrared light, but does not affect the transmission of visible light. After the infrared filter 400 filters out infrared light, the condition that the photo imaged under visible light is reddish can be avoided.
In addition, the infrared filter 400 may include a plurality of infrared filtering units. Thus, a color filter unit 2, a microlens unit 3, and an infrared filter unit are sequentially stacked on each pixel unit 1.
The Image processor includes, for example, an Analog-to-digital converter (ADC) and an Image Signal Processor (ISP). After receiving the optical signal and sensing the optical signal, each pixel unit 1 can convert the optical signal into a sensed electrical signal, form a digital signal matrix, i.e., an image, through a digital-to-analog converter, and then process the image signal by an image signal processor.
In addition, the camera module also comprises at least one camera lens.
The camera module provided by the embodiment of the application can be applied to electronic equipment in various forms, can realize high pixel and high light sensitivity of the camera module under the condition of not increasing the size of the light sensitive sensor, and can also improve the imaging quality of shot pictures.
The Camera Module provided by the embodiment of the application is, for example, a CMOS Camera Module (CCM), which is a Camera Module widely used in current intelligent mobile terminal devices.
Of course, the camera module provided in the embodiment of the present application includes, but is not limited to, the CMOS camera module described above, and the embodiment of the present application is not limited herein.
The embodiment of the application also provides a control method of the camera module, and the control method is based on the camera module.
The control method of the camera module provided by the embodiment of the application, referring to fig. 6, includes:
step S601 of acquiring a first image when all the color filter units are in the filtering state.
Before the first image is acquired, all the color filter units 2 on the filter array 200 may be driven to be in the filtering state by applying a negative voltage under the control of the controller. That is, the first image is taken with all the color filter units 2 in the filter state.
Step S602, acquiring brightness data of all pixel points in the first image according to the first image.
Step S603, in the case that the luminance data of all the pixel points in the first image is greater than the first luminance threshold, adjusting all the color filter units to a full-transmittance state.
And step S604, acquiring a second image.
And step S605, outputting a target image according to the second image.
It should be noted that, when the second image is acquired and then subsequently processed, the demosaicing algorithm directly applies the three-color signals read out from each pixel unit without performing color guessing.
In some examples of the present application, the step S603 may further include the steps of:
under the condition that the brightness data of all pixel points in the first image are smaller than a first brightness threshold value, all the color filter units are adjusted to be in the filtering state;
acquiring a third image; and
and outputting a target image according to the third image.
It should be noted that, after the third image is acquired, it is subjected to subsequent processing by applying a bayer array demosaicing algorithm to form the target image.
In the embodiment of the present application, when the brightness of the acquired first image is found to be too high, the application scene of the camera module is considered to be a high-brightness environment, and at this time, all the color filter units 2 on the filter array 200 are controlled to be adjusted to a full-transmittance state. Because each pixel unit 1 positioned below comprises a photosensitive channel with three wavebands of RGB (red, green and blue), signals entering each pixel unit 1 are split into the three wavebands to be read respectively, so that the overflow phenomenon caused by excessive quantity of photo-generated electrons is avoided, and the problem of overexposure of photos in a highlight environment is avoided. Shooting under a highlight scene can obtain better imaging quality.
In a specific example of the present application, referring to fig. 7, the method for controlling the camera module includes:
step S701, starting a camera module;
step S702, all the color filter units on the set filter array are in a color filtering state under the control of negative voltage;
step S703, starting the first exposure to obtain a first image;
step S704, acquiring brightness data of all pixel points in the first image;
step S705, according to the luminance data of all the pixel points in the first image, executing one of the following steps:
step S7051, when the luminance data of all the pixel points in the first image is greater than the first luminance threshold, all the color filter units on the set filter array are adjusted to a full-transmittance state under the control of a positive voltage;
step S7052, when the luminance data of all the pixel points in the first image is smaller than the first luminance threshold, all the color filter units on the set filter array are adjusted to a filter state under the control of a negative voltage;
step S706, acquiring a second image according to the step S7051;
or, according to step S7052, a third image is acquired;
step S707, outputting a target image according to the second image;
or outputting the target image according to the third image.
In step S704, the brightness data of all the pixel points in the first image may be obtained, for example, by a brightness sensor.
In the step S705, if the brightness of all the pixel points in the acquired first image is greater than a certain threshold (for example, a first brightness threshold), all the color filter units 2 are applied with a positive voltage to perform color removal, and when the pixels are read, TG1/TG2/TG3 are respectively turned on, and the B/G/R signal of each pixel unit 1 is acquired, so as to obtain a second image. Under the highlight environment, pixel element 1 outputs the sensitization signal of telecommunication and can guarantee under the sufficient prerequisite of SNR, promotes the analytic power.
In the embodiment of the present application, in a case where the luminance data of all the pixel points in the first image is smaller than the first luminance threshold, all the color filter units 2 are continuously maintained in the filter state under the control of the negative voltage.
That is, if the brightness of all the pixels in the acquired first image is less than a certain threshold (for example, the first brightness threshold), all the color filter units 2 continue to apply negative voltage to maintain the filtering state, and when the pixels are read, TG1/TG1/TG3 are simultaneously turned on, and only one fusion signal is read for each pixel unit 1, so as to obtain the third image. Under the dark light environment, the light sensing capability of the pixels is improved as much as possible, the signal to noise ratio is improved, and the dark light image quality is ensured.
Referring to fig. 8, another control method of a camera module provided in an embodiment of the present application includes:
step S801, when all the color filter units are in the filtering state, acquires a first image.
Before the first image is acquired, all the color filter units 2 on the filter array 200 may be driven to be in the filtering state by applying a negative voltage under the control of the controller. That is, the first image is taken with all the color filter units 2 in the filter state.
Step S802, according to the first image, obtaining brightness data of all pixel points in the first image.
Step S803, acquiring a high brightness region and a low brightness region on the first image according to the brightness data of all pixels in the first image.
Step S804, when the brightness data of the highlight region is greater than the second brightness threshold, adjusting each color filter unit corresponding to the highlight region to the full-transmission state, and adjusting each color filter unit corresponding to the low-brightness region to the filtering state.
And step S805, acquiring a second image.
And step 806, outputting a target image according to the second image.
When the obtained first image is found to have a highlight area, the highlight area adopts the stacked pixel units 1 to output photosensitive electric signals, and each sub-pixel comprises necessary colors of RGB (red, green and blue) three bands, so that noise introduction of detailed color information is avoided during demosaicing operation, the resolution of the highlight area is improved, signals entering the sub-pixels are split into three bands to be read out respectively, the overflow problem caused by excessive photo-generated electrons is avoided, and the saturation risk of the highlight area is avoided. For the low-brightness area (dark light area), a fusion reading mode is adopted, the obtained signal intensity is higher, the signal to noise ratio of the dark light area can be ensured, and the dark light image quality is ensured.
In a specific example of the present application, referring to fig. 9, the method for controlling the camera module includes:
step 901, starting a camera module;
step S902, all color filter units on the set filter array are in a color filtering state under the control of negative voltage;
step S903, starting the first exposure to obtain a first image;
step S904, acquiring brightness data of all pixel points in the first image, and acquiring a high brightness area and a low brightness area on the first image according to the brightness data of all the pixel points in the first image;
step S905, when the luminance data of the highlight region is greater than a second luminance threshold, adjusting each color filter unit corresponding to the highlight region to the full-transmission state, and adjusting each color filter unit corresponding to the low-luminance region to the filtering state;
step S906, starting exposure for the second time to obtain a second image;
step S907, outputting a target image according to the second image;
and performing operations such as demosaicing and the like on the second image to finish the drawing so as to output a target image.
In step S904, the brightness data of all the pixels in the first image may be obtained, for example, by a brightness sensor.
When the above embodiment is applied, R, G, B signals of three spectra exist in each pixel unit 1 when demosaicing is performed on the highlight area, so color guessing is not needed. The demosaicing algorithm of the dark light area is consistent with the demosaicing algorithm of a Bayer array.
According to another embodiment of the present application, an electronic device is provided.
The electronic equipment comprises the camera module.
The electronic device may be a terminal, or may be another device other than the terminal. For example, the electronic Device may be a Mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic Device, a Mobile Internet Device (MID), an Augmented Reality (AR)/Virtual Reality (VR) Device, a robot, a wearable Device, an ultra-Mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and may also be a server, a Network Attached Storage (Network Attached Storage, NAS), a personal computer (NAS), a Television (TV), a teller machine, a self-service machine, and the like, and the embodiments of the present application are not limited thereto.
Other configurations and operations of the electronic device according to the embodiments of the present application are known to those of ordinary skill in the art and will not be described in detail herein.
In the description herein, reference to the description of the terms "one embodiment," "some embodiments," "an illustrative embodiment," "an example," "a specific example," or "some examples" or the like means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the present application have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the application, the scope of which is defined by the claims and their equivalents.
Claims (10)
1. The utility model provides a module of making a video recording which characterized in that includes:
the pixel unit (1) comprises at least two photosensitive devices which are arranged in a stacked mode, wherein each photosensitive device is used for receiving light with a wave band corresponding to the photosensitive device; and
a color filter unit (2), the color filter unit (2) being disposed over the pixel unit (1), the color filter unit (2) being switchable between a filtering state and a fully transmissive state;
when the color filter unit (2) is in the filtering state, the light filter unit is used for transmitting the light with the wave band corresponding to the color filter unit (2), and the transmitted light can be received by the photosensitive device with the corresponding wave band;
when the color filter unit (2) is in the full light-transmitting state, the light filter unit is used for transmitting light of different wavebands, and the transmitted light of different wavebands can be received by the light-sensitive devices of corresponding wavebands in a one-to-one correspondence manner.
2. The camera module according to claim 1, further comprising a controller electrically connected to the color filter unit (2), the controller being configured to apply different voltages to the color filter unit (2) to drive the color filter unit (2) switchable between the filtering state and the fully transmissive state.
3. The camera module according to claim 1, wherein the pixel unit (1) is provided in plurality, and the plurality of pixel units (1) are arranged to set a pixel array (100);
the color filter units (2) are arranged in a plurality, and the color filter units (2) are arranged to form a set filter array (200);
the pixel units (1) and the color filter units (2) are arranged in a one-to-one correspondence mode.
4. The camera module according to claim 3, wherein the pixel unit (1) comprises three stacked photo-sensitive devices;
when the color filter unit (2) is in the filtering state, the light source is used for transmitting light with a wave band corresponding to the color filter unit (2), and the transmitted light can be received by a photosensitive device with a corresponding wave band below the color filter unit (2);
when the color filter unit (2) is in the full light transmission state, the color filter unit is used for transmitting visible light, and red light, green light and blue light in the transmitted visible light can be respectively received by the three light sensing devices in a one-to-one correspondence manner.
5. The camera module according to claim 1, wherein the color filter unit (2) is made of electrochromic material.
6. The camera module of claim 3, further comprising: a micro-lens layer (300), an infrared filter (400) and an image processor;
the micro-lens layer (300) is covered on the set filter array (200);
the infrared filter (400) is arranged on the micro-lens layer (300);
the image processor is electrically connected to the set pixel array (100).
7. A control method of a camera module according to any one of claims 1-6, characterized by comprising:
acquiring a first image when all the color filter units are in the filtering state;
acquiring brightness data of all pixel points in the first image according to the first image;
under the condition that the brightness data of all pixel points in the first image are larger than a first brightness threshold value, all the color filter units are adjusted to be in a full-light-transmitting state;
acquiring a second image;
and outputting a target image according to the second image.
8. The method for controlling a camera module according to claim 7, further comprising:
under the condition that the brightness data of all pixel points in the first image are smaller than a first brightness threshold value, all the color filter units are adjusted to be in the filtering state;
acquiring a third image; and
and outputting a target image according to the third image.
9. A control method of a camera module according to any one of claims 1-6, characterized by comprising:
acquiring a first image when all the color filter units are in the filtering state;
acquiring brightness data of all pixel points in the first image according to the first image;
acquiring a high-brightness area and a low-brightness area on the first image according to the brightness data of all pixels in the first image;
adjusting each color filter unit corresponding to the highlight region to the full-transmission state and each color filter unit corresponding to the low-brightness region to the filtering state when the brightness data of the highlight region is greater than a second brightness threshold;
acquiring a second image;
and outputting a target image according to the second image.
10. An electronic device comprising the camera module according to any one of claims 1 to 6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210291667.6A CN114650377A (en) | 2022-03-22 | 2022-03-22 | Camera module, control method of camera module and electronic equipment |
| PCT/CN2023/082454 WO2023179527A1 (en) | 2022-03-22 | 2023-03-20 | Camera module, control method for camera module, and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210291667.6A CN114650377A (en) | 2022-03-22 | 2022-03-22 | Camera module, control method of camera module and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114650377A true CN114650377A (en) | 2022-06-21 |
Family
ID=81996166
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210291667.6A Pending CN114650377A (en) | 2022-03-22 | 2022-03-22 | Camera module, control method of camera module and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114650377A (en) |
| WO (1) | WO2023179527A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115118856A (en) * | 2022-06-24 | 2022-09-27 | 维沃移动通信有限公司 | Image sensor, image processing method, camera module and electronic equipment |
| CN115278000A (en) * | 2022-06-24 | 2022-11-01 | 维沃移动通信有限公司 | Image sensor, image generation method, camera module and electronic equipment |
| CN115268128A (en) * | 2022-08-04 | 2022-11-01 | 苏州华星光电技术有限公司 | Array substrate, display panel and defect repairing method thereof |
| WO2023179527A1 (en) * | 2022-03-22 | 2023-09-28 | 维沃移动通信有限公司 | Camera module, control method for camera module, and electronic device |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105578079B (en) * | 2015-12-18 | 2017-11-17 | 广东欧珀移动通信有限公司 | Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal |
| WO2021051354A1 (en) * | 2019-09-19 | 2021-03-25 | 深圳市大疆创新科技有限公司 | Hdr image generating method, filter array, image sensor, image processing chip, and photographing device |
| CN113079306B (en) * | 2021-04-27 | 2023-09-19 | 维沃移动通信有限公司 | Image pickup module, electronic device, image pickup method, and image pickup apparatus |
| CN114125319A (en) * | 2021-11-30 | 2022-03-01 | 维沃移动通信有限公司 | Image sensor, camera module, image processing method and device and electronic equipment |
| CN114650377A (en) * | 2022-03-22 | 2022-06-21 | 维沃移动通信有限公司 | Camera module, control method of camera module and electronic equipment |
-
2022
- 2022-03-22 CN CN202210291667.6A patent/CN114650377A/en active Pending
-
2023
- 2023-03-20 WO PCT/CN2023/082454 patent/WO2023179527A1/en unknown
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023179527A1 (en) * | 2022-03-22 | 2023-09-28 | 维沃移动通信有限公司 | Camera module, control method for camera module, and electronic device |
| CN115118856A (en) * | 2022-06-24 | 2022-09-27 | 维沃移动通信有限公司 | Image sensor, image processing method, camera module and electronic equipment |
| CN115278000A (en) * | 2022-06-24 | 2022-11-01 | 维沃移动通信有限公司 | Image sensor, image generation method, camera module and electronic equipment |
| CN115268128A (en) * | 2022-08-04 | 2022-11-01 | 苏州华星光电技术有限公司 | Array substrate, display panel and defect repairing method thereof |
| CN115268128B (en) * | 2022-08-04 | 2023-08-22 | 苏州华星光电技术有限公司 | Array substrate, display panel and defect repairing method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023179527A1 (en) | 2023-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11706535B2 (en) | Digital cameras with direct luminance and chrominance detection | |
| CN111432099B (en) | Image sensor, processing system and method, electronic device, and storage medium | |
| CN114650377A (en) | Camera module, control method of camera module and electronic equipment | |
| WO2021208593A1 (en) | High dynamic range image processing system and method, electronic device, and storage medium | |
| EP2642757B1 (en) | Imaging systems with clear filter pixels | |
| US10136107B2 (en) | Imaging systems with visible light sensitive pixels and infrared light sensitive pixels | |
| EP2752008B1 (en) | Pixel array, camera using the same and color processing method based on the pixel array | |
| CN102347341B (en) | Solid-state imaging device, its driving method and electronic installation | |
| WO2021212763A1 (en) | High-dynamic-range image processing system and method, electronic device and readable storage medium | |
| CN112822466A (en) | Image sensor, camera module and electronic equipment | |
| CN112235494B (en) | Image sensor, control method, imaging device, terminal, and readable storage medium | |
| US20230086743A1 (en) | Control method, camera assembly, and mobile terminal | |
| WO2021223364A1 (en) | High-dynamic-range image processing system and method, electronic device, and readable storage medium | |
| US8111298B2 (en) | Imaging circuit and image pickup device | |
| US11626436B2 (en) | Imaging device and image sensor | |
| US20220336508A1 (en) | Image sensor, camera assembly and mobile terminal | |
| US11181671B2 (en) | Image sensor and electronic camera | |
| CN115280766B (en) | Image sensor, imaging device, electronic apparatus, image processing system, and signal processing method | |
| WO2023179589A1 (en) | Camera module and electronic device | |
| JP5018125B2 (en) | Solid-state imaging device and imaging device | |
| CN114650358A (en) | Camera module and electronic equipment | |
| EP4246959A1 (en) | Image sensor and imaging apparatus | |
| US20220139974A1 (en) | Image sensor, camera assembly, and mobile terminal | |
| JP5677413B2 (en) | Imaging device | |
| JP5054659B2 (en) | Imaging device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |