CN105430362B - Imaging method, imaging device and electronic installation - Google Patents
Imaging method, imaging device and electronic installation Download PDFInfo
- Publication number
- CN105430362B CN105430362B CN201510964274.7A CN201510964274A CN105430362B CN 105430362 B CN105430362 B CN 105430362B CN 201510964274 A CN201510964274 A CN 201510964274A CN 105430362 B CN105430362 B CN 105430362B
- Authority
- CN
- China
- Prior art keywords
- pixel
- merging
- photosensitive
- image
- photosensitive pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The invention discloses a kind of imaging method, first there is provided imaging sensor, imaging sensor includes photosensitive pixel array and the optical filter being arranged on photosensitive pixel array, and optical filter includes filter unit array, and filter unit includes white filter area and colorized optical filtering area.White filter area covers a photosensitive pixel, and colorized optical filtering area covers at least one photosensitive pixel.Then, the analog signal output that the output of photosensitive pixel array is read so that the photosensitive pixel of the colorized optical filtering area covering of same merging pixel to be produced merges into color simulation signal, and obtains merging the pixel value of pixel to generate merging image according to color simulation signal and the corresponding gray scale analog signal of white filter area.The obtained image that merges includes complete color information, and brightness and definition are higher, and noise is less.The invention also discloses a kind of imaging device that can be used for realizing this imaging method and the electronic installation of application imaging device.
Description
Technical field
The present invention relates to imaging technique, more particularly to a kind of imaging method, imaging device and electronic installation.
Background technology
The optical filtering pixel arrangements of conventional images sensor are RG, GB or RW, and GW, wherein R, G, B and W represent red respectively
Color, green, blueness and white.RG, GB are traditional arrangement modes, can collect accurate color information, but under low-light (level)
Noise is more, unintelligible, RW, and GW arrangement modes can receive preferable definition under low-light (level), but color can be inaccurate.This
Outside, the mode noise that existing photosensitive pixel output merges is larger, and signal to noise ratio is relatively low.
The content of the invention
It is contemplated that at least solving one of technical problem present in prior art.Therefore, the present invention needs offer one
Plant imaging method, imaging device and electronic installation.
The imaging method of embodiment of the present invention comprises the following steps：
Imaging sensor is provided, described image sensor includes photosensitive pixel array and is arranged at the photosensitive pixel array
On optical filter, the optical filter includes filter unit array, and the filter unit includes white filter area and colorized optical filtering area；
The white filter area covers a photosensitive pixel；The colorized optical filtering area covers at least one described photosensitive pixel；Together
The photosensitive pixel that filter unit described in one is covered, which is constituted, merges pixel；
Read the output of the photosensitive pixel array；
Colour is merged into the output of the photosensitive pixel of the same colorized optical filtering area covering for merging pixel
Analog signal；And
Handle the gray scale simulation of the color simulation signal and the corresponding photosensitive pixel output of the white filter area
Signal obtains the pixel value of the merging pixel to generate merging image.
Using the imaging method of embodiment of the present invention, the colorized optical filtering area of filter unit is used to obtain the color for merging pixel
Multimedia message, white filter area is used to obtain the monochrome information of merging pixel under low-light (level) and this monochrome information noise is less.Such as
This, the pixel value of the merging image ultimately produced had not only included color information but also the monochrome information for including low noise degree, merged image
Color is complete, and brightness and definition are preferable, and noise is few.Will be same in addition, circuit can be set in the imaging method of present embodiment
One analog signal for merging the corresponding photosensitive pixel output in colorized optical filtering area of pixel merges, to generate the colored conjunction that signal to noise ratio is high
And image and then the high merging image of generation signal to noise ratio.To sum up, the imaging method of embodiment of the present invention solves existing imaging
Some problems of method.
In some embodiments, the processing process step further comprises：
The color simulation signal and the gray scale analog signal are separately converted to colorful digital signal and gray scale numeral
Signal with obtain it is described merging pixel pixel value.
In some embodiments, each described 2*2 photosensitive pixels of filter unit covering.
In some embodiments, the process step further comprises：
Gather row k and the corresponding colorful digital signal of the photosensitive pixel of the row of kth+1 and gray scale numeral
Signal is simultaneously stored in register, wherein k=2n-1, and n is natural number, and k+1 is less than or equal to total line number of the photosensitive pixel array；And
The output of the photosensitive pixel of the row k and the row of kth+1 is extracted from the register to obtain the conjunction
And the pixel value of pixel.
In some embodiments, the pixel value for merging pixel includes colour corresponding with the color simulation signal
Pixel value and white pixel value corresponding with the gray scale analog signal；
The process step further comprises：
Merge image and according to white pixel value generation gray level image according to color pixel values generation is colored.
In some embodiments, the process step further comprises：
The colored merging image is changed into the colored subgraph of yuv format；And
The brightness value of the colored subgraph is replaced with the brightness value of the gray level image to obtain the merging figure
Picture.
The present invention also provides a kind of imaging device, and it includes：
Imaging sensor, described image sensor includes：
Photosensitive pixel array；And
It is arranged at the optical filter on the photosensitive pixel array；
The optical filter includes filter unit array, and each filter unit includes white filter area and colorized optical filtering
Area；The white filter area covers a photosensitive pixel；The colorized optical filtering area covers at least one described photosensitive pixel；
The photosensitive pixel of the same filter unit covering, which is constituted, merges pixel.
The imaging device also includes the image processing module being connected with described image sensor；
Described image sensor is used for the light-sensitive image of the same colorized optical filtering area covering for merging pixel
Color simulation signal is merged into the output of element, and for handling the color simulation signal and the corresponding institute of the white filter area
The gray scale analog signal for stating photosensitive pixel output obtains the pixel value of the merging pixel to generate merging image.
In some embodiments, described image sensor includes analog-digital converter array；The same institute for merging pixel
All photosensitive pixels for stating the covering of colorized optical filtering area are connected with an analog-digital converter；
The analog-digital converter is used to the color simulation signal and the gray scale analog signal being separately converted to colour
Data signal and gray scale data signal are to obtain the pixel value of the merging pixel.
In some embodiments, described image sensor includes the source follower being connected with the photosensitive pixel, institute
Stating source follower is used to be converted to voltage signal to be changed by the analog-digital converter by the charge signal of the photosensitive pixel
For the colorful digital signal and the gray scale data signal；
The source follower is connected with the analog-digital converter.
In some embodiments, each photosensitive pixel is connected with a source follower.
In some embodiments, it is same it is described merge pixel the colorized optical filtering area covering the photosensitive pixel with
One source follower connection.
In some embodiments, the colorized optical filtering area forms Bayer array.
In some embodiments, each filter unit includes the 2*2 photosensitive pixels.
In some embodiments, each white filter area for merging pixel covers a light-sensitive image
Element, the colorized optical filtering area covers three photosensitive pixels.
In some embodiments, described image sensor includes control module, and the control module is described for controlling
Photosensitive pixel array exposes line by line.
In some embodiments, described image sensor also includes register, and the control module is used to gather successively
The photosensitive pixel of row k and the row of kth+1 corresponding the colorful digital signal and the grey that current exposure is completed
Word signal is simultaneously stored in the register, wherein k=2n-1, and n is natural number, and k+1 is less than or equal to the total of the photosensitive pixel array
Line number.
In some embodiments, described image sensor includes micro mirror array, each micro mirror and a sense
Light pixel correspondence.
In some embodiments, the pixel value for merging pixel includes colour corresponding with the color simulation signal
Pixel value and white pixel value corresponding with the gray scale analog signal；
Described image processing module is used to merge image and according to the white according to color pixel values generation is colored
Pixel value generates gray level image.
In some embodiments, described image processing module is additionally operable to the colored image that merges being changed into YUV lattice
The colored subgraph of formula.
Described image processing module is additionally operable to the brightness value of the colored sub-image pixels to replace with the gray level image
The brightness value of respective pixel is so as to obtain the merging image.
The present invention also provides a kind of electronic installation, and it includes the imaging device in above-mentioned embodiment.
In some embodiments, the electronic installation includes mobile phone.
In some embodiments, the imaging device includes the Front camera of the mobile phone.
In some embodiments, the electronic installation includes the central processing unit and external memory being connected with the imaging device
Reservoir, the central processing unit is used to control the external memory to store the merging image.
In some embodiments, the electronic installation also includes the central processing unit being connected with the imaging device and aobvious
Showing device, the central processing unit is used to control the display device to show the merging image.
The additional aspect and advantage of the present invention will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Brief description of the drawings
The above-mentioned and/or additional aspect and advantage of the present invention will become from description of the accompanying drawings below to embodiment is combined
Obtain substantially and be readily appreciated that, wherein：
Fig. 1 is the schematic flow sheet of the imaging method of embodiment of the present invention.
Fig. 2 is that the reading photosensitive pixel of embodiment of the present invention imaging method exports and generates the schematic flow sheet of image.
Fig. 3 is that the processing photosensitive pixel of embodiment of the present invention imaging method exports and generates the schematic flow sheet of image.
Fig. 4 is that the processing photosensitive pixel of embodiment of the present invention imaging method exports and generates the schematic flow sheet of image.
Fig. 5 is that the processing photosensitive pixel of embodiment of the present invention imaging method exports and generates the schematic flow sheet of image.
Fig. 6 is the schematic side view of the imaging device of embodiment of the present invention.
Fig. 7 is the filter unit schematic diagram of the imaging sensor of embodiment of the present invention.
Fig. 8 is the utility module schematic diagram of embodiment of the present invention.
Fig. 9 is the imaging device photosensitive pixel circuit structural representation of embodiment of the present invention.
Figure 10 is the imaging device photosensitive pixel circuit structural representation of embodiment of the present invention.
Figure 11 is a kind of merging mode circuit structure signal of the imaging device photosensitive pixel output of embodiment of the present invention
Figure.
Figure 12 is that another merging mode circuit structure of the imaging device photosensitive pixel output of embodiment of the present invention shows
It is intended to.
Figure 13 is the filter unit array schematic diagram of embodiment of the present invention.
Figure 14 is Bayer array schematic diagram.
Figure 15 is the dimensional structure diagram of the imaging sensor of embodiment of the present invention.
Figure 16 is the high-level schematic functional block diagram of the imaging device of embodiment of the present invention.
Figure 17 is the dimensional structure diagram of the imaging sensor of embodiment of the present invention.
Figure 18 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Figure 19 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Embodiment
The embodiment of embodiments of the present invention is described below in detail, the example of the embodiment is shown in the accompanying drawings
Go out, wherein same or similar label represents same or similar element or the member with same or like function from beginning to end
Part.The embodiment described below with reference to accompanying drawing is exemplary, is only used for explaining embodiments of the present invention, and can not
It is interpreted as the limitation to embodiments of the present invention.
The imaging method, imaging device and electronic installation of embodiments of the present invention are made furtherly below in conjunction with accompanying drawing
It is bright.
Referring to Fig. 1, the imaging method of embodiment of the present invention comprises the following steps：
S1 is there is provided imaging sensor, and imaging sensor includes photosensitive pixel array and is arranged on photosensitive pixel array
Optical filter, optical filter includes filter unit array, and filter unit includes white filter area and colorized optical filtering area；White filter area covers
One photosensitive pixel of lid；Colorized optical filtering area covers at least one photosensitive pixel；The photosensitive pixel of same filter unit covering is constituted
Merge pixel.
S2, reads the output of photosensitive pixel array.
S3, color simulation signal is merged into by the output of the photosensitive pixel of the colorized optical filtering area covering of same merging pixel.
The gray scale analog signal of S4, processing color simulation signal and the corresponding photosensitive pixel output of white filter area is closed
And the pixel value of pixel is to generate merging image.
The colorized optical filtering area of filter unit in the imaging method of embodiment of the present invention is used to obtain the color for merging pixel
Multimedia message, white filter area is used to obtain the monochrome information of merging pixel under low-light (level) and this monochrome information noise is less.Such as
This, the pixel value for merging image had not only included color information but also the monochrome information for including low noise degree, and the color for merging image is complete, bright
Degree and definition are preferable, and noise is few.In addition, circuit can be set in the imaging method of present embodiment by same merging pixel
The analog signal of the corresponding photosensitive pixel output in colorized optical filtering area merges, to generate the colored merging image that signal to noise ratio is high.
Referring to Fig. 2, step S4 further comprises：
S41：Color simulation signal and gray scale analog signal are separately converted to colorful digital signal and gray scale data signal
To obtain the pixel value for merging pixel.
Subsequent conditioning circuit, such as digital signal processing chip (DSP, digital signal processor), need to be to light-sensitive image
The output of element carries out digital processing to generate merging image, therefore need to convert analog signals into data signal to facilitate processing.
Figure 15 and Figure 13 is referred to, in some embodiments, each filter unit covers 2*2 photosensitive pixel.
Referring to Fig. 3, in imaging method in the present embodiment, step S2 further comprises：
S42：The corresponding colorful digital signal of photosensitive pixel and gray scale data signal of collection row k and the row of kth+1 are simultaneously deposited
Enter register, wherein k=2n-1, n is natural number, and k+1 is less than or equal to total line number of photosensitive pixel array；
S43：The output of photosensitive pixel of row k and the row of kth+1 is extracted from register to obtain merging the pixel of pixel
Value；
In this way, the process that the output that can make full use of register to realize photosensitive unit reads, caches and merged, hardware
Easily realize and processing speed is very fast.
Referring to Fig. 4, in some embodiments, merging the pixel value of pixel includes coloured silk corresponding with color simulation signal
Color pixel value and white pixel value corresponding with gray scale analog signal；
Step S4 further comprises：
S45：Merge image and according to white pixel value generation gray level image according to color pixel values generation is colored.
In this way, the complete colored merging image of color information is worth to according to the colour element for merging pixel, according to merging
The white pixel of pixel is worth to brightness and the gray level image that definition is preferable, noise is less under low-light (level).
Referring to Fig. 5, in some embodiments, step S4 further comprises：
S47, merges the colored subgraph that image is changed into yuv format by colored；And
S49, replaces with the brightness value of gray level image to obtain merging image by the brightness value of colored subgraph.
The image of yuv format includes brightness attribute, it will be understood that gray level image is corresponding by the white filter area of merging pixel
White pixel be worth to, compared to colorized optical filtering area, the barrier effect of white filter area light to external world is smaller therefore same
Merge in pixel, the corresponding gray level image brightness value of white pixel value is higher, noise is also less.Therefore, by colored subgraph
Brightness value replace with gray level image brightness be worth to merging image both include complete color information, brightness, definition also compared with
It is high.Especially under low-light (level), merge image less compared with the colored merging obvious noise of image before brightness value is replaced.
In this way, one, the generally image of digital signal processing chip (DSP, digital signal processor)
Processing module can directly handle the output of imaging sensor, two, relative to it is some by circuit directly to imaging sensor
Analog signal format the scheme that is handled of output for, the information of image is preferably remained, for example, for 16M pictures
For the imaging sensor of element, the imaging method of embodiment of the present invention can retain the letter of 16M pixels (image before merging)
Breath, obtains the merging image of 4M pixels or the image of other resolution ratio by processing on this basis.
The imaging method of embodiment of the present invention can be realized by the imaging device of embodiment of the present invention.
Fig. 6 and Fig. 7 is referred to, the imaging device of embodiment of the present invention includes imaging sensor and connected with imaging sensor
The image processing module connect.
Imaging sensor 10 includes photosensitive pixel array 11 and the optical filter 13 being arranged on photosensitive pixel array 11.Filter
Piece 13 includes filter unit array 131, and each filter unit 1311 includes white filter area 1313 and colorized optical filtering area 1315, in vain
Color filter area 1313 covers a photosensitive pixel 111, and colorized optical filtering area 1315 covers at least one photosensitive pixel 111.Such as Fig. 8
In, colorized optical filtering area 1315 is green filter area, covers 3 photosensitive pixels.The photosensitive pixel that same filter unit 1311 is covered
111 constitute merging pixel.Extraneous light is irradiated to the photosensitive part 1111 of photosensitive pixel 111 to produce telecommunications by optical filter 13
Number, i.e., the analog signal that photosensitive pixel 111 is exported.
The simulation that imaging sensor 10 produces the photosensitive pixel 111 that the colorized optical filtering area 1315 of same merging pixel is covered
Signal output merges into color simulation signal.That is the corresponding color simulation signal in colorized optical filtering area 1315, white 1313 pairs of filter area
Answer gray scale analog signal.Image processing module 10 is used to be obtained merging pixel according to color simulation signal and gray scale analog signal
Pixel value is to generate merging image.
The colorized optical filtering area 1315 of the filter unit 1311 of the imaging sensor 10 of embodiment of the present invention, which is used to obtain, closes
And the color information of pixel, white filter area 1313 is used to obtain the monochrome information for merging pixel under low-light (level) and this brightness is believed
Cease noise less.The pixel value of the merging image generated with this had not only included color information but also the monochrome information for including low noise degree, closed
And the color of image is complete, brightness and definition are preferable, and noise is few.
In addition, setting circuit to close the analog signal of the corresponding photosensitive pixel output in the colorized optical filtering area of same merging pixel
And, the noise of generation is smaller.
Fig. 8 and Fig. 9 is referred to, in the present embodiment, imaging sensor 10 includes what is be connected with image processing module 50
Analog-digital converter array 21.All photosensitive pixels 111 and a modulus that the same colorized optical filtering area 1315 for merging pixel is covered
Converter 211 is connected.Analog-digital converter 211 is used to color simulation signal and gray scale analog signal being separately converted to colorful digital
Signal and gray scale data signal are to obtain merging the pixel value of pixel.
Wherein, the corresponding photosensitive pixel 111 in colorized optical filtering area 1315 is connected with signal merging treatment module 25, to colour filter
The output of the corresponding photosensitive pixel in light area 1315 handles and merges into color simulation signal.White filter area 1313 is corresponding photosensitive
The output of pixel 111 is handled by signal processing module 27.Photosensitive pixel structure includes photodiode 1113 and switching tube 1115,
Switching tube 1115 is used for the break-make for controlling photosensitive pixel to export analog signal, to control photodiode in photosensitive pixel array
1113 analog signals produced are exported line by line.
Referring to Fig. 10, in the present embodiment, the source electrode that imaging sensor 10 includes being connected with photosensitive pixel 111 is followed
Device 1117, for the charge signal of photosensitive pixel 111 to be converted into voltage signal, belongs to the voltage signal of analog signal again by mould
Number converter 211 is converted to data signal, including colorful digital signal and gray scale data signal.Source follower 1117 and modulus
Converter 211 is connected.
The charge signal that source follower 1117 can produce photodiode 1113 through illumination is converted to voltage signal,
To facilitate the further processing of analog-digital converter 211.
Referring to Fig. 10, the primary structure of photosensitive pixel 111 includes photodiode 1113 and switching tube 1115.Photoelectricity two
Pole pipe 1113 is used to illumination being converted into electric charge, and the electric charge relation proportional to intensity of illumination produced.
Also referring to Figure 10, in some embodiments, imaging sensor 10 includes control module 17 and is connected thereto
Row selection logic unit 171 and column selection logic unit 173, for the opening and closing of controlling switch pipe 1115, when switching tube 1115
During closure conducting, source follower 1117 (source follower) believes the electric charge that photodiode 1113 is produced through illumination
Number it is converted into voltage signal.Analog-digital converter 211 (ADC, Analog-to-digital converter) is used for voltage signal
Data signal is converted to, is handled with transmitting to subsequent conditioning circuit such as image processing module.
Connect referring to Fig. 10, setting each photosensitive pixel 111 with a source follower 1117 and an analog-digital converter 211
In the structure connect, several parameters of examination mainly have：Output signal strength, photodiode (PD, photo diode) noise,
Source follower (SF, source follower) noise, A/D converter noise.
Photosensitive pixel has two kinds of connected modes with source follower.
Figure 11 is referred to, in some embodiments, each photosensitive pixel 111 is connected with a source follower 1117.
The corresponding source follower 1117 of colour filter area 1315 is connected with an analog-digital converter 211 in same merging pixel.
Figure 11 is referred to, in some embodiments, each photosensitive pixel 111 is connected with a source follower 1117.
In same merging pixel the colored corresponding source follower 1117 of filter area 1315 and the white corresponding source electrode of filter area 1313 with
It is connected respectively with an analog-digital converter 211 with device 1117.
With each 111 corresponding source followers 1117 of photosensitive pixel and the circuit structure of an analog-digital converter 211
Compare, the signal output intensity of the circuit structure of present embodiment photosensitive pixel 111 is same, and photodiode 1113 is made an uproar
Sound, the noise of source follower 1117 are relatively low, therefore generally signal to noise ratio is higher, and the image of generation is apparent.
Figure 12 is referred to, in other embodiments, it is photosensitive that the same colorized optical filtering area 1315 for merging pixel is covered
Pixel 111 is connected with a source follower 1117.The corresponding source follower of colored filter area 1315 in same merging pixel
1117 are connected with an analog-digital converter 211.
With each 111 corresponding source followers 1113 of photosensitive pixel and the circuit structure of an analog-digital converter 211
Compare, though the output noise of the circuit structure of present embodiment photosensitive pixel 111 is slightly higher, output intensity is its 3 times, thus always
Signal to noise ratio is higher on body, and the image of generation is apparent.
To sum up, the photosensitive pixel of colorized optical filtering area member covering is merged using embodiment of above, when each filter unit
When covering 4 photosensitive pixels, the colored of 4M can be obtained by the photosensitive pixel array of 16M resolution ratio and merges image.Although image
Resolution ratio reduced compared to photosensitive pixel array, but the signal to noise ratio of image is higher, especially under low-light (level), noise compared with
It is few, it can preferably meet the demands such as night bat.Moreover, using the photosensitive pixel circuit structure of embodiment of above, on hardware easily
Realize, and merge compared to software, it exports photosensitive pixel the speed merged.
Figure 13 is referred to, in some embodiments, colorized optical filtering area forms Bayer array (Bayer pattern).Visit
Ear array includes filtering structure 1317, and each filtering structure 1317 includes 2*2 filter unit 1311, is green, red respectively
Color, blueness, green filter unit 1311.
Picture signal can be handled to the algorithm of Bayer structure using conventional needle using Bayer structure, without hardware
Big adjustment is done in structure.
Figure 14 is referred to, in traditional filter unit array structure, each filter unit one photosensitive pixel of correspondence and figure
As pixel.Figure 13 is referred to, in the present embodiment, filter unit array 131 uses Bayer structure, including filtering structure
1317, each filtering structure 1317 includes green, red, blueness, green filter unit 1311, and unlike, it is each to filter
The multiple photosensitive pixels 111 of the correspondence of unit 1311, wherein, one photosensitive pixel 111 of the white correspondence of filter area 1313, colorized optical filtering area
1315 correspond at least one photosensitive pixel 111.
Figure 15 and Figure 13 is referred to, in some embodiments, each filter unit 1311 covers 2*2 photosensitive pixel
111 to form merging pixel.
In addition to 2*2 structures, also 3*3,4*4, the structure (n, m are natural number) such as even any n*m, it will be understood that
The number of sequencable photosensitive pixel 111 is limited, the light-sensitive image that each merging pixel is included on photosensitive pixel array 11
If element 111 is excessive, the resolution sizes of image can be restricted, e.g., if the pixel value of photosensitive pixel array 11 is 16M, be adopted
Can obtain the merging image that resolution ratio is 4M with 2*2 merging dot structure, and use 4*4 structures just can only obtain resolution ratio for
1M merging image.Therefore 2*2 merging dot structure is a preferred arrangement mode, is sacrificing the premise of resolution ratio less as far as possible
Lower lifting brightness of image and definition.Meanwhile, facilitate the reading and conjunction realized and exported to photosensitive pixel on hardware using 2*2 structures
And handle.
Figure 15 and Figure 13 is referred to, in some embodiments, each covering of white filter area 1,313 one for merging pixel
Individual photosensitive pixel 111, colorized optical filtering area 1315 covers three photosensitive pixels 111.
So, white filter area 1313 and colorized optical filtering area 1315 fully cover the photosensitive pixel 111 for merging pixel.
Figure 16 is referred to, in some embodiments, imaging sensor also includes control module 17, and control module 17 is used for
Control photosensitive pixel array 11 exposes line by line.Control module 17 is connected with row selection logic unit 171 and column selection logic unit
173, to control the output line by line to photosensitive pixel 111 to handle.
The mode for exposing and exporting line by line is easier to realize on hardware.
Also referring to Figure 16, in the present embodiment, imaging sensor 10 also includes register 19, and control module 17 is used
In collection current exposure is completed successively the corresponding colorful digital signal of the photosensitive pixel 111 of row k and the row of kth+1 and grey
Word signal, and register 19, wherein k=2n-1 are deposited into, n is natural number, and k+1 is less than or equal to the total of photosensitive pixel array 11
Line number.
Specifically, referring to Figure 16, Figure 11 and Figure 12, imaging sensor includes and row selection logic unit 171 and column selection
Select the control module 17 of the connection of logic unit 173.Row selection logic unit 171 and column selection logic unit 173 are felt with each
The corresponding switching tube 1115 of light pixel 111 is connected, and control module 17 is used to control row selection logic unit 171 and column selection logic
Unit 173 is to gate the switching tube 1115 of the photosensitive pixel 111 of ad-hoc location.
Control module 17 controls the photosensitive pixel 111 of the first row and the second row to export analog signal first, wherein colored filter
The analog signal of the corresponding photosensitive pixel in light area merges into color simulation signal, color simulation signal through signal merging treatment module
Colorful digital signal is converted to through analog-digital converter 211 and is stored in register 19.The structure and principle of wherein analog signal please join
Read Figure 11 and Figure 12 and distinguish corresponding embodiment.The analog signal of the corresponding photosensitive pixel of white filter area is directly turned by modulus
Parallel operation is converted to gray scale data signal and is stored in register 19.
Image processing module 50 extracts from register 19 and handles colorful digital signal and gray scale data signal, to obtain phase
The pixel value of pixel should be merged.
By that analogy, until having handled last four photosensitive pixel of group of the first row and the second row.
By above processing mode, the output to the photosensitive pixel of the third line and fourth line, fifth line and the 6th row etc. is carried out
Processing, until the output of whole photosensitive pixels handles completion.
Figure 17 is referred to, in some embodiments, imaging sensor 10 includes the micro mirror battle array being arranged on optical filter 13
Row 23, each micro mirror 231 is corresponding with a photosensitive pixel 111.
Specifically, each micro mirror 231 is corresponding with a photosensitive pixel 111, including size, position correspondence.Implement some
In mode, each 2*2 photosensitive pixel 111 of correspondence of filter unit 1311 and 2*2 micro mirror 191.It is terrible as technology develops
To the higher image of resolution ratio, the photosensitive pixel 111 on sensitive film is more and more, arranges more and more intensive, single photosensitive pixel
111 is also less and less, and its light is affected, and the area of photosensitive part 1111 of photosensitive pixel 111 is limited, micro mirror 191
Light can be gathered to photosensitive part 1111, so as to lift the light reception intensity of photosensitive pixel 111 to improve image quality.
In some embodiments, merge pixel pixel value include color pixel values corresponding with color simulation signal and
White pixel value corresponding with gray scale analog signal, color pixel values constitute colored merging image, and white pixel value constitutes gray scale
Image.
In this way, to generate color information according to color pixel values corresponding with color simulation signal complete for image processing module
Colour merges image, and higher, the less gray-scale map of noise according to the corresponding white pixel value generation brightness of gray scale analog signal
Picture.
In some embodiments, image processing module is additionally operable to colour that colored merging image is changed into yuv format
Image.Image processing module is additionally operable to the brightness value of colored sub-image pixels to replace with the brightness value of gray level image respective pixel
So as to obtain merging image.
YUV is the picture format that color is described according to the principle of brightness and aberration, and yuv format includes many specific lattice
Formula, such as YUV422, YUV420 etc..In some embodiments, filter unit includes green, red, blue filter unit, image
Processing module first obtains the coloured image of rgb format according to its corresponding photosensitive pixel output, that is, obtains each image pixel
Red luma value, Green brightness value, blue intensity values, respectively with R, G, B is represented, then its corresponding yuv format image pixel
Brightness value Y=0.299*R+0.587*G+0.114*B.
In this way, can obtain the colored subgraph of yuv format.
Image processing module is used further to the brightness value of colored sub-image pixels to replace with the bright of gray level image respective pixel
Angle value is so as to obtain merging image.
Due to only substituted for the brightness value of colored sub-image pixels, therefore the integrality of its color information is not damaged.By
The brightness value for having more preferable translucent effect to export photosensitive pixel in white filter area is higher, therefore gray scale in low light situations
Image is higher than the colored brightness for merging image, and noise is also less.Therefore coloured image luminance raising, noise are made after replacing brightness
Than lifting.
To sum up, using the imaging device of embodiment of the present invention, the brightness value of colored sub-image pixels is replaced with into gray scale
The brightness value of image respective pixel can keep being lifted its brightness, signal to noise ratio and clear on the basis of its color information is complete
Degree.Using embodiment of the present invention photosensitive pixel circuit structure, the colored merging image that signal to noise ratio is high, noise is few can be generated, and
And, easily realized on hardware, and merge compared to software, it exports photosensitive pixel the speed merged.
The present invention also provides a kind of electronic installation of application imaging device.In some embodiments, electronic installation includes
Imaging device.Therefore, electronic installation has camera function and color can be generated under low-light (level) completely, and signal to noise ratio is high, definition
High merging image.
Electronic installation can be mobile phone.
In some embodiments, imaging device can be the Front camera of mobile phone.Because Front camera is used for autodyning,
And autodyne it is general require to require the definition of image and not high to image resolution requirement, using the electronics of present embodiment
Device can meet this requirement.
Figure 18 is referred to, in some embodiments, electronic installation 200 includes the centre being connected with imaging device 100
Device 81 and external memory 83 are managed, central processing unit 81 is used to control the storage of external memory 83 to merge image.
So, the merging image of generation can be stored, it is convenient after check, using or transfer.External memory 83 includes
SM (Smart Media) blocks and CF (Compact Flash) blocks etc..
Figure 19 is referred to, in some embodiments, electronic installation 200 also includes the center being connected with imaging device 100
Processor 81 and display device 85, central processing unit 81 are used to control the display of display device 85 to merge image.So, electronic installation
200 images shot can be shown in display device so that user checks.Display device is including light-emitting diode display etc..
To sum up, using the electronic installation of embodiment of the present invention, with camera function and color can be generated under low-light (level)
Completely, signal to noise ratio is high, the high merging image of definition.Particularly, when this electronic installation is the Front camera of mobile phone, it can be lifted
The brightness of auto heterodyne image and definition under low-light (level), reduce noise.
Part not deployed in imaging method and electronic installation, can join the figure of embodiment of above in embodiment of the present invention
As sensor and the corresponding part of imaging device, no longer it is developed in details herein.
In the description of this specification, reference term " embodiment ", " some embodiments ", " schematically implementation
The description of mode ", " example ", " specific example " or " some examples " etc. means to combine the specific spy that embodiment or example are described
Levy, structure, material or feature are contained at least one embodiment of the present invention or example.In this manual, to upper
The schematic representation for stating term is not necessarily referring to identical embodiment or example.Moreover, description specific features, structure,
Material or feature can in an appropriate manner be combined in any one or more embodiments or example.
Any process described otherwise above or method description are construed as in flow chart or herein, represent to include
Module, fragment or the portion of the code of one or more executable instructions for the step of realizing specific logical function or process
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not be by shown or discussion suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Represent in flow charts or logic and/or step described otherwise above herein, for example, being considered use
In the order list for the executable instruction for realizing logic function, it may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
Defeated program is for instruction execution system, device or equipment or the dress for combining these instruction execution systems, device or equipment and using
Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following：Electricity with one or more wirings
Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that can the paper of print routine thereon or other suitable be situated between
Matter, because can then enter edlin, interpretation or if necessary with other for example by carrying out optical scanner to paper or other media
Suitable method is handled electronically to obtain program, is then stored in computer storage.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, the software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage
Or firmware is realized.If, and in another embodiment, can be with well known in the art for example, realized with hardware
Any one of row technology or their combination are realized：With the logic gates for realizing logic function to data-signal
Discrete logic, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method is carried
It is rapid to can be by program to instruct the hardware of correlation to complete, program can be stored in a kind of computer-readable recording medium
In, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the invention can be integrated in a processing module, can also
That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, it would however also be possible to employ the form of software function module is realized.If integrated module with
The form of software function module realize and as independent production marketing or in use, can also be stored in one it is computer-readable
Take in storage medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changed, replacing and modification.
Claims (22)
1. a kind of imaging method, it is characterised in that comprise the following steps：
Imaging sensor is provided, described image sensor includes photosensitive pixel array and is arranged on the photosensitive pixel array
Optical filter, the optical filter includes filter unit array, and the filter unit includes white filter area and colorized optical filtering area；It is described
White filter area covers a photosensitive pixel；The colorized optical filtering area covers at least one described photosensitive pixel；Same institute
The photosensitive pixel for stating filter unit covering constitutes merging pixel；
Read the output of the photosensitive pixel array；
Color simulation is merged into the output of the photosensitive pixel of the same colorized optical filtering area covering for merging pixel
Signal；And
Handle the gray scale analog signal of the color simulation signal and the corresponding photosensitive pixel output of the white filter area
The pixel value of the merging pixel is obtained, the pixel value of the merging pixel includes colour corresponding with the color simulation signal
Pixel value and white pixel value corresponding with the gray scale analog signal, the process step also include：
Merge image and according to white pixel value generation gray level image according to color pixel values generation is colored；
The colored merging image is changed into the colored subgraph of yuv format；And
The brightness value of the colored subgraph is replaced with the brightness value of the gray level image to obtain the merging image.
2. imaging method as claimed in claim 1, it is characterised in that the processing process step further comprises：
The color simulation signal and the gray scale analog signal are separately converted to colorful digital signal and gray scale data signal
To obtain the pixel value of the merging pixel.
3. imaging method as claimed in claim 2, it is characterised in that each filter unit covering 2*2 is described photosensitive
Pixel.
4. imaging method as claimed in claim 3, it is characterised in that the process step further comprises：
Gather row k and the corresponding colorful digital signal of the photosensitive pixel of the row of kth+1 and the gray scale data signal
And register, wherein k=2n-1 are stored in, n is natural number, and k+1 is less than or equal to total line number of the photosensitive pixel array；And
The output of the photosensitive pixel of the row k and the row of kth+1 is extracted from the register to obtain the merging picture
The pixel value of element.
5. a kind of imaging device, it is characterised in that including：
Imaging sensor, described image sensor includes：
Photosensitive pixel array；And
It is arranged at the optical filter on the photosensitive pixel array；
The optical filter includes filter unit array, and each filter unit includes white filter area and colorized optical filtering area；
The white filter area covers a photosensitive pixel；The colorized optical filtering area covers at least one described light-sensitive image
Element；
The photosensitive pixel of the same filter unit covering, which is constituted, merges pixel；
The imaging device also includes the image processing module being connected with described image sensor；
Described image sensor is used for the photosensitive pixel of the same colorized optical filtering area covering for merging pixel
Color simulation signal is merged into output, and for handling the color simulation signal and the corresponding sense of the white filter area
The gray scale analog signal of light pixel output obtains the pixel value of the merging pixel, and the pixel value of the merging pixel includes and institute
The corresponding color pixel values of color simulation signal and white pixel value corresponding with the gray scale analog signal are stated, described image is passed
Sensor is additionally operable to：
Merge image and according to white pixel value generation gray level image according to color pixel values generation is colored；
The colored merging image is changed into the colored subgraph of yuv format；And
The brightness value of the colored subgraph is replaced with the brightness value of the gray level image to obtain the merging image.
6. imaging device as claimed in claim 5, it is characterised in that described image sensor includes analog-digital converter array；
All photosensitive pixels of the same colorized optical filtering area covering for merging pixel are connected with an analog-digital converter；
The analog-digital converter is used to the color simulation signal and the gray scale analog signal being separately converted to colorful digital
Signal and gray scale data signal are to obtain the pixel value of the merging pixel.
7. imaging device as claimed in claim 6, it is characterised in that described image sensor includes connecting with the photosensitive pixel
The source follower connect, the source follower is used to the charge signal of the photosensitive pixel being converted to voltage signal with by institute
State analog-digital converter and be converted to the colorful digital signal and the gray scale data signal；
The source follower is connected with the analog-digital converter.
8. imaging device as claimed in claim 7, it is characterised in that each photosensitive pixel is followed with a source electrode
Device is connected.
9. imaging device as claimed in claim 7, it is characterised in that cover in the same colorized optical filtering area for merging pixel
The photosensitive pixel of lid is connected with a source follower.
10. imaging device as claimed in claim 5, it is characterised in that the colorized optical filtering area forms Bayer array.
11. imaging device as claimed in claim 5, it is characterised in that it is individual described photosensitive that each filter unit includes 2*2
Pixel.
12. imaging device as claimed in claim 11, it is characterised in that each white filter area for merging pixel
A photosensitive pixel is covered, the colorized optical filtering area covers three photosensitive pixels.
13. imaging device as claimed in claim 11, it is characterised in that described image sensor includes control module, described
Control module is used to control the photosensitive pixel array to expose line by line.
14. imaging device as claimed in claim 13, it is characterised in that described image sensor also includes register, described
Control module is used for the corresponding colour of the photosensitive pixel of row k and the row of kth+1 that collection current exposure is completed successively
Data signal and the gray scale data signal are simultaneously stored in the register, wherein k=2n-1, and n is natural number, and k+1 is less than or equal to
Total line number of the photosensitive pixel array.
15. imaging device as claimed in claim 5, it is characterised in that described image sensor includes micro mirror array, Mei Gesuo
State micro mirror corresponding with a photosensitive pixel.
16. imaging device as claimed in claim 5, it is characterised in that the pixel value of the merging pixel includes and the coloured silk
The corresponding color pixel values of color analog signal and white pixel value corresponding with the gray scale analog signal；
Described image processing module is used to merge image and according to the white pixel according to color pixel values generation is colored
Value generation gray level image.
17. imaging device as claimed in claim 16, it is characterised in that described image processing module is additionally operable to the colour
Merge the colored subgraph that image is changed into yuv format.
Described image processing module is additionally operable to the brightness value of the colored sub-image pixels to replace with the gray level image correspondence
The brightness value of pixel is so as to obtain the merging image.
18. a kind of electronic installation, it is characterised in that including the imaging device as described in claim 14-16 any one.
19. electronic installation as claimed in claim 18, it is characterised in that the electronic installation includes mobile phone.
20. electronic installation as claimed in claim 19, it is characterised in that the imaging device includes the preposition phase of the mobile phone
Machine.
21. electronic installation as claimed in claim 18, it is characterised in that the electronic installation includes connecting with the imaging device
The central processing unit and external memory connect, the central processing unit is used to control the external memory to store the merging image.
22. electronic installation as claimed in claim 18, it is characterised in that the electronic installation also includes and the imaging device
The central processing unit and display device of connection, the central processing unit are used to control the display device to show the merging figure
Picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510964274.7A CN105430362B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging device and electronic installation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510964274.7A CN105430362B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging device and electronic installation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105430362A CN105430362A (en) | 2016-03-23 |
| CN105430362B true CN105430362B (en) | 2017-09-19 |
Family
ID=55508261
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510964274.7A Active CN105430362B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging device and electronic installation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105430362B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105578072A (en) | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | Imaging method, imaging device and electronic device |
| CN106454054B (en) | 2016-11-29 | 2019-03-19 | Oppo广东移动通信有限公司 | Control method, control device and electronic device |
| CN106504218B (en) | 2016-11-29 | 2019-03-12 | Oppo广东移动通信有限公司 | Control method, control device and electronic device |
| CN106341670B (en) | 2016-11-29 | 2017-09-22 | 广东欧珀移动通信有限公司 | Control method, control device and electronic installation |
| WO2022011547A1 (en) * | 2020-07-14 | 2022-01-20 | 深圳市汇顶科技股份有限公司 | Image sensor and related electronic device |
| CN114391248B (en) * | 2020-08-07 | 2024-02-27 | 深圳市汇顶科技股份有限公司 | Pixel array of image sensor, image sensor and electronic device |
| CN113676651B (en) * | 2021-08-25 | 2023-05-26 | 维沃移动通信有限公司 | Image sensor, control method, control device, electronic apparatus, and storage medium |
| CN113676652B (en) * | 2021-08-25 | 2023-05-26 | 维沃移动通信有限公司 | Image sensor, control method, control device, electronic apparatus, and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101467444A (en) * | 2006-06-14 | 2009-06-24 | 株式会社东芝 | Solid-state image sensor |
| CN102460700A (en) * | 2009-06-23 | 2012-05-16 | 诺基亚公司 | Color filters for sub-diffraction limit sensors |
| CN104280803A (en) * | 2013-07-01 | 2015-01-14 | 全视科技有限公司 | Color filter array, color filter array equipment and image sensor |
| EP2926718A1 (en) * | 2014-03-31 | 2015-10-07 | Fujifilm Corporation | Endoscope system and method for operating endoscope system |
-
2015
- 2015-12-18 CN CN201510964274.7A patent/CN105430362B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101467444A (en) * | 2006-06-14 | 2009-06-24 | 株式会社东芝 | Solid-state image sensor |
| CN102460700A (en) * | 2009-06-23 | 2012-05-16 | 诺基亚公司 | Color filters for sub-diffraction limit sensors |
| CN104280803A (en) * | 2013-07-01 | 2015-01-14 | 全视科技有限公司 | Color filter array, color filter array equipment and image sensor |
| EP2926718A1 (en) * | 2014-03-31 | 2015-10-07 | Fujifilm Corporation | Endoscope system and method for operating endoscope system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105430362A (en) | 2016-03-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105430362B (en) | Imaging method, imaging device and electronic installation | |
| CN105592303B (en) | imaging method, imaging device and electronic device | |
| CN105578066B (en) | Imaging method, imaging device and electronic installation | |
| CN105430361B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105430359B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105578078B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN105516697B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN105611124B (en) | Imaging sensor, imaging method, imaging device and terminal | |
| CN105611123B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105611125B (en) | Imaging method, imaging device and electronic installation | |
| CN105578080B (en) | Imaging method, imaging device and electronic device | |
| CN105430363B (en) | imaging method, imaging device and electronic device | |
| CN105611185B (en) | image generating method, device and terminal device | |
| CN105611122B (en) | Imaging sensor and output method, phase focusing method, imaging device and terminal | |
| CN105611257B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105578006B (en) | Imaging method, imaging device and electronic installation | |
| US10257447B2 (en) | Imaging method, imaging device, and electronic device | |
| CN105578081B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105578005B (en) | Imaging method, imaging device and the electronic installation of imaging sensor | |
| CN105578067B (en) | image generating method, device and terminal device | |
| CN105578079B (en) | Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal | |
| CN105635532B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105578076A (en) | Imaging method, imaging device and electronic device | |
| CN105430360B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105635702B (en) | Imaging method, imaging device and electronic installation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd. Address before: Changan town in Guangdong province Dongguan 523859 usha Beach Road No. 18 Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd. |
|
| CP03 | Change of name, title or address |