CN105072359B - Cmos image sensor imaging system based on compressed sensing and method - Google Patents

Cmos image sensor imaging system based on compressed sensing and method Download PDF

Info

Publication number
CN105072359B
CN105072359B CN201510532525.4A CN201510532525A CN105072359B CN 105072359 B CN105072359 B CN 105072359B CN 201510532525 A CN201510532525 A CN 201510532525A CN 105072359 B CN105072359 B CN 105072359B
Authority
CN
China
Prior art keywords
pixel
compressed sensing
image sensor
cmos image
sensor imaging
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510532525.4A
Other languages
Chinese (zh)
Other versions
CN105072359A (en
Inventor
汪辉
叶汇贤
田犁
章琦
方娜
汪宁
封松林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Advanced Research Institute of CAS
Original Assignee
Shanghai Advanced Research Institute of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Advanced Research Institute of CAS filed Critical Shanghai Advanced Research Institute of CAS
Priority to CN201510532525.4A priority Critical patent/CN105072359B/en
Publication of CN105072359A publication Critical patent/CN105072359A/en
Application granted granted Critical
Publication of CN105072359B publication Critical patent/CN105072359B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

The present invention provides a kind of cmos image sensor imaging system and method based on compressed sensing, and the imaging system includes:Pel array, for the optical signal of acquisition to be converted to electric signal;Time-sequence control module, the exposure time series for controlling the pel array;Linear feedback shift register, the pseudo-random number sequence for generating each pixel corresponding to pel array, and determine which pixel needs is averaged based on the pseudo-random number sequence;Sigma delta analog-digital converters, the pixel for being averaged successively to needs sample, the pixel after sampling are averaging and are quantified.The multiple that image taking speed of the present invention is promoted is related with selected compression ratio, controls compression ratio by the number continuously read, selected compression ratio is higher, and image taking speed is just higher, and therefore, the present invention may be implemented image taking speed and be promoted at double.The configuration of the present invention is simple can greatly improve image taking speed, be with a wide range of applications in image sensing area.

Description

Cmos image sensor imaging system based on compressed sensing and method
Technical field
The present invention relates to a kind of cmos image sensor imaging system and methods, and compressed sensing is based on more particularly to one kind Cmos image sensor imaging system and method.
Background technology
High-speed video is as a kind of significant observation means in the fields such as scientific research, engineering, military affairs and amusement many High-speed motion occasion has been able to extensive use.In scientific research, it would be desirable to the high speeds physical phenomenon such as research explosion and collision; In military affairs, real-time tracking high-speed target is needed;In daily entertainment, need to capture excellent sport moment.In addition following artificial Smart field, eyes of the high speed imaging sensor as machine, importance are self-evident.
As the core devices of high speed imaging system, the quality of imaging sensor quality, which directly decides, is ultimately imaged effect Fruit.Imaging sensor includes mainly two kinds of allusion quotations of charge coupling device (CCD) and complementary metal oxide semiconductor (CMOS) at present Type structure.Compared with CCD, cmos image sensor (CIS) is then that light intensity is converted into electric current or voltage swing, without It is that optical signal is characterized using the number of the quantity of electric charge.By fast development for many years, the performance of CIS can obtain significantly It is promoted, image quality can almost contend with CCD, can catch up from behind at last.CIS has many advantages, has at low cost, power consumption It is low, simple in structure and the advantages that be easily integrated.CIS can in time be read after having acquired signal, and therewith Relevant circuit structure can be directly integrated in inside, this makes it be substantially better than CCD in speed.
However, high speed CIS is also faced with stern challenge, although optical signal is converted to electric signal, this process is very fast Speed, but circuit operating rate restricts the overall work speed of system.Especially in the case of high speed imaging, CIS chips need To store mass data in very short time so that storage speed and space are current conventional circuit structures need to be broken through one A the most key technical bottleneck.
Traditional CIS can not break through the main reason for above-mentioned technical bottleneck and be that the sample rate of its signal is built upon Nai Kui On this special Sampling Theorem.Nyquist sampling law thinks that signal can when sample frequency is more than twice of signal frequency To be always completely recovered.Therefore, higher, the required sample frequency of the resolution ratio of image is bigger or signal itself reaches frequency It is up to the limit.Compressed sensing technology can then break through this limit.According to compressive sensing theory, when signal is in a certain substrate When being sparse (nonzero coefficient is much smaller than signal sum), required sample number can greatly reduce, and be much smaller than Nyquist sample Number.
Therefore, the CIS imaging systems and its imaging side that the purpose of the present invention is to provide a kind of based on compressed sensing technology Method, to overcome the technical bottleneck present in conventional high rate CIS.
Invention content
In view of the foregoing deficiencies of prior art, the purpose of the present invention is to provide a kind of CMOS based on compressed sensing Imaging sensor imaging system and method are broken through and are passed with the technical bottleneck for overcoming conventional high rate cmos image sensor to be faced The limitation of system nyquist sampling law, to realize that image taking speed is promoted at double.
In order to achieve the above objects and other related objects, the present invention provides a kind of cmos image sensing based on compressed sensing Device imaging system, including:Pel array, for the optical signal of acquisition to be converted to electric signal;Time-sequence control module, for controlling The exposure time series of the pel array;Linear feedback shift register, for generating each pixel corresponding to pel array The pseudo-random number sequence of point, and determine which pixel needs is averaged based on the pseudo-random number sequence;And Sigma- Delta analog-digital converters, the pixel for being averaged successively to needs are sampled, are asked the pixel after sampling Mean deviation is quantified, and observed result is obtained.
A kind of preferred embodiment of the cmos image sensor imaging system based on compressed sensing as the present invention, the picture Pixel array includes multiple sub-blocks of pixels, and each sub-blocks of pixels includes multiple pixels, wherein each sub-blocks of pixels distribution There are one independent linear feedback shift register and Sigma-delta analog-digital converters.
A kind of preferred embodiment of the cmos image sensor imaging system based on compressed sensing as the present invention, the puppet Random number sequence is made of " 1 " and " 0 ", wherein " 1 " corresponding pixel indicates that the pixel is needed by Sigma-delta moulds Number converter is averaging, and " 0 " corresponding pixel indicates that the pixel is not involved in averaging.
A kind of preferred embodiment of the cmos image sensor imaging system based on compressed sensing as the present invention, when described Sequence control module is additionally operable to be updated the pseudo-random number sequence in linear feedback shift register after each observation.
Further, the time-sequence control module is additionally operable to determine the observation frequency of required progress in a frame image.
A kind of preferred embodiment of the cmos image sensor imaging system based on compressed sensing as the present invention, it is described Cmos image sensor imaging system controls the compression ratio of image by controlling the observation frequency needed for a frame image, passes through figure The image taking speed of the compression ratio control image of picture.
A kind of preferred embodiment of the cmos image sensor imaging system based on compressed sensing as the present invention, it is described Cmos image sensor imaging system further includes:
Compressed sensing matrix operation module is compressed for carrying out discrete cosine transform based on pseudo-random sequence matrix Perceive matrix;
Discrete cosine transform coefficient computing module carries out minimizing a model for being based on observed result and compressed sensing matrix Number operation obtains the corresponding discrete cosine transform coefficient of original image;
Inverse discrete cosine transformation computing module, for being carried out to the observed result based on the discrete cosine transform coefficient Inverse discrete cosine transformation obtains original image.
The present invention also provides a kind of cmos image sensor imaging method based on compressed sensing, including step:Step 1), Optical signal is acquired based on pel array and is converted to electric signal;Step 2) is corresponded to based on linear feedback shift register generation The pseudo-random number sequence of each pixel of pel array, and which pixel needs is determined based on the pseudo-random number sequence It is averaged;Step 3), the pixel being averaged successively to needs based on Sigma-delta analog-digital converters is sampled, right Pixel after sampling is averaging and is quantified, and observed result is obtained;Step 4) is carried out based on pseudo-random sequence matrix Discrete cosine transform obtains compressed sensing matrix;Step 5) carries out minimizing a model based on observed result and compressed sensing matrix Number operation obtains the corresponding discrete cosine transform coefficient of original image;And step 6), it is based on the discrete cosine transform coefficient pair The observed result carries out inverse discrete cosine transformation and obtains original image.
A kind of preferred embodiment of the cmos image sensor imaging method based on compressed sensing as the present invention, the picture Pixel array includes multiple sub-blocks of pixels, and each sub-blocks of pixels includes multiple pixels, wherein each sub-blocks of pixels distribution There are one independent linear feedback shift register and Sigma-delta analog-digital converters.
A kind of preferred embodiment of the cmos image sensor imaging method based on compressed sensing as the present invention, the puppet Random number sequence is made of " 1 " and " 0 ", wherein " 1 " corresponding pixel indicates that the pixel is needed by Sigma-delta moulds Number converter is averaging, and " 0 " corresponding pixel indicates that the pixel is not involved in averaging.
A kind of preferred embodiment of the cmos image sensor imaging method based on compressed sensing as the present invention, passes through control The observation frequency needed for a frame image is made to control the compression ratio of image, the imaging speed of image is controlled by the compression ratio of image Degree.
As described above, the complete denomination of invention of the present invention, has the advantages that:The present invention proposes a kind of compression Cmos image sensor imaging system and imaging method are perceived, the multiple that image taking speed is promoted is related with selected compression ratio, leads to The number that continuously reads is crossed to control compression ratio, selected compression ratio is higher, and image taking speed is just higher, and therefore, the present invention can To realize that cmos image sensor image taking speed is promoted at double.In addition, the present invention, which is that each sub-blocks of pixels is non-, matches an independence Linear feedback shift register and Sigma-delta analog-digital converters, the reading between modules is parallel, to big Improve reading speed greatly;The readout of the present invention uses pipelined fabric, can save pseudo-random sequence and generate institute It takes time.The configuration of the present invention is simple can greatly improve image taking speed, be with a wide range of applications in image sensing area.
Description of the drawings
Fig. 1 is shown as the general frame signal of the cmos image sensor imaging system based on compressed sensing of the present invention Figure.
Fig. 2 is shown as the frame of a submodule in the cmos image sensor imaging system based on compressed sensing of the present invention Frame schematic diagram comprising time-sequence control module, a sub-blocks of pixels, one linear feedback shift register and one Sigma-delta analog-digital converters.
Fig. 3 is shown as the flow diagram of the cmos image sensor imaging method based on compressed sensing of the present invention.
Fig. 4 is shown as the observation flow signal of the cmos image sensor imaging method based on compressed sensing of the present invention Figure.
Component label instructions
11 pel arrays
111 sub-blocks of pixels
12 time-sequence control modules
13 linear feedback shift register groups
131 linear feedback shift registers
14 Sigma-delta analog-digital converter groups
141 Sigma-delta analog-digital converters
S11~S16 steps 1)~step 6)
Specific implementation mode
Illustrate that embodiments of the present invention, those skilled in the art can be by this specification below by way of specific specific example Disclosed content understands other advantages and effect of the present invention easily.The present invention can also pass through in addition different specific realities The mode of applying is embodied or practiced, the various details in this specification can also be based on different viewpoints with application, without departing from Various modifications or alterations are carried out under the spirit of the present invention.
Please refer to Fig.1~Fig. 4.It should be noted that the diagram provided in the present embodiment only illustrates this in a schematic way The basic conception of invention, package count when only display is with related component in the present invention rather than according to actual implementation in illustrating then Mesh, shape and size are drawn, when actual implementation kenel, quantity and the ratio of each component can be a kind of random change, and its Assembly layout kenel may also be increasingly complex.
As shown in Fig. 1~Fig. 2, wherein Fig. 1 is shown as the whole frame of the cmos image sensor imaging system of the present embodiment Frame schematic diagram, Fig. 2 is shown as a submodule in the present embodiment cmos image sensor imaging system, and (it includes timing control mould The linear feedback shift register 131 and a Sigma-delta analog-digital converter of the sub-blocks of pixels 111, one of block 12, one 141) block schematic illustration.
As shown in Figure 1, the present embodiment provides a kind of cmos image sensor imaging system based on compressed sensing, including:
Pel array 11, for the optical signal of acquisition to be converted to electric signal.Wherein, the pel array 11 includes multiple Sub-blocks of pixels 111, each sub-blocks of pixels 111 include multiple pixels.
Time-sequence control module 12, the exposure time series for controlling the pel array 11.
In addition, in the present embodiment, the time-sequence control module 12 is additionally operable to after each observation to linear feedback shift Pseudo-random number sequence in register 131 is updated, meanwhile, the time-sequence control module 12 is additionally operable to determine in a frame image The observation frequency of required progress.
In the present embodiment, the cmos image sensor imaging system is by controlling the observation frequency needed for a frame image Control the compression ratio of image, the compression ratio for passing through image controls the image taking speed of image.
Linear feedback shift register group 13, the pseudorandom for generating each pixel corresponding to pel array 11 Number Sequence, and determine which pixel needs is averaged based on the pseudo-random number sequence.
In the present embodiment, the linear feedback shift register group 13 includes multiple linear feedback shift registers 131, And each sub-blocks of pixels 111 is correspondingly arranged that there are one linear feedback shift registers 131, as shown in Figure 2.
As an example, the pseudo-random number sequence is made of " 1 " and " 0 ", wherein " 1 " corresponding pixel indicates the picture Vegetarian refreshments needs are averaging by Sigma-delta analog-digital converters 141, and " 0 " corresponding pixel indicates that the pixel is not joined With averaging.
Sigma-delta analog-digital converters group 14, the pixel for being averaged successively to needs samples, to adopting Pixel after sample is averaging and is quantified, and observed result is obtained.
In the present embodiment, the Sigma-delta analog-digital converters group 14 includes multiple Sigma-delta analog-to-digital conversions Device 141, and each sub-blocks of pixels 111 is correspondingly arranged that there are one Sigma-delta analog-digital converters 141, as shown in Figure 2.
In this implementation example, the cmos image sensor imaging system further includes:
Compressed sensing matrix operation module is compressed for carrying out discrete cosine transform based on pseudo-random sequence matrix Perceive matrix;
Discrete cosine transform coefficient computing module carries out minimizing a model for being based on observed result and compressed sensing matrix Number operation obtains the corresponding discrete cosine transform coefficient of original image;
Inverse discrete cosine transformation computing module, for being carried out to the observed result based on the discrete cosine transform coefficient Inverse discrete cosine transformation obtains original image.
As shown in Fig. 3~Fig. 4, the present embodiment also provides a kind of cmos image sensor imaging side based on compressed sensing Method, this method include mainly that acquisition observed result and image restore two processes.
The observed result of the present embodiment acquisition is not actual image, but the figure after pseudo-random sequence converts Picture.Briefly, the compression image of acquisition is the product of pseudo-random number sequence matrix Φ and original image.This is a linear change The process changed.If random sequence is made of " 0 " and " 1 ", corresponding conversion process is then that " 1 " corresponding pixel is asked With then the summation that pixel acquires is averaging.
After completing acquisition, system will enter image Restoration stage, i.e., reconstruct real image from observed result.Due to figure As having sparse characteristic on dct basis Ψ, compressed sensing matrix can be obtained in conjunction with pseudo-random number sequence matrix Φ ACS.According to compressive sensing theory, observed result and compressed sensing matrix A are being obtainedCSLater, the corresponding discrete cosine of original image Transformation coefficient can be obtained by minimizing a norm.Finally, real image can be obtained by inverse discrete cosine transformation.
As shown in figure 3, specifically, the cmos image sensor imaging method based on compressed sensing of the present embodiment includes step Suddenly:
Step 1) S11 acquires optical signal based on pel array 11 and is converted to electric signal.
In the present embodiment, the pel array 11 includes multiple sub-blocks of pixels 111, and each sub-blocks of pixels 111 is wrapped Include multiple pixels, wherein there are one 131 Hes of independent linear feedback shift register for each distribution of sub-blocks of pixels 111 Sigma-delta analog-digital converters 141.For example, entire pel array 11 can be divided into multiple 16 × 16 pixel submodules Block 111.Assuming that the number of sub-blocks of pixels 111 is M × N, then the size of entire pel array 11 is 16M × 16N.Make each picture Sub-prime module 111 is distributed there are one independent linear feedback shift register 131 and Sigma-delta analog-digital converters 141, this The purpose that sample is done is to make system can be with concurrent working, to improve processing speed.
Step 2) S12 generates each pixel corresponding to pel array 11 based on linear feedback shift register 131 Pseudo-random number sequence, and determine which pixel needs are averaged based on the pseudo-random number sequence.
In the present embodiment, the pseudo-random number sequence is made of " 1 " and " 0 ", wherein " 1 " corresponding pixel indicates Pixel needs are averaging by Sigma-delta analog-digital converters 141, and " 0 " corresponding pixel indicates the pixel It is not involved in averaging.
Step 3) S13, the pixel being averaged successively to needs based on Sigma-delta analog-digital converters 141 are adopted Sample is averaging and is quantified to the pixel after sampling, and observed result is obtained;
In the present embodiment, the compression ratio of image can be controlled by controlling the observation frequency needed for a frame image, led to Cross the image taking speed of the compression ratio control image of image.
Step 4) S14 carries out discrete cosine transform based on pseudo-random sequence matrix, obtains compressed sensing matrix;
Step 5) S15 is carried out minimizing a norm operation based on observed result and compressed sensing matrix, obtains original image pair The discrete cosine transform coefficient answered;
Step 6) S16 carries out inverse discrete cosine transformation to the observed result based on the discrete cosine transform coefficient and obtains To original image.
As shown in Fig. 3~Fig. 4, its course of work will be explained by taking single submodule as an example below.
Observed result gatherer process includes mainly three phases:Initial phase, reseting stage and reading stage.For every A submodule (includes the linear feedback shift register 131 and one of the sub-blocks of pixels 111, one of time-sequence control module 12, one A Sigma-delta analog-digital converters 141), first one is generated by linear feedback shift register 131LFSR in initial phase 256 pseudo random numbers that group is made of " 1 " and " 0 ", correspond respectively to each pixel.Wherein " 1 " corresponding pixel indicates Pixel summation will be participated in this time observation process, " 0 " then indicates that the pixel is not involved in summation.Pseudo-random sequence has generated it Afterwards, pixel corresponding with " 1 " will reset in module, prepare for the reading stage.
The reading stage is mainly completed by Sigma-delta analog-digital converters 141 (Sigma-delta ADC). Sigma-delta analog-digital converters 141 were built upon using on basis.The meeting pair of Sigma-delta analog-digital converters 141 Input carries out quick sampling, and output then can be regarded as an average embodiment of input sample.From this starting point, Sigma- Delta analog-digital converters 141 successively sample " 1 " pixel, and output result is exactly being averaged for these sampled point pixel values Value.Simultaneously as random number sequence is pseudorandom, thus the number of " 1 " is known.It can thus be found out by average value The sum of these pixel values.In addition to this, another effect of Sigma-delta analog-digital converters 141 be to output result into Row quantization.
After the above process, each submodule will obtain an observation, have 16 × 16 for picture element matrix For the case where number of sub-blocks of pixels 111 is M × N, M × N number of observation will be obtained.After having carried out primary reading, Linear feedback shift register 131LFSR is updated, the second group observations are obtained according to above step.And so on, carry out K sight It after survey, has K × M × N number of result and generates, be equivalent to the Pixel Information for obtaining K × M × N number of pixel, to form one Frame image.By using the working method of pipeline system between K observed result, i.e. initialization and reseting stage is handed over the stage of reading Mistake carries out, as shown in Figure 4.The purpose for the arrangement is that the required time of deinitialization and reseting stage is saved, to be further reduced Obtain the time of a frame image.
In contrast, traditional cmos image sensor has picture element matrix the number of 16 × 16 sub-blocks of pixels 111 For the case where mesh is M × N, acquired in Pixel Information be 16M × 16N, that is, need to obtain the Pixel Information each put.Cause This, the present invention can determine compression ratio, i.e. K by reading times:(M×N).For example, one 256 × 256 pixel Array 11 is segmented into 256 16 × 16 sub-blocks of pixels 111, if carrying out 128 read operations to each module, Corresponding compression ratio is 1:2.That is follow-up storage and the data volume of transmission will reduce by one times, thus correspondingly frame speed It doubles, realizes high speed imaging this purpose.
As described above, the present invention provides a kind of cmos image sensor imaging system and method based on compressed sensing, institute Stating imaging system includes:Pel array 11, for the optical signal of acquisition to be converted to electric signal;Time-sequence control module 12, is used for Control the exposure time series of the pel array 11;Linear feedback shift register 131, for generating corresponding to pel array 11 The pseudo-random number sequence of each pixel, and determine which pixel needs is averaged based on the pseudo-random number sequence; And Sigma-delta analog-digital converters 141, the pixel for being averaged successively to needs samples, after sampling Pixel be averaging and quantified, obtain observed result.The present invention proposes a kind of compressed sensing cmos image biography Sensor imaging system and imaging method, the multiple that image taking speed is promoted is related with selected compression ratio, passes through time continuously read It counts to control compression ratio, selected compression ratio is higher, and image taking speed is just higher, and therefore, cmos image may be implemented in the present invention Sensor image taking speed is promoted at double.In addition, the present invention, which is that each sub-blocks of pixels 111 is non-, matches an independent linear feedback shifting Bit register 131 and Sigma-delta analog-digital converters 141, the reading between modules is parallel, to greatly improve Reading speed;The readout of the present invention uses pipelined fabric, can save pseudo-random sequence and generate required time. The configuration of the present invention is simple can greatly improve image taking speed, be with a wide range of applications in image sensing area.So this Invention effectively overcomes various shortcoming in the prior art and has high industrial utilization.
The above-described embodiments merely illustrate the principles and effects of the present invention, and is not intended to limit the present invention.It is any ripe The personage for knowing this technology can all carry out modifications and changes to above-described embodiment without violating the spirit and scope of the present invention.Cause This, institute is complete without departing from the spirit and technical ideas disclosed in the present invention by those of ordinary skill in the art such as At all equivalent modifications or change, should by the present invention claim be covered.

Claims (11)

1. a kind of cmos image sensor imaging system based on compressed sensing, which is characterized in that including:
Pel array, for the optical signal of acquisition to be converted to electric signal;
Time-sequence control module, the exposure time series for controlling the pel array;
Linear feedback shift register, the pseudo-random number sequence for generating each pixel corresponding to pel array, and Determine which pixel needs is averaged based on the pseudo-random number sequence;
Sigma-delta analog-digital converters, the pixel for being averaged successively to needs samples, to the picture after sampling Vegetarian refreshments is averaging and is quantified, and observed result is obtained, wherein
The time-sequence control module is additionally operable to after each observation to the pseudorandom in the linear feedback shift register Number Sequence is updated.
2. the cmos image sensor imaging system according to claim 1 based on compressed sensing, it is characterised in that:It is described Pel array includes multiple sub-blocks of pixels, and each sub-blocks of pixels includes multiple pixels, wherein each sub-blocks of pixels point With there are one independent linear feedback shift registers and Sigma-delta analog-digital converters.
3. the cmos image sensor imaging system according to claim 1 based on compressed sensing, it is characterised in that:It is described Pseudo-random number sequence is made of " 1 " and " 0 ", wherein " 1 " corresponding pixel indicates that the pixel is needed by Sigma-delta Analog-digital converter is averaging, and " 0 " corresponding pixel indicates that the pixel is not involved in averaging.
4. the cmos image sensor imaging system according to claim 1 based on compressed sensing, it is characterised in that:It is described Time-sequence control module is additionally operable to determine the observation frequency of required progress in a frame image.
5. the cmos image sensor imaging system according to claim 1 based on compressed sensing, it is characterised in that:It is described Cmos image sensor imaging system controls the compression ratio of image by controlling the observation frequency needed for a frame image, passes through figure The image taking speed of the compression ratio control image of picture.
6. the cmos image sensor imaging system according to claim 1 based on compressed sensing, it is characterised in that:It is described Cmos image sensor imaging system further includes:
Compressed sensing matrix operation module obtains compressed sensing for carrying out discrete cosine transform based on pseudo-random sequence matrix Matrix;
Discrete cosine transform coefficient computing module carries out minimizing norm fortune for being based on observed result and compressed sensing matrix It calculates, obtains the corresponding discrete cosine transform coefficient of original image;
Inverse discrete cosine transformation computing module, for based on the discrete cosine transform coefficient to the observed result carry out instead from Scattered cosine transform obtains original image.
7. a kind of cmos image sensor imaging method based on compressed sensing, which is characterized in that including step:
Step 1) acquires optical signal based on pel array and is converted to electric signal;
Step 2) generates the pseudorandom number sequence of each pixel corresponding to pel array based on linear feedback shift register Row, and determine which pixel needs is averaged based on the pseudo-random number sequence;
Step 3), the pixel being averaged successively to needs based on Sigma-delta analog-digital converters is sampled, after sampling Pixel be averaging and quantified, obtain observed result, be based on time-sequence control module, to described linear after observation The pseudo-random number sequence in feedback shift register is updated.
8. the cmos image sensor imaging method according to claim 7 based on compressed sensing, it is characterised in that:It is described Pel array includes multiple sub-blocks of pixels, and each sub-blocks of pixels includes multiple pixels, wherein each sub-blocks of pixels point With there are one independent linear feedback shift registers and Sigma-delta analog-digital converters.
9. the cmos image sensor imaging method according to claim 7 based on compressed sensing, it is characterised in that:It is described Pseudo-random number sequence is made of " 1 " and " 0 ", wherein " 1 " corresponding pixel indicates that the pixel is needed by Sigma-delta Analog-digital converter is averaging, and " 0 " corresponding pixel indicates that the pixel is not involved in averaging.
10. the cmos image sensor imaging method according to claim 7 based on compressed sensing, it is characterised in that:It is logical The observation frequency needed for one frame image of control is crossed to control the compression ratio of image, the imaging of image is controlled by the compression ratio of image Speed.
11. the cmos image sensor imaging method according to claim 7 based on compressed sensing, it is characterised in that:Institute It further includes step to state cmos image sensor imaging method:
Step 4) carries out discrete cosine transform based on pseudo-random sequence matrix, obtains compressed sensing matrix;
Step 5), based on observed result and compressed sensing matrix carry out minimize a norm operation, obtain original image it is corresponding from Dissipate cosine transform coefficient;
Step 6) carries out inverse discrete cosine transformation to the observed result based on the discrete cosine transform coefficient and obtains artwork Picture.
CN201510532525.4A 2015-08-26 2015-08-26 Cmos image sensor imaging system based on compressed sensing and method Active CN105072359B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510532525.4A CN105072359B (en) 2015-08-26 2015-08-26 Cmos image sensor imaging system based on compressed sensing and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510532525.4A CN105072359B (en) 2015-08-26 2015-08-26 Cmos image sensor imaging system based on compressed sensing and method

Publications (2)

Publication Number Publication Date
CN105072359A CN105072359A (en) 2015-11-18
CN105072359B true CN105072359B (en) 2018-09-25

Family

ID=54501628

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510532525.4A Active CN105072359B (en) 2015-08-26 2015-08-26 Cmos image sensor imaging system based on compressed sensing and method

Country Status (1)

Country Link
CN (1) CN105072359B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2018220946B2 (en) * 2017-02-14 2023-12-14 Atracsys Sàrl High-speed optical tracking with compression and/or CMOS windowing
CN106851076B (en) * 2017-04-01 2019-10-22 重庆大学 Compressed sensing video image acquisition circuit based on address decoding
CN109938696A (en) * 2019-03-22 2019-06-28 江南大学 Electroneurographic signal compressed sensing processing method and circuit
CN111077430A (en) * 2019-12-16 2020-04-28 上海集成电路研发中心有限公司 Device and method for detecting CIS chip based on ATE
CN113824903B (en) * 2021-08-11 2022-12-02 西安电子科技大学 Image data transmission system based on compressed sensing technology
CN113938626B (en) * 2021-09-30 2023-03-24 中国科学院长春光学精密机械与物理研究所 TDI-CMOS detector and compressed sensing imaging method applying same

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638659A (en) * 2012-03-28 2012-08-15 西安电子科技大学 High-resolution imaging system and method based on CMOS-TDI (Complementary Metal Oxide Semiconductor-Time Delay and Integration) mode
CN102879783A (en) * 2012-10-12 2013-01-16 西安电子科技大学 Sparse detection frequency signal-based inverse synthetic aperture radar (ISAR) imaging method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638659A (en) * 2012-03-28 2012-08-15 西安电子科技大学 High-resolution imaging system and method based on CMOS-TDI (Complementary Metal Oxide Semiconductor-Time Delay and Integration) mode
CN102879783A (en) * 2012-10-12 2013-01-16 西安电子科技大学 Sparse detection frequency signal-based inverse synthetic aperture radar (ISAR) imaging method

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
BLOCK COMPRESSED SENSING OF NATURAL IMAGES;Lu Gan, et al.;《2007 15th International Conference on Digital Signal Processing》;20070813;全文 *
Compressive Sensing on a CMOS Separable-Transform Image Sensor;Ryan Robucci, et al.;《Proceedings of the IEEE》;20100422;第98卷(第6期);全文 *
Image Compression Using Fast 2-D DCT Technique;Kapoor A, et al.;《International Journal on Computer Science and Engineering》;20110630;第3卷(第6期);全文 *
一种改进的图像分块压缩感知模型;李蕴华;《计算机工程与应用》;20111231;第47卷(第25期);第186-189页 *
基于CMOS图像传感器的压缩感知成像系数研究;瞿广财;《中国优秀硕士论文全文库》;20140831;正文第9-11、17-28页,图3-1、3-4、3-5、3-6 *
瞿广财.基于CMOS图像传感器的压缩感知成像系数研究.《中国优秀硕士论文全文库》.2014, *

Also Published As

Publication number Publication date
CN105072359A (en) 2015-11-18

Similar Documents

Publication Publication Date Title
CN105072359B (en) Cmos image sensor imaging system based on compressed sensing and method
CN102510450A (en) Image sensor, pick-up device and image data generation method
CN102186025B (en) CMOS (complementary metal-oxide-semiconductor transistor) imaging measured value obtaining system based on compressed sensing and method thereof
CN103024309B (en) CMOS (complementary metal oxide semiconductor) image sensor for quick acquisition of single low-order accumulative images
WO2013131329A1 (en) Low power consumption digital domain accumulating cmos-tdi image sensor
CN103139500B (en) Reading circuit and operation time sequence based on sigma-delta analog to digital converter (ADC) and used for imaging sensor
Orchard et al. Real time compressive sensing video reconstruction in hardware
CN102710906A (en) CMOS (complementary metal-oxide-semiconductor transistor) image sensor for realizing two-dimensional discrete cosine transformation
US10240910B2 (en) Systems and methods for compressive image sensor techniques utilizing sparse measurement matrices
US10944923B2 (en) Code division compression for array cameras
CN105245798B (en) The CCD video compress measurement imaging system and control method perceived based on splits' positions
CN106303313B (en) The quantization summing circuit of compressed sensing cmos image sensor
US20200344428A1 (en) Compressive sensing image sensor for enhancing frame rate and operating method thereof
Leitner et al. Compressive image sensor technique with sparse measurement matrix
Liang et al. Angular‐flexible network for light field image super‐resolution
CN110248125A (en) Imaging sensor, electronic system and its operating method including it
Jendernalik et al. Analogue CMOS ASICs in image processing systems
Bevara et al. VLSI implementation of high throughput parallel pipeline median finder for IoT applications
US11877079B2 (en) Time-resolving computational image sensor architecture for time-of-flight, high-dynamic-range, and high-speed imaging
CN106982336B (en) Implement the shared method of dynamic earth fault and imaging sensor in the imaging sensor with pipeline architecture
Spinoulas et al. Sampling optimization for on-chip compressive video
Yamashita et al. A CMOS imager with a programmable bit-serial column-parallel SIMD/MIMD processor
Ayub et al. Fpga based compressive sensing framework for video compression on edge devices
Zhang et al. An ultra-high-speed hardware accelerator for image reconstruction and stereo rectification on event-based camera
CN113938626B (en) TDI-CMOS detector and compressed sensing imaging method applying same

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant