GB2386018A - Noise reduction in infra-red imaging arrays using shielded detectors - Google Patents
Noise reduction in infra-red imaging arrays using shielded detectors Download PDFInfo
- Publication number
- GB2386018A GB2386018A GB0204697A GB0204697A GB2386018A GB 2386018 A GB2386018 A GB 2386018A GB 0204697 A GB0204697 A GB 0204697A GB 0204697 A GB0204697 A GB 0204697A GB 2386018 A GB2386018 A GB 2386018A
- Authority
- GB
- United Kingdom
- Prior art keywords
- line
- noise
- signal
- detectors
- channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000003491 array Methods 0.000 title abstract description 13
- 230000009467 reduction Effects 0.000 title description 2
- 238000003331 infrared imaging Methods 0.000 title 1
- 238000000034 method Methods 0.000 claims abstract description 13
- 238000001931 thermography Methods 0.000 claims abstract description 8
- 238000012545 processing Methods 0.000 claims description 32
- 238000004422 calculation algorithm Methods 0.000 claims description 19
- 238000003384 imaging method Methods 0.000 claims description 5
- 230000001629 suppression Effects 0.000 abstract description 5
- 230000004044 response Effects 0.000 abstract description 4
- 230000003111 delayed effect Effects 0.000 abstract 2
- 230000005855 radiation Effects 0.000 abstract 1
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 229910052710 silicon Inorganic materials 0.000 description 4
- 239000010703 silicon Substances 0.000 description 4
- 238000012937 correction Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000000873 masking effect Effects 0.000 description 2
- 229910000661 Mercury cadmium telluride Inorganic materials 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000009533 lab test Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012419 revalidation Methods 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/67—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response
- H04N25/671—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response for non-uniformity detection or correction
- H04N25/677—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response for non-uniformity detection or correction for reducing the column or line fixed pattern noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
- H04N23/23—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only from thermal infrared radiation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Toxicology (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
A method and apparatus for noise suppression in infra red (IR) detector arrays is provided by removing low frequency line signal noise. This noise is observable as a low-frequency first order slope superimposed on to the actual thermal imaging response signals and natural white noise on each video line of the displayed image. The invention may be used on arrays of ferroelectric detectors, or resistance bolometer detectors arrays, or scanned single or line arrays of IR detectors. Several detectors at both ends of each line of detectors are blanked off from receiving any IR radiation. Each line signal is split into a noise processor channel A and a delay line channel B. In channel A, average outputs from each region of these blanked off detectors are processed to give the noise slope of each line signal. In channel B each line signal is delayed by the total delay in channel A. The noise slope signal for each line is subtracted from its associated delayed line signal.
Description
<Desc/Clms Page number 1>
Noise suppression in infra red detector arrays.
This invention relates to a method and apparatus for noise suppression in infra red detector arrays. The arrays may have detectors of pyroelectric, resistance bolometers, and cooled CdHgTe materials.
Pyroelectric detector arrays are useful in thermal imaging cameras such as those used by the emergency services. In smoke filled buildings they enable users to negotiate within buildings and locate people and sources of fire. Such cameras focus a series of infra red images onto an array of pyroelectric detector elements, whose collective output is displayed on a video screen for viewing by an operator. In low light levels it becomes important to provide as clear a picture as possible on the screen because the detectors are operating near performance limits. Any noise in the system degrades the observable picture.
In several thermal imagers a defect has been observed ; it takes the form of irregular horizontal lines appearing on the screen. This can be distracting or worse.
The above problem is solved, according to this invention, by measuring outputs from each line of detectors to generate a line noise error signal and subtracting this from the line signal itself.
<Desc/Clms Page number 2>
Statement of invention According to this invention method of reducing low frequency lines noise from a thermal image processor includes the steps of: imaging thermal energy from a scene onto a detector, reading detector outputs to form a succession of line signals collectively forming a frame, processing each line signal to form a video signal representing a visible image of the thermal scene for display on a screen, Characterised by the steps of blanking several detectors at both ends of a line signal to prevent receipt of thermal energy from a scene; dividing a line signal into a noise processing channel A and a delay channel B; in the noise processing channel A, time integrate signals from the blanked off detectors and subtract this from the present signal to leave white noise and low frequency noise signals ; calculate average line noise level at the left and right blanked off sections the line ; calculate the best fit line for the line noise in each line signal taking into account its slope over the complete line period to form a line slope noise signal ; in the delay channel B, delay each line of data by the same time delay as that in the noise processing channel A; subtract line slope noise signal from the noise processing channel A from the delay channel B line signal to remove the low frequency line noise in each line.
<Desc/Clms Page number 3>
According to this invention a thermal imaging processor for processing a thermal image for display on a screen includes :means for imaging thermal energy from a scene onto a detector array, means for reading detector outputs to form a succession of line signals, processing means for processing each line signal to form a video signal representing a visible image of the thermal scene for display on a screen, Characterised by :- several detectors at both ends of each line in the detector array being blanked to prevent receipt of thermal energy from a scene; means for dividing a line signal into a noise processing channel A and a delay channel 8 ; means in the noise processing channel A, for time integrating signals from the blanked off detectors and subtract them from a current signal to leave white noise and low frequency noise signals; means for calculating average line noise level at the left and right blanked off detectors; means for calculating the best fit line for the line noise taking into account its slope over the complete line period to form a noise slope line signal; a delay in the delay channel B for delaying each line of data by the same time delay as that in the noise processing channel A; means for subtracting line slope data from the noise processing channel A from the delay channel B noise slope line signal to remove the low frequency line noise in each line.
<Desc/Clms Page number 4>
The detector array may be an array of ferroelectric thermal detectors, or resistance bolometers, or a single or group of line photo detectors with optical scanning. The number of detectors blanked off at both ends of each line may be 8,16, 32 or other convenient digital number to simplify processing.
A sporadic low-frequency noise signal exists at the analogue output of the present generation of UK uncooled ferroelectric arrays. The origin of this noise signal is not known but its effect is observable as a low-frequency first order slope superimposed on to the actual thermal imaging response signals and natural white noise on each video line of the displayed image.
With ferroelectric arrays, thermal image information is extracted by taking the difference between two fields of array information using a thermal reference shutter known as a chopper. This process, termed Image Difference Processing (IDP), removes all common DC offsets and sub frame-rate signal drifts leaving only the differential thermal signal response and white noise.
However, a low-frequency noise signal remains and can be readily perceived as fluctuations in the image with a line structure. This can be confirmed by viewing adjacent lines of video information on an oscilloscope trace, revealing that the noise structure has high frequency components but mainly varies over the line period with an approximately first order linear slope.
Although the'line noise'signal has relatively low amplitude (similar to the white noise) and does not severely degrade the overall image quality, its effect is undesirable and distracting to the viewer. This problem exists on the silicon IC designs for two known thermal detector arrays. The operation of the silicon IC in these array formats has been validated using hybrid detector technology and will eventually enter mass production volumes when the integrated detector technology matures. In order to avoid a costly silicon redesign and revalidation process, it would be preferable to employ a corrective algorithm within the image processing electronics to suppress the effect of the unwanted noise signal.
<Desc/Clms Page number 5>
The method of this invention provides a line noise suppression technique that has been successfully demonstrated using a prototype thermal imaging camera. This technique provides an inexpensive solution to the line noise problem with ferroelectric arrays but could also benefit other imaging systems with similar line noise problems. Thermal cameras employing scanning of an image onto a single detector or a single line of detectors may also benefit from the invention.
Brief description of drawings.
The invention will now be described, by way of example only, with reference to the accompanying drawings of which :- Figure 1 is a block diagram of ferroelectric array image processing to provide a video output signal ; Figure 2 shows an array of ferroelectric detectors; Figure 3 is a flow diagram of a line noise suppression algorithm. * Figure 4 is an infra red image using a thermal imaging camera without the noise cancelling algorithm; Figure 5 is the image of Figure 4 with the algorithm in operation; Figure 6 is an infra red image using a thermal imaging camera without the noise cancelling algorithm; Figure 7 is the image of Figure 6 with the algorithm in operation;
<Desc/Clms Page number 6>
Figure 1 shows the processing of a thermal image into a video signal for display on a video screen such a liquid crystal display screen or a cathode ray tube screen. An infra red (IR) scene S is imaged through a lens 1 on to a detector array 2. Typically this will be an x, y matrix of 384 x 288 pyroelectric detectors, each detector forming one pixel in a displayed image. Pyroelectric detectors measure temperature differences. To do this each one is alternately exposed to IR in the scene S and a reference temperature provided by the blades 3 of a rotating shutter, controlled by a chopper motor 4.
Each detector in the array 2 is read out sequentially through a buffer and demultiplex unit 5 to give a string of voltage levels in successive time intervals.
Each voltage level represents the amount of I R received by each detector in a frame time. The frame time is the time taken to read the whole array 2. The array output is amplified by a channel gain amplifier 6 so that the dynamic range matches the input range of a following analogue to digital converter (ADC) 7. The digitised signal is then processed in a programmable logic device (PLD) 8 as described below, and converted back to an analogue signal in a DAC 9 for supply to a video monitor 10.
The standard digital processing includes the steps of:
Forming an image difference signal in an image difference processor (IDP)
11; this compares the current signal level from a given detector with that of the reference level (a signal emitted from the chopper blades 3) stored in memory 12.
Correcting the gain 13 of each detector to compensate for manufacturing differences in output for a standard measured temperature. Each detector characteristics (obtained by previous calibration) are stored in memory 14 and used to control the gain correction 13.
Video scan converting 15,16 the signal into a suitable video format for display on a video.
<Desc/Clms Page number 7>
All the above steps are controlled by a microcontroller unit 17 with memory 18.
The algorithm of the present invention operates between the IDP 11 and gain correction 13. This algorithm exploits the fact that the line noise signal varies slowly over the duration of a video line with an approximately first order slope.
By taking a measure of the noise offset at either end of the video line it is possible to compute the theoretical first order slope of the line noise over the intervening data points. The computed slope can then be subtracted from each data pixel on the active portion of the line, restoring the thermal image information to a normalised average.
The algorithm requires a small section of the left and right sides of the active array to be masked to prevent differential thermal image information breaking through and thus offsetting the algorithm, see Figure 2 where 8 detectors at both ends of each line are masked. Other numbers could be chosen, e. g. 16 (twice) detectors, but these decrease the number of active detectors and reduce horizontal field of view.
In laboratory experiments masking was achieved using a simple cardboard optical mask positioned in front of the focal plane giving an unchopped thermal signal in those areas with no differential response. The optical mask solution is not ideal however since a small amount of shadowing is observed at the edges of the mask, requiring a larger area to be obscured for correct operation of the algorithm (and thus a greater reduction in the active field of view). The preferred masking solution may be achieved electrically by altering one of the metalisation layers of the silicon readout IC during fabrication to effectively short-circuit the left and right sections of the pixel array to the reset voltage state.
<Desc/Clms Page number 8>
The algorithm steps are shown in Figure 3 and operate on a line signal one line at a time.
Step 1. Divide a line signal into a noise processing channel A and a delay channel B. This line signal is the IDP 11 output of each detector in a line with each line read sequentially. The time taken to read all detectors in one line (including blanked detectors) is a line time, and time for all lines to be read is a frame time.
In channel A.
Step 2. Time integrate each detector output. This provides an average amplitude value for each detector.
Step 3. Subtract time integrated detector value from current value to give a signal having white noise and low frequency noise only.
Step 4. Calculate the average line noise level at the left and right blanked-off sections of the line by summing together the noise signals from the'blind'eight detectors and then divide by eight (This removes the white noise). Note that this process can be performed with a simple binary divide (i. e. right shift 3) rather than employing complicated division arithmetic logic.
Step 5. Calculate the best fit line for the line noise taking into account its slope over the complete line period to form a line slope noise signal.
In channel B.
Step 6. Delay each line of data as they pass through the noise slope calculation algorithm and feedback through the main processing pipeline for correction.
<Desc/Clms Page number 9>
Step 7. Combine channels A and B and subtract the slope line noise component from each data point on the active portion of the line.
Step 8. Repeat for every line in the current field, a complete frame.
Steps 1-8 are repeated for successive frames.
The effect of the algorithm is shown in Figures 4-7. Figure 4 is a thermal image of a person processed without use of the algorithm. Several horizontal lines can be seen particularly across the shirt of the person. This is a snapshot, the position of the lines change with time because they represent noise in the system. Figure 5 is a thermal image with the algorithm in operation; note that the horizontal lines are now missing.
Figure 6 is a thermal image of electrical leads hanging on a wall. Note several horizontal lines. Figure 7 is the same image as in Figure 6 but with the algorithm in operation; note the lack of horizontal lines.
The algorithm may be implemented in hardware, e. g. in a programmable logic device or frozen in an A. S. I. C. design, or instructional software steps incorporated in a recording and storage medium such as a memory chip or disk.
Claims (6)
1. A method of reducing low frequency lines noise from a thermal image processor including the steps of :imaging thermal energy from a scene onto a detector, reading detector outputs to form a succession of line signals, processing each line signal to form a video signal representing a visible image of the thermal scene for display on a screen, Characterised by the steps of blanking several detectors at both ends of a line signal to prevent receipt of thermal energy from a scene; divide a line signal into a noise processing channel A and a delay channel B; in the noise processing channel A, time integrate signals from the blanked off detectors and subtract this from the present signal to leave white noise and low frequency noise signals; calculate average line noise level at the left and right blanked off sections the line ; calculate the best fit line for the line noise taking into account its slope over the complete line period to form a line slope noise signal ; in the delay channel B delay each line of data by the same time delay as that in the noise processing channel; subtract the line slope noise signal from the noise processing channel A from the delay channel B line signal to remove the low frequency line noise in each line.
<Desc/Clms Page number 11>
2. The method of claim 1 applied to an array of ferroelectric thermal detectors.
3. The method of claim 1 applied to an array of resistance bolometer thermal detectors.
4. The method of claim 1 wherein 8 or 16 or 32 detectors at each end of an array of detectors are blanked off.
<Desc/Clms Page number 12>
5. A thermal imaging processor for processing a thermal image for display on a screen including :means for imaging thermal energy from a scene onto a detector array, means for reading detector outputs to form a succession of line signals, processing means for processing each line signal to form a video signal representing a visible image of the thermal scene for display on a screen, Characterised by :- several detectors at both ends of each line in the detector array being blanked to prevent receipt of thermal energy from a scene; means for dividing a line signal into a noise processing channel A and a delay channel B ; means in the noise processing channel A, for time integrating signals from the blanked off detectors and subtract them from a current signal to leave white noise and low frequency noise signals; means for calculating average line noise level at the left and right blanked off detectors; means for calculating the best fit line for the line noise taking into account its slope over the complete line period to form a line slope noise signal ; a delay in the delay channel B for delaying each line of data by the same time delay as that in the noise processing channel A; means for subtracting the line slope noise signal from the noise processing channel A from the delay channel B line signal to remove the low frequency line noise in each line.
6. A processor storage device holding the instructional steps of the algorithm of Figure 3.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GB0204697A GB2386018A (en) | 2002-02-28 | 2002-02-28 | Noise reduction in infra-red imaging arrays using shielded detectors |
| AU2003215724A AU2003215724A1 (en) | 2002-02-28 | 2003-02-19 | Noise suppression in infra red detector arrays |
| PCT/GB2003/000768 WO2003073751A1 (en) | 2002-02-28 | 2003-02-19 | Noise suppression in infra red detector arrays |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GB0204697A GB2386018A (en) | 2002-02-28 | 2002-02-28 | Noise reduction in infra-red imaging arrays using shielded detectors |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| GB0204697D0 GB0204697D0 (en) | 2002-04-17 |
| GB2386018A true GB2386018A (en) | 2003-09-03 |
Family
ID=9931965
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| GB0204697A Withdrawn GB2386018A (en) | 2002-02-28 | 2002-02-28 | Noise reduction in infra-red imaging arrays using shielded detectors |
Country Status (3)
| Country | Link |
|---|---|
| AU (1) | AU2003215724A1 (en) |
| GB (1) | GB2386018A (en) |
| WO (1) | WO2003073751A1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5113851B2 (en) * | 2006-11-23 | 2013-01-09 | シクパ ホールディング エスアー | How to use a fingerprint recognition device to authenticate sheet items |
| US7767963B1 (en) | 2006-12-08 | 2010-08-03 | Draeger Safety, Inc. | Thermal imaging camera internal damping system |
| SE533650C2 (en) | 2009-04-22 | 2010-11-16 | Flir Systems Ab | Imaging method for suppressing column or row noise in an IR-detected image |
| WO2018156668A1 (en) | 2017-02-22 | 2018-08-30 | Flir Systems, Inc. | Low cost and high performance bolometer circuitry and methods |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0710011A1 (en) * | 1994-10-31 | 1996-05-01 | Eastman Kodak Company | Digital black clamp |
| JPH1023335A (en) * | 1996-07-05 | 1998-01-23 | Nec Corp | Infrared ray image pickup device |
| EP1073265A2 (en) * | 1999-07-27 | 2001-01-31 | Canon Kabushiki Kaisha | Image sensing apparatus |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2686472A1 (en) * | 1992-01-17 | 1993-07-23 | Thomson Tubes Electroniques | Method of deriving a matrix image with overall comparison with lines of pixels and reduction of the line correlated noise |
| JP3024532B2 (en) * | 1995-12-15 | 2000-03-21 | 日本電気株式会社 | Thermal infrared imaging device |
| GB2336051A (en) * | 1998-03-28 | 1999-10-06 | Secr Defence | Image processing |
| US6031891A (en) * | 1998-04-30 | 2000-02-29 | Picker International, Inc. | Dual reference blacklevel clamping device and method for video line noise removal |
| US6583416B1 (en) * | 1999-11-15 | 2003-06-24 | Sarnoff Corporation | Uncooled IR detector array having improved temperature stability and reduced fixed pattern noise |
-
2002
- 2002-02-28 GB GB0204697A patent/GB2386018A/en not_active Withdrawn
-
2003
- 2003-02-19 WO PCT/GB2003/000768 patent/WO2003073751A1/en not_active Application Discontinuation
- 2003-02-19 AU AU2003215724A patent/AU2003215724A1/en not_active Withdrawn
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0710011A1 (en) * | 1994-10-31 | 1996-05-01 | Eastman Kodak Company | Digital black clamp |
| JPH1023335A (en) * | 1996-07-05 | 1998-01-23 | Nec Corp | Infrared ray image pickup device |
| EP1073265A2 (en) * | 1999-07-27 | 2001-01-31 | Canon Kabushiki Kaisha | Image sensing apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2003073751A1 (en) | 2003-09-04 |
| AU2003215724A1 (en) | 2003-09-09 |
| GB0204697D0 (en) | 2002-04-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10412314B2 (en) | Systems and methods for photometric normalization in array cameras | |
| US6924841B2 (en) | System and method for capturing color images that extends the dynamic range of an image sensor using first and second groups of pixels | |
| US7535504B2 (en) | One chip camera with color sensing capability and high limiting resolution | |
| US4298887A (en) | Non-uniformity correction in a multielement detector array | |
| Holst | CCD arrays, cameras, and displays | |
| EP1727359B1 (en) | Method for fixed pattern noise reduction in infrared imaging cameras | |
| US20040169747A1 (en) | Image processing apparatus and method, recording medium, and program | |
| US7652250B2 (en) | Noise reduction method for imaging devices | |
| US20090079854A1 (en) | Non-uniformity correction of images generated by focal plane arrays of photodetectors | |
| US5276319A (en) | Method and device for improved IR detection with compensations for individual detector response | |
| US11233957B2 (en) | Solid state image sensor and electronic equipment | |
| WO2006003487B1 (en) | High energy, real time capable, direct radiation conversion x-ray imaging system for cd-te and cd-zn-te based cameras | |
| KR20060049870A (en) | Image pickup device and signal processing method | |
| CN110944126B (en) | Imaging system and method for performing black level correction on image sensor | |
| US20030214590A1 (en) | System and method for adaptively compensating for dark current in an image capture device | |
| GB2386018A (en) | Noise reduction in infra-red imaging arrays using shielded detectors | |
| EP2582130A2 (en) | Infrared solid state imaging device | |
| CN115002360A (en) | Infrared video non-uniformity correction method based on robust estimation | |
| JPH11177891A (en) | Correction method for image pickup output, correction device, image pickup device and image pickup system | |
| Breiter et al. | Focal plane arrays: MCT, quantum wells, PtSi | |
| JP3531256B2 (en) | Automatic correction method for variation of infrared detector | |
| Swierkowski et al. | Emissive infrared projector temperature resolution limiting factors | |
| Hou et al. | Real-time implementation of two-point nonuniformity correction for IR-CCD imagery | |
| Kamberova et al. | The effect of radiometric correction on multicamera algorithms | |
| Kalevo et al. | Sharpening methods for images captured through the Bayer matrix |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WAP | Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1) |