US20170026588A1 - Dual-band divided-aperture infra-red spectral imaging system - Google Patents
Dual-band divided-aperture infra-red spectral imaging system Download PDFInfo
- Publication number
- US20170026588A1 US20170026588A1 US14/700,567 US201514700567A US2017026588A1 US 20170026588 A1 US20170026588 A1 US 20170026588A1 US 201514700567 A US201514700567 A US 201514700567A US 2017026588 A1 US2017026588 A1 US 2017026588A1
- Authority
- US
- United States
- Prior art keywords
- optical
- fpa
- imaging
- scene
- imaging system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000701 chemical imaging Methods 0.000 title abstract description 17
- 230000003287 optical effect Effects 0.000 claims abstract description 448
- 230000005855 radiation Effects 0.000 claims abstract description 109
- 238000012546 transfer Methods 0.000 claims abstract description 14
- 238000003384 imaging method Methods 0.000 claims description 295
- 230000003595 spectral effect Effects 0.000 claims description 195
- 239000007789 gas Substances 0.000 claims description 80
- 238000000034 method Methods 0.000 claims description 79
- 238000012545 processing Methods 0.000 claims description 58
- 238000001228 spectrum Methods 0.000 claims description 49
- 239000013626 chemical specie Substances 0.000 claims description 41
- VNWKTOKETHGBQD-UHFFFAOYSA-N methane Chemical compound C VNWKTOKETHGBQD-UHFFFAOYSA-N 0.000 claims description 20
- RAHZWNYVWXNFOC-UHFFFAOYSA-N Sulphur dioxide Chemical compound O=S=O RAHZWNYVWXNFOC-UHFFFAOYSA-N 0.000 claims description 10
- QGZKDVFQNNGYKY-UHFFFAOYSA-N Ammonia Chemical compound N QGZKDVFQNNGYKY-UHFFFAOYSA-N 0.000 claims description 8
- RWSOTUBLDIXVET-UHFFFAOYSA-N Dihydrogen sulfide Chemical compound S RWSOTUBLDIXVET-UHFFFAOYSA-N 0.000 claims description 4
- 229910021529 ammonia Inorganic materials 0.000 claims description 4
- LELOWRISYMNNSU-UHFFFAOYSA-N hydrogen cyanide Chemical compound N#C LELOWRISYMNNSU-UHFFFAOYSA-N 0.000 claims description 4
- 229910000037 hydrogen sulfide Inorganic materials 0.000 claims description 4
- LVZWSLJZHVFIQJ-UHFFFAOYSA-N Cyclopropane Chemical compound C1CC1 LVZWSLJZHVFIQJ-UHFFFAOYSA-N 0.000 claims description 3
- 150000001335 aliphatic alkanes Chemical class 0.000 claims description 3
- 150000001336 alkenes Chemical class 0.000 claims description 3
- -1 freon Chemical compound 0.000 claims description 3
- 238000003491 array Methods 0.000 abstract description 84
- 239000000203 mixture Substances 0.000 abstract description 5
- 230000000875 corresponding effect Effects 0.000 description 60
- 241000894007 species Species 0.000 description 38
- 238000001514 detection method Methods 0.000 description 37
- 230000002123 temporal effect Effects 0.000 description 31
- 238000005259 measurement Methods 0.000 description 30
- 230000008569 process Effects 0.000 description 23
- 230000008859 change Effects 0.000 description 18
- 238000003860 storage Methods 0.000 description 17
- 238000012937 correction Methods 0.000 description 15
- 230000008901 benefit Effects 0.000 description 14
- 238000004422 calculation algorithm Methods 0.000 description 14
- 238000004891 communication Methods 0.000 description 14
- 230000033001 locomotion Effects 0.000 description 14
- 239000000126 substance Substances 0.000 description 14
- 230000005540 biological transmission Effects 0.000 description 12
- 230000009977 dual effect Effects 0.000 description 12
- 238000001816 cooling Methods 0.000 description 9
- 239000000463 material Substances 0.000 description 9
- 230000002093 peripheral effect Effects 0.000 description 9
- 230000004044 response Effects 0.000 description 9
- 238000013459 approach Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 8
- 230000035945 sensitivity Effects 0.000 description 8
- 238000010521 absorption reaction Methods 0.000 description 7
- 238000000862 absorption spectrum Methods 0.000 description 6
- 239000011159 matrix material Substances 0.000 description 6
- 125000004805 propylene group Chemical group [H]C([H])([H])C([H])([*:1])C([H])([H])[*:2] 0.000 description 6
- 230000003068 static effect Effects 0.000 description 6
- 238000000295 emission spectrum Methods 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- VJYFKVYYMZPMAB-UHFFFAOYSA-N ethoprophos Chemical compound CCCSP(=O)(OCC)SCCC VJYFKVYYMZPMAB-UHFFFAOYSA-N 0.000 description 4
- 229930195733 hydrocarbon Natural products 0.000 description 4
- 150000002430 hydrocarbons Chemical class 0.000 description 4
- 238000005286 illumination Methods 0.000 description 4
- QQONPFPTGQHPMA-UHFFFAOYSA-N propylene Natural products CC=C QQONPFPTGQHPMA-UHFFFAOYSA-N 0.000 description 4
- 210000001747 pupil Anatomy 0.000 description 4
- 238000011002 quantification Methods 0.000 description 4
- UHOVQNZJYSORNB-UHFFFAOYSA-N Benzene Chemical compound C1=CC=CC=C1 UHOVQNZJYSORNB-UHFFFAOYSA-N 0.000 description 3
- 239000004215 Carbon black (E152) Substances 0.000 description 3
- OKKJLVBELUTLKV-UHFFFAOYSA-N Methanol Chemical compound OC OKKJLVBELUTLKV-UHFFFAOYSA-N 0.000 description 3
- MWUXSHHQAYIFBG-UHFFFAOYSA-N Nitric oxide Chemical compound O=[N] MWUXSHHQAYIFBG-UHFFFAOYSA-N 0.000 description 3
- YXFVVABEGXRONW-UHFFFAOYSA-N Toluene Chemical compound CC1=CC=CC=C1 YXFVVABEGXRONW-UHFFFAOYSA-N 0.000 description 3
- 230000000903 blocking effect Effects 0.000 description 3
- 238000009529 body temperature measurement Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000010438 heat treatment Methods 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 230000001902 propagating effect Effects 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- CURLTUGMZLYLDI-UHFFFAOYSA-N Carbon dioxide Chemical compound O=C=O CURLTUGMZLYLDI-UHFFFAOYSA-N 0.000 description 2
- LFQSCWFLJHTTHZ-UHFFFAOYSA-N Ethanol Chemical compound CCO LFQSCWFLJHTTHZ-UHFFFAOYSA-N 0.000 description 2
- OAKJQQAXSVQMHS-UHFFFAOYSA-N Hydrazine Chemical compound NN OAKJQQAXSVQMHS-UHFFFAOYSA-N 0.000 description 2
- 229910000661 Mercury cadmium telluride Inorganic materials 0.000 description 2
- OFBQJSOFQDEBGM-UHFFFAOYSA-N Pentane Chemical compound CCCCC OFBQJSOFQDEBGM-UHFFFAOYSA-N 0.000 description 2
- ATUOYWHBWRKTHZ-UHFFFAOYSA-N Propane Chemical compound CCC ATUOYWHBWRKTHZ-UHFFFAOYSA-N 0.000 description 2
- MCMSPRNYOJJPIZ-UHFFFAOYSA-N cadmium;mercury;tellurium Chemical compound [Cd]=[Te]=[Hg] MCMSPRNYOJJPIZ-UHFFFAOYSA-N 0.000 description 2
- MVPPADPHJFYWMZ-UHFFFAOYSA-N chlorobenzene Chemical compound ClC1=CC=CC=C1 MVPPADPHJFYWMZ-UHFFFAOYSA-N 0.000 description 2
- 238000000576 coating method Methods 0.000 description 2
- 239000002131 composite material Substances 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 230000007123 defense Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000004069 differentiation Effects 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 239000002360 explosive Substances 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- NNPPMTNAJDCUHE-UHFFFAOYSA-N isobutane Chemical compound CC(C)C NNPPMTNAJDCUHE-UHFFFAOYSA-N 0.000 description 2
- QWTDNUCVQCZILF-UHFFFAOYSA-N isopentane Chemical compound CCC(C)C QWTDNUCVQCZILF-UHFFFAOYSA-N 0.000 description 2
- IVSZLXZYQVIEFR-UHFFFAOYSA-N m-xylene Chemical group CC1=CC=CC(C)=C1 IVSZLXZYQVIEFR-UHFFFAOYSA-N 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- CRSOQBOWXPBRES-UHFFFAOYSA-N neopentane Chemical compound CC(C)(C)C CRSOQBOWXPBRES-UHFFFAOYSA-N 0.000 description 2
- URLKBWYHVLBVBO-UHFFFAOYSA-N p-dimethylbenzene Natural products CC1=CC=C(C)C=C1 URLKBWYHVLBVBO-UHFFFAOYSA-N 0.000 description 2
- 238000000411 transmission spectrum Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- SCYULBFZEHDVBN-UHFFFAOYSA-N 1,1-Dichloroethane Chemical compound CC(Cl)Cl SCYULBFZEHDVBN-UHFFFAOYSA-N 0.000 description 1
- WSLDOOZREJYCGB-UHFFFAOYSA-N 1,2-Dichloroethane Chemical compound ClCCCl WSLDOOZREJYCGB-UHFFFAOYSA-N 0.000 description 1
- OCJBOOLMMGQPQU-UHFFFAOYSA-N 1,4-dichlorobenzene Chemical compound ClC1=CC=C(Cl)C=C1 OCJBOOLMMGQPQU-UHFFFAOYSA-N 0.000 description 1
- 238000012935 Averaging Methods 0.000 description 1
- JBANRMVWPQTQQS-UHFFFAOYSA-N C#N.S(=O)=O Chemical compound C#N.S(=O)=O JBANRMVWPQTQQS-UHFFFAOYSA-N 0.000 description 1
- UGFAIRIUMAVXCW-UHFFFAOYSA-N Carbon monoxide Chemical compound [O+]#[C-] UGFAIRIUMAVXCW-UHFFFAOYSA-N 0.000 description 1
- OTMSDBZUPAUEDD-UHFFFAOYSA-N Ethane Chemical compound CC OTMSDBZUPAUEDD-UHFFFAOYSA-N 0.000 description 1
- 244000256297 Euphorbia tirucalli Species 0.000 description 1
- 238000004566 IR spectroscopy Methods 0.000 description 1
- GOOHAUXETOMSMM-UHFFFAOYSA-N Propylene oxide Chemical compound CC1CO1 GOOHAUXETOMSMM-UHFFFAOYSA-N 0.000 description 1
- 229910018503 SF6 Inorganic materials 0.000 description 1
- BZHJMEDXRYGGRV-UHFFFAOYSA-N Vinyl chloride Chemical compound ClC=C BZHJMEDXRYGGRV-UHFFFAOYSA-N 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- BJQHLKABXJIVAM-UHFFFAOYSA-N bis(2-ethylhexyl) phthalate Chemical compound CCCCC(CC)COC(=O)C1=CC=CC=C1C(=O)OCC(CC)CCCC BJQHLKABXJIVAM-UHFFFAOYSA-N 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 229910002092 carbon dioxide Inorganic materials 0.000 description 1
- 239000001569 carbon dioxide Substances 0.000 description 1
- 229910002091 carbon monoxide Inorganic materials 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000000919 ceramic Substances 0.000 description 1
- 230000001010 compromised effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000002939 deleterious effect Effects 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 229940117389 dichlorobenzene Drugs 0.000 description 1
- AFABGHUZZDYHJO-UHFFFAOYSA-N dimethyl butane Natural products CCCC(C)C AFABGHUZZDYHJO-UHFFFAOYSA-N 0.000 description 1
- 238000001839 endoscopy Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 239000005431 greenhouse gas Substances 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- WPYVAWXEWQSOGY-UHFFFAOYSA-N indium antimonide Chemical compound [Sb]#[In] WPYVAWXEWQSOGY-UHFFFAOYSA-N 0.000 description 1
- 238000003331 infrared imaging Methods 0.000 description 1
- 238000002329 infrared spectrum Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 239000001282 iso-butane Substances 0.000 description 1
- 235000013847 iso-butane Nutrition 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012067 mathematical method Methods 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000000386 microscopy Methods 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- IJDNQMDRQITEOD-UHFFFAOYSA-N n-butane Chemical compound CCCC IJDNQMDRQITEOD-UHFFFAOYSA-N 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000003071 parasitic effect Effects 0.000 description 1
- 239000000575 pesticide Substances 0.000 description 1
- 229920003023 plastic Polymers 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 239000001294 propane Substances 0.000 description 1
- 238000007670 refining Methods 0.000 description 1
- 230000006335 response to radiation Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- SFZCNBIFKDRMGX-UHFFFAOYSA-N sulfur hexafluoride Chemical compound FS(F)(F)(F)(F)F SFZCNBIFKDRMGX-UHFFFAOYSA-N 0.000 description 1
- 229960000909 sulfur hexafluoride Drugs 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000001429 visible spectrum Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
- G01J3/0232—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows using shutters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0256—Compact construction
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2803—Investigating the spectrum using photoelectric array detector
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/30—Measuring the intensity of spectral lines directly on the spectrum itself
- G01J3/36—Investigating two or more bands of a spectrum by separate detectors
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/0014—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation from gases, flames
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/02—Constructional details
- G01J5/08—Optical arrangements
- G01J5/0803—Arrangements for time-dependent attenuation of radiation signals
- G01J5/0804—Shutters
-
- G01J5/0834—
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
- G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
- G01N21/35—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light
- G01N21/3504—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light for analysing gases, e.g. multi-gas analysis
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/20—Filters
- G02B5/201—Filters in the form of arrays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/20—Filters
- G02B5/208—Filters for use with infrared or ultraviolet radiation, e.g. for separating visible light from infrared and/or ultraviolet radiation
-
- G06K9/00624—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/143—Sensing or illuminating at different wavelengths
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/147—Details of sensors, e.g. sensor lenses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/17—Image acquisition using hand-held instruments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
-
- H04N5/2258—
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2823—Imaging spectrometer
- G01J2003/2826—Multispectral imaging, e.g. filter imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J2005/0077—Imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
- G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
- G01N21/35—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light
- G01N21/3504—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light for analysing gases, e.g. multi-gas analysis
- G01N2021/3531—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light for analysing gases, e.g. multi-gas analysis without instrumental source, i.e. radiometric
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/02—Mechanical
- G01N2201/022—Casings
- G01N2201/0221—Portable; cableless; compact; hand-held
Definitions
- the present disclosure generally relates to a system and method for gas cloud detection and, in particular, to a system and method of detecting spectral signatures of chemical compositions in a mid- and long-wave infrared spectral region.
- Spectral imaging systems and methods have applications in a variety of fields. Spectral imaging systems and methods obtain a spectral image of a scene in one or more regions of the electromagnetic spectrum to detect phenomena, identify material compositions or characterize processes.
- the spectral image of the scene can be represented as a three-dimensional data cube where two axes of the cube represent two spatial dimensions of the scene and a third axes of the data cube represents spectral information of the scene in different wavelength regions.
- the data cube can be processed using mathematical methods to obtain information about the scene.
- Some of the existing spectral imaging systems generate the data cube by scanning the scene in the spatial domain (e.g., by moving a slit across the horizontal dimensions of the scene) and/or spectral domain (e.g., by scanning a wavelength dispersive element to obtain images of the scene in different spectral regions). Such scanning approaches acquire only a portion of the full data cube at a time. These portions of the full data cube are stored and then later processed to generate a full data cube.
- IR imaging system for determining a concentration of a target chemical species in an object (e.g., a gas plume).
- the imaging system includes (i) an optical system, having an optical focal plane array (FPA) unit configured to receive IR radiation from the object along at least two or more optical channels defined by components of the optical system, the at least two or more optical channels being spatially and spectrally different from one another; and (ii) a processor or processing electronics configured to acquire multispectral optical data representing said target chemical species from the received IR radiation in a single occurrence of data acquisition (or snapshot).
- the optical FPA unit includes an array of photo-sensitive devices that are disposed at the focus of one or more lenses.
- the array of photo-sensitive devices can include a two-dimensional imaging sensor that is sensitive to radiation having wavelengths between 1 ⁇ m and 20 ⁇ m (for example, in mid infra-red wavelength range, long infra-red wavelength range, visible wavelength range, etc.).
- the array of photo-sensitive devices can include CCD or CMOS sensors, bolometers or other detectors that are sensitive to infra-red radiation.
- the optical system may include an optical aperture (a boundary of which is defined to circumscribe or encompass the at least two or more spatially distinct optical channels) and one or more optical filters.
- the one or more optical filters can comprise at least two spectrally-multiplexed filters.
- Each of these optical filters can be associated with one of the at least two or more optical channels and configured to transmit a portion of the IR radiation received in the associated optical channel.
- the one or more optical filters can be spectrally multiplexed and may include, for example, at least one of a longpass optical filter and a shortpass optical filter, or a band pass filter (with or without a combination with another filter such as a notch filter, for example).
- the optical system may further include at least two imaging lenses.
- the at least two imaging lenses for example each of the imaging lens, may be disposed to transmit IR radiation (for example, between about 1 micron and about 20 microns), that has been transmitted through a corresponding optical filter towards the optical FPA unit.
- the optical FPA unit is positioned to receive IR radiation from the object through the at least two imaging lenses to form respectively-corresponding two or more sets of imaging data representing the object.
- the processor or processing electronics is configured to acquire this optical data from the two or more sets of imaging data.
- the FPA unit may be devoid of cooling systems.
- two or more of the array of photo-sensitive devices may be uncooled.
- the system further comprises two or more temperature-controlled shutters removably positioned to block IR radiation incident onto the optical system from the object.
- the method includes receiving IR radiation from an object through at least two optical channels defined by components of an optical system of the IR imaging system, which at least two optical channels are spatially and spectrally different from one another.
- the method further includes transmitting the received IR radiation towards an optical focal plane array (FPA) unit that is not being cooled in the course of normal operation.
- FPA optical focal plane array
- the FPA unit may be devoid of cooling systems.
- two or more of the array of photo-sensitive devices may be uncooled.
- Some embodiments further comprise removably positioning at least one of at least two temperature-controlled shutters in front of the optical system to block IR radiation incident onto the optical system from the object.
- An infrared (IR) imaging system comprising:
- Embodiment 1 wherein the plurality of cameras comprises a FPA unit and a plurality of lenses.
- Embodiments 1-12 further comprising a first and a second temperature-controlled shutter removably positioned to block IR radiation incident on the system from reaching the plurality of cameras.
- Embodiments 1-23 further comprising one or more sensors configured to measure a temperature of the at least one reference source.
- An infrared (IR) imaging system comprising:
- Embodiments 26-34 further comprising a first and a second temperature-controlled shutter removably positioned to block IR radiation incident on the system from reaching the plurality of cameras.
- Embodiments 26-41 further comprising one or more sensors configured to measure a temperature of the first or the second reference source.
- An infrared (IR) imaging system comprising:
- An infrared (IR) imaging system comprising:
- Embodiments 60-69 further comprising a third detector array disposed between the at least two detector arrays.
- Embodiments 60-74 further comprising a third reflecting element disposed outside the field of view of the at least two detector arrays and configured to image the at least one reference onto the third detector array.
- Embodiments 60-75 further comprising a first and a second temperature-controlled element removably positioned to block IR radiation incident on the optical system from reaching the optical FPA unit.
- optical system includes components associated with three optical channels.
- optical system includes components associated with four optical channels.
- optical system includes components associated with six optical channels.
- optical system includes components associated with eight optical channels.
- optical system includes components associated with ten optical channels.
- optical system includes components associated with twelve optical channels.
- optical system includes components associated with sixteen optical channels.
- optical system includes components associated with twenty four optical channels.
- each of the at least two detector arrays is configured to image the same portion of the at least one reference so as to consistently provide a common reference temperature.
- An infrared (IR) imaging system comprising:
- Embodiments 89-104 further comprising a first and a second temperature-controlled element removably positioned to block IR radiation incident on the optical system from reaching the optical FPA unit.
- optical system includes components associated with three optical channels.
- optical system includes components associated with four optical channels.
- optical system includes components associated with five optical channels.
- optical system includes components associated with six optical channels.
- optical system includes components associated with seven optical channels.
- optical system includes components associated with eight optical channels.
- optical system includes components associated with ten optical channels.
- optical system includes components associated with twelve optical channels.
- each of the at least two detector arrays is configured to image the same portion of the first reference source so as to consistently provide a common first reference temperature and wherein each of the at least two detector arrays is configured to image the same portion of the second reference source so as to consistently provide a common second reference temperature.
- thermocontroller configured to control the temperature of the first or second reference.
- Embodiments 89-115 further comprising one or more sensors configured to measure a temperature of the first or the second reference.
- An infrared (IR) imaging system comprising:
- Embodiment 124 wherein the one or more parameters is associated with a gain of the cameras in the plurality of cameras.
- Embodiments 124-128 further comprising at least one reflecting element configured to image the surface onto the plurality of cameras.
- Embodiments 124-129 further comprising a first and a second temperature-controlled element removably positioned to block IR radiation incident on the optical system from reaching the plurality of cameras.
- optical system includes components associated with three optical channels.
- optical system includes components associated with four optical channels.
- optical system includes components associated with six optical channels.
- optical system includes components associated with eight optical channels.
- optical system includes components associated with ten optical channels.
- optical system includes components associated with twelve optical channels.
- An infrared (IR) imaging system comprising:
- Embodiment 141 further comprising twelve optical channels.
- Embodiments 141-142 configured to simultaneously acquire multispectral optical data from the at least four different optical channels.
- the plurality of optical filters comprise at one short pass (SP) filter and one long pass (LP) filter.
- Embodiments 141-154 further comprising first and second temperature-controlled elements removably positioned to block IR radiation incident on the imaging system from reaching the FPA unit.
- Embodiments 141-155 further comprising a field reference configured for dynamically calibrating a plurality of the FPAs in the FPA unit.
- Embodiments 141-157 configured to compare spectral data in at least one of the four optical channels acquired at a first instant of time with spectral data in the at least one of the four optical channels acquired at a second instant of time to generate a temporal difference image.
- Embodiments 141-158 configured to use a difference between the multispectral optical data acquired by the two optical channels to correct parallax-induced imaging errors.
- Embodiments 141-159 configured to use a difference between the multispectral optical data acquired by the two optical channels to estimate a distance between the system and the object.
- Embodiments 141-160 configured to estimate a size of the object based on the estimated distance and an optical magnification factor of the two optical channels.
- Embodiments 141-161 configured to compare spectral data in one of the at least four optical channels with spectral data in another one of the at least four optical channels to generate a spectral difference image.
- Embodiments 141-162 further comprising a visible light imaging sensor.
- Embodiments 141-163 configured to use the visible light imaging sensor to compensate for motion-induced imaging errors.
- the system of any of Embodiments 141-164 configured to process the multispectral optical data by cross-correlating multispectral optical data from at least one of the optical channels with a reference spectrum.
- Embodiments 141-165 configured to process the multispectral optical data using spectral unmixing.
- thermo reference configured to be imaged onto the FPA unit such that a plurality of frames of the acquired multispectral optical data has an image of the thermal reference source.
- thermo reference is a temperature-controlled reference source.
- thermocontroller 141-185 The system of any of Embodiments 141-185, wherein the temperature-controlled reference source includes a heater.
- thermocontroller 141-186 The system of any of Embodiments 141-186, wherein the temperature-controlled reference source includes a cooler.
- thermo reference is a surface
- each optical channel is configured to transfer spectrally distinct, two-dimensional image data of the common object to one or more imaging sensors.
- An infrared (IR) imaging system for imaging a target species in an object, the imaging system comprising:
- the multispectral data comprises a number of spectrally different images of the object obtained from IR image data transferred to the optical FPA unit by a corresponding optical channel.
- Embodiments 200-201 further comprising an optical filter corresponding to a particular optical channel and configured to transmit the portion of IR radiation towards the optical FPA unit.
- optical filter includes one of a longpass optical filter and a shortpass optical filter.
- Embodiments 200-203 further comprising one or more front objective lenses.
- optical system comprises a plurality of lenses, each lens corresponding to an optical channel.
- each optical channel is defined at least in part by a corresponding filter and a corresponding lens.
- Embodiments 200-207 further comprising a plurality of relay lenses configured to relay the IR radiation along the optical channels.
- Embodiments 200-208 further comprising a plurality of moveable temperature-controlled reference source removably positioned to block IR radiation incident onto the optical system from reaching the optical FPA unit.
- Embodiments 200-211 further comprising first and second temperature-controlled moveable shutters removably positioned to block IR radiation incident onto the optical system from reaching the optical FPA unit.
- processor configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process the acquired optical data to compensate for at least one of (i) parallax-induced differences between the two or more sets of imaging data and (ii) difference between the two or more sets of imaging data induced by changes in the object that are not associated with the target species.
- IR radiation measured at a pixel comprises a spectrum comprising a sum of component spectra
- the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to unmix the spectrum.
- optical FPA unit includes a bolometer configured to operate without being cooled.
- Embodiments 200-225 further comprising a visible light imaging sensor.
- processor configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process data received from an imaging sensor to compensate for motion-induced imaging errors.
- processor configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process data received from the visible light imaging sensor to compensate for motion-induced imaging errors.
- the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to construct, in the single occurrence of data acquisition, a multispectral data cube of the object, the multispectral data cube comprising a number of spectrally different images of the object, each spectrally different image comprising IR image data transferred to the optical FPA unit by a corresponding optical channel.
- An infrared (IR) imaging system comprising:
- An infrared (IR) imaging system comprising:
- An infrared (IR) imaging system comprising:
- Embodiment 233 The system of Embodiment 233, wherein spectral characteristics of the two optical channels are identical.
- An infrared (IR) imaging system comprising:
- An infrared (IR) imaging system comprising:
- An infrared (IR) imaging system comprising:
- An infrared (IR) imaging system comprising:
- An infrared (IR) imaging system comprising:
- Embodiments 1-59 comprising at least two spectrally and spatially distinct optical channels configured to transfer two-dimensional image data of an object to the plurality of cameras.
- An infrared (IR) imaging system for imaging a scene comprising:
- an optical system comprising an optical focal plane array (FPA) unit including a plurality of spatially and spectrally different optical channels to transfer IR radiation from the scene towards the optical FPA unit, each optical channel positioned to transfer a portion of the IR radiation incident on the optical system from the scene towards the optical FPA unit,
- FPA optical focal plane array
- At least one of the plurality of optical channels is in the mid-wavelength infrared spectral range and at least another one of the plurality of optical channels is in the long-wavelength infrared spectral range
- the imaging system is configured to acquire a first video image of the scene in the mid-wavelength infrared spectral range and a second video image of the scene in the long-wavelength infrared spectral range.
- Embodiment 242 wherein the at least one mid-wavelength optical channel comprises a cold stop filter.
- the at least one mid-wavelength optical channel comprises filter having a pass-band in the mid-wavelength infrared spectral range.
- the imaging system of any of Embodiments 242-244 further comprising processing electronics configured to extract information from the first and second video image to detect presence of one or more chemical species in the scene.
- Embodiment 245 wherein the processing electronics are configured to compare the extracted information to one or more spectral information stored in a database.
- the imaging system of any of Embodiments 242-246 further comprising a feedback system configured to synchronize the first and the second video image.
- the FPA unit includes at least one mid-wavelength infra-red FPA capable of detecting mid-wavelength infra-red radiation and at least one long-wavelength infra-red FPA capable of detecting long-wavelength infra-red radiation.
- Embodiment 255 wherein the at least one mid-wavelength infra-red FPA is cooled to a temperature below 200 degree Kelvin.
- Embodiment 256 wherein the at least one mid-wavelength infra-red FPA is cooled to a temperature between about 110 degree Kelvin and about 150 degree Kelvin.
- Embodiment 257 wherein the at least one mid-wavelength infra-red FPA is cooled to a temperature of about 135 degree Kelvin.
- each of the one more reference sources has a known temperature.
- At least one of the plurality of optical channels comprises a spectrally selective optical element configured to receive radiation from the scene and direct a portion of the radiation in the mid-wavelength infrared spectral range toward the mid-wavelength infra-red FPA and direct a portion of the radiation in the long-wavelength infrared spectral range toward the long-wavelength infra-red FPA.
- a method of detecting one or more chemical species in a scene comprising:
- Embodiment 271 wherein the first and/or the second video image data has a frame rate between about 5 frames per second and about 60 frames per second.
- Embodiments 270-276 wherein the one or more chemical species detected are selected from the group consisting of methane, cyclopropane, alkanes, alkenes, ammonia, freon, hydrogen cyanide sulfur dioxide, and hydrogen sulfide.
- FIG. 1 shows an embodiment of an imaging system including a common front objective lens that has a pupil divided spectrally and re-imaged with a plurality of lenses onto an infrared FPA.
- FIG. 2 shows an embodiment with a divided front objective lens and an array of infrared sensing FPAs.
- FIG. 3A represents an embodiment employing an array of front objective lenses operably matched with the re-imaging lens array.
- FIG. 3B illustrates a two-dimensional array of optical components corresponding to the embodiment of FIG. 3A .
- FIG. 4 is a diagram of the embodiment employing an array of field references (e.g., field stops that can be used as references for calibration) and an array of respectively corresponding relay lenses.
- an array of field references e.g., field stops that can be used as references for calibration
- an array of respectively corresponding relay lenses e.g., field stops that can be used as references for calibration
- FIG. 5A is a diagram of a 4-by-3 pupil array comprising circular optical filters (and IR blocking material between the optical filters) used to spectrally divide an optical wavefront imaged with an embodiment of the system.
- FIG. 5B is a diagram of a 4-by-3 pupil array comprising rectangular optical filters (and IR blocking material between the optical filters) used to spectrally divide an optical wavefront imaged with an embodiment of the system.
- FIG. 6A depicts theoretical plots of transmission characteristics of a combination of band-pass filters used with an embodiment of the system.
- FIG. 6B depicts theoretical plots of transmission characteristics of a spectrally multiplexed notch-pass filter combination used in an embodiment of the system.
- FIG. 6C shows theoretical plots of transmission characteristics of spectrally multiplexed long-pass filter combination used in an embodiment of the system.
- FIG. 6D shows theoretical plots of transmission characteristics of spectrally multiplexed short-pass filter combination used in an embodiment of the system.
- FIG. 7 is a set of video-frames illustrating operability of an embodiment of the system used for gas detection.
- FIGS. 8A and 8B are plots (on axes of wavelength in microns versus the object temperature in Celsius representing effective optical intensity of the object) illustrating results of dynamic calibration of an embodiment of the system.
- FIGS. 9A and 9B illustrate a cross-sectional view of different embodiments of an imaging system comprising an arrangement of reference sources and mirrors that can be used for dynamic calibration.
- FIGS. 10A-10C illustrate a plan view of different embodiments of an imaging system comprising an arrangement of reference sources and mirrors that can be used for dynamic calibration.
- FIGS. 11A, 12A and 13A illustrate a plan view of different detector arrays including at least one mid-wavelength infra-red spectral FPA and at least one long-wavelength infra-red spectral FPA.
- FIGS. 11B, 12B and 13B illustrate a side-view of the arrays illustrated in FIGS. 11A, 12A and 13A respectively.
- FIGS. 14A and 14B illustrate elements disposed in an optical path of an FPA.
- FIG. 15 provides a visual example of the roles of the MWIR and LWIR FPAs.
- FIG. 16 which shows the temporal variation in the amount of radiation detected by the MWIR FPAs and LWIR FPAs imaging a scene in which the sun emerges from behind a cloud for a certain interval of time and is covered by a cloud subsequently.
- the following description is directed to certain implementations for the purposes of describing the innovative aspects of this disclosure.
- a person having ordinary skill in the art will readily recognize that the teachings herein can be applied in a multitude of different ways.
- the described implementations may be implemented in any device, apparatus, or system that can be configured to operate as an imaging system such as in an infra-red imaging system.
- the methods and systems described herein can be included in or associated with a variety of devices such as, but not limited to devices used for visible and infrared spectroscopy, multispectral and hyperspectral imaging devices used in oil and gas exploration, refining, and transportation, agriculture, remote sensing, defense and homeland security, surveillance, astronomy, environmental monitoring, etc.
- Various embodiments disclosed herein describe a divided-aperture infrared spectral imaging (DAISI) system that is structured and adapted to provide identification of target chemical contents of the imaged scene.
- the system is based on spectrally-resolved imaging and can provide such identification with a single-shot (also referred to as a snapshot) comprising a plurality of images having different wavelength compositions that are obtained generally simultaneously.
- snapshot refers to a system in which most of the data elements that are collected are continuously viewing the light emitted from the scene.
- snapshot refers to a system in which most of the data elements that are collected are continuously viewing the light emitted from the scene.
- scanning systems at any given time only a minority of data elements are continuously viewing a scene, followed by a different set of data elements, and so on, until the full dataset is collected.
- IR detectors such as, for example, infrared focal plane arrays or FPAs
- FPAs infrared focal plane arrays
- spectral data can be obtained from a single snapshot comprising multiple simultaneously acquired images corresponding to different wavelength ranges
- multiple snap shots may be obtained.
- these multiple snapshots can be averaged.
- multiple snap shots may be obtained and a portion of these can be selected and possibly averaged.
- the DAISI system does not require cooling. Accordingly, it can advantageously use uncooled infrared detectors.
- the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 300 Kelvin.
- the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 273 Kelvin.
- the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 250 Kelvin.
- the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 200 Kelvin.
- Implementations disclosed herein provide several advantages over existing IR spectral imaging systems, most if not all of which may require FPAs that are highly sensitive and cooled in order to compensate, during the optical detection, for the reduction of the photon flux caused by spectrum-scanning operation.
- the highly sensitive and cooled FPA systems are expensive and require a great deal of maintenance. Since various embodiments disclosed herein are configured to operate in single-shot acquisition mode without spatial and/or spectral scanning, the instrument can receive photons from a plurality of points (e.g., every point) of the object substantially simultaneously, during the single reading.
- the embodiments of imaging system described herein can collect a substantially greater amount of optical power from the imaged scene (for example, an order of magnitude more photons) at any given moment in time especially in comparison with spatial and/or spectral scanning systems. Consequently, various embodiments of the imaging systems disclosed herein can be operated using uncooled detectors (for example, FPA unit including an array of microbolometers) that are less sensitive to photons in the IR but are well fit for continuous monitoring applications.
- the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 300 Kelvin.
- the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 273 Kelvin.
- the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 250 Kelvin.
- the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 200 Kelvin. Imaging systems including uncooled detectors can be capable of operating in extreme weather conditions, require less power, are capable of operation during day and night, and are less expensive. Some embodiments described herein can also be less susceptible to motion artifacts in comparison with spatially and/or spectrally scanning systems which can cause errors in either the spectral data, spatial data, or both.
- FIG. 1 provides a diagram schematically illustrating spatial and spectral division of incoming light by an embodiment 100 of a divided aperture infrared spectral imager (DAISI) system that can image an object 110 possessing IR spectral signature(s).
- the system 100 includes a front objective lens 124 , an array of optical filters 130 , an array of imaging lenses 128 and a detector array 136 .
- the detector array 136 can include a single FPA or an array of FPAs. Each detector in the detector array 136 can be disposed at the focus of each of the lenses in the array of imaging lenses 128 .
- the detector array 136 can include a plurality of photo-sensitive devices.
- the plurality of photo-sensitive devices may comprise a two-dimensional imaging sensor array that is sensitive to radiation having wavelengths between 1 ⁇ m and 20 ⁇ m (for example, in near infra-red wavelength range, mid infra-red wavelength range, or long infra-red wavelength range,).
- the plurality of photo-sensitive devices can include CCD or CMOS sensors, bolometers, microbolometers or other detectors that are sensitive to infra-red radiation.
- An aperture of the system 100 associated with the front objective lens system 124 is spatially and spectrally divided by the combination of the array of optical filters 130 and the array of imaging lenses 128 .
- the combination of the array of optical filters 130 and the array of imaging lenses 128 can be considered to form a spectrally divided pupil that is disposed forward of the optical detector array 136 .
- the spatial and spectral division of the aperture into distinct aperture portions forms a plurality of optical channels 120 along which light propagates.
- the array 128 of re-imaging lenses 128 a and the array of spectral filters 130 which respectively correspond to the distinct optical channels 120 .
- the plurality of optical channels 120 can be spatially and/or spectrally distinct.
- the plurality of optical channels 120 can be formed in the object space and/or image space.
- the distinct channels 120 may include optical channels that are separated angularly in space.
- the array of spectral filters 130 may additionally include a filter-holding aperture mask (comprising, for example, IR light-blocking materials such as ceramic, metal, or plastic).
- IR light-blocking materials such as ceramic, metal, or plastic.
- Light from the object 110 for example a cloud of gas
- the optical properties of which in the IR are described by a unique absorption, reflection and/or emission spectrum, is received by the aperture of the system 100 . This light propagates through each of the plurality of optical channels 120 and is further imaged onto the optical detector array 136 .
- the detector array 136 can include at least one FPA.
- each of the re-imaging lenses 128 a can be spatially aligned with a respectively-corresponding spectral region.
- each filter element from the array of spectral filters 130 corresponds to a different spectral region.
- Each re-imaging lens 128 a and the corresponding filter element of the array of spectral filter 130 can coincide with (or form) a portion of the divided aperture and therefore with respectively-corresponding spatial channel 120 .
- an imaging lens 128 a and a corresponding spectral filter can be disposed in the optical path of one of the plurality of optical channels 120 .
- Radiation from the object 110 propagating through each of the plurality of optical channels 120 travels along the optical path of each re-imaging lens 128 a and the corresponding filter element of the array of spectral filter 130 and is incident on the detector array (e.g., FPA component) 136 to form a single image (e.g., sub-image) of the object 110 .
- the image formed by the detector array 136 generally includes a plurality of sub-images formed by each of the optical channels 120 .
- Each of the plurality of sub-images can provide different spatial and spectral information of the object 110 .
- the different spatial information results from some parallax because of the different spatial locations of the smaller apertures of the divided aperture.
- adjacent sub-images can be characterized by close or substantially equal spectral signatures.
- the detector array (e.g., FPA component) 136 is further operably connected with a processor 150 (not shown).
- the processor 150 can be programmed to aggregate the data acquired with the system 100 into a spectral data cube.
- the data cube represents, in spatial (x, y) and spectral ( ⁇ ) coordinates, an overall spectral image of the object 110 within the spectral region defined by the combination of the filter elements in the array of spectral filters 130 .
- the processor or processing electronics 150 may be programmed to determine the unique absorption characteristic of the object 110 .
- the processor/processing electronics 150 can, alternatively or in addition, map the overall image data cube into a cube of data representing, for example, spatial distribution of concentrations, c, of targeted chemical components within the field of view associated with the object 110 .
- the embodiment 100 can include an optional moveable temperature-controlled reference source 160 including, for example, a shutter system comprising one or more reference shutters maintained at different temperatures.
- the reference source 160 can include a heater, a cooler or a temperature-controlled element configured to maintain the reference source 160 at a desired temperature.
- the embodiment 100 can include two reference shutters maintained at different temperatures.
- the reference source 160 is removably and, in one implementation, periodically inserted into an optical path of light traversing the system 100 from the object 110 to the detector array (e.g., FPA component) 136 along at least one of the channels 120 .
- the removable reference source 160 thus can block such optical path.
- this reference source 160 can provide a reference IR spectrum to recalibrate various components including the detector array 136 of the system 100 in real time.
- the configuration of the moveable reference source 160 is further discussed below.
- the front objective lens system 124 is shown to include a single front objective lens positioned to establish a common field-of-view (FOV) for the imaging lenses 128 a and to define an aperture stop for the whole system.
- FOV field-of-view
- the aperture stop substantially spatially coincides with and/or is about the same size as or slightly larger than, the plurality of smaller limiting apertures corresponding to different optical channels 120 .
- the positions for spectral filters of the different optical channels 120 coincide with the position of the aperture stop of the whole system, which in this example is shown as a surface between the lens system 124 and the array 128 of the imaging lenses 128 a .
- the lens system 124 can be an objective lens 124 .
- the objective lens 124 is optional and various embodiments of the system 100 need not include the objective lens 124 .
- the objective lens 124 can slightly shift the images obtained by the different detectors in the array 136 spatially along a direction perpendicular to optical axis of the lens 124 , thus the functionality of the system 100 is not necessarily compromised when the objective lens 124 is not included.
- the field apertures corresponding to different optical channels may be located in the same or different planes. These field apertures may be defined by the aperture of the imaging lens 128 a and/or filters in the divided aperture 130 in certain implementations.
- the field apertures corresponding to different optical channels can be located in different planes and the different planes can be optical conjugates of one another.
- filter elements in the array of spectral filters 130 of the embodiment 100 are shown to lie in one plane, generally different filter elements of the array of spectral filter 130 can be disposed in different planes.
- different filter elements of the array of spectral filters 130 can be disposed in different planes that are optically conjugate to one another.
- the different filter elements can be disposed in non-conjugate planes.
- the front objective lens 124 need not be a single optical element, but instead can include a plurality of lenses 224 as shown in an embodiment 200 of the DAISI imaging system in FIG. 2 .
- These lenses 224 are configured to divide an incoming optical wavefront from the object 110 .
- the array of front objective lenses 224 can be disposed so as to receive an IR wavefront emitted by the object that is directed toward the DAISI system.
- the plurality of front objective lenses 224 divide the wavefront spatially into non-overlapping sections.
- FIG. 2 shows three objective lenses 224 in a front optical portion of the optical system contributing to the spatial division of the aperture of the system in this example.
- the plurality of objective lenses 224 can be configured as a two-dimensional (2D) array of lenses.
- FIG. 2 presents a general view of the imaging system 200 and the resultant field of view of the imaging system 200 .
- An exploded view 202 of the imaging system 200 is also depicted in greater detail in a figure inset of FIG. 2 .
- the embodiment of the imaging system 200 includes a field reference 204 at the front end of the system.
- the field reference 204 can be used to truncate the field of view.
- the configuration illustrated in FIG. 2 has an operational advantage over embodiment 100 of FIG. 1 in that the overall size and/or weight and/or cost of manufacture of the embodiment 200 can be greatly reduced because the objective lens is smaller.
- Each pair of the lenses in the array 224 and the array 128 is associated with a field of view (FOV).
- Each pair of lenses in the array 224 and the array 128 receives light from the object from a different angle. Accordingly, the FOV of the different pairs of lenses in the array 224 and the array 128 do not completely overlap as a result of parallax.
- the overlapping region 230 between the FOVs of the individual lenses 224 increases while the amount of parallax 228 remains approximately the same, thereby reducing its effect on the system 200 .
- the parallax effect may be considered to be negligible and, for practical purposes, no longer distinguishable.
- the lenses 224 are shown to be disposed substantially in the same plane, optionally different objective lenses in the array of front objective lenses 224 can be disposed in more than one plane.
- some of the individual lenses 224 can be displaced with respect to some other individual lenses 224 along the axis 226 (not shown) and/or have different focal lengths as compared to some other lenses 224 .
- the field reference 204 can be useful in calibrating the multiple detectors 236 .
- the front objective lens system such as the array of lenses 224 is configured as an array of lenses integrated or molded in association with a monolithic substrate. Such an arrangement can reduce the costs and complexity otherwise accompanying the optical adjustment of individual lenses within the system.
- An individual lens 224 can optionally include a lens with varying magnification.
- a pair of thin and large diameter Alvarez plates can be used in at least a portion of the front objective lens system. Without any loss of generality, the Alvarez plates can produce a change in focal length when translated orthogonally with respect to the optical beam.
- the detector array 136 configured to receive the optical data representing spectral signature(s) of the imaged object 110 can be configured as a single imaging array (e.g., FPA) 136 .
- This single array may be adapted to acquire more than one image (formed by more than one optical channel 120 ) simultaneously.
- the detector array 136 may include a FPA unit.
- the FPA unit can include a plurality of optical FPAs. At least one of these plurality of FPAs can be configured to acquire more than one spectrally distinct image of the imaged object. For example, as shown in the embodiment 200 of FIG.
- the number of FPAs included in the FPA unit may correspond to the number of the front objective lenses 224 .
- the FPA unit can include an array of microbolometers. The use of multiple microbolometers advantageously allows for an inexpensive way to increase the total number of detection elements (i.e. pixels) for recording of the three-dimensional data cube in a single acquisition event (i.e. one snapshot).
- an array of microbolometers more efficiently utilizes the detector pixels of the array of FPAs (e.g., each FPA) as the number of unused pixels is reduced, minimized and/or eliminated between the images that may exist when using a single microbolometer.
- FIG. 3A illustrates schematically an embodiment 300 of the imaging system in which the number of the front objective lenses 324 a in the lens array 324 , the number of re-imaging lenses 128 a in the lens array 128 , and the number of FPAs 336 are the same. So configured, each combination of respectively corresponding front objective lens 324 , re-imaging lens 128 a , and FPAs 336 constitutes an individual imaging channel. Such a channel is associated with acquisition of the IR light transmitted from the object 110 through an individual filter element of the array of optical filters 130 .
- a field reference 338 of the system 300 is configured to have a uniform temperature across its surface and be characterized by a predetermined spectral curve of radiation emanating therefrom.
- the field reference 338 can be used as a calibration target to assist in calibrating or maintaining calibration of the FPA. Accordingly, in various implementations, the field reference 338 is used for dynamically adjusting the data output from each FPA 336 after acquisition of light from the object 110 . This dynamic calibration process helps provide that output of the different (e.g., most, or each of the) FPA 336 represents correct acquired data, with respect to the other FPAs 336 for analysis, as discussed below in more detail.
- FIG. 3B illustrates the plan view perpendicular to the axis 226 of an embodiment 300 of the imaging system illustrated in FIG. 3A .
- the optical components e.g., objective lenses 324 a , filter elements of the array of spectral filters 130 , re-imaging lenses 128 a and FPA units 336
- the 4 ⁇ 3 array 340 of optical components is used behind the temperature controlled reference target 160 .
- the field reference aperture 338 can be adapted to obscure and/or block a peripheral portion of the bundle of light propagating from the object 110 towards the FPA units 336 .
- the field reference 338 obscures and/or blocks the border or peripheral portion(s) of the images of the object 110 formed on the FPA elements located along the perimeter 346 of the detector system.
- two elements of the FPA unit will produce substantially equal values of digital counts when they are used to observe the same portion of the scene in the same spectral region using the same optical train. If any of these input parameters (for example, scene to be observed, spectral content of light from the scene, or optical elements delivering light from the scene to the two detector elements) differ, the counts associated with the elements of the FPA unit will differ as well.
- the outputs from these FPAs can be dynamically adjusted to the output from one of the FPAs located along perimeter 346 (such as, for example, the FPA element # 2 or FPA element # 11 ) that processes light having similar spectral characteristics.
- FIG. 4 illustrates schematically a portion of another embodiment of an imaging system 400 that contains an array 424 of front objective lenses 424 a .
- the array 424 of lenses 424 a adapted to receive light from the object 110 and relay the received light to the array 128 of re-imaging lenses 128 a through an array 438 of field references (or field stops) 438 a , and through an array 440 of the relay lenses.
- the spectral characteristics of the field references/field stops 438 a can be known.
- the field references 438 a are disposed at corresponding intermediate image planes defined, with respect to the object 110 , by respectively corresponding front objective lenses 424 a .
- all of the field references 438 a are disposed in the same plane.
- a field reference 438 a of the array 438 obscures (or casts a shadow on) a peripheral region of a corresponding image (e.g., sub-image) formed at the detector plane 444 through a respectively corresponding spatial imaging channel 450 of the system 400 prior to such image being spectrally processed by the processor 150 .
- the array 440 of relay lenses then transmits light along each of the imaging channels 450 through different spectral filters 454 a of the filter array 454 , past the calibration apparatus that includes two temperature controlled shutters 460 a , 460 b , and then onto the detector module 456 .
- the detector module 456 can include a microbolometer array or some other IR FPA.
- the embodiment 400 has several operational advantages. It is configured to provide a spectrally known object within every image (e.g., sub-image) and for every snapshot acquisition which can be calibrated against. Such spectral certainty can be advantageous when using an array of IR FPAs like microbolometers, the detection characteristics of which can change from one imaging frame to the next due to, in part, changes in the scene being imaged as well as the thermal effects caused by neighboring FPAs.
- the field reference array 438 of the embodiment 400 can be disposed within the Rayleigh range (approximately corresponding to the depth of focus) associated with the front objective lenses 424 , thereby removing unusable blurred pixels due to having the field reference outside of this range. Additionally, the embodiment 400 of FIG.
- the field reference 338 may be separated from the lens array 324 by a distance greater than several (for example, five) focal lengths to minimize/reduce blur contributed by the field reference to an image formed at a detector plane.
- the multi-optical FPA unit of the IR imaging system can additionally include an FPA configured to operate in a visible portion of the spectrum.
- an image of the scene of interest formed by such visible-light FPA may be used as a background to form a composite image by overlapping an IR image with the visible-light image.
- the IR image may be overlapped virtually, with the use of a processor and specifically-designed computer program product enabling such data processing, or actually, by a viewer.
- the IR image may be created based on the image data acquired by the individual FPAs 136 .
- the so-formed composite image facilitates the identification of the precise spatial location of the target species, the spectral signatures of which the system is able to detect/recognize.
- the optical filters used with an embodiment of the system, that define spectrally-distinct IR image (e.g., sub-image) of the object can employ absorption filters, interference filters, and Fabry-Perot etalon based filters, to name just a few.
- the image acquisition through an individual imaging channel defined by an individual re-imaging lens such as a lens 128 a of FIGS. 1, 2, 3, and 4
- an individual re-imaging lens such as a lens 128 a of FIGS. 1, 2, 3, and 4
- Individual filters 1 through 12 are juxtaposed with a supporting opto-mechanical element (not shown) to define a filter-array plane that is oriented, in operation, substantially perpendicularly to the general optical axis 226 of the imaging system.
- the individual filters 1 through 12 need not be discrete optical components. Instead, the individual filters 1 through 12 can comprise one or more coatings that are applied to one or more surfaces of the imaging lenses (such as a lens 128 a of FIGS. 1, 2, 3, and 4 ) or the surfaces of one or more detectors.
- the optical filtering configuration of various embodiments disclosed herein may advantageously use a bandpass filter defining a specified spectral band. Any of the filters 0 a through 3 a , the transmission curves of which are shown in FIG. 6A may, for example, be used.
- the filters may be placed in front of the optical FPA (or generally, between the optical FPA and the object).
- optical detector arrays 136 , 236 , 336 , 456 include microbolometers, the predominant contribution to noise associated with image acquisition is due to detector noise.
- various embodiments disclosed herein utilize spectrally-multiplexed filters.
- the spectrally-multiplexed filters can comprise a plurality of long pass filters, a plurality long pass filters, a plurality of band pass filters and any combinations thereof.
- An example of the spectral transmission characteristics of spectrally-multiplexed filters 0 b through 3 d for use with various embodiments of imaging systems disclosed herein is depicted in FIG. 6B .
- Filters of FIG. 6C can be referred to as long-wavelength pass, LP filters.
- An LP filter generally attenuates shorter wavelengths and transmits (passes) longer wavelengths (e.g., over the active range of the target IR portion of the spectrum).
- short-wavelength-pass filters, SP may also be used.
- An SP filter generally attenuates longer wavelengths and transmits (passes) shorter wavelengths (e.g., over the active range of the target IR portion of the spectrum). At least in part due to the snap-shot/non-scanning mode of operation, embodiments of the imaging system described herein can use less sensitive microbolometers without compromising the SNR.
- each of the filters ( 0 b . . . 3 d ) transmits light in a substantially wider region of the electromagnetic spectrum as compared to those of the filters ( 0 a . . . 3 a ). Accordingly, when the spectrally-multiplexed set of filters ( 0 b . . . 0 d ) is used with an embodiment of the imaging system, the overall amount of light received by the FPAs (for example, 236 , 336 ) is larger than would be received when using the bandpass filters ( 0 a . . . 4 a ).
- This “added” transmission of light defined by the use of the spectrally-multiplexed LP (or SP) filters facilitates an increase of the signal on the FPAs above the level of the detector noise. Additionally, by using, in an embodiment of the imaging system, filters having spectral bandwidths greater than those of band-pass filters, the uncooled FPAs of the embodiment of the imaging system experience less heating from radiation incident thereon from the imaged scene and from radiation emanating from the FPA in question itself. This reduced heating is due to a reduction in the back-reflected thermal emission(s) coming from the FPA and reflecting off of the filter from the non-band-pass regions. As the transmission region of the multiplexed LP (or SP) filters is wider, such parasitic effects are reduced thereby improving the overall performance of the FPA unit.
- the LP and SP filters can be combined, in a spectrally-multiplexed fashion, in order to increase or maximize the spectral extent of the transmission region of the filter system of the embodiment.
- the unknown amount of light within each of the M spectral channels is denoted with f 1 , f 2 , f 3 , . . . f M
- readings from corresponding detector elements receiving light transmitted by each filter is denoted as g 1 , g 2 , g 3 . . . g M
- measurement errors are represented by n 1 , n 2 , n 3 , . . . n M .
- the readings at the seven FPA pixels each of which is optically filtered by a corresponding band-pass filter of FIG. 6A can be represented by:
- g i are estimates of the spectral intensities f i .
- the estimates g i are not equal to the corresponding f i values because of the measurement errors n i .
- the angle brackets indicate the operation of calculating the ensemble mean of a stochastic variable.
- the variance of the measurement can, therefore, be represented as:
- the amount of radiant energy transmitted by each of the spectrally-multiplexed LP or SP filters towards a given detector element can exceed that transmitted through a spectral band of a band-pass filter.
- the intensities of light corresponding to the independent spectral bands can be reconstructed by computational means.
- Such embodiments can be referred to as a “multiplex design”.
- One matrix of such “multiplexed filter” measurements includes a Hadamard matrix requiring “negative” filters that may not be necessarily appropriate for the optical embodiments disclosed herein.
- An S-matrix approach (which is restricted to having a number of filters equal to an integer that is multiple of four minus one) or a row-doubled Hadamard matrix (requiring a number of filters to be equal to an integer multiple of eight) can be used in various embodiments.
- possible numbers of filters using an S-matrix setup are 3, 7, 11, etc and, if a row-doubled Hadamard matrix setup is used, then the possible number of filters is 8, 16, 24, etc.
- the goal of the measurement may be to measure seven spectral band f i intensities using seven measurements g i as follows:
- Optical transmission characteristics of the filters described above are depicted in FIG. 6B .
- a linear combination of the measurements can be used such as, for example,
- ⁇ circumflex over (f) ⁇ 1 1 ⁇ 4(+ g 1 ⁇ g 2 +g 3 ⁇ g 4 +g 5 ⁇ g 6 +g 7 ),
- ⁇ circumflex over (f) ⁇ 2 1 ⁇ 4( ⁇ g 1 +g 2 +g 3 ⁇ g 4 ⁇ g 5 +g 6 +g 7 ),
- ⁇ circumflex over (f) ⁇ 3 1 ⁇ 4(+ g 1 +g 2 ⁇ g 3 ⁇ g 4 +g 5 +g 6 ⁇ g 7 ),
- ⁇ circumflex over (f) ⁇ 4 1 ⁇ 4( ⁇ g 1 ⁇ g 2 ⁇ g 3 +g 4 +g 5 +g 6 +g 7 ),
- ⁇ circumflex over (f) ⁇ 5 1 ⁇ 4(+ g 1 ⁇ g 2 +g 3 +g 4 ⁇ g 5 +g 6 ⁇ g 7 ),
- ⁇ circumflex over (f) ⁇ 6 1 ⁇ 4( ⁇ g 1 +g 2 +g 3 +g 4 +g 5 ⁇ g 6 ⁇ g 7 ),
- ⁇ circumflex over (f) ⁇ 7 1 ⁇ 4(+ g 1 +g 2 ⁇ g 3 +g 4 ⁇ g 5 ⁇ g 6 +g 7 ),
- the SNR improvement achieved with a spectrally-multiplexed system can be expressed as (N+1)/(2 ⁇ square root over (N) ⁇ ).
- N 12 spectral channels
- N 12
- a SNR improvement, over a non-spectrally-multiplexed system comprising a factor of up to 1.88.
- FIGS. 6C and 6D Two additional examples of related spectrally-multiplexed filter arrangements 0 c through 3 c and 0 d through 3 d that can be used in various embodiments of the imaging systems described herein are shown in FIGS. 6C and 6D , respectively.
- the spectrally-multiplexed filters shown in FIGS. 6C and 6D can be used in embodiments of imaging systems employing uncooled FPAs (such as microbolometers).
- FIG. 6C illustrates a set of spectrally-multiplexed long-wavelength pass (LP) filters used in the system.
- An LP filter generally attenuates shorter wavelengths and transmits (passes) longer wavelengths (e.g., over the active range of the target IR portion of the spectrum).
- a single spectral channel having a transmission characteristic corresponding to the difference between the spectral transmission curves of at least two of these LP filters can be used to procure imaging data for the data cube using an embodiment of the system described herein.
- the spectral filters disposed with respect to the different FPAs can have different spectral characteristics.
- the spectral filters may be disposed in front of only some of the FPAs while the remaining FPAs may be configured to receive unfiltered light. For example, in some implementations, only 9 of the 12 detectors in the 4 ⁇ 3 array of detectors described above may be associated with a spectral filter while the other 3 detectors may be configured to received unfiltered light.
- Such a system may be configured to acquire spectral data in 10 different spectral channels in a single data acquisition event.
- microbolometers as detector-noise-limited devices, in turn not only can benefit from the use of spectrally multiplexed filters, but also does not require cooling of the imaging system during normal operation.
- the embodiments of imaging systems described herein can employ less sensitive microbolometers without compromising the SNR. This result is at least in part due to the snap-shot/non-scanning mode of operation.
- an embodiment may optionally, and in addition to a temperature-controlled reference unit (for example temperature controlled shutters such as shutters 160 ; 460 a , 460 b ), employ a field reference component (e.g., field reference aperture 338 in FIG. 3A ), or an array of field reference components (e.g., filed reference apertures 438 in FIG. 4 ), to enable dynamic calibration.
- a field reference component e.g., field reference aperture 338 in FIG. 3A
- an array of field reference components e.g., filed reference apertures 438 in FIG. 4
- Such dynamic calibration can be used for spectral acquisition of one or more or every data cube.
- Such dynamic calibration can also be used for a spectrally-neutral camera-to-camera combination to enable dynamic compensation of parallax artifacts.
- the use of the temperature-controlled reference unit (for example, temperature-controlled shutter system 160 ) and field-reference component(s) facilitates maintenance of proper calibration of each of the FPAs individually and
- the temperature-controlled unit generally employs a system having first and second temperature zones maintained at first and second different temperatures.
- shutter system of each of the embodiments 100 , 200 , 300 and 400 can employ not one but at least two temperature-controlled shutters that are substantially parallel to one another and transverse to the general optical axis 226 of the embodiment(s) 100 , 200 , 300 , 400 .
- Two shutters at two different temperatures may be employed to provide more information for calibration; for example, the absolute value of the difference between FPAs at one temperature as well as the change in that difference with temperature change can be recorded. Referring, for example, to FIG.
- the use of multiple shutters enables the user to create a known reference temperature difference perceived by the FPAs 456 .
- This reference temperature difference is provided by the IR radiation emitted by the shutter(s) 460 a , 460 b when these shutters are positioned to block the radiation from the object 110 .
- the system having first and second temperature zones may include a single or multi-portion piece.
- This single or multi-portion piece may comprise for example a plate. This piece may be mechanically-movable across the optical axis with the use of appropriate guides and having a first portion at a first temperature and a second portion at a second temperature.
- the process of calibration of an embodiment of the imaging system starts with estimating gain and offset by performing measurements of radiation emanating, independently, from at least two temperature-controlled shutters of known and different radiances.
- the gain and offset can vary from detector pixel to detector pixel.
- the first shutter 460 a blocks the FOV of the detectors 456 and the temperature T 1 is measured directly and independently with thermistors.
- the first shutter 460 a is removed from the optical path of light traversing the embodiment and another second shutter (for example, 460 b ) is inserted in its place across the optical axis 226 to prevent the propagation of light through the system.
- the temperature of the second shutter 460 b can be different than the first shutter (T 2 ⁇ T 1 ).
- the temperature of the second shutter 460 b is also independently measured with thermistors placed in contact with this shutter, and the detector response to radiation emanating from the shutter 460 b is also recorded.
- Denoting operational response of FPA pixels (expressed in digital numbers, or “counts”) as g i to a source of radiance L i , the readings corresponding to the measurements of the two shutters can be expressed as:
- g offset is the pixel offset value (in units of counts)
- ⁇ is the pixel gain value (in units of counts per radiance unit).
- the field-reference apertures may be disposed in an object space or image space of the optical system, and dimensioned to block a particular portion of the IR radiation received from the object.
- the field-reference aperture the opening of which can be substantially similar in shape to the boundary of the filter array (for example, and in reference to a filter array of FIGS. 3B, 5B —e.g., rectangular).
- the field-reference aperture can be placed in front of the objective lens ( 124 , 224 , 324 , 424 ) at a distance that is at least several times (in one implementation—at least five times) larger than the focal length of the lens such that the field-reference aperture is placed closer to the object. Placing the field-reference aperture closer to the object can reduce the blurriness of the image. In the embodiment 400 of FIG. 4 , the field-reference aperture can be placed within the depth of focus of an image conjugate plane formed by the front objective lens 424 .
- the field reference generally, can facilitate, effectuates and/or provides dynamic compensation in the system by providing a spectrally known and temporally-stable object within every scene to reference and stabilize the output from the different FPAs in the array.
- each FPA's offset value is generally adjusted from each frame to the next frame by the hardware, comparing the outputs of one FPA with another can have an error that is not compensated for by the static calibration parameters g offset and ⁇ established, for example, by the movable shutters 160 , 460 a , 460 b .
- a portion of each detector array to view a reference source (such as the field reference 338 in FIG. 3A , for example) over a plurality of frames obtained over time.
- the reference source spectrum is known a priori (such as a blackbody source at a known temperature)
- a priori such as a blackbody source at a known temperature
- dynamic calibration of the different detectors can be performed by monitoring the change in the gain and the offset for the various detectors from the time the movable shutters used for static calibration are removed.
- An example calculation of the dynamic offset proceeds as follows.
- one FPA can be selected to be the “reference FPA”.
- the field reference temperature measured by all the other FPAs can be adjusted to agree with the field reference temperature measured by the reference as discussed below.
- the image obtained by each FPA includes a set of pixels obscured by the field reference 338 .
- the effective blackbody temperature T i of the field reference as measured by each FPA is estimated using the equation below:
- ⁇ g i is the difference in offset value of the current frame from ⁇ g offset obtained during the calibration step.
- ⁇ g i can be simply set to zero. Then, using the temperature differences measured by each FPA, one obtains
- T i ⁇ T ref mean ⁇ ( g+ ⁇ g i +g offset / ⁇ + ⁇ T i ⁇ mean ⁇ ( g ⁇ g offset )/ ⁇ + ⁇ T i
- one or more, most, or potentially all the FPAs of the system can be calibrated prior to optical data acquisition using an embodiment of the IR imaging system as described herein.
- the FPAs of the system can be calibrated. For example, greater than 50%, 60%, 70%, 80% or 90% of the FPAs 336 can be initially calibrated. As shown in FIG. 3A , these FPAs 336 may form separate images of the object using light delivered in a corresponding optical channel that may include the combination of the corresponding front objective and re-imaging lenses 324 , 128 .
- the calibration procedure can allow formation of individual images in equivalent units (so that, for example, the reading from the FPA pixels can be re-calculated in units of temperature or radiance units, etc.).
- the calibration process can also allow the FPAs (e.g., each of the FPAs) to be spatially co-registered with one another so that a given pixel of a particular FPA can be optically re-mapped through the optical system to the same location at the object as the corresponding pixel of another FPA.
- the FPAs e.g., each of the FPAs
- a spectral differencing method may be employed.
- the method involves forming a difference image from various combinations of the images from different channels.
- the images used to form difference images can be registered by two or more different FPAs in spectrally distinct channels having different spectral filters with different spectral characteristics. Images from different channels having different spectral characteristics will provide different spectral information. Comparing (e.g., subtracting) these images, can therefore yield valuable spectral based information.
- the filter element of the array of spectral filters 130 corresponding to a particular FPA 336 transmits light from the object 110 including a cloud of gas, for example, with a certain spectrum that contains the gas absorption peak or a gas emission peak while another filter element of the array of spectral filters 130 corresponding to another FPA 336 does not transmit such spectrum, then the difference between the images formed by the two FPAs at issue will highlight the presence of gas in the difference image.
- a shortcoming of the spectral differencing method is that contributions of some auxiliary features associated with imaging (not just the target species such as gas itself) can also be highlighted in and contribute to the difference image.
- Such contributing effects include, to name just a few, parallax-induced imaging of edges of the object, influence of magnification differences between the two or more optical channels, and differences in rotational positioning and orientation between the FPAs. While magnification-related errors and FPA-rotation-caused errors can be compensated for by increasing the accuracy of the instrument construction as well as by post-processing of the acquired imaging, parallax is scene-induced and is not so easily correctable.
- the spectral differencing method is vulnerable to radiance calibration errors.
- one FPA registers radiance of light from a given feature of the object as having a temperature of 40° C., for example, while the data from another FPA represents the temperature of the same object feature as being 39° C., then such feature of the object will be enhanced or highlighted in the difference image (formed at least in part based on the images provided by these two FPAs) due to such radiance-calibration error.
- One solution to some of such problems is to compare (e.g., subtract) images from the same FPA obtained at different instances in time. For example, images can be compared to or subtracted from a reference image obtained at another time. Such reference image, which is subtracted from other later obtained images, may be referred to as a temporal reference image.
- This solution can be applied to spectral difference images as well.
- the image data resulting from spectral difference images can be normalized by the data corresponding to a temporal reference image.
- the temporal reference images can be subtracted from the spectral difference image to obtain the temporal difference image.
- a temporal differencing algorithm or method and the resultant image from subtracting the temporal reference image from another image (such as the spectral difference image) is referred to as the temporal difference image.
- a temporal reference image may be formed, for example, by creating a spectral difference image from the two or more images registered by the two or more FPAs at a single instance in time. This spectral difference image is then used as a temporal reference image. The temporal reference image can then be subtracted from other later obtained images to provide normalization that can be useful in subtracting out or removing various errors or deleterious effects.
- a spectral difference image can be calculated from multiple spectral channels as discussed above based on a snap-shot image acquisition at any later time and can be subtracted from the temporal reference image to form a temporal difference image.
- This temporal difference image is thus a normalized difference image.
- the difference between the two images can highlight the target species (gas) within the normalized difference image, since this species was not present in the temporal reference frame.
- more than two FPAs can be used both for registering the temporal reference image and a later-acquired difference image to obtain a better SNR figure of merit.
- the images obtained by the two FPAs can be combined after they have been registered to get a better SNR figure.
- temporal differencing method can be used to reduce or eliminate some of the shortcomings of the spectral differencing, it can introduce unwanted problems of its own.
- temporal differencing of imaging data is less sensitive to calibration and parallax induced errors than the spectral differencing of imaging data.
- any change in the imaged scene that is not related to the target species of interest is highlighted in a temporally-differenced image.
- the target species of interest such as particular gas, for example
- the temperature of the background against which the gas is being detected changes (due to natural cooling down as the day progresses, or increases due to a person or animal or another object passing through the FOV of the IR imaging system), then such temperature change produces a signal difference as compared to the measurement taken earlier in time. Accordingly, the cause of the scenic temperature change (the cooling object, the person walking, etc.) may appear as the detected target species (such as gas). It follows, therefore, that an attempt to compensate for operational differences among the individual FPAs of a multi-FPA IR imaging system with the use of methods that turn on spectral or temporal differencing can cause additional problems leading to false detection of target species.
- another difference image can be used that is formed from the images of at least two different FPAs to estimate parallax effects.
- Parallax error can be determined by comparing the images from two different FPAs where the position between the FPAs is known. The parallax can be calculated from the known relative position difference. Differences between the images from these two FPAs can be attributed to parallax, especially, if the FPA have the same spectral characteristics, for example have the same spectral filter or both have no spectral filters.
- Parallax error correction can still be obtained from two FPAs that have different spectral characteristics or spectral filters, especially if the different spectral characteristics, e.g., the transmission spectra of the respective filters are known and/or negligible.
- Use of more than two FPAs or FPAs of different locations such as FPAs spaced farther apart can be useful.
- a difference image referred to as a “difference image 2 - 3 ” is formed.
- the alternative “difference image 1 - 4 ” is additionally formed from the image data acquired by, for example, the alternative FPAs corresponding to filters 1 and 4 of FIG. 5A . Assuming or ensuring that both of these two alternative FPAs have approximately the same spectral sensitivity to the target species, the alternative “difference image 1 - 4 ” will highlight pixels corresponding to parallax-induced features in the image. Accordingly, based on positive determination that the same pixels are highlighted in the spectral “difference image 2 - 3 ” used for target species detection, a conclusion can be made that the image features corresponding to these pixels are likely to be induced by parallax and not the presence of target species in the imaged scene.
- compensation of parallax can also be performed using images created by individual re-imaging lenses, 128 a , when using a single FPA or multiple FPA's as discussed above.
- FPAs spaced apart from each other in different directions can also be useful. Greater than 2, for example, 3 or 4, or more FPAs can be used to establish parallax for parallax correction.
- two central FPAs and one corner FPA are used for parallax correction.
- These FPA may, in certain embodiments, have substantially similar or the same spectral characteristics, for example, have filters having similar or the same transmission spectrum or have no filter at all.
- Another capability of the embodiments described herein is the ability to perform the volumetric estimation of a gas cloud. This can be accomplished by using (instead of compensating or negating) the parallax induced effects described above.
- the measured parallax between two or more similar spectral response images e.g., two or more channels or FPAs
- s is the separation between two similar spectral response images
- z′ is the distance to the image plane from the back lens.
- the value for z′ is typically approximately equal to the focal length f of the lens of the imaging system.
- the cloud image can be rotated about a central axis running through the cloud image to create a three dimensional volume estimate of the gas cloud size. It is worth noting that in the embodiments described herein only a single imaging system is required for such volume estimation. Indeed, due to the fact that the information about the angle at which the gas cloud is seen by the system is decoded in the parallax effect, the image data includes the information about the imaged scene viewed by the system in association with at least two angles.
- the temporal differencing algorithm When the temporal differencing algorithm is used for processing the acquired imaging data, a change in the scene that is not caused by the target species can inadvertently be highlighted in the resulting image.
- compensation for this error makes use of the temporal differencing between two FPAs that are substantially equally spectrally sensitive to the target species.
- the temporal difference image will highlight those pixels the intensity of which have changed in time (and not in wavelength). Therefore, subtracting the data corresponding to these pixels on both FPAs, which are substantially equally spectrally sensitive to the target species, to form the resulting image, excludes the contribution of the target species to the resulting image.
- these two channels having the same or substantially similar spectral response so as to be substantially equally spectrally sensitive to the target species may comprise FPAs that operate using visible light.
- FPAs that operate using visible light.
- the data acquired with a visible light FPA can also be used to facilitate such differentiation and compensation of the motion-caused imaging errors.
- Visible cameras generally have much lower noise figure than IR cameras (at least during daytime). Consequently, the temporal difference image obtained with the use of image data from the visible light FPA can be quite accurate.
- the visible FPA can be used to compensate for motion in the system as well as many potential false-alarms in the scene due to motion caused by people, vehicles, birds, and steam, for example, as long as the moving object can be observed in the visible region of the spectra. This has the added benefit of providing an additional level of false alarm suppression without reducing the sensitivity of the system since many targets such as gas clouds cannot be observed in the visible spectral region.
- an IR camera can be used to compensate for motion artifacts.
- a spectral unmixing approach assumes that the spectrum measured at a detector pixel is composed of a sum of component spectra (e.g., methane and other gases). This approach attempts to estimate the relative weights of these components needed to derive the measurement spectrum.
- the component spectra are generally taken from a predetermined spectral library (for example, from data collection that has been empirically assembled), though sometimes one can use the scene to estimate these as well (often called “endmember determination”).
- the image obtained by the detector pixel is a radiance spectrum and provides information about the brightness of the object.
- an absorption/emission spectrum of the various gases of interest can be obtained by comparing the measured brightness with an estimate of the expected brightness.
- the spectral unmixing methodology can also benefit from temporal, parallax, and motion compensation techniques.
- a method of identifying the presence of a target species in the object includes obtaining the radiance spectrum (or the absorption spectrum) from the object in a spectral region indicative of the presence of the target species and calculating a correlation (e.g., a correlation coefficient) by correlating the obtained radiance spectrum (or the absorption spectrum) with a reference spectrum for the target species.
- the presence or absence of the target species can be determined based on an amount of correlation (e.g., a value of correlation coefficient).
- the presence of the target species in the object can be confirmed if the amount of correlation or the value of correlation coefficient is greater than a threshold.
- the radiance spectrum (or the absorption spectrum) can be obtained by obtaining a spectral difference image between a filtered optical channel and/or another filtered optical channel/unfiltered optical channel or any combinations thereof
- an embodiment of the system configured to detect the presence of methane in a gas cloud comprises optical components such that one or more of the plurality of optical channels is configured to collect IR radiation to provide spectral data corresponding to a discrete spectral band located in the wavelength range between about 7.9 ⁇ m and about 8.4 ⁇ m corresponding to an absorption peak of methane.
- the multispectral data obtained in the one or more optical channels can be correlated with a predetermined absorption spectrum of methane in the wavelength range between about 7.9 ⁇ m and 8.4 ⁇ m.
- the predetermined absorption spectrum of methane can be saved in a database or a reference library accessible by the system. Based on an amount of correlation (e.g., a value of correlation coefficient), the presence or absence of methane in the gas cloud can be detected.
- the embodiment 300 of FIGS. 3A and 3B is configured to employ 12 optical channels and 12 corresponding microbolometer FPAs 336 to capture a video sequence substantially immediately after performing calibration measurements.
- the video sequence corresponds to images of a standard laboratory scene and the calibration measurements are performed with the use of a reference source including two shutters, as discussed above, one at room temperature and one 5° C. above room temperature.
- the use of 12 FPAs allows increased chance of simultaneous detection and estimation of the concentrations of about 8 or 9 gases present at the scene.
- the number of FPAs 336 can vary, depending on the balance between the operational requirements and consideration of cost.
- optically-filtered FPAs in various embodiments of the system described herein can provide a system with higher number of pixels.
- embodiments including a single large format microbolometer FPA array can provide a system with large number of pixels.
- Various embodiments of the systems described herein can also offer a high optical throughput for a substantially low number of optical channels.
- the systems described herein can provide a high optical throughput for a number of optical channels between 4 and 50.
- the systems described herein have wider spectral bins which allows the signals acquired within each spectral bin to have a greater integrated intensity.
- An advantage of the embodiments described herein over various scanning based hyperspectral systems that are configured for target species detection is that, the entire spectrum can be resolved in a snapshot mode (for example, during one image frame acquisition by the FPA array).
- This feature enables the embodiments of the imaging systems described herein to take advantage of the compensation algorithms such as the parallax and motion compensation algorithms mentioned above. Indeed, as the imaging data required to implement these algorithms are collected simultaneously with the target-species related data, the compensation algorithms are carried out with respect to target-species related data and not with respect to data acquired at another time interval. This rapid data collection thus improves the accuracy of the data compensation process. In addition, the frame rate of data acquisition is much higher.
- embodiments of the imaging system described herein can operate at video rates from about 5 Hz and higher.
- various embodiments described herein can operate at frame rates from about 5 Hz to about 60 Hz or 200 Hz.
- the user is able to recognize in the images the wisps and swirls typical of gas mixing without blurring out of these dynamic image features and other artifacts caused by the change of scene (whether spatial or spectral) during the lengthy measurements.
- scanning based imaging systems involve image data acquisition over a period of time exceeding a single-snap-shot time and can, therefore, blur the target gas features in the image and inevitably reduce the otherwise achievable sensitivity of the detection.
- the images 1 through 12 are selected frames taken from a video-data sequence captured at a video-rate of 15 frames/sec.
- the detected propylene gas is shown as a streak of light 710 (highlighted in red) near the center of each image.
- the first image is taken just prior to the gas emerging from the nozzle of a gas-contained, while the last image represents the system output shortly after the nozzle has been turned off
- FIGS. 8A, 8B The same prototype of the system can also demonstrate the dynamic calibration improvement described above by imaging the scene surrounding the system (the laboratory) with known temperature differences.
- the result of implementing the dynamic correction procedure is shown in FIGS. 8A, 8B , where the curves labeled “obj” (or “A”) represent temperature estimates of an identified region in the scene.
- the abscissa in each of the plots of FIGS. 8A, 8B indicates the number of a FPA, while the ordinate corresponds to temperature (in degrees C.). Accordingly, it is expected that when all detector elements receive radiant data that, when interpreted as the object's temperature, indicates that the object's temperature perceived by all detector elements is the same, any given curve would be a substantially flat line.
- FIG. 8B represents the results of similar measurements corresponding to a different location in the scene (a location which is at a temperature about 9° C. above the estimated temperature of the aperture 338 of FIG. 3A ).
- the correction algorithm discussed above is operable and effective and applicable to objects kept at different temperature. Accordingly, the algorithm is substantially temperature independent.
- FIGS. 9A and 9B illustrates schematically different implementations 900 and 905 respectively of the imaging system that include a variety of temperature calibration elements to facilitate dynamic calibration of the FPAs.
- the temperature calibration elements can include mirrors 975 a , 975 b (represented as M 1A , M 9A , etc.) as well as reference sources 972 a and 972 b .
- the implementation 900 can be similarly configured as the embodiment 300 and include one or more front objective lens, a divided aperture, one or more spectral filters, an array of imaging lenses 928 a and an imaging element 936 .
- the imaging element 936 e.g., camera block
- the array of cameras can comprise an optical FPA unit.
- the optical FPA unit can comprise a single FPA, an array of FPAs.
- the array of cameras can include one or more detector arrays represented as detector array 1 , detector array 5 , detector array 9 in FIGS. 9A and 9B .
- the FOV of each of the detector arrays 1 , 5 , 9 can be divided into a central region and a peripheral region. Without any loss of generality, the central region of the FOV of each of the detector arrays 1 , 5 , 9 can include the region where the FOV of all the detector arrays 1 , 5 , 9 overlap. In the embodiment illustrated in FIG.
- the reference sources 972 a and 972 b are placed at a distance from the detector arrays 1 , 5 , 9 , for example, and mirrors 975 a and 975 b that can image them onto the detector arrays are then placed at the location of the scene reference aperture (e.g., 338 of FIG. 3A ).
- the mirrors 975 a and 975 b are configured to reflect radiation from the reference sources 972 a and 972 b (represented as ref A and ref B).
- the mirrors 975 a and 975 b can be disposed away from the central FOV of the detector arrays 1 , 5 , 9 such that the central FOV is not blocked or obscured by the image of the reference source 972 a and 972 b .
- the FOV of the detector array 5 could be greater than the FOV of the detector arrays 1 and 9 .
- the mirrors 975 a and 975 b can be disposed away from the central FOV of the detector array 5 at a location such that the reference source 972 a and 972 b is imaged by the detector array 5 .
- the mirrors 975 a and 975 b may comprise imaging optical elements having optical power that image the reference sources 972 a and 972 b onto the detector arrays 1 and 9 .
- the reference sources 972 a and 972 b can be disposed in the same plane as the re-imaging lenses 928 a , however, the reference sources 972 a and 972 b can be disposed in a different plane or in different locations.
- the reference sources 972 a and 972 b can be disposed in a plane that is conjugate to the plane in which the detector array 1 , detector array 5 , and detector array 9 are disposed such that a focused image of the reference sources 972 a and 972 b is formed by the detector arrays.
- the reference sources 972 a and 972 b can be disposed in a plane that is spaced apart from the conjugate plane such that a defocused image of the reference sources 972 a and 972 b is formed by the detector arrays.
- the reference sources 972 a and 972 b need not be disposed in the same plane.
- the reference sources 972 a and 972 b are imaged onto the detector array 1 and detector array 9 , without much blur such that the reference sources 972 a and 972 b are focused.
- the image of reference sources 972 a and 972 b formed on the detector array 1 , and detector array 9 are blurred such that the reference sources 972 a and 972 b are defocused, and thereby provide some averaging, smoothing, and/or low pass filtering.
- the reference sources 972 a and 972 b may comprise a surface of known temperature and may or may not include a heater or cooler attached thereto or in thermal communication therewith.
- the reference source 972 a and 972 b may comprises heaters and coolers respectively or may comprise a surface with a temperature sensor and a heater and sensor respectively in direct thermal communication therewith to control the temperature of the reference surface.
- the reference sources 972 a and 972 b can include a temperature controller configured to maintain the reference sources 972 a and 972 b at a known temperature.
- the reference sources 972 a and 972 b can be associated with one or more sensors that measure the temperature of the reference sources 972 a and 972 b and communicate the measured temperature to the temperature controller.
- the one or more sensors can communicate the measured temperature to the data-processing unit.
- the reference sources 972 a and 972 b may comprise a surface of unknown temperature.
- the reference sources may comprise a wall of a housing comprising the imaging system.
- the reference sources 972 a and 972 b can comprise a surface that need not be associated with sensors, temperature controllers.
- the reference sources 972 a and 972 b can comprise a surface that can be associated with sensors, temperature controllers.
- the temperature-calibration elements comprise temperature-controlled elements 972 a and 972 b (e.g., a thermally controlled emitter, a heating strip, a heater or a cooler) disposed a distance from the detector arrays 1 , 5 , 9 .
- the temperature-controlled elements 972 a and 972 b can be disposed away from the central FOV of the detector arrays 1 , 5 , 9 such that the central FOV is not blocked or obscured by the image of the reference source 972 a and 972 b .
- the radiation emitted from the reference sources 972 a and 972 b is also imaged by the detector array 936 along with the radiation incident from the object.
- the image obtained by the detector array of the reference sources can be blurred (or defocused) or sharp (or focused).
- the images 980 a , 980 b , 980 c , 980 d , 980 e and 980 f of the temperature-controlled elements 972 a and 972 b can be used as a reference to dynamically calibrate the one or more cameras in the array of cameras.
- the detector arrays 1 , 5 and 9 are configured to view (or image) both the reference sources 972 a and 972 b . Accordingly, multiple frames (e.g., every or substantially every frame) within a sequence of images contains one or more regions in the image in which the object image has known thermal and spectral properties. This allows multiple (e.g., most or each) cameras within the array of cameras to be calibrated to agree with other (e.g., most or every other) camera imaging the same reference source(s) or surface(s). For example, detector arrays 1 and 9 can be calibrated to agree with each other. As another example, detector arrays 1 , 5 and 9 can be calibrated to agree with each other.
- the lenses 928 a provide blurred (or defocused) images of the reference sources 972 a , 972 b on the detector arrays 1 and 9 because the location of the reference sources are not exactly in a conjugate planes of the detector arrays 1 and 9 .
- the lenses 928 a are described as providing blurred or defocused images, in various embodiments, reference sources or surfaces are imaged on the detectors arrays 1 , 5 , 9 without such blur and defocus and instead are focused images. Additionally optical elements may be used, such as for example, the mirrors shown in FIG. 9A to provide such focused images.
- the temperature of the reference sources 972 b , 972 a can be different.
- the reference source 972 a can be at a temperature T A
- the reference source 972 b can be at a temperature T B lower than the temperature T A .
- a heater can be provided under the temperature-controlled element 972 a to maintain it at a temperature T A
- a cooler can be provided underneath the temperature-controlled element 972 b to maintain it at a temperature T B .
- the embodiments illustrated in FIGS. 9A and 9B can be configured to image a single reference source 972 instead of two references sources 972 a and 972 b maintained at different temperatures. It is understood that the single reference source need not be thermally controlled.
- a plurality of detectors in the detector array can be configured to image a same surface of at least one calibration element whose thermal and spectral properties are unknown.
- one of the plurality of detectors can be configured as a reference detector and the temperature of the surface of the at least one calibration element imaged by the plurality of detectors can be estimated using the radiance spectrum obtained by the reference detector.
- the remaining plurality of detectors can be calibrated such that their temperature and/or spectral measurements agree with the reference detector.
- detector arrays 1 and 9 can be calibrated to agree with each other.
- detector arrays 1 , 5 and 9 can be calibrated to agree with each other.
- the reference sources 972 a and 972 b can be coated with a material to make it behave substantially as a blackbody (for which the emission spectrum is known for any given temperature). If a temperature sensor is used at the location of each reference source, then the temperature can be tracked at these locations. As a result, the regions in the image of each camera (e.g., on the detector arrays 1 and 9 ) in which the object has such known temperature (and, therefore, spectrum) can be defined. A calibration procedure can thus be used so that most of the cameras (if not every camera) so operated agrees, operationally, with most or every other camera, for objects at the temperatures represented by those two sources.
- Calibrating infrared cameras using sources at two different temperatures is known as a “two-point” calibration, and assumes that the measured signal at a given pixel is linearly related to the incident irradiance. Since this calibration can be performed during multiple, more, or even every frame of a sequence, it is referred to as a “dynamic calibration”.
- thermo calibration procedure is as follows. If there is a temperature sensor on the reference sources or reference surface, then the temperature measurements obtained by these temperature sensors can be used to determine their expected emission spectra. These temperature measurements are labeled as T A [R], T B [R], and T C [R] for the “reference temperatures” of sources/surfaces A, B, and C. These temperature measurements can be used as scalar correction factors to apply to the entire image of a given camera, forcing it to agree with the reference temperatures. Correcting the temperature estimate of a given pixel from T to T′ can use formulae analogous to those discussed below in reference to FIGS. 10A, 10B, 10C . If no direct temperature sensor is used, then one of the cameras can be used instead.
- This camera can be referred to as the “reference camera”.
- the same formulae as those provided in paragraph below can be used, but with T A [R] and T B [R] representing the temperatures of the reference sources/surfaces A and B as estimated by the reference camera.
- T A [R] and T B [R] representing the temperatures of the reference sources/surfaces A and B as estimated by the reference camera.
- the reference sources 972 a and 972 b are placed such that the images of the sources on the detector arrays are blurred.
- the configuration illustrated in FIG. 9A is similar to the system 400 illustrated in FIG. 4 where the reference sources are placed at an intermediate image plane (e.g., a conjugate image plane).
- the array of reference apertures similar to reference apertures 438 a in FIG. 4 , will have an accompanying array of reference sources or reference surfaces such that the reference sources or surfaces (e.g., each reference source or surface) are imaged onto a camera or a detector array such as FPAs 1 , 5 , 9 .
- the reference source or surface images are at a conjugate image plane and thus are not appreciably blurred, so that their images can be made to block a smaller portion of each camera's field of view.
- a “static” calibration (a procedure in which the scene is largely blocked with a reference source such as the moving shutters 960 in FIGS. 9A and 9B , so that imaging of an unknown scene cannot be performed in parallel with calibration) allows a plurality of the cameras (for example, most or each camera) to accurately estimate the temperature of a plurality of elements (for example, most or each element in the scene) immediately after the calibration is complete. It cannot, however, prevent the cameras' estimates from drifting away from one another during the process of imaging an unknown scene.
- the dynamic calibration can be used to reduce or prevent this drift, so that all cameras imaging a scene can be forced to agree on the temperature estimate of the reference sources/surfaces, and adjust this correction during every frame.
- FIG. 10A illustrates schematically a related embodiment 1000 of the imaging system, in which one or more mirrors M OA , . . . M 11A and M OB , . . . M 11B are placed within the fields of view of one or more cameras 0 , . . . , 11 , partially blocking the field of view.
- the cameras 0 , . . . , 11 are arranged to form an outer ring of cameras including cameras 0 , 1 , 2 , 3 , 7 , 11 , 10 , 9 , 8 and 4 surrounding the central cameras 5 and 6 .
- the FOV of the central cameras 5 and 6 can be less than or equal to the FOV of the outer ring of cameras 0 , 1 , 2 , 3 , 7 , 11 , 10 , 9 , 8 and 4 .
- M 11B can be placed outside the central FOV of the cameras 5 and 6 and is placed in a peripheral FOV of the cameras outer ring of cameras 0 , 1 , 2 , 3 , 7 , 11 , 10 , 9 , 8 and 4 which does not overlap with the central FOV of the cameras 5 and 6 such that the reference sources A and B are not imaged by the cameras 5 and 6 .
- the FOV of the central cameras 5 and 6 can be greater than the FOV of the outer ring of cameras 0 , 1 , 2 , 3 , 7 , 11 , 10 , 9 , 8 and 4 .
- M 11B can be placed in a peripheral FOV of the cameras 5 and 6 which does overlap with the central FOV of the outer ring of cameras 0 , 1 , 2 , 3 , 7 , 11 , 10 , 9 , 8 and 4 such that the reference sources A and B are imaged by the cameras 5 and 6 .
- This design is an enhancement to the systems 300 and 400 shown in FIGS. 3A and 4A .
- an array of two or more imaging elements (curved mirrors, for example) is installed at a distance from the FPAs, for example, in the plane of the reference aperture 160 shown in FIG. 3A .
- These elements are used to image one or more temperature-controlled reference sources A and B onto the detector elements of two or more of the cameras.
- the primary difference between embodiment 1000 and embodiment 300 or 400 is that now a plurality or most or all of the outer ring of cameras in the array can image both the reference sources A and B instead of imaging one of the two reference source A and B.
- most or all of the outer ring of cameras image an identical reference source or an identical set of reference sources (e.g., both the reference sources A and B) rather than using different reference sources for different cameras or imaging different portions of the reference sources as shown in FIGS. 3A and 4A .
- this approach improves the robustness of the calibration, as it eliminates potential failures and errors due to the having additional thermal sensors estimating each reference source.
- the imaging elements in the system 1000 (shown as mirrors in FIGS. 10A and 10B ) image one or more controlled-temperature reference sources or a surface of a calibration element (shown as A and B in FIGS. 10A and 10B ) into the blocked region of the cameras' fields of view.
- FIG. 10B shows an example in which mirror M OA images reference source/surface A onto camera 0 , and mirror M OB images reference source/surface B onto camera 0 , and likewise for cameras 1 , 2 , and 3 .
- each of the mirrors is used to image a reference source/surface onto a detector array of a camera, so that many, most, or every frame within a sequence of images contains one or more regions in the image in which the object image has known thermal and spectral properties.
- This approach allows most of the camera, if not each camera, within the array of cameras to be calibrated to agree with most or every other camera imaging the same reference source or sources. For example, cameras 0 , 1 , 2 , 3 , 7 , 11 , 10 , 9 , 8 and 4 can be calibrated to agree with each other. As another example, cameras 0 , 1 , 2 and 3 can be calibrated to agree with each other.
- cameras 0 , 1 , 2 , 3 , 7 , 11 , 10 , 9 , 8 , 4 , 5 and 6 can be calibrated to agree with each other. Accordingly, in various implementations, two, three, four, five, six, seven, eight, nine, ten, eleven or twelve cameras can be calibrated to agree with each other. In certain embodiments, however, not all the cameras are calibrated to agree with each other. For example, one, two, or more cameras may not be calibrated to agree with each other while others may be calibrated to agree with each other. In various embodiments, these mirrors may be configured to image the reference sources/surfaces A and B onto different respective pixels a given FPA. Without any loss of generality, FIGS. 10A and 10B represent a top view of the embodiment shown in FIG. 9A .
- FIG. 10C illustrates schematically a related embodiment 1050 of the imaging system, in which one or more reference sources R OA , . . . , R 11A and R OB , . . . , R 11B are disposed around the array of detectors 0 , . . . , 11 .
- the one or more reference sources R OA , . . . , R 11A and R OB , . . . , R 11B can be a single reference source that is imaged by the detectors 0 , . . . , 11 .
- central detector arrays 5 and 6 can have a FOV that is equal to or lesser than the FOV of the outer ring of the detectors 0 , 1 , 2 , 3 , 7 , 11 , 10 , 9 , 8 and 4 .
- the reference sources R 0A , . . . , R 11A can be disposed away from the central FOV of the detector arrays 5 and 6 such that the radiation from the reference sources R 0A , . . . , R 11A is imaged only by the outer ring of detectors 0 , 1 , 2 , 3 , 7 , 11 , 10 , 9 , 8 and 4 .
- central detector arrays 5 and 6 can have a FOV that is greater than the FOV of the outer ring of the detectors 0 , 1 , 2 , 3 , 7 , 11 , 10 , 9 , 8 and 4 .
- the reference sources R 0A , . . . , R 11A can be disposed in the peripheral FOV of the detector arrays 5 and 6 such that the radiation from the reference sources R OA , . . . , R 11A is imaged only by the outer ring of detectors 0 , 1 , 2 , 3 , 7 , 11 , 10 , 9 , 8 and 4 .
- FIG. 10C represents a top view of the embodiment shown in FIG. 9B .
- a heater can be provided underneath, adjacent to, or in thermal communication with reference source/surface A to give it a higher temperature T A
- a cooler can be provided underneath, adjacent to, or in thermal communication with reference source B to give it a lower temperature T B .
- the embodiments illustrated in FIGS. 10A, 10B and 10C can be configured to image a single reference source A instead of two references sources A and B maintained at different temperatures.
- the embodiments illustrated in FIGS. 10A, 10B and 10C can be configured to image a same surface of a calibration element. In such implementations, the temperature of the surface of the calibration element need not be known.
- each reference source/surface can be coated with a material to make it behave approximately as a blackbody, for which the emission spectrum is known for any given temperature. If many, most, or each camera in the array of cameras images both of references A and B, so that there are known regions in the image of these cameras in which the object has a known temperature (and therefore spectrum), then one can perform a calibration procedure. This procedure can provide that many, most or every camera so operated agrees with various, most, or every other camera, for objects at the temperatures represented by those two sources. For example, two, three, four, five, six, seven, eight, nine, ten, eleven or twelve cameras can be calibrated to agree with each other. In certain embodiments, however, not all the cameras are calibrated to agree with each other.
- one, two, or more cameras may not be calibrated to agree with each other while others may be calibrated to agree with each other.
- calibration of infrared cameras using sources at two different temperatures is known as a “two-point” calibration, and assumes that the measured signal at a given pixel is linearly related to the incident irradiance.
- the dynamic calibration is used to obtain a corrected temperature T′ from the initial temperature T estimated at each pixel in a camera using the following formulae:
- T′[x,y,c ] ( T[x,y,c] ⁇ T A [R ]) G[c]+T A [R]
- T A [R] is a dynamic offset correction factor
- the term c discussed above is a camera index that identifies the camera whose data is being corrected.
- DAISI divided aperture infrared spectral imager
- Various embodiments of the divided aperture infrared spectral imager (DAISI) disclosed herein can be configured to operate over a spectral range extending from mid-wave infrared wavelength range (e.g., between about 3 microns and about 7 microns) and long wave infrared wavelength range (e.g., between about 7 microns and about 14 microns) by including detector arrays that can detect infrared radiation in the mid-wave infrared wavelength range and in the long wave infrared wavelength range respectively.
- mid-wave infrared wavelength range e.g., between about 3 microns and about 7 microns
- long wave infrared wavelength range e.g., between about 7 microns and about 14 microns
- the detector arrays 136 , 236 , 336 and/or 456 can include at least one mid-wave infrared (MWIR) FPA configured to detect infrared radiation in the wavelength range between about 3 microns and about 7 microns and at least one long wave infrared (LWIR) FPA configured to detect infrared radiation in the wavelength range between about 7 microns and about 14 microns.
- MWIR mid-wave infrared
- LWIR long wave infrared
- the detector arrays 136 , 236 , 336 and/or 456 can include one MWIR FPA configured to detect infrared radiation in the wavelength range between about 3 microns and about 7 microns and a plurality of LWIR FPAs configured to detect infrared radiation in the wavelength range between about 7 microns and about 14 microns.
- the MWIR FPA can be cooled and/or uncooled.
- one or more of the LWIR FPAs can be cooled and/or uncooled.
- the MWIR and/or the LWIR FPAs can be cooled to temperatures below room temperature.
- the MWIR and/or the LWIR FPAs can include coolers that maintain the FPAs at a temperature between about 200 degree Kelvin and about 273 degree Kelvin, a temperature between about 150 degree Kelvin and about 200 degree Kelvin, a temperature between about 100 degree Kelvin and about 150 degree Kelvin or a temperature between about 50 degree Kelvin and about 150 degree Kelvin.
- the coolers employed to maintain the MWIR and/or LWIR FPAs at a desired temperature can be a cryogenic cooler.
- the coolers employed to maintain the MWIR and/or LWIR FPAs at a desired temperature can include pulse tube coolers available from Thales Cryogenics or Canberra Industries, Inc.
- the coolers employed to maintain the MWIR and/or LWIR FPAs at a desired temperature can include high operating temperature (HOT) coolers that can maintain the MWIR and/or LWIR FPAs at a temperature between about 110 degree Kelvin and 150 degree Kelvin.
- HET high operating temperature
- the HOT coolers can maintain the at least one MWIR and/or LWIR FPAs at a temperature of about 135 degree Kelvin.
- the use of HOT coolers can facilitate detector arrays comprising novel semiconductor materials that have reduced cooling requirements as compared to detector arrays comprising InSb or Mercury Cadmium Telluride (MCT).
- MCT Mercury Cadmium Telluride
- the HOT coolers can additionally extend the lifetime of the detector arrays beyond 25000 hours, such as, for example up to 90,000 hours.
- the coolers can include cryogenic coolers and/or thermo-electric coolers.
- Implementations of the dual band DAISI including MWIR and LWIR FPAs can have increased detection sensitivity to chemicals/gases that have stronger spectral features in the mid wave infrared wavelength range than the long wave infrared wavelength range. Additionally, since implementations of the dual band DAISI including MWIR and LWIR FPAs are capable of obtaining spectral information in both the mid-wave infrared wavelength range and the long wave infrared wavelength range, such implementations can have enhanced chemical/gas identification capabilities as compared to implementations that operate only in the mid-wave infrared wavelength range or the long wave infrared wavelength range.
- implementations of the dual band DAISI including MWIR and LWIR FPAs are capable of obtaining an image of a scene by combining spectral information in the mid-wave infrared wavelength range and the long wave infrared wavelength range, the accuracy of detecting various gases/chemicals in the imaged scene can be improved. Additionally, since the implementations of the dual band DAISI including MWIR and LWIR FPAs obtain information in the mid-wave infrared wavelength range and the long wave infrared wavelength range using solar as well as thermal sources for signal, they can be used in different weather conditions (e.g., on sunny days, cloudy days, etc.) and at various times of the day (e.g., during the day or night).
- different weather conditions e.g., on sunny days, cloudy days, etc.
- Various implementations of the dual band DAISI system can be used in continuous monitoring of explosive hydrocarbons or hazardous gas leaks and/or any fugitive gas emission. Implementations of the dual band DAISI system used in such applications can provide video imagery identifying the species, size and direction, and concentration of any detected gas cloud. Other implementations of the dual band DAISI system can also be used for exploration, standoff chemical detection, explosive detection, bio-imaging, medical imaging, gas cloud imaging, surveillance, food inspection, and remote sensing applications and other applications including but not limited to biological warfare, gas leaks at refineries, rigs and petroleum plants, imaging for the purpose of reconnaissance, underwater applications, space application, telecommunications and/or optical computing.
- FIGS. 11A, 12A and 13A Various configurations of detector arrays including MWIR and LWIR FPAs are shown in FIGS. 11A, 12A and 13A .
- FIG. 11A illustrates a 4 ⁇ 3 array 1100 including one MWIR FPA 1101 b and a plurality of LWIR FPAs (e.g., 1101 a and 1101 c ).
- FIG. 11B is a cross-sectional view of the detector array 1100 along the axis 1105 A- 1105 A′.
- the MWIR FPA 1101 b is capable of detecting mid-wavelength infra-red radiation in the spectral range between 3-5 microns.
- the MWIR FPA 1101 b can include a plurality of detecting regions, each of the plurality of detecting regions being a part of a spatially and spectrally distinct MWIR optical channel.
- the MWIR FPA 1101 b can comprise one or more imaging lens 1128 b configured to image the radiation incident along each of the spatially and spectrally distinct MWIR optical channel onto the corresponding detecting regions of the MWIR FPA 1101 b .
- Each of the LWIR FPAs 1101 a and 1101 c is capable of detecting long-wavelength infra-red radiation in the spectral range between 7-14 microns.
- the LWIR FPAs 1101 a and 1101 c can include a plurality of detecting regions, each of the plurality of detecting regions being a part of a spatially and spectrally distinct LWIR optical channel.
- the LWIR FPAs 1101 a and 1101 c can comprise one or more imaging lens 1128 a and 1128 c configured to image the radiation incident along each of the spatially and spectrally distinct LWIR optical channel onto the onto the corresponding detecting regions of the LWIR FPAs 1101 a and 1101 c.
- FIG. 12A illustrates a 3 ⁇ 3 array 1200 including one FPA 1201 b ML that can detect mid-wavelength and long-wavelength infra-red radiation and a plurality of LWIR FPAs (e.g., 1201 a and 1201 c ).
- FIG. 12B is a cross-sectional view of the detector array 1200 along the axis 1205 A- 1205 A′.
- a beam splitter 1230 can be disposed in front of the FPA 1201 b ML configured to split incident radiation in a first wavelength band including radiation in the mid-wavelength infra-red spectral range and a second wavelength band including radiation in the long-wavelength infra-red spectral range.
- the first wavelength band in the mid-wavelength infra-red spectral range is directed along a first optical path towards a FPA 1201 b M capable of detecting mid-wavelength infra-red radiation in the spectral range between 3-5 microns.
- the second wavelength band in the long-wavelength infra-red spectral range is directed along a second optical path towards a FPA 120 b L capable of detecting long-wavelength infra-red radiation in the spectral range between 7-14 microns.
- Each of the MWIR FPA 1201 b M and the LWIR FPA 1201 b L can comprise one or more imaging lenses 1228 b M and 1228 b L configured to image received mid-wavelength infra-red radiation and long-wavelength infra-red radiation onto the FPAs 1201 b M and 1201 b L respectively.
- FIG. 13A illustrates a 4 ⁇ 4 array 1300 including a plurality of MWIR FPAs (e.g., 1310 M) and a plurality of LWIR FPAs (e.g., 1301 a , 1301 b , and 1301 c ).
- FIG. 13B is a cross-sectional view of the detector array 1300 along the axis 1305 A- 1305 A′.
- Each of the MWIR FPAs e.g., 1310 M
- Each of the MWIR FPAs can include a plurality of detecting regions, each of the plurality of detecting regions being a part of a spatially and spectrally distinct MWIR optical channel.
- Each of the MWIR FPAs can comprise one or more imaging lens 1328 M configured to image the radiation incident along each of the spatially and spectrally distinct MWIR optical channel onto the corresponding detecting regions of each of the MWIR FPAs (e.g., 1310 M).
- the LWIR FPAs 1301 a - 1301 c can comprise a corresponding imaging lens 1328 a , 1328 b and 1328 c configured to image received long-wavelength infra-red radiation onto the corresponding FPA 1301 a - 1301 c.
- FIG. 11A depicts a 4 ⁇ 3 array including twelve FPAs (e.g., 1 MWIR FPA and 11 LWIR FPAs as shown in FIG. 11A , the number of FPAs can be different in other implementations.
- the number of FPAs can be sixteen as shown in FIG. 13A .
- the number of FPAs can be nine as shown in FIG. 12A .
- the number of FPAs can be between 2 and 50.
- various implementations can include at least 2 FPAs, at least 3 FPAs, at least 4 FPAs, at least 5 FPAs, at least 6 FPAs, at least 7 FPAs, at least 8 FPAs, at least 9 FPAs, at least 10 FPAs, at least 11 FPAs, at least 13 FPAs, at least 14 FPAs, at least 15 FPAs, at least 18 FPAs, at least 24 FPAs, at least 30 FPAs, at least 36 FPAs, etc.
- at least one of the plurality of FPAs can be a MWIR FPA.
- the detector arrays 1100 , 1200 and 1300 can comprise a monolithic FPA unit including one or more MWIR and LWIR detecting regions.
- the MWIR FPA can have a similar size and weight as the LWIR FPA. In some implementations, the MWIR FPA can have a smaller size as compared to the LWIR FPA.
- the one or more MWIR FPAs can be statically and dynamically calibrated using a procedure similar to the static and dynamic calibration of the one or more LWIR FPAs described above.
- the one or more MWIR FPAs can image the moveable temperature-controlled reference source 160 , the field reference 338 , the field reference array 438 , the moveable temperature-controlled shutters 460 a and 460 b , temperature-controlled shutters 960 and/or the reference sources 972 a and 972 b described above.
- the static and dynamic calibration procedures described above can maintain agreement among all the FPAs including the LWIR and MWIR FPAs when viewing the same radiant energy.
- the static and dynamic calibration procedures described above can aid in differentiating between thermally-induced signal and solar-reflection-induced signal which can affect the detection capabilities of a MWIR FPA. For example, if a MWIR FPA (or camera) sees a change in signal within the scene, but none in the reference source, then the user can conclude that the change was induced by a change in the scene illumination or a change in the object temperature. The user can confirm with certain degree of confidence that the change was not induced by changes in the response of the detector which would indicate that the detector calibration is in need of adjustment.
- One or more optical filters can be disposed in the optical path of each MWIR and LWIR FPA in the detector array similar to the embodiments disclosed in FIGS. 1, 2, 3A and 4 .
- the one or more optical filters disposed in the optical path of the MWIR FPA can result in a pass-band in the mid-wavelength infra-red region while the one or more optical filters disposed in the optical path of the LWIR FPA can result in a pass-band in the long-wavelength infra-red region.
- the one or more optical filters can include short-pass filters, long-pass filters, band-pass filters, notch filters, etc.
- the one or more optical filters can include interference films and/or coatings.
- the one or more optical filters can include spectral filters.
- the one or more optical filters can also include a cold stop filter that can limit spectral range that is transmitted toward the FPA.
- the cold stop filter can be configured to transmit spectral regions that are of more interest (e.g., the spectral regions including the prominent spectral features) toward the FPA. This can advantageously reduce noise from radiation in spectral ranges that are of less interest which can help to increase the accuracy of detection.
- embodiments employed to detect hydrocarbon gas can include a cold stop filter in the optical path of the MWIR FPA that transmits light in the spectral range between about 3.1 and about 3.9 microns.
- cold stop filters having a different pass-band can be employed.
- a cold stop filter can include one or more band-pass filters, short-pass filters and/or long-pass filters that are cooled with a cooler.
- the cold stop filter can be maintained at the same temperature as the corresponding detector. Alternately, the cold stop filter can be maintained at a different temperature as the corresponding detector.
- FIGS. 14A and 14B illustrate embodiments including an optical filter 1440 disposed in the optical path of a FPA 1401 .
- the FPA 1401 can be an MWIR FPA and/or a LWIR FPA as discussed above.
- a re-imaging lens 1428 can also be provided to image the incident radiation on the FPA 1401 .
- the optical filter 1440 can be disposed forward of the re-imaging lens 1428 and the FPA 1401 as shown in FIG. 14B or between the re-imaging lens 1428 and the FPA 1401 as shown in FIG. 14A .
- Cooled MWIR FPAs can advantageously operate at a higher frame rate than an uncooled MWIR/LWIR FPA. Accordingly, for any video frame rate, cooled MWIR FPAs can average data over more frames than an uncooled MWIR/LWIR FPA. This can result in an increase in the signal to noise ratio of the images obtained by the uncooled MWIR FPA.
- the increased signal to noise ratio provided by cooled MWIR FPAs can be advantageous in systems that employ one or more uncooled LWIR FPAs.
- the reduced signal to noise ratio of images obtained from uncooled LWIR FPAs can result in reduced absorption strength of spectral features present in the images obtained from one or more uncooled LWIR FPAs.
- imaging systems employing one or more uncooled LWIR FPAs only can result in false positive detection of the presence or absence of one or more chemical species.
- imaging systems employing one or more uncooled LWIR FPAs only can indicate the presence of a chemical species when it is absent in truth or indicate the absence of a chemical species when it is present in truth.
- differentiating between true and false chemical species detections can be challenging when imaging systems employing only one or more uncooled LWIR FPAs are used.
- a cooled MWIR FPA providing images with increased signal to noise ratio, and utilizing the stronger absorption features of various chemical species in mid-wavelength infra-red spectral range, can be used to primarily detect the presence or absence of a chemical species in a scene while the uncooled LWIR FPAs can be used to remove false positive detections and/or to identify the chemical species.
- FIG. 15 provides a visual example of the roles of the MWIR and LWIR FPAs.
- the one or more cooled MWIR FPAs can be configured to image the full extent of a gas cloud 1505 in the scene.
- the one or more LWIR FPAs in the imaging system may require a stronger signal and/or a higher contrast ratio between the gas cloud and a feature in the background of the scene in order to detect various chemical species that may be in the gas cloud 1505 .
- Such LWIR FPAs by themselves may only be capable of detecting the presence of the chemical species (e.g., 1507 a ) that have a higher concentration. Furthermore, the detection of chemical species that are present in higher concentration may be inaccurate due to variations in noise, variations in gas density across the field of view, and in variations in the background against which the gas cloud 1505 is imaged. Thus, an imaging system that employs only such LWIR FPAs may result in false positive detections. However, in imaging system that employ one or more MWIR FPAs (e.g., cooled MWIR FPAs), it is not necessary to rely on the detection capability (and/or the signal-to-noise ratio) of such LWIR FPAs.
- MWIR FPAs e.g., cooled MWIR FPAs
- the LWIR FPAs can be used to perform only false positive removal. Such systems can have increased sensitivity and reliability as compared to imaging systems that employ only LWIR FPAs that require a stronger signal in order to detect various chemical species.
- the LWIR FPAs can be used to identify regions in the gas cloud 1505 where certain chemical species of interest are present in relatively higher concentrations.
- the one or more MWIR FPAs are configured to have increased sensitivity to detect the presence or absence of chemical species in the scene and the one or more MWIR FPAs are configured to speciate or identify the chemical species that are present.
- the one or more MWIR and LWIR FPAs can be configured to output one or more image frames.
- the one or more image frames can be output at video frame rates.
- the output of the one or more MWIR and LWIR FPAs can be between 5 image frames/second and 120 image frames/second.
- the output image frames can be analyzed using hyperspectral video analytics using spectra-temporal algorithms to obtain spectral features of various chemical species that may be present in the scene.
- the spectral features obtained from the image data output from one or more of the MWIR elements and LWIR elements can be cross-correlated with known spectra of various chemical species that are stored in a reference library in a database to identify the chemical species that may be present in the gas cloud 1505 .
- image frames output from the one or more MWIR and LWIR FPAs at the beginning of the measurement period can be used to estimate background features of the scene and image frames acquired later in the measurement period can be used to detect and speciate various chemical species of interest that may be present in the scene.
- the one or more MWIR and LWIR FPAs can be used to not only detect and speciate various chemical species of interest that may be present in the scene but to also estimate the dynamic properties of those chemical species.
- the one or more MWIR and LWIR FPAs can be used to estimate movement of the gas cloud 1505 and/or the region 1507 over time in addition to detecting and speciating various chemical species that may be present in the gas cloud 1505 .
- the results associated with detecting and speciating various chemical species that may be present in the gas cloud 1505 can be obtained within 1 second from the start of imaging the scene.
- the associated results can be updated after every frame thereafter.
- the results associated with detecting and speciating various chemical species that may be present in the gas cloud 1505 can be obtained in sufficiently real time (e.g., between about 0.01 millisecond and about 1 millisecond from the start of imaging the scene, between about 0.01 millisecond and about 10 milliseconds from the start of imaging the scene, between about 0.01 millisecond and about 50 milliseconds from the start of imaging the scene, between about 0.01 millisecond and about 100 milliseconds from the start of imaging the scene, between about 0.01 millisecond and about 500 milliseconds from the start of imaging the scene, between about 0.01 millisecond and about 1 second from the start of imaging the scene, between about 0.01 millisecond and about 10 seconds from the start of imaging the scene, between about 0.01 millisecond and about 30 seconds from the start of imaging the scene, between about 0.01 millisecond and about 1 minute from the start of imaging the scene, between about 0.01 millisecond and about 5 minutes from the start of imaging the scene, or between about 0.01 millisecond and about 10
- MWIR FPAs e.g., cooled MWIR FPAs
- a feedback system can be employed to synchronize the image frames output from the one or more LWIR FPAs and the image frames output from the one or more MWIR FPAs.
- MWIR FPAs in an array of LWIR FPAs also provides improved chemical speciation due to the extension in the spectral range over which data is collected.
- sulfur dioxide (SO 2 ) produces a signature in the long-wavelength infra-red spectral range that can be confused with the signature for propylene (C 3 H 6 ) at very low spectral resolution.
- C 3 H 6 propylene
- the spectral features of SO 2 and C 3 H 6 do not overlap in the mid-wavelength infra-red spectral range.
- the information provided by one or more MWIR FPAs when used in combination with information provided by one or more LWIR FPAs can provide additional information to help differentiate the chemical species that are detected.
- the information provided from the one or more MWIR and LWIR FPAs can also provide information that cannot be obtained by either the MWIR or the LWIR FPAs individually.
- the combined information from MWIR and LWIR FPAs can be used to estimate the illumination of a scene.
- the LWIR FPAs are more sensitive to thermally emitted radiation and less sensitive to reflected solar radiation, since solar light is weaker in the long-wavelength infra-red spectral range in comparison with terrestrial sources that are much closer.
- the MWIR FPAs are sensitive to both thermal and reflected solar radiation. Thus, if LWIR FPAs observing a scene record only small and gradual changes in signal, whereas the MWIR FPAs observing the same scene record much sharper changes then it can be concluded with a degree of confidence that the illumination of the scene is changing.
- FIG. 16 shows the temporal variation in the amount of radiation detected by the MWIR FPAs and LWIR FPAs imaging a scene in which the sun emerges from behind a cloud for a certain interval of time and is covered by a cloud subsequently.
- the curve 1605 depicts the variation of the amount of radiation detected by the MWIR FPAs and the curve 1610 depicts the variation of the amount of radiation detected by the LWIR FPAs.
- T 1 and T 2 the sun emerges from behind a cloud.
- the MWIR FPAs by virtue of their higher sensitivity to wavelengths in the solar spectrum are able to detect almost instantaneously a change in the illumination of the scene, while the LWIR FPAs due to their lower sensitivity to wavelengths in the solar spectrum show a gradual increase in the amount of radiation detected which corresponds to a change in the temperature of the objects in the scene as they are heated by the sun.
- Some of the plurality of spatially and spectrally distinct optical channels in various implementations of the dual band DAISI including MWIR and LWIR FPAs can obtain information from spatially distinct portions of an object. Some of the plurality of spatially and spectrally distinct optical channels in various implementations of the dual band DAISI including MWIR and LWIR FPAs can have a field of view (FOV) that is different from the field of view (FOV) of some other of the plurality of spatially and spectrally distinct optical channels.
- FOV field of view
- Some of the plurality of spatially and spectrally distinct optical channels in various implementations of the dual band DAISI including MWIR and LWIR FPAs can have a field of view (FOV) that is lower than the field of view (FOV) of the entire system.
- FOV field of view
- references throughout this specification to “one embodiment,” “an embodiment,” “a related embodiment,” or similar language mean that a particular feature, structure, or characteristic described in connection with the referred to “embodiment” is included in at least one embodiment of the present invention.
- appearances of the phrases “in one embodiment,” “in an embodiment,” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment. It is to be understood that no portion of disclosure, taken on its own and in possible connection with a figure, is intended to provide a complete description of all features of the invention.
- At least some elements of a device of the invention can be controlled—and at least some steps of a method of the invention can be effectuated, in operation—with a programmable processor governed by instructions stored in a memory.
- the memory may be random access memory (RAM), read-only memory (ROM), flash memory or any other memory, or combination thereof, suitable for storing control software or other instructions and data.
- RAM random access memory
- ROM read-only memory
- flash memory any other memory, or combination thereof, suitable for storing control software or other instructions and data.
- instructions or programs defining the functions of the present invention may be delivered to a processor in many forms, including, but not limited to, information permanently stored on non-writable storage media (e.g.
- ROM read-only memory devices within a computer
- ROM read-only memory devices
- a computer I/O attachment such as CD-ROM or DVD disks
- writable storage media e.g. floppy disks, removable flash memory and hard drives
- information conveyed to a computer through communication media including wired or wireless computer networks.
- firmware and/or hardware components such as combinatorial logic, Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs) or other hardware or some combination of hardware, software and/or firmware components.
- While examples of embodiments of the system and method of the invention have been discussed in reference to the gas-cloud detection, monitoring, and quantification (including but not limited to greenhouse gases such as Carbon Dioxide, Carbon Monoxide, Nitrogen Oxide as well as hydrocarbon gases such as Methane, Ethane, Propane, n-Butane, iso-Butane, n-Pentane, iso-Pentane, neo-Pentane, Hydrogen Sulfide, Sulfur Hexafluoride, Ammonia, Benzene, p- and m-Xylene, Vinyl chloride, Toluene, Propylene oxide, Propylene, Methanol, Hydrazine, Ethanol, 1,2-dichloroethane, 1,1-dichloroethane, Dichlorobenzene, Chlorobenzene, to name just a few), embodiments of the invention can be readily adapted for other chemical detection applications.
- greenhouse gases such as Carbon Dioxide, Carbon Mon
- detection of liquid and solid chemical spills, biological weapons, tracking targets based on their chemical composition identification of satellites and space debris, ophthalmological imaging, microscopy and cellular imaging, endoscopy, mold detection, fire and flame detection, and pesticide detection are within the scope of the invention.
- a phrase referring to “at least one of” a list of items refers to any combination of those items, including single members.
- “at least one of: a, b, or c” is intended to cover: a, b, c, a-b, a-c, b-c, and a-b-c.
- Computer-readable media includes both computer storage media and communication media including any medium that can be enabled to transfer a computer program from one place to another.
- a storage media may be any available media that may be accessed by a computer.
- such computer-readable media may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that may be used to store desired program code in the form of instructions or data structures and that may be accessed by a computer.
- Disk and disc includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above also may be included within the scope of computer-readable media. Additionally, the operations of a method or algorithm may reside as one or any combination or set of codes and instructions on a machine readable medium and computer-readable medium, which may be incorporated into a computer program product.
Abstract
Various embodiments disclosed herein describe a divided-aperture infrared spectral imaging (DAISI) system that is adapted to acquire multiple IR images of a scene with a single-shot (also referred to as a snapshot). The plurality of acquired images having different wavelength compositions that are obtained generally simultaneously. The system includes at least two optical channels that are spatially and spectrally different from one another. Each of the at least two optical channels are configured to transfer IR radiation incident on the optical system towards an optical FPA unit comprising at least two detector arrays. One of the at least two detector arrays comprises a cooled mid-wavelength infra-red FPA. The system further comprises at least one temperature reference source or surface that is used to dynamically calibrate the two detector arrays and compensate for a temperature difference between the two detector arrays.
Description
- The present application claims benefit under 35 U.S.C. §119(e) of U.S. Provisional Application No. 61/986,886, filed on May 1, 2014 and titled “Dual Band Divided Aperture Infrared Spectral Imager (DAISI) for Chemical Detection,” and of U.S. Provisional Application No. 62/082,594, filed on Nov. 20, 2014 and titled “Dual-Band Divided-Aperture Infra-Red Spectral Imaging System.” The disclosure of each of the above identified provisional patent applications is incorporated by reference herein in its entirety.
- This application claims benefit under 35 U.S.C. §119(e) of U.S. Provisional Patent Application No. 61/986,885, filed May 1, 2014, titled “MINIATURE GAS AND CHEMICAL IMAGING CAMERA;” of U.S. Provisional Patent Application No. 62/012,078, filed Jun. 13, 2014, titled “MINIATURE GAS AND CHEMICAL IMAGING CAMERA;” of U.S. Provisional Patent Application No. 62/054,894, filed Sep. 24, 2014, titled “MOBILE GAS AND CHEMICAL IMAGING CAMERA;” of U.S. Provisional Patent Application No. 62/055,342, filed Sep. 25, 2014, titled “MOBILE GAS AND CHEMICAL IMAGING CAMERA;” of U.S. Provisional Patent Application No. 62/055,549, filed Sep. 25, 2014, titled “MOBILE GAS AND CHEMICAL IMAGING CAMERA;” and of U.S. Provisional Patent Application No. 62/082,613, filed Nov. 20, 2014, titled “MOBILE GAS AND CHEMICAL IMAGING CAMERA.” The disclosure of each of the above identified provisional patent applications is incorporated by reference herein in its entirety.
- The present application claims benefit under 35 U.S.C. §119(e) of U.S. Provisional Patent Application No. 62/021,636, filed Jul. 7, 2014, titled “GAS LEAK EMISSION QUANTIFICATION WITH A GAS CLOUD IMAGER;” of U.S. Provisional Patent Application No. 62/021,907, filed Jul. 8, 2014, titled “GAS LEAK EMISSION QUANTIFICATION WITH A GAS CLOUD IMAGER;” and of U.S. Provisional Patent Application No. 62/083,131, filed Nov. 21, 2014, titled “GAS LEAK EMISSION QUANTIFICATION WITH A GAS CLOUD IMAGER.” The disclosure of each of the above identified provisional patent applications is incorporated by reference herein in its entirety.
- The present disclosure generally relates to a system and method for gas cloud detection and, in particular, to a system and method of detecting spectral signatures of chemical compositions in a mid- and long-wave infrared spectral region.
- Spectral imaging systems and methods have applications in a variety of fields. Spectral imaging systems and methods obtain a spectral image of a scene in one or more regions of the electromagnetic spectrum to detect phenomena, identify material compositions or characterize processes. The spectral image of the scene can be represented as a three-dimensional data cube where two axes of the cube represent two spatial dimensions of the scene and a third axes of the data cube represents spectral information of the scene in different wavelength regions. The data cube can be processed using mathematical methods to obtain information about the scene. Some of the existing spectral imaging systems generate the data cube by scanning the scene in the spatial domain (e.g., by moving a slit across the horizontal dimensions of the scene) and/or spectral domain (e.g., by scanning a wavelength dispersive element to obtain images of the scene in different spectral regions). Such scanning approaches acquire only a portion of the full data cube at a time. These portions of the full data cube are stored and then later processed to generate a full data cube.
- The systems, methods and devices of this disclosure each have several innovative aspects, no single one of which is solely responsible for the desirable attributes disclosed herein.
- Various embodiments of the systems described herein provide an infrared (IR) imaging system for determining a concentration of a target chemical species in an object (e.g., a gas plume). The imaging system includes (i) an optical system, having an optical focal plane array (FPA) unit configured to receive IR radiation from the object along at least two or more optical channels defined by components of the optical system, the at least two or more optical channels being spatially and spectrally different from one another; and (ii) a processor or processing electronics configured to acquire multispectral optical data representing said target chemical species from the received IR radiation in a single occurrence of data acquisition (or snapshot). The optical FPA unit includes an array of photo-sensitive devices that are disposed at the focus of one or more lenses. In various embodiments, the array of photo-sensitive devices can include a two-dimensional imaging sensor that is sensitive to radiation having wavelengths between 1 μm and 20 μm (for example, in mid infra-red wavelength range, long infra-red wavelength range, visible wavelength range, etc.). In various embodiments, the array of photo-sensitive devices can include CCD or CMOS sensors, bolometers or other detectors that are sensitive to infra-red radiation. The optical system may include an optical aperture (a boundary of which is defined to circumscribe or encompass the at least two or more spatially distinct optical channels) and one or more optical filters. In various implementations, the one or more optical filters can comprise at least two spectrally-multiplexed filters. Each of these optical filters can be associated with one of the at least two or more optical channels and configured to transmit a portion of the IR radiation received in the associated optical channel. In various embodiments, the one or more optical filters can be spectrally multiplexed and may include, for example, at least one of a longpass optical filter and a shortpass optical filter, or a band pass filter (with or without a combination with another filter such as a notch filter, for example). The optical system may further include at least two imaging lenses. The at least two imaging lenses, for example each of the imaging lens, may be disposed to transmit IR radiation (for example, between about 1 micron and about 20 microns), that has been transmitted through a corresponding optical filter towards the optical FPA unit. In one embodiment, the optical FPA unit is positioned to receive IR radiation from the object through the at least two imaging lenses to form respectively-corresponding two or more sets of imaging data representing the object. The processor or processing electronics is configured to acquire this optical data from the two or more sets of imaging data. In various embodiments of the imaging systems, the FPA unit may be devoid of cooling systems. In various embodiments, two or more of the array of photo-sensitive devices may be uncooled. In some embodiments, the system further comprises two or more temperature-controlled shutters removably positioned to block IR radiation incident onto the optical system from the object.
- Also disclosed herein is an implementation of a method of operating an infrared (IR) imaging system. The method includes receiving IR radiation from an object through at least two optical channels defined by components of an optical system of the IR imaging system, which at least two optical channels are spatially and spectrally different from one another. The method further includes transmitting the received IR radiation towards an optical focal plane array (FPA) unit that is not being cooled in the course of normal operation. For example, in various embodiments of the imaging systems, the FPA unit may be devoid of cooling systems. In various embodiments, two or more of the array of photo-sensitive devices may be uncooled. Some embodiments further comprise removably positioning at least one of at least two temperature-controlled shutters in front of the optical system to block IR radiation incident onto the optical system from the object.
- Various innovative aspects of the subject matter described in this disclosure can be implemented in the following embodiments:
- An infrared (IR) imaging system, the imaging system comprising:
-
- a plurality of cameras;
- at least one thermal reference source having a known temperature placed in front of the plurality of cameras and configured to be imaged by the plurality of cameras; and
- a data-processing unit comprising a processor, the imaging system configured to:
- acquire with the plurality of cameras a plurality of frames having regions that correspond to the image of the reference source; and
- apply a dynamic calibration correction to the plurality of cameras to allow every camera in the plurality of cameras to be calibrated to agree with every other camera in the plurality imaging the reference source.
- The system of
Embodiment 1, wherein the plurality of cameras comprises a FPA unit and a plurality of lenses. - The system of any of Embodiments 1-2, wherein the FPA unit comprises one FPA or a plurality of FPAs.
- The system of any of Embodiments 1-3, wherein the at least one thermal reference source has a known spectrum.
- The system of any of Embodiments 1-4, further comprising an additional thermal reference source imaged by the plurality of cameras.
- The system of any of Embodiments 1-5, wherein the additional reference source has a temperature and a spectrum different from the known temperature and the known spectrum of the at least one reference source.
- The system of any of Embodiments 1-6, wherein the temperature of the additional thermal reference source is less than the known temperature.
- The system of any of Embodiments 1-7, wherein the temperature of the additional thermal reference source is greater than the known temperature.
- The system of any of Embodiments 1-8, wherein the at least one reference source is displaced away from a conjugate image plane of the plurality of cameras such that the image of the at least one reference source captured by the plurality of cameras is blurred.
- The system of any of Embodiments 1-9, wherein the at least one reference source is positioned at a conjugate image plane of the plurality of cameras.
- The system of any of Embodiments 1-10, further comprising a plurality of mirrors configured to image the at least one reference source onto the plurality of cameras.
- The system of any of Embodiments 1-11, wherein the plurality of mirrors are disposed outside a central field of view of the plurality of cameras.
- The system of any of Embodiments 1-12, further comprising a first and a second temperature-controlled shutter removably positioned to block IR radiation incident on the system from reaching the plurality of cameras.
- The system of any of Embodiments 1-13, wherein the system includes at least two spatially and spectrally different optical channels.
- The system of any of Embodiments 1-14, wherein the system includes at least three optical channels.
- The system of any of Embodiments 1-15, wherein the system includes at least four optical channels.
- The system of any of Embodiments 1-16, wherein the system includes at least five optical channels.
- The system of any of Embodiments 1-17, wherein the system includes at least six optical channels.
- The system of any of Embodiments 1-18, wherein the system includes at least seven optical channels.
- The system of any of Embodiments 1-19, wherein the system includes at least eight optical channels.
- The system of any of Embodiments 1-20, wherein the system includes at least nine optical channels.
- The system of any of Embodiments 1-21, wherein the system includes at least ten optical channels.
- The system of any of Embodiments 1-22, wherein the system includes at least twelve optical channels.
- The system of any of Embodiments 1-23, further comprising one or more sensors configured to measure a temperature of the at least one reference source.
- The system of any of Embodiments 1-24, wherein the plurality of cameras is configured to image the same portion of the at least one reference source.
- An infrared (IR) imaging system, the imaging system comprising:
-
- a plurality of cameras;
- a first temperature-controlled reference source imaged by the plurality of cameras;
- a second temperature-controlled reference source imaged by the plurality of cameras; and
- a data-processing unit comprising a processor, said data-processing unit configured to:
- acquire with the plurality of cameras a plurality of frames having regions that correspond to the image of the reference source; and
- dynamically calibrate the plurality of cameras so that various cameras imaging a scene are forced to agree on a temperature estimate of the first and second reference sources.
- The imaging system of any of
Embodiment 26, wherein the data-processing unit is configured to calculate a dynamic calibration correction and apply the correction to the plurality of cameras for each of the plurality of frames. - The system of any of Embodiments 26-27, wherein the first reference source is maintained at a first temperature.
- The system of any of Embodiments 26-28, wherein the second reference source is maintained at a second temperature.
- The system of any of Embodiments 26-29, wherein the first temperature is greater than the second temperature.
- The system of any of Embodiments 26-30, wherein the first temperature is less than the second temperature.
- The system of any of Embodiments 26-31, wherein the first and the second reference sources are displaced away from a conjugate image plane of the plurality of cameras such that the image of the first and the second reference sources captured by the plurality of cameras is blurred.
- The system of any of Embodiments 26-32, wherein the first and the second reference sources are positioned at a conjugate image plane of the plurality of cameras.
- The system of any of Embodiments 26-33, further comprising:
-
- a first mirror configured to image the first reference onto the plurality of cameras; and
- a second mirror configured to image the second reference source onto the plurality of cameras.
- The system of any of Embodiments 26-34, further comprising a first and a second temperature-controlled shutter removably positioned to block IR radiation incident on the system from reaching the plurality of cameras.
- The system of any of Embodiments 26-35, wherein the system includes at least two spatially and spectrally different optical channels.
- The system of any of Embodiments 26-36, wherein the system includes at least four optical channels.
- The system of any of Embodiments 26-37, wherein the system includes at least six optical channels.
- The system of any of Embodiments 26-38, wherein the system includes at least eight optical channels.
- The system of any of Embodiments 26-39, wherein the system includes at least ten optical channels.
- The system of any of Embodiments 26-40, wherein the system includes at least twelve optical channels.
- The system of any of Embodiments 26-41, further comprising one or more sensors configured to measure a temperature of the first or the second reference source.
- The system of any of Embodiments 26-42, wherein the plurality of cameras is configured to image the same portion of the first reference source and wherein plurality of cameras is configured to image the same portion of the second reference source.
- An infrared (IR) imaging system, the imaging system comprising:
-
- a plurality of cameras;
- a reference having an unknown temperature configured to be imaged by the plurality of cameras; and
- a data-processing unit comprising a processor, the imaging system configured to:
- acquire with the plurality of cameras a plurality of frames having regions that correspond to the image of the reference;
- calculate a dynamic calibration correction using a temperature measured by one of the cameras in the plurality of cameras as a reference temperature; and
- apply the calibration correction to the other cameras in the plurality of cameras to match the temperature estimate of the other cameras in the plurality of cameras with the reference temperature.
- The system of any of Embodiment 44, wherein the reference is displaced away from a conjugate image plane of the plurality of cameras such that the image of the reference source captured by the plurality of cameras is blurred.
- The system of any of Embodiments 44-45, wherein the reference is positioned at a conjugate image plane of the plurality of cameras.
- The system of any of Embodiments 44-46, further comprising a plurality of mirrors configured to image the reference onto the plurality of cameras.
- The system of any of Embodiments 44-47, further comprising a first and a second temperature-controlled shutter removably positioned to block IR radiation incident on the system from reaching the plurality of cameras.
- The system of any of Embodiments 44-48, wherein the system includes at least two spatially and spectrally different optical channels.
- The system of any of Embodiments 44-49, wherein the system includes at least three optical channels.
- The system of any of Embodiments 44-50, wherein the system includes at least four optical channels.
- The system of any of Embodiments 44-51, wherein the system includes at least five optical channels.
- The system of any of Embodiments 44-52, wherein the system includes at least six optical channels.
- The system of any of Embodiments 44-52, wherein the system includes at least seven optical channels.
- The system of any of Embodiments 44-53, wherein the system includes at least eight optical channels.
- The system of any of Embodiments 44-54, wherein the system includes at least nine optical channels.
- The system of any of Embodiments 44-55, wherein the system includes at least ten optical channels.
- The system of any of Embodiments 44-56, wherein the system includes at least twelve optical channels.
- The system of any of Embodiments 44-57, wherein the plurality of cameras is configured to image the same portion of the reference.
- An infrared (IR) imaging system, the imaging system comprising:
-
- an optical system including an optical focal plane array (FPA) unit, the optical system includes components associated with at least two optical channels, said at least two optical channels being spatially and spectrally different from one another, each of the at least two optical channels positioned to transfer IR radiation incident on the optical system towards the optical FPA unit, the optical FPA unit comprising at least two detector arrays disposed at a distance from two corresponding focusing lenses;
- at least one thermal reference having a known temperature, wherein radiation emitted from the at least one reference is directed towards the optical FPA unit and imaged by the at least two detector arrays; and
- a data-processing unit, said data-processing unit configured to:
- acquire a plurality of frames with the at least two detector arrays having regions in the plurality of image frames that correspond to the image of the reference; and
- dynamically calibrate the at least two detector arrays to address a difference in the temperature estimate of the reference between the two detector arrays.
- The system of any of Embodiment 60, wherein the at least one thermal reference has a known spectrum.
- The system of any of Embodiments 60-61, further comprising an additional thermal reference, wherein radiation from the additional reference is directed towards the optical FPA unit and imaged by the at least two detector arrays.
- The system of any of Embodiments 60-62, wherein the additional reference has a temperature and a spectrum different from the known temperature and the known spectrum of the at least one reference source.
- The system of any of Embodiments 60-63, wherein the temperature of the additional thermal reference is less than the known temperature.
- The system of any of Embodiments 60-64, wherein the temperature of the additional thermal reference is greater than the known temperature.
- The system of any of Embodiments 60-65, wherein the at least one reference is displaced away from a conjugate image plane of the at least two detector arrays such that the image of the at least one reference captured by the at least two detector arrays is defocused.
- The system of any of Embodiments 60-66, wherein the at least one reference is positioned at a conjugate image plane of the at least two detector arrays such that the image of the at least one reference captured by the at least two detector arrays is focused.
- The system of any of Embodiments 60-67, further comprising at least two reflecting elements configured to direct radiation from the at least one reference source toward the at least two detector arrays.
- The system of any of Embodiments 60-68, wherein the at least two reflecting elements are disposed outside a central field of view of the at least two detector arrays.
- The system of any of Embodiments 60-69, further comprising a third detector array disposed between the at least two detector arrays.
- The system of any of Embodiments 60-70, wherein the data-processing unit is configured to:
-
- acquire a plurality of frames using the third detector array; and
- dynamically calibrate the third detector array to match a temperature estimate of the third detector array with the temperature estimates of the at least two detector arrays.
- The system of any of Embodiments 60-71, wherein radiation emitted from the at least one reference source is not imaged by the third detector array.
- The system of any of Embodiments 60-72, wherein the third detector array has a field of view greater than a field of view of the at least two detector arrays.
- The system of any of Embodiments 60-73, wherein the at least one reference is imaged by the third detector array.
- The system of any of Embodiments 60-74, further comprising a third reflecting element disposed outside the field of view of the at least two detector arrays and configured to image the at least one reference onto the third detector array.
- The system of any of Embodiments 60-75, further comprising a first and a second temperature-controlled element removably positioned to block IR radiation incident on the optical system from reaching the optical FPA unit.
- The system of any of Embodiments 60-76, wherein the optical system includes components associated with three optical channels.
- The system of any of Embodiments 60-77 wherein the optical system includes components associated with four optical channels.
- The system of any of Embodiments 60-78, wherein the optical system includes components associated with six optical channels.
- The system of any of Embodiments 60-79, wherein the optical system includes components associated with eight optical channels.
- The system of any of Embodiments 60-80, wherein the optical system includes components associated with ten optical channels.
- The system of any of Embodiments 60-81, wherein the optical system includes components associated with twelve optical channels.
- The system of any of Embodiments 60-82, wherein the optical system includes components associated with sixteen optical channels.
- The system of any of Embodiments 60-83, wherein the optical system includes components associated with twenty four optical channels.
- The system of any of Embodiments 60-84, wherein each of the at least two detector arrays is configured to image the same portion of the at least one reference so as to consistently provide a common reference temperature.
- The system of any of Embodiments 60-85, wherein the data-processing unit comprises processing electronics.
- The system of any of Embodiments 60-86, wherein the data-processing unit comprises a processor.
- The system of any of Embodiments 60-87, wherein the data-processing unit comprises one or more processors.
- An infrared (IR) imaging system, the imaging system comprising:
-
- an optical system including an optical focal plane array (FPA) unit, the optical system including at least two optical channels, said at least two optical channels being spatially and spectrally different from one another, each of the at least two optical channels positioned to transfer IR radiation incident on the optical system towards the optical FPA unit, the optical FPA unit comprising at least two detector arrays disposed at a distance from two corresponding focusing lenses;
- a first temperature-controlled reference imaged by the at least two detector arrays;
- a second temperature-controlled reference imaged by the at least two detector arrays; and
- a data-processing unit configured to:
- acquire a plurality of frames with the at least two detector arrays having regions in the plurality of image frames that correspond to the image of the first and second references; and
- dynamically calibrate the at least two detector arrays to address a difference in a temperature estimate of the first and second references between the two detector arrays.
- The system of Embodiment 89, wherein the first reference is maintained at a first temperature.
- The system of any of Embodiments 89-90, wherein the second reference is maintained at a second temperature.
- The system of any of Embodiments 89-91, wherein the first temperature is greater than the second temperature.
- The system of any of Embodiments 89-92, wherein the first temperature is less than the second temperature.
- The system of any of Embodiments 89-93, wherein the first and the second references are displaced away from a conjugate image plane of the at least two detector arrays such that the image of the first and the second references captured by the at least two detector arrays is defocused.
- The system of any of Embodiments 89-94, wherein the first and the second references are positioned at a conjugate image plane of the at least two detector arrays such that the image of the first and the second references captured by the at least two detector arrays is focused.
- The system of any of Embodiments 89-95, further comprising:
-
- a first reflecting element configured to direct radiation from the first reference toward the at least two detector arrays; and
- a second reflecting element configured to direct radiation from the second reference toward the at least two detector arrays.
- The system of any of Embodiments 89-96, wherein the first reflecting element is disposed outside a field of view of the at least two detector arrays.
- The system of any of Embodiments 89-97, wherein the second reflecting element is disposed outside a field of view of the at least two detector arrays.
- The system of any of Embodiments 89-98, further comprising a third detector array disposed between the at least two detector arrays.
- The system of any of Embodiments 89-99, wherein the data-processing unit is configured to:
-
- acquire a plurality of frames using the third detector array; and
- dynamically calibrate the third detector array to address a difference in the temperature estimate of the first and second references between the third detector array and the two detector arrays.
- The system of any of Embodiments 89-100, wherein the first and second references are not imaged by the third detector array.
- The system of any of Embodiments 89-101, wherein the third detector array has a field of view greater than a field of view of the at least two detector arrays.
- The system of any of Embodiments 89-102, wherein r first and second references are imaged by the third detector array.
- The system of any of Embodiments 89-103, further comprising a third reflecting element disposed outside the field of view of the at least two detector arrays and configured to image the first and second references onto the third detector array.
- The system of any of Embodiments 89-104, further comprising a first and a second temperature-controlled element removably positioned to block IR radiation incident on the optical system from reaching the optical FPA unit.
- The system of any of Embodiments 89-105, wherein the optical system includes components associated with three optical channels.
- The system of any of Embodiments 89-106, wherein the optical system includes components associated with four optical channels.
- The system of any of Embodiments 89-107, wherein the optical system includes components associated with five optical channels.
- The system of any of Embodiments 89-108, wherein the optical system includes components associated with six optical channels.
- The system of any of Embodiments 89-109, wherein the optical system includes components associated with seven optical channels.
- The system of any of Embodiments 89-110, wherein the optical system includes components associated with eight optical channels.
- The system of any of Embodiments 89-111, wherein the optical system includes components associated with ten optical channels.
- The system of any of Embodiments 89-112, wherein the optical system includes components associated with twelve optical channels.
- The system of any of Embodiments 89-113, wherein each of the at least two detector arrays is configured to image the same portion of the first reference source so as to consistently provide a common first reference temperature and wherein each of the at least two detector arrays is configured to image the same portion of the second reference source so as to consistently provide a common second reference temperature.
- The system of any of Embodiments 89-114, further comprising a temperature controller configured to control the temperature of the first or second reference.
- The system of any of Embodiments 89-115, further comprising one or more sensors configured to measure a temperature of the first or the second reference.
- The system of any of Embodiments 89-116, wherein the one or more sensors are configured to communicate the measured temperature of the first or the second reference to a temperature controller.
- The system of any of Embodiments 89-117, wherein the one or more sensors are configured to communicate the measured temperature of the first or the second reference to the data-processing unit.
- The system of any of Embodiments 89-118, wherein the first or the second reference is associated with a heater.
- The system of any of Embodiments 89-119, wherein the first or the second reference is associated with a cooler.
- The system of any of Embodiments 89-120, wherein the data-processing unit comprises processing electronics.
- The system of any of Embodiments 89-121, wherein the data-processing unit comprises a processor.
- The system of any of Embodiments 89-122, wherein the data-processing unit comprises one or more processors.
- An infrared (IR) imaging system, the imaging system comprising:
-
- an optical system including components associated with at least two optical channels, said at least two optical channels being spectrally different from one another, each of the at least two optical channels positioned to transfer IR radiation incident on the optical system towards a plurality of cameras;
- at least one calibration surface with unknown temperature and imaged by each of the plurality of cameras; and
- a data-processing unit configured to:
- acquire a plurality of image frames with the plurality of cameras including the imaged surface; and
- adjust one or more parameters of the cameras in the plurality of cameras such that a temperature estimate of the calibration surface of the cameras in the plurality of cameras agree with each other.
- The system of
Embodiment 124, wherein the one or more parameters is associated with a gain of the cameras in the plurality of cameras. - The system of any of Embodiments 124-125, wherein the one or more parameters is associated with a gain offset of the cameras in the plurality of cameras.
- The system of any of Embodiments 124-126, wherein the calibration surface is displaced away from a conjugate image plane of the plurality of cameras such that an image of the surface is defocused.
- The system of any of Embodiments 124-127, wherein the calibration surface is positioned at a conjugate image plane of the plurality of cameras such that an image of the surface is focused.
- The system of any of Embodiments 124-128, further comprising at least one reflecting element configured to image the surface onto the plurality of cameras.
- The system of any of Embodiments 124-129, further comprising a first and a second temperature-controlled element removably positioned to block IR radiation incident on the optical system from reaching the plurality of cameras.
- The system of any of Embodiments 124-130, wherein the optical system includes components associated with three optical channels.
- The system of any of Embodiments 124-131, wherein the optical system includes components associated with four optical channels.
- The system of any of Embodiments 124-132, wherein the optical system includes components associated with six optical channels.
- The system of any of Embodiments 124-133, wherein the optical system includes components associated with eight optical channels.
- The system of any of Embodiments 124-134, wherein the optical system includes components associated with ten optical channels.
- The system of any of Embodiments 124-135, wherein the optical system includes components associated with twelve optical channels.
- The system of any of Embodiments 124-136, wherein the data-processing unit comprises processing electronics.
- The system of any of Embodiments 124-137, wherein the data-processing unit comprises a processor.
- The system of any of Embodiments 124-138, wherein the data-processing unit comprises one or more processors.
- The system of any of Embodiments 124-139, wherein the calibration surface comprises a sidewall of a housing of the system.
- An infrared (IR) imaging system, the imaging system comprising:
-
- at least four spatially and spectrally different optical channels configured to receive IR radiation from a common object, each of the at least four spatially and spectrally different optical channels comprising at least one imaging lens configured to image the object on a Focal Plane Array (FPA) unit; and
- processing electronics in communication with the FPA unit,
- wherein said infrared system is configured to:
- acquire multispectral optical data from the at least four different optical channels; and
- process the multispectral optical data to detect one or more target species present in the object.
- The system of Embodiment 141, further comprising twelve optical channels.
- The system of any of Embodiments 141-142, configured to simultaneously acquire multispectral optical data from the at least four different optical channels.
- The system of any of Embodiments 141-143, further comprising a plurality of optical filters associated with the optical channels.
- The system of any of Embodiments 141-144, wherein a number of optical filters is two.
- The system of any of Embodiments 141-145, wherein a number of optical filters is three.
- The system of any of Embodiments 141-146, wherein a number of optical filters is four.
- The system of any of Embodiments 141-147, wherein the plurality of optical filters comprise at least one long pass (LP) filter.
- The system of any of Embodiments 141-148, wherein the plurality of optical filters comprise multiple long pass (LP) filters.
- The system of any of Embodiments 141-149, wherein the plurality of optical filters comprise at least one short pass (SP) filter.
- The system of any of Embodiments 141-150, wherein the plurality of optical filters comprise multiple short pass (SP) filters.
- The system of any of Embodiments 141-151, wherein the plurality of optical filters comprise at least one band pass (BP) filter.
- The system of any of Embodiments 141-152, wherein the plurality of optical filters comprise at one short pass (SP) filter and one long pass (LP) filter.
- The system of any of Embodiments 141-153, wherein the FPA unit comprises a plurality of FPAs.
- The system of any of Embodiments 141-154, further comprising first and second temperature-controlled elements removably positioned to block IR radiation incident on the imaging system from reaching the FPA unit.
- The system of any of Embodiments 141-155, further comprising a field reference configured for dynamically calibrating a plurality of the FPAs in the FPA unit.
- The system of any of Embodiments 141-156, wherein the field reference is configured to obscure a peripheral region of an image generated by a plurality of the FPAs in the FPA unit.
- The system of any of Embodiments 141-157, configured to compare spectral data in at least one of the four optical channels acquired at a first instant of time with spectral data in the at least one of the four optical channels acquired at a second instant of time to generate a temporal difference image.
- The system of any of Embodiments 141-158, configured to use a difference between the multispectral optical data acquired by the two optical channels to correct parallax-induced imaging errors.
- The system of any of Embodiments 141-159, configured to use a difference between the multispectral optical data acquired by the two optical channels to estimate a distance between the system and the object.
- The system of any of Embodiments 141-160, configured to estimate a size of the object based on the estimated distance and an optical magnification factor of the two optical channels.
- The system of any of Embodiments 141-161, configured to compare spectral data in one of the at least four optical channels with spectral data in another one of the at least four optical channels to generate a spectral difference image.
- The system of any of Embodiments 141-162, further comprising a visible light imaging sensor.
- The system of any of Embodiments 141-163, configured to use the visible light imaging sensor to compensate for motion-induced imaging errors.
- The system of any of Embodiments 141-164, configured to process the multispectral optical data by cross-correlating multispectral optical data from at least one of the optical channels with a reference spectrum.
- The system of any of Embodiments 141-165, configured to process the multispectral optical data using spectral unmixing.
- The system of any of Embodiments 141-166, further comprising five optical channels.
- The system of any of Embodiments 141-167, further comprising six optical channels.
- The system of any of Embodiments 141-168, further comprising seven optical channels.
- The system of any of Embodiments 141-169, further comprising eight optical channels.
- The system of any of Embodiments 141-170, further comprising nine optical channels.
- The system of any of Embodiments 141-171, further comprising ten optical channels.
- The system of any of Embodiments 141-172, further comprising eleven optical channels.
- The system of any of Embodiments 141-173, wherein a number of optical filters is five.
- The system of any of Embodiments 141-174, wherein a number of optical filters is six.
- The system of any of Embodiments 141-175, wherein a number of optical filters is seven.
- The system of any of Embodiments 141-176, wherein a number of optical filters is eight.
- The system of any of Embodiments 141-177, wherein a number of optical filters is nine.
- The system of any of Embodiments 141-178, wherein a number of optical filters is ten.
- The system of any of Embodiments 141-179, wherein a number of optical filters is eleven.
- The system of any of Embodiments 141-180, wherein a number of optical filters is twelve.
- The system of any of Embodiments 141-181, wherein the processing electronics comprises one or more processors.
- The system of any of Embodiments 141-182, further comprising a thermal reference configured to be imaged onto the FPA unit such that a plurality of frames of the acquired multispectral optical data has an image of the thermal reference source.
- The system of any of Embodiments 141-183, wherein the thermal reference has a known temperature.
- The system of any of Embodiments 141-184, wherein the thermal reference is a temperature-controlled reference source.
- The system of any of Embodiments 141-185, wherein the temperature-controlled reference source includes a heater.
- The system of any of Embodiments 141-186, wherein the temperature-controlled reference source includes a cooler.
- The system of any of Embodiments 141-187, further comprising a mirror configured to image the thermal reference onto the FPA unit.
- The system of any of Embodiments 141-188, wherein a temperature of the thermal reference is unknown.
- The system of any of Embodiments 141-189, wherein the thermal reference is a surface.
- The system of any of Embodiments 141-190, wherein the surface comprises a wall of a housing of the system.
- The system of any of Embodiments 141-191, wherein different optical channels receive IR radiation from the same portion of the thermal reference so as to consistently provide a common reference temperature.
- The system of any of Embodiments 141-192, wherein a temperature of the same portion of the thermal reference is unknown.
- The system of any of Embodiments 141-193, configured to acquire the multispectral optical data at a frame rate between about 5 Hz to about 200 Hz.
- The system of any of Embodiments 141-194, wherein one or more of the at least four optical channels is configured to collect IR radiation to provide spectral data corresponding to a discrete spectral band located in the wavelength range between about 7.9 μm and about 8.4 μm.
- The system of any of Embodiments 141-195, wherein each optical channel is configured to transfer spectrally distinct, two-dimensional image data of the common object to one or more imaging sensors.
- The system of any of Embodiments 1-24, wherein the one or more sensors are configured to communicate the measured temperature of the at least one reference source to a temperature controller.
- The system of any of Embodiments 1-24, wherein the one or more sensors are configured to communicate the measured temperature of the at least one reference source to the data-processing unit.
- The system of any of Embodiments 26-42, wherein the one or more sensors are configured to communicate measured temperature of the first or the second reference to a temperature controller.
- The system of any of Embodiments 26-42, wherein the one or more sensors are configured communicate the measured temperature of the first or the second reference to the data-processing unit.
- An infrared (IR) imaging system for imaging a target species in an object, the imaging system comprising:
-
- an optical system comprising an optical focal plane array (FPA) unit and defining a plurality of spatially and spectrally different optical channels to transfer IR radiation towards the optical FPA unit, each optical channel positioned to transfer a portion of the IR radiation incident on the optical system from the object towards the optical FPA unit; and
- a programmable processor configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium, to acquire, in a single occurrence of data acquisition, multispectral optical data representing in spatial (x, y) and spectral (λ) coordinates said object and said target species from the IR radiation received at the optical FPA unit.
- The system of
Embodiment 200, wherein the multispectral data comprises a number of spectrally different images of the object obtained from IR image data transferred to the optical FPA unit by a corresponding optical channel. - The system of any of Embodiments 200-201, further comprising an optical filter corresponding to a particular optical channel and configured to transmit the portion of IR radiation towards the optical FPA unit.
- The system of any of Embodiments 200-202, wherein the optical filter includes one of a longpass optical filter and a shortpass optical filter.
- The system of any of Embodiments 200-203, further comprising one or more front objective lenses.
- The system of any of Embodiments 200-204, wherein the optical system comprises a plurality of lenses, each lens corresponding to an optical channel.
- The system of any of Embodiments 200-205, wherein each optical channel is defined at least in part by a corresponding filter and a corresponding lens.
- The system of any of Embodiments 200-206, wherein the plurality of lenses comprises a lens array.
- The system of any of Embodiments 200-207, further comprising a plurality of relay lenses configured to relay the IR radiation along the optical channels.
- The system of any of Embodiments 200-208, further comprising a plurality of moveable temperature-controlled reference source removably positioned to block IR radiation incident onto the optical system from reaching the optical FPA unit.
- The system of any of Embodiments 200-209, wherein the multispectral optical data from the plurality of optical channels is captured substantially simultaneously by the optical FPA unit.
- The system of any of Embodiments 200-210, wherein the multispectral optical data from the plurality of optical channels is captured during one image frame acquisition by the optical FPA unit.
- The system of any of Embodiments 200-211, further comprising first and second temperature-controlled moveable shutters removably positioned to block IR radiation incident onto the optical system from reaching the optical FPA unit.
- The system of any of Embodiments 200-212, wherein the optical FPA unit is devoid of a cooling device.
- The system of any of Embodiments 200-213, further comprising a filter array.
- The system of any of Embodiments 200-214, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to acquire said optical data from the two or more sets of imaging data.
- The system of any of Embodiments 200-215, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process the acquired optical data to compensate for at least one of (i) parallax-induced differences between the two or more sets of imaging data and (ii) difference between the two or more sets of imaging data induced by changes in the object that are not associated with the target species.
- The system of any of Embodiments 200-216, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process the acquired optical data to generate a temporal reference image.
- The system of any of Embodiments 200-217, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to use the temporal reference image to generate a temporal difference image.
- The system of any of Embodiments 200-218, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process the acquired optical data to estimate a volume of a gas cloud.
- The system of any of Embodiments 200-219, wherein IR radiation measured at a pixel comprises a spectrum comprising a sum of component spectra, and wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to unmix the spectrum.
- The system of any of Embodiments 200-220, wherein the optical FPA unit includes a bolometer configured to operate without being cooled.
- The system of any of Embodiments 200-221, further comprising a field reference for dynamically adjusting data output from the optical FPA unit.
- The system of any of Embodiments 200-222, wherein the field reference comprises an array of field stops.
- The system of any of Embodiments 200-223, wherein the field reference comprises a uniform temperature across its surface.
- The system of any of Embodiments 200-224, wherein the field reference is adapted to obscure or block a peripheral portion of the IR radiation propagating from the object towards the optical FPA unit.
- The system of any of Embodiments 200-225, further comprising a visible light imaging sensor.
- The system of any of Embodiments 200-226, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process data received from an imaging sensor to compensate for motion-induced imaging errors.
- The system of any of Embodiments 200-227, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to process data received from the visible light imaging sensor to compensate for motion-induced imaging errors.
- The system of any of Embodiments 200-228, wherein the processor is configured to execute instructions stored in a tangible, non-transitory computer-readable storage medium to construct, in the single occurrence of data acquisition, a multispectral data cube of the object, the multispectral data cube comprising a number of spectrally different images of the object, each spectrally different image comprising IR image data transferred to the optical FPA unit by a corresponding optical channel.
- The system of any of Embodiments 200-229, wherein the portion of the IR radiation corresponds to a region of wavelengths of the spectrum of wavelengths, the region of wavelengths at least partially overlapping another region of wavelengths transferred by another optical channel.
- An infrared (IR) imaging system, the imaging system comprising:
-
- a plurality of spatially and spectrally different optical channels, at least some of the plurality of optical channels configured to receive IR radiation from a common object, each of the plurality of spatially and spectrally different optical channels comprising at least one imaging lens configured to image the object on a Focal Plane Array (FPA) unit; and
- processing electronics in communication with the FPA unit,
- wherein said infrared system is configured to:
- acquire multispectral optical data from the plurality of different optical channels; and
- process the multispectral optical data to detect one or more target species present in the object, and
- wherein the system is further configured to compare spectral data in at least one of the plurality of optical channels acquired at a first instant of time with spectral data in at least one of the plurality of optical channels acquired at a second instant of time to generate a temporal difference image.
- An infrared (IR) imaging system, the imaging system comprising:
-
- a plurality of spatially and spectrally different optical channels, at least some of the plurality of optical channels configured to receive IR radiation from a common object, each of the plurality of spatially and spectrally different optical channels comprising at least one imaging lens configured to image the object on a Focal Plane Array (FPA) unit; and
- processing electronics in communication with the FPA unit,
- wherein said infrared system is configured to:
- acquire multispectral optical data from the plurality of different optical channels; and
- process the multispectral optical data to detect one or more target species present in the object, and
- wherein the system is configured to use a difference between the multispectral optical data acquired by two optical channels to correct parallax-induced imaging errors.
- The system of Embodiment 231, wherein spectral characteristics of the two optical channels are identical.
- An infrared (IR) imaging system, the imaging system comprising:
-
- a plurality of spatially and spectrally different optical channels, at least some of the plurality of optical channels configured to receive IR radiation from a common object, each of the plurality of spatially and spectrally different optical channels comprising at least one imaging lens configured to image the object on a Focal Plane Array (FPA) unit; and
- processing electronics in communication with the FPA unit,
- wherein said infrared system is configured to:
- acquire multispectral optical data from the plurality of different optical channels; and
- process the multispectral optical data to detect one or more target species present in the object, and
- wherein the system is configured to use a difference between the multispectral optical data acquired by two optical channels to estimate a distance between the system and the object.
- The system of Embodiment 233, wherein spectral characteristics of the two optical channels are identical.
- An infrared (IR) imaging system, the imaging system comprising:
-
- a plurality of spatially and spectrally different optical, at least some of the plurality of optical channels configured to receive IR radiation from a common object, each of the plurality of spatially and spectrally different optical channels comprising at least one imaging lens configured to image the object on a Focal Plane Array (FPA) unit;
- a visible light imaging sensor; and
- processing electronics in communication with the FPA unit,
- wherein said infrared system is configured to:
- acquire multispectral optical data from the plurality of different optical channels; and
- process the multispectral optical data to detect one or more target species present in the object.
- An infrared (IR) imaging system, the imaging system comprising:
-
- a plurality of spatially and spectrally different optical, at least some of the plurality of optical channels configured to receive IR radiation from a common object, each of the plurality of spatially and spectrally different optical channels comprising at least one imaging lens configured to image the object on a Focal Plane Array (FPA) unit; and
- processing electronics in communication with the FPA unit,
- wherein said infrared system is configured to:
- acquire multispectral optical data from the plurality of different optical channels; and
- process the multispectral optical data to detect one or more target species present in the object, and
- wherein the system is configured to compensate for motion-induced imaging errors.
- An infrared (IR) imaging system, the imaging system comprising:
-
- a plurality of spatially and spectrally different, at least some of the plurality of optical channels configured to receive IR radiation from a common object, each of the plurality of spatially and spectrally different optical channels comprising at least one imaging lens configured to image the object on a Focal Plane Array (FPA) unit; and
- processing electronics in communication with the FPA unit,
- wherein said infrared system is configured to:
- acquire multispectral optical data from the plurality of different optical channels; and
- process the multispectral optical data to detect one or more target species present in the object by cross-correlating multispectral optical data from at least one of the optical channels with a reference spectrum.
- An infrared (IR) imaging system, the imaging system comprising:
-
- a plurality of spatially and spectrally different optical, at least some of the plurality of optical channels configured to receive IR radiation from a common object, each of the plurality of spatially and spectrally different optical channels comprising at least one imaging lens configured to image the object on a Focal Plane Array (FPA) unit; and
- processing electronics in communication with the FPA unit,
- wherein said infrared system is configured to:
- acquire multispectral optical data from the plurality of different optical channels; and
- process the multispectral optical data to detect one or more target species present in the object by using spectral unmixing.
- An infrared (IR) imaging system, the imaging system comprising:
-
- an optical system including an optical focal plane array (FPA) unit, the optical system includes components associated with at least two optical channels, said at least two optical channels being spatially and spectrally different from one another, each of the at least two optical channels positioned to transfer IR radiation incident on the optical system towards the optical FPA unit, the optical FPA unit comprising at least two detector arrays disposed at a distance from two corresponding focusing lenses;
- at least one thermal reference having a known temperature, wherein one of the at least two detector arrays is configured to image the at least one reference; and
- a data-processing unit, said data-processing unit configured to:
- acquire a plurality of frames with one of the at least two detector arrays having regions in the plurality of image frames that correspond to the image of the reference; and
- dynamically calibrate another of the at least two detector array to match a temperature estimate of another of the at least two detector array with the temperature estimate of one of the at least two detector array.
- The system of any of Embodiments 1-59, wherein the plurality of cameras are configured to acquire multispectral image data from an object continuously for a duration of time.
- The system of any of Embodiments 1-59, comprising at least two spectrally and spatially distinct optical channels configured to transfer two-dimensional image data of an object to the plurality of cameras.
- An infrared (IR) imaging system for imaging a scene, the imaging system comprising:
- an optical system comprising an optical focal plane array (FPA) unit including a plurality of spatially and spectrally different optical channels to transfer IR radiation from the scene towards the optical FPA unit, each optical channel positioned to transfer a portion of the IR radiation incident on the optical system from the scene towards the optical FPA unit,
- wherein at least one of the plurality of optical channels is in the mid-wavelength infrared spectral range and at least another one of the plurality of optical channels is in the long-wavelength infrared spectral range,
- wherein the imaging system is configured to acquire a first video image of the scene in the mid-wavelength infrared spectral range and a second video image of the scene in the long-wavelength infrared spectral range.
- The imaging system of Embodiment 242, wherein the at least one mid-wavelength optical channel comprises a cold stop filter.
- The imaging system of any of Embodiments 242-243, wherein the at least one mid-wavelength optical channel comprises filter having a pass-band in the mid-wavelength infrared spectral range.
- The imaging system of any of Embodiments 242-244, further comprising processing electronics configured to extract information from the first and second video image to detect presence of one or more chemical species in the scene.
- The imaging system of Embodiment 245, wherein the processing electronics are configured to compare the extracted information to one or more spectral information stored in a database.
- The imaging system of any of Embodiments 242-246, further comprising a feedback system configured to synchronize the first and the second video image.
- The imaging system of any of Embodiments 242-247, wherein the first and/or second video image has a frame rate between about 5 frames per second and about 120 frames per second.
- The imaging system of any of Embodiments 242-248, wherein the processing electronics are configured to extract information from the first and/or second video image on a frame by frame basis.
- The imaging system of any of Embodiments 242-249, wherein the processing electronics are configured to extract information from the first video and second video image and detect presence of one or more chemical species in the scene within 5 seconds from a time when imaging of the scene started.
- The imaging system of any of Embodiments 242-250, wherein the processing electronics are configured to extract information from the first video and second video image and detect presence of one or more chemical species in the scene within 1 second from a time when imaging of the scene started.
- The imaging system of any of Embodiments 242-251, wherein the processing electronics are configured to extract information from the first video and second video image and detect presence of one or more chemical species in the scene in sufficiently real time from a time when imaging of the scene started.
- The imaging system of any of Embodiments 242-252, wherein the one or more chemical species are selected from the group consisting of methane, cyclopropane, alkanes, alkenes, ammonia, freon, hydrogen cyanide, sulfur dioxide, and hydrogen sulfide.
- The imaging system of any of Embodiments 242-253, wherein the scene includes a moving gas plume.
- The imaging system of any of Embodiments 242-254, wherein the FPA unit includes at least one mid-wavelength infra-red FPA capable of detecting mid-wavelength infra-red radiation and at least one long-wavelength infra-red FPA capable of detecting long-wavelength infra-red radiation.
- The imaging system of Embodiment 255, wherein the at least one mid-wavelength infra-red FPA is cooled to a temperature below 200 degree Kelvin.
- The imaging system of Embodiment 256, wherein the at least one mid-wavelength infra-red FPA is cooled to a temperature between about 110 degree Kelvin and about 150 degree Kelvin.
- The imaging system of Embodiment 257, wherein the at least one mid-wavelength infra-red FPA is cooled to a temperature of about 135 degree Kelvin.
- The imaging system of any of Embodiments 255-258, wherein the at least one mid-wavelength infra-red FPA is coupled to a cooler.
- The imaging system of any of Embodiments Claims 255-259, wherein the at least one mid-wavelength infra-red FPA and the at least one long-wavelength infra-red FPA are configured to image one more reference sources.
- The imaging system of Embodiment 260, wherein each of the one more reference sources has a known temperature.
- The imaging system of any of Embodiments 242-261, wherein a number of the plurality of optical channels is at least 4.
- The imaging system of any of Embodiments 242-262, wherein a number of the plurality of optical channels is at least 5.
- The imaging system of any of Embodiments 242-263, wherein a number of the plurality of optical channels is at least 8.
- The imaging system of any of Embodiments 242-264, wherein a number of the plurality of optical channels is at least 9.
- The imaging system of any of Embodiments 242-265, wherein a number of the plurality of optical channels is at least 12.
- The imaging system of any of Embodiments 242-266, wherein a number of the plurality of optical channels is at least 13.
- The imaging system of any of Embodiments 242-267, wherein a number of the plurality of optical channels is at least 20.
- The imaging system of any of Embodiments 242-268, wherein a number of the plurality of optical channels is between 4 and 50.
- The imaging system of any of Embodiments 255-261, wherein at least one of the plurality of optical channels comprises a spectrally selective optical element configured to receive radiation from the scene and direct a portion of the radiation in the mid-wavelength infrared spectral range toward the mid-wavelength infra-red FPA and direct a portion of the radiation in the long-wavelength infrared spectral range toward the long-wavelength infra-red FPA.
- A method of detecting one or more chemical species in a scene, the method comprising:
- obtaining a first video image data of the scene in mid-wavelength infrared spectral range using a mid-wavelength infra-red FPA;
- obtaining a second video image data of the scene in long-wavelength infrared spectral range using a long-wavelength infra-red FPA;
- obtaining one or more spectra from the first and the second video image data; and comparing the obtained one or more spectra with one or more reference spectra stored in a database to detect one or more chemical species in the scene.
- The method of Embodiment 271, wherein the first and/or the second video image data has a frame rate between about 5 frames per second and about 60 frames per second.
- The method of any of Embodiments 270-272, wherein the one or more spectra are obtained using hyperspectral video analytics.
- The method of any of Embodiments 270-273, wherein the one or more spectra are obtained within 5 seconds from a time when imaging of the scene begins.
- The method of any of Embodiments 270-274, wherein the one or more spectra are obtained within 1 second from a time when imaging of the scene begins.
- The method of any of Embodiments 270-275, wherein the one or more spectra are obtained in sufficiently real time from a time when imaging of the scene begins.
- The method of any of Embodiments 270-276, wherein the one or more chemical species detected are selected from the group consisting of methane, cyclopropane, alkanes, alkenes, ammonia, freon, hydrogen cyanide sulfur dioxide, and hydrogen sulfide.
- The imaging system or method of any of Embodiments 242-277, wherein some of the plurality of spatially and spectrally distinct optical channels have a different field of view than some other of the plurality of spatially and spectrally distinct optical channels.
- The imaging system or method of any of Embodiments 242-277, wherein some of the plurality of spatially and spectrally distinct optical channels have a field of view that is lower than the field of view of the system.
- The imaging system or method of any of Embodiments 242-279, wherein at least two of the plurality of optical channels is in the long-wavelength infrared spectral range.
- The imaging system or method of any of Embodiments 242-279, wherein a number of optical channels in the long-wavelength infrared spectral range is less than 50.
- The imaging system or method of any of Embodiments 242-279, wherein at least two of the plurality of optical channels is in the mid-wavelength infrared spectral range.
- The imaging system or method of any of Embodiments 242-279, wherein a number of optical channels in the mid-wavelength infrared spectral range is less than 50.
- Details of one or more implementations of the subject matter described in this disclosure are set forth in the accompanying drawings and the description below. Other features, aspects, and advantages will become apparent from the description, the drawings and the claims. Note that the relative dimensions of the following figures may not be drawn to scale.
-
FIG. 1 shows an embodiment of an imaging system including a common front objective lens that has a pupil divided spectrally and re-imaged with a plurality of lenses onto an infrared FPA. -
FIG. 2 shows an embodiment with a divided front objective lens and an array of infrared sensing FPAs. -
FIG. 3A represents an embodiment employing an array of front objective lenses operably matched with the re-imaging lens array.FIG. 3B illustrates a two-dimensional array of optical components corresponding to the embodiment ofFIG. 3A . -
FIG. 4 is a diagram of the embodiment employing an array of field references (e.g., field stops that can be used as references for calibration) and an array of respectively corresponding relay lenses. -
FIG. 5A is a diagram of a 4-by-3 pupil array comprising circular optical filters (and IR blocking material between the optical filters) used to spectrally divide an optical wavefront imaged with an embodiment of the system. -
FIG. 5B is a diagram of a 4-by-3 pupil array comprising rectangular optical filters (and IR blocking material between the optical filters) used to spectrally divide an optical wavefront imaged with an embodiment of the system. -
FIG. 6A depicts theoretical plots of transmission characteristics of a combination of band-pass filters used with an embodiment of the system. -
FIG. 6B depicts theoretical plots of transmission characteristics of a spectrally multiplexed notch-pass filter combination used in an embodiment of the system. -
FIG. 6C shows theoretical plots of transmission characteristics of spectrally multiplexed long-pass filter combination used in an embodiment of the system. -
FIG. 6D shows theoretical plots of transmission characteristics of spectrally multiplexed short-pass filter combination used in an embodiment of the system. -
FIG. 7 is a set of video-frames illustrating operability of an embodiment of the system used for gas detection. -
FIGS. 8A and 8B are plots (on axes of wavelength in microns versus the object temperature in Celsius representing effective optical intensity of the object) illustrating results of dynamic calibration of an embodiment of the system. -
FIGS. 9A and 9B illustrate a cross-sectional view of different embodiments of an imaging system comprising an arrangement of reference sources and mirrors that can be used for dynamic calibration. -
FIGS. 10A-10C illustrate a plan view of different embodiments of an imaging system comprising an arrangement of reference sources and mirrors that can be used for dynamic calibration. -
FIGS. 11A, 12A and 13A illustrate a plan view of different detector arrays including at least one mid-wavelength infra-red spectral FPA and at least one long-wavelength infra-red spectral FPA. -
FIGS. 11B, 12B and 13B illustrate a side-view of the arrays illustrated inFIGS. 11A, 12A and 13A respectively. -
FIGS. 14A and 14B illustrate elements disposed in an optical path of an FPA. -
FIG. 15 provides a visual example of the roles of the MWIR and LWIR FPAs. -
FIG. 16 which shows the temporal variation in the amount of radiation detected by the MWIR FPAs and LWIR FPAs imaging a scene in which the sun emerges from behind a cloud for a certain interval of time and is covered by a cloud subsequently. - Like reference numbers and designations in the various drawings indicate like elements.
- The following description is directed to certain implementations for the purposes of describing the innovative aspects of this disclosure. However, a person having ordinary skill in the art will readily recognize that the teachings herein can be applied in a multitude of different ways. The described implementations may be implemented in any device, apparatus, or system that can be configured to operate as an imaging system such as in an infra-red imaging system. The methods and systems described herein can be included in or associated with a variety of devices such as, but not limited to devices used for visible and infrared spectroscopy, multispectral and hyperspectral imaging devices used in oil and gas exploration, refining, and transportation, agriculture, remote sensing, defense and homeland security, surveillance, astronomy, environmental monitoring, etc. The methods and systems described herein have applications in a variety of fields including but not limited to agriculture, biology, physics, chemistry, defense and homeland security, environment, oil and gas industry, etc. The teachings are not intended to be limited to the implementations depicted solely in the Figures, but instead have wide applicability as will be readily apparent to one having ordinary skill in the art.
- Various embodiments disclosed herein describe a divided-aperture infrared spectral imaging (DAISI) system that is structured and adapted to provide identification of target chemical contents of the imaged scene. The system is based on spectrally-resolved imaging and can provide such identification with a single-shot (also referred to as a snapshot) comprising a plurality of images having different wavelength compositions that are obtained generally simultaneously. Without any loss of generality, snapshot refers to a system in which most of the data elements that are collected are continuously viewing the light emitted from the scene. In contrast in scanning systems, at any given time only a minority of data elements are continuously viewing a scene, followed by a different set of data elements, and so on, until the full dataset is collected. Relatively fast operation can be achieved in a snapshot system because it does not need to use spectral or spatial scanning for the acquisition of infrared (IR) spectral signatures of the target chemical contents. Instead, IR detectors (such as, for example, infrared focal plane arrays or FPAs) associated with a plurality of different optical channels having different wavelength profiles can be used to form a spectral cube of imaging data. Although spectral data can be obtained from a single snapshot comprising multiple simultaneously acquired images corresponding to different wavelength ranges, in various embodiments, multiple snap shots may be obtained. In various embodiments, these multiple snapshots can be averaged. Similarly, in certain embodiments multiple snap shots may be obtained and a portion of these can be selected and possibly averaged. Also, in contrast to commonly used IR spectral imaging systems, the DAISI system does not require cooling. Accordingly, it can advantageously use uncooled infrared detectors. For example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 300 Kelvin. As another example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 273 Kelvin. As yet another example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 250 Kelvin. As another example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 200 Kelvin.
- Implementations disclosed herein provide several advantages over existing IR spectral imaging systems, most if not all of which may require FPAs that are highly sensitive and cooled in order to compensate, during the optical detection, for the reduction of the photon flux caused by spectrum-scanning operation. The highly sensitive and cooled FPA systems are expensive and require a great deal of maintenance. Since various embodiments disclosed herein are configured to operate in single-shot acquisition mode without spatial and/or spectral scanning, the instrument can receive photons from a plurality of points (e.g., every point) of the object substantially simultaneously, during the single reading. Accordingly, the embodiments of imaging system described herein can collect a substantially greater amount of optical power from the imaged scene (for example, an order of magnitude more photons) at any given moment in time especially in comparison with spatial and/or spectral scanning systems. Consequently, various embodiments of the imaging systems disclosed herein can be operated using uncooled detectors (for example, FPA unit including an array of microbolometers) that are less sensitive to photons in the IR but are well fit for continuous monitoring applications. For example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 300 Kelvin. As another example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 273 Kelvin. As yet another example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 250 Kelvin. As another example, in various implementations, the imaging systems disclosed herein do not include detectors configured to be cooled to a temperature below 200 Kelvin. Imaging systems including uncooled detectors can be capable of operating in extreme weather conditions, require less power, are capable of operation during day and night, and are less expensive. Some embodiments described herein can also be less susceptible to motion artifacts in comparison with spatially and/or spectrally scanning systems which can cause errors in either the spectral data, spatial data, or both.
-
FIG. 1 provides a diagram schematically illustrating spatial and spectral division of incoming light by anembodiment 100 of a divided aperture infrared spectral imager (DAISI) system that can image anobject 110 possessing IR spectral signature(s). Thesystem 100 includes a frontobjective lens 124, an array ofoptical filters 130, an array ofimaging lenses 128 and adetector array 136. In various embodiments, thedetector array 136 can include a single FPA or an array of FPAs. Each detector in thedetector array 136 can be disposed at the focus of each of the lenses in the array ofimaging lenses 128. In various embodiments, thedetector array 136 can include a plurality of photo-sensitive devices. In some embodiments, the plurality of photo-sensitive devices may comprise a two-dimensional imaging sensor array that is sensitive to radiation having wavelengths between 1 μm and 20 μm (for example, in near infra-red wavelength range, mid infra-red wavelength range, or long infra-red wavelength range,). In various embodiments, the plurality of photo-sensitive devices can include CCD or CMOS sensors, bolometers, microbolometers or other detectors that are sensitive to infra-red radiation. - An aperture of the
system 100 associated with the frontobjective lens system 124 is spatially and spectrally divided by the combination of the array ofoptical filters 130 and the array ofimaging lenses 128. In various embodiments, the combination of the array ofoptical filters 130 and the array ofimaging lenses 128 can be considered to form a spectrally divided pupil that is disposed forward of theoptical detector array 136. The spatial and spectral division of the aperture into distinct aperture portions forms a plurality ofoptical channels 120 along which light propagates. In various embodiments, thearray 128 ofre-imaging lenses 128 a and the array ofspectral filters 130 which respectively correspond to the distinctoptical channels 120. The plurality ofoptical channels 120 can be spatially and/or spectrally distinct. The plurality ofoptical channels 120 can be formed in the object space and/or image space. In one implementation, thedistinct channels 120 may include optical channels that are separated angularly in space. The array ofspectral filters 130 may additionally include a filter-holding aperture mask (comprising, for example, IR light-blocking materials such as ceramic, metal, or plastic). Light from the object 110 (for example a cloud of gas), the optical properties of which in the IR are described by a unique absorption, reflection and/or emission spectrum, is received by the aperture of thesystem 100. This light propagates through each of the plurality ofoptical channels 120 and is further imaged onto theoptical detector array 136. In various implementations, thedetector array 136 can include at least one FPA. In various embodiments, each of there-imaging lenses 128 a can be spatially aligned with a respectively-corresponding spectral region. In the illustrated implementation, each filter element from the array ofspectral filters 130 corresponds to a different spectral region. Eachre-imaging lens 128 a and the corresponding filter element of the array ofspectral filter 130 can coincide with (or form) a portion of the divided aperture and therefore with respectively-correspondingspatial channel 120. Accordingly, in various embodiment animaging lens 128 a and a corresponding spectral filter can be disposed in the optical path of one of the plurality ofoptical channels 120. Radiation from theobject 110 propagating through each of the plurality ofoptical channels 120 travels along the optical path of eachre-imaging lens 128 a and the corresponding filter element of the array ofspectral filter 130 and is incident on the detector array (e.g., FPA component) 136 to form a single image (e.g., sub-image) of theobject 110. The image formed by thedetector array 136 generally includes a plurality of sub-images formed by each of theoptical channels 120. Each of the plurality of sub-images can provide different spatial and spectral information of theobject 110. The different spatial information results from some parallax because of the different spatial locations of the smaller apertures of the divided aperture. In various embodiments, adjacent sub-images can be characterized by close or substantially equal spectral signatures. The detector array (e.g., FPA component) 136 is further operably connected with a processor 150 (not shown). Theprocessor 150 can be programmed to aggregate the data acquired with thesystem 100 into a spectral data cube. The data cube represents, in spatial (x, y) and spectral (λ) coordinates, an overall spectral image of theobject 110 within the spectral region defined by the combination of the filter elements in the array ofspectral filters 130. Additionally, in various embodiments, the processor orprocessing electronics 150 may be programmed to determine the unique absorption characteristic of theobject 110. Also, the processor/processing electronics 150 can, alternatively or in addition, map the overall image data cube into a cube of data representing, for example, spatial distribution of concentrations, c, of targeted chemical components within the field of view associated with theobject 110. - Various implementations of the
embodiment 100 can include an optional moveable temperature-controlledreference source 160 including, for example, a shutter system comprising one or more reference shutters maintained at different temperatures. Thereference source 160 can include a heater, a cooler or a temperature-controlled element configured to maintain thereference source 160 at a desired temperature. For example, in various implementations, theembodiment 100 can include two reference shutters maintained at different temperatures. Thereference source 160 is removably and, in one implementation, periodically inserted into an optical path of light traversing thesystem 100 from theobject 110 to the detector array (e.g., FPA component)136 along at least one of thechannels 120. Theremovable reference source 160 thus can block such optical path. Moreover, thisreference source 160 can provide a reference IR spectrum to recalibrate various components including thedetector array 136 of thesystem 100 in real time. The configuration of themoveable reference source 160 is further discussed below. - In the
embodiment 100, the frontobjective lens system 124 is shown to include a single front objective lens positioned to establish a common field-of-view (FOV) for theimaging lenses 128 a and to define an aperture stop for the whole system. In this specific case, the aperture stop substantially spatially coincides with and/or is about the same size as or slightly larger than, the plurality of smaller limiting apertures corresponding to differentoptical channels 120. As a result, the positions for spectral filters of the differentoptical channels 120 coincide with the position of the aperture stop of the whole system, which in this example is shown as a surface between thelens system 124 and thearray 128 of theimaging lenses 128 a. In various implementations, thelens system 124 can be anobjective lens 124. However, theobjective lens 124 is optional and various embodiments of thesystem 100 need not include theobjective lens 124. In various embodiments, theobjective lens 124 can slightly shift the images obtained by the different detectors in thearray 136 spatially along a direction perpendicular to optical axis of thelens 124, thus the functionality of thesystem 100 is not necessarily compromised when theobjective lens 124 is not included. Generally, however, the field apertures corresponding to different optical channels may be located in the same or different planes. These field apertures may be defined by the aperture of theimaging lens 128 a and/or filters in the dividedaperture 130 in certain implementations. In one implementation, the field apertures corresponding to different optical channels can be located in different planes and the different planes can be optical conjugates of one another. Similarly, while all of the filter elements in the array ofspectral filters 130 of theembodiment 100 are shown to lie in one plane, generally different filter elements of the array ofspectral filter 130 can be disposed in different planes. For example, different filter elements of the array ofspectral filters 130 can be disposed in different planes that are optically conjugate to one another. However, in other embodiments, the different filter elements can be disposed in non-conjugate planes. - In contrast to the
embodiment 100, the frontobjective lens 124 need not be a single optical element, but instead can include a plurality oflenses 224 as shown in anembodiment 200 of the DAISI imaging system inFIG. 2 . Theselenses 224 are configured to divide an incoming optical wavefront from theobject 110. For example, the array of frontobjective lenses 224 can be disposed so as to receive an IR wavefront emitted by the object that is directed toward the DAISI system. The plurality of frontobjective lenses 224 divide the wavefront spatially into non-overlapping sections.FIG. 2 shows threeobjective lenses 224 in a front optical portion of the optical system contributing to the spatial division of the aperture of the system in this example. The plurality ofobjective lenses 224, however, can be configured as a two-dimensional (2D) array of lenses.FIG. 2 presents a general view of theimaging system 200 and the resultant field of view of theimaging system 200. An explodedview 202 of theimaging system 200 is also depicted in greater detail in a figure inset ofFIG. 2 . As illustrated in thedetailed view 202, the embodiment of theimaging system 200 includes afield reference 204 at the front end of the system. Thefield reference 204 can be used to truncate the field of view. The configuration illustrated inFIG. 2 has an operational advantage overembodiment 100 ofFIG. 1 in that the overall size and/or weight and/or cost of manufacture of theembodiment 200 can be greatly reduced because the objective lens is smaller. Each pair of the lenses in thearray 224 and thearray 128 is associated with a field of view (FOV). Each pair of lenses in thearray 224 and thearray 128 receives light from the object from a different angle. Accordingly, the FOV of the different pairs of lenses in thearray 224 and thearray 128 do not completely overlap as a result of parallax. As the distance between the imaging system 200 (portion 202) and theobject 110 increases, the overlappingregion 230 between the FOVs of theindividual lenses 224 increases while the amount ofparallax 228 remains approximately the same, thereby reducing its effect on thesystem 200. When the ratio of the parallax-to-object-distance is substantially equal to the pixel-size-to-system-focal-length ratio then the parallax effect may be considered to be negligible and, for practical purposes, no longer distinguishable. While thelenses 224 are shown to be disposed substantially in the same plane, optionally different objective lenses in the array of frontobjective lenses 224 can be disposed in more than one plane. For example, some of theindividual lenses 224 can be displaced with respect to some otherindividual lenses 224 along the axis 226 (not shown) and/or have different focal lengths as compared to someother lenses 224. As discussed below, thefield reference 204 can be useful in calibrating themultiple detectors 236. - In one implementation, the front objective lens system such as the array of
lenses 224 is configured as an array of lenses integrated or molded in association with a monolithic substrate. Such an arrangement can reduce the costs and complexity otherwise accompanying the optical adjustment of individual lenses within the system. Anindividual lens 224 can optionally include a lens with varying magnification. As one example, a pair of thin and large diameter Alvarez plates can be used in at least a portion of the front objective lens system. Without any loss of generality, the Alvarez plates can produce a change in focal length when translated orthogonally with respect to the optical beam. - In further reference to
FIG. 1 , the detector array 136 (e.g., FPA component) configured to receive the optical data representing spectral signature(s) of the imagedobject 110 can be configured as a single imaging array (e.g., FPA) 136. This single array may be adapted to acquire more than one image (formed by more than one optical channel 120) simultaneously. Alternatively, thedetector array 136 may include a FPA unit. In various implementations, the FPA unit can include a plurality of optical FPAs. At least one of these plurality of FPAs can be configured to acquire more than one spectrally distinct image of the imaged object. For example, as shown in theembodiment 200 ofFIG. 2 , in various embodiments, the number of FPAs included in the FPA unit may correspond to the number of the frontobjective lenses 224. In theembodiment 200 ofFIG. 2 , for example, threeFPAs 236 are provided corresponding to the threeobjective lenses 224. In one implementation of the system, the FPA unit can include an array of microbolometers. The use of multiple microbolometers advantageously allows for an inexpensive way to increase the total number of detection elements (i.e. pixels) for recording of the three-dimensional data cube in a single acquisition event (i.e. one snapshot). In various embodiments, an array of microbolometers more efficiently utilizes the detector pixels of the array of FPAs (e.g., each FPA) as the number of unused pixels is reduced, minimized and/or eliminated between the images that may exist when using a single microbolometer. -
FIG. 3A illustrates schematically anembodiment 300 of the imaging system in which the number of the frontobjective lenses 324 a in thelens array 324, the number ofre-imaging lenses 128 a in thelens array 128, and the number ofFPAs 336 are the same. So configured, each combination of respectively corresponding frontobjective lens 324,re-imaging lens 128 a, andFPAs 336 constitutes an individual imaging channel. Such a channel is associated with acquisition of the IR light transmitted from theobject 110 through an individual filter element of the array ofoptical filters 130. Afield reference 338 of thesystem 300 is configured to have a uniform temperature across its surface and be characterized by a predetermined spectral curve of radiation emanating therefrom. In various implementations, thefield reference 338 can be used as a calibration target to assist in calibrating or maintaining calibration of the FPA. Accordingly, in various implementations, thefield reference 338 is used for dynamically adjusting the data output from eachFPA 336 after acquisition of light from theobject 110. This dynamic calibration process helps provide that output of the different (e.g., most, or each of the)FPA 336 represents correct acquired data, with respect to theother FPAs 336 for analysis, as discussed below in more detail. -
FIG. 3B illustrates the plan view perpendicular to theaxis 226 of anembodiment 300 of the imaging system illustrated inFIG. 3A . For the embodiment shown inFIG. 3B , the optical components (e.g.,objective lenses 324 a, filter elements of the array ofspectral filters 130,re-imaging lenses 128 a and FPA units 336) are arranged as a 4×3 array. In one implementation, the 4×3 array 340 of optical components (lenses reference target 160. Thefield reference aperture 338 can be adapted to obscure and/or block a peripheral portion of the bundle of light propagating from theobject 110 towards theFPA units 336. As a result, thefield reference 338 obscures and/or blocks the border or peripheral portion(s) of the images of theobject 110 formed on the FPA elements located along theperimeter 346 of the detector system. Generally, two elements of the FPA unit will produce substantially equal values of digital counts when they are used to observe the same portion of the scene in the same spectral region using the same optical train. If any of these input parameters (for example, scene to be observed, spectral content of light from the scene, or optical elements delivering light from the scene to the two detector elements) differ, the counts associated with the elements of the FPA unit will differ as well. Accordingly, and as an example, in a case when the two FPAs of the FPA unit 336 (such as those denoted as #6 and #7 inFIG. 3B ) remain substantially un-obscured by thefield reference 338, the outputs from these FPAs can be dynamically adjusted to the output from one of the FPAs located along perimeter 346 (such as, for example, theFPA element # 2 or FPA element #11) that processes light having similar spectral characteristics. -
FIG. 4 illustrates schematically a portion of another embodiment of animaging system 400 that contains anarray 424 of frontobjective lenses 424 a. Thearray 424 oflenses 424 a adapted to receive light from theobject 110 and relay the received light to thearray 128 ofre-imaging lenses 128 a through anarray 438 of field references (or field stops) 438 a, and through anarray 440 of the relay lenses. The spectral characteristics of the field references/field stops 438 a can be known. The field references 438 a are disposed at corresponding intermediate image planes defined, with respect to theobject 110, by respectively corresponding frontobjective lenses 424 a. When refractive characteristics of all of the frontobjective lenses 424 a are substantially the same, all of the field references 438 a are disposed in the same plane. Afield reference 438 a of thearray 438 obscures (or casts a shadow on) a peripheral region of a corresponding image (e.g., sub-image) formed at thedetector plane 444 through a respectively correspondingspatial imaging channel 450 of thesystem 400 prior to such image being spectrally processed by theprocessor 150. Thearray 440 of relay lenses then transmits light along each of theimaging channels 450 through differentspectral filters 454 a of thefilter array 454, past the calibration apparatus that includes two temperature controlledshutters detector module 456. In various embodiments, thedetector module 456 can include a microbolometer array or some other IR FPA. - The
embodiment 400 has several operational advantages. It is configured to provide a spectrally known object within every image (e.g., sub-image) and for every snapshot acquisition which can be calibrated against. Such spectral certainty can be advantageous when using an array of IR FPAs like microbolometers, the detection characteristics of which can change from one imaging frame to the next due to, in part, changes in the scene being imaged as well as the thermal effects caused by neighboring FPAs. In various embodiments, thefield reference array 438 of theembodiment 400 can be disposed within the Rayleigh range (approximately corresponding to the depth of focus) associated with the frontobjective lenses 424, thereby removing unusable blurred pixels due to having the field reference outside of this range. Additionally, theembodiment 400 ofFIG. 4 can be more compact than, for example, theconfiguration 300 ofFIG. 3A . In the system shown inFIG. 3A , for example, thefield reference 338 may be separated from thelens array 324 by a distance greater than several (for example, five) focal lengths to minimize/reduce blur contributed by the field reference to an image formed at a detector plane. - In various embodiments, the multi-optical FPA unit of the IR imaging system can additionally include an FPA configured to operate in a visible portion of the spectrum. In reference to
FIG. 1 , for example, an image of the scene of interest formed by such visible-light FPA may be used as a background to form a composite image by overlapping an IR image with the visible-light image. The IR image may be overlapped virtually, with the use of a processor and specifically-designed computer program product enabling such data processing, or actually, by a viewer. The IR image may be created based on the image data acquired by theindividual FPAs 136. The so-formed composite image facilitates the identification of the precise spatial location of the target species, the spectral signatures of which the system is able to detect/recognize. - The optical filters, used with an embodiment of the system, that define spectrally-distinct IR image (e.g., sub-image) of the object can employ absorption filters, interference filters, and Fabry-Perot etalon based filters, to name just a few. When interference filters are used, the image acquisition through an individual imaging channel defined by an individual re-imaging lens (such as a
lens 128 a ofFIGS. 1, 2, 3, and 4 ) may be carried out in a single spectral bandwidth or multiple spectral bandwidths. Referring again to theembodiments FIGS. 1 through 4 , and in further reference toFIG. 3B , examples of a 4-by-3 array ofspectral filters 130 is shown inFIGS. 5A and 5B .Individual filters 1 through 12 are juxtaposed with a supporting opto-mechanical element (not shown) to define a filter-array plane that is oriented, in operation, substantially perpendicularly to the generaloptical axis 226 of the imaging system. In various implementations, theindividual filters 1 through 12 need not be discrete optical components. Instead, theindividual filters 1 through 12 can comprise one or more coatings that are applied to one or more surfaces of the imaging lenses (such as alens 128 a ofFIGS. 1, 2, 3, and 4 ) or the surfaces of one or more detectors. - The optical filtering configuration of various embodiments disclosed herein may advantageously use a bandpass filter defining a specified spectral band. Any of the filters 0 a through 3 a, the transmission curves of which are shown in
FIG. 6A may, for example, be used. The filters may be placed in front of the optical FPA (or generally, between the optical FPA and the object). In particular, and in further reference toFIGS. 1, 2 3, and 4, whenoptical detector arrays FIG. 6B . Filters ofFIG. 6C can be referred to as long-wavelength pass, LP filters. An LP filter generally attenuates shorter wavelengths and transmits (passes) longer wavelengths (e.g., over the active range of the target IR portion of the spectrum). In various embodiments, short-wavelength-pass filters, SP, may also be used. An SP filter generally attenuates longer wavelengths and transmits (passes) shorter wavelengths (e.g., over the active range of the target IR portion of the spectrum). At least in part due to the snap-shot/non-scanning mode of operation, embodiments of the imaging system described herein can use less sensitive microbolometers without compromising the SNR. The use of microbolometers, as detector-noise-limited devices, in turn not only benefits from the use of spectrally multiplexed filters, but also does not require cooling of the imaging system during normal operation. - Referring again to
FIGS. 6A, 6B, 6C, and 6D , each of the filters (0 b . . . 3 d) transmits light in a substantially wider region of the electromagnetic spectrum as compared to those of the filters (0 a . . . 3 a). Accordingly, when the spectrally-multiplexed set of filters (0 b . . . 0 d) is used with an embodiment of the imaging system, the overall amount of light received by the FPAs (for example, 236, 336) is larger than would be received when using the bandpass filters (0 a . . . 4 a). This “added” transmission of light defined by the use of the spectrally-multiplexed LP (or SP) filters facilitates an increase of the signal on the FPAs above the level of the detector noise. Additionally, by using, in an embodiment of the imaging system, filters having spectral bandwidths greater than those of band-pass filters, the uncooled FPAs of the embodiment of the imaging system experience less heating from radiation incident thereon from the imaged scene and from radiation emanating from the FPA in question itself. This reduced heating is due to a reduction in the back-reflected thermal emission(s) coming from the FPA and reflecting off of the filter from the non-band-pass regions. As the transmission region of the multiplexed LP (or SP) filters is wider, such parasitic effects are reduced thereby improving the overall performance of the FPA unit. - In one implementation, the LP and SP filters can be combined, in a spectrally-multiplexed fashion, in order to increase or maximize the spectral extent of the transmission region of the filter system of the embodiment.
- The advantage of using spectrally multiplexed filters is appreciated based on the following derivation, in which a system of M filters is examined (although it is understood that in practice an embodiment of the invention can employ any number of filters). As an illustrative example, the case of M=7 is considered. Analysis presented below relates to one spatial location in each of the images (e.g., sub-images) formed by the differing imaging channels (e.g., different optical channels 120) in the system. A similar analysis can be performed for each point at an image (e.g., sub-image), and thus the analysis can be appropriately extended as required.
- The unknown amount of light within each of the M spectral channels (corresponding to these M filters) is denoted with f1, f2, f3, . . . fM, and readings from corresponding detector elements receiving light transmitted by each filter is denoted as g1, g2, g3 . . . gM, while measurement errors are represented by n1, n2, n3, . . . nM. Then, the readings at the seven FPA pixels each of which is optically filtered by a corresponding band-pass filter of
FIG. 6A can be represented by: -
g 1 =f 1 +n 1, -
g 2 =f 2 +n 2, -
g 3 =f 3 +n 3, -
g 4 =f 4 +n 4, -
g 5 =f 5 +n 5, -
g 6 =f 6 +n 6, -
g 7 =f 7 +n 7, - These readings (pixel measurements) gi are estimates of the spectral intensities fi. The estimates gi are not equal to the corresponding fi values because of the measurement errors ni. However, if the measurement noise distribution has zero mean, then the ensemble mean of each individual measurement can be considered to be equal to the true value, i.e. gi =fi. Here, the angle brackets indicate the operation of calculating the ensemble mean of a stochastic variable. The variance of the measurement can, therefore, be represented as:
- In embodiments utilizing spectrally-multiplexed filters, in comparison with the embodiments utilizing band-pass filters, the amount of radiant energy transmitted by each of the spectrally-multiplexed LP or SP filters towards a given detector element can exceed that transmitted through a spectral band of a band-pass filter. In this case, the intensities of light corresponding to the independent spectral bands can be reconstructed by computational means. Such embodiments can be referred to as a “multiplex design”.
- One matrix of such “multiplexed filter” measurements includes a Hadamard matrix requiring “negative” filters that may not be necessarily appropriate for the optical embodiments disclosed herein. An S-matrix approach (which is restricted to having a number of filters equal to an integer that is multiple of four minus one) or a row-doubled Hadamard matrix (requiring a number of filters to be equal to an integer multiple of eight) can be used in various embodiments. Here, possible numbers of filters using an S-matrix setup are 3, 7, 11, etc and, if a row-doubled Hadamard matrix setup is used, then the possible number of filters is 8, 16, 24, etc. For example, the goal of the measurement may be to measure seven spectral band fi intensities using seven measurements gi as follows:
-
g 1 =f 1+0+f 3+0+f 5+0+f 7 +n 1, -
g 2=0+f 2 +f 3+0+0+f 6 +f 7 +n 2 -
g 3 =f 1 +f 2+0+0+f 5+0+f 7 +n 3 -
g 4=0+0+0+f 4 +f 5 +f 7 +f 8 +n 4 -
g 5 =f 1+0+f 3 +f 4+0+f 6+0+n 5 -
g 6=0+f 2 +f 3 +f 4 +f 5+0+0+n 6 -
g 7 =f 1 +f 2+0+f 4+0+0+f 7 +n 7 - Optical transmission characteristics of the filters described above are depicted in
FIG. 6B . Here, a direct estimate of the fi is no longer provided through a relationship similar to gi =fi. Instead, if a “hat” notation is used to denote an estimate of a given value, then a linear combination of the measurements can be used such as, for example, -
{circumflex over (f)} 1=¼(+g 1 −g 2 +g 3 −g 4 +g 5 −g 6 +g 7), -
{circumflex over (f)} 2=¼(−g 1 +g 2 +g 3 −g 4 −g 5 +g 6 +g 7), -
{circumflex over (f)} 3=¼(+g 1 +g 2 −g 3 −g 4 +g 5 +g 6 −g 7), -
{circumflex over (f)} 4=¼(−g 1 −g 2 −g 3 +g 4 +g 5 +g 6 +g 7), -
{circumflex over (f)} 5=¼(+g 1 −g 2 +g 3 +g 4 −g 5 +g 6 −g 7), -
{circumflex over (f)} 6=¼(−g 1 +g 2 +g 3 +g 4 +g 5 −g 6 −g 7), -
{circumflex over (f)} 7=¼(+g 1 +g 2 −g 3 +g 4 −g 5 −g 6 +g 7), -
- From the above equation, it is observed that by employing spectrally-multiplexed system the signal-to-noise ratio (SNR) of a measurement is improved by a factor of √{square root over (16/7)}=1.51.
- For N channels, the SNR improvement achieved with a spectrally-multiplexed system can be expressed as (N+1)/(2√{square root over (N)}). For example, an embodiment employing 12 spectral channels (N=12) is characterized by a SNR improvement, over a non-spectrally-multiplexed system, comprising a factor of up to 1.88.
- Two additional examples of related spectrally-multiplexed filter arrangements 0 c through 3 c and 0 d through 3 d that can be used in various embodiments of the imaging systems described herein are shown in
FIGS. 6C and 6D , respectively. The spectrally-multiplexed filters shown inFIGS. 6C and 6D can be used in embodiments of imaging systems employing uncooled FPAs (such as microbolometers).FIG. 6C illustrates a set of spectrally-multiplexed long-wavelength pass (LP) filters used in the system. An LP filter generally attenuates shorter wavelengths and transmits (passes) longer wavelengths (e.g., over the active range of the target IR portion of the spectrum). A single spectral channel having a transmission characteristic corresponding to the difference between the spectral transmission curves of at least two of these LP filters can be used to procure imaging data for the data cube using an embodiment of the system described herein. In various implementations, the spectral filters disposed with respect to the different FPAs can have different spectral characteristics. In various implementations, the spectral filters may be disposed in front of only some of the FPAs while the remaining FPAs may be configured to receive unfiltered light. For example, in some implementations, only 9 of the 12 detectors in the 4×3 array of detectors described above may be associated with a spectral filter while the other 3 detectors may be configured to received unfiltered light. Such a system may be configured to acquire spectral data in 10 different spectral channels in a single data acquisition event. - The use of microbolometers, as detector-noise-limited devices, in turn not only can benefit from the use of spectrally multiplexed filters, but also does not require cooling of the imaging system during normal operation. In contrast to imaging systems that include highly sensitive FPA units with reduced noise characteristics, the embodiments of imaging systems described herein can employ less sensitive microbolometers without compromising the SNR. This result is at least in part due to the snap-shot/non-scanning mode of operation.
- As discussed above, an embodiment may optionally, and in addition to a temperature-controlled reference unit (for example temperature controlled shutters such as
shutters 160; 460 a, 460 b), employ a field reference component (e.g.,field reference aperture 338 inFIG. 3A ), or an array of field reference components (e.g., filedreference apertures 438 inFIG. 4 ), to enable dynamic calibration. Such dynamic calibration can be used for spectral acquisition of one or more or every data cube. Such dynamic calibration can also be used for a spectrally-neutral camera-to-camera combination to enable dynamic compensation of parallax artifacts. The use of the temperature-controlled reference unit (for example, temperature-controlled shutter system 160) and field-reference component(s) facilitates maintenance of proper calibration of each of the FPAs individually and the entire FPA unit as a whole. - In particular, and in further reference to
FIGS. 1, 2, 3, and 4 , the temperature-controlled unit generally employs a system having first and second temperature zones maintained at first and second different temperatures. For example, shutter system of each of theembodiments optical axis 226 of the embodiment(s) 100, 200, 300, 400. Two shutters at two different temperatures may be employed to provide more information for calibration; for example, the absolute value of the difference between FPAs at one temperature as well as the change in that difference with temperature change can be recorded. Referring, for example, toFIG. 4 , in which such multi-shutter structure is shown, the use of multiple shutters enables the user to create a known reference temperature difference perceived by theFPAs 456. This reference temperature difference is provided by the IR radiation emitted by the shutter(s) 460 a, 460 b when these shutters are positioned to block the radiation from theobject 110. As a result, not only the offset values corresponding to each of the individual FPAs pixels can be adjusted but also the gain values of these FPAs. In an alternative embodiment, the system having first and second temperature zones may include a single or multi-portion piece. This single or multi-portion piece may comprise for example a plate. This piece may be mechanically-movable across the optical axis with the use of appropriate guides and having a first portion at a first temperature and a second portion at a second temperature. - Indeed, the process of calibration of an embodiment of the imaging system starts with estimating gain and offset by performing measurements of radiation emanating, independently, from at least two temperature-controlled shutters of known and different radiances. The gain and offset can vary from detector pixel to detector pixel. Specifically, first the response of the
detector unit 456 to radiation emanating from one shutter is carried out. For example, thefirst shutter 460 a blocks the FOV of thedetectors 456 and the temperature T1 is measured directly and independently with thermistors. Following such initial measurement, thefirst shutter 460 a is removed from the optical path of light traversing the embodiment and another second shutter (for example, 460 b) is inserted in its place across theoptical axis 226 to prevent the propagation of light through the system. The temperature of thesecond shutter 460 b can be different than the first shutter (T2≠T1). The temperature of thesecond shutter 460 b is also independently measured with thermistors placed in contact with this shutter, and the detector response to radiation emanating from theshutter 460 b is also recorded. Denoting operational response of FPA pixels (expressed in digital numbers, or “counts”) as gi to a source of radiance Li, the readings corresponding to the measurements of the two shutters can be expressed as: -
g 1 =γL 1(T 1)+g offset -
g 2 =γL 2(T 2)+g offset - Here, goffset is the pixel offset value (in units of counts), and γ is the pixel gain value (in units of counts per radiance unit). The solutions of these two equations with respect to the two unknowns goffset and γ can be obtained if the values of g1 and g2 and the radiance values L1 and L2 are available. These values can, for example, be either measured by a reference instrument or calculated from the known temperatures T1 and T2 together with the known spectral response of the optical system and FPA. For any subsequent measurement, one can then invert the equation(s) above in order to estimate the radiance value of the object from the detector measurement, and this can be done for each pixel in each FPA within the system.
- As already discussed, and in reference to
FIGS. 1 through 4 , the field-reference apertures may be disposed in an object space or image space of the optical system, and dimensioned to block a particular portion of the IR radiation received from the object. In various implementations, the field-reference aperture, the opening of which can be substantially similar in shape to the boundary of the filter array (for example, and in reference to a filter array ofFIGS. 3B, 5B —e.g., rectangular). The field-reference aperture can be placed in front of the objective lens (124, 224, 324, 424) at a distance that is at least several times (in one implementation—at least five times) larger than the focal length of the lens such that the field-reference aperture is placed closer to the object. Placing the field-reference aperture closer to the object can reduce the blurriness of the image. In theembodiment 400 ofFIG. 4 , the field-reference aperture can be placed within the depth of focus of an image conjugate plane formed by the frontobjective lens 424. The field reference, generally, can facilitate, effectuates and/or provides dynamic compensation in the system by providing a spectrally known and temporally-stable object within every scene to reference and stabilize the output from the different FPAs in the array. - Because each FPA's offset value is generally adjusted from each frame to the next frame by the hardware, comparing the outputs of one FPA with another can have an error that is not compensated for by the static calibration parameters goffset and γ established, for example, by the
movable shutters field reference 338 inFIG. 3A , for example) over a plurality of frames obtained over time. If the reference source spectrum is known a priori (such as a blackbody source at a known temperature), one can measure the response of each FPA to the reference source in order to estimate changes to the pixel offset value. However, the temperature of the reference source need not be known. In such implementations, dynamic calibration of the different detectors can be performed by monitoring the change in the gain and the offset for the various detectors from the time the movable shutters used for static calibration are removed. An example calculation of the dynamic offset proceeds as follows. - Among the FPA elements in an array of FPAs in an embodiment of the imaging system, one FPA can be selected to be the “reference FPA”. The field reference temperature measured by all the other FPAs can be adjusted to agree with the field reference temperature measured by the reference as discussed below. The image obtained by each FPA includes a set of pixels obscured by the
field reference 338. Using the previously obtained calibration parameters goffset and γ (the pixel offset and gain), the effective blackbody temperature Ti of the field reference as measured by each FPA is estimated using the equation below: -
T i=mean{(g+Δg i +g offset/γ}=mean{(g−g offset)/γ}+ΔT i - Using the equation above, the mean value over all pixels that are obscured by the field reference is obtained. In the above equation Δgi is the difference in offset value of the current frame from Δgoffset obtained during the calibration step. For the reference FPA, Δgi can be simply set to zero. Then, using the temperature differences measured by each FPA, one obtains
-
T i −T ref=mean{(g+Δg i +g offset /γ}+ΔT i−mean{(g−g offset)/γ}+ΔT i - Once ΔTi for each FPA is measured, its value can be subtracted from each image in order to force operational agreement between such FPA and the reference FPA. While the calibration procedure has been discussed above in reference to calibration of temperature, a procedurally similar methodology of calibration with respect to radiance value can also be implemented.
- Prior to optical data acquisition using an embodiment of the IR imaging system as described herein, one or more, most, or potentially all the FPAs of the system can be calibrated. For example, greater than 50%, 60%, 70%, 80% or 90% of the FPAs 336 can be initially calibrated. As shown in
FIG. 3A , theseFPAs 336 may form separate images of the object using light delivered in a corresponding optical channel that may include the combination of the corresponding front objective andre-imaging lenses - To achieve at least some of these goals, a spectral differencing method may be employed. The method involves forming a difference image from various combinations of the images from different channels. In particular, the images used to form difference images can be registered by two or more different FPAs in spectrally distinct channels having different spectral filters with different spectral characteristics. Images from different channels having different spectral characteristics will provide different spectral information. Comparing (e.g., subtracting) these images, can therefore yield valuable spectral based information. For example, if the filter element of the array of
spectral filters 130 corresponding to aparticular FPA 336 transmits light from theobject 110 including a cloud of gas, for example, with a certain spectrum that contains the gas absorption peak or a gas emission peak while another filter element of the array ofspectral filters 130 corresponding to anotherFPA 336 does not transmit such spectrum, then the difference between the images formed by the two FPAs at issue will highlight the presence of gas in the difference image. - A shortcoming of the spectral differencing method is that contributions of some auxiliary features associated with imaging (not just the target species such as gas itself) can also be highlighted in and contribute to the difference image. Such contributing effects include, to name just a few, parallax-induced imaging of edges of the object, influence of magnification differences between the two or more optical channels, and differences in rotational positioning and orientation between the FPAs. While magnification-related errors and FPA-rotation-caused errors can be compensated for by increasing the accuracy of the instrument construction as well as by post-processing of the acquired imaging, parallax is scene-induced and is not so easily correctable. In addition, the spectral differencing method is vulnerable to radiance calibration errors. Specifically, if one FPA registers radiance of light from a given feature of the object as having a temperature of 40° C., for example, while the data from another FPA represents the temperature of the same object feature as being 39° C., then such feature of the object will be enhanced or highlighted in the difference image (formed at least in part based on the images provided by these two FPAs) due to such radiance-calibration error.
- One solution to some of such problems is to compare (e.g., subtract) images from the same FPA obtained at different instances in time. For example, images can be compared to or subtracted from a reference image obtained at another time. Such reference image, which is subtracted from other later obtained images, may be referred to as a temporal reference image. This solution can be applied to spectral difference images as well. For example, the image data resulting from spectral difference images can be normalized by the data corresponding to a temporal reference image. For instance, the temporal reference images can be subtracted from the spectral difference image to obtain the temporal difference image. This process is referred to, for the purposes of this disclosure, as a temporal differencing algorithm or method and the resultant image from subtracting the temporal reference image from another image (such as the spectral difference image) is referred to as the temporal difference image. In some embodiments where spectral differencing is employed, a temporal reference image may be formed, for example, by creating a spectral difference image from the two or more images registered by the two or more FPAs at a single instance in time. This spectral difference image is then used as a temporal reference image. The temporal reference image can then be subtracted from other later obtained images to provide normalization that can be useful in subtracting out or removing various errors or deleterious effects. For example, the result of the algorithm is not affected by a prior knowledge of whether the object or scene contains a target species (such as gas of interest), because the algorithm can highlight changes in the scene characteristics. Thus, a spectral difference image can be calculated from multiple spectral channels as discussed above based on a snap-shot image acquisition at any later time and can be subtracted from the temporal reference image to form a temporal difference image. This temporal difference image is thus a normalized difference image. The difference between the two images (the temporal difference image) can highlight the target species (gas) within the normalized difference image, since this species was not present in the temporal reference frame. In various embodiments, more than two FPAs can be used both for registering the temporal reference image and a later-acquired difference image to obtain a better SNR figure of merit. For example, if two FPAs are associated with spectral filters having the same spectral characteristic, then the images obtained by the two FPAs can be combined after they have been registered to get a better SNR figure.
- While the temporal differencing method can be used to reduce or eliminate some of the shortcomings of the spectral differencing, it can introduce unwanted problems of its own. For example, temporal differencing of imaging data is less sensitive to calibration and parallax induced errors than the spectral differencing of imaging data. However, any change in the imaged scene that is not related to the target species of interest (such as particular gas, for example) is highlighted in a temporally-differenced image. Thus such change in the imaged scene may be erroneously perceived as a location of the target species triggering, therefore, an error in detection of target species. For example, if the temperature of the background against which the gas is being detected changes (due to natural cooling down as the day progresses, or increases due to a person or animal or another object passing through the FOV of the IR imaging system), then such temperature change produces a signal difference as compared to the measurement taken earlier in time. Accordingly, the cause of the scenic temperature change (the cooling object, the person walking, etc.) may appear as the detected target species (such as gas). It follows, therefore, that an attempt to compensate for operational differences among the individual FPAs of a multi-FPA IR imaging system with the use of methods that turn on spectral or temporal differencing can cause additional problems leading to false detection of target species. Among these problems are scene-motion-induced detection errors and parallax-caused errors that are not readily correctable and/or compensatable. Accordingly, there is a need to compensate for image data acquisition and processing errors caused by motion of elements within the scene being imaged. Various embodiments of data processing algorithms described herein address and fulfill the need to compensate for such motion-induced and parallax-induced image detection errors.
- In particular, to reduce or minimize parallax-induced differences between the images produced with two or more predetermined FPAs, another difference image can be used that is formed from the images of at least two different FPAs to estimate parallax effects. Parallax error can be determined by comparing the images from two different FPAs where the position between the FPAs is known. The parallax can be calculated from the known relative position difference. Differences between the images from these two FPAs can be attributed to parallax, especially, if the FPA have the same spectral characteristics, for example have the same spectral filter or both have no spectral filters. Parallax error correction, however, can still be obtained from two FPAs that have different spectral characteristics or spectral filters, especially if the different spectral characteristics, e.g., the transmission spectra of the respective filters are known and/or negligible. Use of more than two FPAs or FPAs of different locations such as FPAs spaced farther apart can be useful. For example, when the spectral differencing of the image data is performed with the use of the difference between the images collected by the outermost two cameras in the array (such as, for example, the FPAs corresponding to
filters FIG. 5A ), a difference image referred to as a “difference image 2-3” is formed. In this case, the alternative “difference image 1-4” is additionally formed from the image data acquired by, for example, the alternative FPAs corresponding tofilters FIG. 5A . Assuming or ensuring that both of these two alternative FPAs have approximately the same spectral sensitivity to the target species, the alternative “difference image 1-4” will highlight pixels corresponding to parallax-induced features in the image. Accordingly, based on positive determination that the same pixels are highlighted in the spectral “difference image 2-3” used for target species detection, a conclusion can be made that the image features corresponding to these pixels are likely to be induced by parallax and not the presence of target species in the imaged scene. It should be noted that compensation of parallax can also be performed using images created by individual re-imaging lenses, 128 a, when using a single FPA or multiple FPA's as discussed above. FPAs spaced apart from each other in different directions can also be useful. Greater than 2, for example, 3 or 4, or more FPAs can be used to establish parallax for parallax correction. In certain embodiments two central FPAs and one corner FPA are used for parallax correction. These FPA may, in certain embodiments, have substantially similar or the same spectral characteristics, for example, have filters having similar or the same transmission spectrum or have no filter at all. - Another capability of the embodiments described herein is the ability to perform the volumetric estimation of a gas cloud. This can be accomplished by using (instead of compensating or negating) the parallax induced effects described above. In this case, the measured parallax between two or more similar spectral response images (e.g., two or more channels or FPAs) can be used to estimate a distance between the imaging system and the gas cloud or between the imaging system and an object in the field of view of the system. The parallax induced transverse image shift, d, between two images is related to the distance, z, between the cloud or object 110 and the imaging system according to the equation z=−sz′/d. Here, s, is the separation between two similar spectral response images, and z′ is the distance to the image plane from the back lens. The value for z′ is typically approximately equal to the focal length f of the lens of the imaging system. Once the distance z between the cloud and the imaging system is calculated, the size of the gas cloud can be determined based on the magnification, m=f/z, where each image pixel on the gas cloud, Δx′, corresponds to a physical size in object space Δx=Δx′/m. To estimate the volume of the gas cloud, a particular symmetry in the thickness of the cloud based on the physical size of the cloud can be assumed. For example, the cloud image can be rotated about a central axis running through the cloud image to create a three dimensional volume estimate of the gas cloud size. It is worth noting that in the embodiments described herein only a single imaging system is required for such volume estimation. Indeed, due to the fact that the information about the angle at which the gas cloud is seen by the system is decoded in the parallax effect, the image data includes the information about the imaged scene viewed by the system in association with at least two angles.
- When the temporal differencing algorithm is used for processing the acquired imaging data, a change in the scene that is not caused by the target species can inadvertently be highlighted in the resulting image. In various embodiments, compensation for this error makes use of the temporal differencing between two FPAs that are substantially equally spectrally sensitive to the target species. In this case, the temporal difference image will highlight those pixels the intensity of which have changed in time (and not in wavelength). Therefore, subtracting the data corresponding to these pixels on both FPAs, which are substantially equally spectrally sensitive to the target species, to form the resulting image, excludes the contribution of the target species to the resulting image. The differentiation between (i) changes in the scene due to the presence of target species and (ii) changes in the scene caused by changes in the background not associated with the target species is, therefore, possible. In some embodiments, these two channels having the same or substantially similar spectral response so as to be substantially equally spectrally sensitive to the target species may comprise FPAs that operate using visible light. It should also be noted that, the data acquired with a visible light FPA (when present as part of the otherwise IR imaging system) can also be used to facilitate such differentiation and compensation of the motion-caused imaging errors. Visible cameras generally have much lower noise figure than IR cameras (at least during daytime). Consequently, the temporal difference image obtained with the use of image data from the visible light FPA can be quite accurate. The visible FPA can be used to compensate for motion in the system as well as many potential false-alarms in the scene due to motion caused by people, vehicles, birds, and steam, for example, as long as the moving object can be observed in the visible region of the spectra. This has the added benefit of providing an additional level of false alarm suppression without reducing the sensitivity of the system since many targets such as gas clouds cannot be observed in the visible spectral region. In various implementations, an IR camera can be used to compensate for motion artifacts.
- Another method for detection of the gases is to use a spectral unmixing approach. A spectral unmixing approach assumes that the spectrum measured at a detector pixel is composed of a sum of component spectra (e.g., methane and other gases). This approach attempts to estimate the relative weights of these components needed to derive the measurement spectrum. The component spectra are generally taken from a predetermined spectral library (for example, from data collection that has been empirically assembled), though sometimes one can use the scene to estimate these as well (often called “endmember determination”). In various embodiments, the image obtained by the detector pixel is a radiance spectrum and provides information about the brightness of the object. To identify the contents of a gas cloud in the scene and/or to estimate the concentration of the various gases in the gas cloud, an absorption/emission spectrum of the various gases of interest can be obtained by comparing the measured brightness with an estimate of the expected brightness. The spectral unmixing methodology can also benefit from temporal, parallax, and motion compensation techniques.
- In various embodiments, a method of identifying the presence of a target species in the object includes obtaining the radiance spectrum (or the absorption spectrum) from the object in a spectral region indicative of the presence of the target species and calculating a correlation (e.g., a correlation coefficient) by correlating the obtained radiance spectrum (or the absorption spectrum) with a reference spectrum for the target species. The presence or absence of the target species can be determined based on an amount of correlation (e.g., a value of correlation coefficient). For example, the presence of the target species in the object can be confirmed if the amount of correlation or the value of correlation coefficient is greater than a threshold. In various implementations, the radiance spectrum (or the absorption spectrum) can be obtained by obtaining a spectral difference image between a filtered optical channel and/or another filtered optical channel/unfiltered optical channel or any combinations thereof
- For example, an embodiment of the system configured to detect the presence of methane in a gas cloud comprises optical components such that one or more of the plurality of optical channels is configured to collect IR radiation to provide spectral data corresponding to a discrete spectral band located in the wavelength range between about 7.9 μm and about 8.4 μm corresponding to an absorption peak of methane. The multispectral data obtained in the one or more optical channels can be correlated with a predetermined absorption spectrum of methane in the wavelength range between about 7.9 μm and 8.4 μm. In various implementations, the predetermined absorption spectrum of methane can be saved in a database or a reference library accessible by the system. Based on an amount of correlation (e.g., a value of correlation coefficient), the presence or absence of methane in the gas cloud can be detected.
- The
embodiment 300 ofFIGS. 3A and 3B is configured to employ 12 optical channels and 12 corresponding microbolometer FPAs 336 to capture a video sequence substantially immediately after performing calibration measurements. The video sequence corresponds to images of a standard laboratory scene and the calibration measurements are performed with the use of a reference source including two shutters, as discussed above, one at room temperature and one 5° C. above room temperature. The use of 12 FPAs allows increased chance of simultaneous detection and estimation of the concentrations of about 8 or 9 gases present at the scene. In various embodiments, the number ofFPAs 336 can vary, depending on the balance between the operational requirements and consideration of cost. - Due to the specifics of operation in the IR range of the spectrum, the use of the so-called noise-equivalent temperature difference (or NETD) is preferred and is analogous to the SNR commonly used in visible spectrum instruments. The array of microbolometer FPAs 336 is characterized to perform at NETD≦72 mK at an f-number of 1.2. Each measurement was carried out by summing four consecutive frames, and the reduction in the NETD value expected due to such summation would be described by corresponding factor of √{square root over (4)}=2. Under ideal measurement conditions, therefore, the FPA NETD should be about 36 mK.
- It is worth noting that the use of optically-filtered FPAs in various embodiments of the system described herein can provide a system with higher number of pixels. For example, embodiments including a single large format microbolometer FPA array can provide a system with large number of pixels. Various embodiments of the systems described herein can also offer a high optical throughput for a substantially low number of optical channels. For example, the systems described herein can provide a high optical throughput for a number of optical channels between 4 and 50. By having a lower number of optical channels (e.g., between 4 and 50 optical channels), the systems described herein have wider spectral bins which allows the signals acquired within each spectral bin to have a greater integrated intensity.
- An advantage of the embodiments described herein over various scanning based hyperspectral systems that are configured for target species detection (for example, gas cloud detection) is that, the entire spectrum can be resolved in a snapshot mode (for example, during one image frame acquisition by the FPA array). This feature enables the embodiments of the imaging systems described herein to take advantage of the compensation algorithms such as the parallax and motion compensation algorithms mentioned above. Indeed, as the imaging data required to implement these algorithms are collected simultaneously with the target-species related data, the compensation algorithms are carried out with respect to target-species related data and not with respect to data acquired at another time interval. This rapid data collection thus improves the accuracy of the data compensation process. In addition, the frame rate of data acquisition is much higher. For example, embodiments of the imaging system described herein can operate at video rates from about 5 Hz and higher. For example, various embodiments described herein can operate at frame rates from about 5 Hz to about 60 Hz or 200 Hz. Thus, the user is able to recognize in the images the wisps and swirls typical of gas mixing without blurring out of these dynamic image features and other artifacts caused by the change of scene (whether spatial or spectral) during the lengthy measurements. In contradistinction, scanning based imaging systems involve image data acquisition over a period of time exceeding a single-snap-shot time and can, therefore, blur the target gas features in the image and inevitably reduce the otherwise achievable sensitivity of the detection. This result is in contrast to embodiments of the imaging system described herein that are capable of detecting the localized concentrations of gas without it being smeared out with the areas of thinner gas concentrations. In addition, the higher frame rate also enables a much faster response rate to a leak of gas (when detecting such leak is the goal). For example, an alarm can trigger within fractions of a second rather than several seconds.
- To demonstrate the operation and gas detection capability of the imaging systems described herein, a prototype was constructed in accordance with the
embodiment 300 ofFIG. 3A and used to detect a hydrocarbon gas cloud of propylene at a distance of approximately 10 feet.FIG. 7 illustrates video frames 1 through 12 representing gas-cloud-detection output 710 (seen as a streak of light) in a sequence from t=1 to t=12. Theimages 1 through 12 are selected frames taken from a video-data sequence captured at a video-rate of 15 frames/sec. The detected propylene gas is shown as a streak of light 710 (highlighted in red) near the center of each image. The first image is taken just prior to the gas emerging from the nozzle of a gas-contained, while the last image represents the system output shortly after the nozzle has been turned off - The same prototype of the system can also demonstrate the dynamic calibration improvement described above by imaging the scene surrounding the system (the laboratory) with known temperature differences. The result of implementing the dynamic correction procedure is shown in
FIGS. 8A, 8B , where the curves labeled “obj” (or “A”) represent temperature estimates of an identified region in the scene. The abscissa in each of the plots ofFIGS. 8A, 8B indicates the number of a FPA, while the ordinate corresponds to temperature (in degrees C.). Accordingly, it is expected that when all detector elements receive radiant data that, when interpreted as the object's temperature, indicates that the object's temperature perceived by all detector elements is the same, any given curve would be a substantially flat line. Data corresponding to each of the multiple “obj” curves are taken from a stream of video frames separated from one another by about 0.5 seconds (for a total of 50 frames). The recorded “obj” curves shown inFIG. 8A indicate that the detector elements disagree about the object's temperature, and that difference in object's temperature perceived by different detector elements is as high as about 2.5° C. In addition, all of the temperature estimates are steadily drifting in time, from frame to frame. The curves labeled “ref” (or “C”) correspond to the detectors' estimates of the temperature of theaperture 338 of theembodiment 300 ofFIG. 3A . The results of detection of radiation carried out after each detector pixel has been subjected to the dynamic calibration procedure described above are expressed with the curved labeled “obj corr” (or “B”). Now, the difference in estimated temperature of the object among the detector elements is reduced to about 0.5° C. (thereby improving the original reading at least by a factor of 5). -
FIG. 8B represents the results of similar measurements corresponding to a different location in the scene (a location which is at a temperature about 9° C. above the estimated temperature of theaperture 338 ofFIG. 3A ). As shown, the correction algorithm discussed above is operable and effective and applicable to objects kept at different temperature. Accordingly, the algorithm is substantially temperature independent. -
FIGS. 9A and 9B illustrates schematicallydifferent implementations mirrors reference sources implementation 900 can be similarly configured as theembodiment 300 and include one or more front objective lens, a divided aperture, one or more spectral filters, an array ofimaging lenses 928 a and animaging element 936. In various implementations, the imaging element 936 (e.g., camera block) can include an array of cameras. In various implementations, the array of cameras can comprise an optical FPA unit. The optical FPA unit can comprise a single FPA, an array of FPAs. In various implementations, the array of cameras can include one or more detector arrays represented asdetector array 1,detector array 5,detector array 9 inFIGS. 9A and 9B . In various embodiments, the FOV of each of thedetector arrays detector arrays detector arrays FIG. 9A , thereference sources detector arrays FIG. 3A ). - In
FIG. 9A , themirrors reference sources mirrors detector arrays reference source detector array 5 could be greater than the FOV of thedetector arrays mirrors detector array 5 at a location such that thereference source detector array 5. Themirrors reference sources detector arrays reference sources re-imaging lenses 928 a, however, thereference sources reference sources detector array 1,detector array 5, anddetector array 9 are disposed such that a focused image of thereference sources reference sources reference sources reference sources - As discussed above, in some embodiments, the
reference sources detector array 1 anddetector array 9, without much blur such that thereference sources reference sources detector array 1, anddetector array 9 are blurred such that thereference sources reference sources reference source reference sources reference sources reference sources reference sources reference sources reference sources reference sources - In
FIG. 9B , the temperature-calibration elements comprise temperature-controlledelements detector arrays elements detector arrays reference source reference sources detector array 936 along with the radiation incident from the object. Depending on the position of thereference sources images elements - In the implementations depicted in
FIGS. 9A and 9B , thedetector arrays reference sources detector arrays detector arrays lenses 928 a provide blurred (or defocused) images of thereference sources detector arrays detector arrays lenses 928 a are described as providing blurred or defocused images, in various embodiments, reference sources or surfaces are imaged on thedetectors arrays FIG. 9A to provide such focused images. - The temperature of the
reference sources reference source 972 a can be at a temperature TA, and thereference source 972 b can be at a temperature TB lower than the temperature TA. A heater can be provided under the temperature-controlledelement 972 a to maintain it at a temperature TA, and a cooler can be provided underneath the temperature-controlledelement 972 b to maintain it at a temperature TB. In various implementations, the embodiments illustrated inFIGS. 9A and 9B can be configured to image a single reference source 972 instead of tworeferences sources detector arrays detector arrays - The
reference sources detector arrays 1 and 9) in which the object has such known temperature (and, therefore, spectrum) can be defined. A calibration procedure can thus be used so that most of the cameras (if not every camera) so operated agrees, operationally, with most or every other camera, for objects at the temperatures represented by those two sources. Calibrating infrared cameras using sources at two different temperatures is known as a “two-point” calibration, and assumes that the measured signal at a given pixel is linearly related to the incident irradiance. Since this calibration can be performed during multiple, more, or even every frame of a sequence, it is referred to as a “dynamic calibration”. - An example of the dynamic calibration procedure is as follows. If there is a temperature sensor on the reference sources or reference surface, then the temperature measurements obtained by these temperature sensors can be used to determine their expected emission spectra. These temperature measurements are labeled as TA[R], TB[R], and TC[R] for the “reference temperatures” of sources/surfaces A, B, and C. These temperature measurements can be used as scalar correction factors to apply to the entire image of a given camera, forcing it to agree with the reference temperatures. Correcting the temperature estimate of a given pixel from T to T′ can use formulae analogous to those discussed below in reference to
FIGS. 10A, 10B, 10C . If no direct temperature sensor is used, then one of the cameras can be used instead. This camera can be referred to as the “reference camera”. In this case, the same formulae as those provided in paragraph below can be used, but with TA[R] and TB[R] representing the temperatures of the reference sources/surfaces A and B as estimated by the reference camera. By applying the dynamic calibration correction formulae, all of the other cameras are forced to match the temperature estimates of the reference camera. - In the configuration illustrated in
FIG. 9B , thereference sources FIG. 9A is similar to thesystem 400 illustrated inFIG. 4 where the reference sources are placed at an intermediate image plane (e.g., a conjugate image plane). In this configuration, the array of reference apertures, similar toreference apertures 438 a inFIG. 4 , will have an accompanying array of reference sources or reference surfaces such that the reference sources or surfaces (e.g., each reference source or surface) are imaged onto a camera or a detector array such asFPAs - A “static” calibration (a procedure in which the scene is largely blocked with a reference source such as the moving
shutters 960 inFIGS. 9A and 9B , so that imaging of an unknown scene cannot be performed in parallel with calibration) allows a plurality of the cameras (for example, most or each camera) to accurately estimate the temperature of a plurality of elements (for example, most or each element in the scene) immediately after the calibration is complete. It cannot, however, prevent the cameras' estimates from drifting away from one another during the process of imaging an unknown scene. The dynamic calibration can be used to reduce or prevent this drift, so that all cameras imaging a scene can be forced to agree on the temperature estimate of the reference sources/surfaces, and adjust this correction during every frame. -
FIG. 10A illustrates schematically arelated embodiment 1000 of the imaging system, in which one or more mirrors MOA, . . . M11A and MOB, . . . M11B are placed within the fields of view of one ormore cameras 0, . . . , 11, partially blocking the field of view. Thecameras 0, . . . , 11 are arranged to form an outer ring ofcameras including cameras central cameras central cameras cameras cameras cameras cameras cameras central cameras cameras cameras cameras cameras - This design is an enhancement to the
systems FIGS. 3A and 4A . In thesystem 1000 shown inFIG. 10A , an array of two or more imaging elements (curved mirrors, for example) is installed at a distance from the FPAs, for example, in the plane of thereference aperture 160 shown inFIG. 3A . These elements (mirror or imaging elements) are used to image one or more temperature-controlled reference sources A and B onto the detector elements of two or more of the cameras. The primary difference betweenembodiment 1000 andembodiment FIGS. 3A and 4A . Thus, this approach improves the robustness of the calibration, as it eliminates potential failures and errors due to the having additional thermal sensors estimating each reference source. - The imaging elements in the system 1000 (shown as mirrors in
FIGS. 10A and 10B ) image one or more controlled-temperature reference sources or a surface of a calibration element (shown as A and B inFIGS. 10A and 10B ) into the blocked region of the cameras' fields of view.FIG. 10B shows an example in which mirror MOA images reference source/surface A ontocamera 0, and mirror MOB images reference source/surface B ontocamera 0, and likewise forcameras cameras cameras cameras FIGS. 10A and 10B represent a top view of the embodiment shown inFIG. 9A . -
FIG. 10C illustrates schematically arelated embodiment 1050 of the imaging system, in which one or more reference sources ROA, . . . , R11A and ROB, . . . , R11B are disposed around the array ofdetectors 0, . . . , 11. In various implementations, the one or more reference sources ROA, . . . , R11A and ROB, . . . , R11B can be a single reference source that is imaged by thedetectors 0, . . . , 11. In various implementations,central detector arrays detectors detector arrays detectors central detector arrays detectors detector arrays detectors detectors central cameras FIG. 10C represents a top view of the embodiment shown inFIG. 9B . - In various implementations, a heater can be provided underneath, adjacent to, or in thermal communication with reference source/surface A to give it a higher temperature TA, and a cooler can be provided underneath, adjacent to, or in thermal communication with reference source B to give it a lower temperature TB. In various implementations, the embodiments illustrated in
FIGS. 10A, 10B and 10C can be configured to image a single reference source A instead of two references sources A and B maintained at different temperatures. As discussed above, the embodiments illustrated inFIGS. 10A, 10B and 10C can be configured to image a same surface of a calibration element. In such implementations, the temperature of the surface of the calibration element need not be known. Many, most or each reference source/surface can be coated with a material to make it behave approximately as a blackbody, for which the emission spectrum is known for any given temperature. If many, most, or each camera in the array of cameras images both of references A and B, so that there are known regions in the image of these cameras in which the object has a known temperature (and therefore spectrum), then one can perform a calibration procedure. This procedure can provide that many, most or every camera so operated agrees with various, most, or every other camera, for objects at the temperatures represented by those two sources. For example, two, three, four, five, six, seven, eight, nine, ten, eleven or twelve cameras can be calibrated to agree with each other. In certain embodiments, however, not all the cameras are calibrated to agree with each other. For example, one, two, or more cameras may not be calibrated to agree with each other while others may be calibrated to agree with each other. As discussed above, calibration of infrared cameras using sources at two different temperatures is known as a “two-point” calibration, and assumes that the measured signal at a given pixel is linearly related to the incident irradiance. - The dynamic calibration is used to obtain a corrected temperature T′ from the initial temperature T estimated at each pixel in a camera using the following formulae:
-
T′[x,y,c]=(T[x,y,c]−T A [R])G[c]+T A [R] - where is TA[R] is a dynamic offset correction factor, and,
-
- is a dynamic gain correction factor. The term c discussed above is a camera index that identifies the camera whose data is being corrected.
- Various embodiments of the divided aperture infrared spectral imager (DAISI) disclosed herein (e.g., embodiments illustrated in
FIGS. 1-4, 9A and 9B ) can be configured to operate over a spectral range extending from mid-wave infrared wavelength range (e.g., between about 3 microns and about 7 microns) and long wave infrared wavelength range (e.g., between about 7 microns and about 14 microns) by including detector arrays that can detect infrared radiation in the mid-wave infrared wavelength range and in the long wave infrared wavelength range respectively. - For example, the
detector arrays detector arrays - Implementations of the dual band DAISI including MWIR and LWIR FPAs can have increased detection sensitivity to chemicals/gases that have stronger spectral features in the mid wave infrared wavelength range than the long wave infrared wavelength range. Additionally, since implementations of the dual band DAISI including MWIR and LWIR FPAs are capable of obtaining spectral information in both the mid-wave infrared wavelength range and the long wave infrared wavelength range, such implementations can have enhanced chemical/gas identification capabilities as compared to implementations that operate only in the mid-wave infrared wavelength range or the long wave infrared wavelength range.
- Furthermore, since implementations of the dual band DAISI including MWIR and LWIR FPAs are capable of obtaining an image of a scene by combining spectral information in the mid-wave infrared wavelength range and the long wave infrared wavelength range, the accuracy of detecting various gases/chemicals in the imaged scene can be improved. Additionally, since the implementations of the dual band DAISI including MWIR and LWIR FPAs obtain information in the mid-wave infrared wavelength range and the long wave infrared wavelength range using solar as well as thermal sources for signal, they can be used in different weather conditions (e.g., on sunny days, cloudy days, etc.) and at various times of the day (e.g., during the day or night).
- Various implementations of the dual band DAISI system can be used in continuous monitoring of explosive hydrocarbons or hazardous gas leaks and/or any fugitive gas emission. Implementations of the dual band DAISI system used in such applications can provide video imagery identifying the species, size and direction, and concentration of any detected gas cloud. Other implementations of the dual band DAISI system can also be used for exploration, standoff chemical detection, explosive detection, bio-imaging, medical imaging, gas cloud imaging, surveillance, food inspection, and remote sensing applications and other applications including but not limited to biological warfare, gas leaks at refineries, rigs and petroleum plants, imaging for the purpose of reconnaissance, underwater applications, space application, telecommunications and/or optical computing.
- Various configurations of detector arrays including MWIR and LWIR FPAs are shown in
FIGS. 11A, 12A and 13A .FIG. 11A illustrates a 4×3array 1100 including oneMWIR FPA 1101 b and a plurality of LWIR FPAs (e.g., 1101 a and 1101 c).FIG. 11B is a cross-sectional view of thedetector array 1100 along theaxis 1105A-1105A′. TheMWIR FPA 1101 b is capable of detecting mid-wavelength infra-red radiation in the spectral range between 3-5 microns. TheMWIR FPA 1101 b can include a plurality of detecting regions, each of the plurality of detecting regions being a part of a spatially and spectrally distinct MWIR optical channel. TheMWIR FPA 1101 b can comprise one ormore imaging lens 1128 b configured to image the radiation incident along each of the spatially and spectrally distinct MWIR optical channel onto the corresponding detecting regions of theMWIR FPA 1101 b. Each of the LWIR FPAs 1101 a and 1101 c is capable of detecting long-wavelength infra-red radiation in the spectral range between 7-14 microns. The LWIR FPAs 1101 a and 1101 c can include a plurality of detecting regions, each of the plurality of detecting regions being a part of a spatially and spectrally distinct LWIR optical channel. The LWIR FPAs 1101 a and 1101 c can comprise one ormore imaging lens -
FIG. 12A illustrates a 3×3array 1200 including one FPA 1201 bML that can detect mid-wavelength and long-wavelength infra-red radiation and a plurality of LWIR FPAs (e.g., 1201 a and 1201 c).FIG. 12B is a cross-sectional view of thedetector array 1200 along theaxis 1205A-1205A′. Abeam splitter 1230 can be disposed in front of the FPA 1201 bML configured to split incident radiation in a first wavelength band including radiation in the mid-wavelength infra-red spectral range and a second wavelength band including radiation in the long-wavelength infra-red spectral range. The first wavelength band in the mid-wavelength infra-red spectral range is directed along a first optical path towards a FPA 1201 bM capable of detecting mid-wavelength infra-red radiation in the spectral range between 3-5 microns. The second wavelength band in the long-wavelength infra-red spectral range is directed along a second optical path towards aFPA 120 bL capable of detecting long-wavelength infra-red radiation in the spectral range between 7-14 microns. Each of the MWIR FPA 1201 bM and the LWIR FPA 1201 bL can comprise one or more imaging lenses 1228 bM and 1228 bL configured to image received mid-wavelength infra-red radiation and long-wavelength infra-red radiation onto the FPAs 1201 bM and 1201 bL respectively. -
FIG. 13A illustrates a 4×4array 1300 including a plurality of MWIR FPAs (e.g., 1310M) and a plurality of LWIR FPAs (e.g., 1301 a, 1301 b, and 1301 c).FIG. 13B is a cross-sectional view of thedetector array 1300 along theaxis 1305A-1305A′. Each of the MWIR FPAs (e.g., 1310M) is capable of detecting mid-wavelength infra-red radiation in the spectral range between 3-5 microns. Each of the MWIR FPAs (e.g., 1310M) can include a plurality of detecting regions, each of the plurality of detecting regions being a part of a spatially and spectrally distinct MWIR optical channel. Each of the MWIR FPAs (e.g., 1310M) can comprise one ormore imaging lens 1328M configured to image the radiation incident along each of the spatially and spectrally distinct MWIR optical channel onto the corresponding detecting regions of each of the MWIR FPAs (e.g., 1310M). The LWIR FPAs 1301 a-1301 c can comprise acorresponding imaging lens - Although the embodiment illustrated in
FIG. 11A depicts a 4×3 array including twelve FPAs (e.g., 1 MWIR FPA and 11 LWIR FPAs as shown inFIG. 11A , the number of FPAs can be different in other implementations. For example, the number of FPAs can be sixteen as shown inFIG. 13A . As another example, the number of FPAs can be nine as shown inFIG. 12A . In various implementations, the number of FPAs can be between 2 and 50. For example, various implementations can include at least 2 FPAs, at least 3 FPAs, at least 4 FPAs, at least 5 FPAs, at least 6 FPAs, at least 7 FPAs, at least 8 FPAs, at least 9 FPAs, at least 10 FPAs, at least 11 FPAs, at least 13 FPAs, at least 14 FPAs, at least 15 FPAs, at least 18 FPAs, at least 24 FPAs, at least 30 FPAs, at least 36 FPAs, etc. In such implementations, at least one of the plurality of FPAs can be a MWIR FPA. Thedetector arrays - The MWIR FPA can have a similar size and weight as the LWIR FPA. In some implementations, the MWIR FPA can have a smaller size as compared to the LWIR FPA.
- The one or more MWIR FPAs can be statically and dynamically calibrated using a procedure similar to the static and dynamic calibration of the one or more LWIR FPAs described above. For example, the one or more MWIR FPAs can image the moveable temperature-controlled
reference source 160, thefield reference 338, thefield reference array 438, the moveable temperature-controlledshutters shutters 960 and/or thereference sources - One or more optical filters can be disposed in the optical path of each MWIR and LWIR FPA in the detector array similar to the embodiments disclosed in
FIGS. 1, 2, 3A and 4 . The one or more optical filters disposed in the optical path of the MWIR FPA can result in a pass-band in the mid-wavelength infra-red region while the one or more optical filters disposed in the optical path of the LWIR FPA can result in a pass-band in the long-wavelength infra-red region. The one or more optical filters can include short-pass filters, long-pass filters, band-pass filters, notch filters, etc. The one or more optical filters can include interference films and/or coatings. The one or more optical filters can include spectral filters. In various implementations, the one or more optical filters can also include a cold stop filter that can limit spectral range that is transmitted toward the FPA. The cold stop filter can be configured to transmit spectral regions that are of more interest (e.g., the spectral regions including the prominent spectral features) toward the FPA. This can advantageously reduce noise from radiation in spectral ranges that are of less interest which can help to increase the accuracy of detection. For example, embodiments employed to detect hydrocarbon gas can include a cold stop filter in the optical path of the MWIR FPA that transmits light in the spectral range between about 3.1 and about 3.9 microns. For other chemicals, cold stop filters having a different pass-band can be employed. Without any loss of generality, a cold stop filter can include one or more band-pass filters, short-pass filters and/or long-pass filters that are cooled with a cooler. In various implementations, the cold stop filter can be maintained at the same temperature as the corresponding detector. Alternately, the cold stop filter can be maintained at a different temperature as the corresponding detector. -
FIGS. 14A and 14B illustrate embodiments including anoptical filter 1440 disposed in the optical path of aFPA 1401. TheFPA 1401 can be an MWIR FPA and/or a LWIR FPA as discussed above. Are-imaging lens 1428 can also be provided to image the incident radiation on theFPA 1401. Theoptical filter 1440 can be disposed forward of there-imaging lens 1428 and theFPA 1401 as shown inFIG. 14B or between there-imaging lens 1428 and theFPA 1401 as shown inFIG. 14A . - Cooled MWIR FPAs can advantageously operate at a higher frame rate than an uncooled MWIR/LWIR FPA. Accordingly, for any video frame rate, cooled MWIR FPAs can average data over more frames than an uncooled MWIR/LWIR FPA. This can result in an increase in the signal to noise ratio of the images obtained by the uncooled MWIR FPA.
- The increased signal to noise ratio provided by cooled MWIR FPAs can be advantageous in systems that employ one or more uncooled LWIR FPAs. For example, the reduced signal to noise ratio of images obtained from uncooled LWIR FPAs can result in reduced absorption strength of spectral features present in the images obtained from one or more uncooled LWIR FPAs. Accordingly, imaging systems employing one or more uncooled LWIR FPAs only can result in false positive detection of the presence or absence of one or more chemical species. For example, imaging systems employing one or more uncooled LWIR FPAs only can indicate the presence of a chemical species when it is absent in truth or indicate the absence of a chemical species when it is present in truth. Thus, differentiating between true and false chemical species detections can be challenging when imaging systems employing only one or more uncooled LWIR FPAs are used.
- A cooled MWIR FPA providing images with increased signal to noise ratio, and utilizing the stronger absorption features of various chemical species in mid-wavelength infra-red spectral range, can be used to primarily detect the presence or absence of a chemical species in a scene while the uncooled LWIR FPAs can be used to remove false positive detections and/or to identify the chemical species.
-
FIG. 15 provides a visual example of the roles of the MWIR and LWIR FPAs. Consider an imaging system employing one or more cooled MWIR FPAs and one or more uncooled LWIR FPAs imaging a scene. The one or more cooled MWIR FPAs can be configured to image the full extent of agas cloud 1505 in the scene. In certain embodiments, the one or more LWIR FPAs in the imaging system may require a stronger signal and/or a higher contrast ratio between the gas cloud and a feature in the background of the scene in order to detect various chemical species that may be in thegas cloud 1505. Such LWIR FPAs by themselves may only be capable of detecting the presence of the chemical species (e.g., 1507 a) that have a higher concentration. Furthermore, the detection of chemical species that are present in higher concentration may be inaccurate due to variations in noise, variations in gas density across the field of view, and in variations in the background against which thegas cloud 1505 is imaged. Thus, an imaging system that employs only such LWIR FPAs may result in false positive detections. However, in imaging system that employ one or more MWIR FPAs (e.g., cooled MWIR FPAs), it is not necessary to rely on the detection capability (and/or the signal-to-noise ratio) of such LWIR FPAs. Instead, the LWIR FPAs can be used to perform only false positive removal. Such systems can have increased sensitivity and reliability as compared to imaging systems that employ only LWIR FPAs that require a stronger signal in order to detect various chemical species. In this example, the LWIR FPAs can be used to identify regions in thegas cloud 1505 where certain chemical species of interest are present in relatively higher concentrations. In such implementations, the one or more MWIR FPAs are configured to have increased sensitivity to detect the presence or absence of chemical species in the scene and the one or more MWIR FPAs are configured to speciate or identify the chemical species that are present. - The one or more MWIR and LWIR FPAs can be configured to output one or more image frames. The one or more image frames can be output at video frame rates. For example, the output of the one or more MWIR and LWIR FPAs can be between 5 image frames/second and 120 image frames/second. The output image frames can be analyzed using hyperspectral video analytics using spectra-temporal algorithms to obtain spectral features of various chemical species that may be present in the scene. The spectral features obtained from the image data output from one or more of the MWIR elements and LWIR elements can be cross-correlated with known spectra of various chemical species that are stored in a reference library in a database to identify the chemical species that may be present in the
gas cloud 1505. - In various embodiments, image frames output from the one or more MWIR and LWIR FPAs at the beginning of the measurement period can be used to estimate background features of the scene and image frames acquired later in the measurement period can be used to detect and speciate various chemical species of interest that may be present in the scene. Thus, the one or more MWIR and LWIR FPAs can be used to not only detect and speciate various chemical species of interest that may be present in the scene but to also estimate the dynamic properties of those chemical species. For example, the one or more MWIR and LWIR FPAs can be used to estimate movement of the
gas cloud 1505 and/or the region 1507 over time in addition to detecting and speciating various chemical species that may be present in thegas cloud 1505. - The results associated with detecting and speciating various chemical species that may be present in the
gas cloud 1505, such as, for example, spectral features, concentration, data regarding movement of the gas cloud, etc. 1505 and/or 1507 can be obtained within 1 second from the start of imaging the scene. The associated results can be updated after every frame thereafter. In various implementations, the results associated with detecting and speciating various chemical species that may be present in thegas cloud 1505 can be obtained in sufficiently real time (e.g., between about 0.01 millisecond and about 1 millisecond from the start of imaging the scene, between about 0.01 millisecond and about 10 milliseconds from the start of imaging the scene, between about 0.01 millisecond and about 50 milliseconds from the start of imaging the scene, between about 0.01 millisecond and about 100 milliseconds from the start of imaging the scene, between about 0.01 millisecond and about 500 milliseconds from the start of imaging the scene, between about 0.01 millisecond and about 1 second from the start of imaging the scene, between about 0.01 millisecond and about 10 seconds from the start of imaging the scene, between about 0.01 millisecond and about 30 seconds from the start of imaging the scene, between about 0.01 millisecond and about 1 minute from the start of imaging the scene, between about 0.01 millisecond and about 5 minutes from the start of imaging the scene, or between about 0.01 millisecond and about 10 minutes from the start of imaging the scene). - The ability of one or more MWIR FPAs (e.g., cooled MWIR FPAs) to aid the detection capabilities of the one or more LWIR FPAs can be enhanced when the image frames output from the one or more MWIR FPAs are synchronized with the image frames output from the one or more LWIR FPAs. In various implementations, a feedback system can be employed to synchronize the image frames output from the one or more LWIR FPAs and the image frames output from the one or more MWIR FPAs.
- The inclusion of one or more MWIR FPAs in an array of LWIR FPAs also provides improved chemical speciation due to the extension in the spectral range over which data is collected. For example, sulfur dioxide (SO2) produces a signature in the long-wavelength infra-red spectral range that can be confused with the signature for propylene (C3H6) at very low spectral resolution. However, the spectral features of SO2 and C3H6 do not overlap in the mid-wavelength infra-red spectral range. Thus, the information provided by one or more MWIR FPAs when used in combination with information provided by one or more LWIR FPAs can provide additional information to help differentiate the chemical species that are detected.
- The information provided from the one or more MWIR and LWIR FPAs can also provide information that cannot be obtained by either the MWIR or the LWIR FPAs individually. For example, the combined information from MWIR and LWIR FPAs can be used to estimate the illumination of a scene. The LWIR FPAs are more sensitive to thermally emitted radiation and less sensitive to reflected solar radiation, since solar light is weaker in the long-wavelength infra-red spectral range in comparison with terrestrial sources that are much closer. The MWIR FPAs are sensitive to both thermal and reflected solar radiation. Thus, if LWIR FPAs observing a scene record only small and gradual changes in signal, whereas the MWIR FPAs observing the same scene record much sharper changes then it can be concluded with a degree of confidence that the illumination of the scene is changing.
- This effect is illustrated in
FIG. 16 which shows the temporal variation in the amount of radiation detected by the MWIR FPAs and LWIR FPAs imaging a scene in which the sun emerges from behind a cloud for a certain interval of time and is covered by a cloud subsequently. Thecurve 1605 depicts the variation of the amount of radiation detected by the MWIR FPAs and thecurve 1610 depicts the variation of the amount of radiation detected by the LWIR FPAs. Between time T1 and T2, the sun emerges from behind a cloud. The MWIR FPAs by virtue of their higher sensitivity to wavelengths in the solar spectrum are able to detect almost instantaneously a change in the illumination of the scene, while the LWIR FPAs due to their lower sensitivity to wavelengths in the solar spectrum show a gradual increase in the amount of radiation detected which corresponds to a change in the temperature of the objects in the scene as they are heated by the sun. - Some of the plurality of spatially and spectrally distinct optical channels in various implementations of the dual band DAISI including MWIR and LWIR FPAs can obtain information from spatially distinct portions of an object. Some of the plurality of spatially and spectrally distinct optical channels in various implementations of the dual band DAISI including MWIR and LWIR FPAs can have a field of view (FOV) that is different from the field of view (FOV) of some other of the plurality of spatially and spectrally distinct optical channels. Some of the plurality of spatially and spectrally distinct optical channels in various implementations of the dual band DAISI including MWIR and LWIR FPAs can have a field of view (FOV) that is lower than the field of view (FOV) of the entire system.
- References throughout this specification to “one embodiment,” “an embodiment,” “a related embodiment,” or similar language mean that a particular feature, structure, or characteristic described in connection with the referred to “embodiment” is included in at least one embodiment of the present invention. Thus, appearances of the phrases “in one embodiment,” “in an embodiment,” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment. It is to be understood that no portion of disclosure, taken on its own and in possible connection with a figure, is intended to provide a complete description of all features of the invention.
- In the drawings like numbers are used to represent the same or similar elements wherever possible. The depicted structural elements are generally not to scale, and certain components are enlarged relative to the other components for purposes of emphasis and understanding. It is to be understood that no single drawing is intended to support a complete description of all features of the invention. In other words, a given drawing is generally descriptive of only some, and generally not all, features of the invention. A given drawing and an associated portion of the disclosure containing a description referencing such drawing do not, generally, contain all elements of a particular view or all features that can be presented is this view, for purposes of simplifying the given drawing and discussion, and to direct the discussion to particular elements that are featured in this drawing. A skilled artisan will recognize that the invention may possibly be practiced without one or more of the specific features, elements, components, structures, details, or characteristics, or with the use of other methods, components, materials, and so forth. Therefore, although a particular detail of an embodiment of the invention may not be necessarily shown in each and every drawing describing such embodiment, the presence of this detail in the drawing may be implied unless the context of the description requires otherwise. In other instances, well known structures, details, materials, or operations may be not shown in a given drawing or described in detail to avoid obscuring aspects of an embodiment of the invention that are being discussed. Furthermore, the described single features, structures, or characteristics of the invention may be combined in any suitable manner in one or more further embodiments.
- The features recited in claims appended to this disclosure are intended to be assessed in light of the disclosure as a whole, including features disclosed in prior art to which reference is made.
- At least some elements of a device of the invention can be controlled—and at least some steps of a method of the invention can be effectuated, in operation—with a programmable processor governed by instructions stored in a memory. The memory may be random access memory (RAM), read-only memory (ROM), flash memory or any other memory, or combination thereof, suitable for storing control software or other instructions and data. Those skilled in the art should also readily appreciate that instructions or programs defining the functions of the present invention may be delivered to a processor in many forms, including, but not limited to, information permanently stored on non-writable storage media (e.g. read-only memory devices within a computer, such as ROM, or devices readable by a computer I/O attachment, such as CD-ROM or DVD disks), information alterably stored on writable storage media (e.g. floppy disks, removable flash memory and hard drives) or information conveyed to a computer through communication media, including wired or wireless computer networks. In addition, while the invention may be embodied in software, the functions necessary to implement the invention may optionally or alternatively be embodied in part or in whole using firmware and/or hardware components, such as combinatorial logic, Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs) or other hardware or some combination of hardware, software and/or firmware components.
- While examples of embodiments of the system and method of the invention have been discussed in reference to the gas-cloud detection, monitoring, and quantification (including but not limited to greenhouse gases such as Carbon Dioxide, Carbon Monoxide, Nitrogen Oxide as well as hydrocarbon gases such as Methane, Ethane, Propane, n-Butane, iso-Butane, n-Pentane, iso-Pentane, neo-Pentane, Hydrogen Sulfide, Sulfur Hexafluoride, Ammonia, Benzene, p- and m-Xylene, Vinyl chloride, Toluene, Propylene oxide, Propylene, Methanol, Hydrazine, Ethanol, 1,2-dichloroethane, 1,1-dichloroethane, Dichlorobenzene, Chlorobenzene, to name just a few), embodiments of the invention can be readily adapted for other chemical detection applications. For example, detection of liquid and solid chemical spills, biological weapons, tracking targets based on their chemical composition, identification of satellites and space debris, ophthalmological imaging, microscopy and cellular imaging, endoscopy, mold detection, fire and flame detection, and pesticide detection are within the scope of the invention.
- As used herein, a phrase referring to “at least one of” a list of items refers to any combination of those items, including single members. As an example, “at least one of: a, b, or c” is intended to cover: a, b, c, a-b, a-c, b-c, and a-b-c.
- If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. The steps of a method or algorithm disclosed herein may be implemented in a processor-executable software module which may reside on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that can be enabled to transfer a computer program from one place to another. A storage media may be any available media that may be accessed by a computer. By way of example, and not limitation, such computer-readable media may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that may be used to store desired program code in the form of instructions or data structures and that may be accessed by a computer. Also, any connection can be properly termed a computer-readable medium. Disk and disc, as used herein, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above also may be included within the scope of computer-readable media. Additionally, the operations of a method or algorithm may reside as one or any combination or set of codes and instructions on a machine readable medium and computer-readable medium, which may be incorporated into a computer program product.
- Various modifications to the implementations described in this disclosure may be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other implementations without departing from the spirit or scope of this disclosure. Thus, the claims are not intended to be limited to the implementations shown herein, but are to be accorded the widest scope consistent with this disclosure, the principles and the novel features disclosed herein.
- Certain features that are described in this specification in the context of separate implementations also can be implemented in combination in a single implementation. Conversely, various features that are described in the context of a single implementation also can be implemented in multiple implementations separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
Claims (22)
1. An infrared (IR) imaging system for imaging a scene, the imaging system comprising:
an optical system comprising an optical focal plane array (FPA) unit including a plurality of spatially and spectrally different optical channels to transfer IR radiation from the scene towards the optical FPA unit, each optical channel positioned to transfer a portion of the IR radiation incident on the optical system from the scene towards the optical FPA unit,
wherein at least one of the plurality of optical channels is in the mid-wavelength infrared spectral range and at least another one of the plurality of optical channels is in the long-wavelength infrared spectral range,
wherein the imaging system is configured to acquire a first video image of the scene in the mid-wavelength infrared spectral range and a second video image of the scene in the long-wavelength infrared spectral range.
2. The imaging system of claim 1 , wherein the at least one mid-wavelength optical channel comprises a cold stop filter.
3. The imaging system of claim 1 , wherein the at least one mid-wavelength optical channel comprises filter having a pass-band in the mid-wavelength infrared spectral range.
4. The imaging system of claim 1 , further comprising processing electronics configured to extract information from the first and second video image to detect presence of one or more chemical species in the scene.
5. The imaging system of claim 4 , wherein the processing electronics are configured to compare the extracted information to one or more spectral information stored in a database.
6. The imaging system of claim 1 , further comprising a feedback system configured to synchronize the first and the second video image.
7. The imaging system of claim 1 , wherein the first and/or second video image has a frame rate between about 5 frames per second and about 120 frames per second.
8. The imaging system of claim 1 , wherein the processing electronics are configured to extract information from the first and/or second video image on a frame by frame basis.
9. The imaging system of claim 1 , wherein the processing electronics are configured to extract information from the first video and second video image and detect presence of one or more chemical species in the scene within 5 seconds from a time when imaging of the scene started.
10. The imaging system of claim 1 , wherein the processing electronics are configured to extract information from the first video and second video image and detect presence of one or more chemical species in the scene within 1 second from a time when imaging of the scene started.
11. The imaging system of claim 1 , wherein the processing electronics are configured to extract information from the first video and second video image and detect presence of one or more chemical species in the scene in sufficiently real time from a time when imaging of the scene started.
12. The imaging system of claim 1 , wherein the one or more chemical species are selected from the group consisting of methane, cyclopropane, alkanes, alkenes, ammonia, freon, hydrogen cyanide, sulfur dioxide, and hydrogen sulfide.
13. The imaging system of claim 1 , wherein the scene includes a moving gas plume.
14. The imaging system of claim 1 , wherein the FPA unit includes at least one mid-wavelength infra-red FPA capable of detecting mid-wavelength infra-red radiation and at least one long-wavelength infra-red FPA capable of detecting long-wavelength infra-red radiation.
15. The imaging system of claim 14 , wherein the at least one mid-wavelength infra-red FPA is cooled to a temperature below 200 degree Kelvin.
16. The imaging system of claim 15 , wherein the at least one mid-wavelength infra-red FPA is cooled to a temperature between about 110 degree Kelvin and about 150 degree Kelvin.
17. The imaging system of claim 16 , wherein the at least one mid-wavelength infra-red FPA is cooled to a temperature of about 135 degree Kelvin.
18. The imaging system of claim 14 , wherein the at least one mid-wavelength infra-red FPA is coupled to a cooler.
19. The imaging system of claim 14 , wherein the at least one mid-wavelength infra-red FPA and the at least one long-wavelength infra-red FPA are configured to image one more reference sources.
20.-35. (canceled)
36. A method of detecting one or more chemical species in a scene, the method comprising:
obtaining a first video image data of the scene in mid-wavelength infrared spectral range using a mid-wavelength infra-red FPA;
obtaining a second video image data of the scene in long-wavelength infrared spectral range using a long-wavelength infra-red FPA;
obtaining one or more spectra from the first and the second video image data; and
comparing the obtained one or more spectra with one or more reference spectra stored in a database to detect one or more chemical species in the scene.
37.-42. (canceled)
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/700,567 US20170026588A1 (en) | 2014-05-01 | 2015-04-30 | Dual-band divided-aperture infra-red spectral imaging system |
US16/256,967 US10893220B2 (en) | 2014-05-01 | 2019-01-24 | Dual-band divided-aperture infra-red spectral imaging system |
US17/115,261 US11805221B2 (en) | 2014-05-01 | 2020-12-08 | Dual-band divided-aperture infra-red spectral imaging system |
US18/472,891 US20240098214A1 (en) | 2014-05-01 | 2023-09-22 | Dual-band divided-aperture infra-red spectral imaging system |
Applications Claiming Priority (12)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201461986885P | 2014-05-01 | 2014-05-01 | |
US201461986886P | 2014-05-01 | 2014-05-01 | |
US201462012078P | 2014-06-13 | 2014-06-13 | |
US201462021636P | 2014-07-07 | 2014-07-07 | |
US201462021907P | 2014-07-08 | 2014-07-08 | |
US201462054894P | 2014-09-24 | 2014-09-24 | |
US201462055342P | 2014-09-25 | 2014-09-25 | |
US201462055549P | 2014-09-25 | 2014-09-25 | |
US201462082594P | 2014-11-20 | 2014-11-20 | |
US201462082613P | 2014-11-20 | 2014-11-20 | |
US201462083131P | 2014-11-21 | 2014-11-21 | |
US14/700,567 US20170026588A1 (en) | 2014-05-01 | 2015-04-30 | Dual-band divided-aperture infra-red spectral imaging system |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/256,967 Continuation US10893220B2 (en) | 2014-05-01 | 2019-01-24 | Dual-band divided-aperture infra-red spectral imaging system |
Publications (1)
Publication Number | Publication Date |
---|---|
US20170026588A1 true US20170026588A1 (en) | 2017-01-26 |
Family
ID=54355069
Family Applications (8)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/700,567 Abandoned US20170026588A1 (en) | 2014-05-01 | 2015-04-30 | Dual-band divided-aperture infra-red spectral imaging system |
US14/700,791 Active US9756263B2 (en) | 2014-05-01 | 2015-04-30 | Mobile gas and chemical imaging camera |
US15/623,942 Active US10084975B2 (en) | 2014-05-01 | 2017-06-15 | Mobile gas and chemical imaging camera |
US16/138,823 Active US10834338B2 (en) | 2014-05-01 | 2018-09-21 | Mobile gas and chemical imaging camera |
US16/256,967 Active US10893220B2 (en) | 2014-05-01 | 2019-01-24 | Dual-band divided-aperture infra-red spectral imaging system |
US17/115,261 Active US11805221B2 (en) | 2014-05-01 | 2020-12-08 | Dual-band divided-aperture infra-red spectral imaging system |
US17/652,035 Active US11917321B2 (en) | 2014-05-01 | 2022-02-22 | Mobile gas and chemical imaging camera |
US18/472,891 Pending US20240098214A1 (en) | 2014-05-01 | 2023-09-22 | Dual-band divided-aperture infra-red spectral imaging system |
Family Applications After (7)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/700,791 Active US9756263B2 (en) | 2014-05-01 | 2015-04-30 | Mobile gas and chemical imaging camera |
US15/623,942 Active US10084975B2 (en) | 2014-05-01 | 2017-06-15 | Mobile gas and chemical imaging camera |
US16/138,823 Active US10834338B2 (en) | 2014-05-01 | 2018-09-21 | Mobile gas and chemical imaging camera |
US16/256,967 Active US10893220B2 (en) | 2014-05-01 | 2019-01-24 | Dual-band divided-aperture infra-red spectral imaging system |
US17/115,261 Active US11805221B2 (en) | 2014-05-01 | 2020-12-08 | Dual-band divided-aperture infra-red spectral imaging system |
US17/652,035 Active US11917321B2 (en) | 2014-05-01 | 2022-02-22 | Mobile gas and chemical imaging camera |
US18/472,891 Pending US20240098214A1 (en) | 2014-05-01 | 2023-09-22 | Dual-band divided-aperture infra-red spectral imaging system |
Country Status (1)
Country | Link |
---|---|
US (8) | US20170026588A1 (en) |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9599508B2 (en) | 2012-05-18 | 2017-03-21 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
US9625318B2 (en) | 2012-05-18 | 2017-04-18 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system for chemical detection |
US20170205290A1 (en) | 2013-11-12 | 2017-07-20 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
US9756263B2 (en) | 2014-05-01 | 2017-09-05 | Rebellion Photonics, Inc. | Mobile gas and chemical imaging camera |
US20180195955A1 (en) * | 2015-08-13 | 2018-07-12 | Halliburton Energy Services, Inc. | Calibration of optical computing devices using traceable filters |
US20180279967A1 (en) * | 2017-03-30 | 2018-10-04 | Expantrum Optoelectronics | Portable multispectral imaging device and method of reducing interference of displayed images thereof |
US10375327B2 (en) | 2016-10-21 | 2019-08-06 | Rebellion Photonics, Inc. | Mobile gas and chemical imaging camera |
US10458905B2 (en) | 2014-07-07 | 2019-10-29 | Rebellion Photonics, Inc. | Gas leak emission quantification with a gas cloud imager |
US10605725B2 (en) | 2017-11-09 | 2020-03-31 | Rebellion Photonics, Inc. | Window obscuration sensors for mobile gas and chemical imaging cameras |
US20200116567A1 (en) * | 2018-10-10 | 2020-04-16 | Samsung Electronics Co., Ltd. | Method and apparatus for analyzing spectral information |
US10648960B2 (en) | 2015-05-29 | 2020-05-12 | Rebellion Photonics, Inc. | Hydrogen sulfide imaging system |
CN111458051A (en) * | 2020-03-09 | 2020-07-28 | 西安电子科技大学 | Three-dimensional temperature field measuring system and method based on pixel-level spectral photodetector |
US10948404B2 (en) | 2016-10-21 | 2021-03-16 | Rebellion Photonics, Inc. | Gas imaging system |
US10955355B2 (en) | 2017-02-22 | 2021-03-23 | Rebellion Photonics, Inc. | Systems and methods for monitoring remote installations |
CN112634271A (en) * | 2021-03-09 | 2021-04-09 | 南京智谱科技有限公司 | Method and equipment for determining critical value of gas leakage amount detected by infrared camera |
US11156456B2 (en) * | 2019-05-21 | 2021-10-26 | Apple Inc. | Optical proximity sensor integrated into a camera module for an electronic device |
US20220070366A1 (en) * | 2020-08-28 | 2022-03-03 | Canon Kabushiki Kaisha | Image capturing apparatus, method thereof, and storage medium |
US11290662B2 (en) | 2014-05-01 | 2022-03-29 | Rebellion Photonics, Inc. | Mobile gas and chemical imaging camera |
US11410419B2 (en) * | 2016-07-21 | 2022-08-09 | L3 Technologies, Inc. | Enhanced vision systems and methods |
US11854256B1 (en) * | 2019-07-09 | 2023-12-26 | ACME Atronomatic, LLC | Methods and devices for earth remote sensing using stereoscopic hyperspectral imaging in the visible (VIS) and infrared (IR) bands |
Families Citing this family (71)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10690540B2 (en) | 2015-10-06 | 2020-06-23 | View, Inc. | Multi-sensor having a light diffusing element around a periphery of a ring of photosensors |
US10533892B2 (en) | 2015-10-06 | 2020-01-14 | View, Inc. | Multi-sensor device and system with a light diffusing element around a periphery of a ring of photosensors and an infrared sensor |
US11674843B2 (en) | 2015-10-06 | 2023-06-13 | View, Inc. | Infrared cloud detector systems and methods |
JP2014082541A (en) * | 2012-10-12 | 2014-05-08 | National Institute Of Information & Communication Technology | Method, program and apparatus for reducing data size of multiple images including information similar to each other |
US9464984B2 (en) | 2014-06-20 | 2016-10-11 | Fluke Corporation | Laser illuminated gas imaging device for determining inoperable gas detection pixels |
US9930324B2 (en) * | 2014-08-05 | 2018-03-27 | Seek Thermal, Inc. | Time based offset correction for imaging systems |
WO2016022374A1 (en) | 2014-08-05 | 2016-02-11 | Seek Thermal, Inc. | Local contrast adjustment for digital images |
CN106716992B (en) | 2014-08-20 | 2020-02-07 | 塞克热量股份有限公司 | Method for gain calibration of an imaging system and imaging system |
EP3201613B1 (en) * | 2014-09-29 | 2021-01-06 | View, Inc. | Sunlight intensity or cloud detection with variable distance sensing |
US11781903B2 (en) | 2014-09-29 | 2023-10-10 | View, Inc. | Methods and systems for controlling tintable windows with cloud detection |
TWI727931B (en) | 2014-09-29 | 2021-05-21 | 美商唯景公司 | Combi-sensor systems |
US11566938B2 (en) | 2014-09-29 | 2023-01-31 | View, Inc. | Methods and systems for controlling tintable windows with cloud detection |
US10467736B2 (en) | 2014-12-02 | 2019-11-05 | Seek Thermal, Inc. | Image adjustment based on locally flat scenes |
US10600164B2 (en) | 2014-12-02 | 2020-03-24 | Seek Thermal, Inc. | Image adjustment based on locally flat scenes |
US10970590B2 (en) * | 2015-06-05 | 2021-04-06 | Schlumberger Technology Corporation | Image-based wellsite equipment health monitoring |
WO2017009819A1 (en) * | 2015-07-16 | 2017-01-19 | Ci Systems (Israel) Ltd. | Gas detection, imaging and flow rate measurement system |
US9992477B2 (en) | 2015-09-24 | 2018-06-05 | Ouster, Inc. | Optical system for collecting distance information within a field |
US10063849B2 (en) | 2015-09-24 | 2018-08-28 | Ouster, Inc. | Optical system for collecting distance information within a field |
US11255722B2 (en) | 2015-10-06 | 2022-02-22 | View, Inc. | Infrared cloud detector systems and methods |
WO2017082388A1 (en) * | 2015-11-11 | 2017-05-18 | パイオニア株式会社 | Security device, security control method, program, and storage medium |
CN105628211A (en) * | 2015-12-26 | 2016-06-01 | 深圳市金立通信设备有限公司 | Temperature measurement method and terminal and server |
AU2017212835B2 (en) * | 2016-01-29 | 2019-03-14 | Ouster, Inc. | Systems and methods for calibrating an optical distance sensor |
US10079983B2 (en) * | 2016-03-01 | 2018-09-18 | Fluke Corporation | Compact camera |
WO2017197346A1 (en) * | 2016-05-13 | 2017-11-16 | Gas Sensing Technology Corp. | Gross mineralogy and petrology using raman spectroscopy |
EP3458835B1 (en) * | 2016-05-18 | 2022-03-23 | MultiSensor Scientific, Inc. | Hydrocarbon leak imaging and quantification sensor |
US10867371B2 (en) | 2016-06-28 | 2020-12-15 | Seek Thermal, Inc. | Fixed pattern noise mitigation for a thermal imaging system |
US10634770B2 (en) | 2016-06-29 | 2020-04-28 | Apple Inc. | Optical systems for remote sensing receivers |
US10557943B2 (en) | 2016-08-22 | 2020-02-11 | Apple Inc. | Optical systems |
WO2018038152A1 (en) * | 2016-08-24 | 2018-03-01 | コニカミノルタ株式会社 | Gas measurement system and gas measurement program |
WO2018039432A1 (en) | 2016-08-24 | 2018-03-01 | Ouster, Inc. | Optical system for collecting distance information within a field |
US10670779B1 (en) * | 2016-09-08 | 2020-06-02 | Lockheed Martin Corporation | Multi-layered optical element |
AU2017330180B2 (en) * | 2016-09-26 | 2019-06-27 | Ouster, Inc. | Optical system for collecting distance information within a field |
CN114143435A (en) | 2016-11-10 | 2022-03-04 | 奇跃公司 | Method and system for multiple F-value shots |
CN110088595B (en) * | 2016-12-13 | 2022-08-16 | 皇家飞利浦有限公司 | Microbolometer focal plane array with integrated multi-spectral mosaic bandpass filter/focusing lens array for simultaneous real-time anesthetic and respiratory gas concentration detection and measurement signal processing |
CA3053821A1 (en) * | 2017-03-16 | 2018-09-20 | MultiSensor Scientific, Inc. | Scanning ir sensor for gas safety and emissions monitoring |
WO2018183973A1 (en) * | 2017-03-31 | 2018-10-04 | Flir Systems Ab | Gas imaging systems and methods |
KR102657365B1 (en) | 2017-05-15 | 2024-04-17 | 아우스터, 인크. | Brightness Enhanced Optical Imaging Transmitter |
US11022546B2 (en) | 2017-05-16 | 2021-06-01 | Fluke Corporation | Optical gas imaging systems and methods |
US11361383B1 (en) * | 2017-09-06 | 2022-06-14 | United Services Automobile Association (Usaa) | Simplified interactive user interface |
WO2019055771A1 (en) * | 2017-09-14 | 2019-03-21 | Arizona Board Of Regents On Behalf Of The University Of Arizona | Compact spectrometer devices, methods, and applications |
CA3076483A1 (en) | 2017-11-16 | 2019-05-23 | MultiSensor Scientific, Inc. | Systems and methods for multispectral imaging and gas detection using a scanning illuminator and optical sensor |
US10969490B2 (en) | 2017-12-07 | 2021-04-06 | Ouster, Inc. | Light ranging system with opposing circuit boards |
US10760976B2 (en) * | 2018-04-12 | 2020-09-01 | Mattson Technology, Inc. | Thermal imaging of heat sources in thermal processing systems |
US11055532B2 (en) * | 2018-05-02 | 2021-07-06 | Faro Technologies, Inc. | System and method of representing and tracking time-based information in two-dimensional building documentation |
US11641441B2 (en) | 2018-05-25 | 2023-05-02 | Fluke Corporation | Optical gas imaging systems and method compatible with uncooled thermal imaging cameras |
JP2021170689A (en) * | 2018-06-01 | 2021-10-28 | ソニーグループ株式会社 | Image processing device and method |
CN109263869A (en) * | 2018-08-07 | 2019-01-25 | 杜军华 | A kind of intelligent type atmospheric purification unmanned plane and its application method |
US10739189B2 (en) | 2018-08-09 | 2020-08-11 | Ouster, Inc. | Multispectral ranging/imaging sensor arrays and systems |
US11473970B2 (en) | 2018-08-09 | 2022-10-18 | Ouster, Inc. | Subpixel apertures for channels in a scanning sensor array |
CN109215296A (en) * | 2018-10-08 | 2019-01-15 | 武汉爱迪科技股份有限公司 | A kind of liquefied ammonia leakage alarm system for the monitoring of industrial accident hidden danger |
CN109489717A (en) * | 2018-10-08 | 2019-03-19 | 武汉爱迪科技股份有限公司 | Liquefied ammonia equipment monitoring system for the monitoring of industrial accident hidden danger |
US10976245B2 (en) | 2019-01-25 | 2021-04-13 | MultiSensor Scientific, Inc. | Systems and methods for leak monitoring via measurement of optical absorption using tailored reflector installments |
JP7196640B2 (en) * | 2019-01-29 | 2022-12-27 | セイコーエプソン株式会社 | Information system and identification method |
US11391634B2 (en) * | 2019-02-12 | 2022-07-19 | Accure Acne, Inc. | Temperature sensing apparatus for use with a photo-thermal targeted treatment system and associated methods |
US11276152B2 (en) | 2019-05-28 | 2022-03-15 | Seek Thermal, Inc. | Adaptive gain adjustment for histogram equalization in an imaging system |
US20220244127A1 (en) * | 2019-08-05 | 2022-08-04 | Seekops Inc. | Rapidly Deployable UAS System for Autonomous Inspection Operations Using a Combined Payload |
KR20210020469A (en) | 2019-08-14 | 2021-02-24 | 삼성전자주식회사 | Spectral camera |
CN110631703A (en) * | 2019-09-30 | 2019-12-31 | 中国科学院西安光学精密机械研究所 | Single-pixel spectral imaging system based on tunable optical filter |
RU2743493C1 (en) * | 2019-12-04 | 2021-02-19 | Федеральное государственное бюджетное учреждение "Национальный исследовательский центр "Курчатовский институт" | Low-temperature scanning infrared analyzer of methane and hydrocarbon vapors in atmospheric air |
US11614430B2 (en) | 2019-12-19 | 2023-03-28 | Seekops Inc. | Concurrent in-situ measurement of wind speed and trace gases on mobile platforms for localization and qualification of emissions |
US11692933B2 (en) * | 2020-04-06 | 2023-07-04 | Joyson Safety Systems Acquisition Llc | Systems and methods of ambient gas sensing in a vehicle |
US20210344852A1 (en) * | 2020-05-04 | 2021-11-04 | Rebellion Photonics, Inc. | Apparatuses, systems, and methods for thermal imaging |
CN111914672B (en) * | 2020-07-08 | 2023-08-04 | 浙江大华技术股份有限公司 | Image labeling method and device and storage medium |
US11748866B2 (en) | 2020-07-17 | 2023-09-05 | Seekops Inc. | Systems and methods of automated detection of gas plumes using optical imaging |
GB2597924A (en) * | 2020-07-31 | 2022-02-16 | Thales Holdings Uk Plc | A thermal imaging system and method |
US11501478B2 (en) | 2020-08-17 | 2022-11-15 | Faro Technologies, Inc. | System and method of automatic room segmentation for two-dimensional laser floorplans |
EP4260047A1 (en) * | 2020-12-12 | 2023-10-18 | Blue Sky Measurements, Inc. | Methane monitoring and detection apparatus and methods |
CZ309718B6 (en) * | 2021-11-01 | 2023-08-16 | Západočeská Univerzita V Plzni | Equipment for thermographic temperature measurement |
WO2023091568A1 (en) * | 2021-11-17 | 2023-05-25 | Snap Inc. | Camera intrinsic recalibration in mono visual tracking system |
RU210352U1 (en) * | 2021-12-22 | 2022-04-08 | Федеральное государственное бюджетное учреждение "Национальный исследовательский центр "Курчатовский институт" | LOW-TEMPERATURE SCANNING LIQUEFIED NATURAL GAS VAPOR ANALYZER IN THE ATMOSPHERE |
CN117257204B (en) * | 2023-09-19 | 2024-05-07 | 深圳海业医疗科技有限公司 | Endoscope control assembly control method and system |
Citations (44)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4134683A (en) * | 1976-03-05 | 1979-01-16 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Multispectral imaging and analysis system |
US5157258A (en) * | 1989-08-21 | 1992-10-20 | Rockwell International Corporation | Multicolor infrared focal plane arrays |
US5354987A (en) * | 1992-12-07 | 1994-10-11 | Texas Instruments Incorporated | Calibrating focal plane arrays using multiple variable radiometric sources |
US5559336A (en) * | 1994-07-05 | 1996-09-24 | Santa Barbara Research Center | Integrated LPE-grown structure for simultaneous detection of infrared radiation in two bands |
US5877500A (en) * | 1997-03-13 | 1999-03-02 | Optiscan Biomedical Corporation | Multichannel infrared detector with optical concentrators for each channel |
US6465785B1 (en) * | 2000-05-05 | 2002-10-15 | Infrared Solutions, Inc. | Apparatus and method for compensating for pixel non-uniformity in a bolometer |
US20030102435A1 (en) * | 2001-11-20 | 2003-06-05 | Mark Myers | Multiband, single element wide field of view infrared imaging system |
US20030183756A1 (en) * | 2002-03-27 | 2003-10-02 | Huniu Lee J. | Display uniformity calibration system and method for a staring forward looking infrared sensor |
US20040111232A1 (en) * | 2002-05-22 | 2004-06-10 | Matthew Butler | Processing system for remote chemical identification |
US20040252300A1 (en) * | 2003-06-12 | 2004-12-16 | Slater Richard C. | Chemical identification by flash spectroscopy |
US7109488B2 (en) * | 2004-02-26 | 2006-09-19 | The United States Of America As Represented By The Secretary Of The Army | Multi-color infrared imaging device |
US20060232675A1 (en) * | 2003-04-25 | 2006-10-19 | Land Instruments International Limited | Thermal imaging system and method |
US20060279632A1 (en) * | 2005-05-26 | 2006-12-14 | Anderson Shane M | Method for fixed pattern noise reduction in infrared imaging cameras |
US20070018105A1 (en) * | 2003-10-02 | 2007-01-25 | Ernest Grimberg | Infra-red (ir) sensor with controllable sensitivity |
US20070075888A1 (en) * | 2005-09-30 | 2007-04-05 | Michael Kelly | Digital readout method and apparatus |
US7242478B1 (en) * | 2003-12-05 | 2007-07-10 | Surface Optics Corporation | Spatially corrected full-cubed hyperspectral imager |
US20080170140A1 (en) * | 2007-01-11 | 2008-07-17 | Silver Alan G | Video Camera System Using Multiple Image Sensors |
US20080204744A1 (en) * | 2005-07-11 | 2008-08-28 | Jose Mir | High Speed, Optically-Multiplexed, Hyperspectral Imagers and Methods Thereof |
US7433042B1 (en) * | 2003-12-05 | 2008-10-07 | Surface Optics Corporation | Spatially corrected full-cubed hyperspectral imager |
US20080251724A1 (en) * | 2007-04-11 | 2008-10-16 | Baliga Shankar B | Gas and/or flame imaging system |
US20090252650A1 (en) * | 2006-08-16 | 2009-10-08 | Sridhar Lakshmanan | Portable mems-based spectral identification system |
US20100162206A1 (en) * | 2008-12-24 | 2010-06-24 | Flir Systems Ab | Executable code in digital image files |
US20100309467A1 (en) * | 2009-06-05 | 2010-12-09 | Spectral Sciences, Inc. | Single-Shot Spectral Imager |
US20110176577A1 (en) * | 2008-12-08 | 2011-07-21 | California Institute Of Technology | Superpixel multi-waveband photodetector array for remote temperature measurement |
CA2787303A1 (en) * | 2010-01-19 | 2011-07-28 | Delacom Detection Systems, Llc | A method, device and system for determining the presence of volatile organic compounds (voc) in video |
US8027041B1 (en) * | 2006-06-08 | 2011-09-27 | Wavefront Research, Inc. | Compact snapshot multispectral imaging system |
US8373757B1 (en) * | 2009-02-23 | 2013-02-12 | Flir Systems, Inc. | Flat field correction for infrared cameras |
US20130206990A1 (en) * | 2011-08-22 | 2013-08-15 | ISC8 Inc. | Background Limited Focal Plane Array Assembly |
US20130228887A1 (en) * | 2012-03-01 | 2013-09-05 | Raytheon Company | Photodetector with surface plasmon resonance |
US20130235256A1 (en) * | 2010-11-16 | 2013-09-12 | Kenichi Kodama | Multiband camera, and multiband image capturing method |
US20130307991A1 (en) * | 2009-11-06 | 2013-11-21 | Steven Olsen | Infrared sensor control architecture |
US20130342680A1 (en) * | 2012-06-21 | 2013-12-26 | Providence Photonics, Llc | Multi-spectral infrared imaging system for flare combustion efficiency monitoring |
US20140139643A1 (en) * | 2009-06-03 | 2014-05-22 | Flir Systems, Inc. | Imager with array of multiple infrared imaging modules |
GB2518224A (en) * | 2013-09-16 | 2015-03-18 | Selex Es Ltd | Thermal imaging calibration system and method |
US20150144770A1 (en) * | 2013-11-26 | 2015-05-28 | nanoLambda Korea | Multispectral imager with hybrid double layer filter array |
US20150288894A1 (en) * | 2011-11-04 | 2015-10-08 | Imec | Spectral camera with mirrors for projecting multiple adjacent image copies onto sensor array |
US20160037089A1 (en) * | 2014-07-30 | 2016-02-04 | Raytheon Company | Multi-band thermal imaging sensor with integrated filter array |
US9395516B2 (en) * | 2012-05-28 | 2016-07-19 | Nikon Corporation | Imaging device |
US20160245698A1 (en) * | 2013-10-16 | 2016-08-25 | The Arizona Board Of Regents On Behalf Of The University Of Arizona | Multispectral imaging based on computational imaging and a narrow-band absorptive filter array |
US20160313181A1 (en) * | 2013-06-18 | 2016-10-27 | Ramot At Tel-Aviv University Ltd. | Apparatus and method for snapshot spectral imaging |
US20160380014A1 (en) * | 2014-01-27 | 2016-12-29 | INVIS Technologies Corporation | Thermal Imaging Device |
US9625318B2 (en) * | 2012-05-18 | 2017-04-18 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system for chemical detection |
US9641772B2 (en) * | 2014-11-19 | 2017-05-02 | Northrop Grumman Systems Corporation | Compact PMMW camera calibration target |
US9644562B2 (en) * | 2014-12-03 | 2017-05-09 | Denso Corporation | Injector driving apparatus |
Family Cites Families (126)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB1014769A (en) | 1963-04-11 | 1965-12-31 | Barnes Eng Co | Improvements in thermal image systems for temperature measurement |
FR2181203A5 (en) | 1972-04-21 | 1973-11-30 | Onera (Off Nat Aerospatiale) | |
US3841763A (en) | 1973-06-25 | 1974-10-15 | Timelapse Inc | Method and apparatus for monitoring and correlating visible environmental contamination |
US3978281A (en) * | 1975-04-14 | 1976-08-31 | Burrer Gordon J | Infrared imaging system |
US4464789A (en) | 1980-05-19 | 1984-08-07 | Environmental Research Institute Of Michigan | Image analyzer for processing multiple frames of image data |
US4390785A (en) | 1980-12-29 | 1983-06-28 | E. I. Du Pont De Nemours & Co. | Method and apparatus for remotely detecting gases in the atmosphere |
US4963963A (en) * | 1985-02-26 | 1990-10-16 | The United States Of America As Represented By The Secretary Of The Air Force | Infrared scanner using dynamic range conserving video processing |
US4965448A (en) | 1986-04-24 | 1990-10-23 | Honeywell Inc. | Internal calibration source for infrared radiation detector |
GB2200813B (en) | 1987-02-03 | 1991-06-05 | Gec Avionics | Thermal imager |
US5136421A (en) | 1990-06-29 | 1992-08-04 | Texas Instruments Incorporated | Thermal imaging system and method using scene-average radiation as a thermal reference |
US6198532B1 (en) | 1991-02-22 | 2001-03-06 | Applied Spectral Imaging Ltd. | Spectral bio-imaging of the eye |
US5127742A (en) | 1991-04-19 | 1992-07-07 | Thermoscan Inc. | Apparatus and method for temperature measurement by radiation |
US5430293A (en) | 1991-10-08 | 1995-07-04 | Osaka Gas Co., Ltd. | Gas visualizing apparatus and method for detecting gas leakage from tanks or piping |
SE9201655L (en) | 1992-05-26 | 1993-08-23 | Agema Infrared Systems Ab | ARRANGEMENTS FOR RECORDING AN IR PICTURE OF AN OBJECTIVE INCLUDING A PLAN GROUP OF IR DETECTORS AND A TEMPERATURE REFERENCE ARRANGEMENT |
US5550373A (en) | 1994-12-30 | 1996-08-27 | Honeywell Inc. | Fabry-Perot micro filter-detector |
US5822222A (en) | 1995-04-05 | 1998-10-13 | New Jersey Institute Of Technology | Multi-wavelength imaging pyrometer |
US7119337B1 (en) | 1997-08-04 | 2006-10-10 | Ion Optics, Inc. | Infrared radiation sources, sensors and source combinations, and methods of manufacture |
US6023061A (en) | 1995-12-04 | 2000-02-08 | Microcam Corporation | Miniature infrared camera |
US5973844A (en) | 1996-01-26 | 1999-10-26 | Proxemics | Lenslet array systems and methods |
US5920066A (en) | 1996-08-02 | 1999-07-06 | Raytheon Company | Real-time adaptive thermal reference control for night vision systems |
DE69735411T2 (en) | 1996-10-09 | 2006-09-07 | Symyx Technologies, Inc., Santa Clara | INFRARED SPECTROSCOPY AND LIBRARY IMAGING |
US5994701A (en) | 1996-10-15 | 1999-11-30 | Nippon Avonics Co., Ltd. | Infrared sensor device with temperature correction function |
US5890095A (en) | 1997-01-21 | 1999-03-30 | Nichols Research Corporation | System for receiving and enhancing electromagnetic radiation input signals |
US6268883B1 (en) * | 1997-05-30 | 2001-07-31 | California Institute Of Technology | High speed infrared imaging system and method |
EP1019686B1 (en) | 1997-07-12 | 2009-08-26 | Roper Industries, Inc. | Multi-spectral two-dimensional imaging spectrometer |
US6184529B1 (en) | 1998-01-28 | 2001-02-06 | Lockheed Martin Corporation | Methods and apparatus for performing scene based uniformity correction in imaging systems |
US6097034A (en) | 1998-02-12 | 2000-08-01 | Instrumentarium Oy | Radiation source assembly and transducer for analyzing gases or other substances |
US6456261B1 (en) | 1998-11-23 | 2002-09-24 | Evan Y. W. Zhang | Head/helmet mounted passive and active infrared imaging system with/without parallax |
JP2002539446A (en) | 1999-03-17 | 2002-11-19 | ユニバーシティー オブ ヴァージニア パテント ファウンデーション | Passive remote sensor for chemicals |
US6876305B2 (en) | 1999-12-08 | 2005-04-05 | Gentex Corporation | Compact particle sensor |
GB2359631B (en) | 2000-02-26 | 2002-03-06 | Schlumberger Holdings | Hydrogen sulphide detection method and apparatus |
US6610984B2 (en) | 2000-03-17 | 2003-08-26 | Infrared Components Corporation | Method and apparatus for correction of microbolometer output |
ATE364833T1 (en) | 2000-07-27 | 2007-07-15 | Bae Systems Information | SPECTRAL DRIFT AND CORRECTION METHODS FOR HYPERSPECTRAL IMAGING SYSTEMS |
US6700527B1 (en) | 2000-11-15 | 2004-03-02 | Harris Corporation | Coherent two-dimensional image formation by passive synthetic aperture collection and processing of multi-frequency radio signals scattered by cultural features of terrestrial region |
US7025138B2 (en) | 2000-12-08 | 2006-04-11 | Schlumberger Technology Corporation | Method and apparatus for hydrogen sulfide monitoring |
US6901173B2 (en) | 2001-04-25 | 2005-05-31 | Lockheed Martin Corporation | Scene-based non-uniformity correction for detector arrays |
US6680778B2 (en) | 2001-11-08 | 2004-01-20 | Michele Hinnrichs | Gas leak detector |
US7318909B2 (en) | 2001-12-12 | 2008-01-15 | Trustees Of Princeton University | Method and apparatus for enhanced evanescent field exposure in an optical fiber resonator for spectroscopic detection and measurement of trace species |
GB0205482D0 (en) * | 2002-03-08 | 2002-04-24 | Bae Systems Plc | Improvements in or relating to infra red camera calibration |
US6695886B1 (en) | 2002-08-22 | 2004-02-24 | Axcelis Technologies, Inc. | Optical path improvement, focus length change compensation, and stray light reduction for temperature measurement system of RTP tool |
US6931328B2 (en) | 2002-11-08 | 2005-08-16 | Optiscan Biomedical Corp. | Analyte detection system with software download capabilities |
US7230741B2 (en) * | 2003-01-13 | 2007-06-12 | Bae Systems Information And Electronic Systems Integration, Inc., Reconnaissance And Surveillance Systems | Optimum non-uniformity correction for imaging sensors |
EP1595131A4 (en) | 2003-02-10 | 2008-11-26 | Univ Virginia | System and method for remote sensing and/or analyzing spectral properties of targets and/or chemical speicies for detection and identification thereof |
US7564021B2 (en) | 2003-02-21 | 2009-07-21 | Delphi Technologies, Inc. | Pyroelectric sensor |
EA009547B1 (en) | 2003-06-11 | 2008-02-28 | ФАРРИ БРАЗЕРС ЛЛСи | Method for performing visual detections of chemical leaks emanating from a component |
US7030378B2 (en) | 2003-08-05 | 2006-04-18 | Bae Systems Information And Electronic Systems Integration, Inc. | Real-time radiation sensor calibration |
US7189970B2 (en) | 2003-08-29 | 2007-03-13 | Power Diagnostic Technologies Ltd. | Imaging of fugitive gas leaks |
US6969176B2 (en) * | 2004-02-12 | 2005-11-29 | Textron Systems Corporation | Spherically-enclosed folded imaging system |
US7321119B2 (en) | 2004-08-12 | 2008-01-22 | E.D. Bullard Company | Method and system for thermal imaging having a selective temperature imaging mode |
US20060044562A1 (en) | 2004-08-25 | 2006-03-02 | Norsk Elektro Optikk As | Gas monitor |
SE0402576D0 (en) | 2004-10-25 | 2004-10-25 | Forskarpatent I Uppsala Ab | Multispectral and hyperspectral imaging |
US7248357B2 (en) * | 2004-10-29 | 2007-07-24 | Gas Technology Institute | Method and apparatus for optically measuring the heating value of a multi-component fuel gas using nir absorption spectroscopy |
US7750802B1 (en) | 2005-02-11 | 2010-07-06 | Parish Warren G | Illumination and detection architecture |
US7375814B2 (en) | 2005-03-11 | 2008-05-20 | Sandia Corporation | Natural gas leak mapper |
US7211800B2 (en) | 2005-09-29 | 2007-05-01 | Siemens Medical Solutions Usa, Inc. | Afterglow DC-offset calibration in a nuclear imaging system |
US7459686B2 (en) | 2006-01-26 | 2008-12-02 | L-3 Communications Corporation | Systems and methods for integrating focal plane arrays |
US7655909B2 (en) | 2006-01-26 | 2010-02-02 | L-3 Communications Corporation | Infrared detector elements and methods of forming same |
US7634157B1 (en) | 2006-03-23 | 2009-12-15 | Flir Systems, Inc. | Infrared and near-infrared camera hyperframing |
US7606484B1 (en) | 2006-03-23 | 2009-10-20 | Flir Systems, Inc. | Infrared and near-infrared camera hyperframing |
US20070268121A1 (en) | 2006-05-18 | 2007-11-22 | Daryush Vasefi | On-line portal system and method for management of devices and services |
US8081244B2 (en) | 2006-07-24 | 2011-12-20 | Michael Golub | Snapshot spectral imaging systems and methods |
US7888624B1 (en) | 2006-11-24 | 2011-02-15 | Solid State Scientific Corporation | Simultaneous spectral imaging system including commonly filtered optical paths defined by focusing elements exhibiting disparate f-numbers |
US8153980B1 (en) | 2006-11-30 | 2012-04-10 | L-3 Communications Corp. | Color correction for radiation detectors |
WO2008109183A1 (en) | 2007-03-08 | 2008-09-12 | University Of Virginia Patent Foundation | Approach for passively detecting analytes |
US8653461B1 (en) | 2007-03-23 | 2014-02-18 | Flir Systems, Inc. | Thermography camera tuned to detect absorption of infrared radiation in a selected spectral bandwidth |
US8659664B2 (en) | 2007-03-23 | 2014-02-25 | Flir Systems, Inc. | Thermography camera configured for leak detection |
US7948617B2 (en) | 2007-07-09 | 2011-05-24 | Fluke Corporation | Optical multiwavelength window contamination monitor for optical control sensors and systems |
WO2009094782A1 (en) * | 2008-02-01 | 2009-08-06 | Power Diagnostic Technologies Ltd. | Apparatus and method for multi-spectral dual imaging |
US8212213B2 (en) | 2008-04-07 | 2012-07-03 | Halliburton Energy Services, Inc. | Chemically-selective detector and methods relating thereto |
US9041915B2 (en) * | 2008-05-09 | 2015-05-26 | Ball Aerospace & Technologies Corp. | Systems and methods of scene and action capture using imaging system incorporating 3D LIDAR |
SE532353C2 (en) | 2008-06-19 | 2009-12-22 | Flir Systems Ab | Device for imaging in the IR field |
US7997732B2 (en) | 2008-10-06 | 2011-08-16 | The Catholic University Of America | Lenslet array for retinal oximetry |
US8421017B2 (en) | 2008-10-21 | 2013-04-16 | The United States Of America, As Represented By The Secretary Of The Navy | Analyte detection with infrared light |
BRPI0921770A2 (en) | 2008-11-04 | 2016-01-05 | Univ Rice William M | image mapping spectrometers |
US8259212B2 (en) | 2009-01-05 | 2012-09-04 | Applied Quantum Technologies, Inc. | Multiscale optical system |
US20100211333A1 (en) | 2009-01-14 | 2010-08-19 | Integrated Process Resources, Inc. | Leak Detection and Identification System |
US8159568B2 (en) | 2009-03-26 | 2012-04-17 | Ahdoot Ned M | Hardware implemented pixel level digital filter and processing of electromagnetic signals |
DE102009049387B4 (en) | 2009-10-14 | 2016-05-25 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus, image processing apparatus and method for optical imaging |
US9338276B2 (en) | 2010-01-26 | 2016-05-10 | Apple Inc. | Gating accessory connection |
US20120154792A1 (en) | 2010-05-13 | 2012-06-21 | Chemimage Corporation | Portable system for detecting hazardous agents using SWIR and method for use thereof |
US20130341509A1 (en) | 2010-06-11 | 2013-12-26 | Chemimage Corporation | Portable system for detecting explosive materials using near infrared hyperspectral imaging and method for using thereof |
US9651488B2 (en) | 2010-10-14 | 2017-05-16 | Thermo Fisher Scientific (Bremen) Gmbh | High-accuracy mid-IR laser-based gas sensor |
EP2649421A1 (en) | 2010-12-10 | 2013-10-16 | William Marsh Rice University | Image mapped optical coherence tomography |
CA2816728A1 (en) | 2010-12-14 | 2012-06-21 | William Marsh Rice University | Image mapped spectropolarimetry |
EP2689576B1 (en) | 2011-03-25 | 2020-03-04 | Exxonmobil Upstream Research Company | Autonomous detection of chemical plumes |
KR101131095B1 (en) | 2011-06-10 | 2012-04-02 | 주식회사 창성에이스산업 | Gas Leak Detection System and Method |
JP2013128185A (en) | 2011-12-16 | 2013-06-27 | Toshiba Corp | Camera system and camera mount |
US8854223B2 (en) | 2012-01-18 | 2014-10-07 | Xerox Corporation | Image-based determination of CO and CO2 concentrations in vehicle exhaust gas emissions |
US9599508B2 (en) * | 2012-05-18 | 2017-03-21 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
US8936164B2 (en) | 2012-07-06 | 2015-01-20 | Industrial Origami, Inc. | Solar panel rack |
US8686364B1 (en) | 2012-09-17 | 2014-04-01 | Jp3 Measurement, Llc | Method and system for determining energy content and detecting contaminants in a fluid stream |
US10191022B2 (en) | 2013-03-15 | 2019-01-29 | Uvia Group Llc | Gas imager employing an array imager pixels with order filters |
US9488444B2 (en) | 2013-04-29 | 2016-11-08 | Raytheon Company | Time-multiplexed broadband and multi-filtered electro-optic sensor |
CN105593651B (en) | 2013-08-02 | 2019-06-07 | 威利食品有限公司 | Spectrometric system and method, spectroscopy equipment and system |
WO2015061978A1 (en) | 2013-10-30 | 2015-05-07 | 华为技术有限公司 | Management method and apparatus for network sharing |
CA2870419C (en) | 2013-11-12 | 2023-05-16 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
IL229490A (en) | 2013-11-18 | 2017-11-30 | Tidhar Gil | Multiband flash detection system |
US9467680B2 (en) * | 2013-12-12 | 2016-10-11 | Intel Corporation | Calibration of a three-dimensional acquisition system |
KR101804383B1 (en) | 2014-01-14 | 2017-12-04 | 한화테크윈 주식회사 | System and method for browsing summary image |
US20150226613A1 (en) | 2014-02-07 | 2015-08-13 | Raytheon Company | Imaging device with shutterless non-uniformity correction |
US11290662B2 (en) | 2014-05-01 | 2022-03-29 | Rebellion Photonics, Inc. | Mobile gas and chemical imaging camera |
US20170026588A1 (en) | 2014-05-01 | 2017-01-26 | Rebellion Photonics, Inc. | Dual-band divided-aperture infra-red spectral imaging system |
CA2890498C (en) | 2014-05-01 | 2022-10-18 | Rebellion Photonics, Inc. | Mobile gas and chemical imaging camera |
CA2890559C (en) | 2014-05-01 | 2023-09-12 | Rebellion Photonics, Inc. | Dual-band divided aperture infra-red spectral imaging system |
WO2015195746A1 (en) | 2014-06-18 | 2015-12-23 | Innopix, Inc. | Spectral imaging system for remote and noninvasive detection of target substances using spectral filter arrays and image capture arrays |
US9823231B1 (en) | 2014-06-30 | 2017-11-21 | Picarro, Inc. | Systems and methods for assembling a collection of peaks characterizing a gas leak source and selecting representative peaks for display |
US10458905B2 (en) | 2014-07-07 | 2019-10-29 | Rebellion Photonics, Inc. | Gas leak emission quantification with a gas cloud imager |
RU2726041C2 (en) | 2014-08-08 | 2020-07-08 | АйЭмИкс С.Р.Л. | Gas detection system for toxic and/or flammable gas |
JP6812341B2 (en) | 2014-08-08 | 2021-01-13 | クアンタム−エスアイ インコーポレイテッドQuantum−Si Incorporated | Optical systems and assay chips for molecular exploration, detection and analysis |
US9671331B2 (en) | 2014-10-07 | 2017-06-06 | Providence Photonics, Llc | Apparatus for imaging hydrogen sulfide plume and method of the same |
TW201625923A (en) | 2015-01-02 | 2016-07-16 | 無限傳感有限公司 | Detection of hydrocarbon gases using short wave infrared technology |
US9404804B1 (en) | 2015-04-02 | 2016-08-02 | Palo Alto Research Center Incorporated | Thermal sensor with infrared absorption membrane including metamaterial structure |
EP3304014B1 (en) | 2015-05-29 | 2024-04-03 | Rebellion Photonics, Inc. | Hydrogen sulfide imaging system |
US10311307B2 (en) | 2015-06-23 | 2019-06-04 | Raytheon Company | Methods and apparatus for video wall with feed indicators |
US9594228B1 (en) | 2015-08-28 | 2017-03-14 | Gopro, Inc. | Thermal compensation to adjust camera lens focus |
US9612195B1 (en) | 2015-11-11 | 2017-04-04 | Bert Friedman | Gas detector and method for monitoring gas in a confined space |
GB2544507B (en) | 2015-11-18 | 2017-11-22 | Servomex Group Ltd | Method and system for reduction of influence of baseline distortion in absorption spectroscopy measurements |
US10001427B2 (en) | 2016-02-15 | 2018-06-19 | Kane Usa, Inc. | Leak detector |
EP3458835B1 (en) | 2016-05-18 | 2022-03-23 | MultiSensor Scientific, Inc. | Hydrocarbon leak imaging and quantification sensor |
US10003751B2 (en) | 2016-05-25 | 2018-06-19 | The United States Of America, As Represented By The Secretary Of The Army | Multiple field of view dual band optics with integrated calibration source |
US20180039885A1 (en) | 2016-08-04 | 2018-02-08 | International Business Machines Corporation | Satellite-based location identification of methane-emitting sites |
EP4212851A1 (en) | 2016-10-21 | 2023-07-19 | Rebellion Photonics, Inc. | Gas imaging system |
WO2018075964A1 (en) | 2016-10-21 | 2018-04-26 | Rebellion Photonics, Inc. | Mobile gas and chemical imaging camera |
WO2018156795A1 (en) | 2017-02-22 | 2018-08-30 | Rebellion Photonics, Inc. | Systems and methods for monitoring remote installations |
EP3707497B1 (en) | 2017-11-09 | 2022-09-28 | Rebellion Photonics, Inc. | Window obscuration sensors for mobile gas and chemical imaging cameras |
JP2022022530A (en) * | 2020-06-25 | 2022-02-07 | シャープ株式会社 | Camera, image processing method, program and computer-readable recording medium recording program |
-
2015
- 2015-04-30 US US14/700,567 patent/US20170026588A1/en not_active Abandoned
- 2015-04-30 US US14/700,791 patent/US9756263B2/en active Active
-
2017
- 2017-06-15 US US15/623,942 patent/US10084975B2/en active Active
-
2018
- 2018-09-21 US US16/138,823 patent/US10834338B2/en active Active
-
2019
- 2019-01-24 US US16/256,967 patent/US10893220B2/en active Active
-
2020
- 2020-12-08 US US17/115,261 patent/US11805221B2/en active Active
-
2022
- 2022-02-22 US US17/652,035 patent/US11917321B2/en active Active
-
2023
- 2023-09-22 US US18/472,891 patent/US20240098214A1/en active Pending
Patent Citations (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4134683A (en) * | 1976-03-05 | 1979-01-16 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Multispectral imaging and analysis system |
US5157258A (en) * | 1989-08-21 | 1992-10-20 | Rockwell International Corporation | Multicolor infrared focal plane arrays |
US5354987A (en) * | 1992-12-07 | 1994-10-11 | Texas Instruments Incorporated | Calibrating focal plane arrays using multiple variable radiometric sources |
US5559336A (en) * | 1994-07-05 | 1996-09-24 | Santa Barbara Research Center | Integrated LPE-grown structure for simultaneous detection of infrared radiation in two bands |
US5877500A (en) * | 1997-03-13 | 1999-03-02 | Optiscan Biomedical Corporation | Multichannel infrared detector with optical concentrators for each channel |
US6465785B1 (en) * | 2000-05-05 | 2002-10-15 | Infrared Solutions, Inc. | Apparatus and method for compensating for pixel non-uniformity in a bolometer |
US20030102435A1 (en) * | 2001-11-20 | 2003-06-05 | Mark Myers | Multiband, single element wide field of view infrared imaging system |
US20030183756A1 (en) * | 2002-03-27 | 2003-10-02 | Huniu Lee J. | Display uniformity calibration system and method for a staring forward looking infrared sensor |
US20040111232A1 (en) * | 2002-05-22 | 2004-06-10 | Matthew Butler | Processing system for remote chemical identification |
US20060232675A1 (en) * | 2003-04-25 | 2006-10-19 | Land Instruments International Limited | Thermal imaging system and method |
US20040252300A1 (en) * | 2003-06-12 | 2004-12-16 | Slater Richard C. | Chemical identification by flash spectroscopy |
US20070018105A1 (en) * | 2003-10-02 | 2007-01-25 | Ernest Grimberg | Infra-red (ir) sensor with controllable sensitivity |
US7433042B1 (en) * | 2003-12-05 | 2008-10-07 | Surface Optics Corporation | Spatially corrected full-cubed hyperspectral imager |
US7242478B1 (en) * | 2003-12-05 | 2007-07-10 | Surface Optics Corporation | Spatially corrected full-cubed hyperspectral imager |
US7109488B2 (en) * | 2004-02-26 | 2006-09-19 | The United States Of America As Represented By The Secretary Of The Army | Multi-color infrared imaging device |
US20060279632A1 (en) * | 2005-05-26 | 2006-12-14 | Anderson Shane M | Method for fixed pattern noise reduction in infrared imaging cameras |
US20080204744A1 (en) * | 2005-07-11 | 2008-08-28 | Jose Mir | High Speed, Optically-Multiplexed, Hyperspectral Imagers and Methods Thereof |
US20070075888A1 (en) * | 2005-09-30 | 2007-04-05 | Michael Kelly | Digital readout method and apparatus |
US8027041B1 (en) * | 2006-06-08 | 2011-09-27 | Wavefront Research, Inc. | Compact snapshot multispectral imaging system |
US20090252650A1 (en) * | 2006-08-16 | 2009-10-08 | Sridhar Lakshmanan | Portable mems-based spectral identification system |
US20080170140A1 (en) * | 2007-01-11 | 2008-07-17 | Silver Alan G | Video Camera System Using Multiple Image Sensors |
US20080251724A1 (en) * | 2007-04-11 | 2008-10-16 | Baliga Shankar B | Gas and/or flame imaging system |
US20110176577A1 (en) * | 2008-12-08 | 2011-07-21 | California Institute Of Technology | Superpixel multi-waveband photodetector array for remote temperature measurement |
US20100162206A1 (en) * | 2008-12-24 | 2010-06-24 | Flir Systems Ab | Executable code in digital image files |
US8373757B1 (en) * | 2009-02-23 | 2013-02-12 | Flir Systems, Inc. | Flat field correction for infrared cameras |
US20140139643A1 (en) * | 2009-06-03 | 2014-05-22 | Flir Systems, Inc. | Imager with array of multiple infrared imaging modules |
US20100309467A1 (en) * | 2009-06-05 | 2010-12-09 | Spectral Sciences, Inc. | Single-Shot Spectral Imager |
US20130307991A1 (en) * | 2009-11-06 | 2013-11-21 | Steven Olsen | Infrared sensor control architecture |
CA2787303A1 (en) * | 2010-01-19 | 2011-07-28 | Delacom Detection Systems, Llc | A method, device and system for determining the presence of volatile organic compounds (voc) in video |
US20130235256A1 (en) * | 2010-11-16 | 2013-09-12 | Kenichi Kodama | Multiband camera, and multiband image capturing method |
US20130206990A1 (en) * | 2011-08-22 | 2013-08-15 | ISC8 Inc. | Background Limited Focal Plane Array Assembly |
US20150288894A1 (en) * | 2011-11-04 | 2015-10-08 | Imec | Spectral camera with mirrors for projecting multiple adjacent image copies onto sensor array |
US20130228887A1 (en) * | 2012-03-01 | 2013-09-05 | Raytheon Company | Photodetector with surface plasmon resonance |
US9625318B2 (en) * | 2012-05-18 | 2017-04-18 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system for chemical detection |
US9395516B2 (en) * | 2012-05-28 | 2016-07-19 | Nikon Corporation | Imaging device |
US20130342680A1 (en) * | 2012-06-21 | 2013-12-26 | Providence Photonics, Llc | Multi-spectral infrared imaging system for flare combustion efficiency monitoring |
US20160313181A1 (en) * | 2013-06-18 | 2016-10-27 | Ramot At Tel-Aviv University Ltd. | Apparatus and method for snapshot spectral imaging |
US20160238454A1 (en) * | 2013-09-16 | 2016-08-18 | Selex Es Ltd | Thermal imaging calibration system and method |
GB2518224A (en) * | 2013-09-16 | 2015-03-18 | Selex Es Ltd | Thermal imaging calibration system and method |
US20160245698A1 (en) * | 2013-10-16 | 2016-08-25 | The Arizona Board Of Regents On Behalf Of The University Of Arizona | Multispectral imaging based on computational imaging and a narrow-band absorptive filter array |
US20150144770A1 (en) * | 2013-11-26 | 2015-05-28 | nanoLambda Korea | Multispectral imager with hybrid double layer filter array |
US20160380014A1 (en) * | 2014-01-27 | 2016-12-29 | INVIS Technologies Corporation | Thermal Imaging Device |
US20160037089A1 (en) * | 2014-07-30 | 2016-02-04 | Raytheon Company | Multi-band thermal imaging sensor with integrated filter array |
US9641772B2 (en) * | 2014-11-19 | 2017-05-02 | Northrop Grumman Systems Corporation | Compact PMMW camera calibration target |
US9644562B2 (en) * | 2014-12-03 | 2017-05-09 | Denso Corporation | Injector driving apparatus |
Cited By (53)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10444070B2 (en) | 2012-05-18 | 2019-10-15 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
US9625318B2 (en) | 2012-05-18 | 2017-04-18 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system for chemical detection |
US11313724B2 (en) | 2012-05-18 | 2022-04-26 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system for chemical detection |
US11821792B2 (en) | 2012-05-18 | 2023-11-21 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system for chemical detection |
US10989597B2 (en) | 2012-05-18 | 2021-04-27 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system for chemical detection |
US10914632B2 (en) | 2012-05-18 | 2021-02-09 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
US11879775B2 (en) | 2012-05-18 | 2024-01-23 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
US10254166B2 (en) | 2012-05-18 | 2019-04-09 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system for chemical detection |
US9599508B2 (en) | 2012-05-18 | 2017-03-21 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
US11867564B2 (en) | 2013-11-12 | 2024-01-09 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
US10914639B2 (en) | 2013-11-12 | 2021-02-09 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
US11326957B2 (en) | 2013-11-12 | 2022-05-10 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
US20170205290A1 (en) | 2013-11-12 | 2017-07-20 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
US10267686B2 (en) | 2013-11-12 | 2019-04-23 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
US10893220B2 (en) | 2014-05-01 | 2021-01-12 | Rebellion Photonics, Inc. | Dual-band divided-aperture infra-red spectral imaging system |
US11805221B2 (en) | 2014-05-01 | 2023-10-31 | Rebellion Photonics, Inc. | Dual-band divided-aperture infra-red spectral imaging system |
US9756263B2 (en) | 2014-05-01 | 2017-09-05 | Rebellion Photonics, Inc. | Mobile gas and chemical imaging camera |
US11290662B2 (en) | 2014-05-01 | 2022-03-29 | Rebellion Photonics, Inc. | Mobile gas and chemical imaging camera |
US10084975B2 (en) | 2014-05-01 | 2018-09-25 | Rebellion Photonics, Inc. | Mobile gas and chemical imaging camera |
US10834338B2 (en) | 2014-05-01 | 2020-11-10 | Rebllion Photonics, Inc. | Mobile gas and chemical imaging camera |
US11917321B2 (en) | 2014-05-01 | 2024-02-27 | Rebellion Photonics, Inc. | Mobile gas and chemical imaging camera |
US11796454B2 (en) | 2014-07-07 | 2023-10-24 | Rebellion Photonics, Inc. | Gas leak emission quantification with a gas cloud imager |
US10458905B2 (en) | 2014-07-07 | 2019-10-29 | Rebellion Photonics, Inc. | Gas leak emission quantification with a gas cloud imager |
US10648960B2 (en) | 2015-05-29 | 2020-05-12 | Rebellion Photonics, Inc. | Hydrogen sulfide imaging system |
US11287409B2 (en) | 2015-05-29 | 2022-03-29 | Rebellion Photonics, Inc. | Hydrogen sulfide imaging system |
US11846619B2 (en) | 2015-05-29 | 2023-12-19 | Rebellion Photonics, Inc. | Hydrogen sulfide imaging system |
US20180195955A1 (en) * | 2015-08-13 | 2018-07-12 | Halliburton Energy Services, Inc. | Calibration of optical computing devices using traceable filters |
US10551302B2 (en) * | 2015-08-13 | 2020-02-04 | Halliburton Energy Services, Inc. | Calibration of optical computing devices using traceable filters |
US11410419B2 (en) * | 2016-07-21 | 2022-08-09 | L3 Technologies, Inc. | Enhanced vision systems and methods |
US11676377B2 (en) | 2016-07-21 | 2023-06-13 | Eotech, Llc | Enhanced vision systems and methods |
US11044423B2 (en) | 2016-10-21 | 2021-06-22 | Rebellion Photonics, Inc. | Mobile gas and chemical imaging camera |
US10375327B2 (en) | 2016-10-21 | 2019-08-06 | Rebellion Photonics, Inc. | Mobile gas and chemical imaging camera |
US10948404B2 (en) | 2016-10-21 | 2021-03-16 | Rebellion Photonics, Inc. | Gas imaging system |
US11733158B2 (en) | 2016-10-21 | 2023-08-22 | Rebellion Photonics, Inc. | Gas imaging system |
US10955355B2 (en) | 2017-02-22 | 2021-03-23 | Rebellion Photonics, Inc. | Systems and methods for monitoring remote installations |
US11467098B2 (en) | 2017-02-22 | 2022-10-11 | Rebellion Photonics, Inc. | Systems and methods for monitoring remote installations |
US10778914B2 (en) * | 2017-03-30 | 2020-09-15 | Expantrum Optoelectronics | Portable multispectral imaging device and method of reducing interference of displayed images thereof |
US20180279967A1 (en) * | 2017-03-30 | 2018-10-04 | Expantrum Optoelectronics | Portable multispectral imaging device and method of reducing interference of displayed images thereof |
US10605725B2 (en) | 2017-11-09 | 2020-03-31 | Rebellion Photonics, Inc. | Window obscuration sensors for mobile gas and chemical imaging cameras |
US11391671B2 (en) | 2017-11-09 | 2022-07-19 | Rebellion Photonics, Inc. | Window obscuration sensors for mobile gas and chemical imaging cameras |
US11698339B2 (en) | 2017-11-09 | 2023-07-11 | Rebellion Photonics, Inc. | Window obscuration sensors for mobile gas and chemical imaging cameras |
US11313791B2 (en) | 2017-11-09 | 2022-04-26 | Rebellion Photonics, Inc. | Window obscuration sensors for mobile gas and chemical imaging cameras |
US11933723B2 (en) | 2017-11-09 | 2024-03-19 | Rebellion Photonics, Inc. | Window obscuration sensors for mobile gas and chemical imaging cameras |
US11624705B2 (en) | 2017-11-09 | 2023-04-11 | Rebellion Photonics, Inc. | Window obscuration sensors for mobile gas and chemical imaging cameras |
US10809127B2 (en) * | 2018-10-10 | 2020-10-20 | Samsung Electronics Co., Ltd. | Method and apparatus for analyzing spectral information |
US20200116567A1 (en) * | 2018-10-10 | 2020-04-16 | Samsung Electronics Co., Ltd. | Method and apparatus for analyzing spectral information |
US11156456B2 (en) * | 2019-05-21 | 2021-10-26 | Apple Inc. | Optical proximity sensor integrated into a camera module for an electronic device |
US11854256B1 (en) * | 2019-07-09 | 2023-12-26 | ACME Atronomatic, LLC | Methods and devices for earth remote sensing using stereoscopic hyperspectral imaging in the visible (VIS) and infrared (IR) bands |
CN111458051A (en) * | 2020-03-09 | 2020-07-28 | 西安电子科技大学 | Three-dimensional temperature field measuring system and method based on pixel-level spectral photodetector |
US20220070366A1 (en) * | 2020-08-28 | 2022-03-03 | Canon Kabushiki Kaisha | Image capturing apparatus, method thereof, and storage medium |
US11743577B2 (en) * | 2020-08-28 | 2023-08-29 | Canon Kabushiki Kaisha | Image capturing apparatus, method thereof, and storage medium |
CN112634271A (en) * | 2021-03-09 | 2021-04-09 | 南京智谱科技有限公司 | Method and equipment for determining critical value of gas leakage amount detected by infrared camera |
CN112634271B (en) * | 2021-03-09 | 2021-06-18 | 南京智谱科技有限公司 | Method and equipment for determining critical value of gas leakage amount detected by infrared camera |
Also Published As
Publication number | Publication date |
---|---|
US20190273875A1 (en) | 2019-09-05 |
US10893220B2 (en) | 2021-01-12 |
US20220182560A1 (en) | 2022-06-09 |
US20150316473A1 (en) | 2015-11-05 |
US10084975B2 (en) | 2018-09-25 |
US9756263B2 (en) | 2017-09-05 |
US20190373185A1 (en) | 2019-12-05 |
US20180077363A1 (en) | 2018-03-15 |
US11805221B2 (en) | 2023-10-31 |
US10834338B2 (en) | 2020-11-10 |
US20210352226A1 (en) | 2021-11-11 |
US20240098214A1 (en) | 2024-03-21 |
US11917321B2 (en) | 2024-02-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11805221B2 (en) | Dual-band divided-aperture infra-red spectral imaging system | |
US11867564B2 (en) | Divided-aperture infra-red spectral imaging system | |
US11879775B2 (en) | Divided-aperture infra-red spectral imaging system | |
US11287409B2 (en) | Hydrogen sulfide imaging system | |
US10989597B2 (en) | Divided-aperture infra-red spectral imaging system for chemical detection | |
EP2955496B1 (en) | Dual band divided aperture infrared spectral imager (daisi) for chemical detection |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SILICON VALLEY BANK, CALIFORNIA Free format text: SECURITY INTEREST;ASSIGNOR:REBELLION PHOTONICS, INC.;REEL/FRAME:046212/0512 Effective date: 20170703 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |