WO2017182440A1 - Improvements in or relating to optical remote sensing systems for aerial and aquatic fauna, and use thereof - Google Patents
Improvements in or relating to optical remote sensing systems for aerial and aquatic fauna, and use thereof Download PDFInfo
- Publication number
- WO2017182440A1 WO2017182440A1 PCT/EP2017/059127 EP2017059127W WO2017182440A1 WO 2017182440 A1 WO2017182440 A1 WO 2017182440A1 EP 2017059127 W EP2017059127 W EP 2017059127W WO 2017182440 A1 WO2017182440 A1 WO 2017182440A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electromagnetic radiation
- lidar system
- detector
- measurement volume
- processor
- Prior art date
Links
- 230000003287 optical effect Effects 0.000 title claims abstract description 40
- 241000238631 Hexapoda Species 0.000 claims abstract description 108
- 241001465754 Metazoa Species 0.000 claims abstract description 63
- 230000005670 electromagnetic radiation Effects 0.000 claims description 201
- 238000005259 measurement Methods 0.000 claims description 127
- 241000894007 species Species 0.000 claims description 79
- 238000000034 method Methods 0.000 claims description 43
- 238000004458 analytical method Methods 0.000 claims description 30
- 238000001514 detection method Methods 0.000 claims description 27
- XUMBMVFBXHLACL-UHFFFAOYSA-N Melanin Chemical compound O=C1C(=O)C(C2=CNC3=C(C(C(=O)C4=C32)=O)C)=C2C4=CNC2=C1C XUMBMVFBXHLACL-UHFFFAOYSA-N 0.000 claims description 26
- 238000005507 spraying Methods 0.000 claims description 26
- 238000012544 monitoring process Methods 0.000 claims description 23
- 230000010287 polarization Effects 0.000 claims description 21
- 238000003384 imaging method Methods 0.000 claims description 18
- 239000000575 pesticide Substances 0.000 claims description 18
- 238000010521 absorption reaction Methods 0.000 claims description 14
- 230000004044 response Effects 0.000 claims description 14
- 239000003905 agrochemical Substances 0.000 claims description 13
- 238000005286 illumination Methods 0.000 claims description 12
- 229920002101 Chitin Polymers 0.000 claims description 11
- 238000007493 shaping process Methods 0.000 claims description 10
- 238000009826 distribution Methods 0.000 claims description 8
- 230000003595 spectral effect Effects 0.000 claims description 7
- 230000004308 accommodation Effects 0.000 claims description 6
- 238000010191 image analysis Methods 0.000 claims description 5
- 230000009418 agronomic effect Effects 0.000 claims description 4
- 230000001419 dependent effect Effects 0.000 claims description 3
- 239000013307 optical fiber Substances 0.000 claims description 3
- 230000001629 suppression Effects 0.000 claims description 3
- 241000288673 Chiroptera Species 0.000 abstract description 13
- 241000271566 Aves Species 0.000 abstract description 6
- 241000255925 Diptera Species 0.000 description 18
- 239000003990 capacitor Substances 0.000 description 15
- 201000004792 malaria Diseases 0.000 description 13
- 230000035559 beat frequency Effects 0.000 description 12
- 239000011159 matrix material Substances 0.000 description 12
- 229910000530 Gallium indium arsenide Inorganic materials 0.000 description 7
- KXNLCSXBJCPWGL-UHFFFAOYSA-N [Ga].[As].[In] Chemical compound [Ga].[As].[In] KXNLCSXBJCPWGL-UHFFFAOYSA-N 0.000 description 7
- 230000000694 effects Effects 0.000 description 7
- 238000004519 manufacturing process Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 239000000126 substance Substances 0.000 description 7
- 238000009360 aquaculture Methods 0.000 description 6
- 244000144974 aquaculture Species 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000005855 radiation Effects 0.000 description 6
- 238000005070 sampling Methods 0.000 description 6
- 239000004065 semiconductor Substances 0.000 description 6
- 230000002123 temporal effect Effects 0.000 description 5
- 241000790794 Argulus Species 0.000 description 4
- 241000607479 Yersinia pestis Species 0.000 description 4
- 239000003086 colorant Substances 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- NJPPVKZQTLUDBO-UHFFFAOYSA-N novaluron Chemical compound C1=C(Cl)C(OC(F)(F)C(OC(F)(F)F)F)=CC=C1NC(=O)NC(=O)C1=C(F)C=CC=C1F NJPPVKZQTLUDBO-UHFFFAOYSA-N 0.000 description 4
- 238000002310 reflectometry Methods 0.000 description 4
- 238000000926 separation method Methods 0.000 description 4
- 238000001228 spectrum Methods 0.000 description 4
- 241000251468 Actinopterygii Species 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 238000007405 data analysis Methods 0.000 description 3
- 238000013480 data collection Methods 0.000 description 3
- 238000013500 data storage Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 201000010099 disease Diseases 0.000 description 3
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 241000283153 Cetacea Species 0.000 description 2
- 241000195493 Cryptophyta Species 0.000 description 2
- 241001674048 Phthiraptera Species 0.000 description 2
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 2
- 230000003115 biocidal effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 239000008280 blood Substances 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 229930002875 chlorophyll Natural products 0.000 description 2
- 235000019804 chlorophyll Nutrition 0.000 description 2
- ATNHDLDRLWWWCB-AENOIHSZSA-M chlorophyll a Chemical compound C1([C@@H](C(=O)OC)C(=O)C2=C3C)=C2N2C3=CC(C(CC)=C3C)=[N+]4C3=CC3=C(C=C)C(C)=C5N3[Mg-2]42[N+]2=C1[C@@H](CCC(=O)OC\C=C(/C)CCC[C@H](C)CCC[C@H](C)CCCC(C)C)[C@H](C)C2=C5 ATNHDLDRLWWWCB-AENOIHSZSA-M 0.000 description 2
- 238000004040 coloring Methods 0.000 description 2
- 238000012505 colouration Methods 0.000 description 2
- 230000034994 death Effects 0.000 description 2
- 231100000517 death Toxicity 0.000 description 2
- 239000000428 dust Substances 0.000 description 2
- 230000001747 exhibiting effect Effects 0.000 description 2
- 238000009313 farming Methods 0.000 description 2
- 208000010824 fish disease Diseases 0.000 description 2
- 238000011065 in-situ storage Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000010809 marine debris Substances 0.000 description 2
- 235000012054 meals Nutrition 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 239000012528 membrane Substances 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000010355 oscillation Effects 0.000 description 2
- 230000003534 oscillatory effect Effects 0.000 description 2
- 239000000049 pigment Substances 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 238000011896 sensitive detection Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 230000036962 time dependent Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000011282 treatment Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 241001182413 Aboma Species 0.000 description 1
- 208000000230 African Trypanosomiasis Diseases 0.000 description 1
- 241000134426 Ceratopogonidae Species 0.000 description 1
- 241001502567 Chikungunya virus Species 0.000 description 1
- 208000001490 Dengue Diseases 0.000 description 1
- 206010012310 Dengue fever Diseases 0.000 description 1
- 208000011312 Vector Borne disease Diseases 0.000 description 1
- 241000710886 West Nile virus Species 0.000 description 1
- 208000003152 Yellow Fever Diseases 0.000 description 1
- 241000907316 Zika virus Species 0.000 description 1
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical compound [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 description 1
- 229910052782 aluminium Inorganic materials 0.000 description 1
- 239000004411 aluminium Substances 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 230000027288 circadian rhythm Effects 0.000 description 1
- 230000002498 deadly effect Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 208000025729 dengue disease Diseases 0.000 description 1
- 235000005911 diet Nutrition 0.000 description 1
- 230000000378 dietary effect Effects 0.000 description 1
- 235000013305 food Nutrition 0.000 description 1
- 208000029080 human African trypanosomiasis Diseases 0.000 description 1
- 239000002917 insecticide Substances 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000004920 integrated pest control Methods 0.000 description 1
- 238000012417 linear regression Methods 0.000 description 1
- 244000144972 livestock Species 0.000 description 1
- 238000012634 optical imaging Methods 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 230000003094 perturbing effect Effects 0.000 description 1
- 238000009372 pisciculture Methods 0.000 description 1
- 238000000611 regression analysis Methods 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 201000002612 sleeping sickness Diseases 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 238000001926 trapping method Methods 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
- A01M—CATCHING, TRAPPING OR SCARING OF ANIMALS; APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS
- A01M31/00—Hunting appliances
- A01M31/002—Detecting animals in a given area
-
- A—HUMAN NECESSITIES
- A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
- A01K—ANIMAL HUSBANDRY; AVICULTURE; APICULTURE; PISCICULTURE; FISHING; REARING OR BREEDING ANIMALS, NOT OTHERWISE PROVIDED FOR; NEW BREEDS OF ANIMALS
- A01K11/00—Marking of animals
- A01K11/006—Automatic identification systems for animals, e.g. electronic devices, transponders for animals
-
- A—HUMAN NECESSITIES
- A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
- A01K—ANIMAL HUSBANDRY; AVICULTURE; APICULTURE; PISCICULTURE; FISHING; REARING OR BREEDING ANIMALS, NOT OTHERWISE PROVIDED FOR; NEW BREEDS OF ANIMALS
- A01K29/00—Other apparatus for animal husbandry
-
- A—HUMAN NECESSITIES
- A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
- A01M—CATCHING, TRAPPING OR SCARING OF ANIMALS; APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS
- A01M1/00—Stationary means for catching or killing insects
- A01M1/02—Stationary means for catching or killing insects with devices or substances, e.g. food, pheronones attracting the insects
- A01M1/026—Stationary means for catching or killing insects with devices or substances, e.g. food, pheronones attracting the insects combined with devices for monitoring insect presence, e.g. termites
-
- A—HUMAN NECESSITIES
- A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
- A01M—CATCHING, TRAPPING OR SCARING OF ANIMALS; APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS
- A01M25/00—Devices for dispensing poison for animals
- A01M25/006—Poison applicators, i.e. mobile devices for disposing poison wherever required, e.g. into holes, burrows, walls or ground
-
- A—HUMAN NECESSITIES
- A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
- A01M—CATCHING, TRAPPING OR SCARING OF ANIMALS; APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS
- A01M7/00—Special adaptations or arrangements of liquid-spraying apparatus for purposes covered by this subclass
- A01M7/0089—Regulating or controlling systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/46—Indirect determination of position data
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/4802—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
- G01S7/4815—Constructional features, e.g. arrangements of optical elements of transmitters alone using multiple transmitters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4816—Constructional features, e.g. arrangements of optical elements of receivers alone
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/497—Means for monitoring or calibrating
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/499—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00 using polarisation effects
-
- A—HUMAN NECESSITIES
- A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
- A01M—CATCHING, TRAPPING OR SCARING OF ANIMALS; APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS
- A01M2200/00—Kind of animal
- A01M2200/01—Insects
- A01M2200/012—Flying insects
Definitions
- the present disclosure relates to the field of aerial and aquatic fauna, in particular, to optical remote sensing, known as LIDAR (Light Detection and Ranging).
- LIDAR Light Detection and Ranging
- Improved LIDAR systems and methods are provided for measuring, quantifying, monitoring, classifying, specifying, surveying, predicting, forecasting, investigating, and/or warning against aerial and/or aquatic fauna, e.g. for use in a number of fields and applications, such as agronomics, malaria control, windmill parks, aquaculture production, e.g. fish farms, and science, e.g.
- Atmospheric fauna comprises insects that play a crucial role in the earth's ecosystem and influence civilization in multiple ways; including as pollinators for food production, as pests that can have a devastating effect on agriculture, and as mosquitoes and biting midges that can transmit deadly diseases to humans and livestock.
- the traditional method is using traps in which insects are caught for subsequent inspection and analysis.
- Various types of traps are used and the trap method has for decades been the preferred method for entomologists to determine insect information, such as species, gender, age classification, micromorphology, and dietary information.
- the method is highly laborious, time-consuming and costly per insect.
- the numbers of insects that can be studied are limited to the number of insects that may be trapped (typically in the single to tens, or low hundreds), the available resources (man-power), or the accessibility of the area/atmospheric region of interest.
- many trapping methods are known to be biased and perturbing (Muirhead-Thomson R, Trap responses of flying insects: The influence of trap design on capture efficiency, Academic Press (1991 )).
- LIDAR systems have been proposed, see for example Brydegaard S0rensen, Mikkel LU ; Guan, Switzerlanduang LU ; Wellenreuther, Maren LU and Svanberg, Sune LU (2009) In Applied Optics 48(30). p.5668-5677).
- LIDAR systems for aerial fauna have been the subject of significant research and comprise a laser beam that is transmitted into the atmosphere and a receiver/detector that measures the backscattered laser light from insects.
- the systems are capable of counting the number events, where an insect intersects with the laser beam. Due to the long range of laser beam, large atmospheric regions may be analysed for aerial fauna.
- the systems are capable of counting a large number of insects, such as in the tens to hundreds of thousands, and even up to millions.
- vector-borne diseases such as malaria, yellow fever, zika virus, HAT and AAT sleeping sickness, Chikungunya virus, Dengue fever, West Nile virus, etc.
- a LIDAR system for analysing fauna comprising
- At least one source of electromagnetic radiation that is adapted for emission of
- At least one detector of electromagnetic radiation that is arranged for provision of at least one output signal in response to reception of electromagnetic radiation having interacted with the animals in the measurement volume
- a processor that is adapted for detecting animals in the measurement volume based on the at least one output signal.
- the processor may further be adapted for counting detected animals.
- the processor may further be adapted for determination of at least one parameter of the received electromagnetic radiation relating to the species of the detected animals.
- the processor may further be adapted for comparison of the determined at least one parameter with a set of reference data for different species and for generation of information on biological specificity of the animals based on the comparison.
- the comparison may include comparison of a distribution of values of the at least one parameter with a corresponding distribution of values of the set of reference data.
- the comparison may include utilization of regression analysis, such as linear regression analysis.
- the comparison may include utilization of clustering.
- the comparison may include formation of histograms of values of the determined at least one parameter and formation of histograms of values of the at least one parameter of the set of reference data and comparison of one of more of the formed histograms of the determined at least one parameter with respective one or more formed histograms of the at least one parameter of the set of reference data.
- the set of reference data may include wing beat frequencies of various species of male and female mosquitoes obtained under laboratory conditions.
- male and female mosquitoes of the same species have different wing beat frequencies.
- the wing beat frequencies are obtained by releasing a number of individuals of the same sex and type and determining their wing beat frequencies with a laboratory LIDAR system sequentially for a number of types of mosquitoes. Histograms of wing beat frequencies may then be formed for male mosquitoes of each species and for female mosquitoes of each species.
- a histogram of all wing beat frequencies determined in the field may then be compared with the previously determined histograms of wing beat frequencies for each sex and each species for identification of possible presence of the respective sex and species in the determined field data.
- the measurement volume is a volume in space that is illuminated by the at least one source of electromagnetic radiation and that resides in a viewing field of the at least one detector.
- the measurement volume may have a diameter ranging from 5 cm to 20 cm, such as from 8 cm to 15 cm.
- One end of the measurement volume may be located within a distance of 1 m from the at least one source of electromagnetic radiation of the LIDAR system, and the other end of the measurement volume may be located 1 km from the at least one source of electromagnetic radiation.
- the measurement volume may have a diameter of 12 cm with one end of the measurement volume located 30 m from the at least one source of electromagnetic radiation and the other end of the measurement volume located 200 m from the at least one source of electromagnetic radiation.
- an insect in the measurement volume, it is illuminated by and scatters the electromagnetic radiation.
- a part of the scattered radiation propagates towards the at least one detector that outputs the at least one output signal in response to reception of the scattered electromagnetic radiation so that the animal in the measurement volume can be detected.
- reception of scattered electromagnetic radiation from an animal in the measurement volume is termed an event.
- LIDAR systems such as a LIDAR system wherein the at least one detector comprises a linear CCD or CMOS array arranged in accordance with the Scheimpflug principle as further disclosed in the following, can distinguish scattered electromagnetic radiation from individual animals also when more than one animals are in the measurement volume simultaneously.
- the received scattered electromagnetic radiation contains information about the animal that has scattered the electromagnetic radiation.
- the processor of the LIDAR system is adapted to extract at least part of the information from the received scattered electromagnetic radiation by the determination of the at least one parameter of the received electromagnetic radiation relating to the animal that has scattered the electromagnetic radiation.
- the LIDAR system may comprise a processor unit with the processor.
- the LIDAR system may comprise a processor unit with a processor housing accommodating the processor.
- the LIDAR system may comprise a transmitter unit with the at least one source of electromagnetic radiation.
- the LIDAR system may comprise a transmitter unit with a transmitter housing
- the LIDAR system may comprise a receiver unit with the at least one detector of electromagnetic radiation.
- the LIDAR system may comprise a receiver unit with a receiver housing accommodating the at least one detector of electromagnetic radiation.
- the at least one source of electromagnetic radiation may emit radiation in the Near- Infrared (NIR) range, e.g. having wavelengths ranging from 750 nm to 1400 nm.
- NIR Near- Infrared
- the at least one source of electromagnetic radiation may emit radiation in the Short- Wavelength Infrared (SWIR) range, e.g. having wavelengths ranging from 1400 nm to 3000 nm.
- SWIR Short- Wavelength Infrared
- the at least one source of electromagnetic radiation may comprise one or more lasers, e.g. including a continuous wave laser, for emission of respective one or more beams of electromagnetic radiation.
- the at least one source of electromagnetic radiation may comprise at least one, such as at least two lasers, for emission of electromagnetic radiation of respective at least two different centre wavelengths w1 , w2, ... , wn.
- w1 and w2 are separated by at least 100 nm.
- w1 and w2 may be near-infrared wavelengths for eye-safety reasons, for example w1 may be equal to, or approximately equal to 808 nm, and w2 may be equal to, or approximately equal to 980 nm; or, w1 may be equal to, or approximately equal to 980 nm, and w2 may be equal to, or approximately equal to 1550 nm.
- the at least one source of electromagnetic radiation may comprise a laser emitting radiation at a plurality of frequencies, such as a fundamental frequency and a plurality of harmonics, such as first, second, and third harmonics.
- the at least one source of electromagnetic radiation may comprise two separate continuous wave (CW) lasers.
- the at least one source of electromagnetic radiation may comprise a diode laser, an array of diode lasers, a supercontinuum source, etc.
- a supercontinuum source may be obtained from commercial vendors, such as Eagleyard Photonics GmbH or NKT Photonics A/S.
- the at least one source of electromagnetic radiation may be arranged for emission of electromagnetic radiation of at least two different polarization states p1 , p2.
- the at least one source of electromagnetic radiation may include a diode laser, e.g. a diode laser with an output power in the range from 100 mW to 3 W.
- the at least one detector may include a diode laser, e.g. a diode laser with an output power in the range from 100 mW to 3 W.
- the at least one detector is arranged for reception of electromagnetic radiation having interacted with the animal in the measurement volume, and may also be arranged for detection of direction of movement of the animal through the measurement volume.
- the at least one detector may include a quadrant detector wherein each quadrant provides an output signal in response to reception of electromagnetic radiation enabling detection of direction of movement of an animal through the measurement volume based on the timing of the output signals from each quadrant.
- the at least one detector may also capable of resolving wing-beat frequency provided that the sampling frequency is above 2 kHz, such as above 3 kHz, etc., since the fundamental wing-beat frequency of insects is at most 1 kHz.
- the sampling frequency may be 3 kHz.
- the LIDAR system may comprise at least one first detector of the at least one detector of electromagnetic radiation that is arranged for reception of backscattered electromagnetic radiation from the measurement volume.
- the LIDAR system may comprise at least one second detector of the at least one detector of electromagnetic radiation that is arranged for reception of electromagnetic radiation from the measurement volume from a first angle different from the direction; i.e. the forward or backward direction, of propagation of the electromagnetic radiation emitted by the at least one source of electromagnetic radiation, e.g. in accordance with the Scheimpflug principle.
- the LIDAR system may comprise at least one third detector of the at least one detector of electromagnetic radiation that is arranged for reception of electromagnetic radiation from the measurement volume from a second angle different from the direction; i.e. the forward or backward direction, of propagation of the electromagnetic radiation emitted by the at least one source of electromagnetic radiation and different from the first angle, e.g. in accordance with the Scheimpflug principle.
- the at least one detector of electromagnetic radiation may comprise a semiconductor detector, such as a Silicium (Si) detector, such as a Si quadrant detector, for example a Si detector suitable for detection of electromagnetic radiation ranging from 0.19 ⁇ to 1 ⁇ .
- the Si detector is also capable of resolving wing-beat frequency provided that the sampling frequency is above 2 kHz, such as 3 kHz and above 3 kHz, since the fundamental wing-beat frequency of insects is at most 1 kHz.
- the at least one detector of electromagnetic radiation may comprise an Indium-Gallium- Arsenide (InGaAs) detector, e.g. an InGaAs quadrant detector, e.g. for detection of electromagnetic radiation ranging from 0.9 ⁇ to 1 .7 ⁇ .
- InGaAs Indium-Gallium- Arsenide
- the InGaAs detector may also be capable of resolving wing-beat frequency provided that the sampling frequency is above 2 kHz, such as 3 kHz and above 3 kHz, since the fundamental wing-beat frequency of insects is at most 1 kHz.
- the at least one detector of electromagnetic radiation may comprise an array of
- detectors such as a two-dimensional array of detectors, a linear array of detectors, etc., e.g., a two-dimensional CCD or CMOS array, or a linear CCD or CMOS array, such as a linear CCD or CMOS array with 2048 pixels, wherein each of the detectors, also denoted pixels, of the CCD or CMOS array is arranged for reception of
- Each detector of a CCD or CMOS array charges a capacitor in response to the
- the detector i.e. the electromagnetic radiation incident upon it, so that at each point in time the amount of charge of the capacitor corresponds to the integrated intensity of the electromagnetic radiation
- the entire set of charges of capacitors of the CCD or CMOS array is output at regular intervals and denoted a frame. Upon read-out of the capacitor charge values, the capacitors are reset to zero charge.
- the LIDAR system may comprise a first optical system arranged for cooperation with the least one first detector for reception of backscattered electromagnetic radiation from the measurement volume.
- the LIDAR system may comprise a second optical system arranged for cooperation with the at least one second detector in accordance with the Scheimpflug principle for reception of electromagnetic radiation from the measurement volume from a first angle different from the direction; i.e. the forward or backward direction, of propagation of the electromagnetic radiation emitted by the at least one source of electromagnetic radiation.
- the LIDAR system may comprise a third optical system arranged for cooperation with the at least one third detector of electromagnetic radiation in accordance with the Scheimpflug principle for reception of electromagnetic radiation from the measurement volume from a second angle different from the direction of propagation of the electromagnetic radiation emitted by the at least one source of electromagnetic radiation and different from the first angle of the second optical system.
- the system is designed according to the Scheimpflug principle and the Hinge rule.
- the LIDAR system may comprise at least one imaging system for imaging the measurement volume onto the respective one or more detector surfaces of the at least one detector, e.g., each of the first, second, and third optical systems may comprise at least one imaging system for imaging the measurement volume onto the one or more detector surfaces of the respective at least one first, second, and third detector.
- the at least one imaging system may comprise one or more lenses.
- the at least one imaging system may comprise one or more image forming mirrors.
- the at least one imaging system may comprise one or more diffractive optical elements.
- the at least one imaging system may comprise at least one telescope, e.g. including a Newtonian telescope, e.g. a 800 mm Newtonian telescope with a 200 mm diameter, for cooperation with the at least one detector for reception of electromagnetic radiation from the measurement volume.
- a Newtonian telescope e.g. a 800 mm Newtonian telescope with a 200 mm diameter
- the at least one imaging system may be coupled with, e.g., Si, InGaAs, etc., detectors, e.g. including a quadrant detector for detection of flight direction from the time series of the respective output signals from each quadrant.
- detectors e.g. including a quadrant detector for detection of flight direction from the time series of the respective output signals from each quadrant.
- the at least one imaging system may include two detection telescopes arranged with 90 degree mutual separation, an event, i.e. an animal traversing the measurement volume, may be viewed from the side and the top allowing for good reconstruction of the position of the animal within the measurement volume and flight direction may be determined, e.g. by the processor.
- the LIDAR system may have two or more detectors, and a dichroic beam splitter positioned in front of the, e.g. two, detectors, e.g. a Si detector, e.g. a Si quadrant detector, for detection of electromagnetic radiation ranging from 0.19 ⁇ to 1 ⁇ ; and an InGaAs detector for detection of electromagnetic radiation ranging from 0.9 ⁇ to 1.7 ⁇ .
- the dichroic beam splitter is adapted to transmit SWIR electromagnetic radiation and reflect NIR
- the at least one source of electromagnetic radiation may comprise at least one, such as at least two lasers, for emission of electromagnetic radiation of respective at least two different centre wavelengths w1 , w2, ...
- the transmitted laser beams of electromagnetic radiation having centre wavelengths w1 and w2 and wn are coinciding, or substantially coinciding, in the measurement volume for illumination of an animal, such as an insect, bird, bat, an aquatic organism, etc., with the same, or substantially the same, spot size and spot centre for different centre wavelengths w1 , w2, ... , wn.
- substantially the same spot size and spot centre is meant that the at least one detector of electromagnetic radiation does not detect signal differences relating to different beam paths of electromagnetic radiation at wavelengths w1 and w2, ... , wn.
- a person skilled in the art of optics and photonics would know how to design the at least one source of electromagnetic radiation with two separate wavelengths for illumination of a target/organism with substantially equal spot size and beam centre.
- the LIDAR system may comprise transmitter optics arranged for cooperation with the least one source of electromagnetic radiation for emission of the electromagnetic radiation towards the measurement volume.
- the transmitter optics may comprise optics for emission of laser light beams of at least two different polarization states p1 , p2 that are coinciding, or substantially coinciding, in the measurement volume for illumination of a living organism, such as an insect, bird, bat, an aquatic organism, etc., with the same, or substantially the same, spot size and spot centre for polarization states p1 , p2.
- the optics may comprise a half-waveplate to provide different beam paths in at least part of the system for beams of different polarization states p1 , p2.
- the optics may comprise an optical element, wherein the system is designed such that light of p1 or p2 is transmitted through the optical element in the Brewster angle.
- the transmitter optics may comprise one or more beam shapers, each of which is adapted for shaping the intensity profile of a respective laser beam into a desired profile, such as a Gaussian intensity profile, a top hat intensity profile, etc.
- the one or more beam shapers may comprise an optical fibre adapted for shaping the intensity profile of the beam into a Gaussian beam profile.
- the one or more beam shapers may comprise a phase contrast system adapted for shaping the intensity profile of the beam, such as a Gaussian intensity profile, at top hat intensity profile, etc.
- the transmitter optics may comprise a bandpass filter cooperating with the at least one detector for suppression of background signals and having a centre wavelength within the wavelength range of the at least one source of electromagnetic radiation.
- the transmitter optics may comprise a telescope, such as a 600 mm to 800 mm lens telescope with a 120 mm diameter.
- the processor may be adapted to count the number of animals, such as the number of insects, detected in the measurement volume over a time period.
- the processor may be adapted for controlling the at least one source of electromagnetic radiation and for turning the at least one source of electromagnetic radiation on and off alternatingly.
- the processor may be adapted for determination of background emission of electromagnetic radiation from the measurement volume when the at least one source of electromagnetic radiation is turned off.
- the processor may be connected to the at least one camera for reception of images from the at least one camera.
- the processor may be adapted for performing image analysis of images received from the at least one camera.
- the processor may be adapted for controlling the at least one source of electromagnetic radiation in response to the performed analysis.
- the processor may be adapted for performing image analysis of images received from the at least one camera for monitoring alignment of the at least one source of electromagnetic radiation and the at least one detector.
- the processor may be adapted for monitoring alignment of the at least one source of electromagnetic radiation and the at least one detector based on the at least one output signal from the at least one detector without an animal in the measurement volume.
- the processor may be adapted for monitoring objects, e.g. humans, proximate the electromagnetic radiation emitted by the at least one source of electromagnetic radiation.
- the processor may be adapted for turning the at least one source of electromagnetic radiation off to prevent inadvertent illumination of objects, e.g. humans, in the space that is otherwise illuminated by the electromagnetic radiation.
- the processor may be adapted to determine data based on electromagnetic radiation received from the object placed by the calibrator in the measurement volume.
- the processor may be adapted for controlling the scanner to move the measurement volume to scan a desired volume along a desired moving trajectory, e.g. to perform measurements throughout the desired volume larger than the measurement volume; or to perform measurements in sample volumes, e.g. in a regular pattern of volumes separated by volumes wherein no measurements are performed.
- the processor may be adapted for
- the processor may be adapted for
- the processor may be adapted for reception of data from the at least one detector of electromagnetic radiation and for analysis of the data in real time; or, may be adapted for data collection on a data storage, such as a hard disk, for subsequent analysis.
- about 30000 frames may be collected and saved in one file. This means that the data is effectively an array of 30000 x 2048, 16 bit values.
- the frames are collected at about 3 kHz so that every 10 seconds a file is saved.
- the processor may be adapted for controlling the source of electromagnetic radiation, e.g. a laser, two lasers, etc., and switch it off when a frame has been recorded and switch it on when a frame without emission of electromagnetic radiation from the source has been recorded and read out from the CCD or CMOS array. In this way, an alternating series of frames may be collected that has the source turned on and off, respectively.
- the source of electromagnetic radiation e.g. a laser, two lasers, etc.
- processor central processor
- signal processor signal processor
- controller means, "system”, etc., are intended to refer to CPU-related entities, either
- a "processor”, “signal processor”, “controller”, “system”, etc. may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
- processor central processor
- signal processor central processor
- controller central processor
- system designate both an application running on a processor and a hardware processor.
- processors central processors
- signal processor central processors
- processors may reside within a process and/or thread of execution, and one or more "processors”,
- a processor may be any component or any combination of components that is capable of performing signal processing.
- the processor may be any component or any combination of components that is capable of performing signal processing.
- processor may be an ASIC processor, a FPGA processor, a general purpose
- processor a microprocessor, a circuit component, or an integrated circuit.
- the reference data may comprise data for at least two different species, such as at least three, at least five, at least 10, at least 100, or at least 1000 species.
- the set of reference data comprises information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, microstructures of wings, such as periodicity and/or thickness.
- melanin melanin
- wax chitin
- haemoglobin a microstructures of wings, such as periodicity and/or thickness.
- melanin melanin, wax, chitin, haemoglobin, microstructures of wings, such as periodicity and/or thickness.
- melanin melanin, wax, chitin, haemoglobin, microstructures of wings, such as periodicity and/or thickness.
- the set of reference data comprises spectral differential absorption information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, and microstructures of wings, e.g., periodicity and/or thickness.
- the set of reference data comprises polarization-dependent absorption and/or reflectance information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, and microstructures of wings, e.g., periodicity and/or thickness.
- the set of reference data comprises differential spectral absorption data of different species.
- the set of reference data comprises differential polarization absorption and/or reflectance data of different species.
- the reference data further comprises information with respect to gender and/or age of a species.
- the set of reference data is obtained from operating a LIDAR for aerial fauna in an insectarium, also referred to as insectary, with predetermined species of insects.
- the set of reference data is obtained from operating a LIDAR for aerial fauna in an area with predetermined species of birds and/or bats, and/or or from operating the LIDAR with simultaneously determination of species of birds and/or bats via for example camera and imaging technologies, or via RADAR technologies).
- the set of reference data are obtained from operating a LIDAR for aquatic fauna in an aquarium with
- a method that generates a set of biological specificity data as the set of reference data by applying the LIDAR system for aerial fauna in an insectarium comprising at least one predetermine species, such as at least two, at least three, at least three, at least five, at least 10, at least 100, or at least 1000 predetermined species.
- the set of reference data may be embedded within the processor unit of the LIDAR system.
- the set of reference data may be accessed
- cloud computing providing computing power, database storage, applications, etc.
- a wide-area-network such as the Internet.
- the LIDAR system may comprise a mechanical frame for supporting various parts of the LIDAR system, e.g., a transmitter housing for accommodation of the at least one source of electromagnetic radiation mounted to the frame, and, e.g., at least one receiver housing for accommodation of the at least one detector of electromagnetic radiation mounted to the frame.
- the frame may comprise a girder, e.g., of aluminium.
- the transmitter housing and the at least one receiver housing may be mounted to the girder.
- the LIDAR system may comprise at least one camera arranged for monitoring of the LIDAR system, e.g. the measurement volume of the LIDAR system.
- the at least one camera may comprise at least one line scan camera.
- the LIDAR system may comprise at least one camera housing for accommodation of the at least one camera and/or line scan camera and mounted to the frame.
- the LIDAR system may comprise a scanner that is arranged for moving the frame, e.g. pan and/or tilt and/or pitch and/or traverse the frame, and thereby moving the measurement volume.
- the LIDAR system may comprise a calibrator arranged for placing an object with a known optical characteristic in the measurement volume.
- the LIDAR system may comprise a trap and a filming unit taking a photograph of an insect collected in the trap.
- the trap and the filming unit serve to provide additional information to the system, such as for verification, quality, or reference purposes or combinations of these.
- the LIDAR system may be portable.
- the LIDAR system may comprise
- a transmitter unit that emits laser light
- a receiver unit that receives a back-scattered portion of the laser light
- a processor unit e.g. data processing or computing unit, programmed to analyse the back-scattered light and generate a set of observations of living organisms, such as animals, such as insects, birds, bats, or aquatic organisms, for example plankton or argulus.
- the transmitter unit may be adapted to transmit laser light at at least two wavelengths, w1 and w2, ... , wn, and the receiver units may be adapted to measure light at w1 and w2, ... , wn separately, and the processor unit, as part of the analysis, may be adapted to calculate a difference in absorption at w1 and w2 and wn for each observation and generate information about the biological specificity of the living organisms, e.g.
- the LIDAR system may comprise
- a transmitter unit that emits laser light
- a receiver unit that receives a back-scattered portion of the laser light
- a processor unit e.g. data processing or computing unit, programmed to analyse the back-scattered light and generate a set of observations of living organisms, such as animals, such as insects, birds, bats, or aquatic organisms, for example plankton or argulus.
- the transmitter unit may be adapted to transmit laser light at at least two polarization states, p1 and p2, and/or the receiver units may be adapted to measure light at two polarization states, p1 and p2, separately, and the processor unit, as part of the
- analysis may be adapted to calculate the differential absorption and/or reflectance for each observation and generate information about the biological specificity of the living organisms, e.g. animals.
- the LIDAR system may comprise
- a transmitter unit that emits laser light
- a receiver unit that receives a back-scattered portion of the laser light
- processor unit e.g. data processing or computing unit, programmed to:
- living organisms such as animals, such as insects, birds, bats, or aquatic organisms, for example plankton or argulus.
- the transmitter unit may be adapted to transmit laser light at at least two wavelengths, w1 and w2, ... , wn, and the receiver units may be adapted to measure light at w1 and w2 and wn separately, and the processor unit, as part of the analysis, may be adapted to calculate a difference in absorption at w1 and w2 and wn for each observation, and to compare this to a set of reference data for different species, and to generate information about the biological specificity of the living organisms, e.g. animals, based on the comparison.
- the LIDAR system may comprise
- a transmitter unit that emits laser light
- a receiver unit that receives a back-scattered portion of the laser light
- a processor unit e.g. data processing or computing unit, programmed to analyse the back-scattered light and generate a set of observations of living organisms, such as animals, such as insects, birds, bats, or aquatic organisms, for example plankton or argulus.
- the transmitter unit may be adapted to transmit laser light at at least two polarization states, p1 and p2, and/or the receiver units may be adapted to measure light at two polarization states, p1 and p2, separately, and the processor unit, as part of the analysis, may be adapted to calculate the differential absorption and/or reflectance for each observation, and to compare this to a set of reference data for different species, and to generate information about the biological specificity of the living organisms, e.g. animals, based on the comparison.
- the reference data may comprise data for at least two different species, such as at least three, at least five, at least 10, at least 100, or at least 1000 species.
- the processor may be adapted to count the number of animals, such as the number of insects, detected in the measurement volume over a time period.
- the processor may further be adapted to extract data for each animal, e.g. for each insect, such as wing-beat oscillations, spherical scattering coefficient (size), spectral information in the optical domain of specific molecules, such as melanin, wax, chitin or haemoglobin, and also of microstructures such as wing membrane thickness.
- data for each animal e.g. for each insect, such as wing-beat oscillations, spherical scattering coefficient (size), spectral information in the optical domain of specific molecules, such as melanin, wax, chitin or haemoglobin, and also of microstructures such as wing membrane thickness.
- Scattering process from insects involves diffuse and specular reflectance. Specular reflection could come from the body or the wing depending on the type of species and nature of the body and wing of the insect. If an insect has a furry body and shiny wing or the opposite, the total scatter cross-section will be a combination of diffuse and specular reflections. This can be decomposed into different components to identify the body and wing contributions. In general, specular and diffuse reflectance contributes to the total optical cross-section OCS. The specular reflectance from the wing is
- the fundamental tone and lower harmonics represents the diffuse reflectance.
- chromatic properties of animals in the measurement volume may be determined, e.g. by the processor.
- iridescence features can be determined, e.g. by the processor, e.g. by comparing the shape of temporal waveforms of received electromagnetic radiation in the visible range VIS with electromagnetic radiation in the near infrared range NI R.
- melanisation properties can be determined, e.g. by the processor, e.g. by comparing OCS of insects in the N IR and SWI R ranges, since the optical cross-section ratio between N IR and SWI R scales with melanisation.
- Melanin is a natural pigment or chromophore that determines the colour of an insect's body and wings. Melanisation gives rise to dark or brownish appearance in the VIS. This is due to multiple reflections of the incident light interaction with the tissue. This effect could introduce some uncertainty in determining absolute optical cross-section OCS of insects in the Ultraviolet (UV), VIS and N IR. SWIR is insensitive to UV light. UV light, VIS and N IR.
- melanisation is preferably determined, e.g. by the processor, from the ratio of OCS, e.g. back scattered OCS, in the two bands NI R and SWI R rather than from the ratio of OCS in the two bands VIS and SWI R.
- OCSNIR and OCSswm are the OCS in the N IR and SWI R ranges, respectively.
- the body and wing contribution of the insect to the total OCS may be distinguished, e.g. by the processor, using a sliding temporal minimum filter with width of wing beat periodicity and determine the peak value of the sliding minimum and thereby define the non-oscillatory body contribution to the total OCS.
- wing beat modulation as well as higher order harmonics may be resolved, e.g. by calculation of the modulation power spectrum that includes the non- oscillating body contribution of the insect observation in the measurement volume, the fundamental wing-beat frequency and its harmonics overtones.
- the fundamental frequency may be estimated from the median value of the distance between the peaks in the power spectrum.
- the relative strength of the odd and even harmonics may be used for the determination, e.g.
- the at least one detector of electromagnetic radiation may comprise a CCD or CMOS array, e.g. a linear CCD or CMOS array, e.g. a linear CCD or CMOS array with 2048 pixels, wherein each of the pixels of the CCD or CMOS array is arranged for reception of electromagnetic radiation from a specific part of the measurement volume.
- a CCD or CMOS element of each pixel charges a capacitor in response to the intensity of electromagnetic radiation received by the CCD or CMOS element, i.e. the
- the entire set of charges of capacitors of the CCD or CMOS array is output at regular intervals and denoted a frame. Upon read-out of the capacitor charge values, the capacitors are reset to zero charge.
- the processor may be adapted for reception of the frames and for analysis of the frames in real time or may be adapted for data collection on a data storage, such as a hard disk, for subsequent analysis.
- the data is effectively an array of 30000 x 2048, 16 bit values.
- the frames are collected at about 3 kHz so that every 10 seconds a file is saved.
- the processor is further adapted for controlling the source of electromagnetic radiation, e.g. a laser, two lasers, etc., and switch it off when a frame has been recorded and switch it on when a frame without emission of electromagnetic radiation from the source has been recorded and read out from the CCD or CMOS array. In this way, an alternating series of frames collected that has the source on and off.
- the source of electromagnetic radiation e.g. a laser, two lasers, etc.
- the collected data is processed, e.g. by the processor, as follows:
- the alternating series of frames with the laser(s) on and off is used to subtract the background that originates from, e.g., the sunlight. This is done by subtracting a frame without the laser(s) on, also denoted the dark frame, from a frame with the laser(s) on, and also denoted the bright frame. Currently the dark frame directly following the bright frame is subtracted. In the following, the background subtracted data is denoted "the signal”.
- sliding window averaging may be performed on the dark frames before subtracting in order to obtain noise reduction.
- the processor may perform the following steps:
- the events are now identified and can be further quantified.
- Several parameters of the at least one parameter may be determined for each event and stored in a data base.
- OCS optical cross section
- the signal can be directly related to the OCS assuming that the signal decreases inversely proportional to the squared distance to the object and the sensitivity is constant at all distances. The latter is not obvious and methods to compensate for this difference in sensitivity are currently investigated. The best methods probably rely on measurements of the air signal, i.e. scattering from dust or humidity in the air.
- OCS OCS
- other parameters such as the event length and range, can be determined as well as the total amount of scattered light, peak intensity, its centre of mass in time and in range. Wing-beat frequency and iridescence features of insects may also be determined. Other parameters may be included.
- wing and body contribution to the signal may be separated using a sliding minimum filter.
- Cepstrum analysis may be used to retrieve the fundamental harmonic.
- Reconstruction of the signal and the harmonics may be performed fitting k harmonics with amplitudes a k with a harmonic series that is multiplied by the body contribution.
- Reconstruction of the time dependent scattering may include use of wavelet transforms.
- Polarisation sensitive detection may be included to improve reconstruction of the body signal and thus of the body/wing separation.
- statistical measures and thresholding may be performed with a sliding window, e.g. a matrix with a first-in first-out structure.
- the LIDAR system may be used in agronomics. Agricultural intensification and pesticide use has profound effects on aerial ecology. However, impact on the composition of aerial fauna is not well understood given limitations in monitoring technologies.
- the LIDAR system or method is used, e.g. for smart farming, precision agriculture, integrated pest management, environmental impact assessment, smart curtailment, etc., e.g. at a farm or similar to reduce the use of a pesticide and/or agricultural chemical in crops compared to prior year's use of these.
- prior years is meant the yearly average use of a pesticide and/or agricultural chemical over a period of 1 year, alternatively over 3, 5 or 10 years.
- a method for optimizing use of pesticides in agriculture comprises the steps of measuring one, two or more species of insects using the LIDAR system, analyse data from the measurement and determined a desired pesticide, spraying time, spraying schedule and/or spraying amount.
- a method for optimizing use of agricultural chemicals comprises the steps of measuring one, two or more species of insects using the LIDAR system, analyse data from the measurement and determined a desired agricultural chemical, spraying time, spraying schedule and/or spraying amount.
- the method is automatic and further comprises a database of insect and pesticide and/or agricultural chemical information for determination of spraying parameters, for example pesticide, chemical, amount, time, or schedule.
- the LIDAR system is used to exchange measurement data with digital pest and disease modelling platforms.
- the LIDAR system may be used in malaria control.
- the LIDAR system may be used for malaria mosquito surveillance and enables non-intrusive on site monitoring of malaria mosquitoes improving decision support for national malaria control programs.
- the LIDAR system may be used in bird and bat detection at windmill parks.
- a challenging task in bird monitoring lies in identifying high-altitude migrating bird species and genders.
- the LIDAR system may be used by windmill park operators in order to determine critical times of operation and/or times for operational stop.
- the LIDAR system may be used for developers of windmill parks prior to determining the optimum sites of operation, whereby information of migrating birds and or endangered bats can be taken into account.
- the LIDAR system may be used in aquatic applications, e.g. fish farming.
- Aquaculture production systems may suffer from undesired aquatic organisms, such as sea lice and carpulus.
- An increasing problem is chemical treatments to reduce fish diseases, excessive antibiotic use and resistance. This has negative environmental impact, such algae bloom, marine mammal deaths, marine debris, and waste on the ocean floor.
- the LIDAR system provides a new tool for analysing aquatic organisms and may be used to reduce the use of chemicals in fish farms and aquaculture production.
- the LIDAR system may be used for monitoring of vegetation/seafloor via fluorescence of chlorophyll.
- LIDAR system and method quantifying can be performed of aerial or aquatic fauna with respect to biological specificity for at least two species, such as more than three, more than five, more than ten, more than 100, or more than 1000 species.
- Fig. 1 schematically illustrates various parts of a new LIDAR system
- Fig. 2 schematically illustrates a new LIDAR system with a single laser and operating in accordance with the Scheimpflug principle
- Fig. 3 schematically illustrates the LIDAR system of Fig. 2 with an added camera
- Fig. 4 schematically illustrates a new LIDAR system with a Newtonian telescope
- Fig. 5 schematically illustrates a new LIDAR system with a single laser and two detectors
- Fig. 6 schematically illustrates a new LIDAR system with a Newtonian telescope and a camera
- Fig. 7 schematically illustrates a new LIDAR system with two lasers and two detectors operating according to the Scheimpflug principle
- Fig. 8 is a flowchart of determining and classifying fauna with the new LIDAR system
- Fig. 9 shows a schematic illustration of a LIDAR system for reference measurement of an insect
- Fig. 10 shows plots of detector signals
- Fig. 1 1 shows a histogram of numbers of detected insects
- Fig. 12 shows histograms illustrating recognition of certain mosquitoes.
- Fig. 1 schematically illustrates various parts of a new LIDAR system 10 for analysing fauna in accordance with the appended set of claims.
- the illustrated LIDAR system 10 comprises
- a transmitter unit with a transmitter housing 12 that accommodates the at least one
- a receiver unit with a receiver housing 14 that accommodates the at least one detector (not visible) of electromagnetic radiation that is arranged for provision of at least one output signal in response to reception of electromagnetic radiation having interacted with the animals in the measurement volume,
- a camera unit with a camera housing 16 that accommodates a camera (not visible) that is used for proper alignment of the LIDAR system and optionally for monitoring of the propagation paths of the emitted and received electromagnetic radiation,
- ⁇ a scanner 20 that is connected to the frame 18 and arranged for moving the frame 18, e.g. pan and/or tilt and/or pitch and/or traverse the frame 18, and thereby moving the measurement volume, e.g. to scan a desired volume along a desired moving trajectory, e.g. to perform measurements throughout the desired volume larger than the
- measurement volume or to perform measurements in sample volumes, e.g. in a regular pattern of volumes separated by volumes wherein no measurements are performed, and
- a processor unit 22 with a processor that is adapted for, based on the at least one output signal from detector(s) in the receiver housing 14,
- the LIDAR system 10 is shown with a frame 18 with a horizontal girder 24;
- the LIDAR system 10 may also be oriented with a vertical girder 24; or, with the girder 24 having an orientation somewhere between vertical and horizontal.
- the distance between the transmitter housing 12 and the receiver housing 14 is 800 mm, and the housings 12, 14 are arranged so that the proximate end of the measurement volume is located 20 m from the LIDAR system 10 and the distal end of the measurement volume is located 800 m from the LIDAR system 10.
- the transmitter housing 12 accommodates a laser for emission of a laser beam with wavelengths in the NIR range, e.g. having wavelengths ranging from 750 nm to 1400 nm.
- the transmitter housing 12 accommodates a laser for emission of a laser beam with wavelengths in the SWIR range, e.g. having wavelengths ranging from 1400 nm to 3000 nm.
- the transmitter housing 12 accommodates a first laser for emission of a laser beam with wavelengths in the NIR range and a second laser for emission of a laser beam with wavelengths in the SWIR range.
- the transmitter housing 12 may accommodate one or more sources of electromagnetic radiation of various types and in various combinations.
- the illustrated LIDAR system 10 may have one source of electromagnetic radiation, e.g. emitting electromagnetic radiation at a plurality of wavelengths, e.g. due to emission of harmonics.
- the illustrated LIDAR system 10 may have more than one source of electromagnetic radiation
- the transmitter housing 12 may accommodate transmitter optics (not visible) arranged so that electromagnetic radiation from different sources coincide, or substantially coincide, in the measurement volume for illumination of a living organism, such as an insect, bird, bat, an aquatic organism, etc., e.g., with the same, or substantially the same, spot size and spot centre for the different respective wavelengths w1 , w2, ... , wn.
- the receiver(s) (not visible) accommodated in the receiver housing 14 do(es) not experience a difference in signal related to different propagation paths of the electromagnetic radiation w1 , w2, ... , wn.
- electromagnetic radiation w1 , w2, ... , wn emitted from the same and/or different sources accommodated in the transmitter housing 12 are separated by at least 100 nm.
- w1 and w2 may be near-infrared wavelengths for eye-safety reasons, for example w1 may be equal to, or approximately equal to 808 nm, and w2 may be equal to, or approximately equal to 980 nm; or, w1 may be equal to, or approximately equal to 980 nm, and w2 may be equal to, or approximately equal to 1550 nm.
- the transmitter housing accommodates two separate continuous wave (CW) lasers. In one type of the illustrated LIDAR system 10, the transmitter housing accommodates a diode laser.
- the transmitter housing accommodates an array of diode lasers.
- the transmitter housing accommodates a supercontinuum source.
- the transmitter housing 12 of the illustrated LIDAR system 10 accommodates transmitter optics (not visible) for emission of beams of electromagnetic radiation of at least two different polarization states p1 , p2; wherein the beams are coinciding, or substantially coinciding, in the measurement volume for illumination of a living organism, such as an insect, bird, bat, an aquatic organism, etc., with the same, or substantially the same, spot size and spot centre of the beams with polarization states p1 and p2, respectively.
- the optional transmitter optics comprises a half-waveplate to provide different beam paths in at least part of the system 10 for beams of different polarization states p1 , p2.
- the optional transmitter optics comprises an optical element, wherein the system is designed such that light of p1 or p2 is transmitted through the optical element in the Brewster angle.
- the transmitter housing 12 accommodates one or more beam shapers (not visible), each of which is adapted for shaping the intensity profile of a respective laser beam into a desired profile, such as a Gaussian intensity profile, at top hat intensity profile, etc.
- the one or more beam shapers may comprise an optical fibre adapted for shaping the intensity profile of the beam into a Gaussian beam profile.
- the one or more beam shapers may comprise a phase contrast system adapted for shaping the intensity profile of the beam, such as a Gaussian intensity profile, at top hat intensity profile, etc.
- the illustrated LIDAR system 10 comprises a receiver unit with a receiver housing 14 that accommodates the at least one detector (not visible) of electromagnetic radiation that is arranged for provision of at least one output signal in response to reception of
- the at least one detector is suitable for detection of the radiation emitted by the at least one source of electromagnetic radiation.
- the at least one detector comprises a semiconductor detector.
- the receiver housing 14 accommodates a Si detector, e.g. a quadrant Silicon detector, for detection of electromagnetic radiation with wavelengths in the NIR range.
- the receiver housing 14 accommodates an InGaAs detector for detection of electromagnetic radiation with wavelengths in the SWIR range.
- the receiver housing 14 accommodates both a Si detector and an InGaAS detector and a dichroic beam splitter positioned in the third type of the illustrated system 10.
- the dichroic beam splitter is adapted to transmit SWIR electromagnetic radiation and reflect NIR electromagnetic radiation.
- Quadrant detectors enable detection of direction of movement of an animal through the measurement volume based on the timing of the outputs from each quadrant.
- the receiver housing 14 may accommodate one or more detectors of various types and in various combinations suitable for detection of electromagnetic radiation emitted by the transmitter unit.
- the receiver housing 14 may accommodate a Newtonian telescope (not visible) cooperating with the detector(s) accommodated in the housing for reception of electromagnetic radiation from the measurement volume.
- the receiver housing 14 of the receiver unit can be arranged for reception of backscattered electromagnetic radiation from the measurement volume.
- the receiver housing 14 of the receiver unit can be arranged for reception of electromagnetic radiation from the measurement volume from an angle different from the direction of propagation of the electromagnetic radiation emitted by the source(s) of electromagnetic radiation residing in the transmitter housing 12.
- the receiver housing 14 comprises an optical system (not visible) arranged for cooperation with the detector(s) in the receiver housing 14 for directing the received electromagnetic radiation from an area along the laser beam(s) emitted from the transmitter housing 12 onto the receiver(s) of the receiver housing 14.
- the receiver housing 14 comprises an imaging system (not visible) arranged for cooperation with the detector(s) in the receiver housing 14 in accordance with the Scheimpflug principle by imaging electromagnetic radiation from an area along the emitted laser beam(s) onto the receiver(s) of the receiver housing 14.
- the receiver housing 14 accommodates a linear CCD or CMOS array with 2048 pixels, wherein each of the pixels of the CCD or CMOS array is arranged for reception of electromagnetic radiation from a specific part of the measurement volume.
- a CCD or CMOS element of each pixel charges a capacitor in response to the intensity of electromagnetic radiation received by the CCD or CMOS element, i.e. the electromagnetic radiation incident upon it, so that at each point in time the amount of charge of the capacitor corresponds to the integrated intensity of the received electromagnetic radiation.
- the entire set of 2048 charges of capacitors of the CCD or CMOS array is output at regular intervals and denoted a frame. Upon read-out of the capacitor charge values, the capacitors are reset to zero charge.
- the measurement volume is the part of the emitted electromagnetic radiation that the optical system images onto the receiver(s). In this way, the distance from the LIDAR system to an animal detected in the measurement volume can also be determined.
- the receiver housing 14 accommodates one or more bandpass filter(s) cooperating with the detector(s) also accommodated in the receiver housing 14 for suppression of background signals from the measurement volume and having a centre wavelength within the wavelength range of the source(s) of electromagnetic radiation accommodated in the transmitter housing 12.
- Scattering from insects involves diffuse and specular reflectance. Specular reflection could come from the body or the wing depending on the type of species and nature of the body and wing of the insect. If an insect has a furry body and shine wing or the opposite, the total scatter cross-section will be a combination of diffuse and specular reflections. This can be decomposed into different components to identify the body and wing contributions. In general, specular and diffuse reflectance contributes to the total optical cross-section OCS. The specular reflectance from the wing is responsible for the higher order harmonics. The fundamental tone and lower harmonics represents the diffuse reflectance.
- chromatic properties of animals in the measurement volume may be determined.
- iridescence features can be determined, e.g. by comparing the shape of temporal waveforms of received electromagnetic radiation in the visible range VIS with
- melanisation properties can be determined, e.g. by comparing OCS of insects in the NIR and SWIR ranges, since the optical cross-section ratio between NIR and SWIR scales with melanisation. Determination of insect size is significantly more accurate in the SWI R range as compared to NIR, since N IR OCS depends on the extent of melanisation of the insect, while SWIR OCS is relatively insensitive to insect melanisation.
- Melanin is a natural pigment or chromophore that determines the colour of an insect's body and wings. Melanisation gives rise to dark or brownish appearance in the VIS. This is due to multiple reflections of the incident light interaction with the tissue. This effect could introduce some uncertainty in determining absolute optical cross-section OCS of insects in the
- UV Ultraviolet
- SWI R is insensitive to melanisation. Considering the difference between NI R and SWI R, reflectance from insects of different colour and same size could be different depending on which detector used or detection wavelength chosen. Other colouration mechanisms than melanisation exist in the VIS and UV, such as cryptic coloration, warning colour, sexually selected colours, structural colours, etc. These effects have little impact in the NI R, and therefore melanisation is preferably determined from the ratio of OCS, e.g. back scattered OCS, in the two bands NI R and SWIR rather than from the ratio of OCS in the two bands VIS and SWIR.
- the processor of the processor unit 22 is adapted for determination of
- OCSNIR and OCSSWIR are the OCS in the N IR and SWI R ranges, respectively.
- the processor of the processor unit 22 is adapted for determination of the body and wing contribution of the insect to the total OCS using a sliding temporal minimum filter with width of wing beat periodicity and determining the peak value of the sliding minimum and thereby defines the non-oscillatory body contribution to the total OCS.
- the processor of the processor unit 22 is adapted for determination of wing beat modulation as well as higher order harmonics by calculation of the modulation power spectrum that includes the non-oscillating body contribution of the insect observation in the measurement volume, the fundamental wing-beat frequency and its harmonics.
- the fundamental frequency is estimated from the median value of the distance between the peaks in the power spectrum.
- the relative strength of the odd and even harmonics is used for the determination of observed orientation of the insect and ultimately the flight direction. Insects appears large twice during one wing-beat cycle, strong 2 ⁇ , from the side and appear large once during one wing-beat cycle, strong 1 ⁇ , according the insect model. This means that the total OCS oscillates depending on the type of insect and the observed orientation of the insect.
- the processor of the processor unit 22 is adapted for reception of the frames of the CCD or CMOS array and for analysis of the frames in real time or is adapted for data collection on a data storage, such as a hard disk, for subsequent analysis.
- the data is effectively an array of 30000 x 2048, 16 bit values.
- the frames are collected at about 3 kHz so that every 10 seconds a file is saved.
- the processor of the processor unit 22 is further adapted for controlling the source of electromagnetic radiation, e.g. a laser, two lasers, etc., and switch it off when a frame has been recorded and switch it on when a frame without emission of electromagnetic radiation from the source has been recorded and read out from the CCD or CMOS array. In this way, an alternating series of frames collected with the source on and off.
- the source of electromagnetic radiation e.g. a laser, two lasers, etc.
- the processor of the processor unit 22 may be adapted for processing the collected data as follows:
- the alternating series of frames with the laser(s) on and off is used to subtract the background that originates from, e.g., the sunlight. This is done by subtracting a frame without the laser(s) on, also denoted the dark frame, from a frame with the laser(s) on, and also denoted the bright frame. Currently the dark frame directly following the bright frame is subtracted. In the following, the background subtracted data is denoted "the signal”.
- sliding window averaging may be performed on the dark frames before subtracting in order to obtain noise reduction.
- the signal comprises normal distributed noise and additional rare events.
- the median is robust against rare events and give a good measure of the peak in the normal distribution. By determining the standard deviation on the lower half of the normal distribution, the rare events do not create a bias and the standard deviation of the noise can be determined.
- the events are now identified and can be further quantified. Several parameters are determined for each event and stored in a data base.
- OCS optical cross section
- the termination point By having a termination point of known reflectivity.
- the termination point has a known distance and reflects the entire beam therefore it has a known cross section
- the signal can be directly related to the OCS.
- the best calibration methods probably rely on measurements of the air signal, i.e. scattering from dust or humidity in the air.
- OCS OCS
- other parameters such as the event length and range, can be determined as well as the total amount of scattered light, peak intensity, its centre of mass in time and in range. Wing-beat frequency and iridescence features of insects may also be determined. Other parameters may be included.
- wing and body contribution to the signal may be separated using a sliding minimum filter.
- Cepstrum analysis may be used to retrieve the fundamental harmonic. Reconstruction of the signal and the harmonics may be performed fitting k harmonics with amplitudes ak with a harmonic series that is multiplied by the body contribution.
- Reconstruction of the time dependent scattering may include use of wavelet transforms.
- Polarisation sensitive detection may be included to improve reconstruction of the body signal and thus of the body/wing separation.
- statistical measures and thresholding may be performed with a sliding window, e.g. a matrix with a first-in first-out structure.
- One type of the illustrated LIDAR system has a second receiver unit with a fourth housing (not shown) accommodating the same type of components as the receiver housing 12;
- the receiver housing 14 and the fourth housing are arranged for reception of electromagnetic radiation, e.g., with 90 degree mutual separation, so that an animal in the measurement volume may be viewed from the side and the top allowing for good
- reconstruction of the position of the animal, such as an insect, within the measurement volume and flight direction may be determined.
- the receiver housing 14 of the receiver unit is mounted on a separate frame that can be positioned in an arbitrary position with relation to the transmitter housing 12 of the transmitter unit for detection of fauna in the measurement volume, e.g. in accordance with the Scheimpflug principle.
- the fourth housing of the second receiver unit is mounted on a separate frame that can be positioned in an arbitrary position with relation to the transmitter housing 12 of the transmitter unit for detection of fauna in the measurement volume, e.g. in accordance with the Scheimpflug principle.
- the processor of the processor unit 22 is adapted for controlling the at least one source of electromagnetic radiation in the transmitter housing 12 and for turning the at least one source of electromagnetic radiation on and off alternatingly, and the processor of the processor unit 22 is further adapted for determination of background emission of electromagnetic radiation from the measurement volume when the at least one source of electromagnetic radiation is turned off.
- the processor of the processor unit 22 is adapted for determination of intensities at two or more wavelengths w1 , w2, ... , wn and for comparison of the determined intensities with a set of reference data for different species, and for generation of information on biological specificity of the living organisms, e.g.
- the processor of the processor unit 22 is adapted for determination of intensities at two or more polarization states p1 , p2 and for comparison of the determined intensities with a set of reference data for different species, and for generation of information on biological specificity of the living organisms, e.g. animals.
- the processor of the processor unit 22 is connected to the camera in the camera housing 16 for reception of images from the camera, and the processor of the processor unit 22 is adapted for performing image analysis of images received from the camera and for controlling the source(s) of electromagnetic radiation in the transmitter housing 12 in response to the performed analysis, e.g. during alignment of the system, and e.g. for monitoring obstacles in the propagation paths of the emitted and and/or received
- electromagnetic radiation and turning the source(s) of electromagnetic radiation in the first hosing 12 off to prevent inadvertent illumination of objects, e.g., humans.
- the processor of the processor unit 22 is adapted for controlling the scanner 20 to move the measurement volume across a desired volume along a desired moving trajectory e.g. to perform measurements throughout the desired volume larger than the measurement volume; or, to perform measurements in sample volumes, e.g. in a regular pattern of volumes separated by volumes wherein no measurements are performed.
- the processor of the processor unit 22 may further extract data for each insect, such as wing-beat oscillations, spherical scattering coefficient (size), spectral information of specific molecules, such as melanin, wax, chitin or haemoglobin, and also of microstructures, such as wing membrane thickness.
- data for each insect such as wing-beat oscillations, spherical scattering coefficient (size), spectral information of specific molecules, such as melanin, wax, chitin or haemoglobin, and also of microstructures, such as wing membrane thickness.
- the processor of the processor unit 22 may be adapted to determine reference data based on electromagnetic radiation received from the animal in the measurement volume.
- the reference data may comprise data for at least two different species, such as at least three, at least five, at least 10, at least 100, or at least 1000 species.
- the set of reference data comprises information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, and microstructures of wings, e.g., periodicity and/or thickness.
- melanin melanin
- wax chitin
- haemoglobin e.g., a wax
- microstructures of wings e.g., periodicity and/or thickness.
- the set of reference data comprises spectral differential absorption information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, and microstructures of wings, e.g., periodicity and/or thickness).
- the set of reference data comprises polarization-dependent absorption and/or reflectance information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, and microstructures of wings, e.g., periodicity and/or thickness.
- the set of reference data comprises differential spectral absorption data of different species.
- the set of reference data comprises differential polarization absorption and/or reflectance data of different species.
- the reference data further comprises information with respect to gender and/or age of a species.
- the set of reference data is obtained from operating the illustrated LIDAR system 10 in an insectarium (also referred to as insectary) with predetermined species of insects.
- the set of reference data is obtained from operating the illustrated LIDAR system 10 in an area with predetermined species of birds and/or bats, and/or or from operating the illustrated LIDAR system 10 with simultaneously determination of species of birds and/or bats via for example camera and imaging technologies, or utilizing RADAR technologies.
- the set of reference data is obtained from operating the illustrated LIDAR system 10 for aquatic fauna in an aquarium with predetermined species of aquatic organisms.
- a method that generates a set of biological specificity data by applying the illustrated LIDAR system 10 in an insectarium comprising at least one predetermine species, such as at least two, at least three, at least three, at least five, at least 10, at least 100, or at least 1000 predetermined species.
- the set of reference data may be embedded within the processor of the processor unit 22 of the illustrated LIDAR system 10.
- the set of reference data may be accessed remotely, for example via a cloud-based solution.
- the illustrated LIDAR system 10 comprises a calibrator (not shown) arranged for placing an object with a known optical characteristic in the measurement volume.
- the illustrated LIDAR system 10 comprises a trap and a filming unit taking a photograph of an insect collected in the trap. The trap and the filming unit serve to provide additional information to the system, such as for verification, quality, or reference purposes or combinations of these.
- the illustrated LIDAR system 10 may be used in agronomics. Agricultural intensification and pesticide use has profound effects on aerial ecology. However, impact on the composition of aerial fauna is not well understood given limitations in monitoring technologies.
- a method for optimizing use of pesticides in agriculture comprises the steps of measuring one, two or more species of insects using the illustrated LIDAR system 10, analyse data from the measurement, e.g. using supervised or unsupervised learning algorithms etc., and determine a desired pesticide, spraying time, spraying schedule and/or spraying amount.
- a method for optimizing use of agricultural chemicals comprises the steps of measuring one, two or more species of insects using the Illustrated LIDAR system 10, analyse data from the measurement and determine a desired agricultural chemical, spraying time, spraying schedule and/or spraying amount.
- the method is automatic and further and further comprises data exchange with a digital pest and disease modelling platform for determination of spraying parameters, for example pesticide, chemical, amount, time, or schedule.
- the Illustrated LIDAR system 10 or method is used at a farm or similar to reduce the use of a pesticide and/or agricultural chemical in crops compared to prior year's use of these.
- prior years is meant the yearly average use of a pesticide and/or agricultural chemical over a period of 1 year, alternatively over 3, 5 or 10 years.
- the Illustrated LIDAR system 10 may be used in vector control, such as malaria control.
- vector control such as malaria control.
- the Illustrated LIDAR system 10 may be used for vector surveillance, such as malaria mosquito surveillance, and enables non-intrusive on site monitoring, e.g. of malaria mosquitoes, improving decision support for national vector control programs.
- the Illustrated LIDAR system 10 may be used for monitoring threatened and endangered species of birds and bats. A challenging task in bird monitoring lies in identifying high-altitude bird species and genders.
- Illustrated LIDAR system 10 may be used for bird and bat detection at windmill parks.
- the Illustrated LIDAR system 10 may be used by windmill park operators in order to determine critical times of operation and/or times for operational stop.
- Illustrated LIDAR system 10 may be used for developers of windmill parks prior to determining the optimum sites of operation, whereby information of migrating birds and or endangered bats can be taken into account.
- Illustrated LIDAR system 10 may be used in aquatic applications.
- Aquaculture production systems may suffer from undesired aquatic organisms, such as sea lice and carpulus.
- An increasing problem is chemical treatments to reduce fish diseases, excessive antibiotic use and resistance. This has negative environmental impact, such algae bloom, marine mammal deaths, marine debris, and waste on the ocean floor.
- Illustrated LIDAR system 10 provides a new tool for analysing aquatic organisms and may be used to reduce the use of chemicals in fish farms and aquaculture production.
- Illustrated LIDAR system 10 may be used for monitoring of
- Illustrated LIDAR system 10 and method quantifying can be performed of aerial or aquatic fauna with respect to biological specificity for at least two species, such as more than three, more than five, more than ten, more than 100, or more than 1000 species.
- Fig. 2 schematically illustrates one optical configuration of the LIDAR system 10 shown in Fig. 1 and of a type with a transmitter unit with a transmitter housing accommodating a single laser 40 and with a receiver unit with a receiver housing that is arranged for operation in accordance with the Scheimpflug principle.
- an object plane is usually imaged onto an image plane that is parallel to the object plane, and the imaging is performed with a lens that provides a focussed image of the object plane onto the image plane.
- the lens has an optical axis perpendicular to the object plane and the image. If, however, the optical axis of the lens is tilted with respect to the image plane, the plane imaged onto the image plane with sharp focus will also be tilted according to geometrical and optical properties.
- a lens 42 of the receiver unit is tilted according to the Scheimpflug principle so that the object plane that is focussed onto the image plane 44 of the detector 46 contains the laser beam 48 emitted by the laser 40 of the transmitter unit.
- the detector 46 is a linear CCD or CMOS array with 2048 pixels arranged so that each of the pixels of the CCD or CMOS array receives electromagnetic radiation from a specific part of the laser beam 48 along the length of the laser beam 48 so that ranging can be performed due to the one-to-one imaging of individual segments of the laser beam 48 along the length of the laser beam 48 onto respective individual CCD or CMOS pixels.
- the LIDAR system 10 of Fig. 2 operates as explained in connection with Fig. 1 .
- Fig. 3 schematically illustrates the LIDAR system 10 similar to the LIDAR system 10 shown in Fig. 2 except for the fact that a camera 60 has been added to the LIDAR system 10.
- the camera 60 is used for proper alignment of the LIDAR system 10 and optionally for monitoring of the propagation paths of the emitted and received electromagnetic radiation 48, 62.
- the processor of the processor unit 22 (see Fig. 1 ) is connected to the camera 60 for reception of images from the camera 60, and the processor of the processor unit 22 is adapted for performing image analysis of images received from the camera and for controlling the source 40 of electromagnetic radiation in response to the performed analysis, e.g. during alignment of the system, and e.g. for monitoring obstacles in the propagation paths of the emitted and/or received electromagnetic radiation 48, 62 and turning the source 40 of electromagnetic radiation off to prevent inadvertent illumination of objects, e.g. humans.
- Fig. 4 schematically illustrates a LIDAR system 10 similar to the LIDAR system 10 shown in Fig. 2 except for the fact that a Newtonian telescope (only mirrors shown) with focussing mirror 80 and mirror 82 has been added to the LIDAR system 10. Otherwise, the LIDAR system 10 of Fig. 4 operates in the same way as the LIDAR system 10 of Fig. 2.
- Fig. 5 schematically illustrates a LIDAR system 10 similar to the LIDAR system 10 shown in Fig. 4 except for the fact that another receiver housing 84 has been added to the system 10 proximate the transmitter housing with the laser 40, wherein the other receiver housing 84 accommodates a Si quadrant detector for detection of backscattered NIR radiation for detection of direction of movement through the measurement volume as explained above.
- FIG. 5 schematically illustrates a LIDAR system 10 similar to the LIDAR system 10 shown in Fig. 4 except for the fact that a camera 60 has been added to the LIDAR system 10.
- the camera 60 is connected to the processor of the processor unit 22 for operation in the same way as explained in connection with Fig. 3.
- Fig. 7 schematically illustrates a LIDAR system 10 similar to the LIDAR system 10 shown in Fig. 4 except for the fact that the transmitter unit includes two lasers 86, 88 for emission of electromagnetic radiation of different wavelengths w1 , w2, and the receiver unit includes two semiconductor detectors 90, 92, namely linear CCD or CMOS arrays 90, 92 with 2048 pixels, suitable for detection of electromagnetic radiation of the respective wavelengths w1 , w2.
- the lasers 86, 88 and the semiconductor detectors 90, 92 cooperate with respective
- the length of the measurement volume is of the order of 100 m.
- the illustrated LIDAR system 10 operates as explained in connection with Fig. 4.
- Fig. 8 shows a flowchart of determining and classifying fauna with the new LIDAR system 10. The process is described in more detail in connection with Fig. 1.
- Fig. 9 shows schematically a LIDAR system 10 for reference measurements of insects.
- the measurement volume of the illustrated LIDAR system 10 has a relatively short length of approximately 3 m.
- the semiconductor detectors 90, 92 and the receiving optics are arranged for detection of backscattered electromagnetic radiation and the semiconductor detectors 90, 92 are single element or pixel detectors.
- Fig. 10 shows plots of detector signals and processed detector signal.
- the curve 100 is a plot of an output signal of a detector of a laboratory LIDAR system with an insect in the measurement volume. The output signal is recorded with a high sample frequency and intensity variations caused by the wing beat of the insect is shown with a high resolution.
- the low frequency pedestal of the signal is caused by the signal contribution from the body of the insect. In the lower curve 102 of the plot, the pedestal has been subtracted from the output signal for provision of the signal contribution from the wings of the insect.
- the curve 104 shows a Fourier transformation of the signal contribution from the wings showing a fundamental frequency 106 of the wing beat of approximately 700 Hz and a number of harmonic frequencies of the wing beat frequency.
- the curve 108 shows a Fourier transformation of the signal contribution from the body of the insect.
- the curve 1 10 is a plot of an output signal of a detector of a field LIDAR system with an insect in the measurement volume.
- the output signal is recorded with a low sample frequency and intensity variations caused by the wing beat of the insect is shown with a low resolution.
- the low frequency pedestal of the signal is caused by the signal contribution from the body of the insect.
- the pedestal has been subtracted from the output signal for provision of the signal contribution from the wings of the insect.
- Fig. 1 1 shows a histogram of numbers of detected insects 1 14 in the field in counts per hour as a function of time. A circadian rhythm of the detected insects is clearly visible.
- Fig. 12 shows histograms illustrating recognition of certain mosquitoes.
- Reference data on wing beat frequencies of various types of male and female mosquitoes has been obtained under laboratory conditions by releasing a number of individuals of the same sex and type and determining their wing beat frequencies with the laboratory LIDAR system. This is repeated for a number of types of mosquitoes.
- the plot shows resulting histograms of wing beat frequencies of male Aedis aegypti 1 16 and of female Aedis aegypti 1 18.
- the plot also shows a histogram 120 of all wing beat frequencies recorded in the field for comparison with the reference data 1 16, 1 18. It seems that male and female Aedis aegypti were detected during the field measurements.
Landscapes
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Environmental Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Pest Control & Pesticides (AREA)
- Insects & Arthropods (AREA)
- Zoology (AREA)
- Wood Science & Technology (AREA)
- Electromagnetism (AREA)
- Animal Husbandry (AREA)
- Biodiversity & Conservation Biology (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Toxicology (AREA)
- Birds (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Catching Or Destruction (AREA)
Abstract
Optical remote sensing systems are provided for quantifying aerial or aquatic fauna with respect to number of living organisms, such as animals, such as insects, birds, bats or aquatic organisms, and to biological specificity.
Description
IMPROVEMENTS IN OR RELATING TO OPTICAL REMOTE SENSING SYSTEMS FOR AERIAL AND AQUATIC FAUNA, AND USE THEREOF
FIELD
The present disclosure relates to the field of aerial and aquatic fauna, in particular, to optical remote sensing, known as LIDAR (Light Detection and Ranging). Improved LIDAR systems and methods are provided for measuring, quantifying, monitoring, classifying, specifying, surveying, predicting, forecasting, investigating, and/or warning against aerial and/or aquatic fauna, e.g. for use in a number of fields and applications, such as agronomics, malaria control, windmill parks, aquaculture production, e.g. fish farms, and science, e.g.
entomology, ornithology, biogeography, oceanography.
BACKGROUND
Atmospheric fauna comprises insects that play a crucial role in the earth's ecosystem and influence mankind in multiple ways; including as pollinators for food production, as pests that can have a devastating effect on agriculture, and as mosquitoes and biting midges that can transmit deadly diseases to humans and livestock.
To study insects, the traditional method is using traps in which insects are caught for subsequent inspection and analysis. Various types of traps are used and the trap method has for decades been the preferred method for entomologists to determine insect information, such as species, gender, age classification, micromorphology, and dietary information. The method, however, is highly laborious, time-consuming and costly per insect. Hence, the numbers of insects that can be studied are limited to the number of insects that may be trapped (typically in the single to tens, or low hundreds), the available resources (man-power), or the accessibility of the area/atmospheric region of interest. Furthermore, many trapping methods are known to be biased and perturbing (Muirhead-Thomson R, Trap responses of flying insects: The influence of trap design on capture efficiency, Academic Press (1991 )).
To overcome the limitations of traditional traps, LIDAR systems have been proposed, see for example Brydegaard S0rensen, Mikkel LU ; Guan, Zuguang LU ; Wellenreuther, Maren LU and Svanberg, Sune LU (2009) In Applied Optics 48(30). p.5668-5677). Such LIDAR systems for aerial fauna have been the subject of significant research and comprise a laser beam that is transmitted into the atmosphere and a receiver/detector that measures the backscattered laser light from insects. The systems are capable of counting the number events, where an insect intersects with the laser beam. Due to the long range of laser beam,
large atmospheric regions may be analysed for aerial fauna. Hence, the systems are capable of counting a large number of insects, such as in the tens to hundreds of thousands, and even up to millions.
SUMMARY
It is an object to provide an optical remote sensing system, use thereof and methods to quantify biological specificity in aerial and aquatic environments, such as of insects, birds, bats and aquatic organisms.
It is an object to provide methods that improve and/or reduce use of pesticides and chemicals in agriculture and aquaculture productions.
In particular, it is an object to quantify aerial insect fauna associated with land use, farming regimes and crop type in agricultural landscapes.
It is an object to provide new means for pest control, and for information in relation to pollinators.
It is an object to provide a system for control, warning and/or combat of vector-borne diseases, such as malaria, yellow fever, zika virus, HAT and AAT sleeping sickness, Chikungunya virus, Dengue fever, West Nile virus, etc.
The above-mentioned and other objects are fulfilled by
a LIDAR system for analysing fauna, comprising
at least one source of electromagnetic radiation that is adapted for emission of
electromagnetic radiation towards a measurement volume for illumination of animals in the measurement volume,
at least one detector of electromagnetic radiation that is arranged for provision of at least one output signal in response to reception of electromagnetic radiation having interacted with the animals in the measurement volume, and
a processor that is adapted for detecting animals in the measurement volume based on the at least one output signal.
The processor may further be adapted for counting detected animals.
The processor may further be adapted for determination of at least one parameter of the received electromagnetic radiation relating to the species of the detected animals.
The processor may further be adapted for comparison of the determined at least one parameter with a set of reference data for different species and for
generation of information on biological specificity of the animals based on the comparison.
The comparison may include comparison of a distribution of values of the at least one parameter with a corresponding distribution of values of the set of reference data.
The comparison may include utilization of regression analysis, such as linear regression analysis.
The comparison may include utilization of clustering.
The comparison may include formation of histograms of values of the determined at least one parameter and formation of histograms of values of the at least one parameter of the set of reference data and comparison of one of more of the formed histograms of the determined at least one parameter with respective one or more formed histograms of the at least one parameter of the set of reference data.
For example, the set of reference data may include wing beat frequencies of various species of male and female mosquitoes obtained under laboratory conditions. Typically, male and female mosquitoes of the same species have different wing beat frequencies. The wing beat frequencies are obtained by releasing a number of individuals of the same sex and type and determining their wing beat frequencies with a laboratory LIDAR system sequentially for a number of types of mosquitoes. Histograms of wing beat frequencies may then be formed for male mosquitoes of each species and for female mosquitoes of each species. A histogram of all wing beat frequencies determined in the field may then be compared with the previously determined histograms of wing beat frequencies for each sex and each species for identification of possible presence of the respective sex and species in the determined field data.
The measurement volume is a volume in space that is illuminated by the at least one source of electromagnetic radiation and that resides in a viewing field of the at least one detector. The measurement volume may have a diameter ranging from 5 cm to 20 cm, such as from 8 cm to 15 cm. One end of the measurement volume may be located within a distance of 1 m from the at least one source of electromagnetic radiation of the LIDAR system, and the other end of the measurement volume may be located 1 km from the at least one source of electromagnetic radiation. For example, the measurement volume may have a diameter of 12 cm with one end of the measurement volume located 30 m from the at least one source of electromagnetic radiation and the other end of the measurement volume located 200 m from the at least one source of electromagnetic radiation.
When an object, such as an animal, e.g. an insect, is in the measurement volume, it is illuminated by and scatters the electromagnetic radiation. A part of the scattered radiation propagates towards the at least one detector that outputs the at least one output signal in response to reception of the scattered electromagnetic radiation so that the animal in the measurement volume can be detected.
In the following, reception of scattered electromagnetic radiation from an animal in the measurement volume is termed an event.
Only rarely will two animals be present in the measurement volume simultaneously so that scattered electromagnetic radiation is received by the at least one detector from one animal at the time.
Some of the LIDAR systems disclosed in the following, such as a LIDAR system wherein the at least one detector comprises a linear CCD or CMOS array arranged in accordance with the Scheimpflug principle as further disclosed in the following, can distinguish scattered electromagnetic radiation from individual animals also when more than one animals are in the measurement volume simultaneously.
The received scattered electromagnetic radiation contains information about the animal that has scattered the electromagnetic radiation. The processor of the LIDAR system is adapted to extract at least part of the information from the received scattered electromagnetic radiation by the determination of the at least one parameter of the received electromagnetic radiation relating to the animal that has scattered the electromagnetic radiation.
The LIDAR system may comprise a processor unit with the processor.
The LIDAR system may comprise a processor unit with a processor housing accommodating the processor.
The LIDAR system may comprise a transmitter unit with the at least one source of electromagnetic radiation.
The LIDAR system may comprise a transmitter unit with a transmitter housing
accommodating the at least one source of electromagnetic radiation.
The LIDAR system may comprise a receiver unit with the at least one detector of electromagnetic radiation.
The LIDAR system may comprise a receiver unit with a receiver housing accommodating the at least one detector of electromagnetic radiation.
The at least one source
The at least one source of electromagnetic radiation may emit radiation in the Near- Infrared (NIR) range, e.g. having wavelengths ranging from 750 nm to 1400 nm.
The at least one source of electromagnetic radiation may emit radiation in the Short- Wavelength Infrared (SWIR) range, e.g. having wavelengths ranging from 1400 nm to 3000 nm.
The at least one source of electromagnetic radiation may comprise one or more lasers, e.g. including a continuous wave laser, for emission of respective one or more beams of electromagnetic radiation.
The at least one source of electromagnetic radiation may comprise at least one, such as at least two lasers, for emission of electromagnetic radiation of respective at least two different centre wavelengths w1 , w2, ... , wn.
Preferably, w1 and w2 are separated by at least 100 nm. For example, w1 and w2 may be near-infrared wavelengths for eye-safety reasons, for example w1 may be equal to, or approximately equal to 808 nm, and w2 may be equal to, or approximately equal to 980 nm; or, w1 may be equal to, or approximately equal to 980 nm, and w2 may be equal to, or approximately equal to 1550 nm.
The at least one source of electromagnetic radiation may comprise a laser emitting radiation at a plurality of frequencies, such as a fundamental frequency and a plurality of harmonics, such as first, second, and third harmonics.
The at least one source of electromagnetic radiation may comprise two separate continuous wave (CW) lasers.
The at least one source of electromagnetic radiation, e.g. of the transmitter unit, may comprise a diode laser, an array of diode lasers, a supercontinuum source, etc. A supercontinuum source may be obtained from commercial vendors, such as Eagleyard Photonics GmbH or NKT Photonics A/S.
The at least one source of electromagnetic radiation may be arranged for emission of electromagnetic radiation of at least two different polarization states p1 , p2.
The at least one source of electromagnetic radiation may include a diode laser, e.g. a diode laser with an output power in the range from 100 mW to 3 W.
The at least one detector
The at least one detector is arranged for reception of electromagnetic radiation having interacted with the animal in the measurement volume, and may also be arranged for detection of direction of movement of the animal through the measurement volume.
The at least one detector may include a quadrant detector wherein each quadrant provides an output signal in response to reception of electromagnetic radiation enabling detection of direction of movement of an animal through the measurement volume based on the timing of the output signals from each quadrant.
The at least one detector may also capable of resolving wing-beat frequency provided that the sampling frequency is above 2 kHz, such as above 3 kHz, etc., since the fundamental wing-beat frequency of insects is at most 1 kHz. For example, the sampling frequency may be 3 kHz.
The LIDAR system may comprise at least one first detector of the at least one detector of electromagnetic radiation that is arranged for reception of backscattered electromagnetic radiation from the measurement volume.
The LIDAR system may comprise at least one second detector of the at least one detector of electromagnetic radiation that is arranged for reception of electromagnetic radiation from the measurement volume from a first angle different from the direction; i.e. the forward or backward direction, of propagation of the electromagnetic radiation emitted by the at least one source of electromagnetic radiation, e.g. in accordance with the Scheimpflug principle.
The LIDAR system may comprise at least one third detector of the at least one detector of electromagnetic radiation that is arranged for reception of electromagnetic radiation from the measurement volume from a second angle different from the direction; i.e. the forward or backward direction, of propagation of the electromagnetic radiation emitted by the at least one source of electromagnetic radiation and different from the first angle, e.g. in accordance with the Scheimpflug principle.
The at least one detector of electromagnetic radiation may comprise a semiconductor detector, such as a Silicium (Si) detector, such as a Si quadrant detector, for example a Si detector suitable for detection of electromagnetic radiation ranging from 0.19 μηη to 1 μηη. The Si detector is also capable of resolving wing-beat frequency provided that the sampling frequency is above 2 kHz, such as 3 kHz and above 3 kHz, since the fundamental wing-beat frequency of insects is at most 1 kHz.
The at least one detector of electromagnetic radiation may comprise an Indium-Gallium- Arsenide (InGaAs) detector, e.g. an InGaAs quadrant detector, e.g. for detection of electromagnetic radiation ranging from 0.9 μηη to 1 .7 μηη.
The InGaAs detector may also be capable of resolving wing-beat frequency provided that the sampling frequency is above 2 kHz, such as 3 kHz and above 3 kHz, since the fundamental wing-beat frequency of insects is at most 1 kHz.
The at least one detector of electromagnetic radiation may comprise an array of
detectors, such as a two-dimensional array of detectors, a linear array of detectors, etc., e.g., a two-dimensional CCD or CMOS array, or a linear CCD or CMOS array, such as a linear CCD or CMOS array with 2048 pixels, wherein each of the detectors, also denoted pixels, of the CCD or CMOS array is arranged for reception of
electromagnetic radiation from a specific part of the measurement volume, e.g. in accordance with the Scheimpflug principle.
Each detector of a CCD or CMOS array charges a capacitor in response to the
intensity of electromagnetic radiation received by the detector, i.e. the electromagnetic radiation incident upon it, so that at each point in time the amount of charge of the capacitor corresponds to the integrated intensity of the electromagnetic radiation
received by the detector in question. The entire set of charges of capacitors of the CCD or CMOS array is output at regular intervals and denoted a frame. Upon read-out of the capacitor charge values, the capacitors are reset to zero charge.
Optics
The LIDAR system may comprise a first optical system arranged for cooperation with the least one first detector for reception of backscattered electromagnetic radiation from the measurement volume.
The LIDAR system may comprise a second optical system arranged for cooperation with the at least one second detector in accordance with the Scheimpflug principle for reception of electromagnetic radiation from the measurement volume from a first angle different from the direction; i.e. the forward or backward direction, of propagation of the electromagnetic radiation emitted by the at least one source of electromagnetic radiation.
The LIDAR system may comprise a third optical system arranged for cooperation with the at least one third detector of electromagnetic radiation in accordance with the Scheimpflug principle for reception of electromagnetic radiation from the measurement volume from a second angle different from the direction of propagation of the electromagnetic radiation
emitted by the at least one source of electromagnetic radiation and different from the first angle of the second optical system.
Preferably, the system is designed according to the Scheimpflug principle and the Hinge rule.
The LIDAR system may comprise at least one imaging system for imaging the measurement volume onto the respective one or more detector surfaces of the at least one detector, e.g., each of the first, second, and third optical systems may comprise at least one imaging system for imaging the measurement volume onto the one or more detector surfaces of the respective at least one first, second, and third detector.
The at least one imaging system may comprise one or more lenses.
The at least one imaging system may comprise one or more image forming mirrors.
The at least one imaging system may comprise one or more diffractive optical elements.
The at least one imaging system may comprise at least one telescope, e.g. including a Newtonian telescope, e.g. a 800 mm Newtonian telescope with a 200 mm diameter, for cooperation with the at least one detector for reception of electromagnetic radiation from the measurement volume.
The at least one imaging system may be coupled with, e.g., Si, InGaAs, etc., detectors, e.g. including a quadrant detector for detection of flight direction from the time series of the respective output signals from each quadrant.
The at least one imaging system may include two detection telescopes arranged with 90 degree mutual separation, an event, i.e. an animal traversing the measurement volume, may be viewed from the side and the top allowing for good reconstruction of the position of the animal within the measurement volume and flight direction may be determined, e.g. by the processor.
The LIDAR system may have two or more detectors, and a dichroic beam splitter positioned in front of the, e.g. two, detectors, e.g. a Si detector, e.g. a Si quadrant detector, for detection of electromagnetic radiation ranging from 0.19 μηη to 1 μηη; and an InGaAs detector for detection of electromagnetic radiation ranging from 0.9 μηη to 1.7 μηη. The dichroic beam splitter is adapted to transmit SWIR electromagnetic radiation and reflect NIR
electromagnetic radiation. These detectors are also capable of resolving wing-beat frequency provided that the sampling frequency is above 2 kHz, such as 3 kHz and above 3 kHz, since the fundamental wing-beat frequency of insects is at most 1 kHz.
The at least one source of electromagnetic radiation may comprise at least one, such as at least two lasers, for emission of electromagnetic radiation of respective at least two different centre wavelengths w1 , w2, ... , wn, and preferably, the transmitted laser beams of electromagnetic radiation having centre wavelengths w1 and w2 and wn are coinciding, or substantially coinciding, in the measurement volume for illumination of an animal, such as an insect, bird, bat, an aquatic organism, etc., with the same, or substantially the same, spot size and spot centre for different centre wavelengths w1 , w2, ... , wn.
By substantially the same spot size and spot centre is meant that the at least one detector of electromagnetic radiation does not detect signal differences relating to different beam paths of electromagnetic radiation at wavelengths w1 and w2, ... , wn.
A person skilled in the art of optics and photonics would know how to design the at least one source of electromagnetic radiation with two separate wavelengths for illumination of a target/organism with substantially equal spot size and beam centre.
The LIDAR system may comprise transmitter optics arranged for cooperation with the least one source of electromagnetic radiation for emission of the electromagnetic radiation towards the measurement volume.
The transmitter optics may comprise optics for emission of laser light beams of at least two different polarization states p1 , p2 that are coinciding, or substantially coinciding, in the measurement volume for illumination of a living organism, such as an insect, bird, bat, an aquatic organism, etc., with the same, or substantially the same, spot size and spot centre for polarization states p1 , p2.
The optics may comprise a half-waveplate to provide different beam paths in at least part of the system for beams of different polarization states p1 , p2.
The optics may comprise an optical element, wherein the system is designed such that light of p1 or p2 is transmitted through the optical element in the Brewster angle.
The transmitter optics may comprise one or more beam shapers, each of which is adapted for shaping the intensity profile of a respective laser beam into a desired profile, such as a Gaussian intensity profile, a top hat intensity profile, etc.
The one or more beam shapers may comprise an optical fibre adapted for shaping the intensity profile of the beam into a Gaussian beam profile.
The one or more beam shapers may comprise a phase contrast system adapted for shaping the intensity profile of the beam, such as a Gaussian intensity profile, at top hat intensity profile, etc.
The transmitter optics may comprise a bandpass filter cooperating with the at least one detector for suppression of background signals and having a centre wavelength within the wavelength range of the at least one source of electromagnetic radiation.
The transmitter optics may comprise a telescope, such as a 600 mm to 800 mm lens telescope with a 120 mm diameter.
The processor
The processor may be adapted to count the number of animals, such as the number of insects, detected in the measurement volume over a time period.
The processor may be adapted for controlling the at least one source of electromagnetic radiation and for turning the at least one source of electromagnetic radiation on and off alternatingly.
The processor may be adapted for determination of background emission of electromagnetic radiation from the measurement volume when the at least one source of electromagnetic radiation is turned off.
The processor may be connected to the at least one camera for reception of images from the at least one camera.
The processor may be adapted for performing image analysis of images received from the at least one camera.
The processor may be adapted for controlling the at least one source of electromagnetic radiation in response to the performed analysis.
The processor may be adapted for performing image analysis of images received from the at least one camera for monitoring alignment of the at least one source of electromagnetic radiation and the at least one detector.
The processor may be adapted for monitoring alignment of the at least one source of electromagnetic radiation and the at least one detector based on the at least one output signal from the at least one detector without an animal in the measurement volume.
The processor may be adapted for monitoring objects, e.g. humans, proximate the electromagnetic radiation emitted by the at least one source of electromagnetic radiation.
The processor may be adapted for turning the at least one source of electromagnetic radiation off to prevent inadvertent illumination of objects, e.g. humans, in the space that is otherwise illuminated by the electromagnetic radiation.
The processor may be adapted to determine data based on electromagnetic radiation received from the object placed by the calibrator in the measurement volume.
The processor may be adapted for controlling the scanner to move the measurement volume to scan a desired volume along a desired moving trajectory, e.g. to perform measurements throughout the desired volume larger than the measurement volume; or to perform measurements in sample volumes, e.g. in a regular pattern of volumes separated by volumes wherein no measurements are performed.
The processor may be adapted for
determination of intensities at the at least two wavelengths w1 , w2, ... , wn and for
comparison of the determined intensities with a set of reference data for
different species, and for
generation of information on biological specificity of the animals based on the comparison.
The processor may be adapted for
determination of intensities at the at least two polarization states p1 , p2) and for comparison of the determined intensities with a set of reference data for
different species, and for
generation of information on biological specificity of the animals based on the comparison.
The processor may be adapted for reception of data from the at least one detector of electromagnetic radiation and for analysis of the data in real time; or, may be adapted for data collection on a data storage, such as a hard disk, for subsequent analysis.
For example, about 30000 frames may be collected and saved in one file. This means that the data is effectively an array of 30000 x 2048, 16 bit values. The frames are collected at about 3 kHz so that every 10 seconds a file is saved.
The processor may be adapted for controlling the source of electromagnetic radiation, e.g. a laser, two lasers, etc., and switch it off when a frame has been recorded and switch it on
when a frame without emission of electromagnetic radiation from the source has been recorded and read out from the CCD or CMOS array. In this way, an alternating series of frames may be collected that has the source turned on and off, respectively.
As used herein, the terms "processor", "central processor", "signal processor",
"controller", "system", etc., are intended to refer to CPU-related entities, either
hardware, a combination of hardware and software, software, or software in execution.
For example, a "processor", "signal processor", "controller", "system", etc., may be, but is not limited to being, a process running on a processor, a processor, an object, an executable file, a thread of execution, and/or a program.
By way of illustration, the terms "processor", "central processor", "signal processor", "controller", "system", etc., designate both an application running on a processor and a hardware processor. One or more "processors", "central processors", "signal
processors", "controllers", "systems" and the like, or any combination hereof, may reside within a process and/or thread of execution, and one or more "processors",
"central processors", "signal processors", "controllers", "systems", etc., or any
combination hereof, may be localized in one hardware processor, possibly in
combination with other hardware circuitry, and/or distributed between two or more hardware processors, possibly in combination with other hardware circuitry.
Also, a processor, or similar terms, may be any component or any combination of components that is capable of performing signal processing. For examples, the
processor may be an ASIC processor, a FPGA processor, a general purpose
processor, a microprocessor, a circuit component, or an integrated circuit.
Reference data
The reference data may comprise data for at least two different species, such as at least three, at least five, at least 10, at least 100, or at least 1000 species.
Preferably, the set of reference data comprises information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, microstructures of wings, such as periodicity and/or thickness. By one, but preferably more, of these parameters, it is for example possible to determine colouring of an insect, bird, bat or aquatic organism as an indicator of species, gender and/or age. Further, by one, but preferably more, of these parameters, it is for example possible to determine whether a mosquito has taken a meal, e.g., bitten or sucked blood, i.e. whether it may potentially be infected with malaria and pose a risk.
Preferably, the set of reference data comprises spectral differential absorption information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, and microstructures of wings, e.g., periodicity and/or thickness. Preferably, the set of reference data comprises polarization-dependent absorption and/or reflectance information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, and microstructures of wings, e.g., periodicity and/or thickness.
Preferably, the set of reference data comprises differential spectral absorption data of different species. In a preferred embodiment, the set of reference data comprises differential polarization absorption and/or reflectance data of different species.
Preferably, the reference data further comprises information with respect to gender and/or age of a species.
Preferably, the set of reference data is obtained from operating a LIDAR for aerial fauna in an insectarium, also referred to as insectary, with predetermined species of insects.
Alternatively, the set of reference data is obtained from operating a LIDAR for aerial fauna in an area with predetermined species of birds and/or bats, and/or or from operating the LIDAR with simultaneously determination of species of birds and/or bats via for example camera and imaging technologies, or via RADAR technologies). Alternatively, the set of reference data are obtained from operating a LIDAR for aquatic fauna in an aquarium with
predetermined species of aquatic organisms.
Preferably, a method is provided that generates a set of biological specificity data as the set of reference data by applying the LIDAR system for aerial fauna in an insectarium comprising at least one predetermine species, such as at least two, at least three, at least three, at least five, at least 10, at least 100, or at least 1000 predetermined species.
The set of reference data, or part of the set of reference data, may be embedded within the processor unit of the LIDAR system.
The set of reference data, or part of the set of reference data, may be accessed
remotely, for example utilizing cloud computing providing computing power, database storage, applications, etc., via a wide-area-network, such as the Internet.
Lidar systems
The LIDAR system may comprise a mechanical frame for supporting various parts of the LIDAR system, e.g., a transmitter housing for accommodation of the at least one source of electromagnetic radiation mounted to the frame, and, e.g., at least one receiver housing for
accommodation of the at least one detector of electromagnetic radiation mounted to the frame.
The frame may comprise a girder, e.g., of aluminium.
The transmitter housing and the at least one receiver housing may be mounted to the girder. The LIDAR system may comprise at least one camera arranged for monitoring of the LIDAR system, e.g. the measurement volume of the LIDAR system.
The at least one camera may comprise at least one line scan camera.
The LIDAR system may comprise at least one camera housing for accommodation of the at least one camera and/or line scan camera and mounted to the frame.
The LIDAR system may comprise a scanner that is arranged for moving the frame, e.g. pan and/or tilt and/or pitch and/or traverse the frame, and thereby moving the measurement volume.
The LIDAR system may comprise a calibrator arranged for placing an object with a known optical characteristic in the measurement volume.
The LIDAR system may comprise a trap and a filming unit taking a photograph of an insect collected in the trap. The trap and the filming unit serve to provide additional information to the system, such as for verification, quality, or reference purposes or combinations of these.
The LIDAR system may be portable.
The LIDAR system may comprise
a transmitter unit that emits laser light,
a receiver unit that receives a back-scattered portion of the laser light, and
a processor unit, e.g. data processing or computing unit, programmed to analyse the back-scattered light and generate a set of observations of living organisms, such as animals, such as insects, birds, bats, or aquatic organisms, for example plankton or argulus.
The transmitter unit may be adapted to transmit laser light at at least two wavelengths, w1 and w2, ... , wn, and the receiver units may be adapted to measure light at w1 and w2, ... , wn separately, and the processor unit, as part of the analysis, may be adapted to calculate a difference in absorption at w1 and w2 and wn for each observation and
generate information about the biological specificity of the living organisms, e.g.
animals.
The LIDAR system may comprise
a transmitter unit that emits laser light,
a receiver unit that receives a back-scattered portion of the laser light, and
a processor unit, e.g. data processing or computing unit, programmed to analyse the back-scattered light and generate a set of observations of living organisms, such as animals, such as insects, birds, bats, or aquatic organisms, for example plankton or argulus.
The transmitter unit may be adapted to transmit laser light at at least two polarization states, p1 and p2, and/or the receiver units may be adapted to measure light at two polarization states, p1 and p2, separately, and the processor unit, as part of the
analysis, may be adapted to calculate the differential absorption and/or reflectance for each observation and generate information about the biological specificity of the living organisms, e.g. animals.
The LIDAR system may comprise
a transmitter unit that emits laser light,
a receiver unit that receives a back-scattered portion of the laser light, and
a processor unit, e.g. data processing or computing unit, programmed to:
analyse the back-scattered light and generate a set of observations of living organisms, such as animals, such as insects, birds, bats, or aquatic organisms, for example plankton or argulus.
The transmitter unit may be adapted to transmit laser light at at least two wavelengths, w1 and w2, ... , wn, and the receiver units may be adapted to measure light at w1 and w2 and wn separately, and the processor unit, as part of the analysis, may be adapted to calculate a difference in absorption at w1 and w2 and wn for each observation, and to compare this to a set of reference data for different species, and to generate information about the biological specificity of the living organisms, e.g. animals, based on the comparison.
The LIDAR system may comprise
a transmitter unit that emits laser light,
a receiver unit that receives a back-scattered portion of the laser light, and
a processor unit, e.g. data processing or computing unit, programmed to analyse the back-scattered light and generate a set of observations of living organisms, such as animals, such as insects, birds, bats, or aquatic organisms, for example plankton or argulus.
The transmitter unit may be adapted to transmit laser light at at least two polarization states, p1 and p2, and/or the receiver units may be adapted to measure light at two polarization states, p1 and p2, separately, and the processor unit, as part of the analysis, may be adapted to calculate the differential absorption and/or reflectance for each observation, and to compare this to a set of reference data for different species, and to generate information about the biological specificity of the living organisms, e.g. animals, based on the comparison.
The reference data may comprise data for at least two different species, such as at least three, at least five, at least 10, at least 100, or at least 1000 species.
Data analysis
The processor may be adapted to count the number of animals, such as the number of insects, detected in the measurement volume over a time period.
The processor may further be adapted to extract data for each animal, e.g. for each insect, such as wing-beat oscillations, spherical scattering coefficient (size), spectral information in the optical domain of specific molecules, such as melanin, wax, chitin or haemoglobin, and also of microstructures such as wing membrane thickness.
Scattering process from insects involves diffuse and specular reflectance. Specular reflection could come from the body or the wing depending on the type of species and nature of the body and wing of the insect. If an insect has a furry body and shiny wing or the opposite, the total scatter cross-section will be a combination of diffuse and specular reflections. This can be decomposed into different components to identify the body and wing contributions. In general, specular and diffuse reflectance contributes to the total optical cross-section OCS. The specular reflectance from the wing is
responsible for the higher order harmonics. The fundamental tone and lower harmonics represents the diffuse reflectance.
In a LIDAR system with emission of more than one wavelength, chromatic properties of animals in the measurement volume may be determined, e.g. by the processor.
Also iridescence features can be determined, e.g. by the processor, e.g. by comparing the shape of temporal waveforms of received electromagnetic radiation in the visible range VIS with electromagnetic radiation in the near infrared range NI R.
Also melanisation properties can be determined, e.g. by the processor, e.g. by comparing OCS of insects in the N IR and SWI R ranges, since the optical cross-section ratio between N IR and SWI R scales with melanisation.
Determination of insect size is significantly more accurate in the SWI R range as compared to NI R, since NI R OCS depends on the extent of melanisation of the insect, while SWI R OCS is relatively insensitive to insect melanisation.
Melanin is a natural pigment or chromophore that determines the colour of an insect's body and wings. Melanisation gives rise to dark or brownish appearance in the VIS. This is due to multiple reflections of the incident light interaction with the tissue. This effect could introduce some uncertainty in determining absolute optical cross-section OCS of insects in the Ultraviolet (UV), VIS and N IR. SWIR is insensitive to
melanisation. Considering the difference between NI R and SWI R, reflectance from insects of different colour and same size could be different depending on which detector used or detection wavelength chosen. Other colouration mechanisms than melanisation exist in the VIS and UV, such as cryptic coloration, warning colour, sexually selected colours, structural colours, etc. These effects have little impact in the NIR, and therefore melanisation is preferably determined, e.g. by the processor, from the ratio of OCS, e.g. back scattered OCS, in the two bands NI R and SWI R rather than from the ratio of OCS in the two bands VIS and SWI R.
Melanisation may be calculated, e.g. by the processor, according to the following equation: Melanisation = 1 - [(OCSNIR) I {OCSSWIR + OCSNIR)] wherein
OCSNIR and OCSswm are the OCS in the N IR and SWI R ranges, respectively.
The body and wing contribution of the insect to the total OCS may be distinguished, e.g. by the processor, using a sliding temporal minimum filter with width of wing beat periodicity and determine the peak value of the sliding minimum and thereby define the non-oscillatory body contribution to the total OCS.
With high frequency, wing beat modulation as well as higher order harmonics may be resolved, e.g. by calculation of the modulation power spectrum that includes the non- oscillating body contribution of the insect observation in the measurement volume, the fundamental wing-beat frequency and its harmonics overtones. The fundamental frequency may be estimated from the median value of the distance between the peaks in the power spectrum. The relative strength of the odd and even harmonics may be used for the determination, e.g. by the processor, of observed orientation of the insect and ultimately the flight direction. Insects appears large twice during one wing-beat cycle, strong 2ω, from the side and appear large once during one wing-beat cycle, strong 1 ω, according the insect model. This means that the total OCS oscillates depending on the type of insect and the observed orientation of the insect.
Below an example is disclosed of data analysis for insect detection with the LIDAR system.
The at least one detector of electromagnetic radiation may comprise a CCD or CMOS array, e.g. a linear CCD or CMOS array, e.g. a linear CCD or CMOS array with 2048 pixels, wherein each of the pixels of the CCD or CMOS array is arranged for reception of electromagnetic radiation from a specific part of the measurement volume. A CCD or CMOS element of each pixel charges a capacitor in response to the intensity of electromagnetic radiation received by the CCD or CMOS element, i.e. the
electromagnetic radiation incident upon it, so that at each point in time the amount of charge of the capacitor corresponds to the integrated intensity of the received electromagnetic radiation. The entire set of charges of capacitors of the CCD or CMOS array is output at regular intervals and denoted a frame. Upon read-out of the capacitor charge values, the capacitors are reset to zero charge.
The processor may be adapted for reception of the frames and for analysis of the frames in real time or may be adapted for data collection on a data storage, such as a hard disk, for subsequent analysis.
For example, about 30000 frames are collected and saved in one file. This means that the data is effectively an array of 30000 x 2048, 16 bit values. The frames are collected at about 3 kHz so that every 10 seconds a file is saved.
The processor is further adapted for controlling the source of electromagnetic radiation, e.g. a laser, two lasers, etc., and switch it off when a frame has been recorded and switch it on when a frame without emission of electromagnetic radiation from the
source has been recorded and read out from the CCD or CMOS array. In this way, an alternating series of frames collected that has the source on and off.
The collected data is processed, e.g. by the processor, as follows:
1. Background subtraction
2. Statistics
3. Thresholding of events
4. Grouping of events
5. Extracting events
6. Quantifying events
Each of these steps is shortly detailed below.
Background subtraction
The alternating series of frames with the laser(s) on and off is used to subtract the background that originates from, e.g., the sunlight. This is done by subtracting a frame without the laser(s) on, also denoted the dark frame, from a frame with the laser(s) on, and also denoted the bright frame. Currently the dark frame directly following the bright frame is subtracted. In the following, the background subtracted data is denoted "the signal".
Optionally, sliding window averaging may be performed on the dark frames before subtracting in order to obtain noise reduction.
Statistics
From the signal some statistics is recovered that is later used to determine when an event, e.g., an object, such as an animal, in the measurement volume, has occurred.
The idea is that events are rare are therefore are not well described by the expected noise.
The processor may perform the following steps:
For each frame of pixels:
1. Determine the median of the signal at each pixel
2. Select all data with a value below the median
3. Determine the standard deviation of the values below the median
It is assumed that the signal comprises normal distributed noise and additional rare events. The median is robust against rare events and give a good measure of the peak in the normal distribution. By determining the standard deviation on the lower half of the normal distribution, the rare events do not create a bias and the standard deviation of the noise can be determined.
Thresholding
The rare events are selected by assuming they will be more intense than N times the standard deviation above the median. Presently preferred, N=6 standard deviations above the median are used, but this can be changed. At each of the pixels of the frame, the median and standard deviation are determined and values above the median + N*standard deviation are marked in a binary matrix B.
Grouping of events
Because the noise can give rise to small and closely spaced islands in the binary matrix that actually belong to the same event, smoothening is performed. This is performed by convoluting signal*B with a 2D Gaussian function with tuneable width (along the distance axis) and height (along the time axis). Subsequently everything in this matrix above a threshold value T is marked as an event. These values are put in the mask matrix M. The width of the Gaussian and the threshold value are not very sensitive values, the Gaussian has a FWHM of a few pixels and the threshold is a constant, e.g. equal to 5.
Numbering of events
Events are connected areas in the mask matrix M, a standard algorithm is used to number these connected areas (scipy.ndimage. label).
Quantifying events
The events are now identified and can be further quantified. Several parameters of the at least one parameter may be determined for each event and stored in a data base.
Optical cross section retrieval
One important parameter of the at least one parameter of each event is the optical cross section (OCS) of the animal in the measurement volume generating the signal, which is the equivalent area of a white Lambertian reflector with the same signal strength. The first step in this process is obtaining a calibration standard, for example obtained by:
1. By having a termination point of known reflectivity. The termination point has a known distance and reflects the entire beam therefore it has a known cross section
2. Using another known reflective object in the beam, e.g. a small sphere with known reflectivity and size somewhere at a known distance along the path.
3. Calibrating the setup once in a while by dropping objects of known OCS through the beam, this could be done at any known position or could be done at each pixel.
With the calibration measured the signal can be directly related to the OCS assuming that the signal decreases inversely proportional to the squared distance to the object and the sensitivity is constant at all distances. The latter is not obvious and methods to compensate for this difference in sensitivity are currently investigated. The best methods probably rely on measurements of the air signal, i.e. scattering from dust or humidity in the air.
Other parameters
Once the OCS is retrieved, other parameters, such as the event length and range, can be determined as well as the total amount of scattered light, peak intensity, its centre of mass in time and in range. Wing-beat frequency and iridescence features of insects may also be determined. Other parameters may be included.
Retrieving harmonic content
Further analysis of events exhibiting wing beat characteristics may be performed. The wing and body contribution to the signal may be separated using a sliding minimum filter. Cepstrum analysis may be used to retrieve the fundamental harmonic.
Reconstruction of the signal and the harmonics may be performed fitting k harmonics with amplitudes ak with a harmonic series that is multiplied by the body contribution. Reconstruction of the time dependent scattering may include use of wavelet transforms.
Polarisation sensitive detection may be included to improve reconstruction of the body signal and thus of the body/wing separation.
In real-time, statistical measures and thresholding may be performed with a sliding window, e.g. a matrix with a first-in first-out structure.
Use
The LIDAR system may be used in agronomics. Agricultural intensification and pesticide use has profound effects on aerial ecology. However, impact on the composition of aerial fauna is not well understood given limitations in monitoring technologies.
Advantageously, the LIDAR system or method is used, e.g. for smart farming, precision agriculture, integrated pest management, environmental impact assessment, smart curtailment, etc., e.g. at a farm or similar to reduce the use of a pesticide and/or agricultural chemical in crops compared to prior year's use of these. By prior years, is meant the yearly average use of a pesticide and/or agricultural chemical over a period of 1 year, alternatively over 3, 5 or 10 years.
A method is provided for optimizing use of pesticides in agriculture. The method comprises the steps of measuring one, two or more species of insects using the LIDAR system, analyse data from the measurement and determined a desired pesticide, spraying time, spraying schedule and/or spraying amount.
A method is provided for optimizing use of agricultural chemicals. The method comprises the steps of measuring one, two or more species of insects using the LIDAR system, analyse data from the measurement and determined a desired agricultural chemical, spraying time, spraying schedule and/or spraying amount. Preferably, the method is automatic and further comprises a database of insect and pesticide and/or agricultural chemical information for determination of spraying parameters, for example pesticide, chemical, amount, time, or schedule.
Advantageously, the LIDAR system is used to exchange measurement data with digital pest and disease modelling platforms.
Advantageously, the LIDAR system may be used in malaria control. Today a major limitation in monitoring malaria mosquitoes is that insect abundance assessment is based on insect traps. Placing and emptying the traps are tedious operations and constitute a major effort, and the results are biased with respect to the species, sexes and age groups caught.
The LIDAR system may be used for malaria mosquito surveillance and enables non-intrusive on site monitoring of malaria mosquitoes improving decision support for national malaria control programs.
Advantageously, the LIDAR system may be used in bird and bat detection at windmill parks. A challenging task in bird monitoring lies in identifying high-altitude migrating bird species and genders.
The LIDAR system may be used by windmill park operators in order to determine critical times of operation and/or times for operational stop.
Advantageously, the LIDAR system may be used for developers of windmill parks prior to determining the optimum sites of operation, whereby information of migrating birds and or endangered bats can be taken into account.
Advantageously, the LIDAR system may be used in aquatic applications, e.g. fish farming. Aquaculture production systems may suffer from undesired aquatic organisms, such as sea lice and carpulus. An increasing problem is chemical treatments to reduce fish diseases, excessive antibiotic use and resistance. This has negative environmental impact, such algae bloom, marine mammal deaths, marine debris, and waste on the ocean floor.
Advantageously, the LIDAR system provides a new tool for analysing aquatic organisms and may be used to reduce the use of chemicals in fish farms and aquaculture production.
Advantageously, the LIDAR system may be used for monitoring of vegetation/seafloor via fluorescence of chlorophyll.
With the LIDAR system and method improved determinations of specificity of insects are performed in-situ.
With the LIDAR system and method quantifying can be performed of aerial or aquatic fauna with respect to biological specificity for at least two species, such as more than three, more than five, more than ten, more than 100, or more than 1000 species.
BRIEF DESCRIPTION OF THE DRAWINGS
The drawings illustrate the design and utility of embodiments, in which similar elements are referred to by common reference numerals. These drawings are not necessarily drawn to scale. In order to better appreciate how the above-recited and other advantages and objects are obtained, a more particular description of the embodiments will be rendered, which are illustrated in the accompanying drawings. These drawings depict only typical embodiments and are not therefore to be considered limiting of its scope.
In the drawings:
Fig. 1 schematically illustrates various parts of a new LIDAR system,
Fig. 2 schematically illustrates a new LIDAR system with a single laser and operating in accordance with the Scheimpflug principle,
Fig. 3 schematically illustrates the LIDAR system of Fig. 2 with an added camera,
Fig. 4 schematically illustrates a new LIDAR system with a Newtonian telescope,
Fig. 5 schematically illustrates a new LIDAR system with a single laser and two detectors,
Fig. 6 schematically illustrates a new LIDAR system with a Newtonian telescope and a camera,
Fig. 7 schematically illustrates a new LIDAR system with two lasers and two detectors operating according to the Scheimpflug principle,
Fig. 8 is a flowchart of determining and classifying fauna with the new LIDAR system,
Fig. 9 shows a schematic illustration of a LIDAR system for reference measurement of an insect,
Fig. 10 shows plots of detector signals,
Fig. 1 1 shows a histogram of numbers of detected insects, and
Fig. 12 shows histograms illustrating recognition of certain mosquitoes.
DETAILED DESCRIPTION
The LIDAR system and corresponding methods will now be described more fully hereinafter with reference to the accompanying drawings, in which various types of the LIDAR system are shown. The LIDAR system may be embodied in different forms not shown in the accompanying drawings and should not be construed as limited to the embodiments and examples set forth herein. It should be noted that the figures are not drawn to scale and that elements of similar structures or functions are represented by like reference numerals throughout the figures. It should also be noted that the figures are only intended to facilitate the description of the embodiments. They are not intended as an exhaustive description of the LIDAR system and methods according to the appended claims or as a limitation on the scope of the claims. In addition, an illustrated embodiment needs not have all the aspects or advantages shown. An aspect or an advantage described in conjunction with a particular embodiment is not necessarily limited to that embodiment and can be practiced in any other embodiments even if not so illustrated, or not so explicitly described.
Fig. 1 schematically illustrates various parts of a new LIDAR system 10 for analysing fauna in accordance with the appended set of claims.
The illustrated LIDAR system 10 comprises
■ a transmitter unit with a transmitter housing 12 that accommodates the at least one
source (not visible) of electromagnetic radiation that is adapted for emission of
electromagnetic radiation towards a measurement volume for illumination of an animal in the measurement volume,
■ a receiver unit with a receiver housing 14 that accommodates the at least one detector (not visible) of electromagnetic radiation that is arranged for provision of at least one output signal in response to reception of electromagnetic radiation having interacted with the animals in the measurement volume,
■ a camera unit with a camera housing 16 that accommodates a camera (not visible) that is used for proper alignment of the LIDAR system and optionally for monitoring of the propagation paths of the emitted and received electromagnetic radiation,
■ a frame 18 in the form of a girder 24 that supports the transmitter housing 12, the
receiver housing 14, and the camera housing 16,
■ a scanner 20 that is connected to the frame 18 and arranged for moving the frame 18, e.g. pan and/or tilt and/or pitch and/or traverse the frame 18, and thereby moving the measurement volume, e.g. to scan a desired volume along a desired moving trajectory, e.g. to perform measurements throughout the desired volume larger than the
measurement volume; or to perform measurements in sample volumes, e.g. in a regular pattern of volumes separated by volumes wherein no measurements are performed, and
■ a processor unit 22 with a processor that is adapted for, based on the at least one output signal from detector(s) in the receiver housing 14,
o detecting animals in the measurement volume,
o counting detected animals, and
o determining at least one parameter of the received electromagnetic radiation relating to the species of the animals.
In Fig. 1 , the LIDAR system 10 is shown with a frame 18 with a horizontal girder 24;
however, the LIDAR system 10 may also be oriented with a vertical girder 24; or, with the girder 24 having an orientation somewhere between vertical and horizontal.
In one example of the illustrated LIDAR system, the distance between the transmitter housing 12 and the receiver housing 14 is 800 mm, and the housings 12, 14 are arranged so that the proximate end of the measurement volume is located 20 m from the LIDAR system 10 and the distal end of the measurement volume is located 800 m from the LIDAR system 10.
In a first type of the illustrated system 10, the transmitter housing 12 accommodates a laser for emission of a laser beam with wavelengths in the NIR range, e.g. having wavelengths ranging from 750 nm to 1400 nm.
In a second type of the illustrated system 10, the transmitter housing 12 accommodates a laser for emission of a laser beam with wavelengths in the SWIR range, e.g. having wavelengths ranging from 1400 nm to 3000 nm.
In a third type of the illustrated system 10, the transmitter housing 12 accommodates a first laser for emission of a laser beam with wavelengths in the NIR range and a second laser for emission of a laser beam with wavelengths in the SWIR range.
In a large variety of other types of the illustrated system 10, the transmitter housing 12 may accommodate one or more sources of electromagnetic radiation of various types and in various combinations.
The illustrated LIDAR system 10 may have one source of electromagnetic radiation, e.g. emitting electromagnetic radiation at a plurality of wavelengths, e.g. due to emission of harmonics.
Additionally, or alternatively, the illustrated LIDAR system 10 may have more than one source of electromagnetic radiation, and the transmitter housing 12 may accommodate transmitter optics (not visible) arranged so that electromagnetic radiation from different sources coincide, or substantially coincide, in the measurement volume for illumination of a living organism, such as an insect, bird, bat, an aquatic organism, etc., e.g., with the same, or substantially the same, spot size and spot centre for the different respective wavelengths w1 , w2, ... , wn.
By substantially is meant that the receiver(s) (not visible) accommodated in the receiver housing 14 do(es) not experience a difference in signal related to different propagation paths of the electromagnetic radiation w1 , w2, ... , wn.
Preferably, electromagnetic radiation w1 , w2, ... , wn emitted from the same and/or different sources accommodated in the transmitter housing 12 are separated by at least 100 nm. For example, w1 and w2 may be near-infrared wavelengths for eye-safety reasons, for example w1 may be equal to, or approximately equal to 808 nm, and w2 may be equal to, or approximately equal to 980 nm; or, w1 may be equal to, or approximately equal to 980 nm, and w2 may be equal to, or approximately equal to 1550 nm.
In one type of the illustrated LIDAR system 10, the transmitter housing accommodates two separate continuous wave (CW) lasers.
In one type of the illustrated LIDAR system 10, the transmitter housing accommodates a diode laser.
In one type of the illustrated LIDAR system 10, the transmitter housing accommodates an array of diode lasers.
In one type of the illustrated LIDAR system 10, the transmitter housing accommodates a supercontinuum source.
Optionally, the transmitter housing 12 of the illustrated LIDAR system 10 accommodates transmitter optics (not visible) for emission of beams of electromagnetic radiation of at least two different polarization states p1 , p2; wherein the beams are coinciding, or substantially coinciding, in the measurement volume for illumination of a living organism, such as an insect, bird, bat, an aquatic organism, etc., with the same, or substantially the same, spot size and spot centre of the beams with polarization states p1 and p2, respectively.
The optional transmitter optics comprises a half-waveplate to provide different beam paths in at least part of the system 10 for beams of different polarization states p1 , p2.
The optional transmitter optics comprises an optical element, wherein the system is designed such that light of p1 or p2 is transmitted through the optical element in the Brewster angle.
Optionally, the transmitter housing 12 accommodates one or more beam shapers (not visible), each of which is adapted for shaping the intensity profile of a respective laser beam into a desired profile, such as a Gaussian intensity profile, at top hat intensity profile, etc. The one or more beam shapers may comprise an optical fibre adapted for shaping the intensity profile of the beam into a Gaussian beam profile. The one or more beam shapers may comprise a phase contrast system adapted for shaping the intensity profile of the beam, such as a Gaussian intensity profile, at top hat intensity profile, etc.
The illustrated LIDAR system 10 comprises a receiver unit with a receiver housing 14 that accommodates the at least one detector (not visible) of electromagnetic radiation that is arranged for provision of at least one output signal in response to reception of
electromagnetic radiation having interacted with the animals in the measurement volume. The at least one detector is suitable for detection of the radiation emitted by the at least one source of electromagnetic radiation.
Preferably, the at least one detector comprises a semiconductor detector.
In the first type of the illustrated system 10, the receiver housing 14 accommodates a Si detector, e.g. a quadrant Silicon detector, for detection of electromagnetic radiation with wavelengths in the NIR range.
In the second type of the illustrated system 10, the receiver housing 14 accommodates an InGaAs detector for detection of electromagnetic radiation with wavelengths in the SWIR range.
In the third type of the illustrated system 10, the receiver housing 14 accommodates both a Si detector and an InGaAS detector and a dichroic beam splitter positioned in the
propagation path of the electromagnetic radiation in front of the two detectors. The dichroic beam splitter is adapted to transmit SWIR electromagnetic radiation and reflect NIR electromagnetic radiation.
Quadrant detectors enable detection of direction of movement of an animal through the measurement volume based on the timing of the outputs from each quadrant.
In a large variety of other types of the illustrated system 10, the receiver housing 14 may accommodate one or more detectors of various types and in various combinations suitable for detection of electromagnetic radiation emitted by the transmitter unit.
The receiver housing 14 may accommodate a Newtonian telescope (not visible) cooperating with the detector(s) accommodated in the housing for reception of electromagnetic radiation from the measurement volume.
The receiver housing 14 of the receiver unit can be arranged for reception of backscattered electromagnetic radiation from the measurement volume.
The receiver housing 14 of the receiver unit can be arranged for reception of electromagnetic radiation from the measurement volume from an angle different from the direction of propagation of the electromagnetic radiation emitted by the source(s) of electromagnetic radiation residing in the transmitter housing 12.
Optionally, the receiver housing 14 comprises an optical system (not visible) arranged for cooperation with the detector(s) in the receiver housing 14 for directing the received electromagnetic radiation from an area along the laser beam(s) emitted from the transmitter housing 12 onto the receiver(s) of the receiver housing 14. For example, the receiver housing 14 comprises an imaging system (not visible) arranged for cooperation with the detector(s) in the receiver housing 14 in accordance with the Scheimpflug principle by imaging electromagnetic radiation from an area along the emitted laser beam(s) onto the receiver(s) of the receiver housing 14.
Optionally, the receiver housing 14 accommodates a linear CCD or CMOS array with 2048 pixels, wherein each of the pixels of the CCD or CMOS array is arranged for reception of electromagnetic radiation from a specific part of the measurement volume. A CCD or CMOS element of each pixel charges a capacitor in response to the intensity of electromagnetic radiation received by the CCD or CMOS element, i.e. the electromagnetic radiation incident upon it, so that at each point in time the amount of charge of the capacitor corresponds to the integrated intensity of the received electromagnetic radiation. The entire set of 2048 charges of capacitors of the CCD or CMOS array is output at regular intervals and denoted a frame. Upon read-out of the capacitor charge values, the capacitors are reset to zero charge.
The measurement volume is the part of the emitted electromagnetic radiation that the optical system images onto the receiver(s). In this way, the distance from the LIDAR system to an animal detected in the measurement volume can also be determined.
Optionally, the receiver housing 14 accommodates one or more bandpass filter(s) cooperating with the detector(s) also accommodated in the receiver housing 14 for suppression of background signals from the measurement volume and having a centre wavelength within the wavelength range of the source(s) of electromagnetic radiation accommodated in the transmitter housing 12.
Scattering from insects involves diffuse and specular reflectance. Specular reflection could come from the body or the wing depending on the type of species and nature of the body and wing of the insect. If an insect has a furry body and shine wing or the opposite, the total scatter cross-section will be a combination of diffuse and specular reflections. This can be decomposed into different components to identify the body and wing contributions. In general, specular and diffuse reflectance contributes to the total optical cross-section OCS. The specular reflectance from the wing is responsible for the higher order harmonics. The fundamental tone and lower harmonics represents the diffuse reflectance.
In types of the illustrated LIDAR system 10 with emission of more than one wavelength, chromatic properties of animals in the measurement volume may be determined.
Also iridescence features can be determined, e.g. by comparing the shape of temporal waveforms of received electromagnetic radiation in the visible range VIS with
electromagnetic radiation in the near infrared range NIR.
Also melanisation properties can be determined, e.g. by comparing OCS of insects in the NIR and SWIR ranges, since the optical cross-section ratio between NIR and SWIR scales with melanisation.
Determination of insect size is significantly more accurate in the SWI R range as compared to NIR, since N IR OCS depends on the extent of melanisation of the insect, while SWIR OCS is relatively insensitive to insect melanisation.
Melanin is a natural pigment or chromophore that determines the colour of an insect's body and wings. Melanisation gives rise to dark or brownish appearance in the VIS. This is due to multiple reflections of the incident light interaction with the tissue. This effect could introduce some uncertainty in determining absolute optical cross-section OCS of insects in the
Ultraviolet (UV), VIS and NIR. SWI R is insensitive to melanisation. Considering the difference between NI R and SWI R, reflectance from insects of different colour and same size could be different depending on which detector used or detection wavelength chosen. Other colouration mechanisms than melanisation exist in the VIS and UV, such as cryptic coloration, warning colour, sexually selected colours, structural colours, etc. These effects have little impact in the NI R, and therefore melanisation is preferably determined from the ratio of OCS, e.g. back scattered OCS, in the two bands NI R and SWIR rather than from the ratio of OCS in the two bands VIS and SWIR.
Optionally, the processor of the processor unit 22 is adapted for determination of
melanisation according to the following equation:
Melanisation = 1 - [(OCSNIR) I {OCSSWIR + OCSNIR)]
wherein OCSNIR and OCSSWIR are the OCS in the N IR and SWI R ranges, respectively.
Optionally, the processor of the processor unit 22 is adapted for determination of the body and wing contribution of the insect to the total OCS using a sliding temporal minimum filter with width of wing beat periodicity and determining the peak value of the sliding minimum and thereby defines the non-oscillatory body contribution to the total OCS.
With high sampling frequency, optionally, the processor of the processor unit 22 is adapted for determination of wing beat modulation as well as higher order harmonics by calculation of the modulation power spectrum that includes the non-oscillating body contribution of the insect observation in the measurement volume, the fundamental wing-beat frequency and its harmonics. The fundamental frequency is estimated from the median value of the distance between the peaks in the power spectrum. The relative strength of the odd and even harmonics is used for the determination of observed orientation of the insect and ultimately the flight direction. Insects appears large twice during one wing-beat cycle, strong 2ω, from the side and appear large once during one wing-beat cycle, strong 1 ω, according the insect
model. This means that the total OCS oscillates depending on the type of insect and the observed orientation of the insect.
Below, optional data analysis is disclosed for insect detection with the illustrated LIDAR system 10 with the linear CCD or CMOS array.
The processor of the processor unit 22 is adapted for reception of the frames of the CCD or CMOS array and for analysis of the frames in real time or is adapted for data collection on a data storage, such as a hard disk, for subsequent analysis.
For example, about 30000 frames are collected and saved in one file. This means that the data is effectively an array of 30000 x 2048, 16 bit values. The frames are collected at about 3 kHz so that every 10 seconds a file is saved.
The processor of the processor unit 22 is further adapted for controlling the source of electromagnetic radiation, e.g. a laser, two lasers, etc., and switch it off when a frame has been recorded and switch it on when a frame without emission of electromagnetic radiation from the source has been recorded and read out from the CCD or CMOS array. In this way, an alternating series of frames collected with the source on and off.
The processor of the processor unit 22 may be adapted for processing the collected data as follows:
1. Background subtraction
2. Statistics
3. Thresholding of events
4. Grouping of events
5. Extracting events
6. Quantifying events
Each of these steps is shortly detailed below.
Background subtraction
The alternating series of frames with the laser(s) on and off is used to subtract the background that originates from, e.g., the sunlight. This is done by subtracting a frame without the laser(s) on, also denoted the dark frame, from a frame with the laser(s) on, and also denoted the bright frame. Currently the dark frame directly following the bright frame is subtracted. In the following, the background subtracted data is denoted "the signal".
Optionally, sliding window averaging may be performed on the dark frames before subtracting in order to obtain noise reduction.
Statistics
From the signal some statistics is recovered that is later used to determine when an event, e.g., an object in the measurement volume, has occurred.
The idea is that events are rare are therefore are not well described by the expected noise.
For each frame of pixels:
1. Determine the median of the signal at each pixel
2. Select all data with a value below the median
3. Determine the standard deviation of the values below the median
It is assumed that the signal comprises normal distributed noise and additional rare events. The median is robust against rare events and give a good measure of the peak in the normal distribution. By determining the standard deviation on the lower half of the normal distribution, the rare events do not create a bias and the standard deviation of the noise can be determined.
Thresholding
The rare events are selected by assuming they will be more intense than N times the standard deviation above the median. Presently preferred, N=6 standard deviations above the median are used, but this can be changed. At each of the pixels of the frame, the median and standard deviation are determined and values above the median + N*standard deviation are marked in a binary matrix B.
Grouping of events
Because the noise can give rise to small and closely spaced islands in the binary matrix that actually belong to the same event, smoothening is performed. This is performed by convoluting signal*B with a 2D Gaussian function with tuneable width (along the distance axis) and height (along the time axis). Subsequently everything in this matrix above a threshold value T is marked as an event. These values are put in the mask matrix M. The width of the Gaussian and the threshold value are not very sensitive values, the Gaussian has a FWHM of a few pixels and the threshold is a constant, e.g. equal to 5.
Numbering of events
Events are connected areas in the mask matrix M, a standard algorithm is used to number these connected areas (scipy.ndimage. label).
Quantifying events
The events are now identified and can be further quantified. Several parameters are determined for each event and stored in a data base.
Optical cross section retrieval
One important parameter of each event is the optical cross section (OCS) of the animal in the measurement volume generating the signal, which is the equivalent area of a white Lambertian reflector with the same signal strength. The first step in this process is obtaining a calibration standard, for example obtained by:
1. By having a termination point of known reflectivity. The termination point has a known distance and reflects the entire beam therefore it has a known cross section
2. Using another known reflective object in the beam, e.g. a small sphere with known reflectivity and size somewhere at a known distance along the path.
3. Calibrating the setup once in a while by dropping objects of known OCS through the beam, this could be done at any known position or could be done at each pixel.
With the calibration measured, the signal can be directly related to the OCS. The best calibration methods probably rely on measurements of the air signal, i.e. scattering from dust or humidity in the air.
Other parameters
Once the OCS is retrieved, other parameters, such as the event length and range, can be determined as well as the total amount of scattered light, peak intensity, its centre of mass in time and in range. Wing-beat frequency and iridescence features of insects may also be determined. Other parameters may be included.
Retrieving harmonic content
Further analysis of events exhibiting wing beat characteristics may be performed. The wing and body contribution to the signal may be separated using a sliding minimum filter.
Cepstrum analysis may be used to retrieve the fundamental harmonic. Reconstruction of the signal and the harmonics may be performed fitting k harmonics with amplitudes ak with a harmonic series that is multiplied by the body contribution.
Reconstruction of the time dependent scattering may include use of wavelet transforms.
Polarisation sensitive detection may be included to improve reconstruction of the body signal and thus of the body/wing separation.
In real-time, statistical measures and thresholding may be performed with a sliding window, e.g. a matrix with a first-in first-out structure.
One type of the illustrated LIDAR system has a second receiver unit with a fourth housing (not shown) accommodating the same type of components as the receiver housing 12;
however, the receiver housing 14 and the fourth housing are arranged for reception of electromagnetic radiation, e.g., with 90 degree mutual separation, so that an animal in the measurement volume may be viewed from the side and the top allowing for good
reconstruction of the position of the animal, such as an insect, within the measurement volume and flight direction may be determined.
Optionally, the receiver housing 14 of the receiver unit is mounted on a separate frame that can be positioned in an arbitrary position with relation to the transmitter housing 12 of the transmitter unit for detection of fauna in the measurement volume, e.g. in accordance with the Scheimpflug principle.
Optionally, the fourth housing of the second receiver unit is mounted on a separate frame that can be positioned in an arbitrary position with relation to the transmitter housing 12 of the transmitter unit for detection of fauna in the measurement volume, e.g. in accordance with the Scheimpflug principle.
In the illustrated LIDAR system 10, the processor of the processor unit 22 is adapted for controlling the at least one source of electromagnetic radiation in the transmitter housing 12 and for turning the at least one source of electromagnetic radiation on and off alternatingly, and the processor of the processor unit 22 is further adapted for determination of background emission of electromagnetic radiation from the measurement volume when the at least one source of electromagnetic radiation is turned off.
In the third type of the illustrated system 10, the processor of the processor unit 22 is adapted for determination of intensities at two or more wavelengths w1 , w2, ... , wn and for comparison of the determined intensities with a set of reference data for different species, and for generation of information on biological specificity of the living organisms, e.g.
animals.
Optionally, the processor of the processor unit 22 is adapted for determination of intensities at two or more polarization states p1 , p2 and for comparison of the determined intensities
with a set of reference data for different species, and for generation of information on biological specificity of the living organisms, e.g. animals.
Optionally, the processor of the processor unit 22 is connected to the camera in the camera housing 16 for reception of images from the camera, and the processor of the processor unit 22 is adapted for performing image analysis of images received from the camera and for controlling the source(s) of electromagnetic radiation in the transmitter housing 12 in response to the performed analysis, e.g. during alignment of the system, and e.g. for monitoring obstacles in the propagation paths of the emitted and and/or received
electromagnetic radiation and turning the source(s) of electromagnetic radiation in the first hosing 12 off to prevent inadvertent illumination of objects, e.g., humans.
The processor of the processor unit 22 is adapted for controlling the scanner 20 to move the measurement volume across a desired volume along a desired moving trajectory e.g. to perform measurements throughout the desired volume larger than the measurement volume; or, to perform measurements in sample volumes, e.g. in a regular pattern of volumes separated by volumes wherein no measurements are performed.
In addition to counting the number of detected insects, the processor of the processor unit 22 may further extract data for each insect, such as wing-beat oscillations, spherical scattering coefficient (size), spectral information of specific molecules, such as melanin, wax, chitin or haemoglobin, and also of microstructures, such as wing membrane thickness.
The processor of the processor unit 22 may be adapted to determine reference data based on electromagnetic radiation received from the animal in the measurement volume.
The reference data may comprise data for at least two different species, such as at least three, at least five, at least 10, at least 100, or at least 1000 species.
Preferably, the set of reference data comprises information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, and microstructures of wings, e.g., periodicity and/or thickness. By one, but preferably more, of these parameters, it is for example possible to determine colouring of an insect, bird, bat or aquatic organism as an indicator of species, gender and/or age. Further, by one, but preferably more, of these parameters, it is for example possible to determine whether a mosquito has taken a meal, e.g. bitten or sucked blood, i.e. whether it may potentially be infected with malaria and pose a risk.
Preferably, the set of reference data comprises spectral differential absorption information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, and microstructures of wings, e.g., periodicity and/or thickness).
Preferably, the set of reference data comprises polarization-dependent absorption and/or reflectance information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, and microstructures of wings, e.g., periodicity and/or thickness.
Preferably, the set of reference data comprises differential spectral absorption data of different species. In a preferred embodiment, the set of reference data comprises differential polarization absorption and/or reflectance data of different species.
Preferably, the reference data further comprises information with respect to gender and/or age of a species.
Preferably, the set of reference data is obtained from operating the illustrated LIDAR system 10 in an insectarium (also referred to as insectary) with predetermined species of insects. Alternatively, or additionally, the set of reference data is obtained from operating the illustrated LIDAR system 10 in an area with predetermined species of birds and/or bats, and/or or from operating the illustrated LIDAR system 10 with simultaneously determination of species of birds and/or bats via for example camera and imaging technologies, or utilizing RADAR technologies.
Alternatively, or additionally, the set of reference data is obtained from operating the illustrated LIDAR system 10 for aquatic fauna in an aquarium with predetermined species of aquatic organisms.
Preferably, a method is provided that generates a set of biological specificity data by applying the illustrated LIDAR system 10 in an insectarium comprising at least one predetermine species, such as at least two, at least three, at least three, at least five, at least 10, at least 100, or at least 1000 predetermined species.
The set of reference data, or part of the set of reference data, may be embedded within the processor of the processor unit 22 of the illustrated LIDAR system 10.
The set of reference data, or part of the set of reference data, may be accessed remotely, for example via a cloud-based solution.
Optionally, the illustrated LIDAR system 10 comprises a calibrator (not shown) arranged for placing an object with a known optical characteristic in the measurement volume.
Optionally, the illustrated LIDAR system 10 comprises a trap and a filming unit taking a photograph of an insect collected in the trap. The trap and the filming unit serve to provide additional information to the system, such as for verification, quality, or reference purposes or combinations of these.
The illustrated LIDAR system 10 may be used in agronomics. Agricultural intensification and pesticide use has profound effects on aerial ecology. However, impact on the composition of aerial fauna is not well understood given limitations in monitoring technologies.
A method is provided for optimizing use of pesticides in agriculture. The method comprises the steps of measuring one, two or more species of insects using the illustrated LIDAR system 10, analyse data from the measurement, e.g. using supervised or unsupervised learning algorithms etc., and determine a desired pesticide, spraying time, spraying schedule and/or spraying amount.
A method is provided for optimizing use of agricultural chemicals. The method comprises the steps of measuring one, two or more species of insects using the Illustrated LIDAR system 10, analyse data from the measurement and determine a desired agricultural chemical, spraying time, spraying schedule and/or spraying amount. Preferably, the method is automatic and further and further comprises data exchange with a digital pest and disease modelling platform for determination of spraying parameters, for example pesticide, chemical, amount, time, or schedule.
Preferably, the Illustrated LIDAR system 10 or method is used at a farm or similar to reduce the use of a pesticide and/or agricultural chemical in crops compared to prior year's use of these. By prior years, is meant the yearly average use of a pesticide and/or agricultural chemical over a period of 1 year, alternatively over 3, 5 or 10 years.
Advantageously, the Illustrated LIDAR system 10 may be used in vector control, such as malaria control. Today a major limitation in monitoring malaria mosquitoes is that insect abundance assessment is based on insect traps. Placing and emptying the traps are tedious operations and constitute a major effort, and the results are biased with respect to the species, sexes and age groups caught.
The Illustrated LIDAR system 10 may be used for vector surveillance, such as malaria mosquito surveillance, and enables non-intrusive on site monitoring, e.g. of malaria mosquitoes, improving decision support for national vector control programs.
Advantageously, the Illustrated LIDAR system 10 may be used for monitoring threatened and endangered species of birds and bats. A challenging task in bird monitoring lies in identifying high-altitude bird species and genders.
Advantageously, the Illustrated LIDAR system 10 may be used for bird and bat detection at windmill parks.
The Illustrated LIDAR system 10 may be used by windmill park operators in order to determine critical times of operation and/or times for operational stop.
Advantageously, the Illustrated LIDAR system 10 may be used for developers of windmill parks prior to determining the optimum sites of operation, whereby information of migrating birds and or endangered bats can be taken into account.
Advantageously, the Illustrated LIDAR system 10 may be used in aquatic applications.
Aquaculture production systems may suffer from undesired aquatic organisms, such as sea lice and carpulus. An increasing problem is chemical treatments to reduce fish diseases, excessive antibiotic use and resistance. This has negative environmental impact, such algae bloom, marine mammal deaths, marine debris, and waste on the ocean floor.
Advantageously, the Illustrated LIDAR system 10 provides a new tool for analysing aquatic organisms and may be used to reduce the use of chemicals in fish farms and aquaculture production.
Advantageously, the Illustrated LIDAR system 10 may be used for monitoring of
vegetation/seafloor via fluorescence of chlorophyll.
With the Illustrated LIDAR system 10 and method improved determinations of specificity of insects are performed in-situ.
With the Illustrated LIDAR system 10 and method quantifying can be performed of aerial or aquatic fauna with respect to biological specificity for at least two species, such as more than three, more than five, more than ten, more than 100, or more than 1000 species.
Fig. 2 schematically illustrates one optical configuration of the LIDAR system 10 shown in Fig. 1 and of a type with a transmitter unit with a transmitter housing accommodating a single laser 40 and with a receiver unit with a receiver housing that is arranged for operation in accordance with the Scheimpflug principle.
In optical imaging systems, an object plane is usually imaged onto an image plane that is parallel to the object plane, and the imaging is performed with a lens that provides a focussed image of the object plane onto the image plane. The lens has an optical axis
perpendicular to the object plane and the image. If, however, the optical axis of the lens is tilted with respect to the image plane, the plane imaged onto the image plane with sharp focus will also be tilted according to geometrical and optical properties. In Fig. 2, a lens 42 of the receiver unit is tilted according to the Scheimpflug principle so that the object plane that is focussed onto the image plane 44 of the detector 46 contains the laser beam 48 emitted by the laser 40 of the transmitter unit. In this way, a large part of the laser beam 48 is focussed onto the image plane 44 of the detector 46, and both near and far parts of the laser beam 48 will be in focus. The image plane 44 of the detector 46 and a lens plane 50 of the lens 42 intersect with the laser beam 48 at what is called the Scheimpflug intersection point 52.
The detector 46 is a linear CCD or CMOS array with 2048 pixels arranged so that each of the pixels of the CCD or CMOS array receives electromagnetic radiation from a specific part of the laser beam 48 along the length of the laser beam 48 so that ranging can be performed due to the one-to-one imaging of individual segments of the laser beam 48 along the length of the laser beam 48 onto respective individual CCD or CMOS pixels.
Otherwise, the LIDAR system 10 of Fig. 2 operates as explained in connection with Fig. 1 .
Fig. 3 schematically illustrates the LIDAR system 10 similar to the LIDAR system 10 shown in Fig. 2 except for the fact that a camera 60 has been added to the LIDAR system 10.
The camera 60 is used for proper alignment of the LIDAR system 10 and optionally for monitoring of the propagation paths of the emitted and received electromagnetic radiation 48, 62. Optionally, the processor of the processor unit 22 (see Fig. 1 ) is connected to the camera 60 for reception of images from the camera 60, and the processor of the processor unit 22 is adapted for performing image analysis of images received from the camera and for controlling the source 40 of electromagnetic radiation in response to the performed analysis, e.g. during alignment of the system, and e.g. for monitoring obstacles in the propagation paths of the emitted and/or received electromagnetic radiation 48, 62 and turning the source 40 of electromagnetic radiation off to prevent inadvertent illumination of objects, e.g. humans.
Fig. 4 schematically illustrates a LIDAR system 10 similar to the LIDAR system 10 shown in Fig. 2 except for the fact that a Newtonian telescope (only mirrors shown) with focussing mirror 80 and mirror 82 has been added to the LIDAR system 10. Otherwise, the LIDAR system 10 of Fig. 4 operates in the same way as the LIDAR system 10 of Fig. 2.
Fig. 5 schematically illustrates a LIDAR system 10 similar to the LIDAR system 10 shown in Fig. 4 except for the fact that another receiver housing 84 has been added to the system 10
proximate the transmitter housing with the laser 40, wherein the other receiver housing 84 accommodates a Si quadrant detector for detection of backscattered NIR radiation for detection of direction of movement through the measurement volume as explained above.
Otherwise, the LIDAR system 10 of Fig. 5 operates as explained in connection with Fig. 4. Fig. 6 schematically illustrates a LIDAR system 10 similar to the LIDAR system 10 shown in Fig. 4 except for the fact that a camera 60 has been added to the LIDAR system 10. The camera 60 is connected to the processor of the processor unit 22 for operation in the same way as explained in connection with Fig. 3.
Fig. 7 schematically illustrates a LIDAR system 10 similar to the LIDAR system 10 shown in Fig. 4 except for the fact that the transmitter unit includes two lasers 86, 88 for emission of electromagnetic radiation of different wavelengths w1 , w2, and the receiver unit includes two semiconductor detectors 90, 92, namely linear CCD or CMOS arrays 90, 92 with 2048 pixels, suitable for detection of electromagnetic radiation of the respective wavelengths w1 , w2. The lasers 86, 88 and the semiconductor detectors 90, 92 cooperate with respective
beamsplitters 94, 96 for proper operation in a way well-known to the person skilled in the art. The length of the measurement volume is of the order of 100 m. Moreover, the illustrated LIDAR system 10 operates as explained in connection with Fig. 4.
Fig. 8 shows a flowchart of determining and classifying fauna with the new LIDAR system 10. The process is described in more detail in connection with Fig. 1.
Fig. 9 shows schematically a LIDAR system 10 for reference measurements of insects. The measurement volume of the illustrated LIDAR system 10 has a relatively short length of approximately 3 m. The semiconductor detectors 90, 92 and the receiving optics are arranged for detection of backscattered electromagnetic radiation and the semiconductor detectors 90, 92 are single element or pixel detectors.
Fig. 10 shows plots of detector signals and processed detector signal. The curve 100 is a plot of an output signal of a detector of a laboratory LIDAR system with an insect in the measurement volume. The output signal is recorded with a high sample frequency and intensity variations caused by the wing beat of the insect is shown with a high resolution. The low frequency pedestal of the signal is caused by the signal contribution from the body of the insect. In the lower curve 102 of the plot, the pedestal has been subtracted from the output signal for provision of the signal contribution from the wings of the insect. The curve 104 shows a Fourier transformation of the signal contribution from the wings showing a fundamental frequency 106 of the wing beat of approximately 700 Hz and a number of
harmonic frequencies of the wing beat frequency. The curve 108 shows a Fourier transformation of the signal contribution from the body of the insect.
The curve 1 10 is a plot of an output signal of a detector of a field LIDAR system with an insect in the measurement volume. The output signal is recorded with a low sample frequency and intensity variations caused by the wing beat of the insect is shown with a low resolution. The low frequency pedestal of the signal is caused by the signal contribution from the body of the insect. In the lower curve 1 12 of the plot, the pedestal has been subtracted from the output signal for provision of the signal contribution from the wings of the insect.
Fig. 1 1 shows a histogram of numbers of detected insects 1 14 in the field in counts per hour as a function of time. A circadian rhythm of the detected insects is clearly visible.
Fig. 12 shows histograms illustrating recognition of certain mosquitoes. Reference data on wing beat frequencies of various types of male and female mosquitoes has been obtained under laboratory conditions by releasing a number of individuals of the same sex and type and determining their wing beat frequencies with the laboratory LIDAR system. This is repeated for a number of types of mosquitoes. The plot shows resulting histograms of wing beat frequencies of male Aedis aegypti 1 16 and of female Aedis aegypti 1 18. The plot also shows a histogram 120 of all wing beat frequencies recorded in the field for comparison with the reference data 1 16, 1 18. It seems that male and female Aedis aegypti were detected during the field measurements.
Although particular embodiments have been shown and described, it will be understood that they are not intended to limit the claimed inventions, and it will be obvious to those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the claimed inventions. The specification and drawings are, accordingly, to be regarded in an illustrative rather than restrictive sense. The claimed inventions are intended to cover alternatives, modifications, and equivalents.
With the description above, a person skilled in the art of photonics would be able to carry out the various LIDAR systems and methods according to the appended claims. Examples of practical implementation of a LIDAR system and data processing can be found in literature, including
Mikkel Brydegaard, Aboma Merdasa, Alem Gebru, Hiran Jayaweera, and Sune Svanberg, "Realistic Instrumentation Platform for Active and Passive Optical Remote Sensing," Appl. Spectrosc. 70, 372-385 (2016), included herein by reference, and
Brydegaard, M. (2015): "Towards Quantitative Optical Cross Sections in Entomological Laser Radar - Potential of Temporal and Spherical Parameterizations for Identifying Atmospheric Fauna." PLOS ONE, DOI: 10.1371/journal.pone.0135231 also included herein by reference, and
Mikkel Brydegaard, Alem Gebru, and Sune Svanberg, "Super Resolution Laser Radar with Blinking Atmospheric Particles - Application to Interacting Flying Insects", Progress In Electromagnetics Research, Vol. 147, 141-151 , 2014 also included herein by reference.
Claims
1. A LIDAR system for analysing fauna, comprising
at least one source of electromagnetic radiation that is adapted for emission of
electromagnetic radiation towards a measurement volume for illumination of animals in the measurement volume,
at least one detector of electromagnetic radiation that is arranged for provision of at least one output signal in response to reception of electromagnetic radiation having interacted with the animals in the measurement volume, and
a processor that is adapted for, based on the at least one output signal,
detecting animals in the measurement volume,
counting detected animals, and
determining at least one parameter of the received electromagnetic radiation relating to the species of the animals.
2. A LIDAR system according to claim 1 , wherein the processor is adapted for
comparison of the determined at least one parameter with a set of reference data for different species, and for
generation of information on biological specificity of the animals based on the comparison.
3. A LIDAR system according to claim 2, wherein the comparison includes comparison of a distribution of values of the at least one parameter with a corresponding distribution of values of the set of reference data.
4. A LIDAR system according to any of the previous claims, wherein at least one first detector of the at least one detector of electromagnetic radiation is arranged for reception of electromagnetic radiation backscattered from the measurement volume.
5. A LIDAR system according to any of the previous claims, wherein at least one second detector of the at least one detector of electromagnetic radiation is arranged for reception of electromagnetic radiation from the measurement volume from a first angle different from the direction of propagation of the electromagnetic radiation emitted by the at least one source of electromagnetic radiation.
6. A LIDAR system according to any of the previous claims, wherein at least one third detector of the at least one detector of electromagnetic radiation is arranged for reception of electromagnetic radiation from the measurement volume from a second angle different from the direction of propagation of the electromagnetic radiation emitted by the at least one source of electromagnetic radiation and different from the first angle.
7. A LIDAR system according to claim 4, comprising a first optical system arranged for cooperation with the at least one first detector for reception of electromagnetic radiation backscattered from the measurement volume.
8. A LIDAR system according to claim 5, comprising a second optical system arranged for cooperation with the at least one second detector in accordance with the Scheimpflug principle for reception of electromagnetic radiation from the measurement volume from the first angle.
9. A LIDAR system according to claim 6, comprising a third optical system arranged for cooperation with the at least one third detector in accordance with the Scheimpflug principle for reception of electromagnetic radiation from the measurement volume from the second angle different from the first angle.
10. A LIDAR system according to any of the previous claims, wherein the processor is adapted for controlling the at least one source of electromagnetic radiation and for turning the at least one source of electromagnetic radiation on and off alternatingly, and wherein the processor is further adapted for determination of background emission of electromagnetic radiation from the measurement volume when the at least one source of electromagnetic radiation is turned off.
1 1. A LIDAR system according to any of the previous claims, comprising at least one imaging system for imaging the measurement volume onto the at least one detector.
12. A LIDAR system according to any of the previous claims, comprising
a frame,
a transmitter housing for accommodation of the at least one source of electromagnetic radiation mounted to the frame, and
at least one receiver housing for accommodation of the at least one detector of
electromagnetic radiation mounted to the frame.
13. A LIDAR system according to claim 12, wherein the frame comprises a beam and wherein the transmitter housing and the at least one receiver housing is mounted to the beam.
14. A LIDAR system according to any of the previous claims, comprising at least one camera arranged for monitoring of the measurement volume.
15. A LIDAR system according to claim 14, comprising at least one camera housing for accommodation of the at least one camera and mounted to the frame.
16. A LIDAR system according to claim 14 or 15, wherein the processor is connected to the at least one camera for reception of images from the at least one camera and wherein the processor is adapted for performing image analysis of images received from the at least one camera and for controlling the at least one source of electromagnetic radiation in response to the performed analysis.
17. A LIDAR system according to claim 16, wherein the processor is adapted for monitoring alignment of the at least one source of electromagnetic radiation and the at least one detector.
18. A LIDAR system according to claim 16 or 17, wherein the processor is adapted for monitoring presence of humans proximate the electromagnetic radiation and turning the at least one source of electromagnetic radiation off to prevent inadvertent illumination of humans.
19. A LIDAR system according to any of claims 12 - 18, comprising a scanner that is arranged for moving the frame and thereby moving the measurement volume.
20. A LIDAR system according to claim 19, wherein the processor is adapted for controlling the scanner to move the measurement volume across a desired volume along a desired moving trajectory.
21. A LIDAR system according to any of the previous claims, wherein the at least one source of electromagnetic radiation comprises a laser for emission of a beam of electromagnetic radiation and a beam shaper adapted for shaping the intensity profile of the beam into a desired beam profile.
22. A LIDAR system according to claim 21 , wherein the beam shaper comprises an optical fibre adapted for shaping the intensity profile of the beam into a Gaussian beam profile.
23. A LIDAR system according to claim 21 , wherein the beam shaper comprises a phase contrast system adapted for shaping the intensity profile of the beam.
24. A LIDAR system according to claim 23, wherein the phase contrast system is adapted for shaping the intensity profile of the beam into a top hat profile.
25. A LIDAR system according to any of the previous claims, comprising a calibrator arranged for placing an object with a known optical characteristic in the measurement volume.
26. A LIDAR system according to claim 25, wherein the processor is adapted to determine system reference data based on electromagnetic radiation received from the object in the measurement volume.
27. A LIDAR system according to any of the previous claims, comprising a bandpass filter cooperating with the at least one detector for suppression of background signals and having a centre wavelength within the wavelength range of the at least one source of
electromagnetic radiation.
28. A LIDAR system according to any of the previous claims, wherein
the at least one source of electromagnetic radiation comprises at least two lasers for emission of electromagnetic radiation of respective at least two different centre
wavelengths (w1 , w2, ... , wn) and wherein
the processor is adapted for
determination of intensities at the at least two wavelengths (w1 , w2, ... , wn) and for
comparison of the determined intensities with the set of reference data for
different species, and for
generation of information on biological specificity of the animals based on the comparison.
29. A LIDAR system according to claim 28, wherein the emitted electromagnetic
radiation at the at least two wavelengths (w1 , w2, ... , wn) are coinciding in the
measurement volume.
30. A LIDAR system according to any of the previous claims, wherein
the at least one source of electromagnetic radiation is arranged for emission of
electromagnetic radiation of at least two different polarization states (p1 , p2) and
wherein
the processor is adapted for
determination of intensities at the at least two polarization states (p1 , p2) and for
comparison of the determined intensities with the set of reference data for different species, and for
generation of information on biological specificity of the animals based on the comparison.
31. A LIDAR system according to claim 30, wherein emitted electromagnetic radiation with at least two polarization states (p1 , p2) are coinciding in the measurement volume.
32. A LIDAR system according to any of claims 28 - 31 , wherein the set of reference data comprises biological specificity parameters for at least two species, such as more than three, more than five, more than ten, more than 100, or more than 1000 species.
33. A LIDAR system according to claim 32, wherein the set of reference data comprises data for at least two different species, such as at least three, at least five, at least 10, at least 100, or at least 1000 species.
34. A LIDAR system according to any of claim 28 - 33, wherein the set of reference data comprises information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, microstructures of wings, such as periodicity and/or thickness.
35. A LIDAR system according to any of the claims 28 - 34, wherein the set of reference data comprises spectral differential absorption information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, microstructures of wings, such as periodicity and/or thickness, and/or the set of reference data comprises polarization-dependent absorption and/or reflectance information of different species for one or more of the following parameters: melanin, wax, chitin, haemoglobin, microstructures of wings, such as periodicity and/or thickness.
36. A LIDAR system according to any of the claims 28 - 35, wherein the set of reference data is obtained from operating a LIDAR for aerial fauna in an insectarium with predetermined species of insects.
37. A LIDAR system according to any of the claims 28 - 36, wherein the set of reference data is embedded within the processor.
38. A LIDAR system according to any of the claims 28 - 37, wherein the set of
reference data is accessed remotely.
39. A LIDAR system according to any of the previous claims, wherein at least one of the at least one detector is arranged for detection of direction of movement of the
animal through the measurement volume.
40. A LIDAR system according to claim 39, wherein at least one of the at least one detector of electromagnetic radiation is a quadrant detector.
41. Use of a LIDAR system according to any of the previous claims within agronomics.
42. A method of optimizing use of pesticides in agriculture, wherein said method
comprises the steps of measuring one, two or more species of insects using a system according to any of claims 1 - 40, analyse data from a measurement and determine at least one of desired pesticide, spraying time, spraying schedule, and spraying amount.
43. A method according to claim 42, comprising use of a database comprising information on at least one of insects and pesticides for the determination of at least one of desired pesticide, spraying time, spraying schedule, and spraying amount.
44. A method of optimizing use of agricultural chemicals, comprising the steps of measuring one, two or more species of insects using a system according to any of claims 1 - 40, analyse data from the measurement and determine a desired agricultural chemical, spraying time, spraying schedule, and spraying amount.
45. A method according to claim 44, comprising use of a database comprising information on at least one of insects and agricultural chemicals for the determination of at least one of desired agricultural chemicals, spraying time, spraying schedule, and spraying amount.
46. A method of generating a set of biological specificity data using a LIDAR system according to any of claims 1 - 40 for aerial fauna in an insectarium comprising at least one predetermine species, such as at least two, at least three, at least three, at least five, at least 10, at least 100, or at least 1000 predetermined species.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP17718061.9A EP3446152A1 (en) | 2016-04-18 | 2017-04-18 | Improvements in or relating to optical remote sensing systems for aerial and aquatic fauna, and use thereof |
US16/094,427 US11622555B2 (en) | 2016-04-18 | 2017-04-18 | Optical remote sensing systems for aerial and aquatic fauna, and use thereof |
CN201780036380.6A CN109416403A (en) | 2016-04-18 | 2017-04-18 | Improvement or associated improvement of optical remote sensing system for aerial and aquatic animal group and application thereof |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DKPA201600232 | 2016-04-18 | ||
DKPA201600232 | 2016-04-18 | ||
DKPA201670662 | 2016-08-30 | ||
DKPA201670662 | 2016-08-30 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017182440A1 true WO2017182440A1 (en) | 2017-10-26 |
Family
ID=60115733
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2017/059127 WO2017182440A1 (en) | 2016-04-18 | 2017-04-18 | Improvements in or relating to optical remote sensing systems for aerial and aquatic fauna, and use thereof |
Country Status (4)
Country | Link |
---|---|
US (1) | US11622555B2 (en) |
EP (1) | EP3446152A1 (en) |
CN (1) | CN109416403A (en) |
WO (1) | WO2017182440A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3553556A1 (en) * | 2018-04-09 | 2019-10-16 | Visteon Global Technologies, Inc. | Light modulating lidar apparatus |
US20200154679A1 (en) * | 2018-11-16 | 2020-05-21 | Verily Life Sciences Llc | Systems and methods for sensing insect sex or species |
EP3868202A1 (en) | 2020-02-19 | 2021-08-25 | FaunaPhotonics Agriculture & Enviromental A/S | Method and apparatus for determining an index of insect biodiversity |
EP4108082A1 (en) | 2021-06-21 | 2022-12-28 | FaunaPhotonics Agriculture & Enviromental A/S | Apparatus and method for measuring insect activity |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200100491A1 (en) * | 2018-09-28 | 2020-04-02 | Vital Vio, Inc. | Inactivation of Insects With Light |
BR112022012495A2 (en) * | 2020-04-03 | 2022-10-11 | Prec Planting Llc | AGRICULTURAL SYSTEMS AND METHODS |
CN112369400B (en) * | 2020-10-30 | 2022-03-29 | 杭州双响炮网络技术有限责任公司 | Mouse trapping device capable of being lifted automatically and lifting method |
CN115035411B (en) * | 2022-06-17 | 2023-01-17 | 宁波大学 | Hyperspectral data-based spartina alterniflora index construction and extraction method |
WO2024079343A1 (en) * | 2022-10-13 | 2024-04-18 | Faunaphotonics Agriculture & Environmental A/S | System and method for detection of insects |
CN117607119B (en) * | 2023-12-07 | 2024-08-06 | 百鸟数据科技(北京)有限责任公司 | Bird tracking method and device based on fluorescence detection |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2008009536A1 (en) * | 2006-07-17 | 2008-01-24 | Siemens Aktiengesellschaft | Industrial plant having safety-relevant area |
WO2009064626A1 (en) * | 2007-11-01 | 2009-05-22 | Lockheed Martin Cohernt Technologies, Inc. | Sensing using polarization diversity and wavelength dependent backscatter |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AU693039B2 (en) * | 1995-09-06 | 1998-06-18 | McCarron Pty Ltd | Termite detection system |
US5793034A (en) * | 1995-09-18 | 1998-08-11 | Daedalus Enterprises, Inc. | Target detection system utilizing multiple optical criteria |
US6593582B2 (en) | 2001-05-11 | 2003-07-15 | Science & Engineering Services, Inc. | Portable digital lidar system |
WO2006083349A2 (en) | 2004-11-19 | 2006-08-10 | Science & Engineering Services, Inc. | Enhanced portable digital lidar system |
FR2885744B1 (en) | 2005-05-10 | 2007-07-20 | Thales Sa | ACTIVE OPTICAL MEASURING DEVICE WITH LOW SIGNAL AMPLIFICATION |
US7339670B2 (en) | 2005-07-29 | 2008-03-04 | Lockheed Martin Coherent Technologies, Inc. | Wavelength normalized depolarization ratio lidar |
US9013711B2 (en) * | 2008-04-01 | 2015-04-21 | Perceptron, Inc. | Contour sensor incorporating MEMS mirrors |
US9946922B2 (en) * | 2009-01-15 | 2018-04-17 | Tokitae Llc | Photonic fence |
CN102340988B (en) * | 2009-01-15 | 2014-02-26 | 脱其泰有限责任公司 | Photonic fence |
US20110080311A1 (en) * | 2009-10-05 | 2011-04-07 | Michael Pushkarsky | High output laser source assembly with precision output beam |
US8616052B1 (en) | 2010-10-12 | 2013-12-31 | Exelis, Inc. | System and method of visualization of species characterization, dynamics and stratification of the magnetosphere |
US9222771B2 (en) * | 2011-10-17 | 2015-12-29 | Kla-Tencor Corp. | Acquisition of information for a construction site |
CN102523245A (en) * | 2011-11-10 | 2012-06-27 | 许春香 | Agricultural pest and growth condition forecasting, prevention and control Internet of things and method |
US10390497B2 (en) | 2013-03-07 | 2019-08-27 | Blue River Technology, Inc. | System and method for plant treatment |
US9678099B2 (en) * | 2014-04-24 | 2017-06-13 | Cubic Corporation | Athermalized optics for laser wind sensing |
CN104266982B (en) | 2014-09-04 | 2017-03-15 | 浙江托普仪器有限公司 | A kind of large area insect pest quantifies monitoring system |
CN104597443A (en) * | 2015-01-22 | 2015-05-06 | 成都锦江电子***工程有限公司 | Millimeter-wave radar networking based insect detection system |
US10842131B2 (en) * | 2015-06-24 | 2020-11-24 | Basf Agro Trademarks Gmbh | Method for applying an agrochemical to an agricultural area of interest |
-
2017
- 2017-04-18 WO PCT/EP2017/059127 patent/WO2017182440A1/en active Application Filing
- 2017-04-18 CN CN201780036380.6A patent/CN109416403A/en active Pending
- 2017-04-18 EP EP17718061.9A patent/EP3446152A1/en not_active Withdrawn
- 2017-04-18 US US16/094,427 patent/US11622555B2/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2008009536A1 (en) * | 2006-07-17 | 2008-01-24 | Siemens Aktiengesellschaft | Industrial plant having safety-relevant area |
WO2009064626A1 (en) * | 2007-11-01 | 2009-05-22 | Lockheed Martin Cohernt Technologies, Inc. | Sensing using polarization diversity and wavelength dependent backscatter |
Non-Patent Citations (6)
Title |
---|
GEBRU ALEM ET AL: "Investigation of atmospheric insect wing-beat frequencies and iridescence features using a multi-spectral kHz remote detection system", OPTOMECHATRONIC MICRO/NANO DEVICES AND COMPONENTS III : 8 - 10 OCTOBER 2007, LAUSANNE, SWITZERLAND; [PROCEEDINGS OF SPIE , ISSN 0277-786X], SPIE, BELLINGHAM, WASH, vol. 9221, 8 October 2014 (2014-10-08), pages 922106 - 922106, XP060039855, ISBN: 978-1-62841-730-2, DOI: 10.1117/12.2060827 * |
MIKKEL BRYDEGAARD ET AL: "Feasibility study: fluorescence lidar for remote bird classification", APPLIED OPTICS, OPTICAL SOCIETY OF AMERICA, WASHINGTON, DC; US, vol. 49, no. 24, 20 August 2010 (2010-08-20), pages 4531 - 4544, XP001556809, ISSN: 0003-6935, DOI: 10.1364/AO.49.004531 * |
MIKKEL BRYDEGAARD ET AL: "Realistic Instrumentation Platform for Active and Passive Optical Remote Sensing", SAGE JOURNALS APPLIED SPECTROSCOPY, vol. 70, no. 2, 15 January 2016 (2016-01-15), pages 372 - 385, XP055389465 * |
MIKKEL BRYDEGAARD ET AL: "SUPER RESOLUTION LASER RADAR WITH BLINKING ATMOSPHERIC PARTICLES ---- APPLICATION TO INTERACTING FLYING INSECTS (Invited Paper)", PROGRESS IN ELECTROMAGNETICS RESEARCH, vol. 147, 1 January 2014 (2014-01-01), pages 141 - 151, XP055368766, DOI: 10.2528/PIER14101001 * |
MIKKEL BRYDEGAARD: "Towards Quantitative Optical Cross Sections in Entomological Laser Radar - Potential of Temporal and Spherical Parameterizations for Identifying Atmospheric Fauna", PLOS ONE, 1 January 2015 (2015-01-01), United States, pages e0135231, XP055389056, Retrieved from the Internet <URL:http://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0135231&type=printable> [retrieved on 20170707], DOI: 10.1371/journal.pone.0135231 * |
PATRIK LUNDIN ET AL: "Remote nocturnal bird classification by spectroscopy in extended wavelength ranges", APPLIED OPTICS, OPTICAL SOCIETY OF AMERICA, WASHINGTON, DC; US, vol. 50, no. 20, 10 July 2011 (2011-07-10), pages 3396 - 3411, XP001564198, ISSN: 0003-6935, [retrieved on 20110701], DOI: 10.1364/AO.50.003396 * |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3553556A1 (en) * | 2018-04-09 | 2019-10-16 | Visteon Global Technologies, Inc. | Light modulating lidar apparatus |
US20200154679A1 (en) * | 2018-11-16 | 2020-05-21 | Verily Life Sciences Llc | Systems and methods for sensing insect sex or species |
EP3868202A1 (en) | 2020-02-19 | 2021-08-25 | FaunaPhotonics Agriculture & Enviromental A/S | Method and apparatus for determining an index of insect biodiversity |
WO2021165479A1 (en) | 2020-02-19 | 2021-08-26 | Faunaphotonics Agriculture & Enviromental A/S | Method and apparatus for determining an index of insect biodiversity, an insect sensor and a system of insect sensors |
EP4108082A1 (en) | 2021-06-21 | 2022-12-28 | FaunaPhotonics Agriculture & Enviromental A/S | Apparatus and method for measuring insect activity |
WO2022268756A1 (en) | 2021-06-21 | 2022-12-29 | Faunaphotonics Agriculture & Environmental A/S | Apperatus and method for measuring insect activity |
Also Published As
Publication number | Publication date |
---|---|
US20190124914A1 (en) | 2019-05-02 |
CN109416403A (en) | 2019-03-01 |
US11622555B2 (en) | 2023-04-11 |
EP3446152A1 (en) | 2019-02-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11622555B2 (en) | Optical remote sensing systems for aerial and aquatic fauna, and use thereof | |
EP3532865B1 (en) | An optical remote sensing system for detection of aerial and aquatic fauna | |
AU2018253554B2 (en) | Photonic Fence | |
US7417727B2 (en) | Method and apparatus for standoff detection of liveness | |
US20200182697A1 (en) | Active illumination 2d and/or 3d imaging device for agriculture | |
JP5881082B2 (en) | Plant health diagnosis method and plant health diagnosis device | |
EP3264886B1 (en) | System and method for observing piglet birth | |
Li et al. | Bark beetles as lidar targets and prospects of photonic surveillance | |
US20230106933A1 (en) | Method And Apparatus For Determining An Index Of Insect Biodiversity, An Insect Sensor And A System Of Insect Sensors | |
Jansson et al. | First polarimetric investigation of malaria mosquitoes as lidar targets | |
Andújar et al. | A LiDAR-based system to assess poplar biomass | |
Calcante et al. | Evaluation of “ground sensing” optical sensors for diagnosis of Plasmopara viticola on vines | |
Li et al. | Optical characterization of agricultural pest insects: a methodological study in the spectral and time domains | |
Symonds et al. | A real-time plant discrimination system utilising discrete reflectance spectroscopy | |
Rani et al. | Remote sensing as pest forecasting model in agriculture | |
Wang et al. | Real-time monitoring of insects based on laser remote sensing | |
Brydegaard et al. | High dynamic range in entomological scheimpflug lidars | |
Li et al. | Feasibility of insect identification based on spectral fringes produced by clear wings | |
Li et al. | Potential for identification of wild night-flying moths by remote infrared microscopy | |
Boateng et al. | Remote vegetation diagnostics in ghana with a hyperspectral fluorescence lidar | |
Gbogbo et al. | Predictive model for airborne insect abundance intercepted by a continuous wave Scheimpflug lidar in relation to meteorological parameters | |
EP4108082A1 (en) | Apparatus and method for measuring insect activity | |
Vastaranta et al. | Monitoring forests in space and time using close-range sensing | |
ES2966765T3 (en) | Procedure, system and computer programs for automatic counting of the number of insects in a trap | |
Tauc | Scanning wing-beat-modulation LIDAR for insect studies |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2017718061 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2017718061 Country of ref document: EP Effective date: 20181119 |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17718061 Country of ref document: EP Kind code of ref document: A1 |