WO2021160454A1 - Verfahren zur analyse von rückstreuungs-histogrammdaten bei einem optischen pulslaufzeit-verfahren und vorrichtung zur datenverarbeitung - Google Patents
Verfahren zur analyse von rückstreuungs-histogrammdaten bei einem optischen pulslaufzeit-verfahren und vorrichtung zur datenverarbeitung Download PDFInfo
- Publication number
- WO2021160454A1 WO2021160454A1 PCT/EP2021/052285 EP2021052285W WO2021160454A1 WO 2021160454 A1 WO2021160454 A1 WO 2021160454A1 EP 2021052285 W EP2021052285 W EP 2021052285W WO 2021160454 A1 WO2021160454 A1 WO 2021160454A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- backscatter
- histogram data
- ambient light
- amount
- time
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
- G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/4802—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4865—Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak
- G01S7/4866—Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak by fitting a model or function to the received signal
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/487—Extracting wanted echo signals, e.g. pulse detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/487—Extracting wanted echo signals, e.g. pulse detection
- G01S7/4873—Extracting wanted echo signals, e.g. pulse detection by deriving and controlling a threshold value
Definitions
- the present invention relates generally to a method for analyzing backscatter histogram data in an optical pulse transit time method and a device for data processing.
- optical pulse transit time methods z. B. optical transit time measurement
- time-of-flight principle in which the transit time of a light signal emitted and reflected by an object is measured by the distance to determine the object based on the runtime.
- the amount of ambient light can be relatively large under certain environmental conditions, e.g. when driving during the day, which reduces the signal-to-noise ratio (also known as SNR) can. In such situations, the detection range of the LIDAR application can also be limited.
- SNR signal-to-noise ratio
- the type of light signals detected can differ in LIDAR applications, e.g. B. depending on whether the transmitted light signal is reflected on a solid object (object backscattering) or is backscattered by airborne particles (diffuse backscattering), such as in fog or in Abga sen.
- object backscattering a solid object
- diffuse backscattering airborne particles
- conclusions about the ambient conditions can be drawn from the recorded backscatter data.
- Even if solutions for the analysis of backscatter data in an optical pulse transit time method are known from the prior art, it is an object of the present invention to provide a method for the analysis of backscatter histogram data in an optical pulse transit time method and to provide a device for data processing.
- the present invention provides a method for analyzing backscatter histogram data in an optical pulse time-of-flight method, comprising:
- the present invention provides an apparatus for data processing, comprising means for carrying out the method according to the first aspect.
- some exemplary embodiments relate to a method for analyzing backscatter histogram data in an optical pulse time-of-flight method, including:
- a more precise knowledge of the backscatter signal and an amount of ambient light can also contribute to an effective detection range of a LIDAR measurement to determine. This makes it easier to assess whether the detection of solid objects is reliable. This increases the probability of correctly identifying an object from the measurement data, which also increases the safety and reliability of autonomous vehicles.
- the method is used for the analysis in a LIDAR system or the like and is used, for example, in the motor vehicle environment, without the invention being restricted to these cases.
- LIDAR data typically contain signal contributions from diffuse backscattering, light reflection on objects, ambient light, interfering light signals from other light sources in the vicinity and the like. This data can be presented in a histogram, which is known in principle.
- the analysis of backscatter histogram data in some exemplary embodiments can mean that the signal contributions of the diffuse backscatter, the amount of ambient light and the effective detection area are determined from these data during an optical time of flight measurement (optical pulse time of flight method).
- the backscatter histogram data can therefore be suitable for such an analysis and determination, since they can in principle contain the signal contributions of the diffuse backscatter and the amount of ambient light.
- the optical transit time measurement is based on the so-called TCSPC (time correlated single photon counting) measurement principle, in particular in exemplary embodiments which are based on LIDAR.
- Light pulses are periodically emitted, which are typically a few nanoseconds long and mark a starting point in time for a measurement.
- the light reflected from objects or backscattered light is detected by a light-detecting receiving element (e.g. a single photon avelance diode (SPAD)), with light also being used in a short period of time before the light pulse is emitted can be detected.
- the measurement time is divided into a large number of short time intervals (e.g. 500 ps).
- a point in time can then be assigned to each time interval, which corresponds to a time interval from the start time (for example, in the case of time intervals of 500 ps, a first time interval can be used a point in time of 250 ps can be assigned and a point in time of 750 ps can be assigned to a second time interval, etc.).
- the light reaches the light-detecting receiving element at different times. Since it generates an electrical signal in the light-detecting receiving element.
- TDC time-to-digital converter
- the electrical signal can then be assigned to one of the time intervals.
- the time intervals together with the number of events assigned to each time interval accordingly form histogram data that can basically be represented by digital signals (or also analog signals).
- time-correlated histogram data are data that are generated based on the electrical signals of the light-detecting receiving elements within the (associated) measurement time and shortly before it. These therefore typically contain signal contributions from diffuse backscattering, light reflection on objects, ambient light, interfering light signals from other light sources in the vicinity and the like.
- the backscatter histogram data correspond to an accumulation of time-correlated histogram data from a plurality of light-detecting receiving elements.
- the accumulation of time-correlated histogram data can be advantageous for the determination of various parameters of the measurement (analysis of the backscatter histogram data), since the signal-to-noise ratio (also called "SNR", signal-to-noise ratio) of the diffuse backscatter contribution and the contribution of the ambient light compared to other signal contributions (e.g. Reflection on objects or interfering light sources) can be increased.
- SNR signal-to-noise ratio
- Reflection on objects or interfering light sources can be increased.
- the analysis of the backscatter histogram data can be carried out better in some exemplary embodiments.
- this follows from the fact that an accumulation of several time-correlated histogram data (backscatter histogram data) can smear the reflection of objects (signal contributions from objects) at different distances and / or in different regions of the field of view of the LIDAR measurement.
- the objects are typically only present in a narrow area of the field of view, the field of view typically describing an area of space that is being detected.
- the contributions of diffuse backscatter and ambient light are typically similar over the entire field of view of the LIDAR system.
- the ambient light is also usually constant during the measurement time and thus typically makes a constant contribution in all time intervals.
- the signal contributions from reflections on objects are often sharp peaks, which means that the reflected light is only detected in one or a few time intervals because the light pulse can be received with a weakened amplitude but almost the same pulse duration.
- typical pulse durations of z. B. 10 ns can e.g. B. a 250 ps Zeitauf solution are required for an accurate location.
- diffuse backscattering e.g. Fog or particles in the air can cause continuous backscattering during the light propagation with low intensity.
- the light pulse can be very strongly expanded or smeared over time.
- a 10 ns light pulse with a geometric extent of 1.5 m diffuse backscattering over a 1.5 m depth range can be generated at any time. Therefore, in some exemplary embodiments, a significantly reduced time resolution is sufficient.
- the backscatter histogram data are generated by one or more histogram accumulation units and made available for analysis.
- the histogram accumulation unit has several signal inputs.
- the histogram accumulation unit receives time-correlated histogram data at the or each signal input. It doesn't always have to be on everyone Signal input the histogram data are received and in some exemplary embodiments there are also further signal inputs at which, for example, no histogram data or only after a corresponding configuration are received.
- Backscatter histogram data are generated based on the time-correlated histogram data received at the signal inputs.
- the maximum number of histogram accumulation units is given by the number of light-detecting receiving elements in a system for optical transit time measurement (e.g. LIDAR system).
- the histogram accumulation unit can in principle be or have an electronic circuit or an electronic circuit that receives (the) digital signals or data, such as the time-correlated histogram data, via the signal inputs and the generation of backscattering described here. Executes histogram data.
- the electronic circuit may include electronic components, digital storage elements, and the like to perform the functions described herein.
- the electronic circuit can be implemented by an FPGA (Field Programmable Gate Array), DSP (digital signal processor) or the like.
- the histogram accumulation unit is implemented by a memory and a microprocessor.
- the histogram accumulation unit is implemented by software, the signal inputs in such exemplary embodiments corresponding to the parameters / attributes of a software function / method.
- the generation of the backscatter histogram data then corresponds to the execution of a sequence of commands for the execution of certain arithmetic operations on a computer, so that backscatter histogram data are available after all commands have been processed.
- the histogram accumulation unit is also implemented by a mixture of hardware- and software-based components, to which the functionalities described herein are appropriately distributed.
- the histogram accumulation unit generates the backscatter histogram data by adding the received time-correlated histogram data.
- the number of events that were detected in a time interval can be from all received time-correlated histogram data are added, so that the backscatter histogram data are generated which in each time interval just contain the sum of all events in this time interval.
- the time-correlated histogram data are preferably accumulated or added as integer numbers in order to make a weak, diffuse backscattering measurable in some exemplary embodiments. This is advantageous because the SNR of the diffuse backscatter contribution can be increased compared to other contributions.
- the histogram accumulation unit calculates an arithmetic mean from the received time-correlated histogram data in order to generate the backscatter histogram data.
- the time-correlated histogram data received are added and divided by the number of signal inputs. This can be advantageous in some exemplary embodiments which have a fixed-point number or floating-point number implementation (in contrast to exemplary embodiments, which accumulate integers).
- the histogram accumulation unit accumulates the received time-correlated histogram data from a plurality of time intervals in a time interval in order to generate the backscatter histogram data.
- the histogram accumulation unit is further set up not to take into account received time-correlated histogram data from time intervals that are above a specific time threshold for the generation of the backscatter histogram data.
- the histogram accumulation unit is further set up to weight the received time-correlated histogram data for generating the backscatter histogram data.
- the histogram accumulation unit is further set up to output the backscatter histogram data for determining the backscatter.
- the backscatter histogram data can then, for example, be output to a processor, FPGA or the like to determine the backscatter.
- a receiving system that is used for optical transit time measurement such as, for example, a LIDAR system, can in some exemplary embodiments have a receiving matrix with a plurality of light-detecting receiving elements, each of the light-detecting receiving elements being set up to detect light and, in response to it, an electrical light Generate signal.
- each of the light-detecting receiving elements can be activated and deactivated.
- the light-detecting receiving elements are arranged in columns and rows in the receiving matrix (as is fundamentally known), with some exemplary embodiments being provided in each row with the same number of light-detecting receiving elements without loss of generality.
- the device comprises several evaluation units, one evaluation unit being connected to the light-detecting receiving elements in a column or one evaluating unit being connected to the light-detecting receiving elements in a row.
- each of the evaluation units is set up to generate the time-correlated histogram data based on the electrical signals of the light-detecting receiving elements.
- only those light-detecting receiving elements that are activated are taken into account for generating the time-correlated histogram data.
- each signal input of a histogram accumulation unit is connected to one of the evaluation units, so that the time-correlated histogram data are transmitted from the evaluation unit to the corresponding histogram accumulation unit.
- backscatter histogram data are initially received. These backscatter histogram data are from the histogram or histogram Accumulation units have been generated.
- the received backscatter histogram data is analyzed. Analyzing can be a calculation or a sequence of calculations in order to determine various parameters (backscatter signal, amount of ambient light, effective detection range, etc.) of the optical transit time measurement.
- the calculation takes the backscatter histogram data as input values for mathematical operations such as arithmetic averaging or applying a predetermined function or the like.
- the analysis of the received backscatter histogram data can in principle be carried out by a processor, an FPGA, DSP or the like. In such exemplary embodiments, the analysis is implemented by software.
- the analysis of the backscatter histogram data then corresponds to an execution of a sequence of commands for the execution of specific arithmetic operations on a computer, so that the backscatter histogram data are analyzed after all commands have been processed.
- a specific electronic circuit with corresponding electronic components can be used for analyzing the backscatter histogram data.
- the analysis of the backscatter histogram data is implemented by a mixture of hardware- and software-based components, over which the method described herein is appropriately distributed.
- the above-mentioned exemplary embodiments can be exemplary embodiments of a device for data processing which can additionally contain storage elements for data storage.
- the method for analyzing backscatter histogram data which correspond to accumulated time-correlated histogram data, is used in some exemplary embodiments for the determination of a backscatter signal in an optical transit time measurement.
- the diffuse backscattering is higher at short distances (e.g. 5 m) than with long distances (e.g. 200 m) and can drop continuously.
- the diffuse backscattering in an optical transit time measurement can therefore have a typical signal shape in some exemplary embodiments, which can have a maximum of the backscattered light at short distances and quickly drops for longer distances.
- the backscatter signal then correlates in the backscatter histogram data with the typical signal shape. This is advantageous because the backscatter signal can be identified on the basis of the signal shape over short distances. However, in such exemplary embodiments, when an object is present at short distances, the backscatter signal often cannot be determined either.
- a similarity measure such as e.g. B. a correlation is calculated between the received backscatter histogram data and a predetermined reference backscatter signal in order to determine a backscatter signal.
- the correlation can be a measure of the similarity between two or more temporal or spatial signal curves or for a statistical relationship between the signal curves.
- the correlation is calculated using a correlation integral, which is known in principle.
- the predefined reference backscatter signal can correspond to a typical signal shape of the backscatter, wherein the typical signal shape of the backscatter can differ in the various exemplary embodiments.
- the predefined reference backscatter signal can be present as histogram data in a memory which is accessible for the analysis of the backscatter histogram data, for example by a processor.
- the predefined reference backscatter signal can be calculated dynamically (for example at the required time during the analysis) from a predefined function.
- the typical signal shape of the backscatter can be determined, for example, by searching for a characteristic peak or a sequence of peaks at short distances, the position, signal shape and intensity being evaluated.
- a characteristic peak or a sequence of peaks at short distances the position, signal shape and intensity being evaluated.
- the backscattering has a system-dependent signal form and the position of the peak.
- it can be checked whether the intensity of the peak corresponds to an object or not in order to establish the typical signal shape.
- Typical reference backscatter signals are illustrated, for example, in FIGS.
- single-beam and multi-beam LIDAR systems which are described in more detail below.
- single-beam and multi-beam LIDAR systems single-beam systems only emit one light pulse (beam) at the same time and multi-beam systems can emit several light pulses from different positions at the same time, such as the one in DE 10 2017 222 971 A1 described Ll-DAR system).
- the reference backscatter signal can be determined experimentally by simulating various environmental conditions and measuring the typical signal shape, position and intensity of the backscatter.
- the reference backscatter signal can be determined in that a correlation integral (cross-correlation) is calculated between an expected backscatter signal and the received backscatter histogram data.
- the level of correlation can be used in such execution examples to assess whether the expected backscatter signal can be used as a reference backscatter signal.
- Several expected backscatter signals can be tested and the level of correlation can be compared to determine a reference backscatter signal for the specific system.
- the correlation between the received backscatter histogram data and the specified reference backscatter signal is calculated by a correlation integral
- Light output corresponds to (also abbreviated to AB in the following). Therefore, in such embodiments, the backscatter can be determined from the backscatter histogram data.
- the method for analyzing backscatter ungs histogram data is used for determining an amount of ambient light from the received backscatter histogram data.
- the amount of ambient light (also abbreviated as AL in the following) basically corresponds to the signal contribution, for example in a LIDAR system, which is present and detected, for example, by sunlight or street lamps, regardless of the emitted light pulse. Furthermore, the amount of ambient light can also contain components of electronic noise from the receiver, which is temperature-dependent. However, in such exemplary embodiments, the effect of contributions to the amount of ambient light by ambient light and by noise is the same and is therefore not differentiated.
- the amount of ambient light can be determined from the received backscatter histogram data from several time intervals that are shortly before the emission of the light pulses (start time). In other exemplary embodiments, the amount of ambient light can be determined from the received backscatter histogram data from several time intervals which correspond to a long distance (as long as no objects are present in long distances). In further exemplary embodiments, the amount of ambient light can be determined from a combination of the above methods. In some exemplary embodiments, the method for analyzing the received backscatter histogram data is used to determine an effective detection range of the optical transit time measurement based on the backscatter signal and the amount of ambient light.
- An effective detection area (also abbreviated to EDR in the following) of an optical time of flight measurement can correspond to a distance at which signals that arise from reflection on solid objects can still be clearly detected and assigned.
- the effective detection area is basically referenced to an object with a given reflectivity with a given amount of ambient light and given constant probability of light detection.
- the effective detection range can correspond to an absolute value (for example 100 m).
- the effective detection range can correspond to a relative value, wherein in such exemplary embodiments the effective detection range is related to a nominal detection range which was determined for the above reference values.
- the effective detection range can be reduced by the fact that the backscatter is high, since in such exemplary embodiments the light power of the emitted light pulse is attenuated by the backscatter as the distance increases. Consequently, the light output that is available for reflection on the solid objects is lower than in embodiments with less backscattering, so that the reflected light output is lower and this is further reduced on the way to the receiver.
- the effective detection area can be reduced by reducing the SNR, since the amount of ambient light basically makes a contribution to the level of noise.
- the effective detection area is increased when the amount of ambient light is low, since this increases the SNR.
- the effective detection range of the optical transit time measurement can therefore be determined from the received backscatter histogram data based on the backscatter signal and the amount of ambient light.
- a transformation function is applied to the backscatter signal in order to determine a signal attenuation factor.
- a high backscatter can reduce the effective detection range by attenuating the light power of the emitted light pulse with increasing distance. Therefore, the backscatter signal can be used to determine the amount of such attenuation.
- a transformation function is applied to the backscatter signal, it being possible for the transformation function in some exemplary embodiments to be a predetermined (mathematical) function that results from the backscatter signal Signal damping factor calculated.
- the transformation function can be a sequence of calculations.
- the transformation function can be determined experimentally or gained from experience. In some exemplary embodiments, the experimental determination can take place beforehand in the development and key figures and / or characteristic curves etc. corresponding to the transformation function can be stored in software, for example.
- the signal attenuation factor can then be a distance-dependent percentage reduction in the light output caused by the backscatter.
- the transformation function was therefore determined experimentally in some exemplary embodiments.
- the signal attenuation can, for example, have been measured under different ambient conditions, whereby a transformation function can be found that determines the signal attenuation factor from the backscatter signal (which, as explained above, can also be determined experimentally), which corresponds well to the measured values of the signal attenuation.
- an arithmetic mean is calculated from the received backscatter histogram data from a plurality of time intervals that lie before a start time in order to determine the amount of ambient light.
- the start time is the time at which the light pulse for determining the distance from solid objects is emitted.
- the ambient light can be detected shortly before the light pulse is emitted (e.g. 20 ns), so it is advantageous for determining the amount of ambient light in some exemplary embodiments to take into account those time intervals of the received backscatter histogram data that are before the start time.
- the calculation of an arithmetic mean from several time intervals is advantageous in order to compensate for statistical fluctuations in the ambient light and thus to obtain a more precise value for the amount of ambient light.
- the amount of ambient light determined in such exemplary embodiments can be falsified by the reflection on objects that are very distant.
- an arithmetic mean is calculated from the received backscatter histogram data from several time intervals which lie above a certain time threshold in order to determine the amount of ambient light.
- the diffuse backscattering in an optical time of flight measurement is typically no longer detectable over long distances because the amount of light is too small.
- a constant amount of ambient light can be detected because the light energy or light power has been absorbed or reflected.
- the determination of the amount of ambient light in some exemplary embodiments is advantageous for the determination of the amount of ambient light in some exemplary embodiments to take into account those time intervals of the received backscatter histogram data that are above a certain time threshold (e.g. from a time threshold corresponding to a distance of 20 m). Furthermore, the calculation of an arithmetic mean from several time intervals is advantageous in order to compensate for statistical fluctuations in the ambient light and thus to obtain a more precise value for the amount of ambient light. However, the amount of ambient light determined in such exemplary embodiments can be falsified by the reflection on objects that are far away.
- an arithmetic mean is calculated from the received backscatter histogram data from several time intervals that lie before a start time, and from the received backscatter histogram data from several time intervals that are above a certain time threshold, an arithmetic mean of the amount of ambient light to determine.
- the two methods described above are combined in order to determine the amount of ambient light. This is advantageous because it reduces the possible influence of distant objects on the determination of the amount of ambient light. Furthermore, the calculation of an arithmetic mean is advantageous, since this allows the statistical fluctuations to be reduced even further.
- the received backscatter histo- gram data that are above a certain time threshold a local minimum is determined which meets a certain or predetermined criterion in order to determine the amount of ambient light.
- a constant amount of ambient light can be determined for greater distances (corresponding to the specific time threshold value) if no reflections on objects in this time range have contributed to the received backscatter histogram data.
- the amount of ambient light may correspond to a local minimum in the received backscatter histogram data that is above a certain time threshold.
- signal contributions due to reflection on objects have a certain signal shape that can extend over several time intervals. If several objects are present for larger distances, in some exemplary embodiments the two signal forms can overlap in such a way that a local minimum arises which does not correspond to the amount of ambient light. Therefore, in some exemplary embodiments, only those local minima are taken into account for determining the amount of ambient light that meet a certain or predetermined criterion, wel ches the various possibilities for the presence of a local minimum in the received backscatter histogram data that is above a certain time threshold lie. The local minima can be classified based on this criterion.
- the amount of ambient light can be determined by first determining and classifying a first local minimum (from the time threshold value). If the local minimum does not meet the requirements for determining the amount of ambient light according to the classification, a further local minimum can be searched for in the received backscatter histogram data, this local minimum in such exemplary embodiments being behind and behind the time threshold the first local minimum. The search can accordingly be continued until the end of the measurement period. If the local minimum meets the requirements for determining the amount of ambient light according to the classification, the amount of ambient light is determined as the local minimum.
- the determination of the amount of ambient light has the following steps: Calculating an arithmetic mean from the received Backscatter histogram data of a plurality of time intervals prior to a start time to obtain a first amount of ambient light;
- the method described can thus correspond to a combination of two of the methods outlined above. This can be advantageous since it reduces statistical fluctuations and influences from objects that are far away, so that the amount of ambient light can be determined more precisely.
- the effective detection area of the optimal see transit time measurement determined using a predetermined function.
- the effective detection area can be determined based on the backscatter signal (AB) and the amount of ambient light (AL).
- the given function can be a given (mathematical) function in some exemplary embodiments, which is calculated from the backscatter signal and the amount of ambient light, the effective detection area.
- the predetermined function can be a sequence of calculations.
- the effective detection range of the optical transit time measurement is determined from a characteristic diagram.
- a characteristic diagram can be a table-like, simple and, with regard to the required computing capacity, not very demanding type of mapping of a model that maps the relationship between input and output variables of a system. Almost any mathematical relationship or formula can be represented with characteristic diagrams, whereby the number of input variables is limited.
- the characteristic diagram can therefore be a mapping of the function f (AL, AB), which has correspondingly stored the values of the effective detection range for a large number of values of AL and AB. This is advantageous since the determination of the effective detection area does not have to be calculated in such exemplary embodiments and thus saves computing capacity.
- the effective detection range of the optical transit time measurement is determined in some exemplary embodiments from a comparison with predetermined reference values.
- Some exemplary embodiments relate to a device for data processing, comprising means for carrying out the steps of the method as set out herein.
- the device can be installed in a motor vehicle or implemented in a component of the motor vehicle, e.g. B. in an on-board computer, a controller or the like.
- the means can be one or more (mic- ro) processors, storage means, and other electronic components typically required to implement the functions described herein.
- Fig. 1 illustrates a first embodiment of a reference backscatter signal.
- Fig. 2 illustrates a second embodiment of a reference backscatter signal
- Fig. 3 illustrates a third embodiment of a reference backscatter signal.
- Fig. 4 illustrates a diagram of an embodiment of a receiving system for an optical cal distance measurement
- FIG. 5 illustrates a flow chart of a first embodiment of a method for analyzing backscatter histogram data in an optical time of flight measurement
- FIG. 6 illustrates a flow chart of a second embodiment of a method for analyzing backscatter histogram data in an optical time of flight measurement
- FIG. 7 illustrates a flow diagram of a third embodiment of a method for analyzing backscatter histogram data in an optical time of flight measurement
- FIG. 8 illustrates a flow chart of a fourth exemplary embodiment of a method for analyzing backscatter histogram data in an optical time of flight measurement.
- Fig. 1 illustrates the first embodiment of a reference backscatter signal.
- the reference backscatter signal illustrated in Fig. 1 corresponds to a typical signal form as it occurs in a coaxial LIDAR system, i.e. in an LLAR system in which there is no parallax between transmitter and receiver.
- the reference backscatter signal (in other words the intensity of the backscattered light) falls monotonically over time.
- Fig. 2 illustrates the second embodiment of a reference backscatter signal.
- the reference backscatter signal illustrated in Fig. 2 corresponds to a typical waveform as it occurs in a bi-axial single-beam LIDAR system.
- biaxial systems i.e. transmitting and receiving systems are at a defined distance, e.g. 10 cm and have a defined beam divergence
- an overlap only occurs from a minimum distance (start of the signal increase of the reference backscatter signal).
- the reference backscatter signal then decreases in accordance with the curve in FIG. 1.
- the reference backscatter signal has a low intensity at very short distances and rises to a maximum, which then decreases monotonically over time.
- Fig. 3 illustrates the third embodiment of a reference backscatter signal.
- the reference backscatter signal illustrated in Fig. 3 corresponds to a typical signal form as it typically occurs in a bi-axial multi-beam LIDAR system (e.g. according to DE 10 2017 222 971 A1).
- the reference backscatter signal is similar to a bi-axial single-beam LIDAR system, but has several maxima at distances at which different beams cross the field of view of the light-detecting receiving elements. The intensity falls monotonously over time for greater distances.
- FIG. 4 illustrates a diagram of an exemplary embodiment of a receiving system 1 for an optical distance measurement.
- the receiving system 1 has a receiving matrix 2 on which several light-detecting receiving elements (ENxM, in this exemplary embodiment E0.0 to £ 127.255) are arranged in rows (ZO to Z127) and columns (SO to S255).
- ExM light-detecting receiving elements
- N 128 lines (ZO to Z127)
- the light-detecting receiving elements (E0,0 to E127,255) are SPADs in this exemplary embodiment.
- the receiving system 1 also has several evaluation units (A0 to A127), one evaluation unit (AO to A127) with the light-detecting receiving elements (E0,0 to E127,255) of a line (ZO to Z127) via a multiplexer (not shown) ) connected is.
- each line (ZO to Z127) only the two light-detecting receiving elements (E0,0 and E0,1 to E127,0 and E127, l) in the columns SO and S1 are activated at a given point in time (illustrated by the second circle within the light-detecting receiving elements (E0,0 and E0,1 to E127,0 and E127, l)).
- the activated light-detecting receiving elements (E0,0 and E0,1 to E127,0 and E127, l) generate electrical signals when light is detected, from which a time-to-digital converter (not shown) is time-correlated in each of the evaluation units (AO to A127) Histogram data are generated.
- the time-correlated histogram data of the two activated light-detecting receiving elements (E0,0 and E0,1 to E127,0 and E127, l) are added in the evaluation units (AO to A127) in order to generate and output time-correlated histogram data .
- any number of M 256 light-detecting receiving elements (E0,0 to E127,255) can be activated in each line, for example E0,0 to EO, IO, E1,0 to E1, 10, E2,0 to E2,10, ..., E127,0 to E127,10.
- the receiving system 1 also has several histogram Akkumulationseinhei th (HAO to HAX).
- the Time-correlated histogram data outputted to value units (AO to A127) are transmitted to the histogram accumulation units (HAO to HAX) so that they are received at the signal inputs.
- the histogram accumulation units (HAO to HAX) generate backscatter histogram data based on the received time-correlated histogram data.
- the time-correlated histogram data received at each signal input are added to generate the backscatter histogram data.
- the receiving system 1 also has a device 3 for data processing, which has a processor and memory elements (not shown).
- the histogram accumulation units (HAO to HAX) output the generated backscatter histogram data which are received by the device 3 for data processing.
- the data processing device 3 analyzes the received backscatter histogram data.
- the device 3 for data processing calculates a correlation between the received backscatter histogram data and the reference backscatter signal from FIG. 3 in order to determine a backscatter signal, which is determined, for example, as a backscatter indicator or backscatter signal strength.
- Fig. 5 illustrates a flowchart of the first embodiment of a method 20 for analyzing backscatter histogram data in an optical transit time measurement.
- backscatter histogram data is received as set forth herein.
- the received backscatter histogram data is analyzed as set out herein.
- a measure of similarity between the received backscatter histogram data and a predetermined reference backscatter signal is calculated to determine a backscatter signal as set forth herein.
- a transform function is applied to the backscatter signal to obtain a signal attenuation factor as set forth herein.
- the transformation function from step 24 was (previously) determined experimentally, as set out herein.
- FIG. 6 illustrates a flow chart of the second exemplary embodiment of a method 30 for analyzing backscatter histogram data in an optical transit time measurement.
- backscatter histogram data is received as set forth herein.
- the received backscatter histogram data is analyzed as set out herein.
- an amount of ambient light is determined from the received backscatter histogram data, as set forth herein.
- Steps 34 to 36 are options that are carried out individually.
- an arithmetic mean is calculated from the received backscatter histogram data from a plurality of time intervals that precede a start time to determine the amount of ambient light, as set forth herein.
- an arithmetic mean is calculated from the received backscatter histogram data of multiple time intervals that are above a certain time threshold to determine the amount of ambient light, as set forth herein.
- an arithmetic mean is calculated from the received backscatter histogram data from several time intervals that are in time before a start time, and from the received backscatter histogram data from several time intervals that are above a certain time threshold in order to determine the amount of ambient light as set forth herein.
- Fig. 7 illustrates a flowchart of the third embodiment of a method 40 for analyzing backscatter histogram data in an optical transit time measurement.
- backscatter histogram data is received as set forth herein.
- the received backscatter histogram data is analyzed as set out herein.
- Steps 44 and 45 are options that are each carried out individually.
- a local minimum that meets a specific criterion is determined from the received backscatter histogram data that is above a specific time threshold in order to determine the amount of ambient light, as set forth herein.
- an arithmetic mean is calculated from the received backscattering histogram data from several time intervals that lie before a start time in order to obtain a first amount of ambient light, and a local minimum is determined, which meets a certain criterion, from the received back scatter histogram data that is above a certain time threshold to determine a second amount of ambient light, and an amount of ambient light is determined from a comparison between the first amount of ambient light and the second amount of ambient light, the amount of ambient light being determined as the smaller of the two amounts of ambient light, such as detailed herein.
- FIG. 8 illustrates a flowchart of the fourth exemplary embodiment of a method 50 for analyzing backscatter histogram data in an optical transit time measurement.
- backscatter histogram data is received as set forth herein.
- the received backscatter histogram data is analyzed as set out herein.
- a similarity measure between the received backscatter histo- gram data and a predetermined reference backscatter signal are calculated to determine a backscatter signal as set forth herein.
- an amount of ambient light is determined from the received backscatter histogram data, as set forth herein.
- an effective detection range of the optical transit time measurement is determined based on the backscatter signal, which is determined, for example, as a backscatter indicator or backscatter signal strength, and the amount of ambient light, as set out herein.
- Steps 56 to 58 are options that are each carried out individually.
- the effective detection range of the optical transit time measurement is determined with the aid of a predetermined function, as set out herein.
- the effective detection range of the optical transit time measurement is determined from a characteristic diagram, as set out herein.
- the effective detection range of the optical transit time measurement is determined from a comparison with predetermined reference values, as set out herein.
- 33, 43, 54 determine an amount of ambient light from the received backscatter histogram data
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Electromagnetism (AREA)
- Optical Radar Systems And Details Thereof (AREA)
- Radar Systems Or Details Thereof (AREA)
- Geophysics And Detection Of Objects (AREA)
Abstract
Description
Claims
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA3167506A CA3167506A1 (en) | 2020-02-11 | 2021-02-01 | Method for analyzing backscatter histogram data in an optical pulse runtime method and device for data processing |
US17/797,085 US20230048750A1 (en) | 2020-02-11 | 2021-02-01 | Method for analyzing backscatter histogram data in an optical pulse runtime method and device for data processing |
KR1020227027282A KR20220119500A (ko) | 2020-02-11 | 2021-02-01 | 광학 펄스 런타임 방법에서 후방 산란 히스토그램 데이터를 분석하는 방법 및 데이터 처리 장치 |
JP2022548387A JP7471018B2 (ja) | 2020-02-11 | 2021-02-01 | 光パルスランタイム法において後方散乱ヒストグラムデータを解析する方法及びデータ処理のための装置 |
CN202180013839.7A CN115104038A (zh) | 2020-02-11 | 2021-02-01 | 分析光学脉冲运行时间方法中的反向散射直方图数据的方法和用于数据处理的设备 |
IL295469A IL295469A (en) | 2020-02-11 | 2021-02-01 | A method for analyzing backscatter histogram data using the optical pulse delay method and a data processing device |
EP21702999.0A EP4103962A1 (de) | 2020-02-11 | 2021-02-01 | Verfahren zur analyse von rückstreuungs-histogrammdaten bei einem optischen pulslaufzeit-verfahren und vorrichtung zur datenverarbeitung |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102020201637.2A DE102020201637A1 (de) | 2020-02-11 | 2020-02-11 | Verfahren zur Analyse von Rückstreuungs-Histogrammdaten bei einem optischen Pulslaufzeit-Verfahren und Vorrichtung zur Datenverarbeitung |
DE102020201637.2 | 2020-02-11 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021160454A1 true WO2021160454A1 (de) | 2021-08-19 |
Family
ID=74505266
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2021/052285 WO2021160454A1 (de) | 2020-02-11 | 2021-02-01 | Verfahren zur analyse von rückstreuungs-histogrammdaten bei einem optischen pulslaufzeit-verfahren und vorrichtung zur datenverarbeitung |
Country Status (9)
Country | Link |
---|---|
US (1) | US20230048750A1 (de) |
EP (1) | EP4103962A1 (de) |
JP (1) | JP7471018B2 (de) |
KR (1) | KR20220119500A (de) |
CN (1) | CN115104038A (de) |
CA (1) | CA3167506A1 (de) |
DE (1) | DE102020201637A1 (de) |
IL (1) | IL295469A (de) |
WO (1) | WO2021160454A1 (de) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2189804A1 (de) * | 2008-11-21 | 2010-05-26 | Sick Ag | Optoelektronischer Sensor und Verfahren zur Messung von Entfernungen nach dem Lichtlaufzeitprinzip |
US20160033644A1 (en) * | 2014-07-31 | 2016-02-04 | Stmicroelectronics (Research & Development) Ltd. | Time of flight determination |
WO2017081294A1 (de) | 2015-11-11 | 2017-05-18 | Ibeo Automotive Systems GmbH | Verfahren und vorrichtung zur optischen distanzmessung |
DE102017222971A1 (de) | 2017-12-15 | 2019-07-11 | Ibeo Automotive Systems GmbH | LIDAR Empfangseinheit |
EP3435117B1 (de) * | 2017-07-28 | 2019-09-25 | Sick AG | Sensor und verfahren zur erfassung und abstandsbestimmung von objekten |
DE102018212542A1 (de) * | 2018-07-27 | 2020-01-30 | Audi Ag | Verfahren zur Steuerung einer einem Laserscanner zugeordneten Heizeinrichtung |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2018091760A (ja) | 2016-12-05 | 2018-06-14 | 株式会社豊田中央研究所 | 光学測定装置、光学測定方法、及び光学測定プログラム |
JP6665873B2 (ja) | 2017-03-29 | 2020-03-13 | 株式会社デンソー | 光検出器 |
-
2020
- 2020-02-11 DE DE102020201637.2A patent/DE102020201637A1/de active Pending
-
2021
- 2021-02-01 IL IL295469A patent/IL295469A/en unknown
- 2021-02-01 EP EP21702999.0A patent/EP4103962A1/de active Pending
- 2021-02-01 JP JP2022548387A patent/JP7471018B2/ja active Active
- 2021-02-01 CA CA3167506A patent/CA3167506A1/en active Pending
- 2021-02-01 KR KR1020227027282A patent/KR20220119500A/ko unknown
- 2021-02-01 US US17/797,085 patent/US20230048750A1/en active Pending
- 2021-02-01 WO PCT/EP2021/052285 patent/WO2021160454A1/de unknown
- 2021-02-01 CN CN202180013839.7A patent/CN115104038A/zh active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2189804A1 (de) * | 2008-11-21 | 2010-05-26 | Sick Ag | Optoelektronischer Sensor und Verfahren zur Messung von Entfernungen nach dem Lichtlaufzeitprinzip |
US20160033644A1 (en) * | 2014-07-31 | 2016-02-04 | Stmicroelectronics (Research & Development) Ltd. | Time of flight determination |
WO2017081294A1 (de) | 2015-11-11 | 2017-05-18 | Ibeo Automotive Systems GmbH | Verfahren und vorrichtung zur optischen distanzmessung |
EP3435117B1 (de) * | 2017-07-28 | 2019-09-25 | Sick AG | Sensor und verfahren zur erfassung und abstandsbestimmung von objekten |
DE102017222971A1 (de) | 2017-12-15 | 2019-07-11 | Ibeo Automotive Systems GmbH | LIDAR Empfangseinheit |
DE102018212542A1 (de) * | 2018-07-27 | 2020-01-30 | Audi Ag | Verfahren zur Steuerung einer einem Laserscanner zugeordneten Heizeinrichtung |
Also Published As
Publication number | Publication date |
---|---|
CA3167506A1 (en) | 2021-08-19 |
JP7471018B2 (ja) | 2024-04-19 |
IL295469A (en) | 2022-10-01 |
JP2023513560A (ja) | 2023-03-31 |
KR20220119500A (ko) | 2022-08-29 |
DE102020201637A1 (de) | 2021-08-12 |
US20230048750A1 (en) | 2023-02-16 |
CN115104038A (zh) | 2022-09-23 |
EP4103962A1 (de) | 2022-12-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3418767B1 (de) | Optoelektronischer sensor und verfahren zur messung der entfernung zu einem objekt | |
EP2073038B1 (de) | Verfahren zur Klassifizierung von Abstandsdaten und korrespondierende Abstandsmessvorrichtung | |
EP3418766B1 (de) | Optoelektronischer sensor und verfahren zur messung der entfernung zu einem objekt | |
DE102014108713B3 (de) | Rauch- und Brandmelder | |
EP2942645A1 (de) | Entfernungsmessender Sensor und Verfahren zur Erfassung und Abstandsbestimmung von Objekten | |
DE19531632A1 (de) | Entfernungsmeßgerät für Kraftfahrzeuge | |
WO2019145078A1 (de) | Abstandsdetektionssystem, verfahren für ein abstandsdetektionssystem und fahrzeug | |
DE102018200688B4 (de) | Verfahren und Vorrichtung zum Betreiben eines akustischen Sensors | |
EP2159603B1 (de) | Objektfeststellungsverfahren und Objektfeststellungssensor | |
DE102017208704A1 (de) | Vorrichtung und Verfahren zur Entfernungsmessung | |
EP1085346A1 (de) | Verfahren zur Messung der Entfernung von Objekten, atmosphärischen Partikeln und dergleichen mittels Lidar- oder Laserradar-Signalen | |
WO2021160454A1 (de) | Verfahren zur analyse von rückstreuungs-histogrammdaten bei einem optischen pulslaufzeit-verfahren und vorrichtung zur datenverarbeitung | |
DE102017220925A1 (de) | Verfahren zum Betreiben eines LIDAR-Sensors und LIDAR-Sensor | |
EP3715908A1 (de) | Verfahren und vorrichtung zur optischen distanzmessung | |
DE102014110203B3 (de) | Entfernungsmessender Sensor zur Erfassung und Abstandsbestimmung von Objekten | |
DE10001015C2 (de) | Verfahren zur Messung der Entfernung von Objekten, atmosphärischen Partikeln und dergleichen mittels Lidar- oder Laserradar-Signalen | |
DE19704220A1 (de) | Verfahren und Vorrichtung zum Bestimmen eines Abstandes zwischen Fahrzeug und Hindernis | |
DE102017220774A1 (de) | Vorrichtung und Verfahren zum Bestimmen einer Distanz zu einem Objekt | |
EP3951425A1 (de) | Verfahren sowie messvorrichtung zur bestimmung einer distanz | |
EP3671276B1 (de) | Optoelektronischer sensor und verfahren zur erfassung eines objekts | |
DE102018220600B4 (de) | Verfahren und Vorrichtung zum Detektieren von Partikeln | |
DE102019201739A1 (de) | Vorrichtung und Verfahren für Time-Gating in laufzeitbasierter Distanzmessung | |
DE102017106134A1 (de) | Optischer Sensor und Verfahren zum Nachweis von Objekten in einem Überwachungsbereich | |
DE202014103348U1 (de) | Entfernungsmessender Sensor zur Erfassung und Abstandsbestimmung von Objekten | |
DE102022131848A1 (de) | Verfahren zum betrieb eines lidar-systems und lidar-system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21702999 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 20227027282 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2022548387 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 3167506 Country of ref document: CA |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2021702999 Country of ref document: EP Effective date: 20220912 |