US20230375674A1 - Multi-source lidar - Google Patents
Multi-source lidar Download PDFInfo
- Publication number
- US20230375674A1 US20230375674A1 US18/200,451 US202318200451A US2023375674A1 US 20230375674 A1 US20230375674 A1 US 20230375674A1 US 202318200451 A US202318200451 A US 202318200451A US 2023375674 A1 US2023375674 A1 US 2023375674A1
- Authority
- US
- United States
- Prior art keywords
- illumination source
- mirror
- light
- view
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000005286 illumination Methods 0.000 claims abstract description 323
- 238000000034 method Methods 0.000 claims description 34
- 230000008569 process Effects 0.000 description 15
- 230000003287 optical effect Effects 0.000 description 11
- 150000001875 compounds Chemical class 0.000 description 5
- 238000001514 detection method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 239000003990 capacitor Substances 0.000 description 3
- 230000007935 neutral effect Effects 0.000 description 3
- 201000009310 astigmatism Diseases 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000010304 firing Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- KJLLKLRVCJAFRY-UHFFFAOYSA-N mebutizide Chemical compound ClC1=C(S(N)(=O)=O)C=C2S(=O)(=O)NC(C(C)C(C)CC)NC2=C1 KJLLKLRVCJAFRY-UHFFFAOYSA-N 0.000 description 2
- 238000002310 reflectometry Methods 0.000 description 2
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000010363 phase shift Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 238000009987 spinning Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4817—Constructional features, e.g. arrangements of optical elements relating to scanning
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/42—Simultaneous measurement of distance and other co-ordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
- G01S7/4815—Constructional features, e.g. arrangements of optical elements of transmitters alone using multiple transmitters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4816—Constructional features, e.g. arrangements of optical elements of receivers alone
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/10—Scanning systems
- G02B26/12—Scanning systems using multifaceted mirrors
- G02B26/123—Multibeam scanners, e.g. using multiple light sources or beam splitters
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/08—Mirrors
- G02B5/09—Multifaceted or polygonal mirrors, e.g. polygonal scanning mirrors; Fresnel mirrors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/18—Mountings, adjusting means, or light-tight connections, for optical elements for prisms; for mirrors
- G02B7/182—Mountings, adjusting means, or light-tight connections, for optical elements for prisms; for mirrors for mirrors
- G02B7/1821—Mountings, adjusting means, or light-tight connections, for optical elements for prisms; for mirrors for mirrors for rotating or oscillating mirrors
Definitions
- LiDAR sensors can be applied in various applications, including in autonomous or semi-autonomous vehicles, drones, robotics, security applications, and the like.
- LiDAR sensors are a type of 3D sensor that can achieve high angular resolutions appropriate for such applications.
- a LiDAR sensor can include one or more laser sources for emitting laser pulses and one or more detectors for detecting reflected laser pulses.
- a LiDAR sensor can measure the time it takes for each laser pulse to travel from the LiDAR sensor to an object within the sensor's field of view, then reflect off the object and return to the LiDAR sensor.
- the LiDAR sensor can calculate a distance how far away the object is from the LiDAR sensor based on the time of flight of the laser pulse.
- Some LiDAR sensors can calculate distance based a phase shift of light. By sending out laser pulses in different directions, the LiDAR sensor can build up a three-dimensional (3D) point cloud of one or more objects in an environment.
- an LiDAR system using multiple illumination sources and a rotating mirror comprises: a first illumination source comprising a first plurality of lasers; a second illumination source comprising a second plurality of lasers; a mirror; a detector; and/or one or more memory devices.
- the mirror is arranged to rotate.
- the mirror is arranged to reflect light emitted from the first illumination source into an environment.
- the mirror is arranged to reflect light emitted from the second illumination source into the environment.
- the detector is arranged to receive light emitted from the first illumination source, after light emitted from the first illumination source is reflected by the mirror into the environment.
- the one or more memory devices comprise instructions that, when executed by one or more processors, calculates a distance to an object in the environment based on the detector receiving the light emitted from the first illumination source.
- the mirror is arranged to direct light from the first illumination source into a first field of view; the mirror is arranged to direct light from the second illumination source into a second field of view; the second field of view at least partially overlaps the first field of view; the second field of view overlaps at least 1 ⁇ 8 or 1 ⁇ 4 of the first field of view and does not overlap more than 7 ⁇ 8 or 3 ⁇ 4 of the first field of view;
- the mirror comprises a first surface and a second surface;
- the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first surface of the mirror while the second illumination source illuminates the second surface of the mirror;
- the mirror comprises a first surface and a second surface; the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first surface of the mirror while the second illumination source illuminates
- a method for LiDAR using multiple illumination sources comprises emitting light from a first illumination source, wherein the first illumination source comprises a first plurality of lasers; emitting light from a second illumination source, wherein the second illumination source comprises a second plurality of lasers; rotating a mirror; reflecting, using the mirror, light from the first illumination source into an environment; reflecting, using the mirror, light from the second illumination source into the environment; and/or detecting, using a detector, light emitted from the first illumination source, after light emitted from the first illumination source is reflected into the environment.
- the method comprises directing light from the first illumination source into a first field of view, and directing light from the second illumination source into a second field of view, wherein the second field of view at least partially overlaps the first field of view;
- the mirror comprises a first surface and a second surface;
- the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first surface of the mirror while the second illumination source illuminates the second surface of the mirror;
- the first illumination source is mounted to a platform;
- the platform is coupled with a fixed base using flexures;
- the method comprises translating the platform with respect to the fixed base while reflecting light from the first illumination source by the mirror; and/or the method comprises reflecting light from the first illumination source, using a beam splitter, before reflecting light from the first illumination source with the mirror.
- system for LiDAR using a rotating mirror with reflective surfaces of different widths comprises an illumination source and a mirror.
- the mirror the mirror is arranged to rotate and comprises a first side and second side.
- the first side has a first width.
- the second side has a second width.
- the second width is not equal to the first width.
- the first side and the second side of the mirror are arranged to reflect light from the illumination source into an environment as the mirror rotates.
- the system comprises: a detector arranged to receive light emitted by the illumination source, after light from the illumination source is reflected by the mirror into the environment, and one or more memory devices comprise instructions that, when executed by one or more processors, performs a step for calculating a distance to an object in the environment based on the detector receiving the light emitted by the illumination source, and the mirror rotates about a vertical axis to reflect light from the illumination source into a horizontal field of view; the first width is greater than the second width and equal to or less than four times the second width; the mirror comprises three sides; the first side and the second side have a reflectance, at a wavelength of the illumination source, equal to or greater than 90%; the illumination source is a laser array comprising a plurality of lasers; the mirror rotates about a vertical axis to reflect light from the illumination source horizontally into a field of view; the first side of the mirror rotates vertically to reflect light from the illumination source vertically into the field of view; the mirror rotates about a vertical axi
- a method for using a LiDAR having a rotating mirror with different widths comprises emitting light from an illumination source; rotating a mirror; reflecting, using the mirror, light from the illumination source into an environment, while rotating the mirror; detecting, using a detector, light emitted by the illumination source, after light from the illumination source is reflected by the mirror into the environment; and/or calculating a distance to an object in the environment based on the detector detecting the light emitted by the illumination source.
- the mirror comprises a first side and second side.
- the first side has a first width.
- the second side has a second width.
- the second width is not equal to the first width.
- the first width is greater than the second width and equal to or less than four times the second width; and/or the method comprises rotating the mirror about a vertical axis to reflect light from the illumination source in a horizontal field of view, translating the illumination source vertically to vertically displace light from the illumination source in a vertical field of view, passing light from the illumination source through a lens to the mirror, and/or passing light from the mirror through the lens to the detector.
- a system for LiDAR using a rotating mirror and vertical scanning comprises a platform; an illumination source comprising a plurality of lasers mounted on the platform; a flexure coupling the platform with a fixed base; a mirror, wherein the mirror is arranged to rotate and the mirror is arranged to reflect light from the plurality of lasers into an environment as the mirror rotates; a detector comprising one or more sensors arranged to receive light emitted by the illumination source, after light from the illumination source is reflected by the mirror into the environment; and/or one or more memory devices comprises instructions that, when executed by one or more processors, performs a step for calculating a distance to an object in the environment based on the detector receiving the light emitted by the illumination source.
- the system comprises a lens between the illumination source and the mirror; the platform is arranged to translate vertically as the mirror rotates horizontally about a vertical axis; the plurality of lasers are mounted on the platform with non-uniform spacing between lasers; the illumination source is a first illumination source; the mirror comprises a first surface and a second surface; the system comprises a second illumination source; the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first surface of the mirror while the second illumination source illuminates the second surface of the mirror; the system comprises a beam splitter between the illumination source and the mirror; the system comprises a first lens and a second lens; the first lens is characterized by a first focal length; the second lens is characterized by a second focal length; the first lens is positioned a first distance from the mirror; the first distance is equal to the first focal length; the second lens is positioned a second distance from the first lens; and/or the second distance is equal to a sum of the first focal length and the second focal length.
- a for using a translating platform and a rotating mirror in LiDAR comprises translating a platform relative to a fixed base, wherein a plurality of lasers are mounted on the platform, a flexure couples the platform to the fixed base, and the plurality of lasers are part of an illumination source; emitting light from the plurality of lasers, while translating the platform; reflecting, using the rotating mirror, light emitted from the illumination source into an environment; detecting light from the illumination source, using a detector, after reflecting light emitted from the illumination source into the environment; and/or calculating a distance to an object in the environment based on detecting the light from the illumination source.
- the platform is translated in a vertical dimension, and the rotating mirror rotates horizontally about a vertical axis.
- FIG. 1 illustrates an embodiment of a LiDAR sensor for three-dimensional imaging.
- FIG. 2 depicts an embodiment of a LiDAR system with a rotating mirror.
- FIG. 3 depicts an embodiment of a LiDAR system with a rotating mirror having reflective surfaces of different widths.
- FIG. 4 depicts an embodiment of a LiDAR system with a rotating mirror having non-planar reflective surfaces.
- FIG. 5 depicts an embodiment of a LiDAR system with a rotating mirror having rotating reflective surfaces.
- FIG. 6 depicts a side view an embodiment of a LiDAR system with a rotating mirror.
- FIG. 7 depicts a time sequence of an embodiment of a LiDAR system showing scanning, using flexures, in a vertical direction.
- FIG. 8 depicts embodiments of illumination source arrangements.
- FIG. 9 illustrates a flowchart of an embodiment of a process for LiDAR scanning using a mirror with reflective surfaces of different widths.
- FIG. 10 depicts an embodiment of a LiDAR system with multiple illumination sources.
- FIG. 11 depicts an embodiment of a LiDAR system with multiple illumination sources on opposite sides of a rotating mirror.
- FIG. 12 depicts another embodiment of a LiDAR system with multiple illumination sources on opposite sides of a rotating mirror.
- FIG. 13 depicts overlapping fields of view of an embodiment of a LiDAR system with multiple illumination sources.
- FIG. 14 depicts an embodiment of a LiDAR system with a compound lens.
- FIG. 15 depicts an embodiment of an integrated optics assembly for LiDAR.
- FIG. 16 depicts an embodiment of an integrated optics with a lens used for LiDAR.
- FIG. 17 illustrates a flowchart of an embodiment of a process for LiDAR using multiple illumination sources.
- FIG. 18 illustrates a flowchart of an embodiment of a process 1800 for LiDAR using a translating platform and a rotating mirror.
- FIG. 1 illustrates an embodiment of a LiDAR sensor 100 for three-dimensional imaging.
- the LiDAR sensor 100 includes an emission lens 130 and a receiving lens 140 .
- the LiDAR sensor 100 includes a light source 110 - a disposed substantially in a back focal plane of the emission lens 130 .
- the light source 110 - a is operative to emit a light pulse 120 from a respective emission location in the back focal plane of the emission lens 130 .
- the emission lens 130 is configured to collimate and direct the light pulse 120 toward an object 150 located in front of the LiDAR sensor 100 .
- the collimated light pulse 120 ′ is directed at a corresponding angle toward the object 150 .
- a portion 122 of the collimated light pulse 120 ′ is reflected off of the object 150 toward the receiving lens 140 .
- the receiving lens 140 is configured to focus the portion 122 ′ of the light pulse reflected off of the object 150 onto a corresponding detection location in the focal plane of the receiving lens 140 .
- the LiDAR sensor 100 further includes a detector 160 - a disposed substantially at the focal plane of the receiving lens 140 .
- the detector 160 - a is configured to receive and detect the portion 122 ′ of the light pulse 120 reflected off of the object at the corresponding detection location.
- the corresponding detection location of the detector 160 - a is optically conjugate with the respective emission location of the light source 110 - a.
- the light pulse 120 may be of a short duration, for example, 10 ns pulse width.
- the LiDAR sensor 100 further includes a processor 190 coupled to the light source 110 - a and the detector 160 - a .
- the processor 190 is configured to determine a time of flight (TOF) of the light pulse 120 from emission to detection. Since the light pulse 120 travels at the speed of light, a distance between the LiDAR sensor 100 and the object 150 may be determined based on the determined time of flight.
- TOF time of flight
- One way of scanning a laser beam (e.g., light pulse 120 ′) across a FOV is to move the light source 110 - a laterally relative to the emission lens 130 in the back focal plane of the emission lens 130 .
- the light source 110 - a may be raster scanned to a plurality of emission locations in the back focal plane of the emission lens 130 as illustrated in FIG. 1 .
- the light source 110 - a may emit a plurality of light pulses at the plurality of emission locations. Each light pulse emitted at a respective emission location is collimated by the emission lens 130 and directed at a respective angle toward the object 150 , and impinges at a corresponding point on the surface of the object 150 .
- the detector 160 - a may be raster scanned to be positioned at a plurality of corresponding detection locations in the focal plane of the receiving lens 140 , as illustrated in FIG. 1 .
- the scanning of the detector 160 - a is typically performed synchronously with the scanning of the light source 110 - a , so that the detector 160 - a and the light source 110 - a are always optically conjugate with each other at any given time.
- the distance from the LiDAR sensor 100 to each corresponding point on the surface of the object 150 may be determined.
- the processor 190 is coupled with a position encoder that detects the position of the light source 110 - a at each emission location. Based on the emission location, the angle of the collimated light pulse 120 ′ may be determined. The X-Y coordinate of the corresponding point on the surface of the object 150 may be determined based on the angle and the distance to the LiDAR sensor 100 .
- a three-dimensional image of the object 150 may be constructed based on the measured distances from the LiDAR sensor 100 to various points on the surface of the object 150 .
- the three-dimensional image may be represented as a point cloud, i.e., a set of X, Y, and Z coordinates of the points on the surface of the object 150 .
- the intensity of the return light pulse 122 ′ is measured and used to adjust the power of subsequent light pulses from the same emission point, in order to prevent saturation of the detector, improve eye-safety, or reduce overall power consumption.
- the power of the light pulse may be varied by varying the duration of the light pulse, the voltage or current applied to the laser, or the charge stored in a capacitor used to power the laser. In the latter case, the charge stored in the capacitor may be varied by varying the charging time, charging voltage, or charging current to the capacitor.
- the reflectivity, as determined by the intensity of the detected pulse may also be used to add another dimension to the image.
- the image may contain X, Y, and Z coordinates, as well as reflectivity (or brightness).
- the angular field of view (AFOV) of the LiDAR sensor 100 may be estimated based on the scanning range of the light source 110 - a and the focal length of the emission lens 130 as,
- the LiDAR sensor 100 may include multiple light sources disposed as an array at the back focal plane of the emission lens 130 , so that a larger total AFOV may be achieved while keeping the scan range of each individual light source relatively small. Accordingly, the LiDAR sensor 100 may include multiple detectors disposed as an array at the focal plane of the receiving lens 140 , each detector being conjugate with a respective light source.
- the LiDAR sensor 100 may include a second light source 110 - b and a second detector 160 - b , as illustrated in FIG. 1 .
- the LiDAR sensor 100 may include four light sources and four detectors, or eight light sources and eight detectors.
- the LiDAR sensor 100 may include eight light sources arranged as a 4 ⁇ 2 array and eight detectors arranged as a 4 ⁇ 2 array, so that the LiDAR sensor 100 may have a wider AFOV in the horizontal direction than its AFOV in the vertical direction.
- the total AFOV of the LiDAR sensor 100 may range from about 5 degrees to about 15 degrees, or from about 15 degrees to about 45 degrees, or from about 45 degrees to about 120 degrees, depending on the focal length of the emission lens, the scan range of each light source, and the number of light sources.
- the light source 110 - a may be configured to emit light pulses in the near infrared wavelength ranges.
- the energy of each light pulse may be in the order of microjoules, which is normally considered to be eye-safe for repetition rates in the kHz range.
- the detector 160 - a may comprise a silicon avalanche photodiode, a photomultiplier, a PIN diode, or other semiconductor sensors.
- FIG. 2 depicts an embodiment of a LiDAR system 200 comprising a mirror 204 that rotates.
- the mirror 204 can be used for scanning a laser beam 206 from an illumination source 208 into a field of view (FOV) 212 of the LiDAR system 200 .
- FOV field of view
- Three rows of points are shown scanned across the FOV 212 with uniform spacing (e.g., a uniform density of points and resolution). The three rows might be achieved, for example, by having three lasers in a vertical direction (out of the page).
- the mirror 204 is a polygon mirror. Conventional polygon mirrors are made from a number of planar, equally sized mirror segments fabricated onto a spinning rotor, rotating at a uniform rotational velocity.
- a return beam 214 reflects off the mirror 204 and reflects from a beam splitter 218 and toward a detector 222 (e.g., to a photodetector for calculating one or more points for a LiDAR point cloud).
- FIG. 3 depicts an embodiment of a LiDAR system 300 comprising a mirror 304 that has sides 305 of different widths.
- the mirror 304 is a polygon mirror.
- the sides 305 are reflective surfaces of the mirror 304 .
- the mirror 304 is used for scanning one or more laser beams 306 from an illumination source 308 into a field of view (FOV) 312 of the LiDAR system 300 .
- FOV field of view
- the sides 305 of the mirror 304 reflect light from the illumination source 308 into the environment, within the FOV 312 , as the mirror 304 rotates.
- the illumination source 308 is a laser array comprising a plurality of lasers (e.g., equal to or between 2 and 64 lasers).
- the mirror 304 is arranged, or configured, to rotate (e.g., at a constant rotational velocity).
- the mirror 304 comprises a first side 305 - 1 , a second side 305 - 2 , a third side 305 - 3 , a fourth side 305 - 4 , a fifth side 305 - 5 , and a sixth side 305 - 6 .
- the sides 305 are highly reflective (e.g., a reflectance, at a wavelength of the illumination source 308 source, equal to or greater than 80, 90, 95, 97, 98, or 99 percent).
- the mirror 304 could be more or fewer sides 305 (e.g., 3, 4, 5, 7, or 8 sides). Widths of sides 305 are unequal.
- the first side 305 - 1 and the fourth side 305 - 4 have a first width w- 1 .
- the second side 305 - 2 , the third side 305 - 3 , the fifth side 305 - 5 , and the sixth side 305 - 6 have a second width w- 2 .
- the second width w- 2 is not equal to the first width w- 1 (e.g., the first width w- 1 is wider than the second width w- 2 ).
- the sides 305 have the same height (e.g., in the vertical direction).
- the mirror 304 rotates about a vertical axis 316 to reflect light from the illumination source 308 horizontally in the FOV 312 .
- points e.g., dots
- Filled dots represent a reflection from a side 305 of length w- 1 .
- Unfilled dots represent a reflection from a side 305 of length w- 2 .
- the unfilled dots scan in only a center of the FOV 312 .
- the filled dots scan a wider area (e.g., assuming constant rotation speed of the mirror 304 ; in some configurations the mirror 304 can rotate at variable rotation speed).
- a detector is arranged to receive light emitted by the illumination source 308 , after light from the illumination source 308 is reflected by the mirror 304 into the environment.
- a distance to an object in the environment is calculated based on the detector receiving the light emitted by the illumination source 308 (e.g., a portion of light emitted by the illumination source 308 is reflected from the object to the mirror 304 , and from the mirror 304 to the detector).
- planar mirror segments e.g., sides 305
- Smaller mirror segments scan a central area of the FOV 312
- wider segments scan, horizontally, the full FOV 312 .
- a firing rate of a laser can be modified to be offset in relation to rotation of the mirror 304 to offset points in the FOV 312 to increase coverage.
- An enlargement 330 of points 335 that are part of a point cloud in the FOV 312 is shown in FIG. 3 .
- the enlargement 330 shows a set of points 335 including a first point 335 - 1 , a second point 335 - 2 , a third point 335 - 3 , a fourth point 335 - 4 , a fifth point 335 - 5 , and a sixth point 335 - 6 .
- the first point 335 - 1 is from a reflection of the first side 305 - 1 .
- the second point 335 - 2 is from a reflection of the second side 305 - 2 .
- the third point 335 - 3 is from a reflection of the third side 305 - 3 .
- the fourth point 335 - 4 is from a reflection of the fourth side 305 - 4 .
- the fifth point 335 - 5 is from a reflection of the fifth side 305 - 5 .
- the sixth point 335 - 6 is from a reflection of the sixth side 305 - 6 .
- the set of points 335 in the enlargement 330 is repeated in the center of the FOV 312 , based on a firing rate of a laser.
- a horizontal scanline shown in the FOV 312 is for one full rotation of the mirror 304 .
- the FOV 312 shows three scanlines for scanning of three lasers stacked vertically. In some arrangements, a dithering mirror is used to vertically displace points 335 from one laser.
- a pattern of a scanline can be configured to repeat every rotation (360 degrees), or half rotation (180 degrees), of the mirror 304 .
- One frame is considered one full rotation of the mirror 304 .
- the first width w- 1 is about two-and-a-half times the second width w- 2 .
- the first width w- 1 is greater than or equal to 1.2, 1.5, 1.75, 2, or 2.5 times the second width w- 2 and/or equal to and/or less than 5, 4, or 3 times the second width w- 2 .
- the mirror 304 can have a fewer number or greater number than six sides 305 .
- a fewer number of sides could be used for a wider FOV 312 .
- a larger number of sides could be used for a narrower FOV 312 and/or higher density of points.
- the mirror 304 can be non-symmetrical and/or have different arrangement of widths of sides 305 .
- the mirror 304 could have three sides with two long sides and one short side, three sides with three different widths, four sides with three short sides and one long side, or four sides with two short sides and two long sides, depending on the application and desired density distribution.
- FIG. 4 depicts an embodiment of a LiDAR system 400 with a rotating mirror 404 having non-planar reflective surfaces.
- the mirror 404 has sides 405 that are curved.
- light from an illumination source 408 reflects off varying angles of the sides 405 of the mirror 404 , resulting in a non-uniform scanning speed in a field of view (FOV) 412 .
- FOV field of view
- the sides 405 are curved in one dimension, in a direction perpendicular to a rotation axis 416 of the mirror 404 (e.g., curved within a plane of the page of FIG. 4 ).
- the rotation axis 416 is parallel to a vertical direction.
- the sides 405 are curved in a direction parallel to the rotation axis 416 of the mirror 404 (e.g., curved into and out of the page; in addition to or in lieu of curvature in the direction perpendicular to the rotation axis 416 ).
- Curvature parallel to the rotation axis 416 may be used to increase a density of points in a center of the FOV 412 in a vertical direction (e.g., for either a single laser that is scanned in the vertical direction by a second mirror or for multiple laser beams that are spaced apart in the vertical direction).
- the curvature in the vertical direction may be used to counter an astigmatism effect that could be caused by a side 405 that is curved in only a horizontal direction.
- an optic 420 for astigmatic correction e.g., a cylindrical lens
- Curvature of a side 405 of the mirror 404 may be non-uniform (e.g., having a non-uniform radius of curvature), possibly with multiple sub-segments, to tailor a point density in each portion of the FOV 412 . Curvature may also be adjusted to add a lens or focus effect into the beam path.
- FIG. 5 depicts an embodiment of a LiDAR system 500 with a rotating mirror having sides 505 that rotate.
- Light from an illumination source 508 is reflected by the sides 505 of the mirror 504 into a field of view (FOV) 512 .
- the mirror 504 rotates about a vertical axis 516 to reflect light from the illumination source 508 in a horizontal field of view, and sides 505 of the mirror 504 rotate (e.g., tilt) vertically and/or horizontally to reflect light from the illumination source 508 vertically and/or horizontally into the FOV 512 .
- each side 505 of the mirror 504 is set on an adjustable mount that can be tilted horizontally and/or vertically in real time.
- the sides 505 may be held by a pivot bearing or by a flexure.
- a drive mechanism 507 can be an electric motor, stepper motor, voice coil, piezo-electric device, and/or other drive mechanism.
- the pitch of each side 505 is set mechanically (e.g., by a mechanism similar to that used to set the pitch of blades on a helicopter).
- a side 505 can be tilted as the mirror 504 spins, thus altering a direction of a scanning beam.
- a scanning pattern can be arranged to place more points within a given ROI and fewer points outside the ROI, thus giving higher resolution within the ROI.
- FIG. 6 depicts a side view an embodiment of a LiDAR system 600 with a rotating mirror 604 .
- Light from an illumination source 608 e.g., after passing through a collimating lens 614 ) is reflected by the mirror 604 into a far-field pattern 613 as the mirror 604 rotates about a vertical axis 616 .
- the illumination source 608 comprises one or more lasers 620 .
- the lasers 620 shown in FIG. 6 are arranged in a vertical column.
- the lasers 620 are mechanically scanned in the vertical direction as rotation of the mirror 604 scans in the horizontal direction, thus achieving a 2-dimensional scan profile in the far-field pattern 613 .
- FIG. 7 depicts a time sequence of an embodiment of a LiDAR system 700 showing scanning in a vertical direction using flexures 702 .
- Scanning of the lasers 620 may be accomplished by mounting the lasers 620 on a board 706 (e.g., a platform), which is coupled (e.g., flexibly) with a base 710 (e.g., a fixed base) by flexures 702 that allow controllable movement of the lasers 620 in a vertical (and/or, in some configurations, horizontal) direction.
- the lasers 620 are fixedly coupled with the board 706 so that there is no relative movement between the lasers 620 and the board 706 .
- a position of the lasers 620 may be scanned using a voice coil, linear motor, piezoelectric transducer, or other drive mechanism.
- the flexure 702 may be driven at a resonance frequency to reduce power constraints.
- the lasers 620 in some implementations, may be fiber coupled lasers, and/or one or more optical fibers are used to flexibly attach a laser output at the board 706 with one or more laser modules at the base 710 .
- lasers 620 will be in a different vertical positions, thus resulting in a denser arrangement of points in the vertical dimension.
- One or more detectors may be mounted on the board 706 (e.g., to scan synchronously with the lasers 620 ).
- the mirror 604 rotates about a vertical axis 616 to reflect light from the illumination source (e.g., lasers 620 ) in a horizontal field of view.
- the illumination source e.g., lasers 620 mounted on the board 706
- the illumination source is arranged to translate vertically to scan in a vertical dimension. It may also be advantageous, in some configurations, to scan the illumination source in a 2-dimensional manner to improve horizontal resolution as well as vertical resolution.
- the mirror 604 comprises a first side 605 - 1 , a second side 605 - 2 , a third side 605 - 3 , a fourth side 605 - 4 , a fifth side 605 - 5 , and a sixth side.
- the board 706 is at a lower vertical position (e.g., lower than a neutral vertical position) while light from lasers 620 is reflected by the fourth side 605 - 4 as the mirror 604 rotates.
- the board 706 is at a neutral vertical position while light from lasers 620 is reflected by the fifth side 605 - 5 as the mirror 604 rotates.
- the board 706 is at a higher vertical position (e.g., higher than neutral) while light from lasers 620 is reflected by the sixth side as the mirror 604 rotates.
- lasers 620 can represent rows of lasers 620 (e.g., extending into and out of the page).
- the illumination source comprises a plurality of lasers 620 arranged in a first row 714 - 1 and a second row 714 - 2 ; the illumination source is arranged to translate vertically to scan in the vertical dimension; and a distance of vertical movement (e.g., of the board 706 ) is equal to a distance d between a center of the first row and a center of the second row, plus or minus ten percent of the distance.
- a second illumination source (e.g., on the platform 706 or on a second platform) is arranged to illumination the mirror 604 (e.g., similarly as described in conjunction with FIG. 10 and/or FIG. 11 ).
- FIG. 8 depicts embodiments of lasers 620 arranged in an illumination source 804 .
- FIG. 8 depicts a first illumination source 804 - 1 , a second illumination source 804 - 2 , and a third illumination source 804 - 3 . Though one or two columns are shown in the illumination source 804 in FIG. 8 , the illumination source 804 can have more rows and/or columns.
- the first illumination source 804 - 1 has lasers 620 arranged in two columns with constant pitch (e.g., spacing between lasers) in the vertical dimension.
- the second illumination source 804 - 2 has lasers 620 arranged in the vertical direction with varying, or nonuniform, pitch (e.g., in one dimension). Pitch (e.g., in a vertical direction) is finer in a central portion 808 of the second illumination source 804 - 2 than in a periphery portion 812 of the second illumination source 804 . 2 . This will result in more points and higher resolution in the central portion of the FOV compared to periphery portions (e.g., top and bottom) of the FOV.
- lasers 620 are staggered in the central portion 808 .
- Lasers 620 are staggered, for example, to allow for a larger number of lasers (and/or detectors) to be arranged in the vertical dimension (e.g., when a desired pitch of the laser array, and/or detector array, is less than a physical size of a laser 620 or detector).
- a first plurality (or a first set) of lasers 620 are arranged in a first region (e.g., in the central portion 808 ).
- a second plurality (or a second set) of lasers 620 are arranged in a second region (e.g., in the periphery portion 812 ).
- Lasers 620 in the first region are arranged with a first pitch 816 - 1 .
- Lasers 620 in the second region are arranged with a second pitch 816 - 2 .
- the first pitch 816 - 1 is smaller than the second pitch 816 - 2 , so that the first plurality of lasers 620 are arranged in the first region in a higher density than the second plurality of lasers 620 in the second region.
- FIG. 9 illustrates a flowchart of an embodiment of a process 900 for LiDAR scanning using a mirror with reflective surfaces of different widths.
- Process 900 begins in step 904 with emitting light from an illumination source. For example, light is emitted from illumination source 308 in FIG. 3 .
- a mirror is rotated (e.g., mirror 304 in FIG. 3 ).
- light from the illumination source is reflected by the mirror into an environment (e.g., FOV 312 , in FIG. 3 ) while the mirror rotates.
- the mirror comprises a first side and second side (e.g., first side 305 - 1 and second side 305 - 2 ).
- the first side has a first width.
- the second side has a second width.
- the second width is not equal to the first width.
- step 916 light emitted by the illumination source is detected, using a detector, after light from the illumination source is reflected by the mirror into the environment.
- step 1920 a distance to an object in the environment is calculated based on the detector detecting the light emitted by the illumination source.
- FIG. 10 depicts an embodiment of a LiDAR system 1000 having a rotating mirror 1004 and multiple illumination sources 1108 .
- Light from the illumination sources 1008 is reflected by one or more sides 1005 of the mirror 1004 into a field of view (FOV) 1012 of the LiDAR system 1000 .
- FOV field of view
- a first illumination source 1008 - 1 comprises a first plurality of lasers 1020 .
- a second illumination source 1008 - 2 comprises a second plurality of lasers 1020 .
- the second illumination source 1008 - 2 emits light at the same wavelength as light from the first illumination source 1008 - 1 .
- the second illumination source 1008 - 2 emits light at a different wavelength than light from the first illumination source 1008 - 1 .
- an illumination source 1008 can have lasers or diodes that emit at different center wavelengths. Though a row of five lasers 1020 is shown for an illumination source 1008 , an illumination source 1008 can have multiple columns and/or rows.
- the illumination source can have one, two, three, or more columns of 1, 2, 3, 4, 5, 8, 16, or 32 lasers 1020 .
- the mirror 1004 is arranged to rotate and reflect light emitted from the first illumination source 1008 - 1 and the second illumination source 1008 - 2 into an environment.
- Light from the first illumination source 1008 - 1 is emitted into a first FOV 1024 - 1 of the first illumination source 1008 - 1 .
- Light from the second illumination source 1008 - 2 is emitted into a second FOV 1024 - 2 of the second illumination source 1008 - 2 .
- the first FOV 1024 - 1 at least partially overlaps the second FOV 1024 - 2 . In FIG. 10 , the first FOV 1024 - 1 partially overlaps the second FOV 1024 - 2 but does not fully overlap the second FOV 1024 - 2 .
- the first FOV 1024 - 1 does not overlap the second FOV 1024 - 2 by more than 7 ⁇ 8, 3 ⁇ 4, 5 ⁇ 8, 1 ⁇ 2, 1 ⁇ 3, or 1 ⁇ 4 of the first FOV 1024 - 1 and/or at least overlaps the second FOV 1024 - 2 by at least 1 ⁇ 8, 1 ⁇ 4, 1 ⁇ 3, or 1 ⁇ 2 of the first FOV 1024 - 1 .
- the second field of view overlaps at least 1 ⁇ 8 or 1 ⁇ 4 of the first field of view and does not overlap more than 7 ⁇ 8 or 3 ⁇ 4 of the first field of view; overlaps at least 1 ⁇ 8 of the first field of view and does not overlap more than 7 ⁇ 8 of the first field of view; overlaps at least 1 ⁇ 4 of the first field of view and does not overlap more than 3 ⁇ 4 of the first field of view; overlaps at least 1 ⁇ 4 of the first field of view and does not overlap more than 7 ⁇ 8 of the first field of view; overlaps at least 1 ⁇ 8 of the first field of view and does not overlap more than 3 ⁇ 4 of the first field of view; overlaps half the first field of view; or overlaps at least half the first field of view and not more than 5 ⁇ 8, 2 ⁇ 3, 3 ⁇ 4, or 7 ⁇ 8 the first field of view.
- the FOV 1012 of the LiDAR system 1000 is a combination of the first FOV 1024 - 1 and the second FOV 1024 - 2 of the illumination sources 1008 .
- the FOV 1012 of the LiDAR system 1000 has denser points in a center of the FOV 1012 .
- the second illumination source 1008 - 2 is separated from the first illumination source 1008 - 1 .
- the second illumination source 1008 - 2 is separated from the first illumination source 1008 - 1 so that a field of view of the second illumination source 1008 - 2 does not fully overlap a field of view of the first illumination source 1008 - 1 .
- overlap of the field of view of the first illumination source 1008 - 2 by the field of view of the second illumination source 1008 - 2 is equal to or less than 2 ⁇ 3, 1 ⁇ 2, 1 ⁇ 3, 1 ⁇ 4, or 1 ⁇ 5.
- the field of view of the second illumination source 1008 - 2 does not overlap of the field of view of the first illumination source 1008 - 2 .
- a first detector and a second detector are arranged to receive light emitted by the first illumination source 1008 - 1 and the second illumination source 1008 - 2 , after light emitted from the illumination source 1008 is reflected by the mirror 1004 into the environment.
- One or more memory devices comprise instructions that, when executed by one or more processors, calculates one or more distances to one or more objects in the environment based on the detector(s) receiving the light emitted from the illumination source 1008 .
- the first illumination source 1008 - 1 and the second illumination source 1008 - 2 are arranged so that light emitted from the first illumination source 1008 - 1 and the second illumination source 1008 - 2 concurrently illuminate the same side 1005 of the mirror 1004 . Accordingly, the second illumination source 1008 - 2 is arranged to illuminate the side 1005 of the mirror while the first illumination source 1008 - 1 illuminates the same side 1005 of the mirror.
- the mirror 1004 has sides 1005 of equal width. In some configuration, sides 1005 of mirror 1004 are different widths (e.g., as shown in FIG. 3 ) and/or non-planar (e.g., as shown in FIG. 4 ).
- illumination sources 1008 are spread out horizontally.
- the first illumination source 1008 - 1 will scan a first side of the FOV 1012
- the second illumination source 1008 - 2 will scan a second side of the FOV 1012 .
- Scanning may be arranged so that in a middle of the FOV 1012 has a 2 ⁇ increase in density of points.
- Other arrangements of columns of lasers and/or laser spacing are possible. For example, more columns and/or rows of lasers may be used.
- FIG. 11 depicts an embodiment of a LiDAR system 1100 with a rotating mirror 1004 and multiple illumination sources 1008 on opposite sides of the rotating mirror 1004 .
- the mirror 1004 comprises a first side 1005 - 1 and a second side 1005 - 2 .
- the mirror 1004 is arranged to reflect light emitted from the first illumination source 1008 - 1 into an environment using the first side 1005 - 1 of the mirror and reflect light emitted from the second illumination source 1008 - 2 into the environment using the second side 1005 - 2 of the mirror 1004 while the first side 1005 - 1 of the mirror 1004 is used to reflect light from the first illumination source 1008 - 1 .
- a first detector is arranged to receive light emitted from the first illumination source 1008 - 1 , after light emitted from the first illumination source 1008 - 1 is reflected by the mirror 1004 into the environment.
- a second detector is arranged to receive light emitted from the second illumination source 1008 - 2 , after light emitted from the second illumination source 1008 - 2 is reflected by the mirror 1004 into the environment.
- the second illumination source 1008 - 2 is arranged opposite the first illumination source 1008 - 1 (e.g., with respect to the mirror 1004 ). This allows a single polygon mirror to scan multiple illumination sources 1008 (e.g., multiple sets of lasers). An overlap between light from illumination sources 1008 in the FOV 1012 can be adjusted by varying positions of the illumination sources 1008 relative to the mirror 1004 . Thus, an ROI may also be varied.
- a detector for the first illumination source 1008 - 1 is arranged on the opposite side of the first illumination source 1008 - 1 (e.g., adjacent to the second illumination source 1008 - 2 ). In some configurations, the second illumination source is not used and the detector for the first illumination source 1008 - 1 is on the opposite side of the mirror 1004 . This can avoid the use of a beam splitter to separate outgoing laser beams from return beams.
- fields of view 1024 are shown overlapping in FIG. 11 , in some configurations fields of view 1024 do not overlap but are used to create a wider FOV 1012 .
- FIG. 12 depicts another embodiment of a LiDAR system 1200 with a mirror 1204 arranged to rotate and multiple illumination sources 1208 on opposite sides of the mirror 1204 .
- the LiDAR system 1200 comprises the mirror 1204 , a first illumination source 1208 - 1 , a second illumination source 1208 - 2 , a first detector 1212 - 1 , and a second detector 1212 - 2 .
- the LiDAR system 1200 comprises lenses 1216 and directing mirrors 1220 .
- the first illumination source 1208 - 1 comprises a first plurality of lasers contained within a first housing.
- the second illumination source 1208 - 2 comprises a second plurality of lasers contained within a second housing.
- the first detector 1212 - 1 comprises a first plurality of sensors (e.g., diodes) arranged in a third housing (though in some embodiments, sensors of the first detector 1212 - 1 are housed in the first housing or the second housing).
- the second detector 1212 - 2 comprises a second plurality of sensors (e.g., diodes) arranged in a fourth housing (though in some embodiments, sensors of the second detector 1212 - 2 are housed in the second housing or the first housing). In some arrangements, a number of sensors in the detector 1212 matches a number of lasers in the illumination source 1208 .
- the first detector 1212 - 1 is arranged to detect light from the first illumination source 1208 - 1
- the second detector 1212 - 2 is arranged to detect light from the second illumination source 1208 - 2 , after light from illumination sources 1208 is transmitted into an environment.
- the first detector 1212 - 1 is arranged to detect light from the second illumination source 1208 - 2
- the second detector 1212 - 2 is arranged to detect light from the first illumination source 1208 - 1 (e.g., as discussed in conjunction with FIG. 11 ).
- Lenses 1216 are collimating lenses.
- One or more distances to one or more objects in the environment are measured using the illumination sources 1208 and detectors 1212 . For example, a first distance to a first object in the environment is measured using the first illumination source 1208 - 1 and the first detector 1212 - 1 ; and a second distance to the first object, or to a second object, is measured using the second illumination source 1208 - 2 and the second detector 1212 - 2 .
- Light from the first illumination source 1208 - 1 travels along a first optical path to the mirror 1204
- light from the second illumination source 1208 - 2 travels along a second optical path to the mirror 1204 , where the second optical path is a different horizontal direction than the first optical path.
- a first directing mirror 1220 - 1 directs light from the first illumination source 1208 - 1 in a positive x direction toward the mirror 1204
- a second directing mirror 1220 - 2 directs light from the second illumination source 1208 - 2 in a negative x direction toward the mirror 1204 .
- the second illumination source 1208 - 2 is separated from the first illumination source by a distance equal to or greater than 0.5, 0.75, 1, 1.5, or 1.7 times a width of the mirror 1204 , and/or equal to or less than 3, 2, or 1.7 times the width of the mirror.
- the illumination sources 1208 are shown on top of detectors 1212 , they could be arranged side-by-side, or the illumination sources 1208 could be underneath detectors 1212 .
- FIG. 13 depicts an image of overlapping fields of view of an embodiment of a LiDAR system with two illumination sources.
- a first field of view 1324 - 1 from a first illumination source overlaps with a second field of view 1324 - 2 from a second illumination source.
- a region of overlap has a higher density of measurement points than sides of field of view 1324 that do not overlap.
- FIG. 14 depicts an embodiment of a LiDAR system 1400 with a compound lens.
- Compound lens comprises a first lens 1402 - 1 and a second lens 1402 - 2 .
- the compound lens is inserted between a mirror 1404 (e.g., a rotating polygonal mirror) and an illumination source 1408 (e.g., one or more lasers and a GRIN lens).
- the lens 1402 has a focal length of f.
- the first lens 1402 - 1 is separated from the second lens 1402 - 2 by a length of 2f.
- the compound lens can be used as an optical relay that can correlate a light beam at an input and an output.
- the input e.g., at a galvo mirror 1410
- the output e.g., at the mirror 1404
- a detector 1412 (e.g., an avalanche photodiode), receives light reflected from an object 1413 .
- a transmit path 1416 and a receive path 1420 are shown.
- FIG. 14 shows a 4f two lens element optic
- other optical relay arrangements may be used that change an angle of illumination at the mirror 1404 without substantially changing its position, as an angle with illumination of the mirror 1404 is changed.
- a system comprises a first lens (e.g., first lens 1402 - 1 ) and a second lens (e.g., second lens 1402 - 2 ).
- the first lens is characterized by a first focal length (e.g., f).
- the second lens is characterized by a second focal length (e.g., f or g, where g is not equal to f).
- the first lens is positioned a first distance from a mirror (e.g., galvo mirror 1410 ; or mirror 1404 ).
- the first distance is equal to the first focal length.
- the second lens is positioned a second distance from the first lens.
- the second distance is equal to the sum of the first focal distance and the second focal distance (e.g., 2f, if the first focal distance is equal to the second focal distance, or f+g).
- FIG. 15 depicts an embodiment of an integrated optics assembly 1500 for LiDAR.
- the integrated optics assembly has a coaxial design.
- FIG. 15 shows an optical path, a coaxial path 1502 , of light emitted by an illumination source 1508 and light returning to a detector 1512 .
- Returning photons travel basically the same path as light from a laser beam, but in a reverse direction.
- a type of beam-splitting optics is used to separate the outgoing beam from the returning photons.
- FIG. 15 and FIG. 16 show a couple examples of an integrated optic assembly that can be used to implement a beam-splitting function. By integrating optical components into a single miniature subassembly, a size and/or cost can be reduced.
- mirrors 1516 are arranged to direct light from the illumination source 1508 to the coaxial path 1502 , and/or to direct returning photons to the detector 1512 .
- Mirrors 1516 are segments in a conical arrangement. In some embodiments, the mirror 1516 is a conical mirror.
- the detector 1512 is orthogonal to the illumination source 508 .
- a prism e.g., using total internal reflection
- FIG. 16 depicts an embodiment of an integrated optic 1600 with a lens 1602 and a beam splitter 1606 .
- the lens 1602 can be convex (e.g., to collimate light and/or to focus light onto a detector) or concave (e.g., to help shape divergence of a laser beam into a more symmetrical distribution).
- the beam splitter 1606 is a mirrored beam splitter.
- the lens is a mini-lens (e.g., a width, or diameter, equal to or greater than 0.5, 1, or 2 mm and/or equal to or less than 2, 3, 5, or 10 mm).
- Light from the illumination source 1508 passes through the lens 1602 to the rotating mirror (e.g., mirror 304 in FIG. 3 ), and light passes from the rotating mirror through the lens 1602 to the detector 1512 .
- the lens 1602 is used to collimate light from the laser and/or focus light onto the detector 1512 .
- Components of the integrated optics assembly 1500 and/or the integrated optic 1600 can include mirror(s), beam-splitter(s), miniature lens(es), and/or diffractive optical element(s).
- the entire size of the integrated optics assembly 1500 in FIG. 15 or the integrated optic 1600 in FIG. 16 is in the range of 1 to 3 mm on each side.
- the integrated optics assembly 1500 and the integrated optic 1600 are examples of beam splitters positioned optically between an illumination source and a rotating mirror and between a detector and the rotating mirror so that there light from the illumination source and light returning to the detector share an optical path (e.g., a coaxial path) between the beam splitter than the rotating mirror.
- an optical path e.g., a coaxial path
- FIG. 17 illustrates a flowchart of an embodiment of a process 1700 for LiDAR using multiple illumination sources.
- Process 1700 begins in step 1704 with emitting light from a first illumination source and a second illumination source.
- the first illumination source comprises a first plurality of lasers.
- the second illumination source comprises a second plurality of lasers.
- the first illumination source is the first illumination source 1008 - 1 in FIG. 10 or 11
- the second illumination source is the second illumination source 1008 - 2 in FIG. 10 or 11 .
- a mirror is rotated.
- mirror 1004 in FIG. 10 or 11 is rotated.
- step 1712 light from the first illumination source and the second illumination source is reflected into an environment, while rotating the mirror. For example, light is reflected by mirror 1004 into a field of view 1012 in FIG. 10 or 11 .
- step 1716 After light is reflected into an environment, light is detected, step 1716 .
- light is detected using the first detector 1212 - 1 and the second detector 1212 - 2 in FIG. 12 .
- Distances to one or more objects in the environment are calculated based on detecting received light from the environment.
- FIG. 18 illustrates a flowchart of an embodiment of a process 1800 for LiDAR using a translating platform and a rotating mirror.
- Process 1800 begins in step 1804 with translating a platform relative to a fixed base, wherein a plurality of lasers of an illumination source are mounted on the platform (e.g., board 706 in FIG. 7 is translated relative to base 710 ).
- step 1808 light from the plurality of lasers is emitted while translating the platform mirror is rotated.
- step 1812 light from the illumination source is reflected into an environment, while rotating a mirror.
- light form lasers 620 is reflected by mirror 604 as mirror 604 rotates in FIG. 7 .
- step 1816 After light is reflected into an environment, light is detected, step 1816 . Distances to one or more objects in the environment are calculated based on detecting received light from the illumination source after light from the illumination source is reflected into the environment.
- the platform is translated in a vertical dimension, and the mirror rotates horizontally about a vertical axis (e.g., as shown in FIG. 7 ).
- the platform is translated in only one dimension (e.g., the vertical dimension; to simplify computation).
- the platform is translated in two dimensions.
- Various features described herein can be realized using a combination of dedicated components, programmable processors, and/or other programmable devices. Some processes described herein can be implemented on the same processor or different processors. Where some components are described as being configured to perform certain operations, such configuration can be accomplished, e.g., by designing electronic circuits to perform the operation, by programming programmable electronic circuits (such as microprocessors) to perform the operation, or a combination thereof. Further, while the embodiments described above may make reference to specific hardware and software components, those skilled in the art will appreciate that different combinations of hardware and/or software components may also be used and that particular operations described as being implemented in hardware might be implemented in software or vice versa.
- the embodiments may be described as a process which is depicted as a flowchart, a flow diagram, a data flow diagram, a structure diagram, or a block diagram. Although a flowchart may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged. A process is terminated when its operations are completed, but could have additional steps not included in the figure. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Optics & Photonics (AREA)
- Electromagnetism (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Abstract
In a multi-source LiDAR, light from a first illumination source is reflected by rotating mirror into a first field of view, and light from a second illumination source is reflected by the rotating mirror into a second field of view. The second field of view can be arranged to partially overlap the first field of view to provide higher resolution in a region of interest.
Description
- This application claims the benefit of U.S. Provisional Patent Application No. 63/344,361, filed on May 20, 2022, which is incorporated by reference for all purposes.
- The following two U.S. patent applications (including this one) are being filed concurrently, and the entire disclosure of the other application is incorporated by reference into this application for all purposes:
-
- application Ser. No. ______, filed May ______, 2023, entitled “MULTI-SOURCE LIDAR” (Attorney Docket No. 101658-002210US-1386323); and
- application Ser. No. ______, filed May ______, 2023, entitled “ROTATING LIDAR MIRROR HAVING DIFFERENT SURFACE WIDTHS” (Attorney Docket No. 101658-002220US-1375594).
- Three-dimensional (3D) sensors can be applied in various applications, including in autonomous or semi-autonomous vehicles, drones, robotics, security applications, and the like. LiDAR sensors are a type of 3D sensor that can achieve high angular resolutions appropriate for such applications. A LiDAR sensor can include one or more laser sources for emitting laser pulses and one or more detectors for detecting reflected laser pulses. A LiDAR sensor can measure the time it takes for each laser pulse to travel from the LiDAR sensor to an object within the sensor's field of view, then reflect off the object and return to the LiDAR sensor. The LiDAR sensor can calculate a distance how far away the object is from the LiDAR sensor based on the time of flight of the laser pulse. Some LiDAR sensors can calculate distance based a phase shift of light. By sending out laser pulses in different directions, the LiDAR sensor can build up a three-dimensional (3D) point cloud of one or more objects in an environment.
- In certain configurations, an LiDAR system using multiple illumination sources and a rotating mirror comprises: a first illumination source comprising a first plurality of lasers; a second illumination source comprising a second plurality of lasers; a mirror; a detector; and/or one or more memory devices. The mirror is arranged to rotate. The mirror is arranged to reflect light emitted from the first illumination source into an environment. The mirror is arranged to reflect light emitted from the second illumination source into the environment. The detector is arranged to receive light emitted from the first illumination source, after light emitted from the first illumination source is reflected by the mirror into the environment. The one or more memory devices comprise instructions that, when executed by one or more processors, calculates a distance to an object in the environment based on the detector receiving the light emitted from the first illumination source. In some configurations, the mirror is arranged to direct light from the first illumination source into a first field of view; the mirror is arranged to direct light from the second illumination source into a second field of view; the second field of view at least partially overlaps the first field of view; the second field of view overlaps at least ⅛ or ¼ of the first field of view and does not overlap more than ⅞ or ¾ of the first field of view; the mirror comprises a first surface and a second surface; the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first surface of the mirror while the second illumination source illuminates the second surface of the mirror; the mirror comprises a first surface and a second surface; the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first surface of the mirror while the second illumination source illuminates the second surface of the mirror; the mirror comprises a first surface and a second surface; the second illumination source is arranged to illuminate the first surface of the mirror while the first illumination source illuminates the first surface of the mirror; the detector is a first detector; the distance is a first distance; the object is a first object; the system comprises a second detector; the second detector is arranged to receive light emitted by the second illumination source, after light from the second illumination source is reflected by the mirror into the environment; the one or more memory devices comprises instructions that, when executed by the one or more processors, performs a step for calculating a second distance to a second object in the environment based on the second detector receiving the light emitted by the second illumination source; the mirror is arranged to rotate about a vertical axis to reflect light from the first illumination source horizontally into a field of view; a side of the mirror is arranged to rotate vertically to reflect light from the first illumination source vertically into the field of view; the system comprises a platform; the first illumination source is mounted to the platform (e.g., fixedly coupled with); the platform is coupled with a fixed base using flexures; the first illumination source comprises a first plurality of laser diodes arranged in a first region and a second plurality of laser diodes arranged in a second region; the first plurality of laser diodes are arranged in the first region in a higher density than the second plurality of laser diodes are arranged in the second region; the system comprises a beam splitter between the first illumination source and the mirror; the system comprises a first lens and a second lens; the first lens is characterized by a first focal length; the second lens is characterized by a second focal length; the first lens is positioned a first distance from the mirror; the first distance is equal to the first focal length; the second lens is positioned a second distance from the first lens; and/or the second distance is equal to a sum of the first focal length and the second focal length.
- In certain configurations, a method for LiDAR using multiple illumination sources comprises emitting light from a first illumination source, wherein the first illumination source comprises a first plurality of lasers; emitting light from a second illumination source, wherein the second illumination source comprises a second plurality of lasers; rotating a mirror; reflecting, using the mirror, light from the first illumination source into an environment; reflecting, using the mirror, light from the second illumination source into the environment; and/or detecting, using a detector, light emitted from the first illumination source, after light emitted from the first illumination source is reflected into the environment. In some configurations, the method comprises directing light from the first illumination source into a first field of view, and directing light from the second illumination source into a second field of view, wherein the second field of view at least partially overlaps the first field of view; the mirror comprises a first surface and a second surface; the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first surface of the mirror while the second illumination source illuminates the second surface of the mirror; the first illumination source is mounted to a platform; the platform is coupled with a fixed base using flexures; the method comprises translating the platform with respect to the fixed base while reflecting light from the first illumination source by the mirror; and/or the method comprises reflecting light from the first illumination source, using a beam splitter, before reflecting light from the first illumination source with the mirror.
- In certain configurations, system for LiDAR using a rotating mirror with reflective surfaces of different widths comprises an illumination source and a mirror. The mirror the mirror is arranged to rotate and comprises a first side and second side. The first side has a first width. The second side has a second width. The second width is not equal to the first width. The first side and the second side of the mirror are arranged to reflect light from the illumination source into an environment as the mirror rotates. In some arrangements, the system comprises: a detector arranged to receive light emitted by the illumination source, after light from the illumination source is reflected by the mirror into the environment, and one or more memory devices comprise instructions that, when executed by one or more processors, performs a step for calculating a distance to an object in the environment based on the detector receiving the light emitted by the illumination source, and the mirror rotates about a vertical axis to reflect light from the illumination source into a horizontal field of view; the first width is greater than the second width and equal to or less than four times the second width; the mirror comprises three sides; the first side and the second side have a reflectance, at a wavelength of the illumination source, equal to or greater than 90%; the illumination source is a laser array comprising a plurality of lasers; the mirror rotates about a vertical axis to reflect light from the illumination source horizontally into a field of view; the first side of the mirror rotates vertically to reflect light from the illumination source vertically into the field of view; the mirror rotates about a vertical axis to reflect light from the illumination source in a horizontal field of view; the illumination source is arranged to translate vertically to scan in a vertical dimension; the illumination source comprises a plurality of lasers arranged in a first row and a second row; the illumination source is arranged to translate vertically to scan in a vertical dimension; a distance of vertical movement is equal to a distance between a center of the first row and a center of the second row, plus or minus ten percent of the distance; the illumination source comprises a first plurality of laser diodes arranged in a first region and a second plurality of laser diodes arranged in a second region, and the first plurality of laser diodes are arranged in the first region in a higher density than the second plurality of laser diodes are arranged in the second region; the system comprises a first lens and a second lens; the first lens is characterized by a first focal length; the second lens is characterized by a second focal length; the first lens is positioned a first distance from the mirror; the first distance is equal to the first focal length; the second lens is positioned a second distance from the first lens; the second distance is equal to a sum of the first focal length and the second focal length; the system comprises a lens; light from the illumination source passes through the lens to the mirror; light passes from the mirror through the lens to a detector; illumination source is a first illumination source; the system comprises a second illumination source; the mirror comprises a third side; the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first side of the mirror while the second illumination source illuminates the third side of the mirror; and/or the system comprises a beam splitter between the illumination source and the mirror.
- In certain configurations, a method for using a LiDAR having a rotating mirror with different widths comprises emitting light from an illumination source; rotating a mirror; reflecting, using the mirror, light from the illumination source into an environment, while rotating the mirror; detecting, using a detector, light emitted by the illumination source, after light from the illumination source is reflected by the mirror into the environment; and/or calculating a distance to an object in the environment based on the detector detecting the light emitted by the illumination source. The mirror comprises a first side and second side. The first side has a first width. The second side has a second width. The second width is not equal to the first width. In some arrangements, the first width is greater than the second width and equal to or less than four times the second width; and/or the method comprises rotating the mirror about a vertical axis to reflect light from the illumination source in a horizontal field of view, translating the illumination source vertically to vertically displace light from the illumination source in a vertical field of view, passing light from the illumination source through a lens to the mirror, and/or passing light from the mirror through the lens to the detector.
- In certain configurations, a system for LiDAR using a rotating mirror and vertical scanning comprises a platform; an illumination source comprising a plurality of lasers mounted on the platform; a flexure coupling the platform with a fixed base; a mirror, wherein the mirror is arranged to rotate and the mirror is arranged to reflect light from the plurality of lasers into an environment as the mirror rotates; a detector comprising one or more sensors arranged to receive light emitted by the illumination source, after light from the illumination source is reflected by the mirror into the environment; and/or one or more memory devices comprises instructions that, when executed by one or more processors, performs a step for calculating a distance to an object in the environment based on the detector receiving the light emitted by the illumination source. In some arrangements, the system comprises a lens between the illumination source and the mirror; the platform is arranged to translate vertically as the mirror rotates horizontally about a vertical axis; the plurality of lasers are mounted on the platform with non-uniform spacing between lasers; the illumination source is a first illumination source; the mirror comprises a first surface and a second surface; the system comprises a second illumination source; the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first surface of the mirror while the second illumination source illuminates the second surface of the mirror; the system comprises a beam splitter between the illumination source and the mirror; the system comprises a first lens and a second lens; the first lens is characterized by a first focal length; the second lens is characterized by a second focal length; the first lens is positioned a first distance from the mirror; the first distance is equal to the first focal length; the second lens is positioned a second distance from the first lens; and/or the second distance is equal to a sum of the first focal length and the second focal length.
- In certain configurations, a for using a translating platform and a rotating mirror in LiDAR comprises translating a platform relative to a fixed base, wherein a plurality of lasers are mounted on the platform, a flexure couples the platform to the fixed base, and the plurality of lasers are part of an illumination source; emitting light from the plurality of lasers, while translating the platform; reflecting, using the rotating mirror, light emitted from the illumination source into an environment; detecting light from the illumination source, using a detector, after reflecting light emitted from the illumination source into the environment; and/or calculating a distance to an object in the environment based on detecting the light from the illumination source. In some arrangements, the platform is translated in a vertical dimension, and the rotating mirror rotates horizontally about a vertical axis.
- Further areas of applicability of the present disclosure will become apparent from the detailed description provided hereinafter. It should be understood that the detailed description and specific examples, while indicating various embodiments, are intended for purposes of illustration only and are not intended to necessarily limit the scope of the disclosure.
- The present disclosure is described in conjunction with the appended figures.
-
FIG. 1 illustrates an embodiment of a LiDAR sensor for three-dimensional imaging. -
FIG. 2 depicts an embodiment of a LiDAR system with a rotating mirror. -
FIG. 3 depicts an embodiment of a LiDAR system with a rotating mirror having reflective surfaces of different widths. -
FIG. 4 depicts an embodiment of a LiDAR system with a rotating mirror having non-planar reflective surfaces. -
FIG. 5 depicts an embodiment of a LiDAR system with a rotating mirror having rotating reflective surfaces. -
FIG. 6 depicts a side view an embodiment of a LiDAR system with a rotating mirror. -
FIG. 7 depicts a time sequence of an embodiment of a LiDAR system showing scanning, using flexures, in a vertical direction. -
FIG. 8 depicts embodiments of illumination source arrangements. -
FIG. 9 illustrates a flowchart of an embodiment of a process for LiDAR scanning using a mirror with reflective surfaces of different widths. -
FIG. 10 depicts an embodiment of a LiDAR system with multiple illumination sources. -
FIG. 11 depicts an embodiment of a LiDAR system with multiple illumination sources on opposite sides of a rotating mirror. -
FIG. 12 depicts another embodiment of a LiDAR system with multiple illumination sources on opposite sides of a rotating mirror. -
FIG. 13 depicts overlapping fields of view of an embodiment of a LiDAR system with multiple illumination sources. -
FIG. 14 depicts an embodiment of a LiDAR system with a compound lens. -
FIG. 15 depicts an embodiment of an integrated optics assembly for LiDAR. -
FIG. 16 depicts an embodiment of an integrated optics with a lens used for LiDAR. -
FIG. 17 illustrates a flowchart of an embodiment of a process for LiDAR using multiple illumination sources. -
FIG. 18 illustrates a flowchart of an embodiment of aprocess 1800 for LiDAR using a translating platform and a rotating mirror. - In the appended figures, similar components and/or features may have the same reference label. Further, various components of the same type may be distinguished by following the reference label by a dash and a second label that distinguishes among the similar components. If only the first reference label is used in the specification, the description is applicable to any one of the similar components having the same first reference label irrespective of the second reference label.
- The ensuing description provides preferred exemplary embodiment(s) only, and is not intended to limit the scope, applicability, or configuration of the disclosure. Rather, the ensuing description of the preferred exemplary embodiment(s) will provide those skilled in the art with an enabling description for implementing a preferred exemplary embodiment. It is understood that various changes may be made in the function and arrangement of elements without departing from the spirit and scope as set forth in the appended claims.
-
FIG. 1 illustrates an embodiment of aLiDAR sensor 100 for three-dimensional imaging. TheLiDAR sensor 100 includes anemission lens 130 and a receivinglens 140. TheLiDAR sensor 100 includes a light source 110-a disposed substantially in a back focal plane of theemission lens 130. The light source 110-a is operative to emit alight pulse 120 from a respective emission location in the back focal plane of theemission lens 130. Theemission lens 130 is configured to collimate and direct thelight pulse 120 toward anobject 150 located in front of theLiDAR sensor 100. For a given emission location of the light source 110-a, the collimatedlight pulse 120′ is directed at a corresponding angle toward theobject 150. - A
portion 122 of the collimatedlight pulse 120′ is reflected off of theobject 150 toward the receivinglens 140. The receivinglens 140 is configured to focus theportion 122′ of the light pulse reflected off of theobject 150 onto a corresponding detection location in the focal plane of the receivinglens 140. TheLiDAR sensor 100 further includes a detector 160-a disposed substantially at the focal plane of the receivinglens 140. The detector 160-a is configured to receive and detect theportion 122′ of thelight pulse 120 reflected off of the object at the corresponding detection location. The corresponding detection location of the detector 160-a is optically conjugate with the respective emission location of the light source 110-a. - The
light pulse 120 may be of a short duration, for example, 10 ns pulse width. TheLiDAR sensor 100 further includes aprocessor 190 coupled to the light source 110-a and the detector 160-a. Theprocessor 190 is configured to determine a time of flight (TOF) of thelight pulse 120 from emission to detection. Since thelight pulse 120 travels at the speed of light, a distance between theLiDAR sensor 100 and theobject 150 may be determined based on the determined time of flight. - One way of scanning a laser beam (e.g.,
light pulse 120′) across a FOV is to move the light source 110-a laterally relative to theemission lens 130 in the back focal plane of theemission lens 130. For example, the light source 110-a may be raster scanned to a plurality of emission locations in the back focal plane of theemission lens 130 as illustrated inFIG. 1 . The light source 110-a may emit a plurality of light pulses at the plurality of emission locations. Each light pulse emitted at a respective emission location is collimated by theemission lens 130 and directed at a respective angle toward theobject 150, and impinges at a corresponding point on the surface of theobject 150. Thus, as the light source 110-a is raster scanned within a certain area in the back focal plane of theemission lens 130, a corresponding object area on theobject 150 is scanned. The detector 160-a may be raster scanned to be positioned at a plurality of corresponding detection locations in the focal plane of the receivinglens 140, as illustrated inFIG. 1 . The scanning of the detector 160-a is typically performed synchronously with the scanning of the light source 110-a, so that the detector 160-a and the light source 110-a are always optically conjugate with each other at any given time. - By determining the time of flight for each light pulse emitted at a respective emission location, the distance from the
LiDAR sensor 100 to each corresponding point on the surface of theobject 150 may be determined. In some embodiments, theprocessor 190 is coupled with a position encoder that detects the position of the light source 110-a at each emission location. Based on the emission location, the angle of the collimatedlight pulse 120′ may be determined. The X-Y coordinate of the corresponding point on the surface of theobject 150 may be determined based on the angle and the distance to theLiDAR sensor 100. Thus, a three-dimensional image of theobject 150 may be constructed based on the measured distances from theLiDAR sensor 100 to various points on the surface of theobject 150. In some embodiments, the three-dimensional image may be represented as a point cloud, i.e., a set of X, Y, and Z coordinates of the points on the surface of theobject 150. - In some embodiments, the intensity of the return
light pulse 122′ is measured and used to adjust the power of subsequent light pulses from the same emission point, in order to prevent saturation of the detector, improve eye-safety, or reduce overall power consumption. The power of the light pulse may be varied by varying the duration of the light pulse, the voltage or current applied to the laser, or the charge stored in a capacitor used to power the laser. In the latter case, the charge stored in the capacitor may be varied by varying the charging time, charging voltage, or charging current to the capacitor. In some embodiments, the reflectivity, as determined by the intensity of the detected pulse, may also be used to add another dimension to the image. For example, the image may contain X, Y, and Z coordinates, as well as reflectivity (or brightness). - The angular field of view (AFOV) of the
LiDAR sensor 100 may be estimated based on the scanning range of the light source 110-a and the focal length of theemission lens 130 as, -
- where h is a scan range of the light source 110-a along certain direction, and f is the focal length of the
emission lens 130. For a given scan range h, shorter focal lengths would produce wider AFOVs. For a given focal length f, larger scan ranges would produce wider AFOVs. In some embodiments, theLiDAR sensor 100 may include multiple light sources disposed as an array at the back focal plane of theemission lens 130, so that a larger total AFOV may be achieved while keeping the scan range of each individual light source relatively small. Accordingly, theLiDAR sensor 100 may include multiple detectors disposed as an array at the focal plane of the receivinglens 140, each detector being conjugate with a respective light source. For example, theLiDAR sensor 100 may include a second light source 110-b and a second detector 160-b, as illustrated inFIG. 1 . In other embodiments, theLiDAR sensor 100 may include four light sources and four detectors, or eight light sources and eight detectors. In one embodiment, theLiDAR sensor 100 may include eight light sources arranged as a 4×2 array and eight detectors arranged as a 4×2 array, so that theLiDAR sensor 100 may have a wider AFOV in the horizontal direction than its AFOV in the vertical direction. According to various embodiments, the total AFOV of theLiDAR sensor 100 may range from about 5 degrees to about 15 degrees, or from about 15 degrees to about 45 degrees, or from about 45 degrees to about 120 degrees, depending on the focal length of the emission lens, the scan range of each light source, and the number of light sources. - The light source 110-a may be configured to emit light pulses in the near infrared wavelength ranges. The energy of each light pulse may be in the order of microjoules, which is normally considered to be eye-safe for repetition rates in the kHz range. For light sources operating in wavelengths greater than about 1500 nm (in the near infrared wavelength range), the energy levels could be higher as the eye does not focus at those wavelengths. The detector 160-a may comprise a silicon avalanche photodiode, a photomultiplier, a PIN diode, or other semiconductor sensors.
- Additional LiDAR sensors are described in commonly owned U.S. patent application Ser. No. 15/267,558 filed Sep. 15, 2016, Ser. No. 15/971,548 filed on May 4, 2018, Ser. No. 16/504,989 filed on Jul. 8, 2019, Ser. No. 16/775,166 filed on Jan. 28, 2020, Ser. No. 17/032,526 filed on Sep. 25, 2020, Ser. No. 17/133,355 filed on Dec. 23, 2020, Ser. No. 17/205,792 filed on Mar. 18, 2021, and Ser. No. 17/380,872 filed on Jul. 20, 2021, the disclosures of which are incorporated by reference for all purposes.
-
FIG. 2 depicts an embodiment of aLiDAR system 200 comprising a mirror 204 that rotates. The mirror 204 can be used for scanning alaser beam 206 from anillumination source 208 into a field of view (FOV) 212 of theLiDAR system 200. Three rows of points are shown scanned across theFOV 212 with uniform spacing (e.g., a uniform density of points and resolution). The three rows might be achieved, for example, by having three lasers in a vertical direction (out of the page). The mirror 204 is a polygon mirror. Conventional polygon mirrors are made from a number of planar, equally sized mirror segments fabricated onto a spinning rotor, rotating at a uniform rotational velocity. Compared to other types of optical scan devices, such as galvo mirrors, the polygon mirror has low vibration, low power requirement, and linear scan characteristic. Areturn beam 214 reflects off the mirror 204 and reflects from abeam splitter 218 and toward a detector 222 (e.g., to a photodetector for calculating one or more points for a LiDAR point cloud). - In some LiDAR applications, there is a desire to have higher resolution in a center portion or region of interest (ROI) of the field of view (FOV). Normally, this is not achievable using a polygonal mirror with a uniform rotational velocity and equally sized mirror segments.
-
FIG. 3 depicts an embodiment of aLiDAR system 300 comprising amirror 304 that has sides 305 of different widths. Themirror 304 is a polygon mirror. The sides 305 are reflective surfaces of themirror 304. Themirror 304 is used for scanning one ormore laser beams 306 from anillumination source 308 into a field of view (FOV) 312 of theLiDAR system 300. For example, the sides 305 of themirror 304 reflect light from theillumination source 308 into the environment, within theFOV 312, as themirror 304 rotates. In some configurations, theillumination source 308 is a laser array comprising a plurality of lasers (e.g., equal to or between 2 and 64 lasers). - The
mirror 304 is arranged, or configured, to rotate (e.g., at a constant rotational velocity). Themirror 304 comprises a first side 305-1, a second side 305-2, a third side 305-3, a fourth side 305-4, a fifth side 305-5, and a sixth side 305-6. The sides 305 are highly reflective (e.g., a reflectance, at a wavelength of theillumination source 308 source, equal to or greater than 80, 90, 95, 97, 98, or 99 percent). - Though shown with six sides 305, the
mirror 304 could be more or fewer sides 305 (e.g., 3, 4, 5, 7, or 8 sides). Widths of sides 305 are unequal. The first side 305-1 and the fourth side 305-4 have a first width w-1. The second side 305-2, the third side 305-3, the fifth side 305-5, and the sixth side 305-6 have a second width w-2. The second width w-2 is not equal to the first width w-1 (e.g., the first width w-1 is wider than the second width w-2). The sides 305 have the same height (e.g., in the vertical direction). Themirror 304 rotates about a vertical axis 316 to reflect light from theillumination source 308 horizontally in theFOV 312. - In the
FOV 312 are points (e.g., dots) that are filled and unfilled. Filled dots represent a reflection from a side 305 of length w-1. Unfilled dots represent a reflection from a side 305 of length w-2. The unfilled dots scan in only a center of theFOV 312. The filled dots scan a wider area (e.g., assuming constant rotation speed of themirror 304; in some configurations themirror 304 can rotate at variable rotation speed). - A detector is arranged to receive light emitted by the
illumination source 308, after light from theillumination source 308 is reflected by themirror 304 into the environment. A distance to an object in the environment is calculated based on the detector receiving the light emitted by the illumination source 308 (e.g., a portion of light emitted by theillumination source 308 is reflected from the object to themirror 304, and from themirror 304 to the detector). - In
FIG. 3 , planar mirror segments (e.g., sides 305) are used to encompass different angular extents. Smaller mirror segments scan a central area of theFOV 312, while wider segments scan, horizontally, thefull FOV 312. In combination, this results in a denser point distribution in the central area or region of interest, with correspondingly better resolution in the central area or region of interest. - A firing rate of a laser can be modified to be offset in relation to rotation of the
mirror 304 to offset points in theFOV 312 to increase coverage. Anenlargement 330 of points 335 that are part of a point cloud in theFOV 312 is shown inFIG. 3 . Theenlargement 330 shows a set of points 335 including a first point 335-1, a second point 335-2, a third point 335-3, a fourth point 335-4, a fifth point 335-5, and a sixth point 335-6. The first point 335-1 is from a reflection of the first side 305-1. The second point 335-2 is from a reflection of the second side 305-2. The third point 335-3 is from a reflection of the third side 305-3. The fourth point 335-4 is from a reflection of the fourth side 305-4. The fifth point 335-5 is from a reflection of the fifth side 305-5. The sixth point 335-6 is from a reflection of the sixth side 305-6. The set of points 335 in theenlargement 330 is repeated in the center of theFOV 312, based on a firing rate of a laser. A horizontal scanline shown in theFOV 312 is for one full rotation of themirror 304. TheFOV 312 shows three scanlines for scanning of three lasers stacked vertically. In some arrangements, a dithering mirror is used to vertically displace points 335 from one laser. - A pattern of a scanline can be configured to repeat every rotation (360 degrees), or half rotation (180 degrees), of the
mirror 304. One frame is considered one full rotation of themirror 304. In some configurations, a scanline pattern is repeated every N frames, wherein N is an integer. For example, if N=10, and there were 10 frames per second, then a scanline pattern would repeat every second. In some configurations, N is equal to or greater than 1, 2, 3, 5, or 7 and/or equal to or less than 7, 10, 15, 20, 30, or 50. - In
FIG. 3 , the first width w-1 is about two-and-a-half times the second width w-2. In some arrangements, the first width w-1 is greater than or equal to 1.2, 1.5, 1.75, 2, or 2.5 times the second width w-2 and/or equal to and/or less than 5, 4, or 3 times the second width w-2. - Though there are six sides 305 shown in
FIG. 3 , themirror 304 can have a fewer number or greater number than six sides 305. A fewer number of sides could be used for awider FOV 312. For example, three for 120 degrees, four for 90 degrees, five for 72 degrees, or six for 60 degrees. A larger number of sides could be used for anarrower FOV 312 and/or higher density of points. - The
mirror 304 can be non-symmetrical and/or have different arrangement of widths of sides 305. For example, themirror 304 could have three sides with two long sides and one short side, three sides with three different widths, four sides with three short sides and one long side, or four sides with two short sides and two long sides, depending on the application and desired density distribution. -
FIG. 4 depicts an embodiment of aLiDAR system 400 with arotating mirror 404 having non-planar reflective surfaces. Themirror 404 hassides 405 that are curved. As themirror 404 rotates, light from anillumination source 408 reflects off varying angles of thesides 405 of themirror 404, resulting in a non-uniform scanning speed in a field of view (FOV) 412. By properly curving the sides 405 (e.g., with a concave shape), scanning will be slower in a center portion of aside 405, resulting in a higher density of LiDAR image points in a center of theFOV 412. - The
sides 405 are curved in one dimension, in a direction perpendicular to arotation axis 416 of the mirror 404 (e.g., curved within a plane of the page ofFIG. 4 ). Therotation axis 416 is parallel to a vertical direction. In some arrangements, thesides 405 are curved in a direction parallel to therotation axis 416 of the mirror 404 (e.g., curved into and out of the page; in addition to or in lieu of curvature in the direction perpendicular to the rotation axis 416). Curvature parallel to therotation axis 416 may be used to increase a density of points in a center of theFOV 412 in a vertical direction (e.g., for either a single laser that is scanned in the vertical direction by a second mirror or for multiple laser beams that are spaced apart in the vertical direction). The curvature in the vertical direction may be used to counter an astigmatism effect that could be caused by aside 405 that is curved in only a horizontal direction. In some arrangements, an optic 420 for astigmatic correction (e.g., a cylindrical lens) may be incorporated into a beam path to correct astigmatism fromcurved sides 405 of themirror 404. Curvature of aside 405 of themirror 404 may be non-uniform (e.g., having a non-uniform radius of curvature), possibly with multiple sub-segments, to tailor a point density in each portion of theFOV 412. Curvature may also be adjusted to add a lens or focus effect into the beam path. -
FIG. 5 depicts an embodiment of aLiDAR system 500 with a rotatingmirror having sides 505 that rotate. Light from anillumination source 508 is reflected by thesides 505 of themirror 504 into a field of view (FOV) 512. Themirror 504 rotates about avertical axis 516 to reflect light from theillumination source 508 in a horizontal field of view, andsides 505 of themirror 504 rotate (e.g., tilt) vertically and/or horizontally to reflect light from theillumination source 508 vertically and/or horizontally into theFOV 512. - In
FIG. 5 , eachside 505 of themirror 504 is set on an adjustable mount that can be tilted horizontally and/or vertically in real time. Thesides 505 may be held by a pivot bearing or by a flexure. Adrive mechanism 507 can be an electric motor, stepper motor, voice coil, piezo-electric device, and/or other drive mechanism. In some arrangements, the pitch of eachside 505 is set mechanically (e.g., by a mechanism similar to that used to set the pitch of blades on a helicopter). In operation, aside 505 can be tilted as themirror 504 spins, thus altering a direction of a scanning beam. With proper control logic, a scanning pattern can be arranged to place more points within a given ROI and fewer points outside the ROI, thus giving higher resolution within the ROI. -
FIG. 6 depicts a side view an embodiment of aLiDAR system 600 with arotating mirror 604. Light from an illumination source 608 (e.g., after passing through a collimating lens 614) is reflected by themirror 604 into a far-field pattern 613 as themirror 604 rotates about avertical axis 616. Theillumination source 608 comprises one ormore lasers 620. Thelasers 620 shown inFIG. 6 are arranged in a vertical column. Thelasers 620 are mechanically scanned in the vertical direction as rotation of themirror 604 scans in the horizontal direction, thus achieving a 2-dimensional scan profile in the far-field pattern 613. -
FIG. 7 depicts a time sequence of an embodiment of aLiDAR system 700 showing scanning in a verticaldirection using flexures 702. Scanning of thelasers 620 may be accomplished by mounting thelasers 620 on a board 706 (e.g., a platform), which is coupled (e.g., flexibly) with a base 710 (e.g., a fixed base) byflexures 702 that allow controllable movement of thelasers 620 in a vertical (and/or, in some configurations, horizontal) direction. Thelasers 620 are fixedly coupled with theboard 706 so that there is no relative movement between thelasers 620 and theboard 706. A position of the lasers 620 (e.g., in relation to the mirror 604) may be scanned using a voice coil, linear motor, piezoelectric transducer, or other drive mechanism. In some implementations, theflexure 702 may be driven at a resonance frequency to reduce power constraints. Thelasers 620, in some implementations, may be fiber coupled lasers, and/or one or more optical fibers are used to flexibly attach a laser output at theboard 706 with one or more laser modules at thebase 710. - As light from the
lasers 620 passes oversides 605 of themirror 604,lasers 620 will be in a different vertical positions, thus resulting in a denser arrangement of points in the vertical dimension. One or more detectors may be mounted on the board 706 (e.g., to scan synchronously with the lasers 620). - In the arrangement shown in
FIG. 7 , themirror 604 rotates about avertical axis 616 to reflect light from the illumination source (e.g., lasers 620) in a horizontal field of view. The illumination source (e.g.,lasers 620 mounted on the board 706) is arranged to translate vertically to scan in a vertical dimension. It may also be advantageous, in some configurations, to scan the illumination source in a 2-dimensional manner to improve horizontal resolution as well as vertical resolution. - In
FIG. 7 , a simplified time sequence of T=1, T=2, and T=3 is shown. Themirror 604 comprises a first side 605-1, a second side 605-2, a third side 605-3, a fourth side 605-4, a fifth side 605-5, and a sixth side. At time T=1, theboard 706 is at a lower vertical position (e.g., lower than a neutral vertical position) while light fromlasers 620 is reflected by the fourth side 605-4 as themirror 604 rotates. At time T=2, theboard 706 is at a neutral vertical position while light fromlasers 620 is reflected by the fifth side 605-5 as themirror 604 rotates. At time T=3, theboard 706 is at a higher vertical position (e.g., higher than neutral) while light fromlasers 620 is reflected by the sixth side as themirror 604 rotates. - In
FIG. 7 ,lasers 620 can represent rows of lasers 620 (e.g., extending into and out of the page). In some configurations, vertical motion of theboard 706 is equal to (e.g., +/−1, 5, 10, 15, or 20%), or no larger, than a distance betweenlasers 620, or rows oflasers 620, becausescanlines 708 can be arranged to vertically fill the field of view as the illumination source translates vertically (e.g., as shown inFIG. 7 a time T=3). In some configurations, the illumination source comprises a plurality oflasers 620 arranged in a first row 714-1 and a second row 714-2; the illumination source is arranged to translate vertically to scan in the vertical dimension; and a distance of vertical movement (e.g., of the board 706) is equal to a distance d between a center of the first row and a center of the second row, plus or minus ten percent of the distance. - In some configurations, a second illumination source (e.g., on the
platform 706 or on a second platform) is arranged to illumination the mirror 604 (e.g., similarly as described in conjunction withFIG. 10 and/orFIG. 11 ). -
FIG. 8 depicts embodiments oflasers 620 arranged in an illumination source 804.FIG. 8 depicts a first illumination source 804-1, a second illumination source 804-2, and a third illumination source 804-3. Though one or two columns are shown in the illumination source 804 inFIG. 8 , the illumination source 804 can have more rows and/or columns. - The first illumination source 804-1 has
lasers 620 arranged in two columns with constant pitch (e.g., spacing between lasers) in the vertical dimension. - The second illumination source 804-2 has
lasers 620 arranged in the vertical direction with varying, or nonuniform, pitch (e.g., in one dimension). Pitch (e.g., in a vertical direction) is finer in acentral portion 808 of the second illumination source 804-2 than in aperiphery portion 812 of the second illumination source 804.2. This will result in more points and higher resolution in the central portion of the FOV compared to periphery portions (e.g., top and bottom) of the FOV. - In the third illumination source 804-3,
lasers 620 are staggered in thecentral portion 808.Lasers 620 are staggered, for example, to allow for a larger number of lasers (and/or detectors) to be arranged in the vertical dimension (e.g., when a desired pitch of the laser array, and/or detector array, is less than a physical size of alaser 620 or detector). - In the second illumination source 804-2 and the third illumination source 804-3, a first plurality (or a first set) of lasers 620 (e.g., laser diodes) are arranged in a first region (e.g., in the central portion 808). A second plurality (or a second set) of
lasers 620 are arranged in a second region (e.g., in the periphery portion 812).Lasers 620 in the first region are arranged with a first pitch 816-1.Lasers 620 in the second region are arranged with a second pitch 816-2. The first pitch 816-1 is smaller than the second pitch 816-2, so that the first plurality oflasers 620 are arranged in the first region in a higher density than the second plurality oflasers 620 in the second region. -
FIG. 9 illustrates a flowchart of an embodiment of aprocess 900 for LiDAR scanning using a mirror with reflective surfaces of different widths.Process 900 begins instep 904 with emitting light from an illumination source. For example, light is emitted fromillumination source 308 inFIG. 3 . Instep 908, a mirror is rotated (e.g.,mirror 304 inFIG. 3 ). Instep 912, light from the illumination source is reflected by the mirror into an environment (e.g.,FOV 312, inFIG. 3 ) while the mirror rotates. The mirror comprises a first side and second side (e.g., first side 305-1 and second side 305-2). The first side has a first width. The second side has a second width. The second width is not equal to the first width. - In
step 916, light emitted by the illumination source is detected, using a detector, after light from the illumination source is reflected by the mirror into the environment. In step 1920, a distance to an object in the environment is calculated based on the detector detecting the light emitted by the illumination source. -
FIG. 10 depicts an embodiment of aLiDAR system 1000 having arotating mirror 1004 and multiple illumination sources 1108. Light from the illumination sources 1008 is reflected by one ormore sides 1005 of themirror 1004 into a field of view (FOV) 1012 of theLiDAR system 1000. - A first illumination source 1008-1 comprises a first plurality of
lasers 1020. A second illumination source 1008-2 comprises a second plurality oflasers 1020. The second illumination source 1008-2 emits light at the same wavelength as light from the first illumination source 1008-1. In some embodiments, the second illumination source 1008-2 emits light at a different wavelength than light from the first illumination source 1008-1. In some embodiments, an illumination source 1008 can have lasers or diodes that emit at different center wavelengths. Though a row of fivelasers 1020 is shown for an illumination source 1008, an illumination source 1008 can have multiple columns and/or rows. For example, the illumination source can have one, two, three, or more columns of 1, 2, 3, 4, 5, 8, 16, or 32lasers 1020. - The
mirror 1004 is arranged to rotate and reflect light emitted from the first illumination source 1008-1 and the second illumination source 1008-2 into an environment. Light from the first illumination source 1008-1 is emitted into a first FOV 1024-1 of the first illumination source 1008-1. Light from the second illumination source 1008-2 is emitted into a second FOV 1024-2 of the second illumination source 1008-2. The first FOV 1024-1 at least partially overlaps the second FOV 1024-2. InFIG. 10 , the first FOV 1024-1 partially overlaps the second FOV 1024-2 but does not fully overlap the second FOV 1024-2. In some configurations, the first FOV 1024-1 does not overlap the second FOV 1024-2 by more than ⅞, ¾, ⅝, ½, ⅓, or ¼ of the first FOV 1024-1 and/or at least overlaps the second FOV 1024-2 by at least ⅛, ¼, ⅓, or ½ of the first FOV 1024-1. For example, the second field of view overlaps at least ⅛ or ¼ of the first field of view and does not overlap more than ⅞ or ¾ of the first field of view; overlaps at least ⅛ of the first field of view and does not overlap more than ⅞ of the first field of view; overlaps at least ¼ of the first field of view and does not overlap more than ¾ of the first field of view; overlaps at least ¼ of the first field of view and does not overlap more than ⅞ of the first field of view; overlaps at least ⅛ of the first field of view and does not overlap more than ¾ of the first field of view; overlaps half the first field of view; or overlaps at least half the first field of view and not more than ⅝, ⅔, ¾, or ⅞ the first field of view. TheFOV 1012 of theLiDAR system 1000 is a combination of the first FOV 1024-1 and the second FOV 1024-2 of the illumination sources 1008. TheFOV 1012 of theLiDAR system 1000 has denser points in a center of theFOV 1012. - The second illumination source 1008-2 is separated from the first illumination source 1008-1. The second illumination source 1008-2 is separated from the first illumination source 1008-1 so that a field of view of the second illumination source 1008-2 does not fully overlap a field of view of the first illumination source 1008-1. In some configurations, overlap of the field of view of the first illumination source 1008-2 by the field of view of the second illumination source 1008-2 is equal to or less than ⅔, ½, ⅓, ¼, or ⅕. In some configurations, the field of view of the second illumination source 1008-2 does not overlap of the field of view of the first illumination source 1008-2.
- A first detector and a second detector are arranged to receive light emitted by the first illumination source 1008-1 and the second illumination source 1008-2, after light emitted from the illumination source 1008 is reflected by the
mirror 1004 into the environment. One or more memory devices comprise instructions that, when executed by one or more processors, calculates one or more distances to one or more objects in the environment based on the detector(s) receiving the light emitted from the illumination source 1008. - The first illumination source 1008-1 and the second illumination source 1008-2 are arranged so that light emitted from the first illumination source 1008-1 and the second illumination source 1008-2 concurrently illuminate the
same side 1005 of themirror 1004. Accordingly, the second illumination source 1008-2 is arranged to illuminate theside 1005 of the mirror while the first illumination source 1008-1 illuminates thesame side 1005 of the mirror. In some configurations, themirror 1004 hassides 1005 of equal width. In some configuration,sides 1005 ofmirror 1004 are different widths (e.g., as shown inFIG. 3 ) and/or non-planar (e.g., as shown inFIG. 4 ). - As shown in
FIG. 10 , illumination sources 1008 are spread out horizontally. The first illumination source 1008-1 will scan a first side of theFOV 1012, and the second illumination source 1008-2 will scan a second side of theFOV 1012. Scanning may be arranged so that in a middle of theFOV 1012 has a 2× increase in density of points. Other arrangements of columns of lasers and/or laser spacing are possible. For example, more columns and/or rows of lasers may be used. -
FIG. 11 depicts an embodiment of aLiDAR system 1100 with arotating mirror 1004 and multiple illumination sources 1008 on opposite sides of therotating mirror 1004. Themirror 1004 comprises a first side 1005-1 and a second side 1005-2. Themirror 1004 is arranged to reflect light emitted from the first illumination source 1008-1 into an environment using the first side 1005-1 of the mirror and reflect light emitted from the second illumination source 1008-2 into the environment using the second side 1005-2 of themirror 1004 while the first side 1005-1 of themirror 1004 is used to reflect light from the first illumination source 1008-1. A first detector is arranged to receive light emitted from the first illumination source 1008-1, after light emitted from the first illumination source 1008-1 is reflected by themirror 1004 into the environment. A second detector is arranged to receive light emitted from the second illumination source 1008-2, after light emitted from the second illumination source 1008-2 is reflected by themirror 1004 into the environment. - In
FIG. 11 , the second illumination source 1008-2 is arranged opposite the first illumination source 1008-1 (e.g., with respect to the mirror 1004). This allows a single polygon mirror to scan multiple illumination sources 1008 (e.g., multiple sets of lasers). An overlap between light from illumination sources 1008 in theFOV 1012 can be adjusted by varying positions of the illumination sources 1008 relative to themirror 1004. Thus, an ROI may also be varied. - In some configurations, a detector for the first illumination source 1008-1 is arranged on the opposite side of the first illumination source 1008-1 (e.g., adjacent to the second illumination source 1008-2). In some configurations, the second illumination source is not used and the detector for the first illumination source 1008-1 is on the opposite side of the
mirror 1004. This can avoid the use of a beam splitter to separate outgoing laser beams from return beams. - Though fields of view 1024 are shown overlapping in
FIG. 11 , in some configurations fields of view 1024 do not overlap but are used to create awider FOV 1012. -
FIG. 12 depicts another embodiment of aLiDAR system 1200 with amirror 1204 arranged to rotate and multiple illumination sources 1208 on opposite sides of themirror 1204. TheLiDAR system 1200 comprises themirror 1204, a first illumination source 1208-1, a second illumination source 1208-2, a first detector 1212-1, and a second detector 1212-2. TheLiDAR system 1200 compriseslenses 1216 and directing mirrors 1220. - The first illumination source 1208-1 comprises a first plurality of lasers contained within a first housing. The second illumination source 1208-2 comprises a second plurality of lasers contained within a second housing. The first detector 1212-1 comprises a first plurality of sensors (e.g., diodes) arranged in a third housing (though in some embodiments, sensors of the first detector 1212-1 are housed in the first housing or the second housing). The second detector 1212-2 comprises a second plurality of sensors (e.g., diodes) arranged in a fourth housing (though in some embodiments, sensors of the second detector 1212-2 are housed in the second housing or the first housing). In some arrangements, a number of sensors in the detector 1212 matches a number of lasers in the illumination source 1208.
- The first detector 1212-1 is arranged to detect light from the first illumination source 1208-1, and the second detector 1212-2 is arranged to detect light from the second illumination source 1208-2, after light from illumination sources 1208 is transmitted into an environment. In some embodiments, the first detector 1212-1 is arranged to detect light from the second illumination source 1208-2, and the second detector 1212-2 is arranged to detect light from the first illumination source 1208-1 (e.g., as discussed in conjunction with
FIG. 11 ). - Light from the illumination source 1208 is reflected by directing mirror 1220 to mirror 1204 (e.g., for a transmit path), and from
mirror 1204 to detector 1212 (e.g., for a return path).Lenses 1216 are collimating lenses. One or more distances to one or more objects in the environment are measured using the illumination sources 1208 and detectors 1212. For example, a first distance to a first object in the environment is measured using the first illumination source 1208-1 and the first detector 1212-1; and a second distance to the first object, or to a second object, is measured using the second illumination source 1208-2 and the second detector 1212-2. Light from the first illumination source 1208-1, travels along a first optical path to themirror 1204, and light from the second illumination source 1208-2 travels along a second optical path to themirror 1204, where the second optical path is a different horizontal direction than the first optical path. For example, a first directing mirror 1220-1 directs light from the first illumination source 1208-1 in a positive x direction toward themirror 1204, and a second directing mirror 1220-2 directs light from the second illumination source 1208-2 in a negative x direction toward themirror 1204. - The second illumination source 1208-2 is separated from the first illumination source by a distance equal to or greater than 0.5, 0.75, 1, 1.5, or 1.7 times a width of the
mirror 1204, and/or equal to or less than 3, 2, or 1.7 times the width of the mirror. - Though the illumination sources 1208 are shown on top of detectors 1212, they could be arranged side-by-side, or the illumination sources 1208 could be underneath detectors 1212.
-
FIG. 13 depicts an image of overlapping fields of view of an embodiment of a LiDAR system with two illumination sources. A first field of view 1324-1 from a first illumination source overlaps with a second field of view 1324-2 from a second illumination source. A region of overlap has a higher density of measurement points than sides of field of view 1324 that do not overlap. -
FIG. 14 depicts an embodiment of aLiDAR system 1400 with a compound lens. Compound lens comprises a first lens 1402-1 and a second lens 1402-2. The compound lens is inserted between a mirror 1404 (e.g., a rotating polygonal mirror) and an illumination source 1408 (e.g., one or more lasers and a GRIN lens). The lens 1402 has a focal length of f. The first lens 1402-1 is separated from the second lens 1402-2 by a length of 2f. The compound lens can be used as an optical relay that can correlate a light beam at an input and an output. The input (e.g., at a galvo mirror 1410) is if from the first lens 1402-1 and the output (e.g., at the mirror 1404) is if from the second lens 1402-2. - A detector 1412 (e.g., an avalanche photodiode), receives light reflected from an
object 1413. A transmitpath 1416 and a receivepath 1420 are shown. - While the arrangement in
FIG. 14 shows a 4f two lens element optic, other optical relay arrangements may be used that change an angle of illumination at themirror 1404 without substantially changing its position, as an angle with illumination of themirror 1404 is changed. - One possible advantage of this design in a galvo/polygon system is that an output location will not change as the
galvo mirror 1410 is scanned. Accordingly, an aperture size constraint of the system can be reduced or minimized. - In some configurations, a system comprises a first lens (e.g., first lens 1402-1) and a second lens (e.g., second lens 1402-2). The first lens is characterized by a first focal length (e.g., f). The second lens is characterized by a second focal length (e.g., f or g, where g is not equal to f). The first lens is positioned a first distance from a mirror (e.g.,
galvo mirror 1410; or mirror 1404). The first distance is equal to the first focal length. The second lens is positioned a second distance from the first lens. The second distance is equal to the sum of the first focal distance and the second focal distance (e.g., 2f, if the first focal distance is equal to the second focal distance, or f+g). -
FIG. 15 depicts an embodiment of anintegrated optics assembly 1500 for LiDAR. The integrated optics assembly has a coaxial design.FIG. 15 shows an optical path, acoaxial path 1502, of light emitted by anillumination source 1508 and light returning to adetector 1512. Returning photons travel basically the same path as light from a laser beam, but in a reverse direction. A type of beam-splitting optics is used to separate the outgoing beam from the returning photons. -
FIG. 15 andFIG. 16 show a couple examples of an integrated optic assembly that can be used to implement a beam-splitting function. By integrating optical components into a single miniature subassembly, a size and/or cost can be reduced. - In
FIG. 15 , mirrors 1516 are arranged to direct light from theillumination source 1508 to thecoaxial path 1502, and/or to direct returning photons to thedetector 1512.Mirrors 1516 are segments in a conical arrangement. In some embodiments, themirror 1516 is a conical mirror. Thedetector 1512 is orthogonal to theillumination source 508. In some configurations, a prism (e.g., using total internal reflection) is positioned instead of amirror 1516 that is farthest away from theillumination source 1508. The -
FIG. 16 depicts an embodiment of anintegrated optic 1600 with alens 1602 and abeam splitter 1606. Thelens 1602 can be convex (e.g., to collimate light and/or to focus light onto a detector) or concave (e.g., to help shape divergence of a laser beam into a more symmetrical distribution). Thebeam splitter 1606 is a mirrored beam splitter. The lens is a mini-lens (e.g., a width, or diameter, equal to or greater than 0.5, 1, or 2 mm and/or equal to or less than 2, 3, 5, or 10 mm). Light from theillumination source 1508 passes through thelens 1602 to the rotating mirror (e.g.,mirror 304 inFIG. 3 ), and light passes from the rotating mirror through thelens 1602 to thedetector 1512. In some arrangements, thelens 1602 is used to collimate light from the laser and/or focus light onto thedetector 1512. - Components of the
integrated optics assembly 1500 and/or theintegrated optic 1600 can include mirror(s), beam-splitter(s), miniature lens(es), and/or diffractive optical element(s). In some configurations, the entire size of theintegrated optics assembly 1500 inFIG. 15 or theintegrated optic 1600 inFIG. 16 is in the range of 1 to 3 mm on each side. - The
integrated optics assembly 1500 and theintegrated optic 1600 are examples of beam splitters positioned optically between an illumination source and a rotating mirror and between a detector and the rotating mirror so that there light from the illumination source and light returning to the detector share an optical path (e.g., a coaxial path) between the beam splitter than the rotating mirror. -
FIG. 17 illustrates a flowchart of an embodiment of aprocess 1700 for LiDAR using multiple illumination sources.Process 1700 begins instep 1704 with emitting light from a first illumination source and a second illumination source. The first illumination source comprises a first plurality of lasers. The second illumination source comprises a second plurality of lasers. For example, the first illumination source is the first illumination source 1008-1 inFIG. 10 or 11 , and the second illumination source is the second illumination source 1008-2 inFIG. 10 or 11 . - In
step 1708, a mirror is rotated. For example,mirror 1004 inFIG. 10 or 11 is rotated. - In
step 1712, light from the first illumination source and the second illumination source is reflected into an environment, while rotating the mirror. For example, light is reflected bymirror 1004 into a field ofview 1012 inFIG. 10 or 11 . - After light is reflected into an environment, light is detected,
step 1716. For example, light is detected using the first detector 1212-1 and the second detector 1212-2 inFIG. 12 . Distances to one or more objects in the environment are calculated based on detecting received light from the environment. -
FIG. 18 illustrates a flowchart of an embodiment of aprocess 1800 for LiDAR using a translating platform and a rotating mirror.Process 1800 begins instep 1804 with translating a platform relative to a fixed base, wherein a plurality of lasers of an illumination source are mounted on the platform (e.g.,board 706 inFIG. 7 is translated relative to base 710). Instep 1808, light from the plurality of lasers is emitted while translating the platform mirror is rotated. - In
step 1812, light from the illumination source is reflected into an environment, while rotating a mirror. For example,light form lasers 620 is reflected bymirror 604 asmirror 604 rotates inFIG. 7 . - After light is reflected into an environment, light is detected,
step 1816. Distances to one or more objects in the environment are calculated based on detecting received light from the illumination source after light from the illumination source is reflected into the environment. - In some configurations, the platform is translated in a vertical dimension, and the mirror rotates horizontally about a vertical axis (e.g., as shown in
FIG. 7 ). In some arrangements the platform is translated in only one dimension (e.g., the vertical dimension; to simplify computation). In some configurations, the platform is translated in two dimensions. - Various features described herein, e.g., methods, apparatus, computer-readable media and the like, can be realized using a combination of dedicated components, programmable processors, and/or other programmable devices. Some processes described herein can be implemented on the same processor or different processors. Where some components are described as being configured to perform certain operations, such configuration can be accomplished, e.g., by designing electronic circuits to perform the operation, by programming programmable electronic circuits (such as microprocessors) to perform the operation, or a combination thereof. Further, while the embodiments described above may make reference to specific hardware and software components, those skilled in the art will appreciate that different combinations of hardware and/or software components may also be used and that particular operations described as being implemented in hardware might be implemented in software or vice versa.
- Details are given in the above description to provide an understanding of the embodiments. However, it is understood that the embodiments may be practiced without some of the specific details. Examples in different figures may be combined in various ways to enhance performance or modified for a specific application. For example, vertical motion of sources in
FIG. 7 may be combined with variable laser spacing inFIG. 8 , or themirror 405 inFIG. 4 can be used for themirror 1004 inFIG. 10 . In some instances, well-known circuits, processes, algorithms, structures, and techniques are not shown in the figures. - While the principles of the disclosure have been described above in connection with specific apparatus and methods, it is to be understood that this description is made only by way of example and not as limitation on the scope of the disclosure. Embodiments were chosen and described in order to explain principles and practical applications to enable others skilled in the art to utilize the invention in various embodiments and with various modifications, as are suited to a particular use contemplated. It will be appreciated that the description is intended to cover modifications and equivalents.
- Also, it is noted that the embodiments may be described as a process which is depicted as a flowchart, a flow diagram, a data flow diagram, a structure diagram, or a block diagram. Although a flowchart may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged. A process is terminated when its operations are completed, but could have additional steps not included in the figure. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.
- A recitation of “a”, “an”, or “the” is intended to mean “one or more” unless specifically indicated to the contrary. Patents, patent applications, publications, and descriptions mentioned here are incorporated by reference in their entirety for all purposes. None is admitted to be prior art.
- The specific details of particular embodiments may be combined in any suitable manner without departing from the spirit and scope of embodiments of the invention. However, other embodiments of the invention may be directed to specific embodiments relating to each individual aspect, or specific combinations of these individual aspects.
- The above description of embodiments of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form described, and many modifications and variations are possible in light of the teaching above. The embodiments were chosen and described in order to explain the principles of the invention and its practical applications to thereby enable others skilled in the art to utilize the invention in various embodiments and with various modifications as are suited to the particular use contemplated.
Claims (21)
1. A system for LiDAR using multiple illumination sources and a rotating mirror, the system comprising:
a first illumination source comprising a first plurality of lasers;
a second illumination source comprising a second plurality of lasers;
a mirror, wherein:
the mirror is arranged to rotate;
the mirror is arranged to reflect light emitted from the first illumination source into an environment;
the mirror is arranged to reflect light emitted from the second illumination source into the environment;
a detector arranged to receive light emitted from the first illumination source, after light emitted from the first illumination source is reflected by the mirror into the environment; and
one or more memory devices comprising instructions that, when executed by one or more processors, performs a step for calculating a distance to an object in the environment based on the detector receiving the light emitted from the first illumination source.
2. The system of claim 1 , wherein:
the mirror is arranged to direct light from the first illumination source into a first field of view;
the mirror is arranged to direct light from the second illumination source into a second field of view; and
the second field of view at least partially overlaps the first field of view.
3. The system of claim 2 , wherein the second field of view overlaps at least ⅛ or ¼ of the first field of view and does not overlap more than ⅞ or ¾ of the first field of view.
4. The system of claim 2 , wherein:
the mirror comprises a first surface and a second surface; and
the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first surface of the mirror while the second illumination source illuminates the second surface of the mirror.
5. The system of claim 1 , wherein:
the mirror comprises a first surface and a second surface; and
the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first surface of the mirror while the second illumination source illuminates the second surface of the mirror.
6. The system of claim 1 , wherein:
the mirror comprises a first surface and a second surface; and
the second illumination source is arranged to illuminate the first surface of the mirror while the first illumination source illuminates the first surface of the mirror.
7. The system of claim 1 , wherein:
the detector is a first detector;
the distance is a first distance;
the object is a first object;
the system comprises a second detector;
the second detector is arranged to receive light emitted by the second illumination source, after light from the second illumination source is reflected by the mirror into the environment; and
the one or more memory devices comprises instructions that, when executed by the one or more processors, performs a step for calculating a second distance to a second object in the environment based on the second detector receiving the light emitted by the second illumination source.
8. The system of claim 1 , wherein:
the mirror is arranged to rotate about a vertical axis to reflect light from the first illumination source horizontally into a field of view; and
a side of the mirror is arranged to rotate vertically to reflect light from the first illumination source vertically into the field of view.
9. The system of claim 1 , further comprising a platform, wherein:
the first illumination source is mounted to the platform; and
the platform is coupled with a fixed base using flexures.
10. The system of claim 1 , wherein:
the first illumination source comprises:
a first plurality of laser diodes arranged in a first region; and
a second plurality of laser diodes arranged in a second region; and
the first plurality of laser diodes are arranged in the first region in a higher density than the second plurality of laser diodes are arranged in the second region.
11. The system of claim 1 , further comprising a beam splitter between the first illumination source and the mirror.
12. The system of claim 1 , further comprising a first lens and a second lens, wherein:
the first lens is characterized by a first focal length;
the second lens is characterized by a second focal length;
the first lens is positioned a first distance from the mirror;
the first distance is equal to the first focal length;
the second lens is positioned a second distance from the first lens; and
the second distance is equal to a sum of the first focal length and the second focal length.
13. A method for LiDAR using multiple illumination sources, the method comprising:
emitting light from a first illumination source, wherein the first illumination source comprises a first plurality of lasers;
emitting light from a second illumination source, wherein the second illumination source comprises a second plurality of lasers;
rotating a mirror;
reflecting, using the mirror, light from the first illumination source into an environment;
reflecting, using the mirror, light from the second illumination source into the environment; and
detecting, using a detector, light emitted from the first illumination source, after light emitted from the first illumination source is reflected into the environment.
14. The method of claim 13 , comprising:
directing light from the first illumination source into a first field of view; and
directing light from the second illumination source into a second field of view, wherein the second field of view at least partially overlaps the first field of view.
15. The method of claim 13 , wherein:
the mirror comprises a first surface and a second surface; and
the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first surface of the mirror while the second illumination source illuminates the second surface of the mirror.
16. The method of claim 13 , wherein:
the first illumination source is mounted to a platform;
the platform is coupled with a fixed base using flexures; and
the method comprises translating the platform with respect to the fixed base while reflecting light from the first illumination source by the mirror.
17. The method of claim 13 , wherein:
the first illumination source comprises:
a first plurality of laser diodes arranged in a first region; and
a second plurality of laser diodes arranged in a second region; and
the first plurality of laser diodes are arranged in the first region in a higher density than the second plurality of laser diodes are arranged in the second region.
18. The method of claim 13 , comprising reflecting light from the first illumination source, using a beam splitter, before reflecting light from the first illumination source with the mirror.
19. A system for LiDAR using multiple illumination sources and a rotating mirror, the system comprising:
a first illumination source;
a second illumination source;
a mirror comprising a first side and a second side, wherein:
the mirror is arranged to rotate;
the mirror is arranged to reflect light emitted from the first illumination source into an environment using the first side of the mirror;
the mirror is arranged to direct light from the first illumination source into a first field of view;
the mirror is arranged to reflect light emitted from the second illumination source into the environment using the second side of the mirror while the first side of the mirror is used to reflect light from the first illumination source;
the mirror is arranged to direct light from the second illumination source into a second field of view; and
the second field of view at least partially overlaps the first field of view; and
a detector arranged to receive light emitted from the first illumination source, after light emitted from the first illumination source is reflected by the mirror into the environment; and
one or more memory devices comprising instructions that, when executed by one or more processors, performs a step for calculating a distance to an object in the environment based on the detector receiving the light emitted from the first illumination source.
20. The system of claim 19 , wherein the second illumination source is arranged opposite the first illumination source so that the first illumination source illuminates the first side of the mirror while the second illumination source illuminates the second side of the mirror.
21.-49. (canceled)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18/200,451 US20230375674A1 (en) | 2022-05-20 | 2023-05-22 | Multi-source lidar |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202263344361P | 2022-05-20 | 2022-05-20 | |
US18/200,451 US20230375674A1 (en) | 2022-05-20 | 2023-05-22 | Multi-source lidar |
Publications (1)
Publication Number | Publication Date |
---|---|
US20230375674A1 true US20230375674A1 (en) | 2023-11-23 |
Family
ID=88791355
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/200,457 Pending US20230375675A1 (en) | 2022-05-20 | 2023-05-22 | Rotating lidar mirror having different surface widths |
US18/200,451 Pending US20230375674A1 (en) | 2022-05-20 | 2023-05-22 | Multi-source lidar |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/200,457 Pending US20230375675A1 (en) | 2022-05-20 | 2023-05-22 | Rotating lidar mirror having different surface widths |
Country Status (2)
Country | Link |
---|---|
US (2) | US20230375675A1 (en) |
WO (1) | WO2023225391A1 (en) |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10761195B2 (en) * | 2016-04-22 | 2020-09-01 | OPSYS Tech Ltd. | Multi-wavelength LIDAR system |
WO2018128655A2 (en) * | 2016-09-25 | 2018-07-12 | Okeeffe James | Distributed laser range finder with fiber optics and micromirrors |
US10955530B2 (en) * | 2016-12-23 | 2021-03-23 | Cepton Technologies, Inc. | Systems for vibration cancellation in a lidar system |
US11022688B2 (en) * | 2017-03-31 | 2021-06-01 | Luminar, Llc | Multi-eye lidar system |
JP2022526998A (en) * | 2019-04-09 | 2022-05-27 | オプシス テック リミテッド | Solid-state LIDAR transmitter with laser control |
-
2023
- 2023-05-22 WO PCT/US2023/023064 patent/WO2023225391A1/en unknown
- 2023-05-22 US US18/200,457 patent/US20230375675A1/en active Pending
- 2023-05-22 US US18/200,451 patent/US20230375674A1/en active Pending
Also Published As
Publication number | Publication date |
---|---|
US20230375675A1 (en) | 2023-11-23 |
WO2023225391A1 (en) | 2023-11-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11994621B2 (en) | Mounting apparatuses for optical components in a scanning lidar system | |
EP3821275B1 (en) | Scanning lidar systems with moving lens assembly | |
US10305247B2 (en) | Radiation source with a small-angle scanning array | |
US11592530B2 (en) | Detector designs for improved resolution in lidar systems | |
US20170307759A1 (en) | Multi-Range Three-Dimensional Imaging Systems | |
US10935637B2 (en) | Lidar system including a transceiver array | |
JP5653715B2 (en) | Laser surveyor | |
US11686818B2 (en) | Mounting configurations for optoelectronic components in LiDAR systems | |
US20210132196A1 (en) | Flat optics with passive elements functioning as a transformation optics and a compact scanner to cover the vertical elevation field-of-view | |
CN110658527A (en) | Laser radar, autonomous mobile robot and intelligent vehicle | |
US20230375674A1 (en) | Multi-source lidar | |
US20230013992A1 (en) | Multiple beam generation from a single source beam for use with a lidar system | |
US20230341521A1 (en) | Double-sided flexure for linear lidar scanning | |
US11762066B2 (en) | Multi-beam scanning system | |
US20210302543A1 (en) | Scanning lidar systems with flood illumination for near-field detection | |
US20240255617A1 (en) | Lidar having individually addressable, scannable and integratable laser emiiters | |
CN221465737U (en) | Laser radar | |
US20240183950A1 (en) | Scanning lidar with discrete vertical steps | |
CN111308442B (en) | Laser radar | |
US20210293954A1 (en) | Object detection apparatus and movable apparatus | |
CN116583776A (en) | Light detection device | |
CN114296053A (en) | Laser radar and scanning monitoring system | |
JP2023138001A (en) | Lidar device, and lidar device control method | |
CN116097125A (en) | Lidar with individually addressable, scannable and integrable laser emitters |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
AS | Assignment |
Owner name: CEPTON TECHNOLOGIES, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:PEI, JUN;TAN, SI;ZHOU, LIANG;AND OTHERS;SIGNING DATES FROM 20230524 TO 20230530;REEL/FRAME:064226/0144 |