EP4103966A2 - Centralized object detection sensor network system - Google Patents
Centralized object detection sensor network systemInfo
- Publication number
- EP4103966A2 EP4103966A2 EP21799465.6A EP21799465A EP4103966A2 EP 4103966 A2 EP4103966 A2 EP 4103966A2 EP 21799465 A EP21799465 A EP 21799465A EP 4103966 A2 EP4103966 A2 EP 4103966A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- signals
- probing
- transponders
- sensor network
- echo
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 96
- 230000006854 communication Effects 0.000 claims abstract description 91
- 238000004891 communication Methods 0.000 claims abstract description 91
- 230000003287 optical effect Effects 0.000 claims description 271
- 238000012545 processing Methods 0.000 claims description 109
- 239000000969 carrier Substances 0.000 claims description 19
- 230000007175 bidirectional communication Effects 0.000 claims description 5
- 238000003384 imaging method Methods 0.000 claims description 3
- 238000000034 method Methods 0.000 description 40
- 230000008569 process Effects 0.000 description 16
- 239000013307 optical fiber Substances 0.000 description 11
- 230000008901 benefit Effects 0.000 description 7
- 230000002457 bidirectional effect Effects 0.000 description 6
- 238000006243 chemical reaction Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000015654 memory Effects 0.000 description 5
- 230000005693 optoelectronics Effects 0.000 description 5
- 230000008447 perception Effects 0.000 description 5
- 238000000926 separation method Methods 0.000 description 5
- 230000010287 polarization Effects 0.000 description 4
- 238000003672 processing method Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 230000002787 reinforcement Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/87—Combinations of radar systems, e.g. primary radar and secondary radar
- G01S13/878—Combination of several spaced transmitters or receivers of known location for determining the position of a transponder or a reflector
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
- G01S13/06—Systems determining position data of a target
- G01S13/08—Systems for measuring distance only
- G01S13/32—Systems for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated
- G01S13/34—Systems for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated using transmission of continuous, frequency-modulated waves while heterodyning the received signal, or a signal derived therefrom, with a locally-generated signal related to the contemporaneously transmitted signal
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
- G01S13/50—Systems of measurement based on relative movement of target
- G01S13/58—Velocity or trajectory determination systems; Sense-of-movement determination systems
- G01S13/581—Velocity or trajectory determination systems; Sense-of-movement determination systems using transmission of interrupted pulse modulated waves and based upon the Doppler effect resulting from movement of targets
- G01S13/582—Velocity or trajectory determination systems; Sense-of-movement determination systems using transmission of interrupted pulse modulated waves and based upon the Doppler effect resulting from movement of targets adapted for simultaneous range and velocity measurements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
- G01S13/50—Systems of measurement based on relative movement of target
- G01S13/58—Velocity or trajectory determination systems; Sense-of-movement determination systems
- G01S13/583—Velocity or trajectory determination systems; Sense-of-movement determination systems using transmission of continuous unmodulated waves, amplitude-, frequency-, or phase-modulated waves and based upon the Doppler effect resulting from movement of targets
- G01S13/584—Velocity or trajectory determination systems; Sense-of-movement determination systems using transmission of continuous unmodulated waves, amplitude-, frequency-, or phase-modulated waves and based upon the Doppler effect resulting from movement of targets adapted for simultaneous range and velocity measurements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/74—Systems using reradiation of radio waves, e.g. secondary radar systems; Analogous systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
- G01S13/865—Combination of radar systems with lidar systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/87—Combinations of radar systems, e.g. primary radar and secondary radar
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/887—Radar or analogous systems specially adapted for specific applications for detection of concealed objects, e.g. contraband or weapons
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/42—Simultaneous measurement of distance and other co-ordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/50—Systems of measurement based on relative movement of target
- G01S17/58—Velocity or trajectory determination systems; Sense-of-movement determination systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
- G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/003—Transmission of data between radar, sonar or lidar systems and remote stations
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
- G01S7/023—Interference mitigation, e.g. reducing or avoiding non-intentional interference with other HF-transmitters, base station transmitters for mobile communication or other radar systems, e.g. using electro-magnetic interference [EMI] reduction techniques
- G01S7/0233—Avoidance by phase multiplex
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
- G01S7/28—Details of pulse systems
- G01S7/285—Receivers
- G01S7/292—Extracting wanted echo-signals
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
- G01S7/35—Details of non-pulse systems
- G01S7/352—Receivers
- G01S7/354—Extracting wanted echo-signals
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/484—Transmitters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/487—Extracting wanted echo signals, e.g. pulse detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
- G01S13/867—Combination of radar systems with cameras
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
- G01S2013/9316—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles combined with communication equipment with other vehicles or with base stations
Definitions
- the disclosed technology generally relates to sensor network systems for sensing objects in an environment, and more particularly to object detection sensor network systems that are adapted for long baseline applications.
- RADAR radio detection and ranging
- LIDAR light detection and ranging
- RADAR uses radio waves
- LIDAR uses light waves to measure the velocity and location of an object with respect to a reference frame.
- the one or more transponders are physically separate from the central unit while being communicatively coupled thereto through the one or more communication links.
- the central unit is configured to generate one or more baseband signals, use them to generate one or more probing signals and transmit the one or more probing signals to one or more transponders through the one or more communication links.
- the central unit is further configured to receive one or more echo signals from the one or more transponders through the one or more communication links, and detect the one or more objects based at least in part on the one or more echo signals and the one or more baseband signals.
- the transponders are configured to receive the probing signals from the central unit through the communication links, generate free space probing waves and direct the free space probing waves to the environment for detecting the one or more objects.
- the transponders are further configured to receive one or more free space echo waves from the one or more objects, generate the one or more echo signals using the free space echo waves and transmit the one or more echo signals to the central unit through the one or more communication links.
- the central unit is configured to generate one or more multiplexed probing signals and transmit at least one of the multiplexed probing signals to one of the transponders through one of the communication links and receive a multiplexed echo signal from the one of the transponders through the one of the communication links.
- the central unit is further configured to detect the one or more objects, based at least in part on one or more reflected baseband signals, wherein the one or more reflected baseband signals are generated using the one of the multiplexed echo signals.
- the one of the transponders is configured to receive the one of the multiplexed probing signals from the central unit through the one of the communication links, generate one or more radio frequency (RF) probing signals using the one of the multiplexed probing signals and one or more RF carrier signals.
- the one of the transponders converts the one or more RF probing signals into free space probing waves and directs the free space probing waves to the environment for detecting the one or more objects.
- the one of the transponders is further configured to receive one or more free space echo waves from the one or more objects, and generate the multiplexed echo signal using the free space echo waves and transmit the multiplexed echo signal to the central unit through the communication link.
- the one or more lidar-radar transponders are physically separate from the central unit.
- the central unit is configured to: generate one or more radar probing signals and one or more lidar probing signals; transmit the one or more radar probing signals and the one or more lidar probing signals to the one or more lidar-radar transponders; receive one or more radar echo signals and one or more lidar echo signals from the one or more lidar-radar transponders; and detect the one or more objects based at least in part on the one or more radar echo signals and the one or more lidar echo signals.
- FIG. 1A illustrates a centralized object detection sensor network system having a central unit coupled to a plurality of transponders through communication links, according to embodiments.
- FIG. IB illustrates a centralized object detection sensor network system (e.g., the system shown in FIG. 1A), which is configured to emit multiple waves and use multiple echo waves reflected by one or more objects to determine velocities and/or locations of the one or more objects in an environment, according to embodiments.
- a centralized object detection sensor network system e.g., the system shown in FIG. 1A
- FIG. 2A illustrates a hybrid centralized object detection sensor network system having a central unit coupled to a plurality of transponders and a plurality of other sensors through a plurality of communication links, according to embodiments.
- FIG. 2B illustrates a centralized object detection sensor network system having a central unit coupled to a plurality of end nodes through a plurality of primary communication links (node links) where each end node is coupled to a plurality of transponders through a plurality of secondary communication links, according to embodiments.
- FIG. 3A illustrates a centralized object detection sensor network system having a central unit coupled to a plurality transponders through a plurality of communication links, where the central unit is configured to transmit one probing signal to each transponder and to receive one echo signal from each transponder via each communication link, according to embodiments.
- FIG. 3B illustrates a centralized object detection sensor network system having a central unit coupled to a plurality of transponders through a plurality of communication links, where the central unit is configured to transmit a plurality of multiplexed probing signals to the plurality of transponders and to receive a plurality of multiplexed echo signals from each transponder, according to embodiments.
- FIG. 3C illustrates a centralized object detection sensor network system having a central unit coupled to a plurality of transponders through a plurality of communication links, where the central unit is configured to distribute a multiplexed probing signal among the plurality of transponders and to receive a plurality of multiplexed echo signals from the plurality of transponders, according to embodiments.
- FIG. 4 illustrates a centralized object detection sensor network system having a central unit coupled to a plurality of end nodes through a plurality of primary communication links (node links) where each end node transmits a plurality of probing signals to each transponder and receives a plurality of echo signals from each transponder, according to embodiments.
- FIG. 5 illustrates a transponder of a centralized object detection sensor network system configured to receive/transmit optical and or electronic probing/echo signals from/to the central unit, according to embodiments.
- FIG. 6A illustrates a centralized object detection sensor network system having a central unit coupled to a plurality transponders through a plurality of optical communication links, where the optical communication links for sending and receiving optical probing signals between the central unit and each of the transponders are separate.
- Each of the transponders first convert the optical probing signals to electronic probing signals and then up-convert them to RF frequencies to generate the free space waves, according to embodiments.
- FIG. 6B illustrates a centralized object detection sensor network system having a bidirectional optical link for sending and receiving optical signals between a central unit and each of the transponders.
- Each of the transponders first convert the optical probing signals to electronic probing signals and then up-convert them to RF frequencies to generate the free space waves, according to embodiments
- FIG. 6C illustrates a centralized object detection sensor network system having a central unit coupled to a plurality transponders each comprising an optical transceiver connected to the central unit through a bidirectional optical communication link.
- FIG. 7 illustrates a central unit of a centralized object detection sensor network system configured to generate a plurality of multiplexed optical signals using wavelength division multiplexing.
- FIG. 8 illustrates another example of a centralized sensor network system.
- the illustrated system advantageously integrates lidar and radar sensing subsystems.
- the illustrated lidar-radar sensing subsystem and the lidar and radar sensing subsystem are integrated into a single centralized sensing system.
- FIG. 9 illustrates an example centralized sensor network system that generates an object signal and transmits the object signal to an external processing system.
- FIG. 10 illustrates an example application of a centralized sensor network system where the system is used to monitor the environment surrounding an automobile.
- Disclosed herein are centralized object detection sensor network systems adapted for long-baseline sensing, e.g., radar and/or lidar sensor networks, that support extended spatial and/or angular coverage.
- Possible applications for the disclosed systems include, but are not limited to, autonomous vehicles (e.g. ground-, air-, or sea-based), extended indoor spaces, and outdoor areas.
- a centralized object detection sensor network system comprising a central unit configured to generate one or more probing signals for detecting one or more objects in an environment, and one or more transponders configured to receive the one or more probing signals and convert them into free space waves for detecting the one or more objects in the environment.
- Radio detection and ranging (RADAR) and light detection and ranging (LIDAR) are well-known sensing modalities for detecting objects and determine their range and/or velocity (speed and direction of motion) in an environment. Radar can be used to detect objects in a larger area and low visibility weather conditions compared to LIDAR; however, LIDAR provides higher resolution and accuracy.
- a detection and ranging system may use one or more RADARS and/or one or more LIDARS to facilitate detection of one or more objects distributed in an environment.
- the signal processing functions and components employed for generation of a probing signal e.g., used to generate radio waves or light waves
- processing the corresponding echo signal e.g., generated by reflection of the radio waves or the light waves
- object detection systems may employ multiple sensors located in different positions to detect objects (e.g., to improve the accuracy, to cover larger areas, cover different directions and the like).
- a centralized sensor system may also benefit from making the original (“raw”) information contained in multiple echo signals received by the central processing unit and exploit them through the more advanced signal processing chains that can be implemented in the central processing unit. It should be appreciated that if the received echo signals are processed within each sensor, the level and accuracy of the information extracted from the echo signals may be limited by the computational resources available within each sensor resulting in an inefficient usage of the raw information encoded in the echo signal.
- centralized sensor systems and methods can support both RADAR and LIDAR sensors to enable detection based on both radio waves and light waves, they may enable the realization of compact multi-emitter detection systems that combine high-resolution directional detection with and long-range wide area detection and low-visibility resilience.
- FIG. 1A illustrates a centralized object detection sensor network system 100, according to various embodiments.
- the centralized object detection sensor network system 100 may include a central signal generation and processing unit 102, also referred to herein as a central unit, one or more transponders 104 and one or more communication links 106, also referred to herein as links, that communicatively connect the one or more transponders 104 to the central unit 102.
- the one or more links 106 can be bidirectional analog or digital communication links.
- the one or more links 106 may include one or more of optical communication links, RF communication links, Ethernet communication links or other types of digital or analog communication links. In some cases, a subset of the links may be RF communication links or optical links or Ethernet links.
- the one or more links 106 may comprise multiple-input and multiple-output (MIMO) RF or optical links.
- FIG. IB illustrates some details associated with object detection using the centralized object detection sensor network system 100.
- the central unit 102 generates one or more probing signals configured for detecting objects in an environment and transmits the one or more probing signals to the one or more transponders 104 via the one or more links 106.
- the one or more transponders 104 convert the one or more probing signals to one or more free space probing waves 108 and direct them to the environment.
- the one or more free space probing waves can be free space radio waves or free space optical waves.
- the one or more transponders 104 first convert (e.g., upconvert) the one or more probing signals (e.g., baseband or intermediate frequency probing signals) to one or more RF probing signals.
- the one or more transponders 104 may use the one or more RF probing signals to generate the one or more free space probing waves 108 (e.g., radio waves).
- the environment may include one or more objects 110 that generate one or more free space echo waves 112 by reflecting a portion of the one or more free space probing waves 108.
- the transponders 104 may receive portions of the free space echo waves 112, convert the received portions of the free space echo waves 112 to one or more echo signals and transmit the one or more echo signals back to the central unit 102 via the one or more links 106.
- the one or more transponders 104 convert one or more free space echo waves (e.g., received via one or more antennas), to one or more RF echo signals.
- the one or more transponders 104 may use the one or more RF echo signals to generate the one or more echo signals.
- the central unit 102 receives and processes the one or more echo signals to determine positions and velocities of the one or more objects 110.
- the central unit 102 is advantageously physically separated from the one or more transponders 104 for physical separation between the computational and sensing functionalities of the sensor network system 100, which provides various advantages described above.
- the central unit 102 advantageously serves as a common central processing unit to compute and determine the positions and velocities of the one or more objects 110 detected by the one or more transponders 104.
- the one or more transponders 104 are not configured to provide computing functions for the determination of the positions and velocities of the one or more objects 110.
- cost, reliability and complexity of the sensor network 100 may advantageously be reduced.
- the probing signals can be continuous wave (CW) signals (e.g., signals that continuously vary in time domain without any sudden change of amplitude in time).
- CW probing signals may be used to generate CW free space probing waves and therefore CW echo waves and echo signals.
- the probing signals can be pulsed signals (e.g., signals that include sudden changes of amplitude in time domain). Pulsed probing signals may be used to generate pulsed free space probing waves and therefore pulsed echo waves and echo signals.
- centralized object detection sensor network systems that use CW probing signals CW detection techniques, may be able to measure the positon and velocities of objects with higher precision compared to pulsed systems.
- the centralized object detection sensor network systems described herein may use CW probing signals and CW position and velocity measurement techniques to detect objects in an environment.
- two or more probing signals may be multiplexed to form one or more multiplexed probing signals and two or more echo signals may be multiplexed to form one or more multiplexed echo signals.
- the echo signals or the probing signals can be multiplexed using various multiplexing techniques such as wavelength (or frequency) division multiplexing, time division multiplexing, polarization division multiplexing, angular momentum division multiplexing, code division multiplexing or other multiplexing methods used for multiplexing signals in optical domain, electrical domain or RF domain.
- multiplexing probing and echo signals may reduce a number of links required to connect the one or more transponders 104 to the central unit 102 without reducing the number of probing signals (and the corresponding echo signals) communicated with each transponder.
- the probing signals and the echo signals may comprise: one more of analog signals (e.g., electronic analog signals), digital signals (electronic digital signals), Ethernet signals, , analog optical signals or digital optical signals.
- the probing signals e.g., electronic signals
- An IF signal can be an intermediate frequency (IF) carrier whose amplitude or phase is modulated by one or more baseband signals.
- An RF signal can be a radio frequency (RF) carrier whose amplitude or phase is modulated by one or more baseband signals or one or more IF signals.
- the echo signals may be reflected baseband signals, or reflected baseband signals carried by one or more IF or RF carrier signals.
- phases or amplitudes of the one or more RF or IF carrier signals may be modulated by the reflected baseband signals.
- phases or amplitudes of the one or more RF carrier signals may be modulated an IF signals that carry the reflected baseband signals.
- RF carrier signals can be single tone harmonic signals generated by an oscillator (e.g., a local oscillator) and having frequencies between 1 - 5 GHz, 5 -10 GHz, 10-20 GHz, 20-30 GHz, 30-40 GHz, 40 - 50 GHz, 50 - 60 GHz, 60 - 70 GHz, 70 - 80 GHz, 80 - 90 GHz, 90 - 100 GHz, 100 GHz - 200 GHz, 200 - 300 GHz.
- IF carrier signals can be single tone harmonic signals generated by an oscillator (e.g., a local oscillator) and having frequencies between 10 MHz to 10 GHz.
- Digital optical signals may comprise one or more optical carrier signals whose amplitude, phase, polarization or angular momentum are modulated with one or more digital baseband signals.
- Analog optical signals may comprise one or more optical carrier signals whose amplitude, phase, polarization or angular momentum modulated with one or more baseband signals, IF signals or RF signals.
- the probing signals may be radar signals.
- some of the radar signals may comprise an RF carrier whose amplitude or phase is modulated by one or more baseband signals.
- at least some of the probing signals may comprise baseband signals.
- at least some of the radar signals may comprise an RF carrier whose frequency is shifted by an intermediate frequency (IF) signal whose phase or amplitude is modulated by one or more baseband signals.
- IF intermediate frequency
- Each baseband signal may be a digital signal or an analog signal.
- the frequency of the RF signal may range from few to few hundred gigahertz (e.g., between 1 - 5 GHz, 5 -10 GHz, 10-20 GHz, 20-30 GHz, 30-40 GHz, 40 - 50 GHz, 50 - 60 GHz, 60 - 70 GHz, 70 - 80 GHz, 80 - 90 GHz, 90 - 100 GHz, 100 GHz - 200 GHz, 200 - 300 GHz).
- the frequency of the baseband signal may range from 1 MHz to 10 GHz and the frequency of the IF signal may range from 10 MHz to few 10 GHz.
- a probing signal can be a digital electronic signal or a digital optical signal.
- a digital electronic signal can be a digitized baseband signal, a digitized IF signal or a digitized RF signal.
- a digital optical signal can be an optical carrier signal modulated by a digital electronic signal.
- an electronic-to-optical (E/O) converter electronic signal may convert an electronic signal to an optical signal by directly modulating an amplitude or a phase of a laser.
- an electronic-to-optical (E/O) convert can convert an electronic signal to an optical signal by externally modulating an amplitude or a phase of a laser using an optical amplitude or phase modulator.
- the probing signals and echo signals associated with a transponder may be communicated with the central unit 102, via a single bidirectional link (e.g., using one or more routers in the central unit and in the transponder). In some other embodiments, two separate links may be used for sending probing signals from the central unit 102 to a transponder and sending echo signals from the transponder to the central unit 102.
- the central unit 102 may comprise several subsystems including but not limited to: a signal processing unit (e.g., a digital signal processing unit), a transmitter unit, a receiver unit, and a router unit.
- the receiver unit may include one or more receivers and the transmitter unit may include one or more transmitters.
- the signal processing unit may generate one or more baseband signals and the transmitter unit may convert the one or more baseband signals to one or more probing signals (e.g., by digital-to-analog conversion, up-conversion to higher RF frequencies, and/or amplification).
- the receiver unit may receive one or more echo signals corresponding to the one or more probing signals and provide one or more reflected baseband signals to the signal processing unit.
- the signal processing unit may process the one or more reflected baseband signals to determine positions and or velocities of one or more objects in the environment. Processing the one or more reflected baseband signals may include a comparison between the one or more baseband signals and the one or more reflected baseband signals.
- the baseband signals and the reflected baseband signals can be analog or digital electronic signals.
- the probing signals, multiplxed probing signals, echo signals and multiplexed echo signals can be optical signals.
- the central unit may include one or more electrical-to-optical converters and one or more optical- to-electrical converters.
- the one or more electrical-to-optical converters may include one or more lasers to convert electronic probing signals to optical probing signals.
- the one or more lasers may be directly modulated while in other cases one or more optical modulators may be used to modulate optical outputs of the one or more lasers.
- one or more optical-to-electrical converters may include one or more photodetectors configured to convert optical echo signals to electronic echo signals.
- the central unit 102 may include a multiplexing unit and a demultiplexing unit.
- the multiplexing unit may include one or more optical and/or electronic multiplexers configured to multiplex two or more probing signals to generate one or multiplexed probing signals.
- the demultiplexing unit may include one or more optical or electronic demultiplexers configured to generate two or more echo signals by demultiplexing one or more multiplexed echo signal.
- the router unit may be configured to couple probing signals from the transmitter unit or the multiplexing unit to the one or more links 106 that communicatively connect the central unit 102 to one or more transponders 104 and couple the echo signals received via the one or more links 106 to the receiver unit.
- the router unit allows using a single link to send a probing signal or a multiplexed probing signal and simultaneously receive an echo signal or a multiplexed echo signal.
- each transmitter unit may include one or more digital to analog (D-to-A) converters to convert digital input baseband signals generated by signal processing module to analog input baseband signals.
- each receiver may include one or more analog to digital (A-to-D) converters to convert analog output baseband signals to digital output baseband signals.
- each transmitter may include components configured to mix RF carrier signals with baseband signals (up-conversion) and each receiver may include components configured to extract baseband signals from modulated RF carrier signals.
- the signal processing unit may comprise a digital signal processing module configured to receive and process digital signals (e.g., digital output baseband signals) to provide information pertaining to positions and/or velocities of one or more objects in the environment.
- the digital signal processing unit may comprise a memory configured to store digital data and machine-readable instructions, a processor configured to process the digital data or one or more digital signals and generate an output signal by executing the machine-readable instructions, and an output interface configured to output the one or more output signals.
- the signal processing unit may include one or more digital to analog (D-to-A) converters to convert digital input baseband signals generated by the digital signal processing module to analog input baseband signals and one or more analog to digital (A-to-D) converters to convert analog output baseband signals generated by the one or more receivers to digital output baseband signals.
- D-to-A digital to analog
- A-to-D analog to digital
- a transponder of the one or more transponders 104 may comprise several components, subsystems or units including but not limited to an antenna unit.
- the antenna unit may comprise one or more antennas configured to convert one or more probing signals to one or more free space probing waves and convert one or more free space echo waves, associated with the free space probing waves, to one or more echo signals.
- the antennas of the antenna unit may be configured as multiple input multiple output (MIMO) antennas.
- MIMO multiple input multiple output
- Each antenna used in a transponder can be an RF antenna configured to convert RF signals (e.g., RF probing signals) to free space radio waves or an optical antenna configured to convert optical signals (e.g., guided optical waves) to free space light waves.
- RF signals e.g., RF probing signals
- optical signals e.g., guided optical waves
- one or more of the transponders 104 may include one or more phased array antennas each capable of directing the free space waves (radio wave or light waves) to a propagation direction.
- Each of the one or more phased array antennas may include a plurality of antennas and the propagation direction may be determined by a phase relation among the free space waves emitted by the plurality of antennas. In some cases, the phase relation and therefore the propagation direction may be determined by one or more probing signals received by the transponder.
- the one or more phased array antennas can be optical phased array antennas configured to control the propagation direction of light waves or RF phased array antennas configured to control the propagation direction of radio waves.
- one or more of the transponders 104 may include components for mixing RF carrier signals with baseband signals (up-conversion) and/or extracting basebands signals from modulated RF carrier signals.
- the transponder may include subsystems for demultiplexing one or more probing signals from a multiplexed probing signal received from the central unit and generating a multiplexed echo signal comprising one or more echo signals.
- the probing signals, multiplexed probing signals, echo signals and multiplexed echo signals can be optical signals.
- the transponder may include one or more components for electrical-to-optical and optical-to- electrical conversion.
- the transponder may include one or more photodetectors to convert optical probing signals to electronic probing signals, and one or more lasers to convert electronic echo signals to optical echo signals.
- the one or more lasers may be directly modulated while in other cases one or more optical modulators may be used to modulate optical outputs of the one or more lasers.
- one or more links 106 may comprise one or more coaxial cables configured for transmitting RF probing signals (e.g., multiplexed RF probing signals) and RF echo signals (multiplexed RF echo signals), or one or more optical fibers for transmitting optical probing signals (e.g., multiplexed optical probing signals) and optical echo signals (e.g., multiplexed optical echo signals).
- RF probing signals e.g., multiplexed RF probing signals
- RF echo signals multiplexed RF echo signals
- optical fibers for transmitting optical probing signals (e.g., multiplexed optical probing signals) and optical echo signals (e.g., multiplexed optical echo signals).
- one or more coaxial waveguides may be bundled as a single cable.
- the one or more optical fibers may be bundled as a single cable.
- some of the one or more optical fibers can be single mode optical fibers, multi-mode optical fibers or multicore optical fibers. In some cases, some of the one or more optical fibers can be polarization maintaining optical fibers or other types of specialized optical fibers (e.g., having a special cross-sectional profile, special material composition, special dispersive properties, and the like).
- the one or more links 106 may comprise a multiple input-multiple output (MIMO) link between the central unit and the one or more transponders.
- MIMO multiple input-multiple output
- the centralized object detection sensor network system may be a hybrid centralized object detection sensor network system configured to detect one or more objects and determine their location and position, using a combination of signals received from one or more transponders and one or more other sensors (e.g., image sensors, kinematic sensors, position sensors, LIDAR sensors, acoustic sensors, and the like).
- the sensor may not use a free space probing waves and a comparison between the probing wave and a corresponding echo wave to detect objects.
- FIG. 2A illustrates a hybrid centralized object detection sensor network system 200 comprising one or more transponders 204 that are communicatively connected to the central unit 200 via one or more communication links 106 and one or more sensors 205 that are communicatively connected to the central unit 200 via one or more communication links 207.
- the communication links 106 may be different type of communication links compared to the communication links 207.
- the one or more sensors 205 may generate one or more sensor signals usable for determining position, velocity or other characteristics of the one or more objects (e.g., shape, color, temperature, and the like).
- a centralized object detection sensor network system 201 may include one or more end nodes 205 configured to demultiplex one or more multiplexed probing signal received from the central unit 203 via one or more node links (primary communication links) 209 and multiplexing all echo signals received from one or more transponders (e.g., a first group of transponders 104a), via one or more secondary links 106a, so that they can be transmitted to the central unit 203 using the one or more node links 209.
- node links primary communication links
- transponders e.g., a first group of transponders 104a
- Each of the one or more end nodes 205 may be configured to distribute probing signals among transponders in a group of transponders and receive echo signals from the group of transponders.
- Number of transponders included in a group of transponders may be the same or different from the number of transponders in another group of transponders.
- the end node 205a may be connected to a group of transponders 104a comprising N1 transponders via one or more secondary links 106a
- the end node 205b may be connected to another group of transponders 104b comprising N2 transponders via one or more secondary links 106b, where N1 is not equal to N2.
- Each node link of the one or more node links 209 may include one or more of an Ethernet, RF or optical communication link.
- the use of the end nodes 205 in the centralized object detection sensor network system 201 reduces the cost, complexity, and maintenance of the system, in particular when the distance between transponders and the central unit 203 is long (e.g., in the order of one kilometer or more).
- the disclosed centralized object detection sensor network systems and the corresponding system architectures described above may provide several advantages, including, but not limited to:
- [0060] Distributed sensors and transponders. Relatively more complex, vulnerable and expensive parts of the system (e.g., transmitter, receiver, and signal processor) may be physically decoupled from the transponders and sensors and housed at a remote location (e.g., a base station). Such configuration allows distributing a large number of sensors and transponders over a large area and adjusting their position for optimal detection and sensing with greater efficiency and lower cost.
- the transponders may be in communication with the central unit by wire, waveguide, optical fibers or other types of connections. In the case of optical fibers, the distance between the transponders and central unit may span from a few centimeters to kilometers.
- Advanced raw signal processing methods, advanced and complex signal processing methods may not be implemented in sensors and transponders that may be installed large numbers in a wide area and therefore are limited by various constraints (e.g., size, cost, weight, environmental condition, and the like).
- a sensor network system may still benefit from the above mentioned signal processing methods if they are preformed by a central unit, shared among the sensors and transponders, in which complexity, cost, and environmental constrains may managed more efficiently.
- Such centralized sensor network may be implemented by capturing the original information contained in the echo signals (e.g., raw signals) at the sensors or transponders and transmitting them unaltered to the central unit.
- a centralized sensor network system may also exploit the synchronous processing of raw echo signals received from a plurality of sensors or transponders, to extract certain information about the detected objects, which may not be extracted from individually processed echo signals.
- Reduced System Complexity A centralized object detection sensor network system with shared transmitter, receiver and digital signal processing may reduce the total number of components and the overall hardware and software system complexity.
- Transponders may be configured to detect objects using both free space light waves and free space radio waves.
- the central unit and the communication links e.g., optical links
- the communication links may be shared between lidar and radar systems, thereby further reducing system complexity in applications requiring both sensing modalities (e.g., autonomous vehicles).
- Concurrent Sensing Common signal processing between lidar, radar or other sensing modalities (e.g. cameras, kinematic sensors, position sensors, acoustic sensors) may enhance detection and ranging performance. Exchanging early heuristics through a common signal processing platform may provide mutual reinforcement and validation among the different sensing modalities.
- lidar, radar or other sensing modalities e.g. cameras, kinematic sensors, position sensors, acoustic sensors
- Exchanging early heuristics through a common signal processing platform may provide mutual reinforcement and validation among the different sensing modalities.
- FIG. 3A illustrates an example centralized object detection sensor network system 300a having a central unit 301 coupled to a plurality of transponders 104 through a plurality of communication links 106, where the central unit 301 transmits one probing signal to each of the plurality of transponders 104, and receives one echo signal from each transponder via a communication link.
- the central unit 301 includes a signal processing unit 320 that generates a plurality of baseband signals 333 and transmits them to a transmitter unit 321.
- the number of baseband signals in the plurality of baseband signals may be equal to the number of transponders in the centralized object detection sensor network system 300a.
- the plurality of baseband signals can be analog or digital signals.
- the transmitter unit 321 may use the plurality of baseband signals 333 to generate a plurality of probing signals 337.
- the number of probing signals may be equal to the number of baseband signals.
- the transmitter unit 321 may be configured to upconvert the plurality of baseband signals 333 using one or more RF carrier signals or one or more IF carrier signals and amplify the resulting upconverted baseband signals to generate the plurality of probing signals 337.
- each of the baseband signals 333 may be upconverted using a different RF carrier signal or different IF carrier signal (e.g., having a different frequency).
- the transmitter unit 321 may generate the plurality of probing signals 337 only by amplifying the plurality of baseband signals 333 and/or adjusting relative phase differences associated with the plurality of baseband signals 333.
- the plurality of baseband signals 333 can be a plurality of digital signals, and the transmitter unit 321 may be configured to convert them to a plurality of analog signals (e.g., using an digital-to-analog converter) before up- converting and/or amplifying them.
- the plurality of probing signals 337 may be received by a router unit 331 that couples the plurality of the probing signals 337 to the plurality of links 106.
- Each of the plurality of links 106 may deliver a probing signal to a transponder of the plurality of the transponders 104.
- the transponder may convert the probing signal to one or more free space probing waves directed to an environment.
- the transponder may upconvert the probing signal to an RF probing signal using an RF carrier signal (e.g., generated by a local oscillator in the transponder) and use the resulting RF probing signal to generate the one or more free space probing waves.
- an RF carrier signal e.g., generated by a local oscillator in the transponder
- One or more objects in the environment may generate one or more echo waves by reflecting the one or more free space probing waves.
- the transponder may receive a portion of the one or more echo waves, generate an echo signal and transmit the echo signal to the central unit 301 via the same link from which the corresponding probing signal was received.
- the transponder may downconvert an RF echo signal received from an antenna unit, using the RF carrier signal, to generate the echo signal.
- a plurality of echo signals 339 may be transmitted from the plurality of transponders 104 to the central unit 301 via the plurality of links 106 where each link transmits the echo signal generated by one of the transponders 104.
- the router 331 may couple the plurality of the echo signals 339 received from the plurality of transponders 104 to the receiver unit 323.
- the receiver unit 323 may generate a plurality of reflected baseband signals 335 and send them to the signal processing unit 320.
- the signal processing unit 320 e.g., a digital signal processing unit
- the signal processing unit 320 may generate an object signal based at least in part on the plurality of reflected baseband signals 335.
- the object signal may be usable for determining the velocities and the positions of the one or more objects.
- the object signal may comprise one or more digital signals, and it can be an optical or an electronic signal.
- the signal processing unit 320 may use the plurality of reflected baseband signals 335 and the plurality of the baseband signals 333 to determine velocities and/or locations of the one or more objects or generate the object signal.
- the receiver unit 323 may be configured to downconvert the plurality of reflected baseband signals 335 from the plurality of echo signals 339 using the one or more RF carrier signals or one or more IF carrier signals.
- the one or more RF or IF carrier signals may be generated by one or more local oscillators in the central unit 301.
- the receiver 323 may generate the plurality of reflected baseband signals 335 only by amplifying the plurality of echo signals 339.
- the reflected baseband signals 335 can be digital signals digitized by the receiver unit 323.
- the plurality of links 106 may be optical links, and the plurality of probing signals 337 and the plurality of echo signals 339 may be optical signals (herein referred to as plurality of: optical probing signals and optical echo signals).
- transmitter unit 321 may convert the plurality of baseband signals 333 (electronic signals) to a plurality of optical baseband signals using one or more electric-to- optical (E/O) converters.
- the transmitter unit 321 may first upconvert the plurality of baseband signals using the one or more RF or IF carrier signals and convert the resulting RF or IF signals to the plurality of optical probing signals 337.
- the E/O converters may generate the plurality of optical signals by modulating amplitude or phase of one or more optical carrier signals using the plurality of baseband signals, the IF signals or the RF signals.
- the receiver unit 323 may include one or more optical-to-electrical (O/E) converters to generate the plurality of reflected baseband signals 335 using the plurality optical echo signals 339.
- the O/E converters may generate the plurality of reflected baseband signals 335 using one or more photodetectors.
- FIG. 3B illustrates a centralized object detection sensor network system 300b having a central unit 302 coupled to a plurality of transponders 104 through a plurality of communication links 106, where the central unit 302 is configured to transmit a plurality of multiplexed probing signals 342a to the plurality of transponders 104 and to receive a plurality of multiplexed echo signals 344 from the plurality of transponders 104.
- a multiplexed probing signal and a multiplexed echo signal associated with a transponder of the plurality of transponders 104 may be communicated via a single link.
- the centralized object detection sensor network system 300b can include one or more features, components or functionalities previously described with respect to the centralized object detection sensor network system 300a (FIG. 3A), the details of which may be omitted herein for brevity.
- the central unit 302 includes a signal processing unit 319 that generates a plurality of baseband signals 334a comprising a plurality of baseband groups.
- number of baseband groups may be equal to the number of transponders in the centralized object detection sensor network system 300b.
- Each of the plurality of baseband groups may comprise one or more baseband signals.
- the signal processing unit 319 transmits the plurality of the baseband signals 334a to a transmitter unit 322.
- the transmitter unit 322 may use the plurality of baseband signals 334a to generate a plurality of probing signals 338a comprising a plurality of probing signal groups associated with the plurality of baseband signal groups.
- Each of the probing signal groups 338a may be associated with a transponder of the plurality of transponders 104. Number of probing signal groups may be equal to the number of baseband groups.
- the transmitter unit 322 may be configured to upconvert the plurality of baseband signals 334a using one or more RF carrier signals or one or more IF carrier signals and amplify the resulting upconverted baseband signals to generate the plurality of probing signals 338a.
- each of the baseband signals 334a may be upconverted using a different RF carrier signal or a different IF carrier signal (e.g., having a different frequency).
- the transmitter unit 322 may generate the plurality of probing signals 338a only by amplifying amplitudes and or adjusting relative phase differences among the plurality of baseband signals 334.
- the plurality of baseband signals 334a can be a plurality of digital signals and the transmitter may be configured to convert them to a plurality of analog signals (e.g., using one or more digital-to-analog converters) before upconverting and/or amplifying them.
- the transmitter unit 322 sends the plurality of probing signals 338a, comprising the plurality of probing signal groups, to an intra-transponder multiplexer 326 unit.
- the intra-transponder multiplexer 326 generates a plurality of multiplexed probing signals 342a where each multiplexed probing signal is associated with one of the plurality of probing signal groups.
- the number of multiplexed probing signal groups maybe equal to the number of transponders in plurality of transponders 104.
- the intra-transponder multiplexer 326 may generate each multiplexed probing signal using the one or more probing signals in the corresponding probing signal group and based on a signal multiplexing method (e.g., an electronic or an optical signal multiplexing method).
- a signal multiplexing method e.g., an electronic or an optical signal multiplexing method
- a router 332 may receive the plurality of multiplexed probing signals 342a and couple them to the plurality of links 106 links where each multiplexed probing signal is transmitted to a transponder via a link.
- the transponder may include a demultiplexer unit that receives the multiplexed probing signal, generates the one or more probing signals associated with a probing signal group and use them to generate one or more free space probing waves directed to an environment.
- the transponder may upconvert the one or more probing signals to one or more RF probing signals using one or more RF carrier signals (e.g., generated by one or more ocal oscillators) and use the resulting RF probing signals to generate the one or more free space probing waves.
- One or more objects in the environment may generate one or more echo waves by reflecting the one or more probing waves.
- the transponder may receive a portion of the one or more echo waves, and generate one or more echo signals.
- the one or more echo signals may be generated by downconverting one or more RF echo signals received from an antenna unit (e.g., using one or more IF carrier signals or one or more RF carrier signals)and the one or more echo signal may comprise one or more IF echo signals or one or more reflected baseband signals.
- the transponder may include a multiplexer unit configured to generate a multiplexed echo signal using the one or more echo signals.
- the multiplexed echo signal may comprise an echo signal group. The transponder may transmit the multiplexed echo signal to the central unit 302 via the same link from which the corresponding multiplexed probing signal was received.
- a plurality of multiplexed echo signals may be transmitted from the plurality of transponders 104 to the central unit 302 via the plurality of links 106 where each link transmits the multiplexed echo signal generated by one of the transponders.
- the router 332 may couple the plurality of the multiplexed echo signals 344 received from the plurality of transponders 104 to an intra-transponder de-multiplexer unit 330 configured to generate a plurality of echo signals 340 comprising a plurality of echo signal groups associated with the plurality of probing signal groups.
- the plurality of echo signals 340 may be received by a receiver unit 324.
- the receiver unit 324 may generate a plurality of reflected baseband signals 336 and send them to the signal processing unit 319.
- the signal processing unit 319 may determine velocities and/or locations of the one or more objects based at least in part on the plurality of reflected baseband signals 336. In some examples, the signal processing unit 319 may generate an object signal based at least in part on the plurality of reflected baseband signals 336. The object signal may be usable for determining the velocities and the positions of the one or more objects. In some cases, the object signal may comprise one or more digital signals, and it can be an optical or an electronic signal. In some examples, the signal processing unit 319 may use the plurality of reflected baseband signals 336 and the plurality of the baseband signals 334a to determine velocities and/or locations of the one or more objects or generate the object signal.
- the receiver unit 324 may be configured to downconvert the plurality of reflected baseband signals 336 from the plurality of echo signals 340 using the one or more carrier signals (e.g., RF carrier signals or IF carrier signals). In some other examples, the receiver 324 may generate the plurality of reflected baseband signals 336 only by amplifying the plurality of echo signals 340 and/or adjusting relative phase differences among the plurality of reflected baseband signals.
- the carrier signals e.g., RF carrier signals or IF carrier signals.
- the plurality of links 106 may be optical links
- the plurality of the probing signals 338a, the plurality of multiplexed probing signals 342a, the plurality of echo signals 344 and the plurality of multiplexed echo signals 340 may be optical signals (herein referred to as plurality of: optical probing signals, optical multiplexed probing signals, optical echo signals and optical multiplexed echo signals) .
- transmitter unit 322 may convert the plurality of baseband signals 334a to a plurality of optical probing signals using one or more electric-to-optical (E/O) converters.
- E/O electric-to-optical
- the transmitter unit 322 may first upconvert the plurality of baseband signals using the one or more RF or IF carrier signals and convert the resulting RF or IF signals to an optical probing signals.
- the E/O converters may generate the plurality of optical probing signals by modulating amplitude or phase of one or more optical carrier signals using the baseband, IF or RF signals.
- the receiver unit 322 may include one or more optical-to-electrical (O/E) converters to generate the plurality of reflected baseband signals 336.
- the O/E converters may generate the plurality of reflected baseband signals 336 using one or more photodetectors.
- the intra-transponder multiplexer 326, the intra-transponder demultiplexer 330, the multiplexers unit in each transponder and the demultiplexer unit in each transponder may comprise optical multiplexers and optical demultiplexers, configured to multiplex and demultiplex optical signals using optical multiplexing/demultiplexing methods (e.g., wavelength division multiplexing, time division multiplexing and the like).
- the optical intra-transponder multiplexer 326 may generate a plurality of optical multiplexed probing signals 342a using the plurality of optical probing signals 338a.
- the optical intra-transponder demultiplexer 330 may generate a plurality of optical echo signals 340 using the plurality of optical multiplexed echo signals 344.
- each transponder may include one or more O/E converters to convert the plurality of optical probing signals (generated one or more optical demultiplexers) to electronic signals, and one or more O/E converters to generate the plurality of optical echo signals.
- FIG. 3C illustrates a centralized object detection sensor network system 300c having a central unit 303 coupled to a plurality of transponders 104 through a plurality of communication links 106, where the central unit 303 distributes a plurality of multiplexed probing signals 342b among the plurality of transponders 104 and receives a plurality of multiplexed echo signals 344 from the plurality of transponders 104.
- the centralized object detection sensor network system 300c can include one or more units, functionalities or previously described with respect to the centralized object detection sensor network system 300a (FIG. 3A) or 300b (FIG. 3B) described above, the details of which may be omitted herein for brevity.
- the central unit 303 includes a signal processing unit 318 that generates a plurality of baseband signals 334b and transmits them to a transmitter unit 322b.
- the transmitter unit 322b may use the plurality of baseband signals 334b to generate a plurality of probing signals 338b.
- the transmitter unit 322b may be configured to upconvert the plurality of baseband signals 334b using one or more RF or IF carrier signals and amplify the resulting one or more RF or IF signals (upconverted baseband signals) to generate the plurality of probing signals 338b.
- each baseband signal may be upconverted using a different RF or IF carrier signal (e.g., having a different frequency).
- the transmitter unit 322b may generate the plurality of probing signals 338b only by amplifying amplitudes and or adjusting relative phase differences of the plurality of baseband signals 334b.
- the plurality of baseband signals 334b can be a plurality of digital signals and the transmitter unit 323b may be configured to convert them to a plurality of analog signals before upconverting and/or amplifying them.
- the transmitter unit 322b sends the plurality of probing signals 338b to an intra-transponder multiplexer unit 326a that generates a multiplexed probing signal based on a signal multiplexing method (e.g., an electronic or an optical signal multiplexing method).
- a signal multiplexing method e.g., an electronic or an optical signal multiplexing method.
- an inter-transponder distributor 326b e.g., an electronic or optical inter-transponder distributor
- the inter-transponder distributor 326b may be an electronic or optical coupler with an input port and a plurality of output ports where portions (e.g., equal portions) of a signal received by the input port are output from each output port.
- number the plurality of output ports may equal to the number of transponders in the centralized object detection sensor network system 300c.
- a router 333 may receive the plurality of multiplexed probing signals 342b and couple them to the plurality of links 106 links where each multiplexed probing signal is transmitted to a transponder (e.g., transponder 1, transponder 2, ...or transponder N) via a link.
- the transponder may include a demultiplexer unit that receives the multiplexed probing signal, generates the plurality of probing signals 338b and uses the plurality of probing signals 338b to generate one or more free space probing waves directed to an environment.
- the transponder may upconvert the one or more probing signals using an RF carrier signal and use the resulting RF probing signal to generate the one or more free space probing waves.
- One or more objects in the environment may generate one or more echo waves by reflecting the one or more probing waves.
- the transponder may receive a portion of the one or more echo waves, and to generate one or more echo signals.
- the transponder may include a multiplexer unit configured to generate a multiplexed echo signal using the one or more echo signals.
- the transponder may transmit the multiplexed echo signal to the central unit 303 via the same link from which the corresponding multiplexed probing signal was received.
- the transponder may downconvert one or more RF echo signals received from an antenna unit, using one or more RF carriers, to generate the one or more echo signals.
- each echo signal may be comprise a reflected baseband signal or an IF carrier modulated by the reflected baseband signal
- a plurality of multiplexed echo signals may be transmitted from the plurality of transponders 104 to the central unit 303 via the plurality of links 106 where each link transmits the multiplexed echo signal generated by one of the transponders.
- the router 333 may couple the plurality of the multiplexed echo signals 344b received from the plurality of transponders 104 to an intra-transponder de-multiplexer unit 330b configured to generate a plurality of echo signals 340b comprising a plurality of echo signal groups associated with the plurality of transponders 104.
- the plurality of echo signals 340b may be received by a receiver unit 325.
- the receiver unit 325 may generate a plurality of reflected baseband signals 336b and send them to the signal processing unit 318.
- the signal processing unit 318 may determine velocities and/or locations of the one or more objects based at least in part he plurality of reflected baseband signals 336b.
- the signal processing unit 318 may generate an object signal based at least in part on the plurality of reflected baseband signals 336b.
- the object signal may be usable for determining the velocities and the positions of the one or more objects.
- the object signal may comprise one or more digital signals, and it can be an optical or an electronic signal.
- the signal processing unit 318 may use the plurality of reflected baseband signals 336b and the plurality of the baseband signals 334b to determine velocities and/or locations of the one or more objects or generate the object signal.
- the receiver unit 325 may be configured to downconvert the plurality of reflected baseband signals 336b from the plurality of echo signals 340b using the one or more RF carrier signals and/or using the one or more IF signals.
- the receiver 325 may generate the plurality of reflected baseband signals 336b only by amplifying the plurality of echo signals 340.
- the reflected baseband signals 336b can be digital signals digitized by the receiver unit 325.
- the plurality of links 106 may be optical links
- the plurality of the probing signals 338b, the plurality of multiplexed probing signals 342b, the plurality of echo signals 340b and the plurality of multiplexed echo signals 344b may be optical signals (herein referred to as plurality of: optical probing signals, optical multiplexed probing signals, optical echo signals and optical multiplexed echo signals).
- transmitter unit 323 may convert the plurality of baseband signals 334b to a plurality of optical probing signals using one or more electric-to-optical (E/O) converters.
- E/O electric-to-optical
- the transmitter unit 323 may first upconvert the plurality of baseband signals using the one or more RF or IF carrier signals and convert the resulting RF or IF signals to an optical probing signals.
- the E/O converters may generate the plurality of optical probing signals by modulating amplitude or phase of one or more optical carrier signals using the baseband, IF or RF signals.
- the receiver unit 325 may include one or more optical-to- electrical (O/E) converters to generate the plurality of reflected baseband signals 336b.
- the O/E converters may generate the plurality of reflected baseband signals 336b using one or more photodetectors.
- the intra-transponder multiplexer 326b, the intra-transponder demultiplexer 330b, the multiplexers unit in each transponder and the demultiplexer unit in each transponder may comprise optical multiplexers and optical demultiplexers, configured to multiplex and demultiplex optical signals using optical multiplexing/demultiplexing methods (e.g., wavelength division multiplexing, time division multiplexing and the like).
- the optical intra-transponder multiplexer 326b may generate a plurality of optical multiplexed probing signals 342b using the plurality of optical probing signals 338b.
- the optical intra-transponder demultiplexer 330b may generate a plurality of optical echo signals 340b using the plurality of optical multiplexed echo signals 344b. Further in these embodiments each transponder may include one or more O/E converters to convert the plurality of optical probing signals (generated one or more optical demultiplexers) to electronic signals, and one or more O/E converters to generate the plurality of optical echo signals.
- FIG. 4 illustrates a centralized object detection sensor network system 400 having a central unit 403 coupled to a plurality of end nodes through a plurality of node links 209 where each end node transmits a plurality of probing signals to each transponder and receives a plurality of echo signals from each transponder.
- the centralized object detection sensor network system 400 can include one or more features of some of the embodiments previously described with respect to the centralized object detection sensor network system 300a (FIG. 3A), 300b (FIG. 3B) and/or 300c (FIG. 3C) described above, the details of which may be omitted herein for brevity.
- the central unit 403 includes a signal processing unit 319 that generates a plurality of baseband signals 334 and transmits them to a transmitter unit 322.
- the transmitter unit 322 may use the plurality of baseband signals 334 to generate a plurality of probing signals 338.
- the transmitter unit 323 may be configured to upconvert the plurality of baseband signals 334 using one or more RF carrier signals and amplify the resulting upconverted baseband signals to generate the plurality of probing signals 338.
- each baseband signal may be upconverted using a different RF carrier signal (e.g., having a different frequency).
- the transmitter unit 322 may generate the plurality of probing signals 338 only by amplifying amplitudes and or adjusting relative phase differences of the plurality of baseband signals 334.
- the transmitter unit 322 may be configured to upconvert the plurality of baseband signals 334 using one or more IF carrier signals and amplify the resulting upconverted baseband signals to generate the plurality of probing signals 338.
- each baseband signal may be upconverted using a different IF signal (e.g., having a different frequency).
- the plurality of baseband signals 334 can be a plurality of digital signals and the transmitter may be configured to convert them to a plurality of analog- signals before up-converting and/or amplifying them.
- the transmitter unit 322 sends the plurality of probing signals 338 to an intra-transponder multiplexer unit 326 that generates a plurality of multiplexed probing signals 342.
- Each multiplexed probing signal may comprise a group of probing signals associated with one of the transponders of the plurality of transponders.
- the number of multiplexed probing signals in the plurality of multiplexed probing signals may be equal to the number of transponders in the centralized object detection sensor network system 400.
- an inter-transponder multiplexer 446a generates a plurality of node signals 454 where each node signal is a multiplexed signal comprising one or more multiplexed probing signals associated with the transponders fed by the corresponding node.
- the plurality of multiplexed probing signals 342 and the plurality of node signals 454 may be generated using optical or electronic multiplexing methods.
- a router 450 e.g., an optical router or and electronic router
- Each end node may be configured to: distribute the plurality of probing signals associated with a received node signal among a plurality of transponders, receive a plurality of echo signals from the plurality of transponders and generate an echo node signal that is transmitted back to the router 450 (in the central unit 403), for example, via the link (used to deliver the node signal to the end node).
- each end node may include, one or more of routers, an inter-transponder demultiplexer, and an inter-transponder multiplexer.
- a first end node 405a may receive a first node signal from a first node link 209a and distribute it among a first plurality of transponders 404 (for example N transponders).
- the first node signal may be received by the router 452 that couples the end node signal 454a to the inter-transponder demultiplexer 448b.
- the inter-transponder demultiplexer 448b generates a plurality of multiplexed probing signals 342a and sends them to the router 332 that transmits to the first plurality of transponders 404 via a first plurality of links 406.
- the first plurality of transponders 404 may generate a first plurality of multiplexed echo signals and transmit them to the first end node 405a via the first plurality of links 406 (e.g., based on the process described with respect to FIG. 3B or FIG. 3C).
- the router 332 may couple the plurality of the multiplexed echo signals 344 received from the plurality of transponders 404 to the inter- transponder multiplexer 446b that generates an echo node signal 455a (by multiplexing multiplexed echo signals received from the plurality of transponders 404).
- the router 452 couples the echo node signal 455a to the first node link 209a.
- a plurality of echo node signals 456 may be received by the router 450 that couples them to the inter-transponder demultiplexer 448a.
- the inter-transponder demultiplexer 448a generates a plurality of multiplexed echo signals 344 and send them to the intra-transponder demultiplexer 330.
- the intra-transponder demultiplexer 330 generates a plurality of echo signals 340.
- the plurality of echo signals 340 may be received by a receiver unit 324 that generates a plurality of reflected baseband signals 336 and sends them to the signal processing unit 319.
- the signal processing unit 319 may use the plurality of reflected baseband signals 336 to determine velocities and/or locations of the one or more objects. In some embodiments, the signal processing unit 319 may generate one or more object signals usable for determining velocities and locations of the one or more objects.
- the receiver unit 324 may be configured to downconvert the plurality of reflected baseband signals 336 from the plurality of echo signals 340 using the one or more RF carrier signals and/or using one or more IF signals.
- the receiver unit 324 may generate the plurality of reflected baseband signals 336 only by amplifying the plurality of echo signals 340.
- the reflected baseband signals 336 can be digital signals digitized by the receiver unit 324.
- the plurality of links node links 209 and links 406 may be optical links
- the plurality of the probing signals 338, the plurality of multiplexed probing signals 342, the plurality of node signals 454, the plurality of echo node signals 456, the plurality of echo signals 340 and the plurality of multiplexed echo signals 344 may be optical signals.
- transmitter unit 324 may convert the plurality of baseband signals 334 to a plurality of optical baseband signals or to a plurality of optical upconverted baseband signals (e.g., by modulating amplitude or phase of one or more optical carriers signals using the baseband signals or the upconverted baseband signals).
- Upconverted baseband signals can be baseband signals upconverted using an RF carrier or an IF signal. Further, the receiver unit 324 may convert the plurality optical echo signals 340 to the plurality of reflected baseband signals 336.
- the intra-transponder multiplexer 326, the inter-transponder multiplexer 446a, the inter-transponder demultiplexer 448b, the inter-transponder multiplexer 446b can be optical multiplexers and optical demultiplexer units that function based on optical multiplexing and demultiplexing methods (e.g., wavelength division multiplexing, time division multiplexing and the like).
- FIG. 5 illustrates an example transponder 504 of a centralized object detection sensor network system configured to receive/transmit probing/echo signals from/to a central unit of the centralized object detection sensor system.
- the transponder 504 may be, e.g., a radar transponder configured: to receive on or more probing signals or a multiplexed probing signal, convert them to free space probing waves, receive free space echo waves and convert them to a multiplexed echo signal or one or more echo signals.
- the transponder 504 may comprise a router 550 configured to couple a multiplexed probing signal 570 from a link 506 to an intra-transponder multiplexer unit 552 that generates a plurality of probing signals 572.
- the router 550 can be and electronic router configured for coupling electronic signals from a link to a device or an optical router configured for coupling optical signals from a link to a device.
- the multiplexed probing signal 570 and the plurality of probing signals 572 may be optical signals
- the intra transponder multiplexer unit 552 may be an optical demultiplexer.
- an optical-to-electrical (O/E) converter 554 may convert the plurality of optical probing signals to a plurality of electronic probing signals 574.
- the plurality of probing signals 572 may be electronic probing signals in which case they may be directly transmitted to an upconverter unit 556 or an antenna unit 558 as RF probing signals 576.
- the transponder 504 may not include the O/E converter 554.
- the electronic probing signals 574, or electronic probing signals 572 can be baseband signals (e.g., generated by a central unit), up-converted basedband signals (up converted to intermediate frequencies (IFs) or radio frequencies (RFs)).
- the up-converter unit 556 may upconvert them using on or more RF carriers to generate one or more RF probing signals 576.
- the optical probing signals 572 may comprise one or more optical carriers whose amplitude or phase are modulated by baseband signals, up-converted basedband signals (up converted to intermediate frequencies (IFs) or radio frequencies (RFs)).
- the antenna unit 558 may comprise one or more antennas configured to convert one or more RF probing signals to free space probing waves and receive one or more free space echo waves and convert them to echo RF echo signals 578.
- a downconverter unit 560 may then downconvert the one or more echo RF echo signals 578 to IF signals (one or more IF carriers modulated by baseband signals) or baseband signals to generate one or more echo signals 580.
- the one or more echo signals 580 may be directly transmitted to an intra- transponder multiplexer unit 564 (e.g., an electronic multiplexer unit).
- the intra-transponder multiplexer unit 564 may use the one or more echo signals 582 to generate a multiplexed echo signal 584 (an electronic multiplexed signal).
- an electrical-to-optical (E/O) converter 562 may convert the one or more echo signals 580 (e.g., electronic echo signals) to one or more optical echo signals 582 and send them to the intra- transponder multiplexer unit 564 (e.g., an optical multiplexer unit).
- the intra-transponder multiplexer unit 564 may use the one or more optical echo signals 582 to generate a multiplexed echo signal 584 (an optical multiplexed signal).
- the router 550 may then couple the multiplexed echo signal 584 to the link 506.
- a probing signal received by the transponder may not be a multiplexed probing signal.
- the transponder 504 may not include the intra-transponder demultiplexer 552 and the intra-transponder multiplexer 564.
- the plurality of probing signals 572 (electronic or optical) may be received directly from the router 550 and the plurality of echo signals (electronic or optical) may be transmitted directly to the router 550.
- transponder 504 may not have an optical-to-electrical converter 554 or an electrical-to-optical converter 562.
- the transponder 504 may further comprise one or more analog-to-digital (A-to-D) and one or more digital-to-analog (D-to-A) converters.
- A-to-D analog-to-digital
- D-to-A digital-to-analog converters
- the one or more D-to-A converters may be used to convert one or more digital probing signals received from the central unit to one or more analog signals
- one or more A-to-D converts may be used to convert the one or more echo signals 582 or the multiplexed echo signal 584 generated by the transponder 504 to digital signals before transmitting them to the central unit.
- the transponder 504 may further comprise one or more signal processing units (e.g., digital signal processing units) configured to transform one or more echo signals 580 generated by the transponder 504 to one or more compressed echo signals before multiplexing them or transmitting them to the central unit.
- signal processing units e.g., digital signal processing units
- an information content of the one or more compressed echo signals may be identical to the one or more echo signals but the one or more compressed echo signals may require less bandwidth to be transmitted to the central unit.
- the information content may pertain information usable by the central unit to generate an object signal ort determine velocities and/or positions of one or more objects.
- the one or more signal processing units may be configured to transform the one or more echo signals 580 to one or more pre-processed echo signals where the one or more pre-processed echo signals may be used by the central processing unit to generate an object signal or determine the position and/or velocities of one or more objects.
- generating an object signal or determining the position and/or velocities of one or more objects using one or more pre-processed echo signals may reduce an amount of processing or an amount of computational resources used by the central unit.
- FIG. 6A illustrates an example implementation of the centralized object detection sensor network system 300a described above.
- the centralized object detection sensor network system 600a may comprise a central unit 601a coupled to a plurality transponders through a plurality of optical links where optical probing signals and optical echo signals are transmitted using separate links and the links are optical communication links
- the central unit 601a includes a signal processing unit 620 that generates a plurality of baseband signals (electronic signals) and transmits them to a transmitter unit 621.
- the plurality of baseband signals may be digital electronic signals.
- the transmitter unit 621 may use the plurality of baseband signals to generate a plurality of probing signals that comprise a plurality of analog baseband signals.
- the plurality of probing signals may be transmitted to an optoelectronic unit 631a that comprises a plurality of electrical-to-optical and optical-to-electrical converters.
- the optoelectronic unit 631 may convert the plurality of probing signals (electronic probing signals) to a plurality of optical probing signals.
- an electrical-to-optical converter may comprise a directly modulated or an externally modulated laser.
- an optical-to-electrical converter may comprise a photoreceiver (e.g., an amplified photodetector).
- Each optical probing signal may be transmitted to a transponder via an optical link (e.g., a Tx optical link).
- the transponder may generate a corresponding optical echo signal and transmit it back to the optoelectronic unit 631a via another optical link (e.g., an Rx optical link).
- a first optical probing signal may be generated by directly modulating a laser 654a in the optoelectronic unit 631a.
- the first optical probing signal may be transmitted to a photoreceiver 662a in a first transponder 604 via a first optical link 606a.
- the photoreceiver 662a may convert the first optical probing signal to an electronic probing signal (an electronic baseband signal).
- a first RF mixer 680a may generate an RF probing signal by upconverting the probing signal using a local oscillator (LO) 684 that generates the corresponding RF carrier signal.
- LO local oscillator
- a first RF filter 682a may be used to eliminate the spurious spectral components of the RF probing signal that may be generated during the upconversion process by the mixer 680a.
- the resulting RF probing signal may be delivered to a first antenna unit 658a configured to convert the RF probing signal to a free space probing wave.
- the corresponding free space echo wave may be received by another antenna 658b unit that converts the free space echo wave to an RF echo signal (reflected by one or more objects).
- the RF echo signal may be filtered using a second RF filter 682b and down converted by a second RF mixer 680b (fed by LO 684) to generate a first echo signal (electronic signal) corresponding the first probing signal.
- a direct or external modulation of a laser 654b in the first transponder 604 may convert the first echo signal to a first optical echo signal.
- the first optical echo signal may be transmitted to the central unit 601a via a second optical link 606b.
- a photoreceiver 662a may convert the first optical echo signal to an analog reflected baseband signal and send it to a receiver unit 623.
- the receiver unit may convert the analog reflected baseband signal to a digital reflected baseband signal that can be processed by the signal processing unit 620.
- the signal processing unit may determined the velocities and positions of one or more objects and generate an object signal based at least in part on the digital reflected baseband signal.
- FIG. 6B illustrates an alternative implementation of the centralized object detection sensor network system 600a described above with respect to FIG. 6A and may comprise one or more features, components and functionalities described with respect to the centralized object detection sensor network system 600a.
- the centralized object detection sensor network system 600b shown in FIG. 6B, may comprise a central unit 601b coupled to a plurality transponders through a plurality of links where the probing signals and the echo signals are transmitted using separate links, which are optical communication links.
- the generation of probing signals and processing of the echo signals in the central unit 601b of the system 600b can be similar to those described above with respect to the central unit 601a of the system 600a (FIG. 6A).
- the optoelectronic unit 631b of the system 600b may include an optical circulator (e.g., optical circulator 686a) for each of pairs of lasers and photoreceivers.
- the optical circulator 686a may be configured to couple a first optical probing signal generated by a first laser 654a to an optical link 606c, and couple the corresponding optical echo signal from the same optical link 606c to a first photoreceiver 662a.
- each transponder of the centralized object detection sensor network system 600b may include an optical circulator.
- a first transponder 607 may include an optical circulator 686b configured to couple the first optical probing signal received from the optical link 606c to a photoreceiver 662b (in the first transponder 607) and couple the corresponding optical echo signal, generated by a laser 654a, to the same optical link 606c.
- FIG. 6C illustrates an example implementation of the centralized object detection sensor network system 300b described above.
- the centralized object detection sensor network system 600c can include one or more features of the embodiments previously described with respect to the centralized object detection sensor network systems 300b (FIG. 3B), 300c (FIG. 3C), 600a (FIG. 6A) and 600b (FIG. 6B) described above, the details of which may be omitted herein for brevity.
- the centralized object detection sensor network system 600c may comprise a central unit 609 coupled to a plurality transponders through a plurality of links where each link is an optical communication link.
- central unit 609 includes a signal processing unit 623 that generates a plurality of baseband signals (digital or analog) comprising of a plurality baseband signal groups where each baseband signal group is generated for a transponder of the object detection sensor network system 600c.
- the optical transceiver unit 690 may be configured to receive and convert the plurality of baseband signals to a plurality of multiplexed optical probing signals where each multiplexed optical probing signal comprises a group of baseband signals generated for a transponder.
- the plurality of the multiplexed optical probing signals may be transmitted via a plurality of optical links to a plurality of the transponders where each optical link is connected to one transponder.
- a first optical link may deliver a first multiplexed optical signal to a first transponder 611.
- Each transponder e.g., the first transponder 611) may include an optical transceiver unit (e.g., optical transceiver unit 692) that receives a multiplexed optical probing signal, comprising a group of baseband signals associated with the transponder (e.g., transponder 611), and generates a plurality of electronic probing signals.
- the plurality of electronic probing signals may be IF signals or baseband signals.
- the plurality of electronic probing signals may be upconverted to a plurality of RF probing signal using a mixer 680a, an LO and a filter 682a.
- An antenna unit of the transponder e.g., antenna unit 658a
- the plurality of RF echo signals may be downconverted to a plurality or electronic echo signals (e.g., each using a filter 682b, an LO, and a mixer 680b) and sent to the optical transceiver 692.
- the optical transceiver 692 may use the plurality of electronic echo signals to generate a multiplexed optical echo signal and transmit it to the central unit 609 via the same optical link from which the multiplexed probing signal is received.
- the RF echo signals may be generated by a separate antenna unit (e.g., antenna unit 658b).
- the optical transceiver unit 690 receives a plurality of multiplexed optical echo signals (each from a transponder) and generates a plurality of a reflected baseband signals (electronic signals).
- the plurality of reflected baseband signals may comprise a one or more echo signal groups where each echo signal group corresponds to a multiplexed optical echo signal received from a transponder.
- the optical transceiver unit 690 transmits the plurality of reflected baseband signals (digital or analog signals) to signal processing unit 623 where they are used to extract information pertaining the position and/or velocity of one or more objects in an environment monitored by the centralized object detection sensor network system 600c.
- the optical transceiver unit 690 or 692 may include: one or more of lasers, photoreceivers, optical multiplexers and optical demultiplexers. In some embodiments, the optical transceiver unit 690 may also include a plurality of digital to analog converters.
- FIG. 7 illustrates an example implementation of the central unit 303 used in the centralized object detection sensor network system 300c described above with respect to FIG. 3C.
- the central unit 703 can include one or more features of the embodiments previously described with respect to the central units 302 (FIG. 3B) and 303 (FIG. 3C) described above.
- the central unit 703 includes a signal processing unit 719 that generates a plurality of digital baseband signals 734 and sends them to a transmitter unit 723.
- the transmitter unit 723 may convert the plurality of digital baseband signals 734 to a plurality of analog baseband signals (analog electronic signals) and subsequently convert them to a plurality of analog optical signals.
- three digital baseband signals are received by a digital-to-analog converter 723a in the transmitter unit 723.
- the digital-to-analog converter 723 converts these signals to three analog baseband signals and feeds them to three lasers 723b having three different wavelengths (li, , and lb).
- Each analog baseband signal may directly modulate a laser (e.g., an amplitude or phase of the laser output) and generate three optical probing signals 738 each having a different optical wavelength.
- Each optical probing signal may comprise an optical signal whose phase or amplitude is modulates by one of the analog baseband signals generated by the digital-to- analog converter 723a.
- the optical probing signals 738 may be transmitted to an optical multiplexer 726a (intra- transponder multiplexer) that combines them as one multiplexed optical signal 741.
- An optical splitter may receive the optical probing signal and generate a plurality of secondary multiplexed optical probing signals 742 where each secondary optical probing signal is a copy of the multiplexed optical signal received by the coupler 726b.
- the number of secondary multiplexed optical probing signals may equal to the number of transponders fed by the central unit 702.
- the plurality of secondary multiplexed optical probing signals 742 are transmitted to a router unit 732 where each secondary multiplexed optical probing signal is received by a plurality of circulators and are coupled to the links 106 (optical links) that are connected to the transponders 104 fed by the central unit 702.
- a first secondary multiplexed optical probing signal may be coupled to a first transponder by the circulator 786 to a first link.
- the first transponder may be a transponder in the centralized object detection sensor network system 300c.
- the first transponder may include one or more of the embodiments previously described with respect to the transponder 504 described above with respect to FIG. 5.
- the first transponder may receive the first secondary multiplexed optical probing signal and generate three echo signals (electronic signals) each corresponding to one of the analog baseband signals generated by the digital-to-analog converter 723.
- each echo signal may comprise a reflected baseband signal carried by an intermediate frequency (IF) carrier (e.g., amplitude or phase of the IF carrier may be modulated by the echo signal).
- IF intermediate frequency
- the frequency of the IF carrier may be different for each echo signal, for example, three IF carriers having frequencies IF1, IF2 and IF3), and each may be modulated by one of the three reflected baseband signal.
- the first transponder may convert the echo signals to optical echo signals (e.g., using the E/O converter 562 (FIG. 5)) and multiplex them as a single multiplexed optical echo signal (e.g., using the intra-transponder multiplexer 564 and based on wavelength multiplexing).
- the first multiplexed optical echo signal may be generated using the wavelengths used for generating the corresponding multiplexed optical signal 741 by the transmitter unit 723.
- the first multiplexed optical echo signal is then transmitted to the central unit 702 via the first optical link.
- the circulator 786 couples the first multiplexed optical echo signal to a receiver unit 725 of the central unit 702.
- the central unit 702 may not include an intra-transponder demultiplexer unit (unlike the central unit 303 (FIG. 3C)).
- the receiver unit 725 may include a plurality of photoreceivers 725b each configured to receive a multiplexed optical echo signal from the router 732 and convert it to a plurality of reflected baseband signals (electronic signals).
- the photoreceiver may first convert the multiplexed optical echo signal to a multiplexed electronic echo signal.
- the multiplexed electronic signal may comprise a plurality of IF carriers each modulated by one of the plurality of reflected baseband signals.
- the photoreceiver may further include electronic components and circuitry to generate the plurality of reflected baseband signals (individual signals) using the multiplexed electronic signal.
- a first photoreceiver may receive the first multiplexed optical echo signal and generate three reflected baseband signals (electronic signals) corresponding to the three baseband signals used to generate the three optical probing signals 738.
- the photoreceiver may comprise a first photodetector, an electronic frequency demultiplexer, and three down-converters.
- the photodetector is configured to convert the first multiplexed optical echo signal to a multiplexed electronic signal comprising three IF carriers, IF1, IF2, and IF3 each modulated (e.g., amplitude of phase modulated) by one of the three reflected baseband signals.
- the electronic demultiplexer may be configured to generate three IF signals each comprising one of the IF carriers modulated by one of the reflected basebands. Subsequently, the three down-converters each generate one reflected baseband signal (e.g., by mixing the IF signal with the corresponding IF carrier).
- the centralized sensor network systems described above can be different embodiments of a centralized sensor network system for detecting object using radio waves.
- the free space probing waves and free space echo waves discussed above may comprise radio waves having frequencies between 1 MHz to 100 GHz.
- some of the features, devices, links, units, components, methods and processes described with respect to sensor network systems 300a (FIG. 3 A) and 300b (FIG. 3B) may be used to detecting objects using light waves.
- FIG. 8 illustrates another example of a centralized sensor network system 800.
- the illustrated system integrates lidar and radar sensing subsystems in a centralized system where certain units are shared between the two subsystems.
- the illustrated centralized lidar-radar sensing system allows multi-modal (e.g., based on optical and radio frequency waves) detection and ranging using one central unit 808 and a plurality of hybrid transponders (e.g., lidar-radar transponders configured to generate and detect both light wave and radio waves).
- the centralized object detection sensor network system 800 can include one or more features of embodiments previously described with respect to various centralized object detection sensor network systems described above, the details of which may not be repeated herein for brevity.
- the illustrated centralized sensor network system 800 uses a single central unit 808 connected to a one or more lidar-radar transponders 804 through a plurality of communication links 806 (herein referred to as link).
- the central unit 808 may be configured to generate and process probing signals configured for detection of objects based on free space light waves, herein referred to as lidar probing signals, and probing signals configured for detection of objects based on radio waves, herein referred to as radar probing signals.
- a portion of the links can be optical communication links and the rest can be electronic or RF communication links.
- Each lidar-radar transponder may be connected to the central unit 808 via one or more links.
- the links connecting a lidar-radar transponder to the central unit may comprise both RF/electronic and optical communication links.
- the central unit 808 transmits one or more radar probing signals and one or more lidar probing signals to each lidar-radar transponder and receives a one or more radar echo signals and one or more lidar echo signals from each lidar-radar transponder.
- the lidar or radar probing signals and the lidar or radar echo signals associated with a lidar-radar transponder may be transmitted and received via a single link.
- each lidar-radar transponder may be connected to the central unit 800 via a single link used for transmitting all probing signals and echo signals associated the lidar-radar transponder.
- the central unit 808 includes a signal processing unit 819 comprising a signal processing unit 808 (shared between lidar and radar subsystems), a radar central unit 808a, a lidar central unit 808b and a router unit 832.
- the signal processing unit 819 generates a plurality of radar baseband signals 834a and a plurality of lidar baseband signals 834b.
- the plurality of radar baseband signals 834a may be transmitted to a radar central unit 808a and the plurality of the plurality of lidar baseband signals 834b may be transmitted to a lidar central unit 808b.
- the plurality of the radar baseband signals may comprise the plurality of baseband signals described above.
- the router unit 832 is configured to couple the radar or lidar probing signals from the radar central unit 808a or lidar central unit 808b to the plurality of links 806, and couple the radar or lidar echo signals the one or more lidar-radar transponders 804 received from the plurality of links 806, to the radar central unit 808a or the lidar central unit 808b.
- the router may include one or more optical or RF/electronic routers.
- the radar central unit 808a may be configured to use the plurality of the radar baseband signals to generate one or more radar probing signals 842a and transmit them or the router unit 832.
- the radar central unit 808a may comprise one or more units included in the central unit 302 (FIG. 3B) or the central unit 303 (FIG. 3C).
- one or more radar probing signals may comprise one or more multiplexed radar probing signals (e.g., each comprising a plurality of radar probing signals multiplexed as one signal).
- the router 832 couples the radar probing signals associated with a lidar-radar transponder through a link connected to the lidar-radar transponder, for example, a first link 806a connected to a first lidar-radar transponder 804a of the plurality of lidar-radar transponders shown in centralized sensor network system 800.
- the link 806a may be a bidirectional link.
- the link 805a may comprise two or more links (e.g., one or more links for communicating radar signals and one or more links for communicating lidar signals).
- the transponder 804 may comprise a router unit 895, a radar transponder 804a, and a lidar transponder 804b.
- the router 895 couples the radar probing signals received from the link 806a to the radar transponder 804a and couples back one or more radar echo signals generated by the radar transponder 804a to the link 806a.
- the radar transponder may convert the one or more radar probing signals to one or more free space radar probing waves, direct them to an environment and convert one or more free space radar echo waves to one or more radar echo signals.
- the free space radar echo waves may be reflections of one or more free space radar probing waves by one or more objects in an environment probed by the transponder 804a.
- the one or more radar echo signals may comprise one or more multiplexed radar echo signals.
- the router 832 may couple the radar echo signals 844a received from the link 806a to the radar central unit 808a.
- the radar central unit 808a may use the radar echo signal 844a to generate one or more reflected baseband signals 836a and send them to the signal processing unit 819.
- the signal processing unit 819 may use the one or more baseband signals 834a and the one or more reflected basedband signals 836a to determine positions and/or velocities of the one or more objects.
- the signal processing unit 819 may use the one or more baseband signals 834a and the one or more reflected basedband signals 836a to generate one or more radar object signals usable for determining velocities and locations of the one or more objects.
- the lidar central unit 808b may be configured to use the plurality of the lidar baseband signals to generate one or more lidar probing signals 842b and transmit them or the router unit 832.
- the lidar central unit 808b may comprise one or more units included in the central unit 302 (FIG. 3B) or central unit 303 (FIG. 3C).
- one or more lidar probing signals may comprise one or more multiplexed lidar probing signals (e.g., each comprising a plurality of lidar probing signals multiplexed as one signal).
- the router 832 couples the lidar probing signals associated with a lidar-radar transponder through a link connected to the lidar-radar transponder, for example, a first link 806a connected to a first lidar-radar transponder 804a of the plurality of lidar-radar transponders shown in centralized sensor network system 800.
- the link 806a may be a bidirectional link.
- the link 805a may comprise two or more links (e.g., one or more links for communicating radar signals and one or more links for communicating lidar signals).
- the router 895 in the first lidar-radar transponder 804b couples the lidar probing signals received from the link 806a to the lidar transponder 804b and couples back one or more lidar echo signals generated by the lidar transponder 804b to the link 806a.
- the lidar transponder 804b may convert the one or more lidar probing signals to one or more free space lidar probing waves (light waves), direct them to an environment and convert one or more free space lidar echo waves (reflected light waves) to one or more lidar echo signals.
- the free space lidar echo waves may be reflections of one or more free space lidar probing waves by one or more objects in the environment probed by the transponder 804b.
- the one or more lidar echo signals may comprise one or more multiplexed radar echo signals.
- the router 832 may couple the lidar echo signals 844b received from the link 806a to the lidar central unit 808b.
- the lidar central unit 808b may use the lidar echo signal 844b to generate one or more reflected lidar baseband signals 836b and send them to the signal processing unit 819.
- the signal processing unit 819 may use the one or more lidar baseband signals 834b and the one or more reflected lidar basedband signals 836b to determine positions and/or velocities of the one or more objects.
- the signal processing unit 819 may use the one or more lidar baseband signals 834b and the one or more reflected lidar basedband signals 836b to generate one or more lidar object signals usable for determining velocities and locations of the one or more objects.
- the central unit 819 may use a combination of the radar baseband signals, the reflected radar baseband signals, the lidar baseband signals and the reflected lidar baseband signals to determine positions and/or velocities of the one or more objects or to generate one or more hybrid object signals usable for determining velocities and locations of the one or more objects.
- the positions and/or velocities of the one or more objects can be determined with higher resolution and more accuracy.
- hybrid object signals may be used to extract certain information related to the one or more objects or the environment that may not be extractable from radar object signals or lidar object signals separately.
- the central unit may determine the velocities and the positions of one or more objects based at least in part on one or more reflected baseband signals generated using one or more echo signals received from the one or more transponders. In some cases, the central unit may determine the velocities and the positions of the one or more objects based at least in part on one or more reflected baseband signals generated using one or more echo signals received from the one or more transponders and one or more base band signals associated with the reflected baseband signals.
- the central unit may determine the velocities and/or the positions of the one or more objects based at least in part on one or more reflected baseband signals generated using one or more echo signals received from the one or more transponders and one or more parameter values associated with one or more signal generators that generate the one or more baseband signals associated with the reflected baseband signals.
- the central unit may determine the velocities of the one or more objects with respect to a reference frame.
- the reference frame may be a rest frame of the transponders used to detect the objects (e.g., by sending probing signals and receiving echo signals).
- the rest frame of the transponders may a reference frame in which the coordinate of the transponders do not change over time.
- a central unit of a centralized sensor network system may generate an object signal based at least in part on one or more reflected baseband signals generated using the one or more echo signals received from the plurality of transponders of the centralized sensor network system.
- FIG. 9 illustrates an example centralized sensor network systems with a central unit 902 that generates an object signal 905.
- the central unit 902 may transmit the object signal 907 to an external processing system 908.
- the external processing system 908 may use the object signal 905 to determine the velocities and/or positions of the one or more objects detected by the centralized sensor network system 900. The velocities and/or positions may be determined with respect to the one or more transponders used to detect the one or more objects.
- the external processing system 908 may include one or more memories, one or more processors.
- the one or more processors may be configured to determine the velocities and the positions of the one or more objects by executing machine readable instructions stored in the one or more memories.
- the external processing system may transmit determined velocities and/or positions of the one or more objects to a user interface 910 or a digital interface 912.
- the user interface 910 may be configured to display the determined velocities and the positions along with other information related to the detection of the one or more objects (e.g., location of the transponders, uncertainties associated with the determination process, information about probing signals and free space probing wave used to detect the one or more objects and the like).
- the digital interface 912 may be configured to transmit the determined velocities and/or positions and other information related to the detection of the one or more objects, to one or more electronic devices (e.g., the electronic devices: of an automobile, an airplane, a factory, a user, and the like).
- the electronic devices e.g., the electronic devices: of an automobile, an airplane, a factory, a user, and the like.
- the object signal may carry data (e.g., raw data) extracted from one or more reflected baseband signals by a signal processing unit of the central unit.
- the extracted data may be raw data, compressed raw data or processed raw data (e.g., processed by the signal processing unit of the central unit).
- compressed raw data may comprise the information usable for determining velocities or positions of one or more detected objects but may be smaller compared to raw data and require less bandwidth to be transmitted to the processing system 908 within a given time interval.
- the processed raw data comprises the same information as raw data and can be used to determine the velocities and/or positions of the one or more object detected by the centralized sensor network systems.
- the external processing system 908 may need less computational power or resources to determine the velocities and/or positions of the one or more objects using an object signal comprising processed raw data as compared to using an object signal comprising raw data or compressed raw data.
- the object signal may additionally carry data associated with the baseband signals used to generate the reflected baseband signals.
- the object signal may carry data associated with algorithms, signal generators and/or parameter values used by the signal processing unit of the central unit to generate the one or more baseband signals.
- the object signal may be a multiplexed signal generated by a plurality of signals each usable for determining the velocity or positions of one object of the plurality of objects detected by the centralized sensor network system.
- one or more of the centralized sensor network systems described above can be used to monitor the position and/or the velocities of one or more objects in an environment surrounding an automobile.
- FIG. 10 shows a centralized sensor network system (e.g., centralized sensor network system 100, 200, 300b or 800) used for such application.
- the centralized sensor network system a central unit 1002 is communicatively connected to 8 transponders 1004a- 1004h installed at different sites on the automobile, with minimum impact on the vehicle’s external envelope.
- one or more of the transponders 1004a- 1004h may be replaced by a sensor (e.g., camera, acoustic sensor, and the like).
- one or more of the centralized sensor network systems described above can be used to monitor the position and/or the velocities of one or more objects in an environment surrounding an aircraft.
- a plurality of transponders may be attached to various positions on the aircraft body and enable detecting objects at any arbitrary direction.
- the one or more centralized sensor network systems may comprise, for example, the centralized sensor network system 100, 200, 300b or 800 described above.
- one or more of the centralized sensor network systems described above can be used to monitor an environment, for example, an open (or outdoor) field.
- the open field can be an airport, a parking lot, a stadium, a city street intersection, an animal farm, a wind turbine field, a sea coastal area.
- the one or more centralized sensor network systems may comprise, for example, the centralized sensor network system 100, 200, 300b or 800 described above.
- one or more of the centralized sensor network systems described above can be used to monitor an indoor environment room, a factory floor, a factory assembly line or conveyor belts, or a warehouse.
- the one or more centralized sensor network systems may comprise, for example, the centralized sensor network system 100, 200, 201, 300b or 800 described above.
- a centralized object detection sensor network system for detecting one or more objects in an environment, comprising: a central unit configured to: generate one or more baseband signals, generate one or more probing signals using the one or more baseband signals and transmit the one or more probing signals to one or more transponders, receive one or more echo signals from the one or more transponders, and detect the one or more objects the using one or more baseband signals and the one or more echo signals, wherein the one or more transponders are physically separate from the central unit while being communicatively coupled thereto through one or more communication links, and wherein the one or more transponders are configured to: receive the one or more probing signals from the central unit through the one or more communication links, generate one or more radio frequency (RF) probing signals using the one or more probing signals and an RF carrier signal, convert the one or more RF probing signals into free space probing waves, direct the free space probing waves to the environment for detecting the one or more objects, receive one or more free space echo waves from the one or more objects, and generate the
- the sensor network system comprises a plurality of transponders coupled to the central unit and wherein the central unit serves as a common central unit for detecting the one or more objects based on the one or more echo signals generated by the plurality of transponders.
- the one or more modalities include one or more of radar sensing, lidar sensing, imaging, kinematic sensing and position sensing.
- detecting the one of more objects comprises determining distances between the one or more transponders and the one or more objects.
- detecting the one of more objects comprises determining velocities of the one or more objects with respect to the one or more transponders.
- the central unit comprises: a signal processing unit configured to generate the one or more baseband signals; a transmitter coupled to the signal processing unit and configured to receive the one or more baseband signals from the signal processing unit to generate the one or more probing signals; and a receiver coupled to the signal processing unit and configured to receive the one or more echo signals to generate one or more reflected baseband signals and feed the one or more reflected baseband signals to the signal processing unit.
- the central unit comprises a router configured to couple the one or more probing signals to the one or more communication links, and to couple the one or more echo signals, received from the one or more communication links, to the receiver.
- the one or more transponders generate the one or more echo signals by downconverting one or more RF echo signals.
- the one or more probing signals comprise one or more intermediate frequency (IF) signals comprising intermediate frequency carriers modulated by baseband signals
- the one or more echo signals comprise one or more intermediate frequency (IF) signals comprising intermediate frequency carriers modulated by reflect baseband signals.
- the one or more probing signals comprise a baseband signal and the one or more echo signals comprise one or more IF signals comprising intermediate frequency carriers modulated by one or more baseband signals.
- the central unit comprises one or more electrical-to-optical converters configured to convert electrical probing signals to one or more optical probing signals and one or more electrical-to-optical converters configured to convert one or more optical echo signals to electrical echo signals.
- At least one of the one or more transponders comprises: one or more electrical-to-optical converters configured to convert electrical probing signals to the one or more optical probing signals, and one or more electrical-to-optical converters configured to convert the one or more optical echo signals to electrical echo signals.
- At least one transponder comprises an antenna unit, wherein the antenna unit comprises one or more RF antennas or optical antennas.
- the antenna unit comprises at least one optical antenna configured to generate and/or receive light waves.
- the central unit comprises a radar central unit configured for detecting the one or more objects by radar sensing and a lidar central unit configured for detecting the one or more objects by lidar sensing.
- the radar central unit and the lidar central unit share one or more of a common signal procession unit, a common router, and common links between the central unit and the one or more transponders.
- the central unit is configured to use the one or more probing signals and one or more echo signals to generate an object signal usable for determining distances between the one or more transponders and the one or more objects, and/or for determining velocities of the one or more objects with respect to the one or more transponders.
- a centralized object detection sensor network system for detecting one or more objects in an environment, comprising: a central unit configured to: generate one or more baseband signals, generate one or more probing signals using the one or more baseband signals and transmit the one or more probing signals to one or more transponders, receive one or more echo signals from the one or more transponders, and detect the one or more objects the using the one or more baseband signals and the one or more echo signals, wherein the one or more transponders are physically separate from the central unit while being communicatively coupled thereto through one or more communication links, and wherein the one or more transponders are configured to: receive the one or more probing signals from the central unit through the one or more communication links and generate free space probing waves therefrom, direct the free space probing waves to the environment for detecting the one or more objects, receive one or more free space echo waves from the one or more objects, and generate the one or more echo signals using the free space echo waves and transmit the one or more echo signals to the central unit through the one or more communication links.
- the central unit comprises: a signal processing unit configured to generate the one or more baseband signals; a transmitter coupled to the signal processing unit and configured to receive the one or more baseband signals from the signal processing unit to generate the one or more probing signals; and a receiver coupled to the signal processing unit and configured to receive the one or more echo signals to generate one or more reflected baseband signals and feed the one or more reflected baseband signals to the signal processing unit.
- the central unit comprises a router configured to couple the one or more probing signals to the one or more communication links, and to couple the one or more echo signals, received from the one or more communication links, to the receiver.
- the one or more probing signals comprise one or more intermediate frequency (IF) signals comprising intermediate frequency carriers modulated by the one or more baseband signals
- the one or more echo signals comprise one or more intermediate frequency (IF) signals comprising intermediate frequency carriers modulated by the one or more reflected baseband signals.
- the one or more probing signals comprise the one or more baseband signals and the one or more echo signals comprise one or more IF signals comprising intermediate frequency carriers modulated by the one or more reflected baseband signals.
- the central unit comprises one or more electrical-to-optical converters configured to convert electrical probing signals to one or more optical probing signals and one or more electrical-to-optical converters configured to convert one or more optical echo signals to electrical echo signals.
- At least one of the one or more transponders comprises: one or more electrical-to-optical converters configured to convert electrical probing signals to the one or more optical probing signals, and one or more electrical-to-optical converters configured to convert the one or more optical echo signals to electrical echo signals.
- the sensor network system comprises a plurality of transponders coupled to the central unit, and wherein the central unit serves as a common central unit for detecting the one or more objects based on the one or more echo signals generated by the plurality of transponders.
- the sensor network system comprises a plurality of transponders coupled to the central unit, and wherein the transponders may comprise on or more digital signal processing unit to generate an object signal usable for determining distances between the one or more transponders and the one or more objects, and/or for determining velocities of the one or more objects with respect to the one or more transponders.
- a centralized object detection sensor network system for detecting one or more objects in an environment, comprising: a central unit communicatively coupled to one or more transponders through one or more communication links, wherein the one or more transponders are physically separate from the central unit, wherein the central unit is configured to: generate one or more multiplexed probing signals and transmit at least a multiplexed probing signal of the one or more multiplexed probing signals to a transponder of the one or more transponders, receive a multiplexed echo signal from the transponder, and detect the one or more objects using one or more reflected baseband signals, wherein the baseband signals are generated using the multiplexed echo signal, and wherein the transponder is configured to: receive the multiplexed probing signal from the central unit through a communication link of the one or more communication links, generate one or more radio frequency (RF) probing signals using the multiplexed probing signal and one or more RF carrier signals, convert the one or more RF probing signals into free space probing waves
- the communication link is a bidirectional communication link.
- the central unit is configured to use the one or more probing signals and one or more echo signals to generate an object signal usable for determining distances between the one or more transponders and the one or more objects, and/or for determining velocities of the one or more objects with respect to the one or more transponders.
- the one or more modalities include one or more of radar sensing, lidar sensing, imaging, kinematic sensing and position sensing.
- the one or more modalities include at least radar sensing.
- a centralized object detection sensor network system for detecting one or more objects in an environment, comprising a central unit communicatively coupled to one or more lidar-radar transponders through one or more communication links, wherein the one or more lidar-radar transponders are physically separate from the central unit, and wherein the central unit is configured to: generate one or more radar probing signals and one or more lidar probing signals, transmit the one or more radar probing signals and the one or more lidar signals to the one or more lidar-radar transponders, receive one or more radar echo signals and one or more lidar echo signals from the one or more lidar-radar transponders, and detect the one or more objects based at least in part on the one or more radar echo signals and the one or more lidar echo signals.
- a lidar- radar transponder of the one or more lidar-radar transponsders comprises a lidar transponder configured to generate lidar probing waves using a radar transponder configured to generate radar probing waves, where in lidar probing waves comprise light waves and radar probing wave comprise radio waves.
- the at least one lidar-radar transponder comprises an antenna unit, wherein the antenna unit comprises one or more RF antennas and one or more optical antennas configured to send and receive the light waves.
- the central unit comprises a radar central unit configured for detecting the one or more objects by radar sensing and a lidar central unit configured for detecting the one or more objects by lidar sensing.
- the central unit detects the one or more objects by determining distances between the one or more transponders and the one or more objects, and/or velocities of the one or more objects with respect to the one or more transponders or by generating an object signal usable for determining distances between the one or more transponders and the one or more objects, and/or for determining velocities of the one or more objects with respect to the one or more transponders, base at least in part the one or more lidar echo signals and the one or more radar echo signals.
- each of the processes, methods, and algorithms described herein and/or depicted in the figures may be embodied in, and fully or partially automated by, code modules executed by one or more physical computing systems, hardware computer processors, application- specific circuitry, and/or electronic hardware configured to execute specific and particular computer instructions.
- computing systems may include general purpose computers (e.g., servers) programmed with specific computer instructions or special purpose computers, special purpose circuitry, and so forth.
- a code module may be compiled and linked into an executable program, installed in a dynamic link library, or may be written in an interpreted programming language.
- particular operations and methods may be performed by circuitry that is specific to a given function.
- an input data may include sensor data collected at very short time intervals, with large amounts of data collected at each time interval.
- a specifically programmed computer hardware may be necessary to process the input data in a commercially reasonable amount of time.
- Code modules or any type of data may be stored on any type of non- transitory computer-readable medium, such as physical computer storage including hard drives, solid state memory, random access memory (RAM), read only memory (ROM), optical disc, volatile or non-volatile storage, combinations of the same and/or the like.
- the non-transitory computer-readable medium may be part of one or more of the local processing and data module, the remote processing module, and remote data repository.
- the methods and modules may also be transmitted as generated data signals (e.g., as part of a carrier wave or other analog or digital propagated signal) on a variety of computer-readable transmission mediums, including wireless-based and wired/cable -based mediums, and may take a variety of forms (e.g., as part of a single or multiplexed analog signal, or as multiple discrete digital packets or frames).
- generated data signals e.g., as part of a carrier wave or other analog or digital propagated signal
- computer-readable transmission mediums including wireless-based and wired/cable -based mediums, and may take a variety of forms (e.g., as part of a single or multiplexed analog signal, or as multiple discrete digital packets or frames).
- the results of the disclosed processes or process steps may be stored, persistently or otherwise, in any type of non-transitory, tangible computer storage or may be communicated via a computer- readable transmission medium.
- Any processes, blocks, states, steps, or functionalities in flow diagrams described herein and/or depicted in the attached figures should be understood as potentially representing code modules, segments, or portions of code which include one or more executable instructions for implementing specific functions (e.g., logical or arithmetical) or steps in the process.
- the various processes, blocks, states, steps, or functionalities may be combined, rearranged, added to, deleted from, modified, or otherwise changed from the illustrative examples provided herein.
- additional or different computing systems or code modules may perform some or all of the functionalities described herein.
- conditional language used herein such as, among others, “can,” “could,” “might,” “may,” “e.g.,” and the like, unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or steps. Thus, such conditional language is not generally intended to imply that features, elements and/or steps are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without author input or prompting, whether these features, elements and/or steps are included or are to be performed in any particular embodiment.
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Radar Systems Or Details Thereof (AREA)
- Arrangements For Transmission Of Measured Signals (AREA)
- Optical Radar Systems And Details Thereof (AREA)
- Alarm Systems (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202062972253P | 2020-02-10 | 2020-02-10 | |
PCT/US2021/017100 WO2021225659A2 (en) | 2020-02-10 | 2021-02-08 | Centralized object detection sensor network system |
Publications (2)
Publication Number | Publication Date |
---|---|
EP4103966A2 true EP4103966A2 (en) | 2022-12-21 |
EP4103966A4 EP4103966A4 (en) | 2024-04-17 |
Family
ID=74586879
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP21799465.6A Pending EP4103966A4 (en) | 2020-02-10 | 2021-02-08 | Centralized object detection sensor network system |
Country Status (5)
Country | Link |
---|---|
US (2) | US11340346B1 (en) |
EP (1) | EP4103966A4 (en) |
JP (1) | JP2023513264A (en) |
CN (1) | CN115427836A (en) |
WO (1) | WO2021225659A2 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7516894B2 (en) * | 2020-06-12 | 2024-07-17 | 株式会社アイシン | Object detection device |
US20230204747A1 (en) * | 2021-12-23 | 2023-06-29 | Gm Cruise Holdings Llc | Radar signaling for emergency scenarios |
Family Cites Families (43)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5564698A (en) * | 1995-06-30 | 1996-10-15 | Fox Sports Productions, Inc. | Electromagnetic transmitting hockey puck |
US6701137B1 (en) * | 1999-04-26 | 2004-03-02 | Andrew Corporation | Antenna system architecture |
US6697603B1 (en) * | 1999-12-13 | 2004-02-24 | Andrew Corporation | Digital repeater |
US6529155B2 (en) * | 2001-06-07 | 2003-03-04 | Itt Defense And Electronics | Transponder apparatus |
US7623028B2 (en) * | 2004-05-27 | 2009-11-24 | Lawrence Kates | System and method for high-sensitivity sensor |
US7844216B2 (en) * | 2004-09-07 | 2010-11-30 | Samsung Electronics Co., Ltd. | Wireless repeater using a single RF chain for use in a TDD wireless network |
US7230528B2 (en) * | 2005-09-20 | 2007-06-12 | Lawrence Kates | Programmed wireless sensor system |
US7142123B1 (en) * | 2005-09-23 | 2006-11-28 | Lawrence Kates | Method and apparatus for detecting moisture in building materials |
US7298217B2 (en) * | 2005-12-01 | 2007-11-20 | Raytheon Company | Phased array radar systems and subassemblies thereof |
EP2081048A1 (en) * | 2008-01-15 | 2009-07-22 | Nederlandse Organisatie voor toegepast- natuurwetenschappelijk onderzoek TNO | A radar repeater system and a radar repeating method |
US7782250B2 (en) * | 2008-06-13 | 2010-08-24 | Honeywell International Inc. | Millimeter wave radar target simulation systems and methods |
US9375153B2 (en) * | 2010-05-17 | 2016-06-28 | Industrial Technology Research Institute | Motion/vibration sensor |
EP2749123B1 (en) * | 2011-09-02 | 2022-03-30 | Dali Systems Co. Ltd. | Software configurable distributed antenna system and method for reducing uplink noise |
US9041589B2 (en) * | 2012-04-04 | 2015-05-26 | Caterpillar Inc. | Systems and methods for determining a radar device coverage region |
DE102013007001A1 (en) * | 2013-04-22 | 2014-10-23 | Karl-Heinz Deyer | Warning system against wrong-way and wrong-way drivers |
EP2993488B1 (en) | 2013-05-01 | 2022-01-12 | Furukawa Electric Co., Ltd. | Radar system |
US9069080B2 (en) * | 2013-05-24 | 2015-06-30 | Advanced Scientific Concepts, Inc. | Automotive auxiliary ladar sensor |
US9557414B1 (en) * | 2014-01-30 | 2017-01-31 | The United States Of America As Represented By The Secretary Of The Navy | Ultra-broadband coherent radar transponder for precision tracking |
US9769744B2 (en) * | 2014-03-28 | 2017-09-19 | Commscope Technologies Llc | Power management for distributed antenna system |
US9575184B2 (en) * | 2014-07-03 | 2017-02-21 | Continental Advanced Lidar Solutions Us, Inc. | LADAR sensor for a dense environment |
JP6413623B2 (en) * | 2014-10-22 | 2018-10-31 | 株式会社Soken | Obstacle detection device |
JP6474228B2 (en) * | 2014-10-22 | 2019-02-27 | 株式会社デンソー | Object detection device |
JP2018522232A (en) * | 2015-06-15 | 2018-08-09 | ヒューマティクス コーポレイション | High precision time-of-flight measurement system for industrial automation |
US11691619B2 (en) * | 2015-08-12 | 2023-07-04 | Hyundai Motor Company | Automatic parking system and automatic parking method |
US9979461B2 (en) * | 2016-03-04 | 2018-05-22 | Advanced Rf Technologies, Inc. | RF repeater |
US10698079B2 (en) * | 2016-04-01 | 2020-06-30 | Intel IP Corporation | Method and apparatus for proximity radar in phased array communications |
US10545229B2 (en) * | 2016-04-22 | 2020-01-28 | Huawei Technologies Co., Ltd. | Systems and methods for unified mapping of an environment |
EP3319172B1 (en) | 2016-11-07 | 2020-10-21 | LEONARDO S.p.A. | Airborne/spaceborne distributed aperture multi sensing pulsed rf system |
CN106908785A (en) * | 2017-03-10 | 2017-06-30 | 四川莱源科技有限公司 | Radar network based on cloud computing |
US10671062B2 (en) * | 2017-04-19 | 2020-06-02 | Infineon Technologies Ag | Testing a crash sensor device during vehicle operation |
JP6871073B2 (en) * | 2017-06-08 | 2021-05-12 | 日立Astemo株式会社 | Electronic control device |
KR102483646B1 (en) | 2017-12-22 | 2023-01-02 | 삼성전자주식회사 | Method and device to detect object |
DE102018102979A1 (en) * | 2018-02-09 | 2019-08-14 | Infineon Technologies Ag | High-frequency device, system comprising a high-frequency device and corresponding method |
WO2019161388A1 (en) * | 2018-02-16 | 2019-08-22 | Xiaotian Steve Yao | Optical sensing based on wavelength division multiplexed (wdm) light at different wavelengths in light detection and ranging lidar systems |
US11073599B2 (en) * | 2018-05-07 | 2021-07-27 | Qualcomm Incorporated | Radar interference mitigation using a pseudorandom offset |
US11885906B2 (en) | 2018-06-28 | 2024-01-30 | Plato Systems, Inc. | Multimodal sensing, fusion for machine perception |
US10754011B2 (en) * | 2018-06-29 | 2020-08-25 | Perceptive Inc. | Perception systems for use in autonomously controlling systems |
DE112020001399T5 (en) | 2019-03-22 | 2022-01-05 | Commscope Technologies Llc | DISTRIBUTED ANTENNA SYSTEM AND C-RAN SYSTEM USING INTELLIGENT ENVIRONMENTAL DETECTION |
US11296764B2 (en) * | 2019-05-08 | 2022-04-05 | Qualcomm Incorporated | Beamforming repeaters with digitally assisted interference mitigation |
CN112805591A (en) | 2019-06-20 | 2021-05-14 | 华为技术有限公司 | Radar system |
US11183052B2 (en) * | 2019-07-16 | 2021-11-23 | Ford Global Technologies, Llc | Enhanced vehicle operation |
CN110412559B (en) | 2019-07-26 | 2023-05-26 | 西安电子科技大学 | Non-coherent fusion target detection method for MIMO radar of distributed unmanned aerial vehicle |
US11808843B2 (en) * | 2019-08-29 | 2023-11-07 | Qualcomm Incorporated | Radar repeaters for non-line-of-sight target detection |
-
2021
- 2021-02-08 EP EP21799465.6A patent/EP4103966A4/en active Pending
- 2021-02-08 WO PCT/US2021/017100 patent/WO2021225659A2/en unknown
- 2021-02-08 JP JP2022548481A patent/JP2023513264A/en active Pending
- 2021-02-08 CN CN202180027084.6A patent/CN115427836A/en active Pending
- 2021-02-09 US US17/171,850 patent/US11340346B1/en active Active
-
2022
- 2022-05-23 US US17/751,571 patent/US11860269B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US11340346B1 (en) | 2022-05-24 |
JP2023513264A (en) | 2023-03-30 |
WO2021225659A3 (en) | 2021-12-23 |
US11860269B2 (en) | 2024-01-02 |
US20220163657A1 (en) | 2022-05-26 |
WO2021225659A2 (en) | 2021-11-11 |
EP4103966A4 (en) | 2024-04-17 |
US20220283293A1 (en) | 2022-09-08 |
CN115427836A (en) | 2022-12-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11860269B2 (en) | Centralized object detection sensor network system | |
US8203479B2 (en) | Electronic counter measure system | |
CN115639543A (en) | Frequency modulated continuous wave laser radar and autopilot equipment | |
CN104330801A (en) | Active phased array weather radar system based on full-digital array | |
CN108732562B (en) | Phased array radar | |
CN110275143B (en) | High-integration microwave photon MIMO radar signal transceiving device and method | |
CN110780281A (en) | Optical phased array laser radar system | |
CN108152807A (en) | A kind of spaceborne highly reliable self-test monopulse radar system and its application process | |
CN107728130B (en) | Multi-channel wide-amplitude synthetic aperture laser imaging radar transmitting and receiving system | |
CN103282791B (en) | A radar station, featuring broadband, linear-frequency-modulated, continuous-wave emission | |
KR101012161B1 (en) | System and method for measuring antenna patterns of digital radar | |
CN116068541A (en) | Microwave photon phased array radar detection method and system based on true delay | |
CN113126097B (en) | Meteorological detection method and digital phased array weather radar | |
KR102520675B1 (en) | Photonics based active array radar for transmitting and receiving pulse waveform | |
CN115941074A (en) | Active channel internal calibration method for waveguide array phased array antenna | |
RU2725758C1 (en) | Wide-range intelligent on-board communication system using radio-photon elements | |
CN114640394B (en) | Communication method and communication device | |
Lin | Integration of multiple automotive radar modules based on fiber-wireless network | |
RU2611600C1 (en) | Converting transmitting-receiving module of digital antenna array (optional) | |
EP3816653A1 (en) | An improved coherent multi-antenna radar transceiver | |
CN111665497B (en) | Target positioning and imaging system based on microwave photon and electromagnetic inversion technology | |
CN211426789U (en) | Deformation monitoring radar based on microwave interference | |
CN117276899B (en) | Phased array antenna and radio communication device | |
WO2022104666A1 (en) | Radar system, movable platform, control method, obstacle avoidance method, and storage medium | |
CN217639503U (en) | Millimeter wave radar transmitting device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20220908 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40085433 Country of ref document: HK |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Free format text: PREVIOUS MAIN CLASS: G01S0013880000 Ipc: G01S0007350000 |
|
A4 | Supplementary search report drawn up and despatched |
Effective date: 20240315 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G01S 7/292 20060101ALI20240311BHEP Ipc: G01S 13/87 20060101ALI20240311BHEP Ipc: G01S 13/58 20060101ALI20240311BHEP Ipc: G01S 7/00 20060101ALI20240311BHEP Ipc: G01S 17/58 20060101ALI20240311BHEP Ipc: G01S 13/86 20060101ALI20240311BHEP Ipc: G01S 13/50 20060101ALI20240311BHEP Ipc: G01S 13/04 20060101ALI20240311BHEP Ipc: G01S 7/35 20060101AFI20240311BHEP |