US20180292513A1 - Modulated infrared lighting - Google Patents
Modulated infrared lighting Download PDFInfo
- Publication number
- US20180292513A1 US20180292513A1 US15/481,756 US201715481756A US2018292513A1 US 20180292513 A1 US20180292513 A1 US 20180292513A1 US 201715481756 A US201715481756 A US 201715481756A US 2018292513 A1 US2018292513 A1 US 2018292513A1
- Authority
- US
- United States
- Prior art keywords
- vehicle
- light pulses
- speed
- sequence
- computing device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims description 43
- 230000005855 radiation Effects 0.000 claims description 43
- 230000005540 biological transmission Effects 0.000 claims description 15
- 230000015654 memory Effects 0.000 claims description 11
- 230000033001 locomotion Effects 0.000 claims description 10
- 230000008569 process Effects 0.000 description 26
- 238000004891 communication Methods 0.000 description 22
- 238000010586 diagram Methods 0.000 description 15
- 238000005516 engineering process Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 230000001133 acceleration Effects 0.000 description 5
- 238000004566 IR spectroscopy Methods 0.000 description 4
- 230000007423 decrease Effects 0.000 description 4
- 230000007613 environmental effect Effects 0.000 description 4
- 230000006855 networking Effects 0.000 description 4
- 238000005259 measurement Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 238000002485 combustion reaction Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001066 destructive effect Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004313 glare Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000003754 machining Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000001556 precipitation Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000007921 spray Substances 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/50—Transmitters
- H04B10/516—Details of coding or modulation
- H04B10/524—Pulse modulation
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0965—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages responding to signals from another vehicle, e.g. emergency vehicle
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/4808—Evaluating distance, position or velocity data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
- H04W4/46—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for vehicle-to-vehicle communication [V2V]
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/42—Simultaneous measurement of distance and other co-ordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/50—Systems of measurement based on relative movement of target
- G01S17/58—Velocity or trajectory determination systems; Sense-of-movement determination systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
- G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G01S17/936—
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
- G01S7/021—Auxiliary means for detecting or identifying radar signals or the like, e.g. radar jamming signals
- G01S7/022—Road traffic radar detectors
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/4804—Auxiliary means for detecting or identifying lidar signals or the like, e.g. laser illuminators
- G01S7/4806—Road traffic laser detectors
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/491—Details of non-pulse systems
- G01S7/4912—Receivers
- G01S7/4915—Time delay measurement, e.g. operational details for pixel components; Phase measurement
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/22—Platooning, i.e. convoy of communicating vehicles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/11—Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
- H04B10/114—Indoor or close-range type systems
- H04B10/1143—Bidirectional transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L5/00—Arrangements affording multiple use of the transmission path
- H04L5/14—Two-way operation using the same type of signal, i.e. duplex
- H04L5/1438—Negotiation of transmission parameters prior to communication
- H04L5/1446—Negotiation of transmission parameters prior to communication of transmission speed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
-
- H04N5/332—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
- H04W4/44—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K31/00—Vehicle fittings, acting on a single sub-unit only, for automatically controlling vehicle speed, i.e. preventing speed from exceeding an arbitrarily established velocity or maintaining speed at a particular velocity, as selected by the vehicle operator
- B60K31/0008—Vehicle fittings, acting on a single sub-unit only, for automatically controlling vehicle speed, i.e. preventing speed from exceeding an arbitrarily established velocity or maintaining speed at a particular velocity, as selected by the vehicle operator including means for detecting potential obstacles in vehicle path
- B60K2031/0033—Detecting longitudinal speed or acceleration of target vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2556/00—Input parameters relating to data
- B60W2556/45—External transmission of data to or from the vehicle
- B60W2556/65—Data transmitted between vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
- G01S13/865—Combination of radar systems with lidar systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
- G01S13/867—Combination of radar systems with cameras
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
- G01S2013/9316—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles combined with communication equipment with other vehicles or with base stations
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
- G01S2013/9323—Alternative operation using light waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
- G01S2013/9324—Alternative operation using ultrasonic waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
- G01S2013/9327—Sensor installation details
- G01S2013/93271—Sensor installation details in the front of the vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
- G01S2013/9327—Sensor installation details
- G01S2013/93275—Sensor installation details in the bumper area
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/161—Decentralised systems, e.g. inter-vehicle communication
Definitions
- Vehicles can be equipped to operate in both autonomous and occupant piloted mode.
- Vehicles can be equipped with computing devices, networks, sensors and controllers to acquire information regarding the vehicle's environment and to pilot the vehicle based on the information.
- a computing device can also be equipped with computing devices, networks, sensors and controllers to acquire information regarding the vehicle's occupants and to pilot the vehicle based on the information.
- FIG. 1 is a block diagram of an example vehicle.
- FIG. 4 is a diagram of an IR video frame.
- FIG. 5 is a diagram modulated infrared lighting.
- FIG. 6 is a diagram of a traffic scene.
- FIG. 8 is a flowchart diagram of an example process to modulate infrared lighting.
- Vehicles can be equipped to operate in both autonomous and occupant piloted mode.
- a semi- or fully-autonomous mode we mean a mode of operation wherein a vehicle can be piloted by a computing device as part of a vehicle information system having sensors and controllers. The vehicle can be occupied or unoccupied, but in either case the vehicle can be piloted without assistance of an occupant.
- an autonomous mode is defined as one in which each of vehicle propulsion (e.g., via a powertrain including an internal combustion engine and/or electric motor), braking, and steering are controlled by one or more vehicle computers; in a semi-autonomous mode the vehicle computer(s) control(s) one or two of vehicle propulsion, braking, and steering.
- Vehicles can be equipped with computing devices, networks, sensors and controllers to pilot the vehicle and to determine maps of the surrounding real world including features such as roads. Vehicles can be piloted and maps can be determined based on locating and identifying road signs in the surrounding real world. By piloting we mean directing the movements of a vehicle so as to move the vehicle along a roadway or other portion of a path.
- the computing device can receive a third sequence of light pulses from a third vehicle and transmits the message as a sequence of light pulses having a third speed based on the third sequence of light pulses received from the vehicle, wherein the third speed is different from the second speed.
- the light pulses can be modulated IR radiation.
- the message can include information regarding vehicle position, motion, size, safety events, path history and vehicle status, encoded into light pulses as binary bits, wherein the encoding is independent of message transmission speed.
- the message can also be transmitted via a wireless vehicle-to-vehicle network.
- the sequences of light pulses can be received via an IR video sensor and the sequences of light pulses can be received from two or more vehicles, wherein emitting the message as a sequence of light pulses having a fourth speed can be based on the sequences of light pulses, wherein the fourth speed is set equal to the slowest of the sequences of light pulses.
- the first speed can be indicated by a preamble including a “101010” bit pattern and the message can be encoded using pulse width modulation.
- the message can include a basic safety message and the frame rate of the IR video sensor can be increased by sub-sampling.
- a computer readable medium storing program instructions for executing some or all of the above method steps.
- a computer programmed for executing some or all of the above method steps including a computer apparatus, programmed to transmit a sequence of light pulses having a first speed receive a second sequence of light pulses from a vehicle, and, transmit a message as a sequence of light pulses having a second speed based on the second sequence of light pulses received from the vehicle, wherein the first speed is different from the second speed.
- a computing device can determine the second speed based on the second sequence of light pulses received from the vehicle that is slower than the first speed. The computing device can determine when the vehicle is no longer in proximity and transmits a sequence of light pulses having a third speed, wherein the third speed is faster than the second speed.
- the computing device can receive a third sequence of light pulses from a third vehicle and transmits the message as a sequence of light pulses having a third speed based on the third sequence of light pulses received from the vehicle, wherein the third speed is different from the second speed.
- the light pulses are modulated IR radiation and the message can include information regarding vehicle position, motion, size, safety events, path history and vehicle status, encoded into light pulses as binary bits, wherein the encoding is independent of message transmission speed.
- the message can also be transmitted via a wireless vehicle-to-vehicle network.
- the sequences of light pulses can be received via an IR video sensor and the sequences of light pulse can be received from one or more vehicles, wherein emitting the message as a sequence of light pulses having a fourth speed is based on the sequences of light pulses, wherein the fourth speed is set equal to the slowest.
- FIG. 1 is a diagram of a vehicle information system 100 that includes a vehicle 110 operable in autonomous (“autonomous” by itself in this disclosure means “fully autonomous”) and occupant piloted (also referred to as non-autonomous) mode in accordance with disclosed implementations.
- Vehicle 110 also includes one or more computing devices 115 for performing computations for piloting the vehicle 110 during autonomous operation.
- Computing devices 115 can receive information regarding the operation of the vehicle from sensors 116 .
- the computing device 115 includes a processor and a memory such as are known. Further, the memory includes one or more forms of computer-readable media, and stores instructions executable by the processor for performing various operations, including as disclosed herein.
- the computing device 115 may include programming to operate one or more of vehicle brakes, propulsion (e.g., control of acceleration in the vehicle 110 by controlling one or more of an internal combustion engine, electric motor, hybrid engine, etc.), steering, climate control, interior and/or exterior lights, etc., as well as to determine whether and when the computing device 115 , as opposed to a human operator, is to control such operations.
- propulsion e.g., control of acceleration in the vehicle 110 by controlling one or more of an internal combustion engine, electric motor, hybrid engine, etc.
- steering climate control
- interior and/or exterior lights etc.
- the computing device 115 may include or be communicatively coupled to, e.g., via a vehicle communications bus as described further below, more than one computing devices, e.g., controllers or the like included in the vehicle 110 for monitoring and/or controlling various vehicle components, e.g., a powertrain controller 112 , a brake controller 113 , a steering controller 114 , etc.
- the computing device 115 is generally arranged for communications on a vehicle communication network such as a bus in the vehicle 110 such as a controller area network (CAN) or the like; the vehicle 110 network can include wired or wireless communication mechanism such as are known, e.g., Ethernet or other communication protocols.
- a vehicle communication network such as a bus in the vehicle 110 such as a controller area network (CAN) or the like
- CAN controller area network
- the vehicle 110 network can include wired or wireless communication mechanism such as are known, e.g., Ethernet or other communication protocols.
- the computing device 115 may transmit messages to various devices in the vehicle and/or receive messages from the various devices, e.g., controllers, actuators, sensors, etc., including sensors 116 .
- the vehicle communication network may be used for communications between devices represented as the computing device 115 in this disclosure.
- various controllers or sensing elements may provide data to the computing device 115 via the vehicle communication network.
- the computing device 115 may be configured for communicating through a vehicle-to-infrastructure (V-to-I) interface 111 with a remote server computer 120 , e.g., a cloud server, via a network 130 , which, as described below, may utilize various wired and/or wireless networking technologies, e.g., cellular, BLUETOOTH® and wired and/or wireless packet networks.
- the computing device 115 also includes nonvolatile memory such as is known. Computing device 115 can log information by storing the information in nonvolatile memory for later retrieval and transmittal via the vehicle communication network and a vehicle to infrastructure (V-to-I) interface 111 to a server computer 120 or user mobile device 160 .
- the computing device 115 may make various determinations and/or control various vehicle 110 components and/or operations without a driver to operate the vehicle 110 .
- the computing device 115 may include programming to regulate vehicle 110 operational behaviors such as speed, acceleration, deceleration, steering, etc., as well as tactical behaviors such as a distance between vehicles and/or amount of time between vehicles, lane-change, minimum gap between vehicles, left-turn-across-path minimum, time-to-arrival at a particular location and intersection (without signal) minimum time-to-arrival to cross the intersection.
- vehicle 110 operational behaviors such as speed, acceleration, deceleration, steering, etc.
- tactical behaviors such as a distance between vehicles and/or amount of time between vehicles, lane-change, minimum gap between vehicles, left-turn-across-path minimum, time-to-arrival at a particular location and intersection (without signal) minimum time-to-arrival to cross the intersection.
- Controllers include computing devices that typically are programmed to control a specific vehicle subsystem. Examples include a powertrain controller 112 , a brake controller 113 , and a steering controller 114 .
- a controller may be an electronic control unit (ECU) such as is known, possibly including additional programming as described herein.
- the controllers may communicatively be connected to and receive instructions from the computing device 115 to actuate the subsystem according to the instructions.
- the brake controller 113 may receive instructions from the computing device 115 to operate the brakes of the vehicle 110 .
- the one or more controllers 112 , 113 , 114 for the vehicle 110 may include known electronic control units (ECUs) or the like including, as non-limiting examples, one or more powertrain controllers 112 , one or more brake controllers 113 and one or more steering controllers 114 .
- ECUs electronice control units
- Each of the controllers 112 , 113 , 114 may include respective processors and memories and one or more actuators.
- the controllers 112 , 113 , 114 may be programmed and connected to a vehicle 110 communications bus, such as a controller area network (CAN) bus or local interconnect network (LIN) bus, to receive instructions from the computer 115 and control actuators based on the instructions.
- a vehicle 110 communications bus such as a controller area network (CAN) bus or local interconnect network (LIN) bus
- Sensors 116 may include a variety of devices known to provide data via the vehicle communications bus.
- a radar fixed to a front bumper (not shown) of the vehicle 110 may provide a distance from the vehicle 110 to a next vehicle in front of the vehicle 110
- a global positioning system (GPS) sensor disposed in the vehicle 110 may provide geographical coordinates of the vehicle 110 .
- the distance provided by the radar or the geographical coordinates provided by the GPS sensor may be used by the computing device 115 to operate the vehicle 110 autonomously or semi-autonomously.
- the vehicle 110 is generally a land-based autonomous vehicle 110 having three or more wheels, e.g., a passenger car, light truck, etc.
- the vehicle 110 includes one or more sensors 116 , the V-to-I interface 111 , the computing device 115 and one or more controllers 112 , 113 , 114 .
- the sensors 116 may be programmed to collect data related to the vehicle 110 and the environment in which the vehicle 110 is operating.
- sensors 116 may include, e.g., altimeters, cameras, LIDAR, radar, ultrasonic sensors, infrared sensors, pressure sensors, accelerometers, gyroscopes, temperature sensors, pressure sensors, hall sensors, optical sensors, voltage sensors, current sensors, mechanical sensors such as switches, etc.
- the sensors 116 may be used to sense the environment in which the vehicle 110 is operating such as weather conditions, the grade of a road, the location of a road or locations of neighboring vehicles 110 .
- the sensors 116 may further be used to collect dynamic vehicle 110 data related to operations of the vehicle 110 such as velocity, yaw rate, steering angle, engine speed, brake pressure, oil pressure, the power level applied to controllers 112 , 113 , 114 in the vehicle 110 , connectivity between components and electrical and logical health of the vehicle 110 .
- Computing device 115 in vehicle 110 can communicate with computing devices 115 in other vehicles 110 via vehicle-to-vehicle (V-to-V) networking using V-to-I interface 110 .
- V-to-V networking can permit communication with other vehicles via infrastructure-supported networks, or directly with other vehicles via ad hoc networks created spontaneously with nearby vehicles based on signal strength, for example.
- V-to-V networks can be used to communicate basic safety messages between vehicles 110 and thereby assist computing device 115 in determining safe operation of vehicle 110 by transmitting information on the location and motion of vehicle 110 and receiving information on the location and motion of nearby vehicles.
- V-to-V networks based on 5.9 GHz frequency bands can be limited to 300 meters range and subject to blackouts due to null regions caused by destructive interference of multiple paths of reflected radio waves, for example.
- Communicating basic safety messages via modulated infrared (IR) light can provide redundancy to radio wave-based V-to-V communication and thereby increase vehicle 110 safety.
- IR infrared
- a basic safety message is a message for transmission between vehicles via a V-to-V networking and between vehicles and infrastructure computing devices that includes a predetermined set of parameters that can describe the position, motion, and size of a vehicle, for example.
- BSM contents and transmission are described in SAE standards J2945/1 and J2735, published by the Society of Automotive Engineers, Warrendale, Pa., USA 15096.
- Table 1 is a description of parameters included in BSM Part 1.
- Basic Safety Message, Part I includes information regarding the position, motion and size of a vehicle 110 . This information can be used by other computing devices 115 in other vehicles 110 and infrastructure computing devices to determine predicted paths for vehicles and thereby pilot vehicles and control traffic to prevent impacts between vehicles and promote safe and efficient traffic flow, for example.
- a BSM can encoded as binary characters, grouped into packets identified by headers and protected by checksums to permit computing device 115 to reliably communicate messages including a BSM.
- FIGS. 2-8 include examples of IR LEDs and IR video technology used to permit vehicle 110 to communicate a BSM with other vehicles by modulated IR lighting.
- a vehicle 110 can communicate BSMs with other vehicles via modulated infrared (IR) light emitting diodes (LEDs) and IR video cameras to provide a redundant channel to communicate safety information between vehicles.
- IR infrared
- Receiving BSMs at a computing device 115 includes receiving a stream of modulated IR radiation representing bits of a digital message including the BSM parameters listed in Table 1 via an IR video sensor such as an IR video camera.
- Modulated IR radiation representing bits of a digital message can also be received via an IR sensor having higher sensitivity and higher bit rates than IR video sensors, however IR sensors lack the XY spatial output of IR video sensors that can be used to discern modulated IR radiation from multiple vehicles as will be discussed later in relation to FIG. 6 .
- a high definition (HD) IR video frame rate can be 60 frames per second (fps), making the highest possible bit rate for a single pixel in the IR video frame 30 bits per second (bps) due to Nyquist sampling limits. Multiple pixels in the frame can be sampled together to form a single bit at this rate, for example.
- a BSM can include hundreds of bits, for example. At 30 bps, a BSM could take over a minute to receive at IR video frame rates.
- One solution is to employ high frame rate IR video cameras.
- High frame rate IR video cameras can increase the bit rate at which an IR video camera can receive messages, since high frame rate IR video cameras can operate at up to hundreds of frames per second, however, high frame rate IR video cameras can be much more expensive than HD frame rate IR video cameras.
- IR frame rates are limited by the number of IR photons available to the sensor per frame and the signal-to-noise ratio of the sensor. Increasing frame rate decreases the amount of time available for each frame to integrate photon energy impinging upon the sensor and convert it to charge. Thus, high frame rate IR video cameras have upper limits on frame rates achievable in practice.
- FIG. 2 is a diagram of a technique to increase IR video frame rates to permit timely reception of BSM without the expense associated with high frame rate IR video cameras.
- FIG. 2 shows an IR video frame 200 that includes an image of a vehicle 202 including IR radiation 208 , 210 from IR LEDs 204 , 206 , incorporated into headlights of vehicle 202 , for example.
- IR video frame 200 is constructed using complementary metal-oxide semiconductor (CMOS) technology.
- CMOS complementary metal-oxide semiconductor
- IR video frames 200 constructed using CMOS can address the sensor array according to the XY address of the pixel in the sensor array. This permits reading out only rectangular subsets of the sensor array instead of the entire array in an efficient fashion, and, since the pixel rate can be constant, reading out a subset of the sensor array permits higher effective frame rates due to the limited number of pixels transferred per frame.
- FIG. 3 shows an IR video frame 212 with two regions of interest (ROIs) 314 , 316 formed from video frame 300 that include IR LEDs 304 , 306 , and therefore IR radiation 308 , 310 emitted from IR LEDs 304 , 306 .
- decreasing the number of pixels from n*m to 2(r*p) can increase the frame rate fps rp and therefore the bit rate from 30 bps up to 180 bps, which can reduce the amount of time required to transmit a BSM from over a minute to a few seconds, making IR communication of BSMs between vehicles practical.
- IR LEDs in vehicles 110 can be designed to emit an appropriate photon flux over the designed viewing angles and range to IR video cameras to be reliably detected at the designed frame rate under normal viewing conditions in order to reliably transmit IR data bits.
- IR emitting LEDs in vehicles 110 can also be designed to provide reliable transmission of data bits under less than perfect conditions by slowing the bit rate of data bits transmitted via IR LED radiation to improve the signal-to-noise ratio of received data bits at IR video cameras without changing the sample rate of the IR video sensor.
- IR video sensors can receive IR data bits in modulated IR radiation at bit rates slower than the frame rate by summing or averaging frames over time to reduce the sample rate to match the bit rate of the IR LEDs.
- ROIs 314 , 316 can be formed using known machine vision techniques to locate, track, extract and quantify IR radiation 308 , 310 in IR video frame 312 .
- the process of locating, tracking, extracting and quantifying multiple sources of IR radiation in an IR video frame 312 can introduce a delay and thereby limit the bit rate for receiving IR data bits via modulated IR radiation.
- FIG. 4 is a diagram of IR lighting modulated to provide transmission of data bits at varying speeds.
- the “speed” of a data transmission via light pulses is defined as the number of bits per second transmitted, where a bit is defined as a digital “1” or digital “0” to differentiate it from the number of light pulses transmitted.
- a single digital 1 or 0 can require more than one light pulse to transmit using pulse width modulation (PWM).
- PWM pulse width modulation
- the IR lighting can be modulated using PWM that effectively varies the width of emitted IR light pulses to form the 1's and 0's of binary bits.
- the fastest frame rate is the frame rate at which a single bit emitted from IR LEDs at predetermined intensity, size and distance from an IR video sensor under predetermined environmental conditions can be detected with acceptable reliability.
- Acceptable reliability can be defined as having a 99.9% probability of true positive detection of a single bit emitted from an IR LED, for example.
- PWM can increase the reliability with which IR video sensors detect bits by encoding 1's and 0's as different pulse widths, thereby using multiple frames to encode each bit.
- First column of vehicle 402 , 404 images shows a vehicle 402 at time steps t 1 through 16 .
- Each time step can correspond to one or more IR video frames.
- vehicle 402 has energized IR LEDs included in vehicle 402 headlights to emit IR radiation 406 , 408 (arrows).
- vehicle 402 IR LEDs are emitting IR radiation.
- vehicle 402 IR LEDs are not emitting IR radiation.
- This sequence of three “on” time steps followed by one “off” time step is the PWM encoding for a “1” bit.
- vehicle 404 has energized IR LEDs to emit IR radiation 410 , 412 .
- vehicle 404 has not energized IR LEDs. This sequence of one “on” step followed by three “off” steps is the PWM encoding for a “0” bit.
- a 1-bit is identified by a 3:1 ratio of “on” to “off” time periods, while a 0-bit is identified by a 1:3 ratio of “on” to “off” time periods. This is yields a 9:1 ratio between 1-bit and a 0-bit codes, which provides reliable detection.
- PWM pulse width modulation
- the receiver can be programmed to determine ratios of “on” to “off” periods to determine 1's and 0's regardless of absolute number of time periods.
- PWM data transmission is robust, reliable and can be sped up and slowed down without changing the sample rate of the IR video sensor.
- FIG. 5 is a diagram of a traffic scene 500 with two vehicles 502 , 504 , moving in traffic in a direction shown by arrow 506 .
- Vehicle 502 includes IR LEDs that can be energized via controllers at the direction of a computing device 115 in vehicle 502 to emit modulated IR radiation 508 , 510 , 512 , 514 that can be received by IR video sensors in communication with a computing device 115 in vehicle 504 .
- computing device 115 in vehicle 502 can use IR radiation 508 , 510 communicate with computing device 115 in vehicle 504 via IR video cameras in vehicle 504 .
- Computing device 115 can transmit a BSM to vehicle 504 via IR radiation 508 , 510 and IR video sensors in vehicle 504 , and receive a BSM from computing device 115 in vehicle 504 via IR radiation 512 , 514 and IR video sensors in vehicle 502 .
- Reception of a BSM by vehicles 502 , 504 depends upon the bit rate at which respective IR video sensors are able to reliably receive IR bits.
- the ability of an IR video sensor to reliably detect a single bit can be a function of optical factors such as distance, angle, f-stop and focus and environmental factors such as solar glare, reflections, precipitation, fog, spray and ice, etc. All these factors can combine to decrease the ability of an IR video sensor to detect data bits transmitted by modulated IR radiation 508 , 510 , 512 , 514 .
- bit rate (speed) between vehicles 502 , 504 to establish the highest bit rate with acceptable reliability supported by the receivers by slowing transmit speed incrementally upon failure to receive a positive response to a handshake preamble.
- the handshake preamble can include three “on” and “off” bits in sequence: “101010”. If a computing device 115 in receiving vehicle 504 can reliably detect the sequence of three bit pairs, computing device 115 transmits an acknowledgement (ACK) message to computing device 115 of vehicle 502 by energizing IR LEDs to emit IR radiation 512 , 514 at the same bit rate as was received.
- ACK acknowledgement
- computing device 115 in vehicle 504 can transmit a negative acknowledgement (NAK) message to vehicle 502 via IR radiation 512 , 514 at a bit rate that computing device 115 predicts can be reliably received.
- NAK negative acknowledgement
- computing device 115 in vehicle 502 can determine the bit rate of the received message and retransmit the “101010” preamble to vehicle 504 at the new, slower bit rate.
- Vehicle 504 can respond with an ACK or NAK, if NAK, at increasingly slower speeds until a speed is reached that supports reliable communication and an ACK is received, or a lower limit is reached.
- computing device 115 in vehicle 502 can determine that communication via modulated IR radiation is not currently possible.
- Computing device 115 can set a flag to cause the computing device 115 to try to communicate with vehicle 504 again after a short delay.
- FIG. 6 is a diagram of a traffic scene 600 , wherein vehicles 602 , 604 , 606 are traveling in the direction shown by arrow 608 and vehicles 610 , 612 are traveling in the direction shown by the arrow 614 .
- Vehicle 602 and vehicle 604 can transmit and receive BSMs via modulating IR radiation 614 , 616 , 618 , 620 , while vehicle 606 and vehicle 602 transmit and receive BSMs via modulating IR radiation 622 , 624 , 626 , 628 .
- Vehicle 602 can also transmit and receive BSMs to and from vehicles 610 by modulating IR radiation 614 , 616 , 630 , 632 and vehicle 612 by modulating IR radiation 626 , 628 , 634 , 636 .
- Computing device 115 in vehicle 602 can determine multiple IR bits from multiple sources of IR radiation in a single IR video frame by forming multiple ROIs to track each source of IR radiation separately, for example.
- vehicle 602 can negotiate communication speed with each of the other vehicles 604 , 606 , 610 , 612 .
- Vehicle 602 can select the slowest speed of the speeds negotiated with vehicles 604 , 606 , 610 , 612 and communicate with all the vehicles 604 , 606 , 610 , 612 at the slowest common speed.
- Computing device 115 in vehicle 602 can keep track of which vehicle 604 , 606 , 610 , 612 was the slowest, and, when that vehicle 604 , 606 , 610 , 612 leaves the ad hoc network formed by the vehicles 604 , 606 , 610 , 612 nearby vehicle 602 , vehicle 602 can increase the speed of transmission to a faster common speed among the remaining vehicles 604 , 606 , 610 , 612 by either re-negotiating transmission speeds as described above or switching to a previously determined value.
- FIG. 7 is a diagram of a flowchart, described in relation to FIGS. 1-6 , of a process 700 for transmitting a message, which can be a BSM, with modulated IR light pulses, e.g., as described above.
- Process 700 can be implemented by a processor of computing device 115 , taking as input information from sensors 116 , and executing instructions and sending control signals via controllers 112 , 113 , 114 , for example.
- Process 700 includes multiple steps taken in the disclosed order.
- Process 700 also includes implementations including fewer steps or can include the steps taken in different orders.
- Process 700 begins at step 702 wherein a computing device 115 in a vehicle 502 energizes IR LEDs to emit a sequence of light pulses or modulated IR radiation 508 , 510 .
- the sequence of light pulses is a sequence of bit pairs “101010” as a preamble as described above in relation to FIG. 5 .
- This preamble can be received by a computing device 115 in vehicle 504 as a digital message via an IR video sensor as described above in relation to FIGS. 2-4 .
- Computing device 115 in vehicle 504 can determine if the preamble was received correctly.
- computing device 115 in vehicle 504 can energize IR LEDs to emit a sequence of light pulses or modulated IR radiation 512 , 514 and thereby respond with an ACK message. If the preamble was not received correctly, for example, because of optical and environmental factors, computing device 115 in vehicle 504 can energize IR LEDs to emit a sequence of light pulses or modulated IR radiation 512 , 514 representing a NAK message, as discussed above in relation to FIG. 5 .
- computing device 115 in vehicle 502 receives a digital message from computing device 115 in vehicle 504 via an IR video sensor as described above in relation to FIGS. 2-4 .
- computing device 115 can determine if the message included a NAK. If the message did not include a NAK, the branch is taken to step 708 , where a message can be transmitted from computing device 115 in vehicle 502 to computing device 115 in vehicle 504 via a sequence of light pulses or IR radiation 508 , 510 at the first speed.
- a branch is taken to step 710 , where computing device 115 in vehicle 502 can determine a second, slower bit rate or speed at which to communicate with vehicle 504 .
- the slower bit rate can be an incremental decrease in transmission speed caused by increasing PWM length.
- the slower bit rate can be determined by analyzing the bit rate of the NAK as received at computing device 115 .
- Computing device 115 in vehicle 504 can energize IR LEDs to emit modulated IR radiation 512 , 514 at a bit rate predicted by computing device 115 in vehicle 504 to provide reliable communication between vehicle 502 and vehicle 504 as discussed above in relation to FIG. 4 .
- computing device 115 in vehicle 502 can transmit a message to computing device 115 in vehicle 504 via modulated IR radiation 508 , 510 at the second, slower bit rate or speed.
- This message can be a second preamble of three bit pairs to test the second, slower bit rate or computing device 115 determine that computing device 115 in vehicle 504 correctly predicted a reliable transmission speed and use that slower bit rate or speed.
- computing device 115 in vehicle 502 can transmit a message, which can be a BSM to vehicle 504 at the second, slower bit rate without transmitting a second preamble, after which process 700 ends.
- process 700 describes a process wherein computing device 115 transmits a sequence of light pulses at a first speed, receives a sequence of light pulses, determines a second speed based on the received sequence of light pulses, and transmits a message, which can be a BSM, at the second speed.
- FIG. 8 is a diagram of a flowchart, described in relation to FIGS. 1-7 , of a process 800 for transmitting a message, which can be a BSM, at a second speed, e.g., as described above.
- Process 800 can be implemented by a processor of computing device 115 , taking as input information from sensors 116 , and executing instructions and sending control signals via controllers 112 , 113 , 114 , for example.
- Process 800 includes multiple steps taken in the disclosed order.
- Process 800 also includes implementations including fewer steps or can include the steps taken in different orders.
- Process 800 begins at step 802 , where a computing device 115 in a vehicle 602 energizes IR LEDs to emit IR radiation 614 , 616 , 626 , 628 to transmit a sequence of light pulses at a first speed. These light pulses can be received by computing devices 115 in vehicles 604 , 606 , 610 , 612 . Computing devices 115 in vehicles 604 , 606 , 610 , 612 can determine if a slower bit rate is required for reliable communications and transmit a NAK message at that bit rate by energizing IR LEDs to emit IR radiation 618 , 620 , 622 , 624 , 630 , 632 , 634 , 636 to transmit sequences of light pulses.
- computing device 115 in vehicle 602 receives the sequences of light pulses as a digital messages via IR video sensors.
- computing device 115 in vehicle 602 determines which speed, of the speeds of the sequences of light pulses received, is the slowest speed.
- computing device 115 in vehicle 602 transmits a message, which can be a BSM, by energizing IR LEDs to emit IR radiation 614 , 616 , 626 , 628 to transmit a sequence of light pulses at a second speed, where the second speed is equal to the slowest speed determined in step 806 .
- process 800 is a process for transmitting a sequence of light pulses at a first speed, receiving sequences of light pulses from two or more vehicles, determining a second speed based on the two or more sequences of light pulses where the second speed is the slowest speed and transmitting a message at the second speed to the two or more vehicles.
- Computing devices such as those discussed herein generally each include instructions executable by one or more computing devices such as those identified above, and for carrying out blocks or steps of processes described above.
- process blocks discussed above may be embodied as computer-executable instructions.
- Computer-executable instructions may be compiled or interpreted from computer programs created using a variety of programming languages and/or technologies, including, without limitation, and either alone or in combination, JavaTM, C, C++, Visual Basic, Java Script, Perl, HTML, etc.
- a processor e.g., a microprocessor
- receives instructions e.g., from a memory, a computer-readable medium, etc., and executes these instructions, thereby performing one or more processes, including one or more of the processes described herein.
- Such instructions and other data may be stored in files and transmitted using a variety of computer-readable media.
- a file in a computing device is generally a collection of data stored on a computer readable medium, such as a storage medium, a random access memory, etc.
- a computer-readable medium includes any medium that participates in providing data (e.g., instructions), which may be read by a computer. Such a medium may take many forms, including, but not limited to, non-volatile media, volatile media, etc.
- Non-volatile media include, for example, optical or magnetic disks and other persistent memory.
- Volatile media include dynamic random access memory (DRAM), which typically constitutes a main memory.
- DRAM dynamic random access memory
- Computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, an EPROM, a FLASH-EEPROM, any other memory chip or cartridge, or any other medium from which a computer can read.
- exemplary is used herein in the sense of signifying an example, e.g., a reference to an “exemplary widget” should be read as simply referring to an example of a widget.
- adverb “approximately” modifying a value or result means that a shape, structure, measurement, value, determination, calculation, etc. may deviate from an exact described geometry, distance, measurement, value, determination, calculation, etc., because of imperfections in materials, machining, manufacturing, sensor measurements, computations, processing time, communications time, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Electromagnetism (AREA)
- Signal Processing (AREA)
- Optics & Photonics (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Traffic Control Systems (AREA)
- Optical Communication System (AREA)
- Circuit Arrangement For Electric Light Sources In General (AREA)
Abstract
Description
- Vehicles can be equipped to operate in both autonomous and occupant piloted mode. Vehicles can be equipped with computing devices, networks, sensors and controllers to acquire information regarding the vehicle's environment and to pilot the vehicle based on the information. A computing device can also be equipped with computing devices, networks, sensors and controllers to acquire information regarding the vehicle's occupants and to pilot the vehicle based on the information.
- Vehicles can also be equipped with network interfaces to permit communications between computing devices in vehicles and computing devices in other vehicles and between computing devices in vehicles and infrastructure computing devices via networks including BLUETOOTH®, wi-fi, and cellular phone networks, etc. Vehicles can send and receive messages related to traffic safety via network interfaces to and from other vehicles and infrastructure computing devices.
-
FIG. 1 is a block diagram of an example vehicle. -
FIG. 2 is a diagram of a traffic scene. -
FIG. 3 is a diagram of an IR video frame. -
FIG. 4 is a diagram of an IR video frame. -
FIG. 5 is a diagram modulated infrared lighting. -
FIG. 6 is a diagram of a traffic scene. -
FIG. 7 is a flowchart diagram of an example process to modulate infrared lighting. -
FIG. 8 is a flowchart diagram of an example process to modulate infrared lighting. - Vehicles can be equipped to operate in both autonomous and occupant piloted mode. By a semi- or fully-autonomous mode, we mean a mode of operation wherein a vehicle can be piloted by a computing device as part of a vehicle information system having sensors and controllers. The vehicle can be occupied or unoccupied, but in either case the vehicle can be piloted without assistance of an occupant. For purposes of this disclosure, an autonomous mode is defined as one in which each of vehicle propulsion (e.g., via a powertrain including an internal combustion engine and/or electric motor), braking, and steering are controlled by one or more vehicle computers; in a semi-autonomous mode the vehicle computer(s) control(s) one or two of vehicle propulsion, braking, and steering.
- Vehicles can be equipped with computing devices, networks, sensors and controllers to pilot the vehicle and to determine maps of the surrounding real world including features such as roads. Vehicles can be piloted and maps can be determined based on locating and identifying road signs in the surrounding real world. By piloting we mean directing the movements of a vehicle so as to move the vehicle along a roadway or other portion of a path.
- Disclosed is a method, comprising transmitting a sequence of light pulses having a first speed, receiving a second sequence of light pulses from a vehicle, and, transmitting a message as a sequence of light pulses having a second speed based on the second sequence of light pulses received from the vehicle, wherein the first speed is different from the second speed. A computing device can determine the second speed based on the second sequence of light pulses received from the vehicle that is slower than the first speed. The computing device can determine when the vehicle is no longer in proximity and can transmit a sequence of light pulses having a third speed, wherein the third speed is faster than the second speed. The computing device can receive a third sequence of light pulses from a third vehicle and transmits the message as a sequence of light pulses having a third speed based on the third sequence of light pulses received from the vehicle, wherein the third speed is different from the second speed. The light pulses can be modulated IR radiation.
- The message can include information regarding vehicle position, motion, size, safety events, path history and vehicle status, encoded into light pulses as binary bits, wherein the encoding is independent of message transmission speed. The message can also be transmitted via a wireless vehicle-to-vehicle network. The sequences of light pulses can be received via an IR video sensor and the sequences of light pulses can be received from two or more vehicles, wherein emitting the message as a sequence of light pulses having a fourth speed can be based on the sequences of light pulses, wherein the fourth speed is set equal to the slowest of the sequences of light pulses.
- The first speed can be indicated by a preamble including a “101010” bit pattern and the message can be encoded using pulse width modulation. The message can include a basic safety message and the frame rate of the IR video sensor can be increased by sub-sampling.
- Further disclosed is a computer readable medium storing program instructions for executing some or all of the above method steps. Further disclosed is a computer programmed for executing some or all of the above method steps, including a computer apparatus, programmed to transmit a sequence of light pulses having a first speed receive a second sequence of light pulses from a vehicle, and, transmit a message as a sequence of light pulses having a second speed based on the second sequence of light pulses received from the vehicle, wherein the first speed is different from the second speed. A computing device can determine the second speed based on the second sequence of light pulses received from the vehicle that is slower than the first speed. The computing device can determine when the vehicle is no longer in proximity and transmits a sequence of light pulses having a third speed, wherein the third speed is faster than the second speed.
- The computing device can receive a third sequence of light pulses from a third vehicle and transmits the message as a sequence of light pulses having a third speed based on the third sequence of light pulses received from the vehicle, wherein the third speed is different from the second speed. The light pulses are modulated IR radiation and the message can include information regarding vehicle position, motion, size, safety events, path history and vehicle status, encoded into light pulses as binary bits, wherein the encoding is independent of message transmission speed. The message can also be transmitted via a wireless vehicle-to-vehicle network. The sequences of light pulses can be received via an IR video sensor and the sequences of light pulse can be received from one or more vehicles, wherein emitting the message as a sequence of light pulses having a fourth speed is based on the sequences of light pulses, wherein the fourth speed is set equal to the slowest.
-
FIG. 1 is a diagram of avehicle information system 100 that includes avehicle 110 operable in autonomous (“autonomous” by itself in this disclosure means “fully autonomous”) and occupant piloted (also referred to as non-autonomous) mode in accordance with disclosed implementations.Vehicle 110 also includes one ormore computing devices 115 for performing computations for piloting thevehicle 110 during autonomous operation.Computing devices 115 can receive information regarding the operation of the vehicle fromsensors 116. - The
computing device 115 includes a processor and a memory such as are known. Further, the memory includes one or more forms of computer-readable media, and stores instructions executable by the processor for performing various operations, including as disclosed herein. For example, thecomputing device 115 may include programming to operate one or more of vehicle brakes, propulsion (e.g., control of acceleration in thevehicle 110 by controlling one or more of an internal combustion engine, electric motor, hybrid engine, etc.), steering, climate control, interior and/or exterior lights, etc., as well as to determine whether and when thecomputing device 115, as opposed to a human operator, is to control such operations. - The
computing device 115 may include or be communicatively coupled to, e.g., via a vehicle communications bus as described further below, more than one computing devices, e.g., controllers or the like included in thevehicle 110 for monitoring and/or controlling various vehicle components, e.g., apowertrain controller 112, abrake controller 113, asteering controller 114, etc. Thecomputing device 115 is generally arranged for communications on a vehicle communication network such as a bus in thevehicle 110 such as a controller area network (CAN) or the like; thevehicle 110 network can include wired or wireless communication mechanism such as are known, e.g., Ethernet or other communication protocols. - Via the vehicle network, the
computing device 115 may transmit messages to various devices in the vehicle and/or receive messages from the various devices, e.g., controllers, actuators, sensors, etc., includingsensors 116. Alternatively, or additionally, in cases where thecomputing device 115 actually comprises multiple devices, the vehicle communication network may be used for communications between devices represented as thecomputing device 115 in this disclosure. Further, as mentioned below, various controllers or sensing elements may provide data to thecomputing device 115 via the vehicle communication network. - In addition, the
computing device 115 may be configured for communicating through a vehicle-to-infrastructure (V-to-I)interface 111 with aremote server computer 120, e.g., a cloud server, via anetwork 130, which, as described below, may utilize various wired and/or wireless networking technologies, e.g., cellular, BLUETOOTH® and wired and/or wireless packet networks. Thecomputing device 115 also includes nonvolatile memory such as is known.Computing device 115 can log information by storing the information in nonvolatile memory for later retrieval and transmittal via the vehicle communication network and a vehicle to infrastructure (V-to-I)interface 111 to aserver computer 120 or user mobile device 160. - As already mentioned, generally included in instructions stored in the memory and executed by the processor of the
computing device 115 is programming for operating one ormore vehicle 110 components, e.g., braking, steering, propulsion, etc., without intervention of a human operator. Using data received in thecomputing device 115, e.g., the sensor data from thesensors 116, theserver computer 120, etc., thecomputing device 115 may make various determinations and/or controlvarious vehicle 110 components and/or operations without a driver to operate thevehicle 110. For example, thecomputing device 115 may include programming to regulatevehicle 110 operational behaviors such as speed, acceleration, deceleration, steering, etc., as well as tactical behaviors such as a distance between vehicles and/or amount of time between vehicles, lane-change, minimum gap between vehicles, left-turn-across-path minimum, time-to-arrival at a particular location and intersection (without signal) minimum time-to-arrival to cross the intersection. - Controllers, as that term is used herein, include computing devices that typically are programmed to control a specific vehicle subsystem. Examples include a
powertrain controller 112, abrake controller 113, and asteering controller 114. A controller may be an electronic control unit (ECU) such as is known, possibly including additional programming as described herein. The controllers may communicatively be connected to and receive instructions from thecomputing device 115 to actuate the subsystem according to the instructions. For example, thebrake controller 113 may receive instructions from thecomputing device 115 to operate the brakes of thevehicle 110. - The one or
more controllers vehicle 110 may include known electronic control units (ECUs) or the like including, as non-limiting examples, one ormore powertrain controllers 112, one ormore brake controllers 113 and one ormore steering controllers 114. Each of thecontrollers controllers vehicle 110 communications bus, such as a controller area network (CAN) bus or local interconnect network (LIN) bus, to receive instructions from thecomputer 115 and control actuators based on the instructions. -
Sensors 116 may include a variety of devices known to provide data via the vehicle communications bus. For example, a radar fixed to a front bumper (not shown) of thevehicle 110 may provide a distance from thevehicle 110 to a next vehicle in front of thevehicle 110, or a global positioning system (GPS) sensor disposed in thevehicle 110 may provide geographical coordinates of thevehicle 110. The distance provided by the radar or the geographical coordinates provided by the GPS sensor may be used by thecomputing device 115 to operate thevehicle 110 autonomously or semi-autonomously. - The
vehicle 110 is generally a land-basedautonomous vehicle 110 having three or more wheels, e.g., a passenger car, light truck, etc. Thevehicle 110 includes one ormore sensors 116, the V-to-I interface 111, thecomputing device 115 and one ormore controllers - The
sensors 116 may be programmed to collect data related to thevehicle 110 and the environment in which thevehicle 110 is operating. By way of example, and not limitation,sensors 116 may include, e.g., altimeters, cameras, LIDAR, radar, ultrasonic sensors, infrared sensors, pressure sensors, accelerometers, gyroscopes, temperature sensors, pressure sensors, hall sensors, optical sensors, voltage sensors, current sensors, mechanical sensors such as switches, etc. Thesensors 116 may be used to sense the environment in which thevehicle 110 is operating such as weather conditions, the grade of a road, the location of a road or locations of neighboringvehicles 110. Thesensors 116 may further be used to collectdynamic vehicle 110 data related to operations of thevehicle 110 such as velocity, yaw rate, steering angle, engine speed, brake pressure, oil pressure, the power level applied tocontrollers vehicle 110, connectivity between components and electrical and logical health of thevehicle 110. -
Computing device 115 invehicle 110 can communicate withcomputing devices 115 inother vehicles 110 via vehicle-to-vehicle (V-to-V) networking using V-to-I interface 110. V-to-V networking can permit communication with other vehicles via infrastructure-supported networks, or directly with other vehicles via ad hoc networks created spontaneously with nearby vehicles based on signal strength, for example. V-to-V networks can be used to communicate basic safety messages betweenvehicles 110 and thereby assistcomputing device 115 in determining safe operation ofvehicle 110 by transmitting information on the location and motion ofvehicle 110 and receiving information on the location and motion of nearby vehicles. V-to-V networks based on 5.9 GHz frequency bands can be limited to 300 meters range and subject to blackouts due to null regions caused by destructive interference of multiple paths of reflected radio waves, for example. Communicating basic safety messages via modulated infrared (IR) light can provide redundancy to radio wave-based V-to-V communication and thereby increasevehicle 110 safety. - A basic safety message (BSM) is a message for transmission between vehicles via a V-to-V networking and between vehicles and infrastructure computing devices that includes a predetermined set of parameters that can describe the position, motion, and size of a vehicle, for example. BSM contents and transmission are described in SAE standards J2945/1 and J2735, published by the Society of Automotive Engineers, Warrendale, Pa., USA 15096. Table 1 is a description of parameters included in
BSM Part 1. -
TABLE 1 Basic Safety Message, Part I Part I Data Frame (DF) Data Element (DE) Position (DF) Latitude Elevation Longitude Positional accuracy Motion (DF) Transmission state Speed Steering wheel angle Heading Longitudinal acceleration Vertical acceleration Lateral acceleration Yaw rate Brake applied status Traction control state Stability control status Auxiliary brake status Brake applied boost Vehicle size (DF) Vehicle width Vehicle length - Basic Safety Message, Part I includes information regarding the position, motion and size of a
vehicle 110. This information can be used byother computing devices 115 inother vehicles 110 and infrastructure computing devices to determine predicted paths for vehicles and thereby pilot vehicles and control traffic to prevent impacts between vehicles and promote safe and efficient traffic flow, for example. A BSM can encoded as binary characters, grouped into packets identified by headers and protected by checksums to permitcomputing device 115 to reliably communicate messages including a BSM. - It is possible to communicate between
computing devices 115 invehicles 110 and computing devices in traffic control infrastructure such as traffic lights via color video cameras and visible light emitting diodes (LEDs) installed on the traffic signals and color video cameras and LEDs installed in vehicles to transmit messages. This technology operates in visible wavelengths and is limited to V-to-I networks.FIGS. 2-8 include examples of IR LEDs and IR video technology used to permitvehicle 110 to communicate a BSM with other vehicles by modulated IR lighting. In addition to communicating BSMs with other vehicles via radio frequency V-to-V networks, avehicle 110 can communicate BSMs with other vehicles via modulated infrared (IR) light emitting diodes (LEDs) and IR video cameras to provide a redundant channel to communicate safety information between vehicles. - Receiving BSMs at a
computing device 115 includes receiving a stream of modulated IR radiation representing bits of a digital message including the BSM parameters listed in Table 1 via an IR video sensor such as an IR video camera. Modulated IR radiation representing bits of a digital message can also be received via an IR sensor having higher sensitivity and higher bit rates than IR video sensors, however IR sensors lack the XY spatial output of IR video sensors that can be used to discern modulated IR radiation from multiple vehicles as will be discussed later in relation toFIG. 6 . - Digital bit rate achievable via an IR video sensor, unless spatial patterns are included, is limited to ½ the frame rate. A high definition (HD) IR video frame rate can be 60 frames per second (fps), making the highest possible bit rate for a single pixel in the IR video frame 30 bits per second (bps) due to Nyquist sampling limits. Multiple pixels in the frame can be sampled together to form a single bit at this rate, for example. A BSM can include hundreds of bits, for example. At 30 bps, a BSM could take over a minute to receive at IR video frame rates. One solution is to employ high frame rate IR video cameras.
- High frame rate IR video cameras can increase the bit rate at which an IR video camera can receive messages, since high frame rate IR video cameras can operate at up to hundreds of frames per second, however, high frame rate IR video cameras can be much more expensive than HD frame rate IR video cameras. In addition, IR frame rates are limited by the number of IR photons available to the sensor per frame and the signal-to-noise ratio of the sensor. Increasing frame rate decreases the amount of time available for each frame to integrate photon energy impinging upon the sensor and convert it to charge. Thus, high frame rate IR video cameras have upper limits on frame rates achievable in practice.
-
FIG. 2 is a diagram of a technique to increase IR video frame rates to permit timely reception of BSM without the expense associated with high frame rate IR video cameras.FIG. 2 shows anIR video frame 200 that includes an image of avehicle 202 includingIR radiation IR LEDs vehicle 202, for example.IR video frame 200 can have width and height dimensions w=1920, h=1040 in pixels, for example.IR video frame 200 is constructed using complementary metal-oxide semiconductor (CMOS) technology. IR video frames 200 constructed using CMOS can address the sensor array according to the XY address of the pixel in the sensor array. This permits reading out only rectangular subsets of the sensor array instead of the entire array in an efficient fashion, and, since the pixel rate can be constant, reading out a subset of the sensor array permits higher effective frame rates due to the limited number of pixels transferred per frame. -
FIG. 3 shows an IR video frame 212 with two regions of interest (ROIs) 314, 316 formed from video frame 300 that includeIR LEDs IR radiation IR LEDs ROIs -
- In this example, decreasing the number of pixels from n*m to 2(r*p) can increase the frame rate fpsrp and therefore the bit rate from 30 bps up to 180 bps, which can reduce the amount of time required to transmit a BSM from over a minute to a few seconds, making IR communication of BSMs between vehicles practical.
- Increasing frame rates by subsampling IR frames can reach the same photon limits as high frame rate IR sensors, where the integration time for the IR sensor accumulating IR photons between frames becomes so small that the probability of photon events in the sensor becomes low enough to decrease the signal-to-noise ratio to unacceptably low levels. IR LEDs in
vehicles 110 can be designed to emit an appropriate photon flux over the designed viewing angles and range to IR video cameras to be reliably detected at the designed frame rate under normal viewing conditions in order to reliably transmit IR data bits. IR emitting LEDs invehicles 110 can also be designed to provide reliable transmission of data bits under less than perfect conditions by slowing the bit rate of data bits transmitted via IR LED radiation to improve the signal-to-noise ratio of received data bits at IR video cameras without changing the sample rate of the IR video sensor. - IR video sensors can receive IR data bits in modulated IR radiation at bit rates slower than the frame rate by summing or averaging frames over time to reduce the sample rate to match the bit rate of the IR LEDs.
ROIs IR radiation IR video frame 312. The process of locating, tracking, extracting and quantifying multiple sources of IR radiation in anIR video frame 312 can introduce a delay and thereby limit the bit rate for receiving IR data bits via modulated IR radiation. -
FIG. 4 is a diagram of IR lighting modulated to provide transmission of data bits at varying speeds. In the context of this disclosure, the “speed” of a data transmission via light pulses is defined as the number of bits per second transmitted, where a bit is defined as a digital “1” or digital “0” to differentiate it from the number of light pulses transmitted. A single digital 1 or 0 can require more than one light pulse to transmit using pulse width modulation (PWM). The IR lighting can be modulated using PWM that effectively varies the width of emitted IR light pulses to form the 1's and 0's of binary bits. As discussed above, the fastest frame rate is the frame rate at which a single bit emitted from IR LEDs at predetermined intensity, size and distance from an IR video sensor under predetermined environmental conditions can be detected with acceptable reliability. Acceptable reliability can be defined as having a 99.9% probability of true positive detection of a single bit emitted from an IR LED, for example. PWM can increase the reliability with which IR video sensors detect bits by encoding 1's and 0's as different pulse widths, thereby using multiple frames to encode each bit. - First column of
vehicle vehicle 402 at time steps t1 through 16. Each time step can correspond to one or more IR video frames. At time step t1,vehicle 402 has energized IR LEDs included invehicle 402 headlights to emitIR radiation 406, 408 (arrows). At time steps t3 and t4,vehicle 402 IR LEDs are emitting IR radiation. At time step t5,vehicle 402 IR LEDs are not emitting IR radiation. This sequence of three “on” time steps followed by one “off” time step is the PWM encoding for a “1” bit. At time step t1,vehicle 404 has energized IR LEDs to emitIR radiation vehicle 404 has not energized IR LEDs. This sequence of one “on” step followed by three “off” steps is the PWM encoding for a “0” bit. - By encoding a 1 as three “on” time steps followed by an “off” time step and encoding a 0 as one “on” time step followed by three “off” time steps, redundancy is gained and reliability improved at the cost of requiring 4 time steps to communicate one bit. In the example in
FIG. 3 , a 1-bit is identified by a 3:1 ratio of “on” to “off” time periods, while a 0-bit is identified by a 1:3 ratio of “on” to “off” time periods. This is yields a 9:1 ratio between 1-bit and a 0-bit codes, which provides reliable detection. Another advantage of PWM is that since distinguishing 1's from 0's in PWM includes determining the ratio of “on” to “off” time rather than an absolute value, the bit rate can be slowed down without changing the frame rate by simply increasing the number of “on” time steps and the number of “off” time steps to maintain similar ratios of “on” to “off” periods. The receiver can be programmed to determine ratios of “on” to “off” periods to determine 1's and 0's regardless of absolute number of time periods. PWM data transmission is robust, reliable and can be sped up and slowed down without changing the sample rate of the IR video sensor. -
FIG. 5 is a diagram of atraffic scene 500 with twovehicles arrow 506.Vehicle 502 includes IR LEDs that can be energized via controllers at the direction of acomputing device 115 invehicle 502 to emit modulatedIR radiation computing device 115 invehicle 504. Using encoding technology to encode binary data as pulses of radiation from IR LEDs,computing device 115 invehicle 502 can useIR radiation computing device 115 invehicle 504 via IR video cameras invehicle 504.Computing device 115 can transmit a BSM tovehicle 504 viaIR radiation vehicle 504, and receive a BSM from computingdevice 115 invehicle 504 viaIR radiation vehicle 502. - Reception of a BSM by
vehicles IR radiation IR radiation - To permit
vehicles vehicles computing device 115 in receivingvehicle 504 can reliably detect the sequence of three bit pairs,computing device 115 transmits an acknowledgement (ACK) message tocomputing device 115 ofvehicle 502 by energizing IR LEDs to emitIR radiation - If
computing device 115 invehicle 504 detects at least one bit pair, but cannot detect three discrete bit pairs in the received IR data,computing device 115 invehicle 504 can transmit a negative acknowledgement (NAK) message tovehicle 502 viaIR radiation computing device 115 predicts can be reliably received. Upon reception of the NAK message,computing device 115 invehicle 502 can determine the bit rate of the received message and retransmit the “101010” preamble tovehicle 504 at the new, slower bit rate.Vehicle 504 can respond with an ACK or NAK, if NAK, at increasingly slower speeds until a speed is reached that supports reliable communication and an ACK is received, or a lower limit is reached. In cases where a lower limit is reached and no ACK is received in return,computing device 115 invehicle 502 can determine that communication via modulated IR radiation is not currently possible.Computing device 115 can set a flag to cause thecomputing device 115 to try to communicate withvehicle 504 again after a short delay. -
FIG. 6 is a diagram of atraffic scene 600, whereinvehicles arrow 608 andvehicles arrow 614.Vehicle 602 andvehicle 604 can transmit and receive BSMs via modulatingIR radiation vehicle 606 andvehicle 602 transmit and receive BSMs via modulatingIR radiation Vehicle 602 can also transmit and receive BSMs to and fromvehicles 610 by modulatingIR radiation vehicle 612 by modulatingIR radiation Computing device 115 invehicle 602 can determine multiple IR bits from multiple sources of IR radiation in a single IR video frame by forming multiple ROIs to track each source of IR radiation separately, for example. - In this case,
vehicle 602 can negotiate communication speed with each of theother vehicles Vehicle 602 can select the slowest speed of the speeds negotiated withvehicles vehicles Computing device 115 invehicle 602 can keep track of whichvehicle vehicle vehicles nearby vehicle 602,vehicle 602 can increase the speed of transmission to a faster common speed among the remainingvehicles -
FIG. 7 is a diagram of a flowchart, described in relation toFIGS. 1-6 , of aprocess 700 for transmitting a message, which can be a BSM, with modulated IR light pulses, e.g., as described above.Process 700 can be implemented by a processor ofcomputing device 115, taking as input information fromsensors 116, and executing instructions and sending control signals viacontrollers Process 700 includes multiple steps taken in the disclosed order.Process 700 also includes implementations including fewer steps or can include the steps taken in different orders. -
Process 700 begins atstep 702 wherein acomputing device 115 in avehicle 502 energizes IR LEDs to emit a sequence of light pulses or modulatedIR radiation FIG. 5 . This preamble can be received by acomputing device 115 invehicle 504 as a digital message via an IR video sensor as described above in relation toFIGS. 2-4 .Computing device 115 invehicle 504 can determine if the preamble was received correctly. If the preamble was received correctly,computing device 115 invehicle 504 can energize IR LEDs to emit a sequence of light pulses or modulatedIR radiation computing device 115 invehicle 504 can energize IR LEDs to emit a sequence of light pulses or modulatedIR radiation FIG. 5 . - At
step 704,computing device 115 invehicle 502 receives a digital message from computingdevice 115 invehicle 504 via an IR video sensor as described above in relation toFIGS. 2-4 . Atstep 706,computing device 115 can determine if the message included a NAK. If the message did not include a NAK, the branch is taken to step 708, where a message can be transmitted fromcomputing device 115 invehicle 502 tocomputing device 115 invehicle 504 via a sequence of light pulses orIR radiation - In the case where the message includes a NAK, a branch is taken to step 710, where
computing device 115 invehicle 502 can determine a second, slower bit rate or speed at which to communicate withvehicle 504. The slower bit rate can be an incremental decrease in transmission speed caused by increasing PWM length. The slower bit rate can be determined by analyzing the bit rate of the NAK as received atcomputing device 115.Computing device 115 invehicle 504 can energize IR LEDs to emit modulatedIR radiation device 115 invehicle 504 to provide reliable communication betweenvehicle 502 andvehicle 504 as discussed above in relation toFIG. 4 . - At
step 712,computing device 115 invehicle 502 can transmit a message tocomputing device 115 invehicle 504 via modulatedIR radiation computing device 115 determine thatcomputing device 115 invehicle 504 correctly predicted a reliable transmission speed and use that slower bit rate or speed. In this case,computing device 115 invehicle 502 can transmit a message, which can be a BSM tovehicle 504 at the second, slower bit rate without transmitting a second preamble, after which process 700 ends. - In summary,
process 700 describes a process whereincomputing device 115 transmits a sequence of light pulses at a first speed, receives a sequence of light pulses, determines a second speed based on the received sequence of light pulses, and transmits a message, which can be a BSM, at the second speed. -
FIG. 8 is a diagram of a flowchart, described in relation toFIGS. 1-7 , of aprocess 800 for transmitting a message, which can be a BSM, at a second speed, e.g., as described above.Process 800 can be implemented by a processor ofcomputing device 115, taking as input information fromsensors 116, and executing instructions and sending control signals viacontrollers Process 800 includes multiple steps taken in the disclosed order.Process 800 also includes implementations including fewer steps or can include the steps taken in different orders. -
Process 800 begins atstep 802, where acomputing device 115 in avehicle 602 energizes IR LEDs to emitIR radiation devices 115 invehicles Computing devices 115 invehicles IR radiation step 804computing device 115 invehicle 602 receives the sequences of light pulses as a digital messages via IR video sensors. - At
step 806,computing device 115 invehicle 602 determines which speed, of the speeds of the sequences of light pulses received, is the slowest speed. Atstep 808computing device 115 invehicle 602 transmits a message, which can be a BSM, by energizing IR LEDs to emitIR radiation step 806. - In summary,
process 800 is a process for transmitting a sequence of light pulses at a first speed, receiving sequences of light pulses from two or more vehicles, determining a second speed based on the two or more sequences of light pulses where the second speed is the slowest speed and transmitting a message at the second speed to the two or more vehicles. - Computing devices such as those discussed herein generally each include instructions executable by one or more computing devices such as those identified above, and for carrying out blocks or steps of processes described above. For example, process blocks discussed above may be embodied as computer-executable instructions.
- Computer-executable instructions may be compiled or interpreted from computer programs created using a variety of programming languages and/or technologies, including, without limitation, and either alone or in combination, Java™, C, C++, Visual Basic, Java Script, Perl, HTML, etc. In general, a processor (e.g., a microprocessor) receives instructions, e.g., from a memory, a computer-readable medium, etc., and executes these instructions, thereby performing one or more processes, including one or more of the processes described herein. Such instructions and other data may be stored in files and transmitted using a variety of computer-readable media. A file in a computing device is generally a collection of data stored on a computer readable medium, such as a storage medium, a random access memory, etc.
- A computer-readable medium includes any medium that participates in providing data (e.g., instructions), which may be read by a computer. Such a medium may take many forms, including, but not limited to, non-volatile media, volatile media, etc. Non-volatile media include, for example, optical or magnetic disks and other persistent memory. Volatile media include dynamic random access memory (DRAM), which typically constitutes a main memory. Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, an EPROM, a FLASH-EEPROM, any other memory chip or cartridge, or any other medium from which a computer can read.
- All terms used in the claims are intended to be given their plain and ordinary meanings as understood by those skilled in the art unless an explicit indication to the contrary in made herein. In particular, use of the singular articles such as “a,” “the,” “said,” etc. should be read to recite one or more of the indicated elements unless a claim recites an explicit limitation to the contrary.
- The term “exemplary” is used herein in the sense of signifying an example, e.g., a reference to an “exemplary widget” should be read as simply referring to an example of a widget.
- The adverb “approximately” modifying a value or result means that a shape, structure, measurement, value, determination, calculation, etc. may deviate from an exact described geometry, distance, measurement, value, determination, calculation, etc., because of imperfections in materials, machining, manufacturing, sensor measurements, computations, processing time, communications time, etc.
- In the drawings, the same reference numbers indicate the same elements. Further, some or all of these elements could be changed. With regard to the media, processes, systems, methods, etc. described herein, it should be understood that, although the steps of such processes, etc. have been described as occurring according to a certain ordered sequence, such processes could be practiced with the described steps performed in an order other than the order described herein. It further should be understood that certain steps could be performed simultaneously, that other steps could be added, or that certain steps described herein could be omitted. In other words, the descriptions of processes herein are provided for the purpose of illustrating certain embodiments, and should in no way be construed so as to limit the claimed invention.
Claims (20)
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/481,756 US10816644B2 (en) | 2017-04-07 | 2017-04-07 | Modulated infrared lighting |
RU2018110369A RU2018110369A (en) | 2017-04-07 | 2018-03-23 | MODULATED INFRARED LIGHTING |
CN201810281698.7A CN108696320A (en) | 2017-04-07 | 2018-04-02 | The infrared illumination of modulation |
DE102018107854.4A DE102018107854A1 (en) | 2017-04-07 | 2018-04-03 | Modulated infrared lighting |
GB1805771.1A GB2563323A (en) | 2017-04-07 | 2018-04-06 | Modulated infrared lighting |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/481,756 US10816644B2 (en) | 2017-04-07 | 2017-04-07 | Modulated infrared lighting |
Publications (2)
Publication Number | Publication Date |
---|---|
US20180292513A1 true US20180292513A1 (en) | 2018-10-11 |
US10816644B2 US10816644B2 (en) | 2020-10-27 |
Family
ID=62202713
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/481,756 Active 2037-10-31 US10816644B2 (en) | 2017-04-07 | 2017-04-07 | Modulated infrared lighting |
Country Status (5)
Country | Link |
---|---|
US (1) | US10816644B2 (en) |
CN (1) | CN108696320A (en) |
DE (1) | DE102018107854A1 (en) |
GB (1) | GB2563323A (en) |
RU (1) | RU2018110369A (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11005564B2 (en) * | 2019-01-17 | 2021-05-11 | Kookmin University Industry Academy Cooperation Foundation | Communication method and apparatus using hybrid modulation scheme in communication system |
US11055423B2 (en) * | 2018-03-30 | 2021-07-06 | Infineon Technologies Ag | Signal pattern checksum |
US11293758B2 (en) * | 2019-05-22 | 2022-04-05 | Ford Global Technologies, Llc | Systems and methods for increasing the accuracy of vehicle positioning |
US11330432B2 (en) * | 2017-06-27 | 2022-05-10 | Kddi Corporation | Maintenance system and maintenance method |
US11366885B2 (en) * | 2017-08-14 | 2022-06-21 | Kddi Corporation | Vehicle security system and vehicle security method |
US11408273B2 (en) * | 2012-07-20 | 2022-08-09 | Merlin Technology, Inc. | Advanced inground operations, system and associated apparatus |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6959959B2 (en) * | 2019-05-22 | 2021-11-05 | 本田技研工業株式会社 | Software update device, server device, and software update method |
CN112769487B (en) * | 2020-12-31 | 2022-06-21 | 中国人民解放军32181部队 | Individual soldier night vision optical communication helmet system |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030231105A1 (en) * | 2002-06-11 | 2003-12-18 | Jong-Ho Kim | Apparatus for mediating communication between controller and transponders of many moving objects and method for controlling the same |
US20150327028A1 (en) * | 2014-05-09 | 2015-11-12 | Cisco Systems, Inc. | Dynamic adjustment of wireless communication transmission rates |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US15096A (en) | 1856-06-10 | Improvement in reaping and mowing machines | ||
ATE299630T1 (en) | 2002-02-14 | 2005-07-15 | Matsushita Electric Ind Co Ltd | METHOD FOR CONTROLLING DATA RATE IN A WIRELESS PACKET DATA COMMUNICATIONS SYSTEM, TRANSMITTER AND RECEIVER FOR USE THEREOF |
JP3997403B2 (en) | 2002-07-03 | 2007-10-24 | ソニー株式会社 | Vehicle communication device and communication method |
JP2006525591A (en) | 2003-05-07 | 2006-11-09 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Public service system |
US7961086B2 (en) | 2006-04-17 | 2011-06-14 | James Roy Bradley | System and method for vehicular communications |
US8265624B2 (en) * | 2007-09-24 | 2012-09-11 | Kapsch Trafficcom Ag | Method and system for broadcast message transmission in mobile systems |
US8848549B2 (en) * | 2008-09-17 | 2014-09-30 | Qualcomm Incorporated | Optimizing throughput in a wireless communication system |
US20100205321A1 (en) | 2009-02-12 | 2010-08-12 | Qualcomm Incorporated | Negotiable and adaptable periodic link status monitoring |
WO2011137477A1 (en) | 2010-05-04 | 2011-11-10 | Cameron Harrison | Cyclist proximity warning system |
JP5966458B2 (en) | 2011-12-13 | 2016-08-10 | 住友電気工業株式会社 | Road-to-vehicle communication system and optical beacon |
US8868141B2 (en) | 2012-01-23 | 2014-10-21 | Qualcomm Incorporated | Methods and apparatus for controlling the transmission and/or reception of safety messages by portable wireless user devices |
JP5300107B1 (en) | 2012-08-08 | 2013-09-25 | 住友電工システムソリューション株式会社 | Light beacon |
-
2017
- 2017-04-07 US US15/481,756 patent/US10816644B2/en active Active
-
2018
- 2018-03-23 RU RU2018110369A patent/RU2018110369A/en not_active Application Discontinuation
- 2018-04-02 CN CN201810281698.7A patent/CN108696320A/en active Pending
- 2018-04-03 DE DE102018107854.4A patent/DE102018107854A1/en active Pending
- 2018-04-06 GB GB1805771.1A patent/GB2563323A/en not_active Withdrawn
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030231105A1 (en) * | 2002-06-11 | 2003-12-18 | Jong-Ho Kim | Apparatus for mediating communication between controller and transponders of many moving objects and method for controlling the same |
US20150327028A1 (en) * | 2014-05-09 | 2015-11-12 | Cisco Systems, Inc. | Dynamic adjustment of wireless communication transmission rates |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11408273B2 (en) * | 2012-07-20 | 2022-08-09 | Merlin Technology, Inc. | Advanced inground operations, system and associated apparatus |
US20220333480A1 (en) * | 2012-07-20 | 2022-10-20 | Merlin Technology, Inc. | Advanced inground operations, system and associated apparatus |
US11330432B2 (en) * | 2017-06-27 | 2022-05-10 | Kddi Corporation | Maintenance system and maintenance method |
US11366885B2 (en) * | 2017-08-14 | 2022-06-21 | Kddi Corporation | Vehicle security system and vehicle security method |
US11055423B2 (en) * | 2018-03-30 | 2021-07-06 | Infineon Technologies Ag | Signal pattern checksum |
US11005564B2 (en) * | 2019-01-17 | 2021-05-11 | Kookmin University Industry Academy Cooperation Foundation | Communication method and apparatus using hybrid modulation scheme in communication system |
US11293758B2 (en) * | 2019-05-22 | 2022-04-05 | Ford Global Technologies, Llc | Systems and methods for increasing the accuracy of vehicle positioning |
Also Published As
Publication number | Publication date |
---|---|
RU2018110369A (en) | 2019-09-23 |
CN108696320A (en) | 2018-10-23 |
GB2563323A (en) | 2018-12-12 |
GB201805771D0 (en) | 2018-05-23 |
DE102018107854A1 (en) | 2018-10-11 |
US10816644B2 (en) | 2020-10-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10816644B2 (en) | Modulated infrared lighting | |
CN107590768B (en) | Method for processing sensor data for the position and/or orientation of a vehicle | |
US10672206B2 (en) | Systems, methods and apparatuses for diagnostic fault detection by parameter data using a redundant processor architecture | |
CN111201787B (en) | Imaging apparatus, image processing apparatus, and image processing method | |
US11702076B2 (en) | Cargo trailer sensor assembly | |
US20170364758A1 (en) | Systems and methods for vehicle signal light detection | |
US20190073908A1 (en) | Cooperative vehicle operation | |
US10769799B2 (en) | Foreground detection | |
JP2024045402A (en) | Vehicle control device, vehicle control method, vehicle control program | |
US20210362733A1 (en) | Electronic device for vehicle and method of operating electronic device for vehicle | |
US10569770B1 (en) | Driver assistance system | |
CN112389407A (en) | Vehicle parking control | |
US11222540B2 (en) | Vehicle and method of controlling the same | |
WO2023212129A1 (en) | Managing vehicle resources based on scenarios | |
US11610412B2 (en) | Vehicle neural network training | |
CN112550263B (en) | Information processing device, vehicle system, information processing method, and storage medium | |
US20220094435A1 (en) | Visible light communication apparatus, visible light communication method, and visible light communication program | |
US11216677B2 (en) | Signal processing apparatus, signal processing method, program, and moving body | |
KR20190115435A (en) | Electronic device for vehicle and method for operating the same | |
US11417023B2 (en) | Image processing device, image processing method, and program | |
WO2024009739A1 (en) | Optical ranging sensor and optical ranging system | |
US20240083464A1 (en) | Autonomous vehicle monitoring system using system-on-chip on-die resources | |
US20240124060A1 (en) | A method for determining whether an automatic collision avoidance steering maneuver should be executed or not | |
US20240160219A1 (en) | Automated platooning system and method thereof | |
KR20240017183A (en) | Method And Apparatus for Controlling Autonomous Driving Vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: FORD GLOBAL TECHNOLOGIES, LLC, MICHIGAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BIDNER, DAVID KARL;CLARK, TIMOTHY JOSEPH;SIGNING DATES FROM 20170403 TO 20170406;REEL/FRAME:041929/0522 |
|
STCV | Information on status: appeal procedure |
Free format text: NOTICE OF APPEAL FILED |
|
STCV | Information on status: appeal procedure |
Free format text: APPEAL BRIEF (OR SUPPLEMENTAL BRIEF) ENTERED AND FORWARDED TO EXAMINER |
|
STCV | Information on status: appeal procedure |
Free format text: EXAMINER'S ANSWER TO APPEAL BRIEF MAILED |
|
STCV | Information on status: appeal procedure |
Free format text: APPEAL READY FOR REVIEW |
|
STCV | Information on status: appeal procedure |
Free format text: ON APPEAL -- AWAITING DECISION BY THE BOARD OF APPEALS |
|
STCV | Information on status: appeal procedure |
Free format text: BOARD OF APPEALS DECISION RENDERED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |