WO2020139390A1 - Correction de carte à l'aide de données fournies par un véhicule - Google Patents
Correction de carte à l'aide de données fournies par un véhicule Download PDFInfo
- Publication number
- WO2020139390A1 WO2020139390A1 PCT/US2018/068034 US2018068034W WO2020139390A1 WO 2020139390 A1 WO2020139390 A1 WO 2020139390A1 US 2018068034 W US2018068034 W US 2018068034W WO 2020139390 A1 WO2020139390 A1 WO 2020139390A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- vehicle
- data
- stop
- virtual line
- virtual
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/28—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
- G01C21/30—Map- or contour-matching
- G01C21/32—Structuring or formatting of map data
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0108—Measuring and analyzing of parameters relative to traffic conditions based on the source of data
- G08G1/0112—Measuring and analyzing of parameters relative to traffic conditions based on the source of data from the vehicle, e.g. floating car data [FCD]
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0125—Traffic data processing
- G08G1/0133—Traffic data processing for classifying traffic situation
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0137—Measuring and analyzing of parameters relative to traffic conditions for specific applications
- G08G1/0141—Measuring and analyzing of parameters relative to traffic conditions for specific applications for traffic information dissemination
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
- G08G1/096708—Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control
- G08G1/096725—Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control where the received information generates an automatic action on the vehicle control
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
- G08G1/096766—Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission
- G08G1/096775—Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission where the origin of the information is a central station
Definitions
- Vehicles such as vehicles used for ride-sharing purposes, vehicles that provide driver-assist functionality, and/or automated or autonomous vehicles (AVs)—may obtain and process sensor data using an on-board data processing system to perform a variety of functions.
- functions can include determining and/or displaying navigational routes, identifying road signs, detecting objects and/or road obstructions, controlling vehicle operation, and/or the like.
- a vehicle can include an on-board data processing system that receives sensor data captured by various sensors of the vehicle. As a vehicle travels along a route, the on-board data processing system can process the captured sensor data to identify a potential vehicle stop.
- the on-board data processing system can then identify geographical coordinates of the location at which the potential vehicle stop occurred, use artificial intelligence (e.g., a trained neural network, a trained machine learning model, etc.) to classify a situation of the vehicle at the potential stop, determine what caused the vehicle to stop using the classification and/or map data, and determine whether the reason for stopping corresponds with an unmarked intersection and/or a location at which vehicles typically yield to oncoming traffic. If the reason for stopping corresponds with an unmarked intersection and/or a location at which vehicles typically yield to oncoming traffic, the on-board data processing system can generate a virtual stop or yield line at the identified geographic coordinates and/or update internal map data accordingly. Furthermore, the vehicle may transmit information corresponding to the virtual stop or yield line (e.g., a location of the virtual stop line, a reason why the virtual stop line was generated, etc.) to the external system (e.g., a network-accessible server).
- artificial intelligence e.g., a trained neural network, a trained machine learning model,
- One or more vehicles may repeat the operations described above one or more times.
- a vehicle may generate virtual stop or yield line information for a particular location each time the vehicle travels through the location.
- the external system may receive virtual stop or yield line information from one or more vehicles, with some or all of the vehicles providing virtual stop or yield line information multiple times.
- the external system can aggregate or cluster the virtual stop or yield lines generated by the various vehicles for a particular location to identify a representative virtual stop or yield line for that location.
- the external system can then validate the representative virtual stop or yield line by comparing the representative virtual stop or yield line with existing map data. If the representative virtual stop or yield line is validated, the external system can update maps to include the virtual stop or yield line and transmit the updated maps to one or more vehicles.
- on-board and off-board systems can work together to identify unobservable features of a road network and update maps accordingly.
- One aspect of the disclosure provides a vehicle comprising a plurality of sensors, where a first sensor in the plurality of sensors is configured to generate velocity data, and where a second sensor in the plurality of sensors is configured to generate location data.
- the vehicle further comprises a processor configured with computer- executable instructions, where the computer-executable instructions, when executed, cause the processor to: detect a vehicle stop at a first time instant using the generated velocity data; determine a location of the vehicle at the first time instant using the generated location data; determine, using a deep neural network stored on the vehicle, a situation of the vehicle at the determined location; determine, based on at least one of the determined situation or map data, that a cause of the detected vehicle stop is the vehicle arriving at the unmarked intersection; generate virtual stop line data in response to determining that the cause of the detected vehicle stop is the vehicle arriving at an unmarked intersection; and transmit the virtual stop line data to a server over a network via a communication array.
- the vehicle of the preceding paragraph can include any sub-combination of the following features: where the location of the vehicle comprises geographical coordinates of the vehicle at the first time instant and a lane on a road in which the vehicle was positioned at the first time instant; where the computer-executable instructions, when executed, further cause the processor to: generate a grid map, apply the grid map as an input to the deep neural network, and determine the situation of the vehicle based on an output of the deep neural network; where the computer-executable instructions, when executed, further cause the processor to: obtain the map data and at least one of light detection and ranging (LiDAR) data, radar data, or camera data, and generate an image in which information derived from the map data is laid over information derived from at least one of the LiDAR data, the radar data, or the camera data to form the grid map; where the computer- executable instructions, when executed, further cause the processor to train the deep neural network using a training set of grid maps; where the computer-executable instructions, when executed, further cause the
- Another aspect of the disclosure provides a method implemented by a vehicle.
- the method comprises: detecting a vehicle stop at a first time instant using velocity data measured by the vehicle; determining a location of the vehicle at the first time instant; determining, based in part on execution of an artificial intelligence engine running on the vehicle, that a cause of the detected vehicle stop is the vehicle arriving at an unmarked intersection; generating virtual stop line data in response to determining that the cause of the detected vehicle stop is the vehicle arriving at the unmarked intersection; and transmitting the virtual stop line data to a server over a network.
- the method of the preceding paragraph can include any sub-combination of the following features: where the location of the vehicle comprises at least one of geographical coordinates of the vehicle at the first time instant or a lane on a road in which the vehicle was positioned at the first time instant; where determining that a cause of the detected vehicle stop is the vehicle arriving at an unmarked intersection further comprises: generating a grid map, applying the grid map as an input to the artificial intelligence engine, determining a situation of the vehicle based on an output of the artificial intelligence engine, and determining the cause based on at least one of the determined situation or map data; where generating a grip map further comprises: obtaining map data and at least one of light detection and ranging (LiDAR) data, radar data, or camera data, and generating an image in which information derived from the map data is laid over information derived from at least one of the LiDAR data, the radar data, or the camera data to form the grid map; where the artificial intelligence engine is one of a deep neural network or a machine learning model; where
- Another aspect of the disclosure provides non-transitory, computer-readable storage media comprising computer executable instructions for identifying a virtual stop line, where the computer-executable instructions, when executed by a vehicle, cause the vehicle to: detect a vehicle stop at a first time instant using velocity data measured by the vehicle; determine a location of the vehicle at the first time instant; determine, based in part on execution of an artificial intelligence engine running on the vehicle, that a cause of the detected vehicle stop is the vehicle arriving at an unmarked intersection; generate virtual stop line data in response to determining that the cause of the detected vehicle stop is the vehicle arriving at the unmarked intersection; and transmit the virtual stop line data external to the vehicle.
- the non-transitory, computer-readable storage media of the preceding paragraph can include any sub-combination of the following features: where the location of the vehicle comprises at least one of geographical coordinates of the vehicle at the first time instant or a lane on a road in which the vehicle was positioned at the first time instant; where the computer-executable instructions, when executed, further cause the vehicle to: generate a grid map, apply the grid map as an input to the artificial intelligence engine, determine a situation of the vehicle based on an output of the artificial intelligence engine, and determine the cause based on at least one of the determined situation or map data; and where the artificial intelligence engine is one of a deep neural network or a machine learning model.
- the system further comprises a computing device in communication with the plurality of vehicles over a network, the computing device comprising a processor configured with computer-executable instructions that, when executed, cause the computing device to: obtain first virtual line data from a first vehicle in the plurality of vehicles; obtain second virtual line data from a second vehicle in the plurality of vehicles; aggregate the first virtual line data and the second virtual line data using a statistical analysis; and determine a representative virtual line based on the aggregation of the first virtual line data and the second virtual line data, where the representative virtual line, when incorporated into map data, causes at least some of the vehicles in the plurality of vehicles to operate in accordance with the representative virtual line.
- the system of the preceding paragraph can include any sub-combination of the following features: where the first virtual line data is one of first virtual stop line data or first virtual yield line data; where the representative virtual line is one of a representative virtual stop line or a representative virtual yield line; where the computer-executable instructions, when executed, further cause the computing device to select one of a first virtual line corresponding to the first virtual line data or a second virtual line corresponding to the second virtual line data as the representative virtual line; where the representative virtual line corresponds to at least one of a geographic location, a range of geographic locations, or a lane in a road derived from the aggregation of the first virtual line data and the second virtual line data; where the first virtual line data corresponds to a first intersection, and the second virtual line data corresponds to the first intersection; where the first virtual line data corresponds to a first location in the first intersection, and where the second virtual line data corresponds to a second location different than the first location in the first intersection; where the computer-executable instructions, when executed, further cause
- Another aspect of the disclosure provides computer-implemented method comprising: as implemented by one or more computing devices in communication with a first vehicle over a network, obtaining first virtual line data from the first vehicle, where the first virtual line data corresponds to a first time instant and a first intersection; obtaining second virtual line data from the first vehicle, where the second virtual line data corresponds to a second time instant after the first time instant and the first intersection; clustering the first virtual line data and the second virtual line data; and determining a representative virtual line based on the clustering of the first virtual line data and the second virtual line data, where the representative virtual line, when accessed, causes at least one of the first vehicle or another vehicle to operate in accordance with the representative virtual line.
- the computer-implemented method of the preceding paragraph can include any sub-combination of the following features: where the first virtual line data is one of first virtual stop line data or first virtual yield line data; where the representative virtual line is one of a representative virtual stop line or a representative virtual yield line; where determining a representative virtual line further comprises selecting one of a first virtual line corresponding to the first virtual line data or a second virtual line corresponding to the second virtual line data to be the representative virtual line; where the representative virtual line, when accessed, causes at least one of the first vehicle or another vehicle to stop at a location corresponding to the representative virtual line; where the first virtual line data corresponds to a first location in the first intersection, and where the second virtual line data corresponds to a second location different than the first location in the first intersection; and where the first vehicle is at least one of an autonomous vehicle, a vehicle that provides one or more driver-assist features, or a vehicle used to offer location-based services.
- Another aspect of the disclosure provides non-transitory, computer-readable storage media comprising computer executable instructions for identifying a representative virtual line, where the computer-executable instructions, when executed by a computing system, cause the computing system to: obtain first virtual line data from a first vehicle, where the first virtual line data corresponds to a first time instant; obtain second virtual line data from the first vehicle, where the second virtual line data corresponds to a second time instant after the first time instant; cluster the first virtual line data and the second virtual line data; and determine a representative virtual line based on the clustering of the first virtual line data and the second virtual line data, where the representative virtual line, when accessed, causes at least one of a driver alert to be generated or vehicle operation to commence in accordance with the representative virtual line.
- the non-transitory, computer-readable storage media of the preceding paragraph can include any sub-combination of the following features: where the representative virtual line is one of a representative virtual stop line or a representative virtual yield line; and where the driver alert comprises an indication that the first vehicle should stop at a location corresponding to the representative virtual line.
- the system further comprises a computing device in communication with the plurality of vehicles over a network, the computing device comprising a processor configured with computer-executable instructions that, when executed, cause the computing device to: obtain first virtual line data from a first vehicle in the plurality of vehicles; obtain second virtual line data from a second vehicle in the plurality of vehicles; determine a representative virtual line based on the first virtual line data and the second virtual line data; validate the representative virtual line; update map data to incorporate the representative virtual line; and transmit the updated map data to the plurality of vehicles, where the updated map data, when accessed, causes at least some of the vehicles in the plurality of vehicles to operate in accordance with the representative virtual line.
- the system of the preceding paragraph can include any sub-combination of the following features: where the first virtual line data is one of first virtual stop line data or first virtual yield line data; where the representative virtual line is one of a representative virtual stop line or a representative virtual yield line; where the computer-executable instructions, when executed, further cause the computing device to: compare the representative virtual line with a marked line present in the map data, determine that the representative virtual line is at least a threshold distance away from the marked line based on the comparison, and validate the representative virtual line based on the determination that the representative virtual line is at least the threshold distance away from the marked line; where the representative virtual line corresponds to at least one of a geographic location, a range of geographic locations, or a lane in a road derived from at least one of the first virtual line data and the second virtual line data; where the first virtual line data corresponds to a first intersection, and the second virtual line data corresponds to the first intersection; where the first virtual line data corresponds to a first location in the first intersection, and where the second
- Another aspect of the disclosure provides a computer-implemented method comprising: as implemented by one or more computing devices in communication with a first vehicle over a network, obtaining first virtual line data from the first vehicle, where the first virtual line data corresponds to a first time instant and a first intersection; obtaining second virtual line data from the first vehicle, where the second virtual line data corresponds to a second time instant after the first time instant and the first intersection; determining a representative virtual line based on the first virtual line data and the second virtual line data; updating map data to incorporate the representative virtual line; and transmitting the updated map data to the first vehicle, where the updated map data, when accessed, causes at least one of the first vehicle or another vehicle to operate in accordance with the representative virtual line.
- the computer-implemented method of the preceding paragraph can include any sub-combination of the following features: where the first virtual line data is one of first virtual stop line data or first virtual yield line data; where the representative virtual line is one of a representative virtual stop line or a representative virtual yield line; where the computer-implemented method further comprises determining that a validation of the representative virtual line succeeded; where determining that a validation of the representative virtual line succeeded further comprises: comparing the representative virtual line with a marked line present in the map data, determining that the representative virtual line is at least a threshold distance away from the marked line based on the comparison, and validating the representative virtual line based on the determination that the representative virtual line is at least the threshold distance away from the marked line; where the updated map data, when accessed, causes at least one of the first vehicle or another vehicle to stop at a location corresponding to the representative virtual line; and where the first vehicle is at least one of an autonomous vehicle, a vehicle that provides one or more driver-assist features, or a vehicle used to offer location-
- Another aspect of the disclosure provides non-transitory, computer-readable storage media comprising computer executable instructions for editing a map, where the computer-executable instructions, when executed by a computing system, cause the computing system to: obtain first virtual line data from the first vehicle, where the first virtual line data corresponds to a first time instant; obtain second virtual line data from the first vehicle, where the second virtual line data corresponds to a second time instant after the first time instant; determine a representative virtual line based on the first virtual line data and the second virtual line data; update map data to incorporate the representative virtual line; and transmit the updated map data to the first vehicle, where the updated map data, when accessed, causes at least one of an alert to be generated for display in the first vehicle or operation of the first vehicle to commence in accordance with the representative virtual line.
- the non-transitory, computer-readable storage media of the preceding paragraph can include any sub-combination of the following features: where the representative virtual line is one of a representative virtual stop line or a representative virtual yield line; and where the alert comprises an indication that the first vehicle should stop at a location corresponding to the representative virtual line.
- a vehicle comprising a first sensor configured to generate velocity data.
- the vehicle further comprises: a processor configured with computer-executable instructions, where the computer-executable instructions, when executed, cause the processor to: identify, based on the velocity data, a trough in a plurality of velocity values, where the trough occurs at a first time instant; determine that a first velocity value in the plurality of velocity values that corresponds to the first time instant is below a velocity threshold value; determine that a prior vehicle stop occurred at a second time instant that is less than a threshold time before the first time instant; determine that a velocity of the vehicle increased by at least a velocity ripple value between the second time instant and the first time instant; and detect a second vehicle stop at the first time instant in response to the determination that the velocity of the vehicle increased by at least the velocity ripple value between the second time instant and the first time instant.
- the vehicle of the preceding paragraph can include any sub-combination of the following features: where the prior vehicle stop corresponds to a second trough in the plurality of velocity values, where the second trough corresponds to the second time instant; the second trough corresponds to a second velocity value in the plurality of velocity values, and where a difference between a third velocity value in the plurality of velocity values corresponding to a third time instant between the first and second time instants and the second velocity value is greater than the velocity ripple value; where the computer- executable instructions, when executed, further cause the processor to: identify, based on the velocity data, a second trough in the plurality of velocity values, where the second trough occurs at a third time instant after the first time instant, determine that a second velocity value in the plurality of velocity values that corresponds to the third time instant is above the velocity threshold value, and determine that a third vehicle stop did not occur at the third time instant; where the computer-executable instructions, when executed, further cause the processor to: identify, based on the velocity
- Another aspect of the disclosure provides a method implemented by a vehicle.
- the method comprises: obtaining velocity data from a first sensor coupled to or embedded within the vehicle; determining, based on the velocity data, that a first velocity value corresponding to a first time instant is below a velocity threshold value; determining that a prior vehicle stop occurred at a second time instant that is less than a threshold time before the first time instant; determining that a velocity of the vehicle increased by at least a velocity ripple value between the second time instant and the first time instant; and detecting a second vehicle stop at the first time instant in response to the determination that the velocity of the vehicle increased by at least the velocity ripple value between the second time instant and the first time instant.
- the method of the preceding paragraph can include any sub-combination of the following features: where the prior vehicle stop corresponds to a second velocity value, where the second velocity value is at a trough of velocity values; where a difference between a third velocity value corresponding to a third time instant between the first and second time instants and the second velocity value is greater than the velocity ripple value; where the method further comprises: identifying, based on the velocity data, a second velocity value corresponding to a third time instant after the first time instant, determining that the second velocity value is above the velocity threshold value, and determining that a third vehicle stop did not occur at the third time instant; where the method further comprises: identifying, based on the velocity data, a second velocity value corresponding to a third time instant after the first time instant, determining that the second velocity value is below the velocity threshold value, determining that the second vehicle stop occurred more than the threshold time before the third time instant, and detecting a third vehicle stop at the third time instant; where the method further comprises: identifying, based on the
- Another aspect of the disclosure provides non-transitory, computer-readable storage media comprising computer executable instructions for detecting a stop, where the computer-executable instructions, when executed by a vehicle, cause the vehicle to: determine, based on velocity data obtained from a first sensor of the vehicle, that a first velocity value corresponding to a first time instant is below a velocity threshold value; determine that a prior vehicle stop occurred at a second time instant that is less than a threshold time before the first time instant; determine that a velocity of the vehicle increased by at least a velocity ripple value between the second time instant and the first time instant; and detect a second vehicle stop at the first time instant in response to the determination that the velocity of the vehicle increased by at least the velocity ripple value between the second time instant and the first time instant.
- the non-transitory, computer-readable storage media of the preceding paragraph can include any sub-combination of the following features: where the computer- executable instructions, when executed, further cause the vehicle to: identify, based on the velocity data, a second velocity value corresponding to a third time instant after the first time instant, determine that the second velocity value is above the velocity threshold value, and determine that a third vehicle stop did not occur at the third time instant; where the computer-executable instructions, when executed, further cause the vehicle to: identify, based on the velocity data, a second velocity value corresponding to a third time instant after the first time instant, determine that the second velocity value is below the velocity threshold value, determine that the second vehicle stop occurred more than the threshold time before the third time instant, and detect a third vehicle stop at the third time instant; and where the computer-executable instructions, when executed, further cause the vehicle to: identify, based on the velocity data, a second velocity value corresponding to a third time instant after the first time instant, determine that the second velocity value is below the
- a vehicle comprising a plurality of sensors, where a first sensor in the plurality of sensors is configured to generate velocity data, and where a second sensor in the plurality of sensors is configured to generate location data.
- the vehicle further comprises a processor configured with computer- executable instructions, where the computer-executable instructions, when executed, cause the processor to: detect a vehicle stop at a first time instant using the generated velocity data; determine a location of the vehicle at the first time instant using the generated location data; determine, using a deep neural network stored on the vehicle, a situation of the vehicle at the determined location; determine, based on at least one of the determined situation or map data, that a cause of the detected vehicle stop is a road obstacle; generate virtual stop line data in response to determining that the cause of the detected vehicle stop is the road obstacle, where the virtual stop line data comprises an indication of a hidden problem at the determined location; and transmit the virtual stop line data to a server over a network via a communication array.
- the vehicle of the preceding paragraph can include any sub-combination of the following features: where the location of the vehicle comprises geographical coordinates of the vehicle at the first time instant and a lane on a road in which the vehicle was positioned at the first time instant; where the computer-executable instructions, when executed, further cause the processor to: generate a grid map, apply the grid map as an input to the deep neural network, and determine the situation of the vehicle based on an output of the deep neural network; where the computer-executable instructions, when executed, further cause the processor to: obtain the map data and at least one of light detection and ranging (LiDAR) data, radar data, or camera data, and generate an image in which information derived from the map data is laid over information derived from at least one of the LiDAR data, the radar data, or the camera data to form the grid map; where the computer- executable instructions, when executed, further cause the processor to train the deep neural network using a training set of grid maps; where the computer-executable instructions, when executed, further cause the
- Another aspect of the disclosure provides a method implemented by a vehicle.
- the method comprises: detecting a vehicle stop at a first time instant using velocity data measured by the vehicle; determining a location of the vehicle at the first time instant; determining, based in part on execution of an artificial intelligence engine running on the vehicle, that a cause of the detected vehicle stop is a road obstacle; generating virtual stop line data in response to determining that the cause of the detected vehicle stop is the road obstacle, where the virtual stop line data comprises an indication of a hidden danger at the determined location; and transmitting the virtual stop line data to a server over a network.
- the method of the preceding paragraph can include any sub-combination of the following features: where the method further comprises operating in a sensitive mode at the determined location in response to accessing map data incorporating information derived from the virtual stop line data; where determining that a cause of the detected vehicle stop is road obstacle further comprises: generating a grid map, applying the grid map as an input to the artificial intelligence engine, determining a situation of the vehicle based on an output of the artificial intelligence engine, and determining the cause based on at least one of the determined situation or map data; where generating a grip map further comprises: obtaining map data and at least one of light detection and ranging (LiDAR) data, radar data, or camera data, and generating an image in which information derived from the map data is laid over information derived from at least one of the LiDAR data, the radar data, or the camera data to form the grid map; where the artificial intelligence engine is one of a deep neural network or a machine learning model; where the road obstacle comprises at least one of a speed bump, a gutter
- Another aspect of the disclosure provides non-transitory, computer-readable storage media comprising computer executable instructions for identifying a virtual stop line, where the computer-executable instructions, when executed by a vehicle, cause the vehicle to: detect a vehicle stop at a first time instant using velocity data measured by the vehicle; determine a location of the vehicle at the first time instant; determine, based in part on execution of an artificial intelligence engine running on the vehicle, that a cause of the detected vehicle stop is a road obstacle; generate virtual stop line data in response to determining that the cause of the detected vehicle stop is the road obstacle, where the virtual stop line data comprises an indication of a hidden danger at the determined location; and transmit the virtual stop line data external to the vehicle.
- the non-transitory, computer-readable storage media of the preceding paragraph can include any sub-combination of the following features: where the computer- executable instructions, when executed, further cause the vehicle to operate in a sensitive mode at the determined location in response to accessing map data incorporating information derived from the virtual stop line data; where the computer-executable instructions, when executed, further cause the vehicle to: generate a grid map, apply the grid map as an input to the artificial intelligence engine, determine a situation of the vehicle based on an output of the artificial intelligence engine, and determine the cause based on at least one of the determined situation or map data; and where the artificial intelligence engine is one of a deep neural network or a machine learning model.
- FIG. 1A illustrates a block diagram of a networked vehicle environment in which one or more vehicles and/or one or more user devices interact with a server via a network, according to one embodiment.
- FIG. 1B illustrates a block diagram showing the vehicle of FIG. 1A in communication with one or more other vehicles and/or the server of FIG. 1A, according to one embodiment.
- FIG.2 illustrates a block diagram of the networked vehicle environment of FIG. 1A in which the vehicle generates virtual stop or yield lines and the server aggregates multiple virtual stop or yield lines to identify a representative virtual stop or yield line, according to one embodiment.
- FIG. 3 illustrates a block diagram showing the operations performed by the vehicle to generate a virtual stop line, according to one embodiment.
- FIG. 4A illustrates a block diagram showing the operations performed by vehicle(s) and the server to update a map to include a representative virtual stop line, according to one embodiment.
- FIG. 4B illustrates a block diagram showing the operations performed by the vehicle(s) and the server to provide vehicle(s) with updated maps, according to one embodiment.
- FIGS. 5A-5B illustrate various velocity graphs that visually explain how the vehicle stop detector of FIG.2 detects an actual stop.
- FIG. 6A illustrates an example unmarked intersection at which actual stops may be detected and virtual stop lines may be generated, according to one embodiment.
- FIG. 6B illustrates an example unmarked, yield intersection at which actual stops may be detected and virtual yield lines may be generated, according to one embodiment.
- FIG. 7 shows a flow diagram illustrative of embodiments of a routine implemented by the vehicle to generate a virtual stop line.
- FIG. 8 shows a flow diagram illustrative of embodiments of a routine implemented by the server to identify a representative virtual stop line.
- FIG. 9 shows a flow diagram illustrative of embodiments of a routine implemented by the server to update or edit a map based on vehicle-provided data.
- FIG. 10 shows a flow diagram illustrative of embodiments of a routine implemented by the vehicle to detect a stop.
- FIG. 11 shows a flow diagram illustrative of embodiments of a routine implemented by the vehicle to generate virtual stop line data that includes an indication of a hidden problem at the location of the virtual stop line.
- vehicles such as vehicles used for ride-sharing purposes, vehicles that provide driver-assist functionality, and/or automated or autonomous vehicles (AVs)—may obtain and process sensor data using an on-board data processing system to perform a variety of functions.
- a vehicle can obtain sensor data to capture features of a road network.
- the vehicle or an external system can then use the captured road network features to update maps (e.g., 2D and/or 3D geographic maps, such as road maps, terrain maps, etc.) for use by vehicles in the future to aid with navigation, driving, and/or maneuvering.
- maps e.g., 2D and/or 3D geographic maps, such as road maps, terrain maps, etc.
- the vehicle may only be able to capture features of a road network that are observable. For example, crosswalks, intersection stop lines, and/or other painted road markings are observable features of a road network that can be captured and converted into data for updating maps.
- Other features of a road network may be unobservable, such as locations at which vehicles stop in an unmarked intersection or the proper positions for vehicles to wait to yield to merging and/or oncoming traffic. While unobservable, it may be desirable that these features be incorporated into maps to aid with vehicle navigation, driving, and/or maneuvering. In particular, incorporating these unobservable features into maps may help vehicles avoid collisions, avoid unnecessary stops, conserve fuel, and/or the like.
- a user may attempt to manually label a map to incorporate unobservable features.
- an appropriate position for a vehicle to stop at an unmarked intersection or before merging with traffic may be dependent on various factors that are only observable by a vehicle at the location of the unmarked intersection or yielding area.
- Such factors can include the density of vehicle traffic at the location, the speed at which oncoming vehicles typically travel, a number of pedestrians that are typically present, whether oncoming traffic is sufficiently visible to make a decision on whether to proceed or remain in a stopped state (e.g., whether trees, buildings, or other objects are obstructing a view of oncoming traffic), whether road hazards (e.g., potholes, construction, uneven surfaces, etc.) are present and/or the location of such hazards, and/or the like.
- road hazards e.g., potholes, construction, uneven surfaces, etc.
- a vehicle can include an on-board data processing system that receives sensor data captured by various sensors of the vehicle. As a vehicle travels along a route, the on-board data processing system can process the captured sensor data to identify a potential vehicle stop (e.g., an event at which a vehicle is traveling at less than a threshold velocity for at least a threshold period of time).
- a potential vehicle stop e.g., an event at which a vehicle is traveling at less than a threshold velocity for at least a threshold period of time.
- the on-board data processing system can then identify geographical coordinates of the location at which the potential vehicle stop occurred, use artificial intelligence (e.g., a trained neural network, a trained machine learning model, etc.) to classify a situation of the vehicle at the potential stop, determine what caused the vehicle to stop using the classification and/or map data, and determine whether the reason for stopping corresponds with an unmarked intersection and/or a location at which vehicles typically yield to oncoming traffic. If the reason for stopping corresponds with an unmarked intersection and/or a location at which vehicles typically yield to oncoming traffic, the on-board data processing system can generate a virtual stop or yield line at the identified geographic coordinates and/or update or edit internal map data accordingly. Furthermore, the vehicle may transmit information corresponding to the virtual stop or yield line (e.g., a location of the virtual stop line, a reason why the virtual stop line was generated, etc.) to the external system (e.g., a network-accessible server).
- artificial intelligence e.g., a trained neural network, a trained machine learning
- One or more vehicles may repeat the operations described above one or more times. For example, a vehicle may generate virtual stop or yield line information for a particular location each time the vehicle travels through the location. Thus, for a particular location, the external system may receive virtual stop or yield line information from one or more vehicles, with some or all of the vehicles providing virtual stop or yield line information multiple times. The external system can aggregate or cluster the virtual stop or yield lines generated by the various vehicles for a particular location to identify a representative virtual stop or yield line for that location. The external system can then validate the representative virtual stop or yield line by comparing the representative virtual stop or yield line with existing map data.
- the external system can update or edit maps to include the virtual stop or yield line and transmit the updated maps to one or more vehicles.
- on-board and off-board systems can work together to identify unobservable features of a road network and update maps accordingly.
- the map creation and update framework described herein can not only improve vehicle navigation, driving, and/or maneuvering by incorporating unobservable road network features into maps used by vehicles, but the framework can also reduce network congestion and protect the privacy of location-sensitive data.
- sensors of a vehicle may capture sensor data often (e.g., every 1 ms, every 5 ms, etc.), and therefore the amount of raw sensor data captured by a vehicle and used for identifying a virtual stop or yield line can be very large (e.g., in the gigabytes, in the terabytes, etc.).
- the vehicle can instead process the raw sensor data internally and simply transmit an output (e.g., the location of a potential virtual stop or yield line) to the external system.
- an output e.g., the location of a potential virtual stop or yield line
- the raw sensor data may include sensitive user data, such as user location, driving habits, etc.
- FIG. 1A illustrates a block diagram of a networked vehicle environment 100 in which one or more vehicles 120 and/or one or more user devices 102 interact with a server 130 via a network 110, according to one embodiment.
- the vehicles 120 may be equipped to provide ride-sharing and/or other location-based services, to assist drivers in controlling vehicle operation (e.g., via various driver-assist features, such as adaptive and/or regular cruise control, adaptive headlight control, anti-lock braking, automatic parking, night vision, blind spot monitor, collision avoidance, crosswind stabilization, driver drowsiness detection, driver monitoring system, emergency driver assistant, intersection assistant, hill descent control, intelligent speed adaptation, lane centering, lane departure warning, forward, rear, and/or side parking sensors, pedestrian detection, rain sensor, surround view system, tire pressure monitor, traffic sign recognition, turning assistant, wrong-way driving warning, traffic condition alerts, etc.), and/or to fully control vehicle operation.
- driver-assist features such as adaptive and/or regular cruise control, adaptive headlight control, anti-
- the vehicles 120 can be regular gasoline, natural gas, biofuel, electric, hydrogen, etc. vehicles configured to offer ride-sharing and/or other location-based services, vehicles that provide driver-assist functionality (e.g., one or more of the driver- assist features described herein), and/or automated or autonomous vehicles (AVs).
- the vehicles 120 can be automobiles, trucks, vans, buses, motorcycles, scooters, bicycles, and/or any other motorized vehicle.
- the server 130 can communicate with the vehicles 120 to obtain vehicle data, such as route data, sensor data, perception data, vehicle 120 control data, vehicle 120 component fault and/or failure data, etc.
- vehicle data such as route data, sensor data, perception data, vehicle 120 control data, vehicle 120 component fault and/or failure data, etc.
- the server 130 can process and store the vehicle data for use in other operations performed by the server 130 and/or another computing system (not shown).
- Such operations can include running diagnostic models to identify vehicle 120 operational issues (e.g., the cause of vehicle 120 navigational errors, unusual sensor readings, an object not being identified, vehicle 120 component failure, etc.); running models to simulate vehicle 120 performance given a set of variables; identifying objects that cannot be identified by a vehicle 120, generating control instructions that, when executed by a vehicle 120, cause the vehicle 120 to drive and/or maneuver in a certain manner along a specified path; and/or the like.
- vehicle data such as route data, sensor data, perception data, vehicle 120 control data, vehicle 120 component fault and/or failure data, etc
- the server 130 can also transmit data to the vehicles 120.
- the server 130 can transmit map data, firmware and/or software updates, vehicle 120 control instructions, an identification of an object that could not otherwise be identified by a vehicle 120, passenger pickup information, traffic data, and/or the like.
- the server 130 can communicate with one or more user devices 102.
- the server 130 can provide a network service to enable a user to request, via an application running on a user device 102, location-based services (e.g., transportation services, such as ride-sharing services).
- the user devices 102 can correspond to a computing device, such as a smart phone, tablet, laptop, smart watch, or any other device that can communicate over the network 110 with the server 130.
- a user device 102 executes an application, such as a mobile application, that the user operating the user device 102 can use to interact with the server 130.
- the user device 102 can communicate with the server 130 to provide location data and/or queries to the server 130, to receive map-related data and/or directions from the server 130, and/or the like.
- the server 130 can process requests and/or other data received from user devices 102 to identify service providers (e.g., vehicle 120 drivers) to provide the requested services for the users.
- the server 130 can receive data—such as user trip pickup or destination data, user location query data, etc.—based on which the server 130 identifies a region, an address, and/or other location associated with the various users.
- the server 130 can then use the identified location to provide services providers and/or users with directions to a determined pickup location.
- the application running on the user device 102 may be created and/or made available by the same entity responsible for the server 130.
- the application running on the user device 102 can be a third-party application that includes features (e.g., an application programming interface or software development kit) that enables communications with the server 130.
- a single server 130 is illustrated in FIG. 1A for simplicity and ease of explanation. It is appreciated, however, that the server 130 may be a single computing device, or may include multiple distinct computing devices logically or physically grouped together to collectively operate as a server system.
- the components of the server 130 can be implemented in application-specific hardware (e.g., a server computing device with one or more ASICs) such that no software is necessary, or as a combination of hardware and software.
- the modules and components of the server 130 can be combined on one server computing device or separated individually or into groups on several server computing devices.
- the server 130 may include additional or fewer components than illustrated in FIG.1A.
- the network 110 includes any wired network, wireless network, or combination thereof.
- the network 110 may be a personal area network, local area network, wide area network, over-the-air broadcast network (e.g., for radio or television), cable network, satellite network, cellular telephone network, or combination thereof.
- the network 110 may be a publicly accessible network of linked networks, possibly operated by various distinct parties, such as the Internet.
- the network 110 may be a private or semi-private network, such as a corporate or university intranet.
- the network 110 may include one or more wireless networks, such as a Global System for Mobile Communications (GSM) network, a Code Division Multiple Access (CDMA) network, a Long Term Evolution (LTE) network, or any other type of wireless network.
- GSM Global System for Mobile Communications
- CDMA Code Division Multiple Access
- LTE Long Term Evolution
- the network 110 can use protocols and components for communicating via the Internet or any of the other aforementioned types of networks.
- the protocols used by the network 110 may include Hypertext Transfer Protocol (HTTP), HTTP Secure (HTTPS), Message Queue Telemetry Transport (MQTT), Constrained Application Protocol (CoAP), and the like. Protocols and components for communicating via the Internet or any of the other aforementioned types of communication networks are well known to those skilled in the art and, thus, are not described in more detail herein.
- the server 130 can include a navigation unit 140, a vehicle data processing unit 145, and a data store 150.
- the navigation unit 140 can assist with location-based services.
- the navigation unit 140 can facilitate the transportation of a user (also referred to herein as a“rider”) and/or an object (e.g., food, packages, etc.) by another user (also referred to herein as a“driver”) from a first location (also referred to herein as a “pickup location”) to a second location (also referred to herein as a“destination location”).
- the navigation unit 140 may facilitate user and/or object transportation by providing map and/or navigation instructions to an application running on a user device 102 of a rider, to an application running on a user device 102 of a driver, and/or to a navigational system running on a vehicle 120.
- the navigation unit 140 can include a matching service (not shown) that pairs a rider requesting a trip from a pickup location to a destination location with a driver that can complete the trip.
- the matching service may interact with an application running on the user device 102 of the rider and/or an application running on the user device 102 of the driver to establish the trip for the rider and/or to process payment from the rider to the driver.
- the navigation unit 140 can also communicate with the application running on the user device 102 of the driver during the trip to obtain trip location information from the user device 102 (e.g., via a global position system (GPS) component coupled to and/or embedded within the user device 102) and provide navigation directions to the application that aid the driver in traveling from the current location of the driver to the destination location.
- GPS global position system
- the navigation unit 140 can also direct the driver to various geographic locations or points of interest, regardless of whether the driver is carrying a rider.
- the vehicle data processing unit 145 can be configured to support vehicle 120 driver-assist features and/or to support autonomous driving. For example, the vehicle data processing unit 145 can generate and/or transmit to a vehicle 120 map data, run diagnostic models to identify vehicle 120 operational issues, run models to simulate vehicle 120 performance given a set of variables, use vehicle data provided by a vehicle 120 to identify an object and transmit an identification of the object to the vehicle 120, generate and/or transmit to a vehicle 120 vehicle 120 control instructions, and/or the like.
- the data store 150 can store various types of data used by the navigation unit 140, the vehicle data processing unit 145, the user devices 102, and/or the vehicles 120.
- the data store 150 can store user data 152, map data 154, search data 156, and log data 158.
- the user data 152 may include information on some or all of the users registered with a location-based service, such as drivers and riders.
- the information may include, for example, usernames, passwords, names, addresses, billing information, data associated with prior trips taken or serviced by a user, user rating information, user loyalty program information, and/or the like.
- the map data 154 may include high definition (HD) maps generated from sensors (e.g., light detection and ranging (LiDAR) sensors, radio detection and ranging (RADAR) sensors, infrared cameras, visible light cameras, stereo cameras, an inertial measurement unit (IMU), etc.), satellite imagery, optical character recognition (OCR) performed on captured street images (e.g., to identify names of streets, to identify street sign text, to identify names of points of interest, etc.), etc.; information used to calculate routes; information used to render 2D and/or 3D graphical maps; and/or the like.
- sensors e.g., light detection and ranging (LiDAR) sensors, radio detection and ranging (RADAR) sensors, infrared cameras, visible light cameras, stereo cameras, an inertial measurement unit (IMU), etc.
- satellite imagery e.g., optical character recognition (OCR) performed on captured street images (e.g., to identify names of streets, to identify street sign text, to identify names of points of interest, etc.
- the map data 154 can include elements like the layout of streets and intersections, bridges (e.g., including information on the height and/or width of bridges over streets), off-ramps, buildings, parking structure entrances and exits (e.g., including information on the height and/or width of the vehicle entrances and/or exits), the placement of street signs and stop lights, emergency turnoffs, points of interest (e.g., parks, restaurants, fuel stations, attractions, landmarks, etc., and associated names), road markings (e.g., centerline markings dividing lanes of opposing traffic, lane markings, stop lines, left turn guide lines, right turn guide lines, crosswalks, bus lane markings, bike lane markings, island marking, pavement text, highway exist and entrance markings, etc.), curbs, rail lines, waterways, turning radiuses and/or angles of left and right turns, the distance and dimensions of road features, the placement of barriers between two-way traffic, and/or the like, along with the elements’ associated geographical locations (e
- the map data 154 can also include reference data, such as real-time and/or historical traffic information, current and/or predicted weather conditions, road work information, information regarding laws and regulations (e.g., speed limits, whether right turns on red lights are permitted or prohibited, whether U-turns are permitted or prohibited, permitted direction of travel, and/or the like), news events, and/or the like.
- reference data such as real-time and/or historical traffic information, current and/or predicted weather conditions, road work information, information regarding laws and regulations (e.g., speed limits, whether right turns on red lights are permitted or prohibited, whether U-turns are permitted or prohibited, permitted direction of travel, and/or the like), news events, and/or the like.
- map data 154 is illustrated as being stored in the data store 150 of the server 130, this is not meant to be limiting.
- the server 130 can transmit the map data 154 to a vehicle 120 for storage therein (e.g., in the data store 129, described below).
- the search data 156 can include searches entered by various users in the past.
- the search data 156 can include textual searches for pickup and/or destination locations.
- the searches can be for specific addresses, geographical locations, names associated with a geographical location (e.g., name of a park, restaurant, fuel station, attraction, landmark, etc.), etc.
- the log data 158 can include vehicle data provided by one or more vehicles 120.
- the vehicle data can include route data, sensor data, perception data, vehicle 120 control data, vehicle 120 component fault and/or failure data, etc.
- FIG. 1B illustrates a block diagram showing the vehicle 120 of FIG. 1A in communication with one or more other vehicles 170A-N and/or the server 130 of FIG. 1A, according to one embodiment.
- the vehicle 120 can include various components and/or data stores.
- the vehicle 120 can include a sensor array 121, a communications array 122, a data processing system 123, a communication system 124, an interior interface system 125, a vehicle control system 126, operative systems 127, a mapping engine 128, and/or a data store 129.
- Communications 180 may be transmitted and/or received between the vehicle 120, one or more vehicles 170A-N, and/or the server 130.
- the server 130 can transmit and/or receive data from the vehicle 120 as described above with respect to FIG. 1A.
- the server 130 can transmit vehicle control instructions or commands (e.g., as communications 180) to the vehicle 120.
- the vehicle control instructions can be received by the communications array 122 (e.g., an array of one or more antennas configured to transmit and/or receive wireless signals), which is operated by the communication system 124 (e.g., a transceiver).
- the communication system 124 can transmit the vehicle control instructions to the vehicle control system 126, which can operate the acceleration, steering, braking, lights, signals, and other operative systems 127 of the vehicle 120 in order to drive and/or maneuver the vehicle 120 and/or assist a driver in driving and/or maneuvering the vehicle 120 through road traffic to destination locations specified by the vehicle control instructions.
- the vehicle control instructions can include route data 163, which can be processed by the vehicle control system 126 to maneuver the vehicle 120 and/or assist a driver in maneuvering the vehicle 120 along a given route (e.g., an optimized route calculated by the server 130 and/or the mapping engine 128) to the specified destination location.
- the vehicle control system 126 can generate control commands 164 for execution by the operative systems 127 (e.g., acceleration, steering, braking, maneuvering, reversing, etc.) to cause the vehicle 120 to travel along the route to the destination location and/or to assist a driver in maneuvering the vehicle 120 along the route to the destination location.
- the operative systems 127 e.g., acceleration, steering, braking, maneuvering, reversing, etc.
- a destination location 166 may be specified by the server 130 based on user requests (e.g., pickup requests, delivery requests, etc.) transmitted from applications running on user devices 102.
- a passenger and/or driver of the vehicle 120 can provide user input(s) 169 through an interior interface system 125 (e.g., a vehicle navigation system) to provide a destination location 166.
- the vehicle control system 126 can transmit the inputted destination location 166 and/or a current location of the vehicle 120 (e.g., as a GPS data packet) as a communication 180 to the server 130 via the communication system 124 and the communications array 122.
- the server 130 (e.g., the navigation unit 140) can use the current location of the vehicle 120 and/or the inputted destination location 166 to perform an optimization operation to determine an optimal route for the vehicle 120 to travel to the destination location 166.
- Route data 163 that includes the optimal route can be transmitted from the server 130 to the vehicle control system 126 via the communications array 122 and the communication system 124.
- the vehicle control system 126 can cause the operative systems 127 to maneuver the vehicle 120 through traffic to the destination location 166 along the optimal route, assist a driver in maneuvering the vehicle 120 through traffic to the destination location 166 along the optimal route, and/or cause the interior interface system 125 to display and/or present instructions for maneuvering the vehicle 120 through traffic to the destination location 166 along the optimal route.
- the route data 163 includes the optimal route and the vehicle control system 126 automatically inputs the route data 163 into the mapping engine 128.
- the mapping engine 128 can generate map data 165 using the optimal route (e.g., generate a map showing the optimal route and/or instructions for taking the optimal route) and provide the map data 165 to the interior interface system 125 (e.g., via the vehicle control system 126) for display.
- the map data 165 may include information derived from the map data 154 stored in the data store 150 on the server 130.
- the displayed map data 165 can indicate an estimated time of arrival and/or show the progress of the vehicle 120 along the optimal route.
- the displayed map data 165 can also include indicators, such as reroute commands, emergency notifications, road work information, real-time traffic data, current weather conditions, information regarding laws and regulations (e.g., speed limits, whether right turns on red lights are permitted or prohibited, where U-turns are permitted or prohibited, permitted direction of travel, etc.), news events, and/or the like.
- indicators such as reroute commands, emergency notifications, road work information, real-time traffic data, current weather conditions, information regarding laws and regulations (e.g., speed limits, whether right turns on red lights are permitted or prohibited, where U-turns are permitted or prohibited, permitted direction of travel, etc.), news events, and/or the like.
- the user input 169 can also be a request to access a network (e.g., the network 110).
- the interior interface system 125 can generate an access request 168, which can be processed by the communication system 124 to configure the communications array 122 to transmit and/or receive data corresponding to a user’s interaction with the interior interface system 125 and/or with a user device 102 in communication with the interior interface system 125 (e.g., a user device 102 connected to the interior interface system 125 via a wireless connection).
- the vehicle 120 can include on-board Wi-Fi, which the passenger(s) and/or driver can access to send and/or receive emails and/or text messages, stream audio and/or video content, browse content pages (e.g., network pages, web pages, etc.), and/or access applications that use network access.
- the interior interface system 125 can receive content 167 via the network 110, the communications array 122, and/or the communication system 124.
- the communication system 124 can dynamically manage network access to avoid or minimize disruption of the transmission of the content 167.
- the sensor array 121 can include any number of one or more types of sensors, such as a satellite-radio navigation system (e.g., GPS), a LiDAR sensor, a landscape sensor (e.g., a radar sensor), an IMU, a camera (e.g., an infrared camera, a visible light camera, stereo cameras, etc.), a Wi-Fi detection system, a cellular communication system, an inter-vehicle communication system, a road sensor communication system, feature sensors, proximity sensors (e.g., infrared, electromagnetic, photoelectric, etc.), distance sensors, depth sensors, and/or the like.
- the satellite-radio navigation system may compute the current position (e.g., within a range of 1-10 meters) of the vehicle 120 based on an analysis of signals received from a constellation of satellites.
- the LiDAR sensor, the radar sensor, and/or any other similar types of sensors can be used to detect the vehicle 120 surroundings while the vehicle 120 is in motion or about to begin motion.
- the LiDAR sensor may be used to bounce multiple laser beams off approaching objects to assess their distance and to provide accurate 3D information on the surrounding environment.
- the data obtained from the LiDAR sensor may be used in performing object identification, motion vector determination, collision prediction, and/or in implementing accident avoidance processes.
- the LiDAR sensor may provide a 360° view using a rotating, scanning mirror assembly.
- the LiDAR sensor may optionally be mounted on a roof of the vehicle 120.
- the IMU may include X, Y, Z oriented gyroscopes and/or accelerometers.
- the IMU provides data on the rotational and linear motion of the vehicle 120, which may be used to calculate the motion and position of the vehicle 120.
- Cameras may be used to capture visual images of the environment surrounding the vehicle 120. Depending on the configuration and number of cameras, the cameras may provide a 360° view around the vehicle 120. The images from the cameras may be used to read road markings (e.g., lane markings), read street signs, detect objects, and/or the like.
- road markings e.g., lane markings
- read street signs e.g., street signs
- detect objects e.g., lane markings
- the Wi-Fi detection system and/or the cellular communication system may be used to perform triangulation with respect to Wi-Fi hot spots or cell towers respectively, to determine the position of the vehicle 120 (optionally in conjunction with then satellite-radio navigation system).
- the inter-vehicle communication system (which may include the Wi-Fi detection system, the cellular communication system, and/or the communications array 122) may be used to receive and/or transmit data to the other vehicles 170A-N, such as current speed and/or location coordinates of the vehicle 120, time and/or location coordinates corresponding to when deceleration is planned and the planned rate of deceleration, time and/or location coordinates when a stop operation is planned, time and/or location coordinates when a lane change is planned and direction of lane change, time and/or location coordinates when a turn operation is planned, time and/or location coordinates when a parking operation is planned, and/or the like.
- the other vehicles 170A-N such as current speed and/or location coordinates of the vehicle 120, time and/or location coordinates corresponding to when deceleration is planned and the planned rate of deceleration, time and/or location coordinates when a stop operation is planned, time and/or location coordinates when a lane change is planned and direction of
- the road sensor communication system (which may include the Wi-Fi detection system and/or the cellular communication system) may be used to read information from road sensors (e.g., indicating the traffic speed and/or traffic congestion) and/or traffic control devices (e.g., traffic signals).
- road sensors e.g., indicating the traffic speed and/or traffic congestion
- traffic control devices e.g., traffic signals.
- the origination location may be the current location of the vehicle 120, which may be determined using the satellite-radio navigation system installed in the vehicle (e.g., GPS, Galileo, BeiDou/COMPASS, DORIS, GLONASS, and/or other satellite-radio navigation system), a Wi-Fi positioning System, cell tower triangulation, and/or the like.
- the origination location may be specified by the user via a user interface provided by the vehicle 120 (e.g., the interior interface system 125) or via the user device 102 running the application.
- the origination location may be automatically determined from location information obtained from the user device 102.
- one or more waypoints may be specified, enabling multiple destination locations.
- Raw sensor data 161 from the sensor array 121 can be processed by the on- board data processing system 123.
- the processed data 162 can then be sent by the data processing system 123 to the vehicle control system 126, and optionally sent to the server 130 via the communication system 124 and the communications array 122.
- the data store 129 can store map data (e.g., the map data 154) and/or a subset of the map data 154 (e.g., a portion of the map data 154 corresponding to a general region in which the vehicle 120 is currently located).
- the vehicle 120 can use the sensor array 121 to record updated map data along traveled routes, and transmit the updated map data to the server 130 via the communication system 124 and the communications array 122.
- the server 130 can then transmit the updated map data to one or more of the vehicles 170A-N and/or further process the updated map data.
- the data processing system 123 can provide continuous or near continuous processed data 162 to the vehicle control system 126 to respond to point-to-point activity in the surroundings of the vehicle 120.
- the processed data 162 can comprise comparisons between the raw sensor data 161—which represents an operational environment of the vehicle 120, and which is continuously collected by the sensor array 121—and the map data stored in the data store 129.
- the data processing system 123 is programmed with machine learning or other artificial intelligence capabilities to enable the vehicle 120 to identify and respond to conditions, events, and/or potential hazards.
- the data processing system 123 can continuously or nearly continuously compare raw sensor data 161 to stored map data in order to perform a localization to continuously or nearly continuously determine a location and/or orientation of the vehicle 120.
- Localization of the vehicle 120 may allow the vehicle 120 to become aware of an instant location and/or orientation of the vehicle 120 in comparison to the stored map data in order to maneuver the vehicle 120 on surface streets through traffic and/or assist a driver in maneuvering the vehicle 120 on surface streets through traffic and identify and respond to potential hazards (e.g., pedestrians) or local conditions, such as weather or traffic conditions.
- potential hazards e.g., pedestrians
- local conditions such as weather or traffic conditions.
- localization can enable the vehicle 120 to tune or beam steer the communications array 122 to maximize a communication link quality and/or to minimize interference with other communications from other vehicles 170A-N.
- the communication system 124 can beam steer a radiation patterns of the communications array 122 in response to network configuration commands received from the server 130.
- the data store 129 may store current network resource map data that identifies network base stations and/or other network sources that provide network connectivity.
- the network resource map data may indicate locations of base stations and/or available network types (e.g., 3G, 4G, LTE, Wi-Fi, etc.) within a region in which the vehicle 120 is located.
- FIG. 1B describes certain operations as being performed by the vehicle 120 or the server 130, this is not meant to be limiting.
- the operations performed by the vehicle 120 and the server 130 as described herein can be performed by either entity.
- certain operations normally performed by the server 130 e.g., transmitting updating map data to the vehicles 170A-N
- may be performed by the vehicle 120 for load balancing purposes e.g., to reduce the processing load of the server 130, to take advantage of spare processing capacity on the vehicle 120, etc.
- any of the vehicles 170A-N may include some or all of the components of the vehicle 120 described herein.
- a vehicle 170A-N can include a communications array 122 to communicate with the vehicle 120 and/or the server 130. Updating Maps Using Virtual Stop and Yield Lines
- on-board and/or off-board systems can work in conjunction to identify unobservable features of a road network and update maps accordingly.
- the data processing system 123 of the vehicle 120 and the vehicle data processing unit 145 of the server 130 can communicate with each other to identify unobservable features of a road network and update maps accordingly.
- FIG. 2 illustrates a block diagram of the networked vehicle environment 100 in which the vehicle 120 generates virtual stop or yield lines and the server 130 aggregates multiple virtual stop or yield lines to identify a representative virtual stop or yield line, according to one embodiment.
- the data processing system 123 of the vehicle 120 includes various components to implement some or all of the functionality described herein.
- the data processing system 123 can include a vehicle stop detector 220, a vehicle situation classifier 222, a stop cause deriver 224, a stop cause analyzer 226, and a stop line generator 228.
- the vehicle data processing unit 145 of the server 130 includes various components to implement some or all of the functionality described herein.
- the vehicle data processing unit 145 can include a stop line aggregator 246 and a map updater 248.
- the vehicle stop detector 220 may be configured to detect a possible occurrence of an actual vehicle stop (e.g., a stop occurring as a result of a traffic light, stop sign, pedestrian crossing, yielding zone, and/or any other set location at which a vehicle stop is sometimes or always required).
- an actual vehicle stop e.g., a stop occurring as a result of a traffic light, stop sign, pedestrian crossing, yielding zone, and/or any other set location at which a vehicle stop is sometimes or always required.
- an actual stop cannot simply be defined as an event during which a vehicle comes to a complete stop (e.g., the vehicle is not moving (e.g., traveling at 0mph, 0m/s, etc.) for at least a threshold period of time).
- stop-and-go traffic e.g., traffic in which vehicles repeatedly accelerate and decelerate within short distances
- the vehicle stop detector 220 can use sensor data provided by the sensor array 121 to identify stops that should be considered actual stops and stops that should not be considered actual stops.
- the vehicle stop detector 220 can obtain vehicle velocity information for the vehicle 120 from a speedometer, an accelerometer, a radar sensor, a LiDAR sensor, a camera, a GPS, and/or any other sensor comprised within the sensor array 121 that can measure vehicle velocity or data that can be used to derive vehicle velocity.
- the vehicle velocity information may include (or be used to derive) vehicle velocity values measured over a period of time and/or distances.
- the vehicle velocity information can form an ego vehicle velocity profile.
- the vehicle stop detector 220 can analyze the vehicle velocity information to detect an actual stop. For example, the vehicle stop detector 220 can identify a first time instant (e.g., a time and/or date) at which the vehicle 120 velocity falls below a velocity threshold value (e.g., 5mph, 10mph, etc.) and is at a lowest value within a threshold time range (e.g., 5 seconds, 10 seconds, 30 seconds, etc.) surrounding the time instant. The vehicle stop detector 220 can then identify whether a second time instant exists before the first time instant at which the vehicle 120 velocity also falls below the velocity threshold value and is at a lowest value within a threshold time range surrounding the second time instant.
- a first time instant e.g., a time and/or date
- a velocity threshold value e.g., 5mph, 10mph, etc.
- a threshold time range e.g., 5 seconds, 10 seconds, 30 seconds, etc.
- the vehicle stop detector 220 determines that the first time instant corresponds to an actual stop. If such a second time instant exists, the vehicle stop detector 220 determines whether the second time instant is within a threshold time (e.g., 5 seconds, 10 seconds, 30 seconds, 1 minute, etc.) of the first time instant and/or whether the vehicle 120 velocity increased by a second velocity threshold value (e.g., 10mph, 15mph, etc., also referred to herein as a velocity ripple value) between the second time instant and the first time instant.
- a threshold time e.g., 5 seconds, 10 seconds, 30 seconds, 1 minute, etc.
- the vehicle stop detector 220 determines that the first time instant does not correspond to an actual stop. Rather, the first time instant may be part of an actual stop corresponding to the second time instant. Otherwise, if the second time instant is not within the threshold time of the first time instant and/or the vehicle 120 velocity increased by at least the second velocity threshold value between the second and time instants, then the vehicle stop detector 220 determines that the first time instant does correspond to an actual stop (and/or a stop corresponding to the second time instant may be a separate stop).
- the vehicle stop detector 220 can identify the geographic coordinates of the vehicle 120 and/or the lane in which the vehicle 120 is present at the first time instant (e.g., by obtaining GPS data from the sensor array 121) and provide the geographic coordinates, lane identification, and/or first time instant to the vehicle situation classifier 222.
- Graphs depicting various situations that may or may not be considered actual stops are described in greater detail below with respect to FIGS.5A-5B.
- the vehicle situation classifier 222 can use artificial intelligence to determine a situation of the vehicle 120 at the geographic coordinates provided by the vehicle stop detector 220.
- the vehicle situation classifier 222 can provide a grid map as an input to a trained deep neural network (or a trained machine learning model), and the trained deep neural network may produce an output indicating the situation of the vehicle 120 at the geographic coordinates.
- the grid map may be an image overlaid with different information.
- the information can include a map layout at the provided geographic coordinates, identified lane, and/or the first time instant (e.g., map data that identifies lanes, roads, etc., also referred to herein as a horizon layer), a LiDAR scan of an area surrounding the vehicle 120 at the provided geographic coordinates, identified lane, and/or the first time instant (also referred to herein as an occupancy layer), data indicating which area is free space and which area is not free space in the area surrounding the vehicle 120 at the provided geographic coordinates, identified lane, and/or the first time instant (which can be derived from radar data, LiDAR data, camera data, etc., also referred to herein as a semantics layer), and/or velocity data at the provided geographic coordinates, identified lane, and/or the first time instant (which can be derived from radar data, also referred to herein as a velocity layer).
- the horizon, occupancy, semantics, and velocity layer can be coded different colors and overlay each other to form the grid map. Alternatively,
- a vehicle situation output by the trained deep neural network may be a traffic scene surrounding the vehicle 120 at the provided geographical coordinates, identified lane, and/or the first time instant.
- a vehicle situation can include whether the vehicle 120 is or is not at an intersection, whether another vehicle is or is not directly in front of the vehicle 120 (e.g., within a threshold distance of the vehicle 120, such as within 2m, 5m, 10m, etc., where the other vehicle may be referred to as a leading vehicle), whether another vehicle is or is not near (e.g., within 2m, 5m, 10m, or some other threshold distance) the vehicle 120 and traveling in a different direction than the vehicle 120, whether an object other than another vehicle is or is not directly in front of the vehicle 120, whether the vehicle 120 is or is not close to a road marking (e.g., within 2m, 5m, 10m, or some other threshold distance of the road marking, such as a stop line, a yield line, a crosswalk, etc.), whether the vehicle 120 is or is
- the vehicle situation classifier 222 and/or the server may train the deep neural network using one or more grid maps in a training set.
- grid maps in the training set may correspond to locations, lanes, and/or time instants in which vehicles were stopped at an intersection; locations, lanes, and/or time instants in which vehicles were stopped, but not at an intersection; locations, lanes, and/or time instants in which vehicles were stopped behind a leading vehicle; locations, lanes, and/or time instants in which vehicles were stopped, but not behind a leading vehicle; locations, lanes, and/or time instants in which vehicles were stopped behind an object other than a vehicle; locations, lanes, and/or time instants in which vehicles were stopped, but not behind a leading vehicle or an object other than a vehicle; locations, lanes, and/or time instants in which vehicles were stopped close to a road marking; locations, lanes, and/or time instants in which vehicles were stopped, but not close to a road marking
- the vehicle situation classifier 222 can provide an indication of the vehicle situation to the stop cause deriver 224.
- the stop cause deriver 224 can use the provided vehicle situation and/or map data 165 to determine a cause of the vehicle 120 stop.
- the stop cause deriver 224 can determine that the vehicle 120 stopped because of a painted stop line at an intersection based on the map data 165 and/or the vehicle situation.
- the map data 165 may include geographic coordinates of the painted stop line, and the stop cause deriver 224 can determine that the geographic coordinates of the actual stop are before the geographic coordinates of the painted stop line along the vehicle 120 path using the map data 165.
- the map data 165 may include geographic coordinates of the painted stop line and the vehicle situation may indicate that the vehicle 120 is at an intersection
- the stop cause deriver 224 can determine that the geographic coordinates of the actual stop are after the geographic coordinates of the painted stop line along the vehicle 120 path using the map data 165, but that the stop occurred at an intersection using the provided vehicle situation.
- the stop cause deriver 224 can determine that the vehicle 120 stopped independently at a possible unmarked intersection and/or to yield to oncoming traffic if the vehicle situation indicates that the stop did not occur close to a road marking and the vehicle 120 was not behind a leading vehicle.
- the stop cause deriver 224 can determine that the vehicle 120 stopped because of traffic congestion at a location other than an intersection if the vehicle situation indicates that the stop did not occur at an intersection and/or the vehicle 120 was behind a leading vehicle.
- the stop cause deriver 224 can determine any number of types of causes for a vehicle 120 stopping.
- the stop cause deriver 224 can use artificial intelligence to determine the cause of a vehicle 120 stop.
- a neural network and/or machine learning model can be trained by the stop cause deriver 224 and/or the vehicle data processing unit 145 to output vehicle 120 stop causes based on vehicle situations and/or map data 165 provided as inputs to the neural network and/or machine learning model.
- the stop cause deriver 224 can provide an indication of the cause of the vehicle 120 stop to the stop cause analyzer 226.
- the stop cause analyzer 226 can evaluate the indicated cause and discard any actual stops that were caused by anything other than a possible unmarked intersection and/or yielding to oncoming traffic. For example, the stop cause analyzer 226 can discard an actual stop caused by a leading vehicle not at an intersection.
- the stop cause analyzer 226 determines that the cause of the vehicle 120 stop was because of a possible unmarked intersection and/or yielding to oncoming traffic, the stop cause analyzer 226 can provide the actual stop data (e.g., geographic coordinates of the actual stop, a lane in which the actual stop occurred, a time instant at which the actual stop occurred, etc.) to the stop line generator 228.
- the actual stop data e.g., geographic coordinates of the actual stop, a lane in which the actual stop occurred, a time instant at which the actual stop occurred, etc.
- the stop line generator 228 can generate a virtual stop or yield line using the actual stop data.
- the stop line generator 228 can generate virtual stop or yield line data that indicates a geographic location and/or lane at which a vehicle 120 should stop.
- the stop line generator 228 can optionally update the map data 165 to include the virtual stop or yield line data.
- inclusion of the virtual stop or yield line data into the map data 165 may cause the map data 165 to include a graphical line representing the virtual stop or yield line at the geographic location and/or lane where a vehicle 120 should stop.
- the stop line generator 228 can also transmit the virtual stop or yield line data to the stop line aggregator 246.
- the stop line generator 228 may provide the virtual stop or yield line data to the communications array 122 via the vehicle control system and communication system 124 for transmission over the network 110. Alternatively, the stop line generator 228 may provide the virtual stop or yield line data to the communications array 122 via the communication system 124.
- the stop line aggregator 246 may receive virtual stop or yield line data from one or more vehicles 120. For example, for a particular location, one vehicle 120 may provide virtual stop or yield line data, one vehicle 120 may provide multiple instances of the virtual stop or yield line data (e.g., new virtual stop or yield line data may be generated by the vehicle 120 each time the vehicle 120 passes through the corresponding geographic coordinates), multiple vehicles 120 may each provide virtual stop or yield line data, and/or any combination thereof.
- the stop line aggregator 246 can cluster the virtual stop or yield lines generated by one of more of the vehicles 120 to identify a representative virtual stop or yield line.
- the stop line aggregator 246 can average the locations of the virtual stop or yield lines generated by the vehicle(s) 120 and set the average location to be the location of the representative virtual stop or yield line. As another example, the stop line aggregator 246 can identify the most common location for a virtual stop or yield line and set the most common location to be the location of the representative virtual stop or yield line. As another example, the stop line aggregator 246 can identify the median virtual stop or yield line location and set the median location to be the location of the representative virtual stop or yield line. Once the location (e.g., geographic coordinates and/or lane) of the representative virtual stop or yield line is set, the stop line aggregator 246 can provide an indication of the representative virtual stop or yield line to the map updater 248.
- the location e.g., geographic coordinates and/or lane
- the map updater 248 optionally performs a validation operation by cross- referencing the representative virtual stop or yield line with the map data 154.
- the map updater 248 can determine whether a marked stop or yield line exists near the location of the representative virtual stop or yield line (e.g., the marked stop or yield line is within 2m, 5m, 10m, or some other threshold distance of the location of the representative virtual stop or yield line and/or in the same lane as the representative virtual stop or yield line). If the representative virtual stop or yield line is near a marked stop or yield line, the map updater 248 may not update or edit the map data 154 to include the representative virtual stop or yield line because the representative virtual stop or yield line may be redundant of the marked stop or yield line. On the other hand, if the representative virtual stop or yield line is not near a marked stop or yield line, the map updater 248 may update or edit the map data 154 to include the representative virtual stop or yield line.
- the map updater 248 can store the updated map data 154 in the data store 150.
- the map updater 248 can also transmit the updated map data 154 to one or more of the vehicles 120 for storage and use by the vehicle 120 components.
- the map updater 248 can transmit the updated map data 154 to the stop line generator 228 (via the communications array 122, communication system 124, and/or vehicle control system 126), and the stop line generator 228 can store the updated map data 154 in the data store 129 (directly or via the vehicle control system 126) to replace the originally stored map data 165.
- the vehicle control system 126, the interior interface system 125, the mapping engine 128, and/or other components of the vehicle 120 can then rely on the updated map data 154, 165 to improve ride-sharing services (e.g., improve navigation instructions presented to the driver, such as indicating where to stop or yield), to assist drivers in driving and/or maneuvering the vehicle 120, and/or to automatically drive and/or maneuver the vehicle 120.
- ride-sharing services e.g., improve navigation instructions presented to the driver, such as indicating where to stop or yield
- vehicle(s) 120 and/or the vehicle data processing unit 145 can implement a self-healing map process in which vehicle(s) 120 detect unobservable road network features and provide suggested virtual stop or yield lines to the vehicle data processing unit 145, the vehicle data processing unit 145 determines a single aggregated virtual stop or yield line and updates a map accordingly, and the vehicle data processing unit 145 transmits map updates to the vehicle(s) 120. The vehicle(s) 120 can then use the updated map to improve future navigation, driving, and/or maneuvering.
- any operation described herein as being performed by the vehicle 120 can alternatively or in addition be performed by the vehicle data processing unit 145.
- the vehicle 120 can transmit an indication of a cause of a vehicle 120 stop to the vehicle data processing unit 145, and the vehicle data processing unit 145 can determine whether the cause corresponds to an unmarked intersection and/or a location at which yields occur and, if so, generate a virtual stop or yield line.
- any operation described herein as being performed by the vehicle data processing unit 145 can alternatively or in addition be performed by the vehicle 120.
- the vehicle 120 can receive virtual stop or yield line data from other vehicles 120 and cluster the virtual stop or yield lines to form a representative virtual stop or yield line.
- the techniques described herein as being implemented by the vehicle 120 and/or the vehicle data processing unit 145 can be used to identify other unobservable road network features (e.g., unobservable road network features other than unmarked intersections or positions at which vehicles 120 wait to merge with incoming traffic) and update map data 154, 165 accordingly.
- other unobservable road network features can be at speed bumps, gutters crossing a street, unmarked crosswalks, railroad crossings, and/or other features at which vehicles 120 often come to a partial, but not a complete, stop (e.g., where a partial stop may be when a vehicle 120 slows by a threshold velocity and/or by a threshold percentage, and then accelerates thereafter).
- the vehicle(s) 120 and/or the vehicle data processing unit 145 can generate a representative virtual partial stop line at the location of one of these features using the techniques described herein and update the map data 154, 165 to include the representative virtual partial stop line.
- the stop cause analyzer 226 can be configured to keep actual stops that are caused by situations other than or in addition to the vehicle 120 being at an unmarked intersection and/or at a position where yielding occurs that optionally may result in the vehicle 120 operating in a sensitive or cautious mode and/or alerting a driver to be more cautious.
- Such situations can be road obstacles (or road hazards), such as speed bumps, gutters, informal crosswalks, potholes, construction, uneven surfaces, and/or other similar obstacles that are not necessarily at an intersection.
- the stop cause analyzer 226 can keep actual stops that are caused by the vehicle 120 identifying a pedestrian while the vehicle 120 is not at an intersection.
- the stop line generator 228 can generate a virtual stop line in a manner as described herein and provide the virtual stop line data to the stop line aggregator 246.
- the stop line generator 228 may further include information in the virtual stop line data indicating that there may be a hidden problem (e.g., a hidden danger) at the location of the virtual stop line (e.g., pedestrians cross at an unmarked location).
- the stop line aggregator 246 can then determine a representative virtual stop line, the map updater 248 may update the map data 154 to include the representative virtual stop line and/or information indicating that there may be hidden problem at the location of the representative virtual stop line, and the map updater 248 may transmit the updated map data 154 to the data processing system 123.
- the vehicle control system 126 may then, based on the updated map data 154, 165, operate in a sensitive or cautious mode when near the location of the representative virtual stop line given that a hidden problem has been identified. For example, the vehicle control system 126 may provide control commands 164 to the operative systems 127 that direct the operative systems 127 to cause the vehicle 120 to drive and/or maneuver at a slower velocity, to turn on headlights, fog lights, and/or blinkers, to sound a horn, to turn on traction control, etc. while within a certain distance of the representative virtual stop line associated with the hidden problem.
- the vehicle control system 126 may instruct the interior interface system 125 to display an alert to a driver to travel at a slower speed, to turn on headlights, fog lights, and/or blinkers, to sound a horn, to turn on traction control, etc. while within a certain distance of the representative virtual stop line associated with the hidden problem.
- FIG. 3 illustrates a block diagram showing the operations performed by the vehicle 120 to generate a virtual stop line, according to one embodiment.
- the sensor array 121 may transmit vehicle velocity data and location data to the vehicle stop detector 220 at (1).
- the vehicle velocity data can include vehicle 120 velocity values at various time instants.
- the location data can include the geographic coordinates of the vehicle 120 and/or the lane in which the vehicle 120 was located at various time instants.
- the sensor array 121 may continuously or periodically transmit the vehicle velocity data and/or the location data to the vehicle stop detector 220.
- the vehicle stop detector 220 can detect a vehicle stop at (2). For example, the vehicle stop detector 220 may determine that the vehicle 120 stopped at a particular time instant based on a velocity profile of the vehicle 120 (as derived from the vehicle velocity data). The vehicle stop detector 220 can then determine a location of the vehicle stop at (3). For example, the vehicle stop detector 220 can use the location data to identify the geographic coordinates and/or lane at which the vehicle 120 was situated at the time instant corresponding to the detected vehicle 120 stop. The vehicle stop detector 220 can then transmit an indication of the location of the vehicle stop to the vehicle situation classifier 222 at (4). As described herein, the location can include geographic coordinates and/or an identification of a lane in which the vehicle 120 was positioned.
- the sensor array 121 can transmit perception data to the vehicle situation classifier 222 at (5).
- the perception data may be associated with (e.g., captured at) the vehicle 120 stop time instant or a range of time instants around the vehicle 120 stop time instant.
- the perception data can include data used to derive at least a portion of the horizon, occupancy, semantics, and/or velocity layers.
- the perception data can include radar data, LiDAR data, camera data, etc.
- the vehicle situation classifier 222 can also retrieve map data (e.g., map data 165) from the data store 129 (e.g., directly or via the vehicle control system 126) at (6).
- the vehicle situation classifier 222 can use the map data to derive at least a portion of the horizon layer.
- the vehicle situation classifier 222 can use the perception data and/or the map data to form the grid map.
- the vehicle situation classifier 222 can then provide the grid map as an input to a trained artificial intelligence engine (e.g., a trained deep neural network, a trained machine learning model, etc.) executed by the vehicle situation classifier 222.
- a trained artificial intelligence engine e.g., a trained deep neural network, a trained machine learning model, etc.
- the trained artificial intelligence engine may produce an output that allows the vehicle situation classifier 222 to determine a situation of the vehicle 120 at the vehicle 120 stop time instant at (7).
- the vehicle situation classifier 222 can transmit the determined vehicle situation to the stop cause deriver 224 at (8).
- the stop cause deriver 224 can retrieve map data from the data store 129 (e.g., directly or via the vehicle control system 126) at (9). Using the determined vehicle situation and/or the map data, the stop cause deriver 224 can determine a cause of a vehicle stop at (10).
- the cause can be that a painted stop line was present at an intersection, that another vehicle was in front of the vehicle 120 while not at an intersection, that another vehicle was in front of the vehicle 120 at an intersection, that the vehicle 120 was at an unmarked intersection (e.g., because no other vehicle was in front of the vehicle 120 and no marked stop or yield line was present), that the vehicle 120 was in a position waiting to merge into oncoming traffic (e.g., because no other vehicle was in front of the vehicle 120, no marked stop or yield line was present, and the vehicle 120 was in the process of turning or changing lanes), and/or the like.
- the stop cause deriver 224 can transmit an indication of the cause of the vehicle 120 stop to the stop cause analyzer 226 at (11).
- the stop cause analyzer 226 can filter stops caused by reasons that are not of interest to the data processing system 123. For example, the stop causer analyzer 226 can filter stops that occurred as a result of a leading vehicle while the vehicle 120 was not at an intersection. However, the stop cause analyzer 226 may keep stops that occurred as a result of the vehicle 120 being at an unmarked intersection or being in a position to wait to merge into oncoming traffic. Here, the stop cause analyzer 226 keeps the vehicle stop at (12) because the stop corresponds to an unmarked intersection. As a result, the stop cause analyzer 226 can transmit vehicle stop data to the stop line generator 228 at (13). The vehicle stop data can include a geographic location of the detected stop, a lane in which the vehicle 120 was positioned during the detected stop, and/or a time instant at which the stop occurred.
- the stop line generator 228 can generate virtual stop line data at (14).
- the virtual stop line data can indicate a geographic location and/or lane at which a vehicle 120 should stop.
- the stop line generator can retrieve the map data (e.g., the map data 165) from the data store 129 (e.g., directly or via the vehicle control system 126) and update the map data at (15), storing the updated map data in the data store 129.
- the vehicle control system 126 can use the updated map data to instruct the interior interface system 125 and/or an external user device 102 to display stop instructions, to instruct the operative systems 127 to stop the vehicle 120, to instruct the operative systems 127 to assist the driver in stopping the vehicle 120, and/or the like.
- FIG.3 illustrates the operations performed to generate a virtual stop line, this is not meant to be limiting.
- the operations described with respect to FIG.3 can also be used to generate a virtual yield line, a virtual line or marking indicating that the vehicle 120 should operate in a more cautious or sensitive mode, and/or the like.
- FIG.3 depicts a sequence of operations occurring in a numbered order, this is not meant to be limiting. Some or all of the operations described above with respect to FIG. 3 can be performed in a different order than shown. For example, while FIG. 3 depicts the stop cause deriver 224 retrieving the map data after receiving the indication of the determined vehicle situation, the stop cause deriver 224 can retrieve the map data prior to receiving the indication of the determined vehicle situation.
- Any of the operations performed by the vehicle 120 as depicted in FIG. 3 can be performed periodically and/or continuously as the vehicle 120 travels along a route. Alternatively or in addition, some or all of the operations can be performed after the vehicle 120 has finished traveling along a route and is an idle and/or parked position.
- FIG. 4A illustrates a block diagram showing the operations performed by vehicle(s) 120 and the server 130 to update a map to include a representative virtual stop line, according to one embodiment.
- various vehicles 120A-N can transmit virtual stop line data to the stop line aggregator 246.
- a stop line generator 228A of the vehicle 120A can transmit virtual stop line data to the stop line aggregator 246 at (1A)
- a stop line generator 228B of the vehicle 120B can transmit virtual stop line data to the stop line aggregator 246 at (1B)
- a stop line generator 228N of the vehicle 120N can transmit virtual stop line data to the stop line aggregator 246 at (1N)
- the vehicles 120A-N can transmit the virtual stop line data at the same and/or different times.
- the virtual stop line data transmitted by the vehicles 120A-N may correspond to the same intersection.
- the virtual stop line data may not necessarily all correspond to the same geographic location and/or lane.
- the vehicle 120A may have stopped a short distance before the vehicle 120B at the intersection (e.g., 2m before the vehicle 120B), and therefore the virtual stop line data transmitted by the vehicle 120A may correspond to a geographic location that is a short distance away from the geographic location corresponding to the virtual stop line data transmitted by the vehicle 120B.
- the stop line aggregator 246 may receive virtual stop line data corresponding to geographic locations and/or lanes within a short distance of each other.
- a vehicle 120A-N can transmit virtual stop line data multiple times, such as one or more times the vehicle 120A-N travels to and/or through the intersection.
- the vehicle 120A-N may not stop in the same location each time, however.
- the same vehicle 120A-N can transmit to the stop line aggregator 246 virtual stop line data corresponding to different geographic locations and/or lanes at the same intersection.
- the stop line aggregator 246 can determine a representative virtual stop line at (2) using the virtual stop line data received from the vehicles 120A-N. For example, the stop line aggregator 246 can cluster the different geographic locations and/or lanes identified in the virtual stop line data to identify a representative geographic location and/or lane (e.g., an average geographic location and/or lane, a median geographic location and/or lane, a mode geographic location and/or lane, and/or a geographic location and/or lane identified using any other statistical analysis). The stop line aggregator 246 can transmit an indication of the representative virtual stop line to the map updater 248 at (3).
- a representative geographic location and/or lane e.g., an average geographic location and/or lane, a median geographic location and/or lane, a mode geographic location and/or lane, and/or a geographic location and/or lane identified using any other statistical analysis.
- the stop line aggregator 246 can transmit an indication of the representative virtual stop line to the map updater 2
- the map updater 248 can retrieve map data from the data store 150 at (4).
- the map data can be the map data 154.
- the map updater 248 can use the map data to perform a validation of the representative virtual stop line.
- the map updater 248 can determine whether the representative virtual stop line is near a painted or marked stop line and/or another virtual stop line incorporated into the map data. If the representative virtual stop line is near a painted or marked stop line and/or another virtual stop line, it may be redundant of the stop line that already exists. Thus, the map updater 248 may not validate the representative virtual stop line and take no further action.
- the map updater 248 validates the representative virtual stop line at (5).
- the map updater 248 updates the map data at (6) to include the data corresponding to the representative virtual stop line.
- the data can include a geographic location or range of geographic locations (e.g., a line of geographic locations) and/or a lane at which a stop should occur. Incorporating the representative virtual stop line data into the map data may cause a graphically displayed map corresponding to the map data to depict a color or shaded line at the geographic location, range of geographic locations, and/or identified lane.
- incorporating the representative virtual stop line data into the map data may cause the map data to include a line at the geographic location, range of geographic locations, and/or identified lane that appears identical or nearly identical to a painted or marked stop line.
- the map updater 248 can update the map data to include a virtual stop line that otherwise appears to be an actual stop line existing in the environment.
- the map updater 248 can optionally store the updated map data in the data store 150 at (7).
- FIG. 4B illustrates a block diagram showing the operations performed by the vehicle(s) 120 and the server 130 to provide vehicle(s) 120 with updated maps, according to one embodiment.
- the vehicle(s) 120 and/or the server 130 can implement a self-healing map process in which vehicle(s) 120 and the server 130 can communicate with each other to continually refine and/or update maps to improve future navigation, driving, and/or maneuvering.
- FIG. 4B depicts the operations performed to provide vehicles 120A-N with updated maps based on virtual stop line data provided by one or more of the vehicles 120A-N.
- the map updater 248 has already validated a representative virtual stop line and updated the map data.
- the map updater 248 can then transmit the updated map data to the vehicles 120A-N.
- the map updater 248 can transmit the updated map data to the stop line generator 228A of the vehicle 120A at (8A)
- the map updater 248 can transmit the updated map data to the stop line generator 228B of the vehicle 120B at (8B)
- the map updater 248 can transmit the updated map data to the stop line generator 228N of the vehicle 120N at (8N)
- the map updater 248 can transmit the updated map data to the vehicles 120A-N simultaneously, in sequence, and/or any combination thereof.
- the map updater 248 can distribute the updated map data to any number of vehicles 120A-N, whether or not such vehicles 120A-N provided the virtual stop line data used to identify the representative virtual stop line.
- the stop line generators 228A-228N can then store the updated map data in their respective data stores 129A-N.
- the stop line generator 228A can store the updated map data in the data store 129A (e.g., directly or via a vehicle control system 126A) at (9A)
- the stop line generator 228B can store the updated map data in the data store 129B (e.g., directly or via a vehicle control system 126B) at (9B)
- the stop line generator 228N can store the updated map data in the data store 129N (e.g., directly or via a vehicle control system 126N) at (9N)
- the stop line generators 228A-N can store the updated map data at the same and/or different times.
- a vehicle 120A-N can then use the updated map data to, for example, instruct a driver to stop, assist a driver in stopping, automatically stop, and/or enter a cautious or sensitive mode when approaching the geographic location and/or lane corresponding to the representative virtual stop line.
- FIGS.4A-4B illustrate the operations performed to update and distribute map data that includes a representative virtual stop line
- the operations described with respect to FIGS. 4A-4B can also be used to update and distribute map data that includes a representative virtual yield line, a representative virtual line or marking indicating that the vehicle 120 should operate in a more cautious or sensitive mode, and/or the like.
- FIGS. 4A-4B depict a sequence of operations occurring in a numbered order, this is not meant to be limiting. Some or all of the operations described above with respect to FIGS. 4A-4B can be performed in a different order than shown.
- FIG. 4A depicts the map updater 248 validating the representative virtual stop line before updating the map data
- the map updater 248 can validate the representative virtual stop line after updating the map data.
- FIGS.5A-5B illustrate various velocity graphs 500 and 550 that visually explain how the vehicle stop detector 220 detects an actual stop.
- the graph 500 may be an ego vehicle velocity profile that depicts velocity on the y-axis and distance on the x-axis.
- the graph 500 may correspond to an intersection that includes a crosswalk 540, and the distance values may represent a distance from the crosswalk 540.
- vehicles 120 that traveled according to paths 505 and 510 slowed briefly, but generally maintained speed while passing through the intersection.
- Such vehicles 120 may not have stopped because of a green light allowing traffic to pass in the direction that the vehicles 120 were traveling (e.g., left to right in the graph 500) and/or no pedestrians were present in the crosswalk 540.
- Factors considered in making the determination may include the rate of deceleration prior to the potential stop, the rate of acceleration after the potential stop, the amount or percentage by which the velocity decreased prior to the potential stop, the amount or percentage by which the velocity increased after the potential stop, the distance that the stop occurred from the crosswalk 540, and/or the like.
- the graph 550 depicts velocity on the y-axis and time on the x-axis.
- four troughs 555, 560, 565, and 570 in velocity occur at various times and each may correspond to a potential stop.
- the first trough 555 may be at a velocity that is greater than a velocity threshold value (e.g., Vth), and therefore the vehicle stop detector 220 may determine that the potential stop corresponding to the trough 555 is not an actual stop.
- Vth velocity threshold value
- the second trough 560 may be at a velocity that is less than the velocity threshold value.
- the vehicle stop detector 220 may determine whether any actual stop occurred within a threshold time of the time instant corresponding to the trough 560.
- the trough 555 may be within the threshold time of the trough 560, but the trough 555 is not an actual stop and therefore the vehicle stop detector 220 determines that there is no actual stop within the threshold time of the time instant corresponding to the trough 560. Accordingly, the vehicle stop detector 220 identifies the trough 560 as corresponding to an actual stop.
- the vehicle stop detector 220 would then determine whether the velocity had risen by at least the velocity ripple value (e.g., V ripple ) before the trough 560 occurred. If the velocity had increased by at least the velocity ripple value, then the vehicle stop detector 220 would consider the trough 560 to be a separate, actual stop. Otherwise, if the velocity had not increased by at least the velocity ripple value, then the vehicle stop detector 220 would consider the trough 560 to be a part of the same, actual stop as the previous actual stop.
- V ripple velocity ripple
- the third trough 565 may also be at a velocity that is less than the velocity threshold value. However, the vehicle stop detector 220 may determine that the trough 565 does not correspond to an actual stop. While the velocity at the trough 565 is less than the velocity threshold value, an actual stop occurred within the threshold time of the time instant corresponding to the trough 565 (e.g., the actual stop corresponding to the 560) and the velocity did not increase by at least the velocity ripple value before falling to the value at the trough 565.
- the fourth trough 570 may also be at a velocity that is less than the velocity threshold value.
- the vehicle stop detector 220 may determine that the trough 570 corresponds to an actual stop.
- the time instant corresponding to the trough 570 may not be within the threshold time of the time instant corresponding to the trough 560, which is the last detected actual stop. Even if the time instant corresponding to the trough 570 is within the threshold time of the time instant corresponding to the trough 560, the velocity increased by more than the velocity ripple value between the trough 560 time instant and the trough 570 time instant.
- the difference between the velocity value at peak 568 and the velocity value at the trough 560 may be greater than the velocity ripple value.
- FIG.6A illustrates an example unmarked intersection 600 at which actual stops may be detected and virtual stop lines may be generated, according to one embodiment.
- the intersection 600 includes a crosswalk 605 that traverses road 610 and a crosswalk 615 that traverses a North end of road 620.
- the crosswalks 605 and 615 may serve as natural stop lines and may be recognized as such.
- No crosswalk traverses the South end of road 620, however, and no other painted or marked stop lines are present.
- Vehicles 120 may nonetheless stop at the South end of the intersection 600 when traveling North on the road 620 before proceeding through the intersection 600.
- various vehicles 120 may detect actual stops when traveling through the intersection 600, and may generate virtual stop line data corresponding to one or more of the virtual stop lines 622, 624, and/or 626 depicted in FIG.6A.
- the vehicle data processing unit 145 may eventually receive this virtual stop line data from one or more vehicles 120 and select or determine a representative virtual stop line.
- the vehicle data processing unit 145 can select one of virtual stop lines 622, 624, and/or 626 to be the representative virtual stop line.
- the vehicle data processing unit 145 can perform a statistical analysis on the virtual stop lines 622, 624, and/or 626 and generate a representative virtual stop line that is an aggregation of the virtual stop lines 622, 624, and/or 626.
- the vehicle data processing unit 145 can then update map data to include the representative virtual stop line (such that if displayed, a map based on the map data would depict a line similar to the depicted virtual stop lines 622, 624, and/or 626) and transmit the updated map data to one or more vehicles 120.
- FIG.6B illustrates an example unmarked, yield intersection 650 at which actual stops may be detected and virtual yield lines may be generated, according to one embodiment.
- the intersection 650 includes a road 670 intersecting with a road 660.
- the road 670 may include a marked and/or painted stop line 672.
- a driver operating a vehicle 120 that stops at the stop line 672 may have an obstructed view of traffic traveling East on the road 660.
- drivers may not immediately turn right after stopping at the stop line 672. Rather, drivers may cross the stop line 672 and stop again prior to entering the intersection 650 to obtain a better view of the traffic traveling East on the road 660.
- drivers may then merge onto the road 660 when safe.
- various vehicles 120 may detect actual stops when traveling through the intersection 600, and may generate virtual yield line data corresponding to one or more of the virtual yield lines 662, 664, 666, and/or 668 depicted in FIG. 6B.
- the vehicle data processing unit 145 may eventually receive this virtual yield line data from one or more vehicles 120 and select or determine a representative virtual yield line. For example, the vehicle data processing unit 145 can select one of virtual yield lines 662, 664, 666, and/or 668 to be the representative virtual yield line.
- the vehicle data processing unit 145 can perform a statistical analysis on the virtual yield lines 662, 664, 666, and/or 668 and generate a representative virtual yield line that is an aggregation of the virtual yield lines 662, 664, 666, and/or 668.
- the vehicle data processing unit 145 can then update map data to include the representative virtual yield line (such that if displayed, a map based on the map data would depict a line similar to the depicted virtual yield lines 662, 664, 666, and/or 668) and transmit the updated map data to one or more vehicles 120.
- FIG. 7 shows a flow diagram illustrative of embodiments of a routine 700 implemented by the vehicle 120 to generate a virtual stop line.
- routine 700 may be implemented by one or more components that are associated with the data processing system 123 of the vehicle 120.
- a vehicle stop is detected.
- the data processing system 123 of the vehicle 120 may detect a stop based on an analysis of the vehicle 120 velocity at various time instants and/or in relation to certain road markings (e.g., stop lines, crosswalks, etc.). A process performed by the data processing system 123 to detect a vehicle stop is described in greater detail below with respect to FIG.10.
- a location of a vehicle at a time of the detected vehicle stop is determined.
- the location may be determined using GPS data that identifies the location of the vehicle 120 at a time instant corresponding to the detected stop.
- a situation of the vehicle at the determined location is determined.
- the situation may be determined by obtaining perception data and/or map data, converting the perception data and/or map data into a grid map, and applying the grid map as an input to a trained deep neural network.
- virtual stop line data is generated.
- the virtual stop line data may be generated because the determined vehicle stop cause is a reason that is of interest to the vehicle 120 and/or the server 130 in eventually generating a virtual stop line.
- the virtual stop line data is transmitted to a server over a network.
- the virtual stop line data can be transmitted to the vehicle data processing unit 145 of the server 130.
- the routine 700 is complete.
- FIG. 7 is described with respect to virtual stop lines, this is not meant to be limiting.
- a routine similar to the routine 700 can be executed to generate virtual yield line data.
- virtual yield line data may be generated if the determined vehicle stop cause is related to the vehicle 120 yielding while waiting to merge into oncoming traffic.
- FIG. 8 shows a flow diagram illustrative of embodiments of a routine 800 implemented by the server 130 to identify a representative virtual stop line.
- routine 800 may be implemented by one or more components that are associated with the vehicle data processing unit 145 of the server 130.
- virtual stop or yield line data is obtained from a plurality of vehicles.
- one or more vehicles 120 may execute the routine 700 of FIG.7 to generate virtual stop or yield line data for a particular intersection or yielding area.
- the obtained virtual stop or yield line data is aggregated.
- the obtained virtual stop or yield line data can be clustered to identify an average virtual stop or yield line, a median virtual stop or yield line, the most common virtual stop or yield line, etc.
- a representative virtual stop or yield line is determined based on the aggregation.
- the representative virtual stop or yield line may be a virtual stop or yield line generated by a particular vehicle 120 or may be a combination of virtual stop or yield lines generated by the same vehicle 120 or multiple vehicles 120.
- the routine 800 is complete.
- FIG. 9 shows a flow diagram illustrative of embodiments of a routine 900 implemented by the server 130 to update or edit a map based on vehicle-provided data.
- routine 900 may be implemented by one or more components that are associated with the vehicle data processing unit 145 of the server 130.
- virtual stop or yield line data is obtained from a plurality of vehicles.
- one or more vehicles 120 may execute the routine 700 of FIG.7 to generate virtual stop or yield line data for a particular intersection or yielding area.
- a representative virtual stop or yield line is determined based on the obtained virtual stop or yield line data.
- the representative virtual stop or yield line may be a virtual stop or yield line generated by a particular vehicle 120 or may be a combination of virtual stop or yield lines generated by the same vehicle 120 or multiple vehicles 120.
- the representative virtual stop or yield line is validated.
- the representative virtual stop or yield line may be compared to any actual or virtual stop lines already incorporated in the map data. If the representative virtual stop or yield line is close to an already-existing stop line, then the validation may fail. Otherwise, if the representative virtual stop or yield line is not close to an already-existing stop line, then the validation may succeed.
- the updated map data can then be transmitted to one or more vehicles 120 to aid in future navigation, driving, and/or maneuvering.
- the routine 900 is complete.
- FIG. 10 shows a flow diagram illustrative of embodiments of a routine 1000 implemented by the vehicle 120 to detect a stop.
- routine 1000 may be implemented by one or more components that are associated with the data processing system 123 of the vehicle 120.
- routine 1000 it is determined that the possible stop currently being evaluated is part of the prior stop. The routine 1000 then reverts back to block 1002 to repeat the routine 1000 to detect a future stop.
- FIG. 11 shows a flow diagram illustrative of embodiments of a routine 1100 implemented by the vehicle 120 to generate virtual stop line data that includes an indication of a hidden problem at the location of the virtual stop line.
- routine 1100 may be implemented by one or more components that are associated with the data processing system 123 of the vehicle 120.
- a vehicle stop is detected.
- the data processing system 123 of the vehicle 120 may detect a stop based on an analysis of the vehicle 120 velocity at various time instants and/or in relation to certain road markings (e.g., stop lines, crosswalks, etc.). A process performed by the data processing system 123 to detect a vehicle stop is described in greater detail above with respect to FIG.10.
- a location of a vehicle at a time of the detected vehicle stop is determined.
- the location may be determined using GPS data that identifies the location of the vehicle 120 at a time instant corresponding to the detected stop.
- a situation of the vehicle at the determined location is determined.
- the situation may be determined by obtaining perception data and/or map data, converting the perception data and/or map data into a grid map, and applying the grid map as an input to a trained deep neural network.
- a cause of the vehicle stop corresponds to a road obstacle.
- the road obstacle may be a speed bump, a gutter that traverses a road, an informal (e.g., unmarked) crosswalk, a pothole, construction (e.g., road flares, traffic cones, detour signs, etc.), uneven surfaces, and/or the like.
- the determination may be made based on the determined vehicle situation and/or map data.
- virtual stop line data is generated that includes an indication of a hidden problem at the determined location.
- the virtual stop line data may be generated because the determined vehicle stop cause is a reason that is of interest to the vehicle 120 and/or the server 130 in eventually generating a virtual stop line.
- the virtual stop line data is transmitted to a server over a network.
- the virtual stop line data can be transmitted to the vehicle data processing unit 145 of the server 130.
- the virtual stop line data may cause a vehicle 120 to alert a driver to be cautious near the geographic location corresponding to the virtual stop line and/or to enter a cautious and/or sensitive mode (e.g., automatically cause the vehicle 120, assist a driver, and/or instruct a driver to slow down more than what typically would happen at a similar type of traffic scene, to turn on headlights, fog lights, and/or blinkers, to sound a horn, to turn on traction control, etc.).
- the routine 1100 is complete.
- One aspect of the disclosure provides a vehicle comprising a plurality of sensors, where a first sensor in the plurality of sensors is configured to generate velocity data, and where a second sensor in the plurality of sensors is configured to generate location data.
- the vehicle further comprises a processor configured with computer- executable instructions, where the computer-executable instructions, when executed, cause the processor to: detect a vehicle stop at a first time instant using the generated velocity data; determine a location of the vehicle at the first time instant using the generated location data; determine, using a deep neural network stored on the vehicle, a situation of the vehicle at the determined location; determine, based on at least one of the determined situation or map data, that a cause of the detected vehicle stop is the vehicle arriving at the unmarked intersection; generate virtual stop line data in response to determining that the cause of the detected vehicle stop is the vehicle arriving at an unmarked intersection; and transmit the virtual stop line data to a server over a network via a communication array.
- the vehicle of the preceding paragraph can include any sub-combination of the following features: where the location of the vehicle comprises geographical coordinates of the vehicle at the first time instant and a lane on a road in which the vehicle was positioned at the first time instant; where the computer-executable instructions, when executed, further cause the processor to: generate a grid map, apply the grid map as an input to the deep neural network, and determine the situation of the vehicle based on an output of the deep neural network; where the computer-executable instructions, when executed, further cause the processor to: obtain the map data and at least one of light detection and ranging (LiDAR) data, radar data, or camera data, and generate an image in which information derived from the map data is laid over information derived from at least one of the LiDAR data, the radar data, or the camera data to form the grid map; where the computer- executable instructions, when executed, further cause the processor to train the deep neural network using a training set of grid maps; where the computer-executable instructions, when executed, further cause the
- Another aspect of the disclosure provides a method implemented by a vehicle.
- the method comprises: detecting a vehicle stop at a first time instant using velocity data measured by the vehicle; determining a location of the vehicle at the first time instant; determining, based in part on execution of an artificial intelligence engine running on the vehicle, that a cause of the detected vehicle stop is the vehicle arriving at an unmarked intersection; generating virtual stop line data in response to determining that the cause of the detected vehicle stop is the vehicle arriving at the unmarked intersection; and transmitting the virtual stop line data to a server over a network.
- the method of the preceding paragraph can include any sub-combination of the following features: where the location of the vehicle comprises at least one of geographical coordinates of the vehicle at the first time instant or a lane on a road in which the vehicle was positioned at the first time instant; where determining that a cause of the detected vehicle stop is the vehicle arriving at an unmarked intersection further comprises: generating a grid map, applying the grid map as an input to the artificial intelligence engine, determining a situation of the vehicle based on an output of the artificial intelligence engine, and determining the cause based on at least one of the determined situation or map data; where generating a grip map further comprises: obtaining map data and at least one of light detection and ranging (LiDAR) data, radar data, or camera data, and generating an image in which information derived from the map data is laid over information derived from at least one of the LiDAR data, the radar data, or the camera data to form the grid map; where the artificial intelligence engine is one of a deep neural network or a machine learning model; where
- Another aspect of the disclosure provides non-transitory, computer-readable storage media comprising computer executable instructions for identifying a virtual stop line, where the computer-executable instructions, when executed by a vehicle, cause the vehicle to: detect a vehicle stop at a first time instant using velocity data measured by the vehicle; determine a location of the vehicle at the first time instant; determine, based in part on execution of an artificial intelligence engine running on the vehicle, that a cause of the detected vehicle stop is the vehicle arriving at an unmarked intersection; generate virtual stop line data in response to determining that the cause of the detected vehicle stop is the vehicle arriving at the unmarked intersection; and transmit the virtual stop line data external to the vehicle.
- the non-transitory, computer-readable storage media of the preceding paragraph can include any sub-combination of the following features: where the location of the vehicle comprises at least one of geographical coordinates of the vehicle at the first time instant or a lane on a road in which the vehicle was positioned at the first time instant; where the computer-executable instructions, when executed, further cause the vehicle to: generate a grid map, apply the grid map as an input to the artificial intelligence engine, determine a situation of the vehicle based on an output of the artificial intelligence engine, and determine the cause based on at least one of the determined situation or map data; and where the artificial intelligence engine is one of a deep neural network or a machine learning model.
- the system further comprises a computing device in communication with the plurality of vehicles over a network, the computing device comprising a processor configured with computer-executable instructions that, when executed, cause the computing device to: obtain first virtual line data from a first vehicle in the plurality of vehicles; obtain second virtual line data from a second vehicle in the plurality of vehicles; aggregate the first virtual line data and the second virtual line data using a statistical analysis; and determine a representative virtual line based on the aggregation of the first virtual line data and the second virtual line data, where the representative virtual line, when incorporated into map data, causes at least some of the vehicles in the plurality of vehicles to operate in accordance with the representative virtual line.
- the system of the preceding paragraph can include any sub-combination of the following features: where the first virtual line data is one of first virtual stop line data or first virtual yield line data; where the representative virtual line is one of a representative virtual stop line or a representative virtual yield line; where the computer-executable instructions, when executed, further cause the computing device to select one of a first virtual line corresponding to the first virtual line data or a second virtual line corresponding to the second virtual line data as the representative virtual line; where the representative virtual line corresponds to at least one of a geographic location, a range of geographic locations, or a lane in a road derived from the aggregation of the first virtual line data and the second virtual line data; where the first virtual line data corresponds to a first intersection, and the second virtual line data corresponds to the first intersection; where the first virtual line data corresponds to a first location in the first intersection, and where the second virtual line data corresponds to a second location different than the first location in the first intersection; where the computer-executable instructions, when executed, further cause
- Another aspect of the disclosure provides computer-implemented method comprising: as implemented by one or more computing devices in communication with a first vehicle over a network, obtaining first virtual line data from the first vehicle, where the first virtual line data corresponds to a first time instant and a first intersection; obtaining second virtual line data from the first vehicle, where the second virtual line data corresponds to a second time instant after the first time instant and the first intersection; clustering the first virtual line data and the second virtual line data; and determining a representative virtual line based on the clustering of the first virtual line data and the second virtual line data, where the representative virtual line, when accessed, causes at least one of the first vehicle or another vehicle to operate in accordance with the representative virtual line.
- the computer-implemented method of the preceding paragraph can include any sub-combination of the following features: where the first virtual line data is one of first virtual stop line data or first virtual yield line data; where the representative virtual line is one of a representative virtual stop line or a representative virtual yield line; where determining a representative virtual line further comprises selecting one of a first virtual line corresponding to the first virtual line data or a second virtual line corresponding to the second virtual line data to be the representative virtual line; where the representative virtual line, when accessed, causes at least one of the first vehicle or another vehicle to stop at a location corresponding to the representative virtual line; where the first virtual line data corresponds to a first location in the first intersection, and where the second virtual line data corresponds to a second location different than the first location in the first intersection; and where the first vehicle is at least one of an autonomous vehicle, a vehicle that provides one or more driver-assist features, or a vehicle used to offer location-based services.
- Another aspect of the disclosure provides non-transitory, computer-readable storage media comprising computer executable instructions for identifying a representative virtual line, where the computer-executable instructions, when executed by a computing system, cause the computing system to: obtain first virtual line data from a first vehicle, where the first virtual line data corresponds to a first time instant; obtain second virtual line data from the first vehicle, where the second virtual line data corresponds to a second time instant after the first time instant; cluster the first virtual line data and the second virtual line data; and determine a representative virtual line based on the clustering of the first virtual line data and the second virtual line data, where the representative virtual line, when accessed, causes at least one of a driver alert to be generated or vehicle operation to commence in accordance with the representative virtual line.
- the non-transitory, computer-readable storage media of the preceding paragraph can include any sub-combination of the following features: where the representative virtual line is one of a representative virtual stop line or a representative virtual yield line; and where the driver alert comprises an indication that the first vehicle should stop at a location corresponding to the representative virtual line.
- Another aspect of the disclosure provides a system comprising a plurality of vehicles.
- the system further comprises a computing device in communication with the plurality of vehicles over a network, the computing device comprising a processor configured with computer-executable instructions that, when executed, cause the computing device to: obtain first virtual line data from a first vehicle in the plurality of vehicles; obtain second virtual line data from a second vehicle in the plurality of vehicles; determine a representative virtual line based on the first virtual line data and the second virtual line data; validate the representative virtual line; update map data to incorporate the representative virtual line; and transmit the updated map data to the plurality of vehicles, where the updated map data, when accessed, causes at least some of the vehicles in the plurality of vehicles to operate in accordance with the representative virtual line.
- the system of the preceding paragraph can include any sub-combination of the following features: where the first virtual line data is one of first virtual stop line data or first virtual yield line data; where the representative virtual line is one of a representative virtual stop line or a representative virtual yield line; where the computer-executable instructions, when executed, further cause the computing device to: compare the representative virtual line with a marked line present in the map data, determine that the representative virtual line is at least a threshold distance away from the marked line based on the comparison, and validate the representative virtual line based on the determination that the representative virtual line is at least the threshold distance away from the marked line; where the representative virtual line corresponds to at least one of a geographic location, a range of geographic locations, or a lane in a road derived from at least one of the first virtual line data and the second virtual line data; where the first virtual line data corresponds to a first intersection, and the second virtual line data corresponds to the first intersection; where the first virtual line data corresponds to a first location in the first intersection, and where the second
- Another aspect of the disclosure provides a computer-implemented method comprising: as implemented by one or more computing devices in communication with a first vehicle over a network, obtaining first virtual line data from the first vehicle, where the first virtual line data corresponds to a first time instant and a first intersection; obtaining second virtual line data from the first vehicle, where the second virtual line data corresponds to a second time instant after the first time instant and the first intersection; determining a representative virtual line based on the first virtual line data and the second virtual line data; updating map data to incorporate the representative virtual line; and transmitting the updated map data to the first vehicle, where the updated map data, when accessed, causes at least one of the first vehicle or another vehicle to operate in accordance with the representative virtual line.
- the computer-implemented method of the preceding paragraph can include any sub-combination of the following features: where the first virtual line data is one of first virtual stop line data or first virtual yield line data; where the representative virtual line is one of a representative virtual stop line or a representative virtual yield line; where the computer-implemented method further comprises determining that a validation of the representative virtual line succeeded; where determining that a validation of the representative virtual line succeeded further comprises: comparing the representative virtual line with a marked line present in the map data, determining that the representative virtual line is at least a threshold distance away from the marked line based on the comparison, and validating the representative virtual line based on the determination that the representative virtual line is at least the threshold distance away from the marked line; where the updated map data, when accessed, causes at least one of the first vehicle or another vehicle to stop at a location corresponding to the representative virtual line; and where the first vehicle is at least one of an autonomous vehicle, a vehicle that provides one or more driver-assist features, or a vehicle used to offer location-
- the non-transitory, computer-readable storage media of the preceding paragraph can include any sub-combination of the following features: where the representative virtual line is one of a representative virtual stop line or a representative virtual yield line; and where the alert comprises an indication that the first vehicle should stop at a location corresponding to the representative virtual line.
- a vehicle comprising a first sensor configured to generate velocity data.
- the vehicle further comprises: a processor configured with computer-executable instructions, where the computer-executable instructions, when executed, cause the processor to: identify, based on the velocity data, a trough in a plurality of velocity values, where the trough occurs at a first time instant; determine that a first velocity value in the plurality of velocity values that corresponds to the first time instant is below a velocity threshold value; determine that a prior vehicle stop occurred at a second time instant that is less than a threshold time before the first time instant; determine that a velocity of the vehicle increased by at least a velocity ripple value between the second time instant and the first time instant; and detect a second vehicle stop at the first time instant in response to the determination that the velocity of the vehicle increased by at least the velocity ripple value between the second time instant and the first time instant.
- the vehicle of the preceding paragraph can include any sub-combination of the following features: where the prior vehicle stop corresponds to a second trough in the plurality of velocity values, where the second trough corresponds to the second time instant; the second trough corresponds to a second velocity value in the plurality of velocity values, and where a difference between a third velocity value in the plurality of velocity values corresponding to a third time instant between the first and second time instants and the second velocity value is greater than the velocity ripple value; where the computer- executable instructions, when executed, further cause the processor to: identify, based on the velocity data, a second trough in the plurality of velocity values, where the second trough occurs at a third time instant after the first time instant, determine that a second velocity value in the plurality of velocity values that corresponds to the third time instant is above the velocity threshold value, and determine that a third vehicle stop did not occur at the third time instant; where the computer-executable instructions, when executed, further cause the processor to: identify, based on the velocity
- Another aspect of the disclosure provides a method implemented by a vehicle.
- the method comprises: obtaining velocity data from a first sensor coupled to or embedded within the vehicle; determining, based on the velocity data, that a first velocity value corresponding to a first time instant is below a velocity threshold value; determining that a prior vehicle stop occurred at a second time instant that is less than a threshold time before the first time instant; determining that a velocity of the vehicle increased by at least a velocity ripple value between the second time instant and the first time instant; and detecting a second vehicle stop at the first time instant in response to the determination that the velocity of the vehicle increased by at least the velocity ripple value between the second time instant and the first time instant.
- the method of the preceding paragraph can include any sub-combination of the following features: where the prior vehicle stop corresponds to a second velocity value, where the second velocity value is at a trough of velocity values; where a difference between a third velocity value corresponding to a third time instant between the first and second time instants and the second velocity value is greater than the velocity ripple value; where the method further comprises: identifying, based on the velocity data, a second velocity value corresponding to a third time instant after the first time instant, determining that the second velocity value is above the velocity threshold value, and determining that a third vehicle stop did not occur at the third time instant; where the method further comprises: identifying, based on the velocity data, a second velocity value corresponding to a third time instant after the first time instant, determining that the second velocity value is below the velocity threshold value, determining that the second vehicle stop occurred more than the threshold time before the third time instant, and detecting a third vehicle stop at the third time instant; where the method further comprises: identifying, based on the
- Another aspect of the disclosure provides non-transitory, computer-readable storage media comprising computer executable instructions for detecting a stop, where the computer-executable instructions, when executed by a vehicle, cause the vehicle to: determine, based on velocity data obtained from a first sensor of the vehicle, that a first velocity value corresponding to a first time instant is below a velocity threshold value; determine that a prior vehicle stop occurred at a second time instant that is less than a threshold time before the first time instant; determine that a velocity of the vehicle increased by at least a velocity ripple value between the second time instant and the first time instant; and detect a second vehicle stop at the first time instant in response to the determination that the velocity of the vehicle increased by at least the velocity ripple value between the second time instant and the first time instant.
- the non-transitory, computer-readable storage media of the preceding paragraph can include any sub-combination of the following features: where the computer- executable instructions, when executed, further cause the vehicle to: identify, based on the velocity data, a second velocity value corresponding to a third time instant after the first time instant, determine that the second velocity value is above the velocity threshold value, and determine that a third vehicle stop did not occur at the third time instant; where the computer-executable instructions, when executed, further cause the vehicle to: identify, based on the velocity data, a second velocity value corresponding to a third time instant after the first time instant, determine that the second velocity value is below the velocity threshold value, determine that the second vehicle stop occurred more than the threshold time before the third time instant, and detect a third vehicle stop at the third time instant; and where the computer-executable instructions, when executed, further cause the vehicle to: identify, based on the velocity data, a second velocity value corresponding to a third time instant after the first time instant, determine that the second velocity value is below the
- a vehicle comprising a plurality of sensors, where a first sensor in the plurality of sensors is configured to generate velocity data, and where a second sensor in the plurality of sensors is configured to generate location data.
- the vehicle further comprises a processor configured with computer- executable instructions, where the computer-executable instructions, when executed, cause the processor to: detect a vehicle stop at a first time instant using the generated velocity data; determine a location of the vehicle at the first time instant using the generated location data; determine, using a deep neural network stored on the vehicle, a situation of the vehicle at the determined location; determine, based on at least one of the determined situation or map data, that a cause of the detected vehicle stop is a road obstacle; generate virtual stop line data in response to determining that the cause of the detected vehicle stop is the road obstacle, where the virtual stop line data comprises an indication of a hidden problem at the determined location; and transmit the virtual stop line data to a server over a network via a communication array.
- the vehicle of the preceding paragraph can include any sub-combination of the following features: where the location of the vehicle comprises geographical coordinates of the vehicle at the first time instant and a lane on a road in which the vehicle was positioned at the first time instant; where the computer-executable instructions, when executed, further cause the processor to: generate a grid map, apply the grid map as an input to the deep neural network, and determine the situation of the vehicle based on an output of the deep neural network; where the computer-executable instructions, when executed, further cause the processor to: obtain the map data and at least one of light detection and ranging (LiDAR) data, radar data, or camera data, and generate an image in which information derived from the map data is laid over information derived from at least one of the LiDAR data, the radar data, or the camera data to form the grid map; where the computer- executable instructions, when executed, further cause the processor to train the deep neural network using a training set of grid maps; where the computer-executable instructions, when executed, further cause the
- Another aspect of the disclosure provides a method implemented by a vehicle.
- the method comprises: detecting a vehicle stop at a first time instant using velocity data measured by the vehicle; determining a location of the vehicle at the first time instant; determining, based in part on execution of an artificial intelligence engine running on the vehicle, that a cause of the detected vehicle stop is a road obstacle; generating virtual stop line data in response to determining that the cause of the detected vehicle stop is the road obstacle, where the virtual stop line data comprises an indication of a hidden danger at the determined location; and transmitting the virtual stop line data to a server over a network.
- the method of the preceding paragraph can include any sub-combination of the following features: where the method further comprises operating in a sensitive mode at the determined location in response to accessing map data incorporating information derived from the virtual stop line data; where determining that a cause of the detected vehicle stop is road obstacle further comprises: generating a grid map, applying the grid map as an input to the artificial intelligence engine, determining a situation of the vehicle based on an output of the artificial intelligence engine, and determining the cause based on at least one of the determined situation or map data; where generating a grip map further comprises: obtaining map data and at least one of light detection and ranging (LiDAR) data, radar data, or camera data, and generating an image in which information derived from the map data is laid over information derived from at least one of the LiDAR data, the radar data, or the camera data to form the grid map; where the artificial intelligence engine is one of a deep neural network or a machine learning model; where the road obstacle comprises at least one of a speed bump, a gutter
- Another aspect of the disclosure provides non-transitory, computer-readable storage media comprising computer executable instructions for identifying a virtual stop line, where the computer-executable instructions, when executed by a vehicle, cause the vehicle to: detect a vehicle stop at a first time instant using velocity data measured by the vehicle; determine a location of the vehicle at the first time instant; determine, based in part on execution of an artificial intelligence engine running on the vehicle, that a cause of the detected vehicle stop is a road obstacle; generate virtual stop line data in response to determining that the cause of the detected vehicle stop is the road obstacle, where the virtual stop line data comprises an indication of a hidden danger at the determined location; and transmit the virtual stop line data external to the vehicle.
- the non-transitory, computer-readable storage media of the preceding paragraph can include any sub-combination of the following features: where the computer- executable instructions, when executed, further cause the vehicle to operate in a sensitive mode at the determined location in response to accessing map data incorporating information derived from the virtual stop line data; where the computer-executable instructions, when executed, further cause the vehicle to: generate a grid map, apply the grid map as an input to the artificial intelligence engine, determine a situation of the vehicle based on an output of the artificial intelligence engine, and determine the cause based on at least one of the determined situation or map data; and where the artificial intelligence engine is one of a deep neural network or a machine learning model.
- a system or systems may operate according to one or more of the methods and/or computer-readable media recited in the preceding paragraphs.
- a method or methods may operate according to one or more of the systems and/or computer-readable media recited in the preceding paragraphs.
- a computer-readable medium or media, excluding transitory propagating signals may cause one or more computing devices having one or more processors and non-transitory computer-readable memory to operate according to one or more of the systems and/or methods recited in the preceding paragraphs.
- Conditional language such as, among others,“can,”“could,”“might,” or“may,” unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or steps. Thus, such conditional language is not generally intended to imply that features, elements and/or steps are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without user input or prompting, whether these features, elements and/or steps are included or are to be performed in any particular embodiment.
- the words“comprise,”“comprising,” and the like are to be construed in an inclusive sense, as opposed to an exclusive or exhaustive sense, i.e., in the sense of “including, but not limited to.”
- the terms “connected,” “coupled,” or any variant thereof means any connection or coupling, either direct or indirect, between two or more elements; the coupling or connection between the elements can be physical, logical, or a combination thereof.
- the words“herein,”“above,” “below,” and words of similar import when used in this application, refer to this application as a whole and not to any particular portions of this application.
- words using the singular or plural number may also include the plural or singular number respectively.
- the word "or” in reference to a list of two or more items covers all of the following interpretations of the word: any one of the items in the list, all of the items in the list, and any combination of the items in the list.
- the term“and/or” in reference to a list of two or more items covers all of the following interpretations of the word: any one of the items in the list, all of the items in the list, and any combination of the items in the list.
- certain operations, acts, events, or functions of any of the algorithms described herein can be performed in a different sequence, can be added, merged, or left out altogether (e.g., not all are necessary for the practice of the algorithms).
- operations, acts, functions, or events can be performed concurrently, e.g., through multi-threaded processing, interrupt processing, or multiple processors or processor cores or on other parallel architectures, rather than sequentially.
- Systems and modules described herein may comprise software, firmware, hardware, or any combination(s) of software, firmware, or hardware suitable for the purposes described.
- Software and other modules may reside and execute on servers, workstations, personal computers, computerized tablets, PDAs, and other computing devices suitable for the purposes described herein.
- Software and other modules may be accessible via local computer memory, via a network, via a browser, or via other means suitable for the purposes described herein.
- Data structures described herein may comprise computer files, variables, programming arrays, programming structures, or any electronic information storage schemes or methods, or any combinations thereof, suitable for the purposes described herein.
- User interface elements described herein may comprise elements from graphical user interfaces, interactive voice response, command line interfaces, and other suitable interfaces.
- processing of the various components of the illustrated systems can be distributed across multiple machines, networks, and other computing resources. Two or more components of a system can be combined into fewer components.
- Various components of the illustrated systems can be implemented in one or more virtual machines, rather than in dedicated computer hardware systems and/or computing devices.
- the data repositories shown can represent physical and/or logical data storage, including, e.g., storage area networks or other distributed storage systems.
- the connections between the components shown represent possible paths of data flow, rather than actual connections between hardware. While some examples of possible connections are shown, any of the subset of the components shown can communicate with any other subset of components in various implementations.
- Embodiments are also described above with reference to flow chart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products.
- Each block of the flow chart illustrations and/or block diagrams, and combinations of blocks in the flow chart illustrations and/or block diagrams may be implemented by computer program instructions.
- Such instructions may be provided to a processor of a general purpose computer, special purpose computer, specially-equipped computer (e.g., comprising a high-performance database server, a graphics subsystem, etc.) or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor(s) of the computer or other programmable data processing apparatus, create means for implementing the acts specified in the flow chart and/or block diagram block or blocks.
- These computer program instructions may also be stored in a non-transitory computer-readable memory that can direct a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the acts specified in the flow chart and/or block diagram block or blocks.
- the computer program instructions may also be loaded to a computing device or other programmable data processing apparatus to cause operations to be performed on the computing device or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computing device or other programmable apparatus provide steps for implementing the acts specified in the flow chart and/or block diagram block or blocks.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Life Sciences & Earth Sciences (AREA)
- Atmospheric Sciences (AREA)
- Automation & Control Theory (AREA)
- Traffic Control Systems (AREA)
Abstract
Un serveur en communication avec de multiples véhicules peut recevoir des données de ligne de stop ou de céder le passage virtuelle provenant de tels véhicules. Les données de ligne de stop ou de céder le passage virtuelle peuvent correspondre à différents véhicules qui se sont arrêtés au même croisement au même moment ou à des moments différents. Le serveur peut identifier une ligne de stop ou de céder le passage virtuelle représentative à l'aide des données de ligne de stop ou de céder le passage virtuelle reçues, et valider la ligne de stop ou de céder le passage virtuelle représentative à l'aide de données de carte. Après validation, le serveur peut mettre à jour des données de carte pour qu'elles incorporent la ligne de stop ou de céder le passage virtuelle représentative, et transmettre les données de carte mises à jour à un ou plusieurs véhicules pour leur fournir une assistance à la navigation, à la conduite et/ou à la manœuvre à l'avenir.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US2018/068034 WO2020139390A1 (fr) | 2018-12-28 | 2018-12-28 | Correction de carte à l'aide de données fournies par un véhicule |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US2018/068034 WO2020139390A1 (fr) | 2018-12-28 | 2018-12-28 | Correction de carte à l'aide de données fournies par un véhicule |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020139390A1 true WO2020139390A1 (fr) | 2020-07-02 |
Family
ID=71127390
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2018/068034 WO2020139390A1 (fr) | 2018-12-28 | 2018-12-28 | Correction de carte à l'aide de données fournies par un véhicule |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2020139390A1 (fr) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2592197A (en) * | 2020-02-18 | 2021-08-25 | Daimler Ag | Autonomous vehicle and system thereof |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080147305A1 (en) * | 2006-12-07 | 2008-06-19 | Hitachi, Ltd. | Car Information System, Map Server And On-Board System |
US20150254986A1 (en) * | 2014-03-04 | 2015-09-10 | Google Inc. | Reporting Road Event Data and Sharing with Other Vehicles |
US20170122749A1 (en) * | 2015-11-04 | 2017-05-04 | Toyota Jidosha Kabushiki Kaisha | Map update determination system |
JP2018106255A (ja) * | 2016-12-22 | 2018-07-05 | パイオニア株式会社 | 地図データ構造、送信装置、及び、運転支援装置 |
JP2018197964A (ja) * | 2017-05-24 | 2018-12-13 | 日産自動車株式会社 | 車両の制御方法及び装置 |
-
2018
- 2018-12-28 WO PCT/US2018/068034 patent/WO2020139390A1/fr active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080147305A1 (en) * | 2006-12-07 | 2008-06-19 | Hitachi, Ltd. | Car Information System, Map Server And On-Board System |
US20150254986A1 (en) * | 2014-03-04 | 2015-09-10 | Google Inc. | Reporting Road Event Data and Sharing with Other Vehicles |
US20170122749A1 (en) * | 2015-11-04 | 2017-05-04 | Toyota Jidosha Kabushiki Kaisha | Map update determination system |
CN106996793A (zh) * | 2015-11-04 | 2017-08-01 | 丰田自动车株式会社 | 地图更新判定*** |
JP2018106255A (ja) * | 2016-12-22 | 2018-07-05 | パイオニア株式会社 | 地図データ構造、送信装置、及び、運転支援装置 |
JP2018197964A (ja) * | 2017-05-24 | 2018-12-13 | 日産自動車株式会社 | 車両の制御方法及び装置 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2592197A (en) * | 2020-02-18 | 2021-08-25 | Daimler Ag | Autonomous vehicle and system thereof |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11860639B2 (en) | Vehicle-based road obstacle identification system | |
US10990105B2 (en) | Vehicle-based virtual stop and yield line detection | |
US11373524B2 (en) | On-board vehicle stop cause determination system | |
US20200211370A1 (en) | Map editing using vehicle-provided data | |
US11860625B2 (en) | System and method for updating vehicle operation based on remote intervention | |
US11287270B2 (en) | Systems and methods for safe route planning for a vehicle | |
US11720094B2 (en) | System and method for remote intervention of vehicles | |
US11131554B2 (en) | Systems and methods for vehicle telemetry | |
US11023745B2 (en) | System for automated lane marking | |
CN114370883B (zh) | 用于操纵车辆的方法和*** | |
US20200208991A1 (en) | Vehicle-provided virtual stop and yield line clustering | |
WO2020139355A1 (fr) | Système de marquage de voie automatisé | |
CN113748316B (zh) | 用于车辆遥测的***和方法 | |
US11670286B2 (en) | Training mechanism of verbal harassment detection systems | |
WO2020139356A1 (fr) | Prétraitement d'image dans un système de détermination de marquage de voie | |
CN113748448B (zh) | 基于车辆的虚拟停止线和让行线检测 | |
WO2020139324A1 (fr) | Systèmes et procédés de planification d'itinéraire sûr pour un véhicule | |
WO2020139392A1 (fr) | Système d'identification d'obstacle routier basé sur un véhicule | |
US11620987B2 (en) | Generation of training data for verbal harassment detection | |
US11094197B2 (en) | System and method for switching from a curbside lane to a lane-of-interest | |
WO2020139390A1 (fr) | Correction de carte à l'aide de données fournies par un véhicule | |
WO2020139388A1 (fr) | Regroupement de ligne de stop ou de céder le passage virtuelle fourni par un véhicule | |
CN114722931A (zh) | 车载数据处理方法、装置、数据采集设备和存储介质 | |
WO2020139394A1 (fr) | Système embarqué de détermination de cause d'arrêt de véhicule | |
US20240239359A1 (en) | System, Method, and Computer Program Product for Data-Driven Optimization of Onboard Data Collection |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18944759 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18944759 Country of ref document: EP Kind code of ref document: A1 |