EP3718097A1 - Procédé d'affichage du tracé d'une zone de sécurité devant un véhicule ou un objet avec une unité d'affichage, dispositif pour la mise en uvre du procédé ainsi que véhicule automobile et programme informatique - Google Patents
Procédé d'affichage du tracé d'une zone de sécurité devant un véhicule ou un objet avec une unité d'affichage, dispositif pour la mise en uvre du procédé ainsi que véhicule automobile et programme informatiqueInfo
- Publication number
- EP3718097A1 EP3718097A1 EP18803343.5A EP18803343A EP3718097A1 EP 3718097 A1 EP3718097 A1 EP 3718097A1 EP 18803343 A EP18803343 A EP 18803343A EP 3718097 A1 EP3718097 A1 EP 3718097A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- vehicle
- grid
- driver
- displayed
- safety zone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000004590 computer program Methods 0.000 title claims description 7
- 239000011521 glass Substances 0.000 claims abstract description 9
- 230000009471 action Effects 0.000 claims description 15
- 238000001514 detection method Methods 0.000 claims description 11
- 238000004040 coloring Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 4
- 230000003190 augmentative effect Effects 0.000 abstract description 9
- 238000003780 insertion Methods 0.000 description 15
- 230000037431 insertion Effects 0.000 description 15
- 238000004891 communication Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 11
- 230000008901 benefit Effects 0.000 description 8
- 230000007613 environmental effect Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 238000007906 compression Methods 0.000 description 7
- 230000006835 compression Effects 0.000 description 7
- 238000013459 approach Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000001556 precipitation Methods 0.000 description 4
- 230000003416 augmentation Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000033001 locomotion Effects 0.000 description 3
- 230000007774 longterm Effects 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 238000004378 air conditioning Methods 0.000 description 1
- 230000009118 appropriate response Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000003542 behavioural effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009472 formulation Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/001—Texturing; Colouring; Generation of texture or colour
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/161—Decentralised systems, e.g. inter-vehicle communication
- G08G1/163—Decentralised systems, e.g. inter-vehicle communication involving continuous checking
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/165—Anti-collision systems for passive traffic, e.g. including static obstacles, trees
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/179—Distances to obstacles or vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/20—Optical features of instruments
- B60K2360/31—Virtual images
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/23—Head-up displays [HUD]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
Definitions
- the proposal concerns the technical field of driver information systems, also known as infotainment systems. In particular, this involves a method for displaying a safety zone in front of a vehicle or an object on a display unit. Such systems are used primarily in vehicles. But there is also the possibility of using the invention in pedestrians, cyclists, etc. with data glasses. The proposal continues to cover a correspondingly designed one
- Control of the vehicle can take over.
- the driver also takes
- HUD Head-Up Display
- Vehicle sensors are in particular called the following components that allow an environment observation: RADAR devices according to Radio Detection and Ranging, LIDAR devices, according to Light Detection and Ranging, mainly for distance detection / warning, and cameras with appropriate image processing for the field of object recognition.
- This data on the environment can thus be used as a basis for system-side driving recommendations, warnings, etc.
- LTE V2X Long Term Evolution
- Autonomous driving (sometimes also called automatic driving, automated driving or piloted driving) is the movement of vehicles, mobile robots and driverless transport systems to understand the largely autonomous behavior.
- autonomous driving There are different gradations of the term autonomous driving. It is spoken at certain stages even from autonomous driving, if there is still a driver in the vehicle, if necessary, only takes over the monitoring of the automatic driving.
- the various ceremonies of transport in Germany the Federal Highway Research Institute was involved) worked together and the following
- Level 0 Driver only, the driver drives, steers, accelerates, brakes, etc.
- Level 1 Certain assistance systems help with vehicle operation (including a cruise control system - Automatic Cruise Control ACC).
- Level 3 high automation. The driver does not have to keep the system permanently
- the vehicle autonomously performs functions such as triggering the turn signal, lane change and lane keeping.
- the driver can turn to other things, but if necessary within a warning time of the system
- Level 4 full automation. The guidance of the vehicle is permanently taken over by the system. If the system no longer copes with the driving tasks, the driver can be asked to take the lead.
- Level 5 No driver required. There is no human intervention beyond setting the goal and starting the system.
- a future vision in the automotive industry is to be able to record the windscreen of one's own vehicle with virtual elements, in order to offer the driver some advantages.
- the so-called "augmented reality” technology (AR) is used. Less familiar is the corresponding German-language term of "augmented reality”.
- the real environment is enriched with virtual elements. This has several advantages: The view down, on displays other than the windshield, is eliminated, since many relevant information is displayed on the windshield. So the driver does not have to avert his gaze from the road. In addition, due to the positionally exact sclerosing of the virtual elements in the real environment, a lesser cognitive effort on the part of the driver is likely because no interpretation of a graphic must be done on a separate display. With regard to automatic driving, an added value can also be generated.
- Display area of the HUD has the consequence that a section of it can be seen.
- a method for displaying a lane course in front of a vehicle wherein a current speed of the vehicle is determined.
- points of a vehicle environment lying in front of the vehicle are determined so that an optical flow of these points is determined taking into account the current vehicle speed and that symbols for displaying the optical flow are displayed in the head-up display for a presentation of the course of the lane.
- Path control method known. The method and system is used to support the path control, in particular a vehicle on a road or in a
- the method consists of performing at least one of the following steps (a) and (b): (a) estimating an actual future path of the vehicle based on
- a stereoscopic head-up display in which a photometric parameters of the display unit, such as the brightness and background color from the environment of the vehicle, in particular only as a function of the position of the vehicle to a determined precipitation the position of the vehicle, a determined ambient temperature at the position of the vehicle, a time information and / or at least one value of an external data source is determined.
- a motor vehicle with head-up display in which a braking distance of the motor vehicle is displayed with the head-up display. In order to make the driver immediately aware of the length of the braking path, that fictitious point at which the motor vehicle would come to a standstill on the basis of the initiated braking process is visualized in the head-up display with a cross-beam projected in.
- the actual braking distance is not limited to an actual braking operation, i. when the brake pedal is pressed, displayed but constantly during the entire driving operation.
- a method for displaying a distance information on a display device of a vehicle is known.
- the method is characterized in that a real image of the lane ahead of the vehicle is recorded with the camera, and a safety distance to the vehicle in front is determined as a function of at least one vehicle-dynamic size of the vehicle.
- the real image is extended by a virtual image portion in the form of a crossbar, which indicates the safety distance in the correct position to the vehicle in front.
- AR augmented reality
- Scope of the invention recognized.
- the problem is that depending on the ambient conditions, in particular the driving situation, the representation of the Safety zone either poorly recognizable or just too conspicuous and distracts from the actual events on the road.
- Safety zone in front of the vehicle which should be variably adapted to the ambient conditions so that it can not lead to distractions of the driver.
- the invention sets itself the task of finding such an approach. Another object is that, conversely, it should be prevented that the direction of travel is displayed too weakly in certain environmental conditions, so that the driver can track the course poorly.
- This object is achieved by a method for displaying a safety zone in front of a vehicle or an object with the aid of a display unit according to claim 1
- the solution according to the invention is to dispense with masking surfaces and instead to make the representation of the security zone in a fragmented form.
- This approach a number of advantages are seen, in addition to the fulfillment of the
- Fault tolerance consists in the fact that the human perceptive apparatus is easily able, the individual perceptible due to the evolution-biological conditions
- the representation of the safety zone is done in grid form, wherein the vehicle facing away from the end of the grid indicates the end of the safety zone at the measured speed and optionally taking into account the detected environmental conditions. Until the end of the safety zone, the driver could take into account the
- the representation of the safety zone is calculated such that it illustrates the instantaneous braking distance or stopping distance of the vehicle. Change the speed of the vehicle and / or the environmental conditions, such as Precipitation situation, temperature, humidity, so also the braking distance changes and accordingly also the representation of the safety zone.
- Attention of the driver requires the grid completed and, in addition, depending on the situation, a virtual stop line is displayed at a location of the track in front of the displayed grid, where the driver's heightened attention is required. Whenever the security zone becomes visible in full raster form, this is an indication of increased attention to the driver. When the stop line is displayed, the driver can already adjust to a braking process and, for example, "take gas off".
- Typical driving situations that are assessed to require increased driver attention correspond to driving on a non-urban road approaching a crossroads or intersection with a priority rule to follow, such as right-to-left, stop-road or right of way. Street.
- Grid insertion would also be considered in other driving situations.
- Other examples include: Sudden braking of the vehicle in front, occurrence of
- Road irregularities such as potholes, cobblestones, etc., and in other situations requiring action of the driver in terms of speed change or steering action, e.g., animals or people on the road or obstacles on the road.
- the grid is additionally highlighted highlighted in a driving situation that predicts an intrusion of another road user in the safety zone in front of the vehicle.
- the coloring can be carried out dynamically in a further embodiment, wherein the
- Halftone dots are dyed radially out of the direction from which the other Road users in the safety zone in front of the vehicle presumably penetrates. This makes it intuitively visible to the driver from which direction the danger threatens.
- the grid when approaching the vehicle to the virtual stop line, the grid may be calculated to be displayed in a compressed form so that all
- Grid points are positioned in front of the stop line when the position of the grid has been calculated so that the vehicle-remote end of the grid has reached the stop line.
- the grid does not push itself into the intersection or inflection. Due to the compression, the attention is directed to the stop line, which, in contrast to the "vehicle-fixed" grid at a certain point on the road (street-fixed) is located.
- the procedure provides the driver with the information that is essential in the situation, namely at which point of the road he must necessarily come to a stop.
- the crushing of the grid occurs whenever the stopping distance becomes greater than the distance to the obstacle.
- the obstacle may be the virtual stop line, but also e.g. the braking fore vehicle.
- the grid is then compressed so that it ends in front of the fore vehicle.
- the danger situation can be pointed even more strongly by one or more action request symbols being displayed in addition to coloring the virtual stop line. So then the driver becomes very insistent on the need to initiate the braking process
- an action request symbol is preferably a
- the action prompt icon is preferably displayed as hovering over the virtual stop line. This ensures that this symbol still remains visible due to its height above the road surface, even if the augmented stop line is so close to the vehicle that they are no longer displayed in the field of view of the head-up display (field of view) can.
- this device For a device for carrying out the method, it is advantageous if it has a display unit with which additional virtual information can be superimposed into the field of vision of the driver or the operator of the object. This is the case with a head-up display as well as with data glasses. Furthermore, this device should be a Have arithmetic unit and detection means. With the detection means is the
- the arithmetic unit is designed, depending on the speed and / or of the detected environment / environmental conditions for the display of
- Security zone to calculate a grid, with the vehicle-remote end of the grid indicates the end of the security zone.
- the environment is detected. Also important is the very accurate recording of your own position in the environment. This is beneficial to one
- “Accurate” augmentation is possible. This also includes the detection of the future course of the road, as the display of the grid should be adapted to the course of the road and e.g. should not be in a bend next to the road. In this context should also be data about the control process of the vehicle, such as its own
- Steering angle setting the "turn signal” or a cross-shelf within the lane detected, and taken into account so that the grid, for example. when lane changes can be displayed correctly on the future trajectory of the vehicle.
- weather conditions such as rainfall, heavy rain, snow, hail or fog can be recorded. This can also be the
- the display unit is designed as a head-up display.
- a data goggle or a monitor can be used in the device as a display unit, on which a camera image is displayed, in which the grid is displayed.
- the device according to the invention can be used in a motor vehicle.
- the invention is preferably realized so that the display unit is permanently installed in the vehicle, e.g. in the form of a head-up display.
- the invention can also be advantageously used if the display unit corresponds to data glasses. Then, the invention can be
- Fig. 2 shows the typical cockpit of a vehicle
- FIG. 3 shows the block diagram of the infotainment system of the vehicle
- Fig. 4 shows two representations of grid overlays for the display of
- Figure 5 shows the principle of the insertion of a safety zone in the field of view of the driver of a vehicle in grid form according to the invention.
- Fig. 6 is an illustration of a reduced insertion of a security zone in the
- Fig. 7 is an illustration of the complete insertion of a security zone in the
- Fig. 1 1 is a representation of an insertion of a security zone in the field of view of
- FIG. 12 shows the illustration of the insertion of a safety zone in the field of vision of the driver of a vehicle in grid form according to the fifth embodiment of the invention Invention, in which only the display of the brake request symbol is visible;
- FIG. 13 shows the representation of the insertion of a safety zone in the field of vision of the driver of a vehicle according to the fifth exemplary embodiment of the invention in an escalation stage in which only the display of the
- Brake call icon is visible, and the other road users, which has penetrated into the safety zone, is also visible in the field of vision of the driver;
- Raster for displaying the security area according to an embodiment of the invention.
- Fig. 1 illustrates the basic operation of a head-up display.
- the head-up display 20 is in the vehicle 10 below / behind the instrument cluster in
- Additional information is displayed in the driver's field of vision.
- This additional information appears as if it were projected onto a projection surface 21 at a distance of 7 - 15 m in front of the vehicle 10.
- the additional information displayed creates a kind of virtual environment.
- the virtual environment is theoretically placed over the real world and contains the virtual objects that support and inform the driver while driving. However, it is only projected onto a part of the windshield, so that the additional information can not be arbitrarily arranged in the field of vision of the driver.
- Fig. 2 shows the cockpit of the vehicle 10. Shown is a passenger car. As vehicle 10, however, any other vehicles would also be considered. Examples of other vehicles are: buses, commercial vehicles, especially trucks trucks, agricultural machinery, construction machinery, rail vehicles, etc. The use of the invention would be generally in land vehicles, rail vehicles, watercraft and aircraft possible.
- the cockpit three display units of an infotainment system are shown. It is the head-up display 20 and a touch-sensitive screen 30, which is mounted in the center console.
- the center console When driving, the center console is not in the driver's field of vision. Therefore, the additional information is not displayed on the display unit 30 while driving.
- the touch-sensitive screen 30 serves in particular for the operation of functions of the vehicle 10. For example, about a radio, a radio, a radio, a
- An infotainment system refers to motor vehicles, especially passenger cars, the merger of car radio, navigation system,
- infotainment is a boxword word composed of the words information and entertainment (entertainment).
- touch screen To operate the infotainment system mainly the touch-sensitive screen 30 ("touch screen") is used, this screen 30 can be well viewed and operated in particular by a driver of the vehicle 10, but also by a passenger of the vehicle 10.
- mechanical operating elements for example keys, rotary encoders or combinations thereof, such as, for example, a push-dial regulator, can be arranged in an input unit 50.
- This unit is not shown separately, but is considered part of the input unit 50.
- the operation device includes the touch-sensitive display unit 30, a calculator 40, an input unit 50, and a memory 60.
- the display unit 30 includes both a display surface for displaying variable graphic information and a control surface (touch-sensitive layer) disposed above the display surface
- the display unit 30 is connected to the computing device 40 via a data line 70
- the data line can be designed according to the LVDS standard, corresponding to Low Voltage Differential Signaling.
- the display unit 30 receives control data for driving the display surface of the touch screen 30 from the
- Computing device 40 Via the data line 70 are also control data of
- Reference numeral 50 denotes the input unit. It is associated with the already mentioned control elements such as buttons, knobs, sliders, or rotary pushbuttons, with the help of which the operator can make inputs via the menu. Input is generally understood as selecting a selected menu item, as well as changing a parameter, turning a function on and off, and so on.
- the memory device 60 is connected to the computing device 40 via a data line 80.
- a pictogram directory and / or symbol directory is stored with the pictograms and / or symbols for the possible overlays of additional information.
- the points / symbols can be stored, which serve as the basis for the calculation of the raster overlay.
- the other parts of the infotainment system camera 150, radio 140, navigation device 130, telephone 120 and instrument cluster 110 are connected via the data bus 100 with the device for operating the infotainment system.
- the data bus 100 is the high-speed variant of the CAN bus according to ISO standard 11898-2.
- Ethernet-based bus system such as BroadR-Reach in question.
- Bus systems in which the data is transmitted via optical fibers can also be used. Examples are the MOST Bus (Media Oriented System Transport) or the D2B Bus (Domestic Digital Bus).
- the camera 150 can be designed as a conventional video camera. In this case, it will record 25 frames / s, which is equivalent to 50 fields / s in the interlace recording mode.
- the vehicle 10 is with a special camera that captures more images / sec to increase the accuracy of object detection on faster moving objects.
- a special camera can be used that captures more images / sec to increase the accuracy of object detection on faster moving objects.
- Several cameras can be used for monitoring the environment.
- the already mentioned RADAR or LIDAR systems could be used in addition or alternatively to carry out or expand the field observation.
- the vehicle 10 is with a
- Communication module 160 equipped. This module is often referred to as an on-board unit. It can be used for mobile communication, e.g. according to LTE standard,
- the basis of the security zone display according to the invention is a virtual grid which is displayed at a distance above the actual real environment.
- the real environment corresponds to the real road course.
- FIG. 4 shows the principle of how information is superimposed on the driver's field of vision by means of the head-up display 20.
- the reference number 21 again denotes the projection area of the head-up display 20. It is shown that a grid 22 is displayed along the roadway course.
- This control of the longitudinal and lateral guidance is accomplished by drivers continuously trying to maintain a safety zone around their vehicle while driving
- This safety zone can be understood as an area or time within which the vehicle can move safely and without collision.
- the visualization of this safety zone using an augmented reality head-up display (AR-HUD) directly in the real environment therefore provides valuable support for the driver to master the driving task.
- AR-HUD augmented reality head-up display
- the invention relates to the logic and visualization of the safety zone in the AR-HUD using a point grid.
- FIG. 5 shows the principle of the insertion of a safety area into the field of vision of the driver.
- the security area is displayed in the form of a dot matrix 22.
- the extent of the dot matrix 22 was calculated so that it corresponds approximately to the braking distance of the vehicle at the given driving speed under the given conditions, as indicated in Fig. 5 by the arrow. Striking is that
- Dot matrix 22 does not extend to the front of the vehicle.
- the display area of the HUD actually begins only a few meters in front of your own vehicle.
- the grid 22 is then displayed only for the braking distance 25. Until the initiation of the braking process can still pass time that is not covered by the grid 22.
- Grid 22 visualizes the braking distance based on its dimensions. Increasing the speed therefore leads to an increasing number of dot lines of the grid due to the associated extension of the braking distance.
- the grid 22 is dependent on the vehicle behavior, is carried while driving and is therefore to be understood as vehicle-fixed and not road-firm (in contrast to navigation arrows in a navigation system, for example).
- the grid 22 follows the roadway and conforms e.g. in curves to the road.
- FIG. 6 shows the first example of the fade-in of the security area in raster form, where the raster 22 can be seen in a reduced form.
- D current gear
- maximum speed 60
- current vehicle speed 33 km / h
- target speed 35 km / h
- Remaining Range 220 km. The information applies to an electric vehicle.
- the grid 22 is completely with white grid points in transparent form.
- the extent of the grid 22 continues to indicate the length of the braking path in the longitudinal direction. This corresponds to the escalation level 1 and the driver is thus prepared for poorly predictable situations.
- FIG. An example of how this can be done is shown in FIG. There, the driving situation is shown, where the vehicle approaches to a right-to-left intersection. There, in any case, the stop in front of the crossing lane is appropriate. To prepare the driver for it, one becomes
- Augmentation can be road-resistant in contrast to the vehicle-fixed grid 22.
- the driver receives a behavioral recommendation that does not exist in the real environment.
- the grid 22 Upon detection of an impending collision, e.g. Due to the threat of another road user entering their own security zone, the grid 22 is colored reddish. This is shown in FIG. 9.
- the grid is calculated in such a way that the coloration starts radially from the direction from which the other road user should appear.
- the coloring of the grid is predictive, i. already when the other vehicle is still relatively far away from the intersection. Often, the situation will be such that the board's own environmental monitoring tools such as Camera 150 or Radar can not easily detect the other vehicle. However, the vehicles will in the future be networked via Car2Car communication so that they constantly exchange relevant information. At the same time their position data are exchanged. From the successive
- the vehicle 10 can estimate the movement of approaching vehicles and determine those vehicles with collision / hazard potential. By coloring the grid 22 from the side of the imminent danger, the driver is warned and directed his attention in this direction. The coloring corresponds to a second escalation stage.
- Another action on the side of the second escalation stage is made when the front raster page reaches the fade in stop line 23. This is shown in FIG. 10. Then, the grid 22 is compressed to end before the stop line 23. The compression can be done so that the distance of the grid transverse lines is reduced starting from the stop line 23 to the vehicle-facing side, as shown in Fig. 10. The grid 22 is therefore not pushed into the intersection.
- the compression of the grid lines is emphasizes the stop line 23, which in contrast to the vehicle-fixed grid 22 is located at a certain point on the road (road-fixed). In addition, the stop line is also colored red.
- a disadvantage is that the length of the grid 22 can no longer correctly visualize the braking distance due to the compression. However, this information is increasingly taking a back seat in this situation. This measure provides the driver with the essential information in the situation, namely at which point of the road he must necessarily come to a halt. The compression and the red color no longer indicate the actual braking distance, but the only way available.
- an action symbol 24 can be displayed as an additional measure simultaneously with the appearance of the augmented, red stop line 23, which is shown hovering above the stop line 23 in the street space.
- the advantage of this additional measure is that due to its elevated position above the road surface, this symbol remains visible even when the augmented stop line 23 is so close to the vehicle 10 that it is no longer in the field of view of the head-up display 20 (FIG. Field of View) can be displayed.
- the action icon 24 corresponds to a 2D brake symbol in the illustrated case.
- FIG. 14 the course of a program is now shown, which is processed in the arithmetic unit 40 for carrying out the method according to the invention.
- the program start is designated by the reference numeral 405.
- program step 410 the surroundings information U1 for the vehicle 10 is recorded. This happens mainly with the help of the already mentioned data transmitted by Car2Car communication from surrounding vehicles.
- the image data recorded by camera 150 are also evaluated in order, for example, to detect obstacles on the roadside.
- program step 415 the weather conditions are detected. Here, for example, it depends very much on whether precipitation falls, and also what type of precipitation it is. This can with a rain sensor or via the measurement of the speed of the wiper motor or also by an image evaluation method and camera 150.
- the weather data include other measured values such as outside temperature and humidity. These data can be captured by on-board sensors.
- This type of data may also be loaded via the on-board unit 160, e.g. from a website that provides the local weather data WD very accurately.
- step 420 the current driving speed and the data on the current control process SG are detected. This information is available in the instrument cluster 110 and is transmitted via the vehicle bus 100 in the arithmetic unit 40.
- program step 425 the evaluation of the navigation route NR, which is carried out by the
- Navigation system 130 is derived. Via the navigation route and the map data, the system is then aware of which road intersections or road turns follow on the planned route. Thereafter, in step 430, the calculation of the raster 22 takes place as a function of the acquired parameters U1, WD, SG and the
- Navigation route NR for the insertion on the head-up display 20 is thus calculated, where in the field of view of the driver, the grid 22 is to be displayed and what dimensions the grid 22 should have and, for example. also, if a compression is necessary.
- the data for the display of the grid 22 in step 435 are transmitted to the head-up display 20. This then inserts the calculated grid 22 into the field of view of the driver.
- the program ends in program step 440.
- Special purpose processors may include Application Specific Integrated Circuits (ASICs), Reduced Instruction Set Computer (RISC), and / or Field Programmable Gate Arrays (FPGAs).
- ASICs Application Specific Integrated Circuits
- RISC Reduced Instruction Set Computer
- FPGAs Field Programmable Gate Arrays
- the proposed method and apparatus implemented as a combination of hardware and software.
- the software is preferably installed as an application program on a program storage device. Typically it is a machine based on a
- Computer platform that has hardware, such as one or more
- CPU Central processing units
- RAM random access memory
- I / O Input / output interface
- the computer platform also typically installs an operating system.
- the various processes and functions described herein may be part of the application program or part that is executed via the operating system.
- the invention can always be used when the field of view of a driver, an operator or even just a person with data glasses can be enriched with AR impressions.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Traffic Control Systems (AREA)
- Instrument Panels (AREA)
Abstract
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102017221191.1A DE102017221191B4 (de) | 2017-11-27 | 2017-11-27 | Verfahren zur Anzeige des Verlaufs einer Sicherheitszone vor einem Fahrzeug oder einem Objekt mit einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm |
PCT/EP2018/079958 WO2019101491A1 (fr) | 2017-11-27 | 2018-11-01 | Procédé d'affichage du tracé d'une zone de sécurité devant un véhicule ou un objet avec une unité d'affichage, dispositif pour la mise en œuvre du procédé ainsi que véhicule automobile et programme informatique |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3718097A1 true EP3718097A1 (fr) | 2020-10-07 |
Family
ID=64308709
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18803343.5A Pending EP3718097A1 (fr) | 2017-11-27 | 2018-11-01 | Procédé d'affichage du tracé d'une zone de sécurité devant un véhicule ou un objet avec une unité d'affichage, dispositif pour la mise en uvre du procédé ainsi que véhicule automobile et programme informatique |
Country Status (5)
Country | Link |
---|---|
US (1) | US11325471B2 (fr) |
EP (1) | EP3718097A1 (fr) |
CN (1) | CN111373461A (fr) |
DE (1) | DE102017221191B4 (fr) |
WO (1) | WO2019101491A1 (fr) |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102018203462A1 (de) * | 2018-03-07 | 2019-09-12 | Volkswagen Aktiengesellschaft | Verfahren zur Berechnung einer Einblendung von Zusatzinformationen für eine Anzeige auf einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm |
JP7508763B2 (ja) * | 2018-03-29 | 2024-07-02 | 株式会社リコー | 画像制御装置、表示装置、移動体、画像制御方法、及びプログラム |
US11435751B2 (en) * | 2018-12-28 | 2022-09-06 | Beijing Voyager Technology Co., Ltd. | Vehicle-based road obstacle identification system |
US10991244B2 (en) | 2018-12-28 | 2021-04-27 | Beijing Voyager Technology Co., Ltd. | On-board vehicle stop cause determination system |
DE102019217250A1 (de) * | 2019-11-07 | 2021-05-12 | Volkswagen Aktiengesellschaft | Identifikation eines durchzuführenden Fahrmanövers mittels zusätzlicher Bodenmarkierung |
US11354913B1 (en) * | 2019-11-27 | 2022-06-07 | Woven Planet North America, Inc. | Systems and methods for improving vehicle predictions using point representations of scene |
DE102020102278A1 (de) | 2020-01-30 | 2021-08-05 | Bayerische Motoren Werke Aktiengesellschaft | Verfahren zur Navigationsunterstützung in einem Kraftfahrzeug auf Grundlage von Informationen aus mehreren erfassenden Kraftfahrzeugen |
JP2022126240A (ja) * | 2021-02-18 | 2022-08-30 | トヨタ自動車株式会社 | 車両用表示装置 |
EP4068153A1 (fr) * | 2021-03-31 | 2022-10-05 | Honda Research Institute Europe GmbH | Système d'aide à la conduite avancé pour aider un conducteur d'un véhicule |
JP2022184350A (ja) * | 2021-06-01 | 2022-12-13 | マツダ株式会社 | ヘッドアップディスプレイ装置 |
CN113421346B (zh) * | 2021-06-30 | 2023-02-17 | 暨南大学 | 一种增强驾驶感的ar-hud抬头显示界面的设计方法 |
DE102022109576B4 (de) | 2022-04-20 | 2024-06-27 | Bayerische Motoren Werke Aktiengesellschaft | System, verfahren und software zum anzeigen einer abstandsmarkierung |
US20230401873A1 (en) * | 2022-06-14 | 2023-12-14 | Snap Inc. | Ar assisted safe cycling |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19940718C1 (de) | 1999-08-27 | 2001-05-31 | Daimler Chrysler Ag | Verfahren zur Anzeige eines perspektivischen Bildes und Anzeigevorrichtung für mindestens einen Insassen eines Fahrzeugs |
DE10317044A1 (de) * | 2003-04-11 | 2004-10-21 | Daimlerchrysler Ag | Freiraumüberwachung bei Kraftfahrzeugen |
AU2003300514A1 (en) | 2003-12-01 | 2005-06-24 | Volvo Technology Corporation | Perceptual enhancement displays based on knowledge of head and/or eye and/or gaze position |
GB2419118A (en) | 2004-10-13 | 2006-04-19 | Adrian James Locke | Traffic spacer using head-up display |
DE102005046756B4 (de) | 2005-09-29 | 2017-10-26 | Volkswagen Ag | Verfahren und Vorrichtung zur Darstellung von Informationen einer automatischen Distanzregelung |
JP4720457B2 (ja) * | 2005-11-22 | 2011-07-13 | アイシン・エィ・ダブリュ株式会社 | 車両の運転支援方法及び運転支援装置 |
DE102006032770A1 (de) | 2006-07-14 | 2008-01-17 | GM Global Technology Operations, Inc., Detroit | Kraftfahrzeug mit einem Head-Up-Display |
JP4808119B2 (ja) * | 2006-09-28 | 2011-11-02 | クラリオン株式会社 | 停車予測位置を表示するナビゲーション装置 |
DE102007016868A1 (de) | 2007-04-10 | 2008-10-16 | Robert Bosch Gmbh | Verfahren zur Anzeige eines Fahrbahnverlaufs und Steuereinrichtung |
DE102008013981B4 (de) * | 2008-03-12 | 2015-01-15 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Dynamische Geschwindigkeitsinformationsanzeige und deren Migrationsstrategie |
US8686872B2 (en) | 2010-12-29 | 2014-04-01 | GM Global Technology Operations LLC | Roadway condition warning on full windshield head-up display |
CN103732480B (zh) * | 2011-06-17 | 2017-05-17 | 罗伯特·博世有限公司 | 用于在行车道上车辆的线路引导中辅助驾驶员的方法和设备 |
DE102011121763B4 (de) | 2011-12-21 | 2023-04-06 | Volkswagen Aktiengesellschaft | Verfahren zur Darstellung einer Abstandsinformation auf einer Anzeigevorrichtung eines Fahrzeugs und Anzeigevorrichtung |
DE102012222380A1 (de) | 2012-12-06 | 2014-06-12 | Robert Bosch Gmbh | Verfahren zum Bestimmen wenigstens eines Darstellungsparameters, Vorrichtung, Computerprogrammprodukt |
DE102013016242A1 (de) * | 2013-10-01 | 2015-04-02 | Daimler Ag | Verfahren und Vorrichtung zur Unterstützung mindestens eines Fahrassistenzsystems |
DE102015204122A1 (de) * | 2014-05-12 | 2015-11-12 | Volkswagen Aktiengesellschaft | Ampelassistenzsystem für ein Fahrzeug mit einer Anzeigeeinrichtung |
EP3093194B1 (fr) * | 2015-04-24 | 2021-09-22 | Ricoh Company, Ltd. | Dispositif de fourniture d'informations |
EP3353763A1 (fr) * | 2015-09-25 | 2018-08-01 | Apple Inc. | Système d'affichage à réalité augmentée |
JP6493923B2 (ja) * | 2016-11-08 | 2019-04-03 | 本田技研工業株式会社 | 情報表示装置、情報表示方法、および情報表示プログラム |
US11010934B2 (en) * | 2016-12-09 | 2021-05-18 | Kyocera Corporation | Imaging apparatus, image processing apparatus, display system, and vehicle |
-
2017
- 2017-11-27 DE DE102017221191.1A patent/DE102017221191B4/de active Active
-
2018
- 2018-11-01 WO PCT/EP2018/079958 patent/WO2019101491A1/fr unknown
- 2018-11-01 CN CN201880076615.9A patent/CN111373461A/zh active Pending
- 2018-11-01 EP EP18803343.5A patent/EP3718097A1/fr active Pending
- 2018-11-01 US US16/766,311 patent/US11325471B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN111373461A (zh) | 2020-07-03 |
US20200369149A1 (en) | 2020-11-26 |
DE102017221191B4 (de) | 2019-06-13 |
DE102017221191A1 (de) | 2019-05-29 |
WO2019101491A1 (fr) | 2019-05-31 |
US11325471B2 (en) | 2022-05-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE102017221191B4 (de) | Verfahren zur Anzeige des Verlaufs einer Sicherheitszone vor einem Fahrzeug oder einem Objekt mit einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm | |
EP3543059B1 (fr) | Procédé de calcul d'une surimpression des informations supplémentaires pour un affichage sur une unité d'affichage, dispositif de mise en oeuvre du procédé, ainsi que véhicule automobile et programme informatique | |
DE102017212367B4 (de) | Vorrichtung zur Anzeige des Verlaufs einer Trajektorie vor einem Fahrzeug oder einem Objekt mit einer Anzeigeeinheit sowie Kraftfahrzeug | |
EP2720929B1 (fr) | Procédé et dispositif pour assister un conducteur lors d'un guidage d'un véhicule sur une bande de circulation | |
EP3425442B1 (fr) | Procédé d'enrichissement d'un champ de vision d'un conducteur d'un véhicule avec des informations additionnelles, dispositif d'utilisation dans un véhicule observateur, ainsi que véhicule automobile | |
DE102018203121B4 (de) | Verfahren zur Berechnung einer AR-Einblendung von Zusatzinformationen für eine Anzeige auf einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm | |
EP3762684A1 (fr) | Incrustation d'informations additionnelles sur une unité d'affichage | |
EP2172801B1 (fr) | Procédé d'affichage d'une représentation d'alerte visuelle | |
DE102013200862B4 (de) | Optimaler Blickort an Anzeige für gesamte Frontscheibe | |
EP3717954B1 (fr) | Procédé d'affichage du déroulement d'une trajectoire devant un véhicule ou un objet pourvu d'une unité d'affichage, dispositif de mise en oeuvre du procédé | |
DE102011083770A1 (de) | Verfahren zur rechnergestützten Verarbeitung des Nahfeldes eines Fahrzeugs | |
EP3931034A1 (fr) | Procédé pour faire fonctionner un système d'information du conducteur dans un égo-véhicule et système d'information du conducteur | |
DE112017007631B4 (de) | Anzeigesystem und Anzeigeverfahren | |
EP3803275A1 (fr) | Procédé de calcul d'une incrustation à réalité augmentée pour la représentation d'un itinéraire de navigation sur une unité d'affichage à réalité augmentée, dispositif servant à mettre en oeuvre le procédé, ainsi que véhicule à moteur et programme informatique | |
EP3260329A1 (fr) | Système de remplacement de rétroviseur pour véhicule | |
DE102011121763A1 (de) | Verfahren zur Darstellung einer Abstandsinformation auf einer Anzeigevorrichtung eines Fahrzeugs | |
DE112021004492T5 (de) | Fahrzeuganzeigevorrichtung | |
DE102017003399A1 (de) | Technik zur Ausgabe von Fahrzeugmeldungen | |
DE102015210780A1 (de) | Verfahren und Steuereinheit zur Kommunikation zwischen einem autonomen Fahrzeug und einem Insassen | |
EP3922501A1 (fr) | Commande d'un affichage d'un dispositif d'affichage tête haute de réalité augmentée pour un moyen de déplacement | |
EP4073470A1 (fr) | Procédé et dispositif de représentation d'éléments de navigation virtuels | |
DE102018116067A1 (de) | Verfahren zur Unterstützung eines Fahrzeugführers sowie Assistenzeinrichtung, Fahrzeug, Computerprogramm und System hierzu | |
EP3931030B1 (fr) | Procédé pour faire fonctionner un système d'information du conducteur dans un égo-véhicule et système d'information du conducteur | |
EP3931025B1 (fr) | Procédé pour faire fonctionner un système d'information du conducteur dans un égo-véhicule et système d'information du conducteur | |
DE102020106851A1 (de) | Vorrichtung und Verfahren zur Unterstützung eines Fahrers eines Fahrzeugs bei einem Abbiege-Manöver |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20200629 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20230510 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: B60W 50/14 20200101ALI20230926BHEP Ipc: G08G 1/16 20060101AFI20230926BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20231109 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |