EP3794500A1 - Verfahren und vorrichtung zum betreiben eines kamera-monitor-systems für ein kraftfahrzeug - Google Patents
Verfahren und vorrichtung zum betreiben eines kamera-monitor-systems für ein kraftfahrzeugInfo
- Publication number
- EP3794500A1 EP3794500A1 EP19722607.9A EP19722607A EP3794500A1 EP 3794500 A1 EP3794500 A1 EP 3794500A1 EP 19722607 A EP19722607 A EP 19722607A EP 3794500 A1 EP3794500 A1 EP 3794500A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- camera
- motor vehicle
- monitor
- changing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000004891 communication Methods 0.000 claims description 9
- 230000008859 change Effects 0.000 claims description 6
- 238000009877 rendering Methods 0.000 claims description 2
- 238000012986 modification Methods 0.000 claims 1
- 230000004048 modification Effects 0.000 claims 1
- 230000000694 effects Effects 0.000 description 3
- 102100034112 Alkyldihydroxyacetonephosphate synthase, peroxisomal Human genes 0.000 description 2
- 101000799143 Homo sapiens Alkyldihydroxyacetonephosphate synthase, peroxisomal Proteins 0.000 description 2
- 238000000848 angular dependent Auger electron spectroscopy Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 206010016256 fatigue Diseases 0.000 description 2
- 230000001154 acute effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003867 tiredness Effects 0.000 description 1
- 208000016255 tiredness Diseases 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000004804 winding Methods 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/22—Display screens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
- B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
- B60R1/26—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/30—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles providing vision in the non-visible spectrum, e.g. night or infrared vision
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
- B60R11/0229—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof for displays, e.g. cathodic tubes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
- H04W4/46—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for vehicle-to-vehicle communication [V2V]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/176—Camera images
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/20—Optical features of instruments
- B60K2360/21—Optical features of instruments using cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
- B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
- B60R2300/202—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used displaying a blind spot scene on the vehicle part responsible for the blind spot
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
- B60R2300/301—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
- B60R2300/304—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images
- B60R2300/305—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images merging camera image with lines or icons
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
- B60R2300/306—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using a re-scaling of images
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
- B60R2300/307—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing virtually distinguishing relevant parts of a scene from the background of the scene
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/50—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the display information being shared, e.g. external display, data transfer to other traffic participants or centralised traffic controller
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/8093—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for obstacle warning
Definitions
- a method for operating a camera monitor system for a motor vehicle is disclosed. There is further provided a device which is adapted to carry out the method.
- Motor vehicles may include a camera and a monitor that displays images of the camera to a user of the motor vehicle.
- a camera and a monitor that displays images of the camera to a user of the motor vehicle.
- mirror replacement systems are known in which the viewing areas of conventional exterior mirrors are imaged by means of the camera and the monitor.
- the invention is characterized by a method for operating a camera monitor system for a motor vehicle and by a corresponding device that is designed to carry out the method.
- the camera-monitor system has a camera.
- the camera is in particular configured to record and provide an image of an environment of the motor vehicle.
- the camera monitor system has a monitor for displaying images of the camera.
- An image of the camera is provided.
- An attention-relevant object is determined in the environment.
- At least one representation property of the image is shown in Ab- changed from the determined object, so that a modified image is provided.
- the at least one presentation property is temporarily changed.
- the changed image is displayed on the monitor.
- the camera-monitor system By means of the camera-monitor system, it is possible to represent the environment of the motor vehicle on the monitor of the camera-monitor system at least partially for a driver of the motor vehicle.
- On conventional exterior mirrors can be omitted.
- the camera is assigned to a longitudinal side of the motor vehicle and is set up to image at least the part of the environment which can be viewed conventionally by means of a conventional exterior mirror.
- the attention-relevant object is in particular an object to which the attention of the user of the motor vehicle is to be directed and directed.
- the attention-relevant object is a pedestrian, a use vehicle with blue light, an overtaking vehicle or another particular moving object, which is located in the A flow region of the motor vehicle.
- the user's attention is directed to the monitor. For example, the brightness of the image is increased.
- the presentation property is not changed for a longer period or permanently, but only temporarily.
- the picture is displayed again with the unchanged presentation properties. This avoids that the user is disturbed. For example, it is avoidable so that the user is blinded by the monitor for a long time during a night drive. For example, for after-rides on a highway, for example, hardly anything is displayed on the monitor unless a light, such as another vehicle with a front-end, is approaching. Headlights.
- the brightness of the monitor is readjusted so that the driver is not disturbed by too much movement and image noise in the monitor. Nevertheless, a warning effect is achieved by means of the temporary change of the display characteristic, for example an increase in the brightness of the monitor.
- the user is also made aware of the object when using the mirror replacement system instead of a conventional exterior mirror.
- the object is determined by means of an object recognition method in the provided image.
- the image contents are evaluated software-based.
- An object recognition makes it possible to identify the attention-relevant object in the provided image.
- the object is determined alternatively or additionally by means of at least one further sensor of the motor vehicle.
- a radar for example, a LIDAR, additional cameras or distance sensors are used to determine the attention-relevant object in the environment.
- the object is determined alternatively or additionally by means of a vehicle-to-vehicle communication (car2car communication).
- car2car communication vehicle-to-vehicle communication
- the attentively relevant object and the motor vehicle can thus communicate directly with one another and, for example, exchange information about position, speed or planned routes with one another. This is done for example by means of a
- changing the display characteristic comprises changing a brightness.
- changing the presentation characteristic includes changing a color.
- changing the display property comprises displaying an additional graphical element. Further changes of the presentation characteristic are possible, which are suitable to draw the attention of the user to the presented image.
- a display area of the object in the image is determined on the monitor.
- the display property is kept in the viewport and changed outside the viewport.
- the attention-relevant object remains easily recognizable.
- a threshold value for the attention relevance is determined.
- a value of the attention relevance of the object is determined.
- the representation property is changed if the determined value is greater than the threshold value.
- the threshold value is determined as a function of the object.
- the threshold value is determined as a function of the object.
- Threshold determined, for example, depending on a user of the camera-monitor system.
- the threshold value is determined as a function of a determined concentration ability of the user. For example, a fatigue of the user is determined. For example, it is determined whether the user is relatively distracted, for example by using other devices of the motor vehicle as in example of the radio.
- the threshold is determined depending on whether the object is approaching fast or slow.
- a time period for changing the presentation property is determined.
- the period of time is determined as a function of the object and / or by a user of the camera monitor system.
- the presentation property is changed for the determined period.
- the changed image is displayed within the determined period.
- the image is displayed with the unchanged rendering property outside the period, especially after the period.
- FIG. 1 shows a schematic representation of a motor vehicle with a camera-monitor system according to awhosbei game
- FIG. 2 shows a schematic representation of a flow chart of a method according to an exemplary embodiment
- FIG. 3 shows a schematic representation of an image according to an exemplary embodiment
- FIG. 4 shows a schematic representation of the image of FIG. 3 with changed presentation properties
- FIG. 6 shows a schematic illustration of the image of FIG. 5 with altered presentation properties
- Figure 7 is a schematic representation of an image according to an embodiment
- FIG. 8 shows a schematic representation of the image of FIG. 7 with altered presentation properties.
- FIG. 1 shows a schematic representation of a motor vehicle 101 according to an exemplary embodiment from above.
- the motor vehicle 101 is, for example, a truck. According to further embodiments, the motor vehicle is a bus and / or a passenger car.
- the motor vehicle 101 has a camera monitor system 100 as a mirror replacement system.
- the camera monitor system 100 has a camera 102 on each longitudinal side 106.
- the cameras 102 each serve to receive part of an environment 105 of the motor vehicle 101.
- several cameras 106 are provided on each side, for example two cameras or more.
- the camera 102 is provided only on one side 106 of the motor vehicle 101.
- the camera 102 is assigned in particular to a longitudinal side of the motor vehicle 101.
- the camera 102 serves, in particular, to record a part of the environment 105 which lies within the field of vision of conventional exterior mirrors.
- the camera monitor system 100 has two monitors 104.
- a section of the associated environment 105 is provided on the associated page 106 on the monitor 104, respectively.
- the image of the associated camera 102 is displayed on the monitor 104.
- the displayed images 400 on the monitors 104 are different from each other.
- a device 110 is provided, with which the cameras 102 and the monitors 104 are signal-technically coupled.
- the device 110 is configured to control both the cameras 102 and the monitors 104.
- the device 110 is a control device or part of a control device of the motor vehicle 101.
- the device 110 is set up for image processing.
- FIG. 2 shows a flowchart of a method according to one exemplary embodiment.
- recognition of an object 103 (FIG. 1) in the environment 105 of the motor vehicle 101 is first of all carried out. It is determined whether the object 103 is an attention-relevant object.
- An attention-relevant object is, for example, an object from which a potential danger to the user of the motor vehicle 101 originates and / or for which the motor vehicle 101 represents a potential danger.
- An attention-relevant object is in particular special a person, an approaching motor vehicle such as a motorcycle or for example another approaching object.
- a sensor system 107 of the motor vehicle is used. For example, information about a CAN and / or ADAS unit or similar information sources is used. Brightness sensors, speed and other data can also be taken into account.
- another camera 108 is used to determine the object 103.
- the camera 102 of the camera monitor system is used to determine the object 103.
- 108 is an infrared camera.
- a further control unit 109 of the motor vehicle 101 is used to detect the object 103.
- information is received by means of a communication interface 111 from external information sources and taken into account in the determination of the object 103. For example, information about a car2car or a car2x interface is received.
- step 302 it is determined whether the user should be made particularly aware of the object 103 or not. If not, the process continues in step 301.
- step 302 If it is determined in step 302 that the attentively keitsrelevante object 103 requires a special notice, in step 303, a display property of an image 201 ( Figures 3, 5 and 7) of the camera 102 and the Dar position on the monitor 104 is changed. For example, the brightness of the monitor is increased. Alternatively or additionally, the representation is colored on the monitor in a predetermined color.
- step 304 The image is displayed in step 304 for a predetermined time period on the monitor 104 with the changed presentation properties. Subsequently, in step 305, the presentation performance property is reset and the image 201 un changed displayed on the monitor 104.
- the decision in step 302 is made, for example, as a function of visibility 112 of the motor vehicle 101. For example, at night and / or fog and / or a winding road visibility 112 may be reduced.
- the decision 302 is made as a function of a history 113.
- the history 113 includes information as to when and how often in the past, in step 303, the presentation properties were changed.
- the decision is made in step 302 in response to attention recognition 114.
- the attention recognition includes, for example, fatigue detection of the driver.
- it is determined whether the driver is otherwise distracted, for example by using other devices of the motor vehicle 101.
- the decision in step 302 is alternatively or additionally made depending on a criticality 115. Thus, for example, it is taken into account how acute a driving situation is by the object 103.
- an approaching vehicle is detected as object 103.
- This is done for example by an automatic detection system, for example by means of at least one of the elements 107, 108, 109, 111.
- an abrupt brightness control of the camera automatic system is a way to detect an approaching vehicle with headlights.
- the brightness of the monitor 104 is increased for a short time of, for example, 0.1 second to 5 seconds. Another period is possible, for example, the period is set by a user adjustable or predetermined depending on the determined object 103.
- the brightness of the monitor 104 is achieved by raising the backlight.
- the brightness of the display on the monitor is generally increased, for example, by increasing the light transmittance of the liquid crystals in the monitor or the like in other monitor technologies.
- the change of the display on the monitor 104 excites the attention of the driver. As a result, a risk from the object 103 is avoided.
- the driver does not continue to blind himself, for example, from the headlight of the approaching vehicle due to the rapidly following reduction of the brightness of the driver.
- the brightness of the monitor 104 can be greatly reduced without danger to cause no distraction in normal danger situations. Once an attention-relevant object 103 is determined, the driver is intuitively made aware of this.
- Another example of an attention-relevant object 103 is, in addition to the approaching vehicle, an approaching person.
- the display on the monitor 104 for the given period of time in one color.
- color choice for example red
- information is communicated to the driver by means of the color selection.
- a pre-given color is used, for example, to indicate a low, medium and high risk.
- by means of the color selection it is possible to represent a low, medium and high speed of the approaching vehicle. It is possible to color a frame around the entire display. Alternatively or additionally, it is possible to color a frame around the field of view. It is also possible to colorize a frame around the object 103 in the illustration on the monitor 104.
- Ge drive for example, an approaching vehicle, a pedestrian, overtaking color-coded represent.
- an approaching blue light vehicle for example, a frame can be coded in blue.
- a different color is used as blue, so that the actual blue light also provides well Darge and is recognized.
- a gradation of the brightness increase is used according to exemplary embodiments for the stated applications, for example stepwise, low, medium high, or by a continuous change in the brightness. If a monitor 104 is used which can display high brightness, it is possible to use the method without restrictions during the day.
- the information on the dangerous situations is provided by the camera monitor system 100 according to the exemplary embodiment by system-internal sources.
- the information is provided by external warning systems.
- This concerns for example, in-vehicle information, which is provided, for example, by means of CAN or an ADAS unit or similar information sources, for example by means of the sensor 107, the camera 108 and / or the control unit 109.
- external information is taken into account which, for example, via a car2car communication or a car2x communication to the motor vehicle 101 are transmitted.
- threshold values can be defined as of when the system should warn the driver. These are taken into account in particular in step 302.
- the threshold value is specified, for example, by the driver. Alternatively or additionally, the threshold value can be configured ex works.
- setting the threshold value involves the attention of the driver. If the driver is distracted, for example by prolonged operation of the navigation system or the radio, the threshold value is set lower, for example. Thus, the driver becomes warned earlier.
- the attention is estimated by means of a tiredness recognition implemented in the camera monitor system 100 itself or provided by external control devices, in particular by the attention recognition 114.
- the threshold value is determined as a function of the criticality 115.
- object recognition and other control devices and / or by the car2car communication are for example detailed information about the object 103 before.
- a critical situation is determined depending on the information about the object 103, in particular a BEWE movement vector and a derived trajectory, a vehicle type, a lighting condition and other properties, depending on the own trajectory and lane and other information about the motor vehicle 101.
- the threshold value is set correspondingly high in order to suppress a warning if necessary, or to warn it accordingly if there is a potential danger.
- the threshold value is set as a function of a speed of an approaching object 103. For example, a high-speed vehicle is approaching from behind, and the driver of the motor vehicle 101 is warned by changing the appearance of the image on the monitor 104.
- the threshold value is set as a function of visibility of the object 103.
- the object 103 is hidden behind a long curve.
- the transmitted via the car2car communication position is taken into account and combined by means of example detailed map data, so that there is information about the elongated curve.
- the object 103 is detected in the image 201 of the camera 102 of the camera-monitor system 100 by means of object recognition.
- the further control device 109 it is determined by means of the further control device 109, whether the object 103 for the driver of the motor vehicle 101 should already be visible. For example, this is done by means of radar sensors LIDAR.
- the history of how and when the presentation property should be changed and thereby warned is included. For example, when the motor vehicle 101 is moved on a highway, it is possible that no other car, and thus no object 103, will approach for a longer time. Thus, the
- Threshold set comparatively low to give a warning early.
- the driver's concentration is lower than in the case of heavy traffic. For example, if another vehicle relatively promptly follows the previous warning, the next warning could accordingly be less intense or even fail.
- FIG. 3 shows the image 201 of the camera 102 with unchanged display properties according to an exemplary embodiment.
- FIG. 4 shows a modified image 202 according to an exemplary embodiment.
- the modified image 202 is displayed on the monitor 104 in order to alert the driver to the attention-relevant object 103 or to warn.
- FIG. 3 shows the conventional representation of the image 201, in which the camera monitor system 100 selects the presentation properties so as to be able to display as many details of the surroundings 104 as possible.
- the brightness in the area of the headlights of the approaching motor vehicle 103 is reduced.
- the brightness of the monitor 104 is increased.
- the modified image 202 with the changed display properties simulates, for a short time, an aperture that could occur with a conventional side mirror.
- Figure 5 shows the image 201 according to another embodiment example.
- the attention-relevant object 103 is a pedestrian in the area of the motor vehicle 100.
- the display properties are changed such that the modified image 202 shown in the monitor 104 is colored in color.
- a yellow veil is provided in order to point the user of the motor vehicle 101 to the person 103 in the area of the motor vehicle 101 and to warn him / her against this.
- Figure 7 shows the image 201 according to another embodiment example.
- the attention-relevant object 103 is a motorcycle approaching from behind.
- the presentation properties are changed and the modified image 202 is displayed, as shown by way of example in FIG.
- a graphical element 203 is displayed.
- the graphical element 203 is in the embodiment shown, a frame, in particular in a pre-given color, which is displayed on the monitor 104.
- the frame 203 is shown on the outer periphery of the monitor 104.
- the frame is provided in the area of the security-relevant object 103.
- a presentation area 204 is determined in which the security-relevant object 103 is displayed on the monitor 104.
- the image 202 is changed only outside the display area 204 to warn the user of the motor vehicle 101.
- the unchanged image 201 is displayed.
- attention-relevant object 103 shown as detailed as possible. It is avoided that important information is not displayed on the monitor 104 due to the change of the display characteristic, for example, an emergency vehicle's flashing light.
- the different described examples for the change of the presentation properties can be combined arbitrarily.
- the representation outside the display area 204 is colored in color, as explained in connection with FIG.
- the described method as well as the described camera monitor system 100 make it possible to inform the driver of the motor vehicle 101 about dangers without the driver having to look directly at one of the monitors 104. With the help of color or brightness coding, different types of dangerous situations are also communicated. In addition, the dazzling effect of approaching vehicle headlights is avoided ver. The safety for the driver and other persons is thereby increased. It is also possible to inform the driver about movements outside the vehicle 101 in the state, for example, as a theft warning system. Alternatively or additionally, it is possible to warn the driver before getting out of an approaching vehicle. This is triggered for example by a handle to the doorknob.
- the environment 105 is detailed and easily recognizable in the monitor 104. Especially at night, it is possible the display brightness sufficiently reduce. Nevertheless, a warning effect is realized by temporarily changing the display on the monitor 104.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Multimedia (AREA)
- Transportation (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Automation & Control Theory (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Traffic Control Systems (AREA)
- Closed-Circuit Television Systems (AREA)
- Instrument Panels (AREA)
- Image Analysis (AREA)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102018207762 | 2018-05-17 | ||
DE102018209192.7A DE102018209192B3 (de) | 2018-05-17 | 2018-06-08 | Verfahren und Vorrichtung zum Betreiben eines Kamera-Monitor-Systems für ein Kraftfahrzeug |
PCT/EP2019/061624 WO2019219440A1 (de) | 2018-05-17 | 2019-05-07 | Verfahren und vorrichtung zum betreiben eines kamera-monitor-systems für ein kraftfahrzeug |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3794500A1 true EP3794500A1 (de) | 2021-03-24 |
Family
ID=66179169
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19722607.9A Withdrawn EP3794500A1 (de) | 2018-05-17 | 2019-05-07 | Verfahren und vorrichtung zum betreiben eines kamera-monitor-systems für ein kraftfahrzeug |
Country Status (9)
Country | Link |
---|---|
US (1) | US11766971B2 (zh) |
EP (1) | EP3794500A1 (zh) |
JP (1) | JP2021524105A (zh) |
KR (1) | KR102468922B1 (zh) |
CN (1) | CN112119398B (zh) |
CA (1) | CA3097948A1 (zh) |
DE (1) | DE102018209192B3 (zh) |
MX (1) | MX2020012215A (zh) |
WO (1) | WO2019219440A1 (zh) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102018209192B3 (de) * | 2018-05-17 | 2019-05-09 | Continental Automotive Gmbh | Verfahren und Vorrichtung zum Betreiben eines Kamera-Monitor-Systems für ein Kraftfahrzeug |
EP4149809B1 (en) * | 2020-05-12 | 2023-10-11 | C.R.F. Società Consortile per Azioni | Motor-vehicle driving assistance in low meteorological visibility conditions, in particular with fog |
IT202100020852A1 (it) * | 2021-08-03 | 2023-02-03 | X Ender S R L | Metodo di integrazione alla vista per un utente |
DE102022105187B4 (de) | 2022-03-04 | 2024-06-20 | Audi Aktiengesellschaft | Verfahren zum Darstellen einer Umgebung eines Fahrzeugs und Anzeigesystem |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4696339B2 (ja) * | 2000-07-11 | 2011-06-08 | マツダ株式会社 | 車両の制御装置 |
DE102005020772A1 (de) * | 2005-05-02 | 2006-11-09 | Siemens Ag | Anzeigesystem zur Darstellung der Umgebung eines Kraftfahrzeuges |
DE102006012773A1 (de) | 2006-03-17 | 2006-11-30 | Daimlerchrysler Ag | Virtuelles Spotlight zur Kennzeichnung von interessierenden Objekten in Bilddaten |
JP4940767B2 (ja) * | 2006-06-05 | 2012-05-30 | マツダ株式会社 | 車両周辺情報報知装置 |
DE102008017833A1 (de) | 2008-02-06 | 2009-08-20 | Daimler Ag | Verfahren zum Betrieb einer Bildaufnahmevorrichtung und eine Bildaufnahmevorrichtung |
JP2009205268A (ja) * | 2008-02-26 | 2009-09-10 | Honda Motor Co Ltd | 障害物表示装置 |
WO2016014966A2 (en) * | 2014-07-24 | 2016-01-28 | Brubaker Curtis M | Systems, methods, and devices for generating critical mass in a mobile advertising, media, and communications platform |
JP2011180873A (ja) * | 2010-03-02 | 2011-09-15 | Panasonic Corp | 運転支援装置、及び運転支援方法 |
DE102012002149B3 (de) * | 2012-02-04 | 2013-06-20 | Audi Ag | Verfahren zur Visualisierung des Umfelds eines Kraftfahrzeugs und zugehöriges Kraftfahrzeug |
DE102012006679A1 (de) * | 2012-03-31 | 2012-09-20 | Daimler Ag | Verfahren zum Erfassen und Darstellen einer Fahrzeugumgebung eines Fahrzeugs |
US20150232026A1 (en) * | 2012-10-01 | 2015-08-20 | Conti Temic Microelectronic Gmbh | Method for Assisting a Driver at a Traffic Light for a Vehicle |
US9576208B2 (en) * | 2013-12-11 | 2017-02-21 | Continental Automotive Systems, Inc. | Emergency vehicle detection with digital image sensor |
CN108800037B (zh) * | 2014-03-03 | 2021-02-09 | 株式会社小糸制作所 | 车辆用灯具及车辆用灯具的控制*** |
US20160063761A1 (en) * | 2014-08-27 | 2016-03-03 | Toyota Jidosha Kabushiki Kaisha | Communication of spatial information based on driver attention assessment |
DE102015011536A1 (de) | 2015-09-02 | 2017-03-02 | Man Truck & Bus Ag | Spiegelersatzsystem als Kamera-Monitor-System (KMS) eines Kraftfahrzeugs, insbesondere eines Nutzfahrzeugs |
FR3068945B1 (fr) * | 2017-07-11 | 2019-08-30 | Institut Francais Des Sciences Et Technologies Des Transports, De L'amenagement Et Des Reseaux | Vehicule routier et methode de reengagement de la conduite manuelle |
DE102017220394A1 (de) | 2017-11-15 | 2019-05-16 | Continental Automotive Gmbh | Verfahren und Vorrichtung zum Betreiben eines Fahrerassistenzsystems für ein Kraftfahrzeug und Kraftfahrzeug |
US11347218B2 (en) * | 2017-11-21 | 2022-05-31 | Shawn Wang | Portable universal autonomous driving system |
DE102018209192B3 (de) * | 2018-05-17 | 2019-05-09 | Continental Automotive Gmbh | Verfahren und Vorrichtung zum Betreiben eines Kamera-Monitor-Systems für ein Kraftfahrzeug |
CN114942453A (zh) * | 2019-03-08 | 2022-08-26 | 欧司朗股份有限公司 | Lidar传感器***、用于该***的光学部件、传感器和方法 |
-
2018
- 2018-06-08 DE DE102018209192.7A patent/DE102018209192B3/de active Active
-
2019
- 2019-05-07 KR KR1020207032890A patent/KR102468922B1/ko active IP Right Grant
- 2019-05-07 JP JP2020564369A patent/JP2021524105A/ja active Pending
- 2019-05-07 CA CA3097948A patent/CA3097948A1/en active Pending
- 2019-05-07 MX MX2020012215A patent/MX2020012215A/es unknown
- 2019-05-07 EP EP19722607.9A patent/EP3794500A1/de not_active Withdrawn
- 2019-05-07 WO PCT/EP2019/061624 patent/WO2019219440A1/de active Application Filing
- 2019-05-07 CN CN201980032744.2A patent/CN112119398B/zh active Active
-
2020
- 2020-11-16 US US17/098,661 patent/US11766971B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US11766971B2 (en) | 2023-09-26 |
CN112119398B (zh) | 2024-06-04 |
JP2021524105A (ja) | 2021-09-09 |
US20210061184A1 (en) | 2021-03-04 |
CN112119398A (zh) | 2020-12-22 |
KR102468922B1 (ko) | 2022-11-21 |
KR20200142571A (ko) | 2020-12-22 |
WO2019219440A1 (de) | 2019-11-21 |
DE102018209192B3 (de) | 2019-05-09 |
CA3097948A1 (en) | 2019-11-21 |
MX2020012215A (es) | 2021-01-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3401166B1 (de) | Spiegelersatzsystem als kamera-monitor-system (kms) eines kraftfahrzeugs, insbesondere eines nutzfahrzeugs | |
EP2172801B1 (de) | Verfahren für eine Anzeige einer visuellen Warndarstellung | |
EP3794500A1 (de) | Verfahren und vorrichtung zum betreiben eines kamera-monitor-systems für ein kraftfahrzeug | |
EP2617022B1 (de) | Visuelles fahrerinformations- und warnsystem für einen fahrer eines kraftfahrzeugs | |
DE102017221191B4 (de) | Verfahren zur Anzeige des Verlaufs einer Sicherheitszone vor einem Fahrzeug oder einem Objekt mit einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm | |
DE102013012891B4 (de) | Verfahren zum Projizieren eines graphisch darstellbaren Anzeigeinhaltes durch ein Kraftfahrzeug in eine Umgebung des Kraftfahrzeugs | |
DE10131720B4 (de) | Head-Up Display System und Verfahren | |
EP2427855B1 (de) | Verfahren zur darstellung von objekten aus der umgebung eines fahrzeugs auf der anzeige einer anzeigevorrichtung | |
EP3717954B1 (de) | Verfahren zur anzeige des verlaufs einer trajektorie vor einem fahrzeug oder einem objekt mit einer anzeigeeinheit, vorrichtung zur durchführung des verfahrens | |
DE102019208663B4 (de) | Verfahren zur Unterstützung eines Fahrers hinsichtlich für eine Verkehrssituation relevanter Objekte und Kraftfahrzeug | |
DE102011083770A1 (de) | Verfahren zur rechnergestützten Verarbeitung des Nahfeldes eines Fahrzeugs | |
DE102005054972A1 (de) | Verfahren zur Totwinkelüberwachung bei Fahrzeugen | |
DE102009027755A1 (de) | Verfahren zum Unterstützen eines Fahrbetriebs eines Kraftfahrzeugs sowie Fahrerassistenzvorrichtung | |
DE102020127764A1 (de) | Fahrzeuganzeigenverbesserung | |
DE112017007217T5 (de) | Fahrmodusumschaltsteuereinrichtung, System, Verfahren und Programm | |
DE102018108433A1 (de) | Bildanzeigevorrichtung | |
DE102017223439B4 (de) | Warnvorrichtung vor Gefahrensituationen für ein Kraftfahrzeug | |
DE102012018556B4 (de) | Assistenzsystem zur Ermöglichung einer erweiterten Vorausschau für nachfolgende Verkehrsteilnehmer | |
EP3583488B1 (de) | Automatisierte aktivierung eines sichtunterstützungssystems | |
DE102012012783A1 (de) | Kamera-Monitor-System zur Überwachung des toten Winkels oder der Umgebung für Kraftfahrzeuge | |
DE102020121655A1 (de) | System und Verfahren zur Lenkung der Aufmerksamkeit eines Fahrzeuginsassen beim automatisierten Fahren | |
DE102018127471A1 (de) | Verfahren und System zum Warnen eines Fahrers eines Fahrzeugs | |
DE102022105187B4 (de) | Verfahren zum Darstellen einer Umgebung eines Fahrzeugs und Anzeigesystem | |
EP2468571B1 (de) | Innenrückspiegel mit Bildanzeige bei Spurwechsel | |
DE102022113245A1 (de) | Verfahren zum Betreiben einer Anzeigevorrichtung eines Kraftfahrzeugs, Steuereinrichtung, und Kraftfahrzeug |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20201217 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: CONTINENTAL AUTOMOTIVE TECHNOLOGIES GMBH |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20230330 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |
|
18W | Application withdrawn |
Effective date: 20230621 |