EP3794500A1 - Verfahren und vorrichtung zum betreiben eines kamera-monitor-systems für ein kraftfahrzeug - Google Patents

Verfahren und vorrichtung zum betreiben eines kamera-monitor-systems für ein kraftfahrzeug

Info

Publication number
EP3794500A1
EP3794500A1 EP19722607.9A EP19722607A EP3794500A1 EP 3794500 A1 EP3794500 A1 EP 3794500A1 EP 19722607 A EP19722607 A EP 19722607A EP 3794500 A1 EP3794500 A1 EP 3794500A1
Authority
EP
European Patent Office
Prior art keywords
image
camera
motor vehicle
monitor
changing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP19722607.9A
Other languages
German (de)
English (en)
French (fr)
Inventor
Andreas Weinlich
Thomas Smits
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Continental Automotive Technologies GmbH
Original Assignee
Continental Automotive GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Continental Automotive GmbH filed Critical Continental Automotive GmbH
Publication of EP3794500A1 publication Critical patent/EP3794500A1/de
Withdrawn legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22Display screens
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/26Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/30Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles providing vision in the non-visible spectrum, e.g. night or infrared vision
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
    • B60R11/0229Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof for displays, e.g. cathodic tubes
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/04Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/166Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/167Driving aids for lane monitoring, lane changing, e.g. blind spot detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/40Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
    • H04W4/46Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for vehicle-to-vehicle communication [V2V]
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16Type of output information
    • B60K2360/176Camera images
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20Optical features of instruments
    • B60K2360/21Optical features of instruments using cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/105Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/202Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used displaying a blind spot scene on the vehicle part responsible for the blind spot
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/301Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/304Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images
    • B60R2300/305Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images merging camera image with lines or icons
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/306Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using a re-scaling of images
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/307Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing virtually distinguishing relevant parts of a scene from the background of the scene
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/50Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the display information being shared, e.g. external display, data transfer to other traffic participants or centralised traffic controller
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8093Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for obstacle warning

Definitions

  • a method for operating a camera monitor system for a motor vehicle is disclosed. There is further provided a device which is adapted to carry out the method.
  • Motor vehicles may include a camera and a monitor that displays images of the camera to a user of the motor vehicle.
  • a camera and a monitor that displays images of the camera to a user of the motor vehicle.
  • mirror replacement systems are known in which the viewing areas of conventional exterior mirrors are imaged by means of the camera and the monitor.
  • the invention is characterized by a method for operating a camera monitor system for a motor vehicle and by a corresponding device that is designed to carry out the method.
  • the camera-monitor system has a camera.
  • the camera is in particular configured to record and provide an image of an environment of the motor vehicle.
  • the camera monitor system has a monitor for displaying images of the camera.
  • An image of the camera is provided.
  • An attention-relevant object is determined in the environment.
  • At least one representation property of the image is shown in Ab- changed from the determined object, so that a modified image is provided.
  • the at least one presentation property is temporarily changed.
  • the changed image is displayed on the monitor.
  • the camera-monitor system By means of the camera-monitor system, it is possible to represent the environment of the motor vehicle on the monitor of the camera-monitor system at least partially for a driver of the motor vehicle.
  • On conventional exterior mirrors can be omitted.
  • the camera is assigned to a longitudinal side of the motor vehicle and is set up to image at least the part of the environment which can be viewed conventionally by means of a conventional exterior mirror.
  • the attention-relevant object is in particular an object to which the attention of the user of the motor vehicle is to be directed and directed.
  • the attention-relevant object is a pedestrian, a use vehicle with blue light, an overtaking vehicle or another particular moving object, which is located in the A flow region of the motor vehicle.
  • the user's attention is directed to the monitor. For example, the brightness of the image is increased.
  • the presentation property is not changed for a longer period or permanently, but only temporarily.
  • the picture is displayed again with the unchanged presentation properties. This avoids that the user is disturbed. For example, it is avoidable so that the user is blinded by the monitor for a long time during a night drive. For example, for after-rides on a highway, for example, hardly anything is displayed on the monitor unless a light, such as another vehicle with a front-end, is approaching. Headlights.
  • the brightness of the monitor is readjusted so that the driver is not disturbed by too much movement and image noise in the monitor. Nevertheless, a warning effect is achieved by means of the temporary change of the display characteristic, for example an increase in the brightness of the monitor.
  • the user is also made aware of the object when using the mirror replacement system instead of a conventional exterior mirror.
  • the object is determined by means of an object recognition method in the provided image.
  • the image contents are evaluated software-based.
  • An object recognition makes it possible to identify the attention-relevant object in the provided image.
  • the object is determined alternatively or additionally by means of at least one further sensor of the motor vehicle.
  • a radar for example, a LIDAR, additional cameras or distance sensors are used to determine the attention-relevant object in the environment.
  • the object is determined alternatively or additionally by means of a vehicle-to-vehicle communication (car2car communication).
  • car2car communication vehicle-to-vehicle communication
  • the attentively relevant object and the motor vehicle can thus communicate directly with one another and, for example, exchange information about position, speed or planned routes with one another. This is done for example by means of a
  • changing the display characteristic comprises changing a brightness.
  • changing the presentation characteristic includes changing a color.
  • changing the display property comprises displaying an additional graphical element. Further changes of the presentation characteristic are possible, which are suitable to draw the attention of the user to the presented image.
  • a display area of the object in the image is determined on the monitor.
  • the display property is kept in the viewport and changed outside the viewport.
  • the attention-relevant object remains easily recognizable.
  • a threshold value for the attention relevance is determined.
  • a value of the attention relevance of the object is determined.
  • the representation property is changed if the determined value is greater than the threshold value.
  • the threshold value is determined as a function of the object.
  • the threshold value is determined as a function of the object.
  • Threshold determined, for example, depending on a user of the camera-monitor system.
  • the threshold value is determined as a function of a determined concentration ability of the user. For example, a fatigue of the user is determined. For example, it is determined whether the user is relatively distracted, for example by using other devices of the motor vehicle as in example of the radio.
  • the threshold is determined depending on whether the object is approaching fast or slow.
  • a time period for changing the presentation property is determined.
  • the period of time is determined as a function of the object and / or by a user of the camera monitor system.
  • the presentation property is changed for the determined period.
  • the changed image is displayed within the determined period.
  • the image is displayed with the unchanged rendering property outside the period, especially after the period.
  • FIG. 1 shows a schematic representation of a motor vehicle with a camera-monitor system according to awhosbei game
  • FIG. 2 shows a schematic representation of a flow chart of a method according to an exemplary embodiment
  • FIG. 3 shows a schematic representation of an image according to an exemplary embodiment
  • FIG. 4 shows a schematic representation of the image of FIG. 3 with changed presentation properties
  • FIG. 6 shows a schematic illustration of the image of FIG. 5 with altered presentation properties
  • Figure 7 is a schematic representation of an image according to an embodiment
  • FIG. 8 shows a schematic representation of the image of FIG. 7 with altered presentation properties.
  • FIG. 1 shows a schematic representation of a motor vehicle 101 according to an exemplary embodiment from above.
  • the motor vehicle 101 is, for example, a truck. According to further embodiments, the motor vehicle is a bus and / or a passenger car.
  • the motor vehicle 101 has a camera monitor system 100 as a mirror replacement system.
  • the camera monitor system 100 has a camera 102 on each longitudinal side 106.
  • the cameras 102 each serve to receive part of an environment 105 of the motor vehicle 101.
  • several cameras 106 are provided on each side, for example two cameras or more.
  • the camera 102 is provided only on one side 106 of the motor vehicle 101.
  • the camera 102 is assigned in particular to a longitudinal side of the motor vehicle 101.
  • the camera 102 serves, in particular, to record a part of the environment 105 which lies within the field of vision of conventional exterior mirrors.
  • the camera monitor system 100 has two monitors 104.
  • a section of the associated environment 105 is provided on the associated page 106 on the monitor 104, respectively.
  • the image of the associated camera 102 is displayed on the monitor 104.
  • the displayed images 400 on the monitors 104 are different from each other.
  • a device 110 is provided, with which the cameras 102 and the monitors 104 are signal-technically coupled.
  • the device 110 is configured to control both the cameras 102 and the monitors 104.
  • the device 110 is a control device or part of a control device of the motor vehicle 101.
  • the device 110 is set up for image processing.
  • FIG. 2 shows a flowchart of a method according to one exemplary embodiment.
  • recognition of an object 103 (FIG. 1) in the environment 105 of the motor vehicle 101 is first of all carried out. It is determined whether the object 103 is an attention-relevant object.
  • An attention-relevant object is, for example, an object from which a potential danger to the user of the motor vehicle 101 originates and / or for which the motor vehicle 101 represents a potential danger.
  • An attention-relevant object is in particular special a person, an approaching motor vehicle such as a motorcycle or for example another approaching object.
  • a sensor system 107 of the motor vehicle is used. For example, information about a CAN and / or ADAS unit or similar information sources is used. Brightness sensors, speed and other data can also be taken into account.
  • another camera 108 is used to determine the object 103.
  • the camera 102 of the camera monitor system is used to determine the object 103.
  • 108 is an infrared camera.
  • a further control unit 109 of the motor vehicle 101 is used to detect the object 103.
  • information is received by means of a communication interface 111 from external information sources and taken into account in the determination of the object 103. For example, information about a car2car or a car2x interface is received.
  • step 302 it is determined whether the user should be made particularly aware of the object 103 or not. If not, the process continues in step 301.
  • step 302 If it is determined in step 302 that the attentively keitsrelevante object 103 requires a special notice, in step 303, a display property of an image 201 ( Figures 3, 5 and 7) of the camera 102 and the Dar position on the monitor 104 is changed. For example, the brightness of the monitor is increased. Alternatively or additionally, the representation is colored on the monitor in a predetermined color.
  • step 304 The image is displayed in step 304 for a predetermined time period on the monitor 104 with the changed presentation properties. Subsequently, in step 305, the presentation performance property is reset and the image 201 un changed displayed on the monitor 104.
  • the decision in step 302 is made, for example, as a function of visibility 112 of the motor vehicle 101. For example, at night and / or fog and / or a winding road visibility 112 may be reduced.
  • the decision 302 is made as a function of a history 113.
  • the history 113 includes information as to when and how often in the past, in step 303, the presentation properties were changed.
  • the decision is made in step 302 in response to attention recognition 114.
  • the attention recognition includes, for example, fatigue detection of the driver.
  • it is determined whether the driver is otherwise distracted, for example by using other devices of the motor vehicle 101.
  • the decision in step 302 is alternatively or additionally made depending on a criticality 115. Thus, for example, it is taken into account how acute a driving situation is by the object 103.
  • an approaching vehicle is detected as object 103.
  • This is done for example by an automatic detection system, for example by means of at least one of the elements 107, 108, 109, 111.
  • an abrupt brightness control of the camera automatic system is a way to detect an approaching vehicle with headlights.
  • the brightness of the monitor 104 is increased for a short time of, for example, 0.1 second to 5 seconds. Another period is possible, for example, the period is set by a user adjustable or predetermined depending on the determined object 103.
  • the brightness of the monitor 104 is achieved by raising the backlight.
  • the brightness of the display on the monitor is generally increased, for example, by increasing the light transmittance of the liquid crystals in the monitor or the like in other monitor technologies.
  • the change of the display on the monitor 104 excites the attention of the driver. As a result, a risk from the object 103 is avoided.
  • the driver does not continue to blind himself, for example, from the headlight of the approaching vehicle due to the rapidly following reduction of the brightness of the driver.
  • the brightness of the monitor 104 can be greatly reduced without danger to cause no distraction in normal danger situations. Once an attention-relevant object 103 is determined, the driver is intuitively made aware of this.
  • Another example of an attention-relevant object 103 is, in addition to the approaching vehicle, an approaching person.
  • the display on the monitor 104 for the given period of time in one color.
  • color choice for example red
  • information is communicated to the driver by means of the color selection.
  • a pre-given color is used, for example, to indicate a low, medium and high risk.
  • by means of the color selection it is possible to represent a low, medium and high speed of the approaching vehicle. It is possible to color a frame around the entire display. Alternatively or additionally, it is possible to color a frame around the field of view. It is also possible to colorize a frame around the object 103 in the illustration on the monitor 104.
  • Ge drive for example, an approaching vehicle, a pedestrian, overtaking color-coded represent.
  • an approaching blue light vehicle for example, a frame can be coded in blue.
  • a different color is used as blue, so that the actual blue light also provides well Darge and is recognized.
  • a gradation of the brightness increase is used according to exemplary embodiments for the stated applications, for example stepwise, low, medium high, or by a continuous change in the brightness. If a monitor 104 is used which can display high brightness, it is possible to use the method without restrictions during the day.
  • the information on the dangerous situations is provided by the camera monitor system 100 according to the exemplary embodiment by system-internal sources.
  • the information is provided by external warning systems.
  • This concerns for example, in-vehicle information, which is provided, for example, by means of CAN or an ADAS unit or similar information sources, for example by means of the sensor 107, the camera 108 and / or the control unit 109.
  • external information is taken into account which, for example, via a car2car communication or a car2x communication to the motor vehicle 101 are transmitted.
  • threshold values can be defined as of when the system should warn the driver. These are taken into account in particular in step 302.
  • the threshold value is specified, for example, by the driver. Alternatively or additionally, the threshold value can be configured ex works.
  • setting the threshold value involves the attention of the driver. If the driver is distracted, for example by prolonged operation of the navigation system or the radio, the threshold value is set lower, for example. Thus, the driver becomes warned earlier.
  • the attention is estimated by means of a tiredness recognition implemented in the camera monitor system 100 itself or provided by external control devices, in particular by the attention recognition 114.
  • the threshold value is determined as a function of the criticality 115.
  • object recognition and other control devices and / or by the car2car communication are for example detailed information about the object 103 before.
  • a critical situation is determined depending on the information about the object 103, in particular a BEWE movement vector and a derived trajectory, a vehicle type, a lighting condition and other properties, depending on the own trajectory and lane and other information about the motor vehicle 101.
  • the threshold value is set correspondingly high in order to suppress a warning if necessary, or to warn it accordingly if there is a potential danger.
  • the threshold value is set as a function of a speed of an approaching object 103. For example, a high-speed vehicle is approaching from behind, and the driver of the motor vehicle 101 is warned by changing the appearance of the image on the monitor 104.
  • the threshold value is set as a function of visibility of the object 103.
  • the object 103 is hidden behind a long curve.
  • the transmitted via the car2car communication position is taken into account and combined by means of example detailed map data, so that there is information about the elongated curve.
  • the object 103 is detected in the image 201 of the camera 102 of the camera-monitor system 100 by means of object recognition.
  • the further control device 109 it is determined by means of the further control device 109, whether the object 103 for the driver of the motor vehicle 101 should already be visible. For example, this is done by means of radar sensors LIDAR.
  • the history of how and when the presentation property should be changed and thereby warned is included. For example, when the motor vehicle 101 is moved on a highway, it is possible that no other car, and thus no object 103, will approach for a longer time. Thus, the
  • Threshold set comparatively low to give a warning early.
  • the driver's concentration is lower than in the case of heavy traffic. For example, if another vehicle relatively promptly follows the previous warning, the next warning could accordingly be less intense or even fail.
  • FIG. 3 shows the image 201 of the camera 102 with unchanged display properties according to an exemplary embodiment.
  • FIG. 4 shows a modified image 202 according to an exemplary embodiment.
  • the modified image 202 is displayed on the monitor 104 in order to alert the driver to the attention-relevant object 103 or to warn.
  • FIG. 3 shows the conventional representation of the image 201, in which the camera monitor system 100 selects the presentation properties so as to be able to display as many details of the surroundings 104 as possible.
  • the brightness in the area of the headlights of the approaching motor vehicle 103 is reduced.
  • the brightness of the monitor 104 is increased.
  • the modified image 202 with the changed display properties simulates, for a short time, an aperture that could occur with a conventional side mirror.
  • Figure 5 shows the image 201 according to another embodiment example.
  • the attention-relevant object 103 is a pedestrian in the area of the motor vehicle 100.
  • the display properties are changed such that the modified image 202 shown in the monitor 104 is colored in color.
  • a yellow veil is provided in order to point the user of the motor vehicle 101 to the person 103 in the area of the motor vehicle 101 and to warn him / her against this.
  • Figure 7 shows the image 201 according to another embodiment example.
  • the attention-relevant object 103 is a motorcycle approaching from behind.
  • the presentation properties are changed and the modified image 202 is displayed, as shown by way of example in FIG.
  • a graphical element 203 is displayed.
  • the graphical element 203 is in the embodiment shown, a frame, in particular in a pre-given color, which is displayed on the monitor 104.
  • the frame 203 is shown on the outer periphery of the monitor 104.
  • the frame is provided in the area of the security-relevant object 103.
  • a presentation area 204 is determined in which the security-relevant object 103 is displayed on the monitor 104.
  • the image 202 is changed only outside the display area 204 to warn the user of the motor vehicle 101.
  • the unchanged image 201 is displayed.
  • attention-relevant object 103 shown as detailed as possible. It is avoided that important information is not displayed on the monitor 104 due to the change of the display characteristic, for example, an emergency vehicle's flashing light.
  • the different described examples for the change of the presentation properties can be combined arbitrarily.
  • the representation outside the display area 204 is colored in color, as explained in connection with FIG.
  • the described method as well as the described camera monitor system 100 make it possible to inform the driver of the motor vehicle 101 about dangers without the driver having to look directly at one of the monitors 104. With the help of color or brightness coding, different types of dangerous situations are also communicated. In addition, the dazzling effect of approaching vehicle headlights is avoided ver. The safety for the driver and other persons is thereby increased. It is also possible to inform the driver about movements outside the vehicle 101 in the state, for example, as a theft warning system. Alternatively or additionally, it is possible to warn the driver before getting out of an approaching vehicle. This is triggered for example by a handle to the doorknob.
  • the environment 105 is detailed and easily recognizable in the monitor 104. Especially at night, it is possible the display brightness sufficiently reduce. Nevertheless, a warning effect is realized by temporarily changing the display on the monitor 104.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Multimedia (AREA)
  • Transportation (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Automation & Control Theory (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Traffic Control Systems (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Instrument Panels (AREA)
  • Image Analysis (AREA)
EP19722607.9A 2018-05-17 2019-05-07 Verfahren und vorrichtung zum betreiben eines kamera-monitor-systems für ein kraftfahrzeug Withdrawn EP3794500A1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102018207762 2018-05-17
DE102018209192.7A DE102018209192B3 (de) 2018-05-17 2018-06-08 Verfahren und Vorrichtung zum Betreiben eines Kamera-Monitor-Systems für ein Kraftfahrzeug
PCT/EP2019/061624 WO2019219440A1 (de) 2018-05-17 2019-05-07 Verfahren und vorrichtung zum betreiben eines kamera-monitor-systems für ein kraftfahrzeug

Publications (1)

Publication Number Publication Date
EP3794500A1 true EP3794500A1 (de) 2021-03-24

Family

ID=66179169

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19722607.9A Withdrawn EP3794500A1 (de) 2018-05-17 2019-05-07 Verfahren und vorrichtung zum betreiben eines kamera-monitor-systems für ein kraftfahrzeug

Country Status (9)

Country Link
US (1) US11766971B2 (zh)
EP (1) EP3794500A1 (zh)
JP (1) JP2021524105A (zh)
KR (1) KR102468922B1 (zh)
CN (1) CN112119398B (zh)
CA (1) CA3097948A1 (zh)
DE (1) DE102018209192B3 (zh)
MX (1) MX2020012215A (zh)
WO (1) WO2019219440A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102018209192B3 (de) * 2018-05-17 2019-05-09 Continental Automotive Gmbh Verfahren und Vorrichtung zum Betreiben eines Kamera-Monitor-Systems für ein Kraftfahrzeug
EP4149809B1 (en) * 2020-05-12 2023-10-11 C.R.F. Società Consortile per Azioni Motor-vehicle driving assistance in low meteorological visibility conditions, in particular with fog
IT202100020852A1 (it) * 2021-08-03 2023-02-03 X Ender S R L Metodo di integrazione alla vista per un utente
DE102022105187B4 (de) 2022-03-04 2024-06-20 Audi Aktiengesellschaft Verfahren zum Darstellen einer Umgebung eines Fahrzeugs und Anzeigesystem

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4696339B2 (ja) * 2000-07-11 2011-06-08 マツダ株式会社 車両の制御装置
DE102005020772A1 (de) * 2005-05-02 2006-11-09 Siemens Ag Anzeigesystem zur Darstellung der Umgebung eines Kraftfahrzeuges
DE102006012773A1 (de) 2006-03-17 2006-11-30 Daimlerchrysler Ag Virtuelles Spotlight zur Kennzeichnung von interessierenden Objekten in Bilddaten
JP4940767B2 (ja) * 2006-06-05 2012-05-30 マツダ株式会社 車両周辺情報報知装置
DE102008017833A1 (de) 2008-02-06 2009-08-20 Daimler Ag Verfahren zum Betrieb einer Bildaufnahmevorrichtung und eine Bildaufnahmevorrichtung
JP2009205268A (ja) * 2008-02-26 2009-09-10 Honda Motor Co Ltd 障害物表示装置
WO2016014966A2 (en) * 2014-07-24 2016-01-28 Brubaker Curtis M Systems, methods, and devices for generating critical mass in a mobile advertising, media, and communications platform
JP2011180873A (ja) * 2010-03-02 2011-09-15 Panasonic Corp 運転支援装置、及び運転支援方法
DE102012002149B3 (de) * 2012-02-04 2013-06-20 Audi Ag Verfahren zur Visualisierung des Umfelds eines Kraftfahrzeugs und zugehöriges Kraftfahrzeug
DE102012006679A1 (de) * 2012-03-31 2012-09-20 Daimler Ag Verfahren zum Erfassen und Darstellen einer Fahrzeugumgebung eines Fahrzeugs
US20150232026A1 (en) * 2012-10-01 2015-08-20 Conti Temic Microelectronic Gmbh Method for Assisting a Driver at a Traffic Light for a Vehicle
US9576208B2 (en) * 2013-12-11 2017-02-21 Continental Automotive Systems, Inc. Emergency vehicle detection with digital image sensor
CN108800037B (zh) * 2014-03-03 2021-02-09 株式会社小糸制作所 车辆用灯具及车辆用灯具的控制***
US20160063761A1 (en) * 2014-08-27 2016-03-03 Toyota Jidosha Kabushiki Kaisha Communication of spatial information based on driver attention assessment
DE102015011536A1 (de) 2015-09-02 2017-03-02 Man Truck & Bus Ag Spiegelersatzsystem als Kamera-Monitor-System (KMS) eines Kraftfahrzeugs, insbesondere eines Nutzfahrzeugs
FR3068945B1 (fr) * 2017-07-11 2019-08-30 Institut Francais Des Sciences Et Technologies Des Transports, De L'amenagement Et Des Reseaux Vehicule routier et methode de reengagement de la conduite manuelle
DE102017220394A1 (de) 2017-11-15 2019-05-16 Continental Automotive Gmbh Verfahren und Vorrichtung zum Betreiben eines Fahrerassistenzsystems für ein Kraftfahrzeug und Kraftfahrzeug
US11347218B2 (en) * 2017-11-21 2022-05-31 Shawn Wang Portable universal autonomous driving system
DE102018209192B3 (de) * 2018-05-17 2019-05-09 Continental Automotive Gmbh Verfahren und Vorrichtung zum Betreiben eines Kamera-Monitor-Systems für ein Kraftfahrzeug
CN114942453A (zh) * 2019-03-08 2022-08-26 欧司朗股份有限公司 Lidar传感器***、用于该***的光学部件、传感器和方法

Also Published As

Publication number Publication date
US11766971B2 (en) 2023-09-26
CN112119398B (zh) 2024-06-04
JP2021524105A (ja) 2021-09-09
US20210061184A1 (en) 2021-03-04
CN112119398A (zh) 2020-12-22
KR102468922B1 (ko) 2022-11-21
KR20200142571A (ko) 2020-12-22
WO2019219440A1 (de) 2019-11-21
DE102018209192B3 (de) 2019-05-09
CA3097948A1 (en) 2019-11-21
MX2020012215A (es) 2021-01-29

Similar Documents

Publication Publication Date Title
EP3401166B1 (de) Spiegelersatzsystem als kamera-monitor-system (kms) eines kraftfahrzeugs, insbesondere eines nutzfahrzeugs
EP2172801B1 (de) Verfahren für eine Anzeige einer visuellen Warndarstellung
EP3794500A1 (de) Verfahren und vorrichtung zum betreiben eines kamera-monitor-systems für ein kraftfahrzeug
EP2617022B1 (de) Visuelles fahrerinformations- und warnsystem für einen fahrer eines kraftfahrzeugs
DE102017221191B4 (de) Verfahren zur Anzeige des Verlaufs einer Sicherheitszone vor einem Fahrzeug oder einem Objekt mit einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm
DE102013012891B4 (de) Verfahren zum Projizieren eines graphisch darstellbaren Anzeigeinhaltes durch ein Kraftfahrzeug in eine Umgebung des Kraftfahrzeugs
DE10131720B4 (de) Head-Up Display System und Verfahren
EP2427855B1 (de) Verfahren zur darstellung von objekten aus der umgebung eines fahrzeugs auf der anzeige einer anzeigevorrichtung
EP3717954B1 (de) Verfahren zur anzeige des verlaufs einer trajektorie vor einem fahrzeug oder einem objekt mit einer anzeigeeinheit, vorrichtung zur durchführung des verfahrens
DE102019208663B4 (de) Verfahren zur Unterstützung eines Fahrers hinsichtlich für eine Verkehrssituation relevanter Objekte und Kraftfahrzeug
DE102011083770A1 (de) Verfahren zur rechnergestützten Verarbeitung des Nahfeldes eines Fahrzeugs
DE102005054972A1 (de) Verfahren zur Totwinkelüberwachung bei Fahrzeugen
DE102009027755A1 (de) Verfahren zum Unterstützen eines Fahrbetriebs eines Kraftfahrzeugs sowie Fahrerassistenzvorrichtung
DE102020127764A1 (de) Fahrzeuganzeigenverbesserung
DE112017007217T5 (de) Fahrmodusumschaltsteuereinrichtung, System, Verfahren und Programm
DE102018108433A1 (de) Bildanzeigevorrichtung
DE102017223439B4 (de) Warnvorrichtung vor Gefahrensituationen für ein Kraftfahrzeug
DE102012018556B4 (de) Assistenzsystem zur Ermöglichung einer erweiterten Vorausschau für nachfolgende Verkehrsteilnehmer
EP3583488B1 (de) Automatisierte aktivierung eines sichtunterstützungssystems
DE102012012783A1 (de) Kamera-Monitor-System zur Überwachung des toten Winkels oder der Umgebung für Kraftfahrzeuge
DE102020121655A1 (de) System und Verfahren zur Lenkung der Aufmerksamkeit eines Fahrzeuginsassen beim automatisierten Fahren
DE102018127471A1 (de) Verfahren und System zum Warnen eines Fahrers eines Fahrzeugs
DE102022105187B4 (de) Verfahren zum Darstellen einer Umgebung eines Fahrzeugs und Anzeigesystem
EP2468571B1 (de) Innenrückspiegel mit Bildanzeige bei Spurwechsel
DE102022113245A1 (de) Verfahren zum Betreiben einer Anzeigevorrichtung eines Kraftfahrzeugs, Steuereinrichtung, und Kraftfahrzeug

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201217

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: CONTINENTAL AUTOMOTIVE TECHNOLOGIES GMBH

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230330

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20230621