EP2983152A1 - Verkehrsereignisdetektionssystem für Fahrzeuge - Google Patents

Verkehrsereignisdetektionssystem für Fahrzeuge Download PDF

Info

Publication number
EP2983152A1
EP2983152A1 EP14179680.5A EP14179680A EP2983152A1 EP 2983152 A1 EP2983152 A1 EP 2983152A1 EP 14179680 A EP14179680 A EP 14179680A EP 2983152 A1 EP2983152 A1 EP 2983152A1
Authority
EP
European Patent Office
Prior art keywords
sensor
vehicle
assembly
cpu
image stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP14179680.5A
Other languages
English (en)
French (fr)
Inventor
Eric Sinclair
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to EP14179680.5A priority Critical patent/EP2983152A1/de
Publication of EP2983152A1 publication Critical patent/EP2983152A1/de
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/09—Arrangements for giving variable traffic instructions
    • G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/09623—Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle

Definitions

  • the present teachings are related to traffic event detection, and more particularly, to systems, platforms, and techniques for automotive and other vehicles to increase safety in case of sudden and abrupt change in traffic conditions by forward detection of hazardous or anomalous driving conditions.
  • the system addressing these and other needs can comprise a sensor element, such as a video camera mounted on a vehicle to capture the images of the traffic ahead, a central processing unit (CPU) or other logic to process image streams captured by the camera, and software that analyses the images in the captured stream and detects events taking place ahead of the vehicle.
  • the system can also include a video display that presents the images captured by the camera and a powered speaker to generate an audible alarm that warns the driver of the vehicle of troubles ahead.
  • the camera can monitor or sample the field of view in front of the vehicle, including other vehicles in proximity to the vehicle equipped with systems according to the invention.
  • the software associated with the sensor can automatically detect an increase in red light intensity present in the field of view, due to the activation of brake lights in the vehicles ahead.
  • the system can recognize that change in content, and notify the driver by emitting an alarm sound.
  • a video display can also be installed inside.the vehicle above the driver, for example near the sun visor, to present additional information and to provide the driver with complementary visual aid.
  • FIG. 1 shows an illustrative overall system 50 not installed on a vehicle.
  • the sensor 101 is connected to a CPU 103 by a cable 102.
  • the sensor 101 can be or include, for example, a video camera, such as a digital device using a charge coupled device (CCD) sensor array.
  • CCD charge coupled device
  • Other types of sensing elements or other devices can be used, including, merely for example, complementary metal oxide semiconductor (CMOS) sensing elements, and/or forward looking infrared (FLIR) sensors.
  • CMOS complementary metal oxide semiconductor
  • FLIR forward looking infrared
  • sensors operating on other types of signals such as acoustic sensors, can be used in addition to or instead of visual detectors.
  • sensor 101 is shown as being connected to the CPU 103 by a cable 102, which can for instance be or include a local area network (LAN) cable, other wired or wireless connections between the sensor 101 and CPU 103 can be used.
  • the sensor 101 can connect to the CPU 103 via a Bluetooth wireless connection, or others.
  • the CPU 103 can be or include a general-purpose or special-purpose computer programmed with software, applications, and/or services to perform sensor control and image processing according to the teachings herein. Other devices configured to perform control logic can be used.
  • the senor 101 can operate to capture images in front of a vehicle equipped with system 50 for the CPU 103 to process.
  • the CPU 103 can execute software and/or invoke services to analyze each of the images in the resulting image stream, and then use an algorithm such as the one illustrated in FIG. 5 to alert the driver of possible traffic events.
  • the CPU 103 can be configured to send the images captured by the sensor 101 to a video display 106, for instance through a connecting cable 104. If the CPU 103 and associated software or logic have detected a traffic event and need to alert the driver, the CPU 103 can in implementations do so by transmitting an audible alarm through cable 105 to a speaker 107. Other alerts or notifications, such as flashing lights or other visual cues, can also be used.
  • FIG. 2 shows the system 50 as mounted or installed on a vehicle 51.
  • the sensor 101 can be installed on a support 52.
  • the support 52 can, in implementations, be a rigid element constructed to be high enough to be located above the vehicles ahead.
  • the support 52 can be or include a retractable or articulated element, so that the support 52 can for instance be placed in a folded-down or prone position when not in use, such as in a recess or channel in the roof or other structure of the vehicle 51.
  • the support 52 in those cases can be driven by a motorized drive to an upright state or position, or returned to a resting state in the recess or other receiving structure or position.
  • the support 52 can also or instead be implemented using a telescoping element, for instance to allow an adjustable or selectable height to be reached.
  • the motorized drive of the support 52 can likewise be controlled by the CPU 103, and/or other or separate processors or logic.
  • the system 50 can achieve a higher and/or selectable elevation of the CCD or other sensing elements of the sensor 101.
  • the capability to elevate the sensor can permit the sensor to "see" a greater depth or distance into the field of view, and/or a wider viewing range, than if the sensor were mounted in a fixed manner to the body of the subject vehicle 51 equipped with the system 50.
  • the greater viewing depth can allow the system 50 to detect and take into account the brake light activity or other details produced by more vehicles located farther ahead of the vehicle equipped with the system 50. This can allow the system to draw inferences about traffic events based on a larger number of brake light and other features, thus enhancing sensitivity, accuracy, and other parameters of system 50.
  • the senor 101 can be mounted on the support 52 in a rotatable and/or otherwise articulated fashion.
  • the sensor 101 can be attached to the support using a rotary drive element, so that the sensor 101 can be rotated from side to side when the support is in an extended or deployed position.
  • the sensor 101 can be mounted to the support with a motorized drive to permit horizontal rotation of 180 degrees on a horizontal plane or other amounts, to allow the driver of the vehicle to pan the field of view of the sensor with regard to traffic ahead.
  • the sensor 101 and/or mount 102 can be configured to permit vertical adjustments as well, to change the vertical pointing angle and hence range of view provided by the sensor 101 ahead of the subject vehicle.
  • the one or more motors or drives used to drive motion of the sensor 101 can be or include, for instance, direct current (DC) motors, stepper motors, linear motors, and/or others, as understood by persons skilled in the art.
  • Those motorized drives can transmit the driving force to support 52 and/or other members using gears, bearings, and/or other mechanical transmissions.
  • the video display 106 can be mounted on the ceiling 53 of the car or other subject vehicle 51.
  • the video display 106 can be fixed, or can rotate along an axis like a visor, to allow the driver to place the video display 106 at a convenient angle for viewing.
  • FIG. 3 illustrates the system 51 mounted on a vehicle 50, but in a further, three-dimensional view.
  • the sensor 101 as shown is installed on a support 52.
  • the video display 106 is shown from the back of that element.
  • a speaker 107 can be used to provide audible warnings or annunciations of traffic events, and can as shown be installed on the video display 106, and/or in other locations.
  • FIG. 4 shows the video display 106 from inside the vehicle 51.
  • the video display can be attached to the ceiling 53, and again can be pulled down the same way the sun visor 54 can rotate.
  • the sound speaker 107 is attached to the video display 106.
  • FIG. 5 shows a diagram of illustrative processing to analyze the stream of images captured by the sensor 101.
  • each of the images captured by the camera can be compared with the previous image. Differences between successive image frames can be used to determine if a traffic event is taking place. For instance, the spectral content of different image frames can be compared to determine if the color content of the field of view is changing. For instance, in implementations, if the second, or new image, has more red intensity than the previous one by some threshold, the detection of an event can be triggered.
  • the threshold used to measure changes in red content can be predetermined or set, for instance, to a fixed threshold X by the car manufacturer or manufacturer of the system 50.
  • the threshold can also or instead by dynamically set or adjusted by the CPU 103, for instance, to take into account ambient conditions, such as red light content from a sunset, sodium vapor lamps along a roadway, or other light sources. As noted, upon detection of a traffic event, an audible alarm and/or other notification can be sent to the driver.
  • processing can begin by making a determination whether system 50 is turned on, powered, and/or otherwise in an operational state. If the determination in 502 is no, processing proceeds to 504 in which no analysis is performed. If the determination in 502 is yes, processing proceeds to 506, in which the sensor 101 captures image number "n."
  • the captured image can consist of one video frame, and/or other image formats or configurations.
  • the captured image and/or image stream can be encoded in standard image formats, such as motion picture experts group (.mpg) format, joint photographic experts group (.jpg) format, raw image format, and/or other formats, encodings, or file types.
  • the sensor 101 can be configured to capture each successive video frame or other unit of data using a predetermined frame rate, such as 30 frames/sec, or others.
  • the image date captured by sensor 101 can be stored by CPU 103 to local storage, such as electronic memory, solid state drives, hard drives, and/or other storage media, if desired.
  • the CPU 103 and/or other processor or logic can analyze the color content of the captured frame n, such as for instance by calculating the percentage of red color content in that image content. Red may be used because that color is produced by standard rear brake lights. It will however be appreciated that other colors can be used in addition or instead when performing a spectral or color analysis of image n. It will also be appreciated that image processing characteristics or signatures other than color content, such as luminance values, motion analysis, or others can likewise be used to analyze the scene or view in front of the vehicle equipped with system 50.
  • the sensor 101 can capture or acquire a next image or image frame "n+1," acting together with the CPU 103 can capture or acquire a next image or image frame "n+1.”
  • the CPU 103 and/or other processor or logic can similarly calculate the percentage of red color content, or other spectral or other signature, in image or image frame n+1.
  • the CPU 103 and/or other logic or processor can determine if the percentage of red color content in image or image frame n+1 is less than or equal to the percentage of red color content in image or image frame n, then processing will proceed to 516, in which a determination can be made that the color content of image/frame n and n+1 are equal. In that case, processing can return to 510. In aspects, processing can return to 510 (and acquire a further image or frame) because no change in red-color content is detected, and the total brake light illumination is assumed to be the same, with no sudden change in forward traffic conditions.
  • the CPU 103 and/or other processor or logic can determine that if the percentage of red color content in image or frame n+1 is greater than that of image or frame n plus a selected threshold (e.g., 10% or other value), then processing will proceed to 520 in which a traffic event is deemed to be detected and the driver can be alerted with an audible sound or other alert or notification.
  • a traffic event is deemed to be detected and the driver can be alerted with an audible sound or other alert or notification.
  • the alert or notification can continue until the driver hits a cancel button, a predetermined timeout takes place, or other conditions occur. Processing can then return to a prior processing point (e.g., 502), jump to a further processing point, or end.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
EP14179680.5A 2014-08-04 2014-08-04 Verkehrsereignisdetektionssystem für Fahrzeuge Withdrawn EP2983152A1 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP14179680.5A EP2983152A1 (de) 2014-08-04 2014-08-04 Verkehrsereignisdetektionssystem für Fahrzeuge

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP14179680.5A EP2983152A1 (de) 2014-08-04 2014-08-04 Verkehrsereignisdetektionssystem für Fahrzeuge

Publications (1)

Publication Number Publication Date
EP2983152A1 true EP2983152A1 (de) 2016-02-10

Family

ID=51263275

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14179680.5A Withdrawn EP2983152A1 (de) 2014-08-04 2014-08-04 Verkehrsereignisdetektionssystem für Fahrzeuge

Country Status (1)

Country Link
EP (1) EP2983152A1 (de)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3726065A1 (de) * 1987-08-06 1988-01-21 Friedhelm Fredrich Kastenwagenkraftfahrzeug mit einer auswerteinrichtung im fahrerhaus, die einer bedienungsperson eine beurteilung eines objektes durch bildschirme und schallwandler erlaubt, wobei speziell die signale einer videokamera zur beurteilung des aufnahmewinkels dient
WO2001043104A1 (en) * 1999-12-10 2001-06-14 David Sitrick Methodology, apparatus, and system for electronic visualization of traffic conditions
JP2003028654A (ja) * 2001-07-12 2003-01-29 Matsushita Electric Ind Co Ltd ナビゲーション装置
JP2003091799A (ja) * 2001-09-18 2003-03-28 Clarion Co Ltd 車載用周辺画像取得方法及び車載用周辺画像取得装置及びそれに用いる撮像用カメラ及びそれに用いる画像提示装置
US6975347B1 (en) * 2000-07-20 2005-12-13 Ford Global Technologies, Llc Method and apparatus for acquiring and displaying images
JP2006168683A (ja) * 2004-12-20 2006-06-29 Nissan Motor Co Ltd 車載カメラ装置
US20100145617A1 (en) * 2008-12-04 2010-06-10 Denso Corporation Obstacle detecting device
DE102011088130A1 (de) * 2011-12-09 2013-06-13 Robert Bosch Gmbh Verfahren und Vorrichtung zur Erkennung einer Bremssituation
FR2986647A3 (fr) * 2012-02-07 2013-08-09 Renault Sas Vehicule automobile associe a un drone d'observation

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3726065A1 (de) * 1987-08-06 1988-01-21 Friedhelm Fredrich Kastenwagenkraftfahrzeug mit einer auswerteinrichtung im fahrerhaus, die einer bedienungsperson eine beurteilung eines objektes durch bildschirme und schallwandler erlaubt, wobei speziell die signale einer videokamera zur beurteilung des aufnahmewinkels dient
WO2001043104A1 (en) * 1999-12-10 2001-06-14 David Sitrick Methodology, apparatus, and system for electronic visualization of traffic conditions
US6975347B1 (en) * 2000-07-20 2005-12-13 Ford Global Technologies, Llc Method and apparatus for acquiring and displaying images
JP2003028654A (ja) * 2001-07-12 2003-01-29 Matsushita Electric Ind Co Ltd ナビゲーション装置
JP2003091799A (ja) * 2001-09-18 2003-03-28 Clarion Co Ltd 車載用周辺画像取得方法及び車載用周辺画像取得装置及びそれに用いる撮像用カメラ及びそれに用いる画像提示装置
JP2006168683A (ja) * 2004-12-20 2006-06-29 Nissan Motor Co Ltd 車載カメラ装置
US20100145617A1 (en) * 2008-12-04 2010-06-10 Denso Corporation Obstacle detecting device
DE102011088130A1 (de) * 2011-12-09 2013-06-13 Robert Bosch Gmbh Verfahren und Vorrichtung zur Erkennung einer Bremssituation
FR2986647A3 (fr) * 2012-02-07 2013-08-09 Renault Sas Vehicule automobile associe a un drone d'observation

Similar Documents

Publication Publication Date Title
US20140218530A1 (en) Traffic Event Detection System for Vehicles
US9975482B2 (en) Systems and methods for traffic event detection for vehicles using rolling averages
US11488398B2 (en) Detecting illegal use of phone to prevent the driver from getting a fine
US10740627B2 (en) Multi-camera vision system and method of monitoring
US11745755B2 (en) Vehicular driving assist system with driver monitoring
US10116873B1 (en) System and method to adjust the field of view displayed on an electronic mirror using real-time, physical cues from the driver in a vehicle
US9630569B2 (en) Field of vision display device for a sun visor of a vehicle
CN105308620B (zh) 信息处理设备、接近对象通知方法和程序
US11833966B2 (en) Switchable display during parking maneuvers
JP5070809B2 (ja) 運転支援装置、運転支援方法、及び、プログラム
US11970156B1 (en) Parking assistance using a stereo camera and an added light source
JP2010067262A (ja) インテリジェント走行支援システム
US20230351633A1 (en) Vehicle system for controlling and not controlling electronic device
US10495458B2 (en) Image processing system for vehicle
US10846833B2 (en) System and method for visibility enhancement
CN106926794B (zh) 车辆监控***及其方法
US11586843B1 (en) Generating training data for speed bump detection
JP4601505B2 (ja) トップビュー画像生成装置及びトップビュー画像表示方法
JP2019188855A (ja) 車両用視認装置
IL263529A (en) Visual display system for accident prevention with vehicles
US20200275022A1 (en) Automotive driving recorder
EP2983152A1 (de) Verkehrsereignisdetektionssystem für Fahrzeuge
JP6403378B2 (ja) 安全運転支援装置および安全運転支援方法
JP2021060676A (ja) システムおよびプログラム等
KR20180013126A (ko) 차량용 블랙박스

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20160803

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17Q First examination report despatched

Effective date: 20161108

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20170519