EP3588939C0 - Bundling night vision and other driver assistance systems (das) using near infra red (nir) illumination and a rolling shutter - Google Patents

Bundling night vision and other driver assistance systems (das) using near infra red (nir) illumination and a rolling shutter

Info

Publication number
EP3588939C0
EP3588939C0 EP19192365.5A EP19192365A EP3588939C0 EP 3588939 C0 EP3588939 C0 EP 3588939C0 EP 19192365 A EP19192365 A EP 19192365A EP 3588939 C0 EP3588939 C0 EP 3588939C0
Authority
EP
European Patent Office
Prior art keywords
nir
bundling
das
illumination
driver assistance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19192365.5A
Other languages
German (de)
French (fr)
Other versions
EP3588939A1 (en
EP3588939B1 (en
Inventor
Gideon P Stein
Efim Belman
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mobileye Vision Technologies Ltd
Original Assignee
Mobileye Vision Technologies Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mobileye Vision Technologies Ltd filed Critical Mobileye Vision Technologies Ltd
Publication of EP3588939A1 publication Critical patent/EP3588939A1/en
Application granted granted Critical
Publication of EP3588939C0 publication Critical patent/EP3588939C0/en
Publication of EP3588939B1 publication Critical patent/EP3588939B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/30—Transforming light or analogous information into electric information
    • H04N5/33—Transforming infrared radiation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/24—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view in front of the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/30—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles providing vision in the non-visible spectrum, e.g. night or infrared vision
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/53—Control of the integration time
    • H04N25/531—Control of the integration time by controlling rolling shutters in CMOS SSIS

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Traffic Control Systems (AREA)
  • Studio Devices (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Lighting Device Outwards From Vehicle And Optical Signal (AREA)
EP19192365.5A 2010-10-31 2011-10-28 Bundling night vision and other driver assistance systems (das) using near infra red (nir) illumination and a rolling shutter Active EP3588939B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US40861710P 2010-10-31 2010-10-31
US42142410P 2010-12-09 2010-12-09
EP11187158.8A EP2448251B1 (en) 2010-10-31 2011-10-28 Bundling night vision and other driver assistance systems (DAS) using near infra red (NIR) illumination and a rolling shutter

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
EP11187158.8A Division EP2448251B1 (en) 2010-10-31 2011-10-28 Bundling night vision and other driver assistance systems (DAS) using near infra red (NIR) illumination and a rolling shutter
EP11187158.8A Division-Into EP2448251B1 (en) 2010-10-31 2011-10-28 Bundling night vision and other driver assistance systems (DAS) using near infra red (NIR) illumination and a rolling shutter

Publications (3)

Publication Number Publication Date
EP3588939A1 EP3588939A1 (en) 2020-01-01
EP3588939C0 true EP3588939C0 (en) 2023-10-18
EP3588939B1 EP3588939B1 (en) 2023-10-18

Family

ID=44862773

Family Applications (2)

Application Number Title Priority Date Filing Date
EP11187158.8A Active EP2448251B1 (en) 2010-10-31 2011-10-28 Bundling night vision and other driver assistance systems (DAS) using near infra red (NIR) illumination and a rolling shutter
EP19192365.5A Active EP3588939B1 (en) 2010-10-31 2011-10-28 Bundling night vision and other driver assistance systems (das) using near infra red (nir) illumination and a rolling shutter

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP11187158.8A Active EP2448251B1 (en) 2010-10-31 2011-10-28 Bundling night vision and other driver assistance systems (DAS) using near infra red (NIR) illumination and a rolling shutter

Country Status (2)

Country Link
US (4) US9179072B2 (en)
EP (2) EP2448251B1 (en)

Families Citing this family (111)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6822563B2 (en) 1997-09-22 2004-11-23 Donnelly Corporation Vehicle imaging system with accessory control
US5877897A (en) 1993-02-26 1999-03-02 Donnelly Corporation Automatic rearview mirror, vehicle lighting control and vehicle interior monitoring system using a photosensor array
US7655894B2 (en) 1996-03-25 2010-02-02 Donnelly Corporation Vehicular image sensing system
ES2391556T3 (en) 2002-05-03 2012-11-27 Donnelly Corporation Object detection system for vehicles
US7526103B2 (en) 2004-04-15 2009-04-28 Donnelly Corporation Imaging system for vehicle
US7972045B2 (en) 2006-08-11 2011-07-05 Donnelly Corporation Automatic headlamp control system
US10922567B2 (en) 2010-06-07 2021-02-16 Affectiva, Inc. Cognitive state based vehicle manipulation using near-infrared image processing
EP2448251B1 (en) 2010-10-31 2019-09-25 Mobileye Vision Technologies Ltd. Bundling night vision and other driver assistance systems (DAS) using near infra red (NIR) illumination and a rolling shutter
DE102010063133A1 (en) * 2010-12-15 2012-06-21 Robert Bosch Gmbh Method and system for determining a self-motion of a vehicle
CN104094330B (en) * 2012-02-03 2016-06-29 大陆-特韦斯贸易合伙股份公司及两合公司 For highlighting the application of the signal recurring structure of object in road traffic, system and method and systematic difference and signal recurring structure
JP5486031B2 (en) * 2012-03-06 2014-05-07 本田技研工業株式会社 Light distribution control device
JP2013200603A (en) * 2012-03-23 2013-10-03 Hitachi Automotive Systems Ltd In-vehicle image processing device and method
US9307207B2 (en) * 2013-01-07 2016-04-05 GM Global Technology Operations LLC Glaring reduction for dynamic rearview mirror
US9475521B1 (en) * 2015-06-08 2016-10-25 Honda Motor Co., Ltd. Failsafe detection
US9751534B2 (en) 2013-03-15 2017-09-05 Honda Motor Co., Ltd. System and method for responding to driver state
US10298741B2 (en) 2013-07-18 2019-05-21 Secure4Drive Communication Ltd. Method and device for assisting in safe driving of a vehicle
WO2015152984A2 (en) 2014-01-22 2015-10-08 Polaris Sensor Technologies, Inc. Polarization imaging for facial recognition enhancement system and method
US9589195B2 (en) 2014-01-22 2017-03-07 Polaris Sensor Technologies, Inc. Polarization-based mapping and perception method and system
US9361502B2 (en) 2014-07-31 2016-06-07 Symbol Technologies, Llc System for, and method of, controlling target illumination for an imaging reader
KR102323393B1 (en) 2015-01-12 2021-11-09 삼성전자주식회사 Device and method of controlling the device
WO2016132976A1 (en) * 2015-02-17 2016-08-25 ソニー株式会社 Transmission device, transmission method, reception device, and reception method
US9953428B2 (en) * 2015-03-03 2018-04-24 Microsoft Technology Licensing, Llc Digital camera unit with simultaneous structured and unstructured illumination
WO2016163248A1 (en) * 2015-04-09 2016-10-13 ソニー株式会社 Imaging device and method, electronic device, and vehicle-mounted electronic device
JP6034923B1 (en) * 2015-06-26 2016-11-30 富士重工業株式会社 Outside environment recognition device
CN107218886B (en) * 2016-03-22 2020-07-03 中国科学院国家空间科学中心 Optical positioning tracking system and method based on invisible combined road sign
US9535423B1 (en) * 2016-03-29 2017-01-03 Adasworks Kft. Autonomous vehicle with improved visual detection ability
KR20190007442A (en) 2016-06-09 2019-01-22 쓰리엠 이노베이티브 프로퍼티즈 컴파니 Optical filter
TWI596941B (en) * 2016-09-19 2017-08-21 Vivotek Inc Image capturing method and monitoring apparatus with supplemental lighting modulation
WO2018132378A2 (en) 2017-01-10 2018-07-19 Cavh Llc Connected automated vehicle highway systems and methods
US10380886B2 (en) 2017-05-17 2019-08-13 Cavh Llc Connected automated vehicle highway systems and methods
US10311312B2 (en) 2017-08-31 2019-06-04 TuSimple System and method for vehicle occlusion detection
US10067509B1 (en) 2017-03-10 2018-09-04 TuSimple System and method for occluding contour detection
US11587304B2 (en) 2017-03-10 2023-02-21 Tusimple, Inc. System and method for occluding contour detection
US10671873B2 (en) 2017-03-10 2020-06-02 Tusimple, Inc. System and method for vehicle wheel detection
US10147193B2 (en) 2017-03-10 2018-12-04 TuSimple System and method for semantic segmentation using hybrid dilated convolution (HDC)
US9953236B1 (en) 2017-03-10 2018-04-24 TuSimple System and method for semantic segmentation using dense upsampling convolution (DUC)
US9952594B1 (en) 2017-04-07 2018-04-24 TuSimple System and method for traffic data collection using unmanned aerial vehicles (UAVs)
US10471963B2 (en) 2017-04-07 2019-11-12 TuSimple System and method for transitioning between an autonomous and manual driving mode based on detection of a drivers capacity to control a vehicle
US10710592B2 (en) 2017-04-07 2020-07-14 Tusimple, Inc. System and method for path planning of autonomous vehicles based on gradient
US10552691B2 (en) 2017-04-25 2020-02-04 TuSimple System and method for vehicle position and velocity estimation based on camera and lidar data
US10488028B2 (en) * 2017-05-03 2019-11-26 Fluence Bioengineering, Inc. Systems and methods for a heat sink
US20180324367A1 (en) * 2017-05-03 2018-11-08 Ford Global Technologies, Llc Using nir illuminators to improve vehicle camera performance in low light scenarios
US10692365B2 (en) 2017-06-20 2020-06-23 Cavh Llc Intelligent road infrastructure system (IRIS): systems and methods
US12008893B2 (en) 2017-05-17 2024-06-11 Cavh Llc Autonomous vehicle (AV) control system with roadside unit (RSU) network
US10558864B2 (en) 2017-05-18 2020-02-11 TuSimple System and method for image localization based on semantic segmentation
US10481044B2 (en) 2017-05-18 2019-11-19 TuSimple Perception simulation for improved autonomous vehicle control
US10474790B2 (en) 2017-06-02 2019-11-12 TuSimple Large scale distributed simulation for realistic multiple-agent interactive environments
US10762635B2 (en) 2017-06-14 2020-09-01 Tusimple, Inc. System and method for actively selecting and labeling images for semantic segmentation
US10737695B2 (en) 2017-07-01 2020-08-11 Tusimple, Inc. System and method for adaptive cruise control for low speed following
US10493988B2 (en) 2017-07-01 2019-12-03 TuSimple System and method for adaptive cruise control for defensive driving
US10752246B2 (en) 2017-07-01 2020-08-25 Tusimple, Inc. System and method for adaptive cruise control with proximate vehicle detection
US10308242B2 (en) 2017-07-01 2019-06-04 TuSimple System and method for using human driving patterns to detect and correct abnormal driving behaviors of autonomous vehicles
US10303522B2 (en) 2017-07-01 2019-05-28 TuSimple System and method for distributed graphics processing unit (GPU) computation
US11029693B2 (en) 2017-08-08 2021-06-08 Tusimple, Inc. Neural network based vehicle dynamics model
US10360257B2 (en) 2017-08-08 2019-07-23 TuSimple System and method for image annotation
US10816354B2 (en) 2017-08-22 2020-10-27 Tusimple, Inc. Verification module system and method for motion-based lane detection with multiple sensors
US10762673B2 (en) 2017-08-23 2020-09-01 Tusimple, Inc. 3D submap reconstruction system and method for centimeter precision localization using camera-based submap and LiDAR-based global map
US10565457B2 (en) 2017-08-23 2020-02-18 Tusimple, Inc. Feature matching and correspondence refinement and 3D submap position refinement system and method for centimeter precision localization using camera-based submap and LiDAR-based global map
US10303956B2 (en) 2017-08-23 2019-05-28 TuSimple System and method for using triplet loss for proposal free instance-wise semantic segmentation for lane detection
US10678234B2 (en) 2017-08-24 2020-06-09 Tusimple, Inc. System and method for autonomous vehicle control to minimize energy cost
US10783381B2 (en) 2017-08-31 2020-09-22 Tusimple, Inc. System and method for vehicle occlusion detection
US10953881B2 (en) 2017-09-07 2021-03-23 Tusimple, Inc. System and method for automated lane change control for autonomous vehicles
US10649458B2 (en) 2017-09-07 2020-05-12 Tusimple, Inc. Data-driven prediction-based system and method for trajectory planning of autonomous vehicles
US10782694B2 (en) 2017-09-07 2020-09-22 Tusimple, Inc. Prediction-based system and method for trajectory planning of autonomous vehicles
US10656644B2 (en) 2017-09-07 2020-05-19 Tusimple, Inc. System and method for using human driving patterns to manage speed control for autonomous vehicles
US10953880B2 (en) 2017-09-07 2021-03-23 Tusimple, Inc. System and method for automated lane change control for autonomous vehicles
US10782693B2 (en) 2017-09-07 2020-09-22 Tusimple, Inc. Prediction-based system and method for trajectory planning of autonomous vehicles
US10552979B2 (en) 2017-09-13 2020-02-04 TuSimple Output of a neural network method for deep odometry assisted by static scene optical flow
US10671083B2 (en) 2017-09-13 2020-06-02 Tusimple, Inc. Neural network architecture system for deep odometry assisted by static scene optical flow
US10733465B2 (en) 2017-09-20 2020-08-04 Tusimple, Inc. System and method for vehicle taillight state recognition
US10387736B2 (en) 2017-09-20 2019-08-20 TuSimple System and method for detecting taillight signals of a vehicle
US10768626B2 (en) 2017-09-30 2020-09-08 Tusimple, Inc. System and method for providing multiple agents for decision making, trajectory planning, and control for autonomous vehicles
US10962979B2 (en) 2017-09-30 2021-03-30 Tusimple, Inc. System and method for multitask processing for autonomous vehicle computation and control
US10970564B2 (en) 2017-09-30 2021-04-06 Tusimple, Inc. System and method for instance-level lane detection for autonomous vehicle control
US10410055B2 (en) 2017-10-05 2019-09-10 TuSimple System and method for aerial video traffic analysis
US10666730B2 (en) 2017-10-28 2020-05-26 Tusimple, Inc. Storage architecture for heterogeneous multimedia data
US10812589B2 (en) 2017-10-28 2020-10-20 Tusimple, Inc. Storage architecture for heterogeneous multimedia data
US10739775B2 (en) 2017-10-28 2020-08-11 Tusimple, Inc. System and method for real world autonomous vehicle trajectory simulation
US10657390B2 (en) 2017-11-27 2020-05-19 Tusimple, Inc. System and method for large-scale lane marking detection using multimodal sensor data
US10528823B2 (en) 2017-11-27 2020-01-07 TuSimple System and method for large-scale lane marking detection using multimodal sensor data
US10528851B2 (en) 2017-11-27 2020-01-07 TuSimple System and method for drivable road surface representation generation using multimodal sensor data
US10877476B2 (en) 2017-11-30 2020-12-29 Tusimple, Inc. Autonomous vehicle simulation system for analyzing motion planners
US10860018B2 (en) 2017-11-30 2020-12-08 Tusimple, Inc. System and method for generating simulated vehicles with configured behaviors for analyzing autonomous vehicle motion planners
AU2019206509A1 (en) 2018-01-09 2020-07-23 Tusimple, Inc. Real-time remote control of vehicles with high redundancy
CN111989716B (en) 2018-01-11 2022-11-15 图森有限公司 Monitoring system for autonomous vehicle operation
US10867512B2 (en) 2018-02-06 2020-12-15 Cavh Llc Intelligent road infrastructure system (IRIS): systems and methods
US11009365B2 (en) 2018-02-14 2021-05-18 Tusimple, Inc. Lane marking localization
US11009356B2 (en) 2018-02-14 2021-05-18 Tusimple, Inc. Lane marking localization and fusion
US10685244B2 (en) 2018-02-27 2020-06-16 Tusimple, Inc. System and method for online real-time multi-object tracking
US10685239B2 (en) 2018-03-18 2020-06-16 Tusimple, Inc. System and method for lateral vehicle detection
CN110378184A (en) 2018-04-12 2019-10-25 北京图森未来科技有限公司 A kind of image processing method applied to automatic driving vehicle, device
CN116129376A (en) 2018-05-02 2023-05-16 北京图森未来科技有限公司 Road edge detection method and device
KR20210008836A (en) 2018-05-09 2021-01-25 씨에이브이에이치 엘엘씨 System and method for allocation of driving intelligence between vehicles and highways
US11104334B2 (en) 2018-05-31 2021-08-31 Tusimple, Inc. System and method for proximate vehicle intention prediction for autonomous vehicles
WO2019246246A1 (en) 2018-06-20 2019-12-26 Cavh Llc Connected automated vehicle highway systems and methods related to heavy vehicles
WO2020006161A1 (en) * 2018-06-28 2020-01-02 Cavh Llc Cloud-based technology for connected and automated vehicle highway systems
US11373122B2 (en) 2018-07-10 2022-06-28 Cavh Llc Fixed-route service system for CAVH systems
WO2020014227A1 (en) 2018-07-10 2020-01-16 Cavh Llc Route-specific services for connected automated vehicle highway systems
US10839234B2 (en) 2018-09-12 2020-11-17 Tusimple, Inc. System and method for three-dimensional (3D) object detection
AU2019339418A1 (en) 2018-09-13 2021-05-13 Tusimple, Inc. Remote safe driving methods and systems
US10796402B2 (en) 2018-10-19 2020-10-06 Tusimple, Inc. System and method for fisheye image processing
US10942271B2 (en) 2018-10-30 2021-03-09 Tusimple, Inc. Determining an angle between a tow vehicle and a trailer
CN111319629B (en) 2018-12-14 2021-07-16 北京图森智途科技有限公司 Team forming method, device and system for automatically driving fleet
US11030472B2 (en) 2019-04-30 2021-06-08 Axon Enterprise, Inc. Asymmetrical license plate reading (ALPR) camera system
US10715738B1 (en) 2019-04-30 2020-07-14 Axon Enterprise, Inc. Asymmetrical license plate reading (ALPR) camera system
US11532170B2 (en) 2019-04-30 2022-12-20 Axon Enterprise, Inc. License plate reading system with enhancements
US11823460B2 (en) 2019-06-14 2023-11-21 Tusimple, Inc. Image fusion for autonomous vehicle operation
EP3893150A1 (en) 2020-04-09 2021-10-13 Tusimple, Inc. Camera pose estimation techniques
AU2021203567A1 (en) 2020-06-18 2022-01-20 Tusimple, Inc. Angle and orientation measurements for vehicles with multiple drivable sections
KR102460660B1 (en) 2020-08-24 2022-10-31 현대모비스 주식회사 Lamp controller interlocking system of camera built-in headlamp and method thereof
DE102022002637B3 (en) 2022-07-19 2023-07-27 Mercedes-Benz Group AG Camera system and method for its operation

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5001558A (en) * 1985-06-11 1991-03-19 General Motors Corporation Night vision system with color video camera
US6704621B1 (en) 1999-11-26 2004-03-09 Gideon P. Stein System and method for estimating ego-motion of a moving vehicle using successive images recorded along the vehicle's path of motion
JP3732398B2 (en) * 2000-10-11 2006-01-05 三菱電機株式会社 Crew protection device
US7113867B1 (en) 2000-11-26 2006-09-26 Mobileye Technologies Limited System and method for detecting obstacles to vehicle motion and determining time to contact therewith using sequences of images
JP4154157B2 (en) * 2002-02-25 2008-09-24 株式会社東芝 Imaging device
US7733464B2 (en) * 2002-08-05 2010-06-08 Elbit Systems Ltd. Vehicle mounted night vision imaging system and method
DE10245912B4 (en) * 2002-10-01 2011-12-08 Bayerische Motoren Werke Aktiengesellschaft Method for operating an optoelectronic sensor device
JP3846410B2 (en) * 2002-11-21 2006-11-15 ソニー株式会社 Image processing apparatus and method, recording medium, and program
US7881496B2 (en) * 2004-09-30 2011-02-01 Donnelly Corporation Vision system for vehicle
JP4452161B2 (en) * 2004-11-12 2010-04-21 パナソニック株式会社 Imaging device
EP2420954B8 (en) * 2004-12-01 2017-04-12 Datalogic USA, Inc. Data reader with automatic exposure adjustment and methods of operating a data reader
JP4320780B2 (en) * 2005-12-26 2009-08-26 船井電機株式会社 Imaging device
GB2435974A (en) * 2006-03-07 2007-09-12 I S G Thermal Systems Ltd Imaging system including detectors using plural sensitivity levels
JP2007318581A (en) * 2006-05-29 2007-12-06 Casio Comput Co Ltd Imaging apparatus, photographing auxiliary light source emitting/imaging control method, and photographing auxiliary light source emitting/imaging control program
EP2383679A1 (en) 2006-12-06 2011-11-02 Mobileye Technologies Limited Detecting and recognizing traffic signs
US7855740B2 (en) * 2007-07-20 2010-12-21 Eastman Kodak Company Multiple component readout of image sensor
JP2009152669A (en) * 2007-12-18 2009-07-09 Sony Corp Imaging apparatus, imaging processing method and imaging control program
JP5040776B2 (en) * 2008-03-31 2012-10-03 アイシン精機株式会社 Imaging device
US20100149393A1 (en) * 2008-05-22 2010-06-17 Panavision Imaging, Llc Increasing the resolution of color sub-pixel arrays
JP5435916B2 (en) * 2008-09-18 2014-03-05 富士フイルム株式会社 Electronic endoscope system
US8717417B2 (en) * 2009-04-16 2014-05-06 Primesense Ltd. Three-dimensional mapping and imaging
US9749607B2 (en) * 2009-07-16 2017-08-29 Digimarc Corporation Coordinated illumination and image signal capture for enhanced signal detection
EP2448251B1 (en) 2010-10-31 2019-09-25 Mobileye Vision Technologies Ltd. Bundling night vision and other driver assistance systems (DAS) using near infra red (NIR) illumination and a rolling shutter

Also Published As

Publication number Publication date
EP3588939A1 (en) 2020-01-01
US9800779B2 (en) 2017-10-24
US10880471B2 (en) 2020-12-29
EP2448251B1 (en) 2019-09-25
US20180063423A1 (en) 2018-03-01
EP2448251A2 (en) 2012-05-02
US10129465B2 (en) 2018-11-13
US20120105639A1 (en) 2012-05-03
EP3588939B1 (en) 2023-10-18
US9179072B2 (en) 2015-11-03
US20160037064A1 (en) 2016-02-04
EP2448251A3 (en) 2015-10-28
US20190109987A1 (en) 2019-04-11

Similar Documents

Publication Publication Date Title
EP3588939C0 (en) Bundling night vision and other driver assistance systems (das) using near infra red (nir) illumination and a rolling shutter
EP2559937A4 (en) Illumination device and illumination system
EP2340455A4 (en) Camera and camera system
EP2630802A4 (en) Camera imaging systems and methods
EP2567534A4 (en) Image capture
EP2280306A4 (en) Camera system
EP2547175A4 (en) Illumination system
EP2290948A4 (en) Camera system
GB201212039D0 (en) Camera platform system
GB201000119D0 (en) A camera arrangement, camera system and method
EP2589216A4 (en) Camera module and method for driving the same
EP2499813A4 (en) Camera system
IL214631A0 (en) Ir camera system and method
PL2608944T3 (en) Extensible co-extrusion device
GB2488049B (en) Camera system
EP2591252A4 (en) Closed-loop transmission integration with forward and/or reverse assist system
EP2891009B8 (en) Vision system with video camera and system for reducing stresses
GB2481036B (en) A vehicle light and a vehicle including at least one vehicle light
EP2624404A4 (en) System connection device and system connection system
GB201011734D0 (en) Outdoor cctv camera system
GB201007249D0 (en) A camera device, arrangement and system
GB201000176D0 (en) Reflective display, sensor and camera
AU2009904188A0 (en) Video Camera System
AU2010904383A0 (en) Roof safety system
AU2009905613A0 (en) Visual surveillance system

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AC Divisional application: reference to earlier application

Ref document number: 2448251

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200630

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20210325

REG Reference to a national code

Ref document number: 602011074345

Country of ref document: DE

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: H04N0005235000

Ipc: G06V0020580000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 23/74 20230101ALI20230412BHEP

Ipc: G06V 20/56 20220101ALI20230412BHEP

Ipc: H04N 23/70 20230101ALI20230412BHEP

Ipc: H04N 5/33 20060101ALI20230412BHEP

Ipc: H04N 25/531 20230101ALI20230412BHEP

Ipc: H04N 23/80 20230101ALI20230412BHEP

Ipc: G06V 40/10 20220101ALI20230412BHEP

Ipc: G06V 20/58 20220101AFI20230412BHEP

INTG Intention to grant announced

Effective date: 20230511

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230705

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AC Divisional application: reference to earlier application

Ref document number: 2448251

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602011074345

Country of ref document: DE

P04 Withdrawal of opt-out of the competence of the unified patent court (upc) registered

Effective date: 20231120

U01 Request for unitary effect filed

Effective date: 20231117

U07 Unitary effect registered

Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT SE SI

Effective date: 20231123

U20 Renewal fee paid [unitary effect]

Year of fee payment: 13

Effective date: 20240122

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240218

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231018

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240218

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240119

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231018

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231018

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231018

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240118

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231018

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL