WO2011114814A1 - 車両姿勢角算出装置及びそれを用いた車線逸脱警報システム - Google Patents
車両姿勢角算出装置及びそれを用いた車線逸脱警報システム Download PDFInfo
- Publication number
- WO2011114814A1 WO2011114814A1 PCT/JP2011/052695 JP2011052695W WO2011114814A1 WO 2011114814 A1 WO2011114814 A1 WO 2011114814A1 JP 2011052695 W JP2011052695 W JP 2011052695W WO 2011114814 A1 WO2011114814 A1 WO 2011114814A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- vehicle
- lane
- distance
- calculated
- angle
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 claims abstract description 59
- 238000012545 processing Methods 0.000 claims abstract description 43
- 230000003287 optical effect Effects 0.000 claims abstract description 29
- 238000001514 detection method Methods 0.000 claims abstract description 27
- 238000012937 correction Methods 0.000 claims description 13
- 238000012935 Averaging Methods 0.000 claims description 12
- 238000005259 measurement Methods 0.000 claims description 3
- 238000005192 partition Methods 0.000 claims description 2
- 238000000034 method Methods 0.000 description 72
- 238000010586 diagram Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/10—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/10—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
- B60W40/114—Yaw movement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
- B60W2420/403—Image sensing, e.g. optical camera
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/14—Yaw
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Y—INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
- B60Y2400/00—Special features of vehicle units
- B60Y2400/30—Sensors
- B60Y2400/301—Sensors for position or displacement
- B60Y2400/3015—Optical cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
- G06T2207/30256—Lane; Road marking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Definitions
- the present invention relates to a method for calculating a posture angle of a vehicle with respect to a lane in which the vehicle is traveling using an in-vehicle camera.
- Various technologies for capturing the surroundings of a vehicle with an in-vehicle camera and recognizing objects (vehicles, pedestrians, etc.) and road markings / signs (road surface paint such as lane markings, signs such as stops) in the captured image Proposed For example, if an in-vehicle camera can recognize a marking line on the road and determine the position of the vehicle in the lane, it can alert the driver when the vehicle deviates from the lane, It is possible to suppress deviation by controlling.
- LDWS Lane Departure Warning Systems
- JIS D 0804 of JIS Japanese Industrial Standards
- Patent Document 1 a road vanishing point that is a point where two road parallel lines cross and disappear in a screen imaged by an in-vehicle camera is obtained, and the two road parallel lines and the road vanishing point are obtained.
- An apparatus for calculating a posture parameter (posture angle (yaw angle)) of a vehicle-mounted camera based on the above is disclosed.
- Patent Document 1 it is difficult to obtain the road vanishing point unless the running road is straight and flat, and even if the road vanishing point is obtained, the change in the vehicle pitch angle (change in the number of passengers) There is a problem that an error occurs in the vehicle yaw angle with respect to the lane because the relationship between the road vanishing point and the road parallel line changes due to, for example, fuel consumption).
- An object of the present invention is to provide a vehicle attitude angle calculation device capable of stably obtaining a yaw angle of a vehicle with respect to a lane without using road vanishing point information even in a situation where the vehicle pitch angle changes. is there.
- the present invention provides a lane line detection unit that detects a lane line from image information obtained by imaging the outside of a vehicle captured from an in-vehicle imaging device, and a distance between the lane line and the optical axis of the in-vehicle imaging device.
- a distance calculation unit that calculates every predetermined processing cycle, a distance between the calculated lane line and the optical axis of the in-vehicle imaging device, and a vehicle traveling distance that the vehicle has traveled during the predetermined processing cycle.
- a vehicle angle calculation unit that calculates an angle.
- a vehicle attitude angle calculation device that can stably obtain a yaw angle of a vehicle with respect to a lane without using road vanishing point information even under a situation where the vehicle pitch angle changes.
- FIG. 1 is a schematic diagram of a first embodiment of a vehicle attitude angle calculation device according to the present invention. It is a figure which shows the flowchart which shows the processing content of the vehicle attitude angle calculation apparatus which concerns on this invention. It is the schematic which shows the processing content of the lane marking detection part of this invention. It is the schematic which shows the processing content of the distance calculation part to the lane marking of this invention. It is a figure which shows the flowchart which shows the processing content of the division line angle calculation process of this invention. It is a figure which shows an example of the method of calculating the angle of the division line of this invention. It is the schematic of the lane departure warning system using the vehicle attitude angle calculation apparatus which concerns on this invention. It is the schematic explaining the distance correction
- FIG. 1 is a schematic diagram of a vehicle attitude angle calculation device 100 according to the first embodiment.
- the vehicle attitude angle calculation device 100 includes a lane line detection unit 3, a distance calculation unit 4, a distance storage unit 5, a lane line angle calculation unit 6, an angle storage unit 7, an angle change rate calculation unit 8, and a lane line error.
- the detection frequency measuring unit 9, the lane marking angle averaging unit 10, the vehicle yaw angle calculation unit 11, the yaw angle storage unit 12, and the yaw angle change rate calculation unit 13 are programmed into a computer (not shown) of the vehicle attitude angle calculation device 100. And repeatedly executed at a predetermined cycle.
- the vehicle attitude angle calculation device 100 inputs an image captured by the imaging device 1, inputs a vehicle speed detected by the vehicle speed detection unit 2, and outputs the yaw angle of the vehicle with respect to the lane to the outside. It has a configuration.
- the imaging device 1 captures the outside of the vehicle with an image sensor such as a CCD (Charge-Coupled Device) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor, and digitally processes the obtained image to convert it into image data that can be handled by a computer. To do.
- an image sensor such as a CCD (Charge-Coupled Device) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor
- the vehicle speed detection unit 2 detects the speed at which the vehicle travels.
- the vehicle speed detection unit 2 detects the vehicle speed by averaging the values obtained by the wheel speed sensors attached to the front, rear, left, and right wheels of the vehicle. There is a method of calculating the vehicle speed by integrating the acceleration value of the own vehicle obtained by the acceleration sensor.
- the lane line detection unit 3 is a lane line painted on the road using image data (image information) obtained by imaging the outside of the vehicle acquired by the in-vehicle imaging device 1 (a pair of left and right lines on the left and right sides of the vehicle) , Roadway outer line, etc.).
- the distance calculation unit 4 to the lane line calculates the distance (distance to the lane line) between the lane line detected by the lane line detection unit 3 and the optical axis of the imaging device 1. This calculation is performed a plurality of times at a predetermined processing cycle.
- the distance storage unit 5 stores a plurality of past distances to the lane line calculated by the distance calculation unit 4 to the lane line.
- the storage medium is generally RAM (Random Access Memory) inside the computer.
- the lane line angle calculation unit 6 includes an angle storage unit 7, an angle change rate calculation unit 8, and a lane line non-detection frequency measurement unit 9, and the distances to a plurality of past lane lines stored in the distance storage unit 5. And the detected vehicle speed (or the vehicle travel distance traveled by the vehicle during the calculation period determined from the vehicle speed) to calculate the angle of the lane marking.
- the angle storage unit 7 is a part that stores a plurality of past lane line angles calculated by the lane line angle calculation unit 6, and as a storage medium thereof, a RAM inside the computer is generally used like the distance storage unit 5. It is.
- the angle change rate calculation unit 8 calculates the angle change rate of the lane markings using the past lane line angles stored in the angle storage unit 7.
- the lane line non-detection frequency measurement unit 9 measures the number of times (distance detection counter) that the distance to the lane line cannot be calculated continuously in the distance calculation unit 4 to the lane line.
- the lane line angle calculation unit 6 When the lane line angle averaging unit 10 calculates distances to a plurality of lane lines in the lane line distance calculation unit 4, the lane line angle calculation unit 6 also calculates a plurality of lane line angles. Therefore, the angles of the plurality of lane markings are averaged. When the distance to the lane marking unit 4 calculates only the distance to one lane line per lane line, the lane line angle averaging unit 10 does not perform the averaging process, and the value is used as it is. Output.
- the vehicle yaw angle calculation unit 11 calculates the yaw angle of the vehicle with respect to the lane line based on the calculated lane line angle. Specifically, the angle of the lane line averaged by the lane line angle averaging unit 10 is converted into the yaw angle of the vehicle with respect to the lane. Also, the yaw angle of the current vehicle is predicted using the rate of change of the yaw angle of the vehicle.
- the yaw angle storage unit 12 is a part that stores a plurality of past vehicle yaw angles calculated by the vehicle yaw angle calculation unit 11.
- the storage medium is a computer similar to the distance storage unit 5 and the angle storage unit 7. Internal RAM is common.
- the yaw angle change rate calculation unit 13 calculates the change rate of the yaw angle of the vehicle using the yaw angles of a plurality of past vehicles stored in the yaw angle storage unit 12.
- the lane line angle calculation unit 6, the lane line angle averaging unit 10, and the vehicle yaw angle calculation unit 11 are vehicle angle calculation units, and the output of the vehicle angle calculation unit is the yaw angle of the vehicle.
- the lane line angle calculated by the lane line angle calculation unit 6 and the vehicle yaw angle calculated by the vehicle yaw angle calculation unit 11 may be the same.
- the angle of the lane marking is output from the vehicle angle calculation unit as it is as the yaw angle of the vehicle.
- FIG. 2 is a flowchart showing the processing contents of the vehicle attitude angle calculation device 100.
- an image captured by the imaging apparatus 1 is digitally processed and captured as image data.
- FIG. 3A shows the image data captured in the process 201, and there are two partition lines 301 and 302.
- FIG. 3 As a method for detecting the lane markings, there is a method for extracting the lane markings by calculating the edge strength in the image.
- the edge is a point where the luminance value changes abruptly in the image.
- FIG. 3 (b) shows the result of detecting edge strength from A to B in FIG. 3 (a).
- the peaks of 303 and 305 change from roads to lane markings (the luminance value changes suddenly from dark to bright).
- Each of the peaks 304 and 306 is a point where the lane mark changes from a road to a road (a point where the luminance value changes suddenly from light to dark). In this manner, the division line can be detected by finding the combination of 303 and 304 and the combination of 305 and 306.
- the distance between the lane line detected in process 202 and the optical axis of the imaging device 1 is calculated by the distance calculation unit 4 to the lane line.
- a specific method for calculating the distance to the lane marking will be described with reference to FIG. 4A is the image data captured in the process 201 as in FIG. 3A, and FIG. 4B is a plan view seen from the top in the same situation as FIG. 4A. is there.
- there are two lane markings 401 and 402 the arrow 403 is the optical axis of the imaging device 1
- 405 is the imaging device 1.
- the distance to the lane marking 402 is the distance from the optical axis 403 to the point A on the lane marking 402 as indicated by an arrow 404, and the coordinates of the point A on FIG. Then, the distance is calculated by converting to the actual coordinate system of FIG. Note that the distance to the lane line does not use the coordinates inside the lane line, but may use coordinates outside the lane line or the center of the lane line as long as they are consistently defined. Further, the distance to the lane marking may be calculated not for each lane marking in the image but for a plurality (for example, 10) for each lane marking.
- the distance to the lane line calculated in the process 203, the detected vehicle speed, and the vehicle travel distance traveled during the calculation cycle are stored in the RAM inside the computer by the distance storage unit 5.
- the processing results of a plurality of past times for example, the past 10 times
- each of the plurality is stored for a plurality of past times.
- the lane line angle calculation unit 6 calculates the angle of the lane line using the distances to the past plurality of lane lines stored in the process 204. Specific processing contents will be described with reference to the flowchart of FIG. In the case of the configuration in which the distances to a plurality of lane markings are calculated in the process 203, the angle of the lane marking is calculated for each of the plurality.
- the process 501 determines whether the distance to the latest lane line is valid among the distances to the plurality of past lane lines stored in the process 204, that is, whether the latest distance has been calculated. If the distance to the latest lane line is valid, the process proceeds to step 502. If the distance to the latest lane line is not valid, the process proceeds to step 506. Here, the distance to the latest lane line is valid when the distance to the lane line can be calculated in the process 203. If the type of the lane line is interrupted by a broken line or a dotted line, the distance to the lane line The distance may not be calculated.
- the process 502 whether or not the distance to the plurality of past lane lines stored in the process 204 is valid at least N out of M points (for example, 4 or more out of 8 points) counted from the latest value. That is, it is determined whether or not a plurality of distances can be calculated by a predetermined first predetermined value or more, and when N or more M points are valid (determined that a predetermined number or more can be calculated). If YES, the process proceeds to process 503. If N or more of M points are not valid, the process proceeds to process 506. M and N are determined in advance and stored in a storage device or the like.
- the angle of the lane marking is calculated using the effective value of the distance to the lane marking determined in processing 502.
- the regression line 601 is obtained from the past 6 points of information counted from the latest value of the distance to the lane line by the least square method, and the angle of the lane line is calculated.
- the horizontal axis of this graph is the position (the distance traveled by the vehicle during the calculation cycle), and is obtained from the vehicle speed and the calculation cycle.
- process 504 the angle of the lane marking calculated in process 503 is stored in the RAM inside the computer by the angle storage unit 7.
- process 505 the non-detection counter that is incremented when the distance to the lane line could not be calculated in process 203 is reset, and in process 512, the lane line calculated in process 503 to the previous angle ⁇ z of the lane line.
- the angle ⁇ is substituted, and a series of processing is completed.
- a non-detection counter that is incremented when the distance to the lane marking cannot be calculated in process 203 is incremented.
- process 507 it is determined whether or not the non-detection counter is 1. If the non-detection counter is 1, the process proceeds to process 508. If the non-detection counter is not 1, the process proceeds to process 510.
- step 508 whether or not the points of the past plurality of plot lines stored in the process 504 are effective from the latest value to Q points of P points (for example, 3 points of 6 points or more). That is, it is determined whether or not the angle of a plurality of lane markings calculated in the past can be calculated by a predetermined number or more, and when it is effective for Q points or more out of P points (a predetermined second predetermined value or more, If it is determined that the calculation can be performed), the process proceeds to step 509, and if not more than Q points out of the P points, the process proceeds to step 511.
- P and Q are determined in advance and stored in a storage device or the like.
- the lane marking angle change rate (the value obtained by differentiating the lane marking angle by the distance traveled by the vehicle during the calculation cycle) is calculated using the effective value of the lane marking angle determined in processing 508. Specifically, as in the method described with reference to FIG. 6, the vertical axis is replaced with the angle of the lane marking, and a regression line is obtained by the least square method or the like to calculate the angle change rate of the lane marking.
- the angle change rate of the lane marking is set to zero.
- the difference between the processing 509 and the processing 511 is determined by the number of effective values of the lane marking angles determined in the processing 508, and a predetermined number or more (for example, 3 points) is calculated in calculating the lane marking angle change rate. This is because the reliability of the calculation result of the angle change rate of the lane marking is low if the angle of the lane marking of (above) is not present.
- the angle of the lane marking is predicted using the lane marking angle change rate calculated in process 509 or 511.
- the lane line angle ⁇ can be calculated by the following equation (1) using the lane line previous value ⁇ z described later, the lane line angle change rate ⁇ , and the calculation cycle ⁇ t.
- processing 206 when the angles of a plurality of lane markings are calculated in processing 205, the angles of the plurality of lane markings are averaged by the lane marking angle averaging unit 10.
- this specific method include (b) an arithmetic average, (b) a weighted average based on the distance resolution of the imaging device, and (c) a weighted average based on the freshness of information, and these may be combined. .
- (a) to (c) will be specifically described.
- B Weighted average based on distance resolution of imaging device
- the distance resolution decreases as the distance from the imaging device on the image increases. For example, when four lane marking angles ⁇ 1, ⁇ 2, ⁇ 3, and ⁇ 4 are calculated and the horizontal distance resolution of each calculated location is 1 cm, 2 cm, 3 cm, and 4 cm, the reciprocal (1 , 1/2, 1/3, 1/4) as weights, the average value of the lane line angle ⁇ ave is calculated as in equation (3).
- the vehicle yaw angle with respect to the lane is calculated by the vehicle yaw angle calculation unit 11 using the angle of the lane marking calculated in processing 206, and the series of processing ends.
- the vehicle While the vehicle is traveling in the road lane, two lane lines are detected by the process 202, and the angle of the two lane lines is calculated by the process 206. Therefore, the angle of the two lane lines is used.
- the yaw angle of the vehicle with respect to the lane Basically, the yaw angle of the vehicle is calculated by averaging the angles of the two lane markings, but the angles of the two lane markings may be weighted and averaged.
- the angle of the lane marking is the vehicle yaw angle.
- the past line information is used to calculate the angle of the lane marking, so that there may be a time delay in the yaw angle of the vehicle. Therefore, the yaw angle storage unit 12 stores the yaw angle of the vehicle retroactively, and the yaw angle change rate calculation unit 13 calculates the yaw angle change rate of the vehicle using the stored yaw angles of the plurality of past vehicles. There is also a method for predicting a future value by the delay time using the yaw angle change rate of the vehicle. Thereby, it becomes possible to eliminate the delay time caused by using past information.
- the yaw angle of the vehicle with respect to the lane can be calculated from the relative distance change, so that even when the vehicle pitch angle changes, it is stable.
- the yaw angle of the vehicle with respect to the lane can be obtained.
- the yaw angle of the vehicle with respect to the lane can be obtained more stably.
- FIG. 7 is a schematic diagram of a lane departure warning system when the output of the vehicle attitude angle calculation device 100 according to the first embodiment is applied to the lane departure warning device 700. Note that the imaging direction of the imaging apparatus 1 in the present embodiment is the rear of the vehicle.
- the lane departure warning device 700 is constituted by a lane departure distance correction unit 701 and a lane departure warning generation unit 702, programmed in a computer (not shown) of the lane departure warning device 700, and repeatedly executed at a predetermined cycle.
- the lane departure warning here is assumed to correspond to the JIS standard (JIS D 0804). That is, the lane departure warning device 700 needs to generate a lane departure warning based on the yaw angle of the vehicle input from the vehicle attitude angle calculation device 100 and the distance between the lane marking and the optical axis of the in-vehicle imaging device. Determine no.
- the distance correction unit 701 to the lane line inputs the vehicle yaw angle calculated by the vehicle attitude angle calculation device 100 and the distance to the lane line, and corrects the distance to the lane line.
- the distance to the lane marking detected from the image behind the vehicle captured by the imaging device 1 Needs to be corrected to the distance from the outside of the vehicle front wheel to the lane marking. Specifically, this will be described with reference to FIG.
- FIG. 8 assumes a case where the vehicle 801 is traveling on a road where two lane markings 802 and 803 exist.
- the lane departure warning generation unit 702 notifies the occupant when the vehicle departs from the lane (or is likely to deviate) using the distances D1 and D2 to the left and right lane lines corrected by the lane line distance correction unit 701. An alarm is generated. In other words, if either the distance from the outside of the front wheel of the vehicle to the left lane or the distance from the outside of the front wheel of the vehicle to the right lane is less than a predetermined distance, a flag for generating a lane departure warning is set. .
- the alarm method may be a sound from a speaker or a method of displaying on a display.
- an alarm is generated when the distance D1 or D2 to the corrected lane marking is within a predetermined range (for example, within 5 cm).
- a predetermined range for example, within 5 cm.
- a predetermined time for example, after 2 seconds
- FIG. 9 assumes a case in which the vehicle 900 returns to the left lane again after the vehicle 900 is about to deviate to the right lane along the locus indicated by the dotted line 901 while traveling on the left lane on the one-lane two-lane road.
- the road boundary lane marking is a solid line
- the lane boundary lane marking is painted with a broken line.
- the distance to the left lane marking of the vehicle is d1
- the distance to the right lane marking is d2
- the distance to the lane marking on the left side of the vehicle after correction is D1
- the distance to the lane marking on the right side of the vehicle after correction is D2.
- the imaging device mounted on the vehicle images the rear of the vehicle.
- distances d1 and d2 to the lane markings are calculated as a solid line 911 and a dotted line 912, respectively.
- the values of the distance d2 to the lane marking of the dotted line 912 is indefinite.
- the lane line angle ⁇ 1 (the angle of the lane line on the left side of the vehicle) and ⁇ 2 (the angle of the lane line on the right side of the vehicle) are a solid line 913 and a dotted line using time series data of distances d1 and d2 to the lane line, respectively. 914 is calculated.
- the lane line angle ⁇ 1 is calculated by using the distances d1 to a plurality of past lane lines stored in advance because the distance d1 to the lane line can be calculated continuously.
- the distance d2 to the lane line is a discontinuous value, and thus the angle change rate of the lane line in the section where the distance to the lane line can be calculated continuously is calculated.
- the angle of the lane marking in the section where the distance to the lane marking cannot be calculated is predicted. For this reason, an error may accumulate in the angle of the lane marking in the section where the distance to the lane marking cannot be calculated, and the value may jump in the portion surrounded by 915.
- the yaw angle of the vehicle is calculated as indicated by a solid line 916 using the divergence line angles ⁇ 1 and ⁇ 2.
- the vehicle yaw angle is calculated by averaging the lane line angle ⁇ 2 and the lane line angle ⁇ 2 that are reversed. Similar to the portion surrounded by 915, an error may occur in the angle of the lane line in a section where the distance to the lane line cannot be calculated. Therefore, the value may jump as in the portion surrounded by 917.
- the corrected distances D1 and D2 to the lane line are expressed by solid lines 918 and 919 in the equations (5) and (6) using the distances d1 and d2 to the lane line and the vehicle yaw angle, respectively. calculate.
- the lane departure warning flag is set to 1 (ON) when the distance D1 or D2 to the lane line after correction becomes a predetermined value or less.
- the lane departure warning flag is turned ON and turned OFF (set to 0) after a predetermined time. This is because it is only necessary to turn on the lane departure warning flag for a time during which the driver recognizes the warning (for example, for 2 seconds). Even if the distance D2 to the lane line after correction is less than a predetermined value when turning off, Turns off (because the driver feels bothersome if the alarm continues).
- a change in a series of values of the lane departure warning flag is as shown by a solid line 920.
- a lane line is detected from an image obtained by imaging the rear of the vehicle, a vehicle yaw angle is calculated, a distance to the lane line is corrected using the calculated vehicle yaw angle, and a lane departure warning flag is set. It becomes possible.
- an imaging device that images the front of the vehicle may be used, and the mounting angle and mounting position of the imaging device are different from the present embodiment. Also good.
- the least square method is used as the method for calculating the angle of the lane marking.
- a method other than the least square method may be used.
- the distance to the lane line calculated by the imaging device is corrected to the distance from the outside of the front wheel of the vehicle to the lane line, but is corrected to the distance from the corner in front of the vehicle to the lane line.
- the distance to the lane marking at an arbitrary place may be corrected.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Mechanical Engineering (AREA)
- Automation & Control Theory (AREA)
- Mathematical Physics (AREA)
- Transportation (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Traffic Control Systems (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
Description
301,302,401,402,802,803 区画線
303~306 エッジ強度のピーク
403 撮像装置の光軸
404 区画線までの距離
405,804 撮像装置
801,900 車両
901 走行軌跡
φ=φz+α×Δt (1)
最後に、処理512において、区画線の角度前回値φzに処理510で計算した区画線の角度φを代入し、一連の処理を終了する。
例えば、区画線の角度がφ1,φ2,φ3,φ4の4個算出された場合は、区画線角度の平均値φaveは(2)式で計算できる。
φave=(φ1+φ2+φ3+φ4)÷4 (2)
(ロ)撮像装置の距離分解能に基づいた重み付け平均
撮像装置の特性として、画像上で撮像装置から遠くなればなるほど距離分解能が低下する。例えば、区画線の角度がφ1,φ2,φ3,φ4の4個算出された場合、それぞれが算出された場所の水平方向の距離分解能が1cm,2cm,3cm,4cmであれば、その逆数(1,1/2,1/3,1/4)を重みとして区画線角度の平均値φaveを(3)式のように計算する。
φave=(1×φ1+1/2×φ2+1/3×φ3+1/4×φ4)÷(1+1/2+1/3+1/4) (3)
(ハ)情報の鮮度に基づいた重み付け平均
処理501および処理502の判定結果がNOの場合は区画線角度の変化率を用いて現在の区画線の角度を予測するが、処理506によりインクリメントされる不検知カウンタが大きくなればなるほど予測による誤差が蓄積する。つまり、不検知カウンタが大きいほど情報の鮮度が落ちることになるため、不検知カウンタの値に基づいた重み付け平均が有効である。例えば、区画線の角度がφ1,φ2,φ3,φ4の4個算出された場合、それぞれの不検知カウンタが0,1,2,3であれば、所定の値(例えば20)から不検知カウンタの値を引いた数(20,19,18,17)を重みとして区画線角度の平均値φaveを(4)式のように計算する。ただし、重みが1以下になる場合は1に置き換える。
φave=(20×φ1+19×φ2+18×φ3+17×φ4)÷(20+19+18+17) (4)
また、(ロ)と(ハ)を組み合わせる場合は、それぞれ求めた重みを掛け合わせて平均してもよいし、個別に求めた後に相加平均してもよい。
D1=d1-L×tanθ-C1 (5)
同様に、車両の後方に設置された撮像装置804で算出された右区画線までの距離d2を車両右前輪の外側から右区画線までの距離D2(補正後の区画線までの距離)に補正するためには、右区画線までの距離d2が算出された地点から車両前輪までの距離L、撮像装置804から車両右前輪の外側までの距離C2、および車両ヨー角θを用いると(6)式で計算できる。
D2=d2+L×tanθ-C2 (6)
車線逸脱警報発生部702は、区画線までの距離補正部701で補正された左右の区画線までの距離D1,D2を用いて車両が車線を逸脱する(もしくは、逸脱しそうな)場合に乗員に対して警報を発生する。つまり、車両前輪の外側から左車線までの距離と、車両前輪の外側から右車線までの距離の、どちらか一方が予め定めた距離以下となった場合は、車線逸脱警報を発生するフラグを立てる。なお、警報の方法としては、スピーカーからの音声でもよいし、ディスプレイに表示する方式でもよい。具体的な一手法としては、補正後の区画線までの距離D1またはD2が所定の範囲内(例えば、5cm以内)になった場合に警報を発生する。なお、警報を解除するタイミングは警報を発生して所定時間経過後(例えば、2秒後)とする方法がある。
Claims (17)
- 車載用撮像装置から取り込んだ車外を撮像した画像情報から区画線を検出する区画線検出部と、
前記区画線と前記車載用撮像装置の光軸間の距離を所定の処理周期毎に算出する距離算出部と、
算出された前記区画線と前記車載用撮像装置の光軸間の距離と所定の処理周期の間に車両が進行した車両進行距離に基づいて区画線の角度を算出する車両角度算出部と、を有する車両姿勢角算出装置。 - 請求項1記載の車両姿勢角算出装置において、
前記車両角度算出部は、算出された前記区画線と前記車載用撮像装置の光軸間の距離と所定の処理周期の間に車両が進行した車両進行距離に基づいて区画線の角度を算出する区画線角度算出部と、算出された区画線の角度に基づいて区画線に対する車両のヨー角を算出する車両ヨー角算出部と、を有する車両姿勢角算出装置。 - 請求項1記載の車両姿勢角算出装置において、
前記距離算出部で算出された距離を記憶する距離記憶部を有し、
前記車両角度算出部は、前記距離記憶部から複数の距離を取り込み、前記複数の距離と前記車両進行距離に基づいて区画線の角度を算出する車両姿勢角算出装置。 - 請求項2記載の車両姿勢角算出装置において、
前記区画線角度算出部は、
前記区画線角度算出部で算出された過去の区画線の角度が記憶された角度記憶部と、
前記角度記憶部に記憶された複数の区画線の角度に基づいて区画線の角度変化率を算出する角度変化率算出部と、を有する車両姿勢角算出装置。 - 請求項1記載の車両姿勢角算出装置において、
前記車両角度算出部は、前記距離算出部で前記区画線と前記車載用撮像装置の光軸間の距離が連続して算出できなかった回数を計測する区画線不検知回数計測部を有する車両姿勢角算出装置。 - 請求項1記載の車両姿勢角算出装置において、
前記車両角度算出部で算出された複数の区画線の角度を平均する区画線角度平均化部を有する車両姿勢角算出装置。 - 請求項2記載の車両姿勢角算出装置において、
前記車両ヨー角算出部は、
車両ヨー角算出部で算出された過去の複数のヨー角を記憶するヨー角記憶部と、
前記ヨー角記憶部で記憶された複数のヨー角から車両のヨー角の変化率を算出するヨー角変化率算出部と、を有する車両姿勢角算出装置。 - 請求項2記載の車両姿勢角算出装置において、
前記区画線角度算出部は、
前記距離算出部にて算出された前記区画線と前記車載用撮像装置の光軸間の最新の距離が算出できているか否かを判定し、
最新の距離が算出できていると判定された場合、前記距離算出部にて算出された前記区画線と前記車載用撮像装置の光軸間の複数の距離が予め定めた第1の所定値以上、算出できているか否かを判定し、
前記第1の所定値以上、算出できていると判定された場合、算出できている複数の距離から区画線の角度を算出する、車両姿勢角算出装置。 - 請求項8記載の車両姿勢角算出装置において、
前記区画線角度算出部は、
前記距離算出部にて算出された前記区画線と前記車載用撮像装置の光軸間の最新の距離が算出できていないと判定された場合、又は、前記距離算出部にて算出された前記区画線と前記車載用撮像装置の光軸間の複数の距離が前記第1の所定値以上、算出できていないと判定された場合、過去に算出された複数の区画線の角度が予め定めた第2の所定値以上、算出できているか否かを判定し、
過去に算出された複数の区画線の角度が前記第2の所定値以上、算出できていると判定された場合、算出できている複数の区画線の角度から区画線の角度変化率を算出し、
算出された区画線の角度変化率から区画線の角度を予測する、車両姿勢角算出装置。 - 請求項1記載の車両姿勢角算出装置において、
前記区画線は、自車の左右にある一対の左右線であり、
前記区画線と前記車載用撮像装置の光軸間の距離は、前記左線と前記車載用撮像装置の光軸間の距離と、前記右線と前記車載用撮像装置の光軸間の距離を含む車両姿勢角算出装置。 - 車載用撮像装置から取り込んだ車外を撮像した画像情報から区画線を検出する区画線検出部と、前記区画線と前記車載用撮像装置の光軸間の距離を所定の処理周期毎に算出する距離算出部と、算出された前記区画線と前記車載用撮像装置の光軸間の距離と所定の処理周期の間に車両が進行した車両進行距離に基づいて区画線の角度を算出する車両角度算出部と、を有する車両姿勢角算出装置と、
前記車両姿勢角算出装置から入力された前記区画線の角度と、前記区画線と前記車載用撮像装置の光軸間の前記距離と、に基づいて車線逸脱の警報の発生の要否を判断する車線逸脱警報装置と、を有する車線逸脱警報システム。 - 請求項11記載の車線逸脱警報システムにおいて、
前記車両姿勢角算出装置の前記車両角度算出部は、算出された前記区画線と前記車載用撮像装置の光軸間の距離と所定の処理周期の間に車両が進行した車両進行距離に基づいて区画線の角度を算出する区画線角度算出部と、算出された区画線の角度に基づいて区画線に対する車両のヨー角を算出する車両ヨー角算出部と、を有し、
前記車線逸脱警報装置は、前記車両姿勢角算出装置から入力された前記車両のヨー角と、前記区画線と前記車載用撮像装置の光軸間の前記距離と、に基づいて車線逸脱の警報の発生の要否を判断する車線逸脱警報システム。 - 請求項12記載の車線逸脱警報システムにおいて、
前記車線逸脱警報装置は、
前記区画線と前記車載用撮像装置の光軸間の前記距離を前記車両のヨー角に基づいて、車両前輪の外側から区画線までの距離に補正する区画線までの距離補正部と、
補正された前記区画線までの距離に基づいて車線逸脱の警報の発生の要否を判断する車線逸脱警報発生部と、を有する車線逸脱警報システム。 - 請求項13記載の車線逸脱警報システムにおいて、
前記区画線までの距離補正部で補正する前記車両前輪の外側から区画線までの距離は、前記区画線と前記車載用撮像装置の光軸間の前記距離と、前記車両のヨー角と、前記区画線と前記車載用撮像装置の光軸間の前記距離が算出された地点から車両前輪までの距離と、前記車載用撮像装置から車両前輪の外側までの距離と、から算出される車線逸脱警報システム。 - 請求項13記載の車線逸脱警報システムにおいて、
前記区画線は、自車の左右にある一対の左右線であり、
前記車両前輪の外側から区画線までの距離は、左の前記車両前輪の外側から前記左線までの距離と、右の前記車両前輪の外側から前記右線までの距離を含む車線逸脱警報システム。 - 請求項15記載の車線逸脱警報システムにおいて、
前記車線逸脱警報発生部は、前記車両前輪の外側から前記左線までの距離と、前記車両前輪の外側から前記右線までの距離の、どちらか一方が予め定めた距離以下となった場合は、車線逸脱警報を発生する車線逸脱警報システム。 - 請求項11記載の車線逸脱警報システムにおいて、
前記車載用撮像装置から取り込んだ前記画像情報は、車両後方の画像情報である車線逸脱警報システム。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201180008700.XA CN102754139B (zh) | 2010-03-17 | 2011-02-09 | 车辆姿态角算出装置及使用了该装置的车道偏离警报*** |
US13/522,985 US9123110B2 (en) | 2010-03-17 | 2011-02-09 | Vehicle attitude angle calculating device, and lane departure warning system using same |
EP11756004.5A EP2549458B1 (en) | 2010-03-17 | 2011-02-09 | Vehicle orientation angle calculating device, and lane deviation warning system using same |
US14/806,379 US9393966B2 (en) | 2010-03-17 | 2015-07-22 | Vehicle attitude angle calculating device, and lane departure warning system using same |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010-060106 | 2010-03-17 | ||
JP2010060106A JP5350297B2 (ja) | 2010-03-17 | 2010-03-17 | 車両姿勢角算出装置及びそれを用いた車線逸脱警報システム |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/522,985 A-371-Of-International US9123110B2 (en) | 2010-03-17 | 2011-02-09 | Vehicle attitude angle calculating device, and lane departure warning system using same |
US14/806,379 Continuation US9393966B2 (en) | 2010-03-17 | 2015-07-22 | Vehicle attitude angle calculating device, and lane departure warning system using same |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011114814A1 true WO2011114814A1 (ja) | 2011-09-22 |
Family
ID=44648921
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2011/052695 WO2011114814A1 (ja) | 2010-03-17 | 2011-02-09 | 車両姿勢角算出装置及びそれを用いた車線逸脱警報システム |
Country Status (5)
Country | Link |
---|---|
US (2) | US9123110B2 (ja) |
EP (1) | EP2549458B1 (ja) |
JP (1) | JP5350297B2 (ja) |
CN (1) | CN102754139B (ja) |
WO (1) | WO2011114814A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112020461A (zh) * | 2018-04-27 | 2020-12-01 | 图森有限公司 | 用于确定汽车到车道距离的***和方法 |
Families Citing this family (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102549631B (zh) * | 2009-09-30 | 2014-11-12 | 松下电器产业株式会社 | 车辆周围监视装置 |
JP5389864B2 (ja) * | 2011-06-17 | 2014-01-15 | クラリオン株式会社 | 車線逸脱警報装置 |
CN103164851B (zh) * | 2011-12-09 | 2016-04-20 | 株式会社理光 | 道路分割物检测方法和装置 |
JP6035904B2 (ja) * | 2012-06-29 | 2016-11-30 | 株式会社デンソー | 電子機器 |
JP6035064B2 (ja) * | 2012-07-03 | 2016-11-30 | クラリオン株式会社 | 車線逸脱判定装置,車線逸脱警報装置及びそれらを使った車両制御システム |
KR101502511B1 (ko) * | 2013-11-28 | 2015-03-13 | 현대모비스 주식회사 | 가상 차선 생성 장치와 방법 및 상기 장치를 구비하는 차선 유지 제어 시스템 |
JP6260233B2 (ja) * | 2013-12-02 | 2018-01-17 | 富士通株式会社 | 情報処理装置、カメラ取付角度の推定方法、及びプログラム |
JP5874770B2 (ja) * | 2014-03-12 | 2016-03-02 | トヨタ自動車株式会社 | 区画線検出システム |
JP6421547B2 (ja) * | 2014-10-22 | 2018-11-14 | いすゞ自動車株式会社 | 警報装置 |
JP6456682B2 (ja) * | 2014-12-25 | 2019-01-23 | 株式会社Soken | 走行区画線認識装置 |
FR3033912B1 (fr) * | 2015-03-18 | 2018-06-15 | Valeo Schalter Und Sensoren Gmbh | Procede d'estimation de parametres geometriques representatifs de la forme d'une route, systeme d'estimation de tels parametres et vehicule automobile equipe d'un tel systeme |
FR3036180B1 (fr) * | 2015-05-11 | 2018-08-10 | Valeo Schalter Und Sensoren Gmbh | Procede de determination de l'assiette d'un vehicule automobile. |
JP6547452B2 (ja) * | 2015-06-29 | 2019-07-24 | 株式会社デンソー | 車線逸脱回避装置 |
TWI609807B (zh) * | 2016-05-17 | 2018-01-01 | 緯創資通股份有限公司 | 影像評估方法以及其電子裝置 |
JP6500844B2 (ja) | 2016-06-10 | 2019-04-17 | 株式会社デンソー | 車両位置姿勢算出装置及び車両位置姿勢算出プログラム |
KR20180061686A (ko) | 2016-11-30 | 2018-06-08 | 삼성전자주식회사 | 자율 주행 경로 생성 방법 및 그 장치 |
JP2018116369A (ja) * | 2017-01-16 | 2018-07-26 | 株式会社Soken | 車線認識装置 |
JP6834657B2 (ja) * | 2017-03-23 | 2021-02-24 | いすゞ自動車株式会社 | 車線逸脱警報装置の制御装置、車両および車線逸脱警報制御方法 |
CN106910358B (zh) * | 2017-04-21 | 2019-09-06 | 百度在线网络技术(北京)有限公司 | 用于无人车的姿态确定方法和装置 |
JP6663406B2 (ja) * | 2017-10-05 | 2020-03-11 | 本田技研工業株式会社 | 車両制御装置、車両制御方法、およびプログラム |
KR102552490B1 (ko) * | 2018-01-03 | 2023-07-06 | 현대자동차주식회사 | 차량용 영상 처리 장치 및 방법 |
KR102034316B1 (ko) * | 2019-01-29 | 2019-11-08 | 주식회사 만도 | 차량 위치 보정 시스템 및 방법, 그리고 카메라 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07147000A (ja) | 1993-11-25 | 1995-06-06 | Sumitomo Electric Ind Ltd | 車載カメラの姿勢パラメータ算出装置 |
JPH07198349A (ja) * | 1993-12-29 | 1995-08-01 | Nissan Motor Co Ltd | 道路形状及び自車両姿勢の計測装置 |
JP2001175999A (ja) * | 1999-12-17 | 2001-06-29 | Mitsubishi Motors Corp | 車線逸脱抑制装置 |
JP2001266163A (ja) * | 2000-03-17 | 2001-09-28 | Nissan Motor Co Ltd | 車両用画像処理装置 |
JP2002117391A (ja) * | 2000-10-06 | 2002-04-19 | Nissan Motor Co Ltd | 車両用前方画像撮像装置 |
JP2005346383A (ja) * | 2004-06-02 | 2005-12-15 | Toyota Motor Corp | 境界線検出装置 |
JP2008033807A (ja) * | 2006-07-31 | 2008-02-14 | Nissan Motor Co Ltd | 車線逸脱防止装置 |
JP2008087726A (ja) * | 2006-10-05 | 2008-04-17 | Xanavi Informatics Corp | 車両の走行制御システム |
JP2009181310A (ja) * | 2008-01-30 | 2009-08-13 | Toyota Central R&D Labs Inc | 道路パラメータ推定装置 |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5638116A (en) | 1993-09-08 | 1997-06-10 | Sumitomo Electric Industries, Ltd. | Object recognition apparatus and method |
DE19680415C2 (de) * | 1995-04-26 | 2003-02-06 | Hitachi Ltd | Bildbearbeitungsvorrichtung für Fahrzeuge |
JP3733875B2 (ja) * | 2000-09-29 | 2006-01-11 | 日産自動車株式会社 | 道路白線認識装置 |
KR100435650B1 (ko) * | 2001-05-25 | 2004-06-30 | 현대자동차주식회사 | 카메라가 장착된 차량의 도로정보 추출 및 차간거리 탐지방법 |
TWI246665B (en) * | 2001-07-12 | 2006-01-01 | Ding-Jang Tzeng | Method for aiding the driving safety of road vehicle by monocular computer vision |
JP4016735B2 (ja) * | 2001-11-30 | 2007-12-05 | 株式会社日立製作所 | レーンマーク認識方法 |
JP4374211B2 (ja) * | 2002-08-27 | 2009-12-02 | クラリオン株式会社 | レーンマーカー位置検出方法及びレーンマーカー位置検出装置並びに車線逸脱警報装置 |
JP3922194B2 (ja) * | 2003-03-11 | 2007-05-30 | 日産自動車株式会社 | 車線逸脱警報装置 |
JP3722487B1 (ja) * | 2004-05-19 | 2005-11-30 | 本田技研工業株式会社 | 車両用走行区分線認識装置 |
US7415134B2 (en) * | 2005-05-17 | 2008-08-19 | Honda Motor Co., Ltd. | Traffic lane marking line recognition system for vehicle |
JP4822766B2 (ja) * | 2005-08-18 | 2011-11-24 | 富士通株式会社 | 路面標示認識装置及びシステム |
US7561032B2 (en) * | 2005-09-26 | 2009-07-14 | Gm Global Technology Operations, Inc. | Selectable lane-departure warning system and method |
US8462988B2 (en) * | 2007-01-23 | 2013-06-11 | Valeo Schalter Und Sensoren Gmbh | Method and system for universal lane boundary detection |
KR100941271B1 (ko) * | 2007-03-30 | 2010-02-11 | 현대자동차주식회사 | 자동차용 차선이탈 방지 방법 |
US8855848B2 (en) * | 2007-06-05 | 2014-10-07 | GM Global Technology Operations LLC | Radar, lidar and camera enhanced methods for vehicle dynamics estimation |
EP2195688B1 (en) * | 2007-08-30 | 2018-10-03 | Valeo Schalter und Sensoren GmbH | Method and system for weather condition detection with image-based road characterization |
US20110115912A1 (en) * | 2007-08-31 | 2011-05-19 | Valeo Schalter Und Sensoren Gmbh | Method and system for online calibration of a video system |
JP4710981B2 (ja) * | 2009-01-23 | 2011-06-29 | トヨタ自動車株式会社 | 区画線認識装置、及び当該装置で用いられる区画線認識方法 |
DE112009005401B4 (de) * | 2009-11-27 | 2021-01-28 | Toyota Jidosha Kabushiki Kaisha | Fahrunterstützungsvorrichtung und fahrunterstützungsverfahren |
-
2010
- 2010-03-17 JP JP2010060106A patent/JP5350297B2/ja active Active
-
2011
- 2011-02-09 EP EP11756004.5A patent/EP2549458B1/en active Active
- 2011-02-09 WO PCT/JP2011/052695 patent/WO2011114814A1/ja active Application Filing
- 2011-02-09 CN CN201180008700.XA patent/CN102754139B/zh active Active
- 2011-02-09 US US13/522,985 patent/US9123110B2/en active Active
-
2015
- 2015-07-22 US US14/806,379 patent/US9393966B2/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07147000A (ja) | 1993-11-25 | 1995-06-06 | Sumitomo Electric Ind Ltd | 車載カメラの姿勢パラメータ算出装置 |
JPH07198349A (ja) * | 1993-12-29 | 1995-08-01 | Nissan Motor Co Ltd | 道路形状及び自車両姿勢の計測装置 |
JP2001175999A (ja) * | 1999-12-17 | 2001-06-29 | Mitsubishi Motors Corp | 車線逸脱抑制装置 |
JP2001266163A (ja) * | 2000-03-17 | 2001-09-28 | Nissan Motor Co Ltd | 車両用画像処理装置 |
JP2002117391A (ja) * | 2000-10-06 | 2002-04-19 | Nissan Motor Co Ltd | 車両用前方画像撮像装置 |
JP2005346383A (ja) * | 2004-06-02 | 2005-12-15 | Toyota Motor Corp | 境界線検出装置 |
JP2008033807A (ja) * | 2006-07-31 | 2008-02-14 | Nissan Motor Co Ltd | 車線逸脱防止装置 |
JP2008087726A (ja) * | 2006-10-05 | 2008-04-17 | Xanavi Informatics Corp | 車両の走行制御システム |
JP2009181310A (ja) * | 2008-01-30 | 2009-08-13 | Toyota Central R&D Labs Inc | 道路パラメータ推定装置 |
Non-Patent Citations (1)
Title |
---|
See also references of EP2549458A4 |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112020461A (zh) * | 2018-04-27 | 2020-12-01 | 图森有限公司 | 用于确定汽车到车道距离的***和方法 |
US11727811B2 (en) | 2018-04-27 | 2023-08-15 | Tusimple, Inc. | System and method for determining car to lane distance |
CN112020461B (zh) * | 2018-04-27 | 2024-02-27 | 图森有限公司 | 用于确定汽车到车道距离的***和方法 |
Also Published As
Publication number | Publication date |
---|---|
US9393966B2 (en) | 2016-07-19 |
EP2549458A4 (en) | 2014-01-15 |
US9123110B2 (en) | 2015-09-01 |
EP2549458A1 (en) | 2013-01-23 |
US20150375755A1 (en) | 2015-12-31 |
US20120327233A1 (en) | 2012-12-27 |
CN102754139A (zh) | 2012-10-24 |
CN102754139B (zh) | 2014-12-31 |
EP2549458B1 (en) | 2016-08-10 |
JP2011192227A (ja) | 2011-09-29 |
JP5350297B2 (ja) | 2013-11-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5350297B2 (ja) | 車両姿勢角算出装置及びそれを用いた車線逸脱警報システム | |
JP6035064B2 (ja) | 車線逸脱判定装置,車線逸脱警報装置及びそれらを使った車両制御システム | |
JP5281664B2 (ja) | 車線逸脱警報装置および車線逸脱警報システム | |
US9280824B2 (en) | Vehicle-surroundings monitoring device | |
US8682500B2 (en) | Driving assistance apparatus | |
JP5939357B2 (ja) | 移動軌跡予測装置及び移動軌跡予測方法 | |
EP2682897B1 (en) | Lane departure warning system | |
EP3161507B1 (en) | Method for tracking a target vehicle approaching a motor vehicle by means of a camera system of the motor vehicle, camera system and motor vehicle | |
US20140044311A1 (en) | Neighboring vehicle detecting apparatus | |
JP6278222B2 (ja) | 車両用表示装置及び車両用表示方法 | |
US20150070158A1 (en) | Alert display device and alert display method | |
JP4962581B2 (ja) | 区画線検出装置 | |
JP2013003913A (ja) | 車線逸脱警報装置 | |
WO2014129312A1 (ja) | 車線境界線逸脱抑制装置 | |
JP2011118482A (ja) | 車載装置および認知支援システム | |
JP6011625B2 (ja) | 速度算出装置及び速度算出方法並びに衝突判定装置 | |
JP2018081363A (ja) | 運転支援装置 | |
JP5561469B2 (ja) | ヨーレート補正装置、及びその方法 | |
JP5625094B2 (ja) | 車両姿勢角算出装置 | |
JP2015154337A (ja) | 対象範囲設定装置、および対象範囲設定プログラム | |
WO2019139084A1 (ja) | 通知装置及び車載機 | |
US11433810B2 (en) | Image processing apparatus, camera, moveable body, and image processing method | |
CN116118727B (zh) | 一种车道偏离预警方法、装置、设备及存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201180008700.X Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11756004 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13522985 Country of ref document: US |
|
REEP | Request for entry into the european phase |
Ref document number: 2011756004 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011756004 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |