EP1674375A1 - Method for determining a measure for evaluating the behaviour of a driver of a vehicle - Google Patents
Method for determining a measure for evaluating the behaviour of a driver of a vehicle Download PDFInfo
- Publication number
- EP1674375A1 EP1674375A1 EP04030208A EP04030208A EP1674375A1 EP 1674375 A1 EP1674375 A1 EP 1674375A1 EP 04030208 A EP04030208 A EP 04030208A EP 04030208 A EP04030208 A EP 04030208A EP 1674375 A1 EP1674375 A1 EP 1674375A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- vehicle
- planned
- driver
- instant
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
Definitions
- the present invention relates to a method for determining a measure useful for evaluating the behaviour of a driver of a vehicle.
- One type of current solution is based on driver monitoring with a camera where the eye-lid and head/gaze behaviour of the driver is analysed. Although this approach uses a direct measurement of the driver, it suffers from reliability issues due to light conditions, glasses and facial features of the driver.
- Another type of current solution is based on analysis of the driver's performance in the lane keeping task.
- US 5 745 031 describes a safety driving system for detecting a driver's alertness comprising an operation detecting section which updates monotonousness each time one of the driver-operated devices is operated, a steering section for deriving a steering amount and a running position detecting section for detecting a zigzag amount denoting a deviation of white lines detected based on an image of a road surface. Information from the different sections is used to determine the driver's alertness.
- US 5 821 860 describes a driving condition-monitoring apparatus for monitoring a driving condition of a driver.
- a sensed yaw rate and speed are used to calculate a reference line of a lane along which the vehicle should travel.
- a parameter indicative of the deviation of the vehicle from this reference line is calculated, based on the sensed yaw rate and vehicle speed.
- the driving condition of the driver is calculated based on the deviation from the reference line.
- US 6 335 689 describes a method in which the lateral displacement of a vehicle is detected consecutively and subjected to a frequency conversion to obtain a frequency component power. A driver's arousal level is judged based on an evaluation value obtained from performing integrations of the frequency component power.
- US 5 925 082 describes a method in which the alertness of the vehicle operator is determined by collecting data on manual steering torque applied to the manual steering input means. The occurrences of abrupt corrective steering operations are counted and used to evaluate the alertness of the driver. In addition, when the alertness is low, a steering control system takes control over the steering of the vehicle.
- a method for determining a measure for evaluation of the behaviour of a driver of a vehicle comprising determining the lateral position of the vehicle in relation to a lane and the state of the vehicle at a first instant, determining the planned path which the vehicle would be expected to follow from said first instant considering the state at said first instant, determining the planned lateral position of the vehicle in relation to a lane at a second instant being a time interval after said first instant, if said planned path were followed, and determining a planned deviation being the difference between the planned lateral position at the second instant and the lateral position at the first instant.
- a new impairment measure namely the "planned deviation” is provided according to the invention.
- This impairment measure is intended to be used to evaluate slow impairment processes like drowsiness or fatigue.
- the "state of the vehicle” may be described using variables indicating the way in which the driver controls the vehicle.
- the state of the vehicle may include the current speed and yaw rate, but also other variables such as acceleration or deceleration.
- the planned path is the path that the vehicle would follow considering the state of the vehicle at the first instant, there is a possibility of adapting the system by selecting the variables used to describe the state. If for example only the speed and yaw rate of the vehicle are used to describe its state, the planned path will be the path followed if speed and yaw rate are held constant from the first instant. In a more complicated model, the acceleration of the vehicle could also be used, and the planned path would be calculated not using a constant speed, but assuming a constant acceleration.
- the lateral position of the vehicle is the lateral position of the vehicle in relation to a road or lane.
- the lateral position may be determined using various lane tracking or GPS systems; particularly advantageous alternatives for determining the lateral position will however be described in the following.
- the planned lateral position is the lateral position to which the vehicle would arrive a certain time/distance ahead in case the vehicle state is held constant from a current lateral position.
- the path followed by the vehicle if the vehicle state is held constant is referred to as the planned path.
- the planned path and the planned lateral position may be determined using a number of different methods. In the following, a method giving particularly good results will be described.
- the planned deviation By comparing a current lateral position at a certain time with the planned lateral position a certain interval of time ahead if the vehicle were to continue on the planned path, the planned deviation being useful as a measure of the driver's ability to plan ahead is obtained. All drivers make steering corrections based on the upcoming road shape and traffic situation. Impaired drivers lose the ability to plan ahead to some extent. The inventors have discovered that the variability and/or magnitude of the planned deviation measure increases with increasing drowsiness of the driver. Accordingly, the variability and/or magnitude of the planned deviation may be studied to evaluate the driver's impairment.
- Calculations of the planned deviation measure may preferably be performed at subsequent instances having a selected frequency.
- This frequency would preferably selected such that the time gap between the instances is considerably less than the time period between the first and the second instant used in the planned deviation calculation.
- the frequency may for instance be selected in the order of magnitude of 10 Hz.
- a number of planned deviation measures may be calculated at subsequent instants and the deviation measures may be used for the evaluation.
- the planned deviation measures are then compiled, e.g. by forming a mean over the planned deviation measures, a sum thereof, obtaining a distribution thereof, a filtration or other compilation resulting in a measure representative of a number of planned deviation measures.
- this measure will be referred to as a Mean Planned Deviation measure (MPD), although it shall be understood from the above that this measure need not strictly be a mean of a number of planned deviation measures.
- MPD Mean Planned Deviation measure
- the MPD values tend to increase over time (as the driver gets more and more impaired), whereas for alert drivers the MPD values stay relatively constant, This property of the MPD signal can be used to detect impaired drivers in a very accurate way.
- the planned deviation measures or MPD may be compared with a threshold value in order to determine whether the driver is impaired or not.
- the threshold value may be individually adapted for the driver.
- a threshold determining algorithm may be used wherein the driver's normal mean planned deviation is determined during a selected interval of a ride, and a threshold value for that driver is set in relation thereto. If desired, the threshold value may be updated during the ride.
- the data representative of the state of the vehicle may advantageously comprise data representative of the vehicle' s speed and yaw rate.
- the planned path may be calculated using the vehicle's position, speed and yaw rate at the first instant t1 as indata.
- the planned path may advantageously be calculated using a linear bicycle model.
- the lateral positions may advantageously be determined using a lane-tracking system including a camera.
- the method comprises retrieving and storing data representative of the vehicle's state and retrieving and storing data representative of the surrounding environment at a first instant t1, retrieving and storing data representative of the vehicle's state and retrieving and storing data representative of the surrounding environment of the vehicle during an estimation period after said first instant, and using the data retrived and stored during the estimation period for determining the planned lateral position of the vehicle at the second instant.
- This embodiment has the advantage that the actual road situation is accounted for in that data of the surrounding environment and vehicle's state during the estimation period is used in order to evaluate the behaviour of the driver at the start of the interval.
- the estimation period ⁇ t TS may be at least 0.5 s, preferably at least 2 s, most preferred at least 5 s.
- the data representative of the surrounding environment may include information regarding surrounding movable objects, such as vehicles, and stationary objects. Accordingly, the surrounding traffic situation of the vehicle during the interval may also be taken into account when evaluating the driver's behaviour.
- the invention in a second aspect, relates to a system for warning a driver using a method for determining a measure of a driver's behaviour as described above, and issuing or not issuing a warning based on said measure.
- the invention in a third aspect, relates to a device having means for performing a method as described above.
- the method of the invention will now be described in relation to an embodiment where it is used in combination with a method for estimating a traffic situation. It is to be understood that the method for determining a measure for evaluation of the behaviour of a driver is not limited to this particular embodiment, although it has been found to be particularly advantageous.
- An embodiment of a method for determining a measure for evaluation of the behaviour of a driver will first be described in relation to Figs. 1a and 1b.
- the inventors have found that, generally, drivers being impaired by e. g. drowsiness, illness, distraction or intoxication seem to plan the path of the vehicle worse than alert drivers do. In other words, an impaired driver cannot estimate the upcoming road situation and/or cannot adapt his driving to the upcoming road situation as accurately as an alert driver can.
- the state of the vehicle and/or the behaviour of the driver at the first instant t1 may be evaluated.
- the measure for evaluation of a driver makes use of the finding that the planned path 3 of impaired drivers often varies largely in relation to the lane markings 2. For alert drivers, this is not nearly as common. This suggests that impaired drivers seem to concentrate on keeping the vehicle on the road, and are not able to plan ahead in view of a traffic situation in the same way as alert drivers do.
- the method for determining a measure for evaluation of a driver compares the lateral position LP1 of a vehicle 1 in relation to a lane at a first instant t1 with a planed lateral position PLP2 to which the vehicle would arrive at a second instant t2 if the planned path calculated from t1 were followed. Thereafter, a measure called "planned deviation" is determined, being the difference between the planned lateral position PLP2 at the second instant t2 and the lateral position LP1 at the first instant.
- the road shape following the first instant t1 must be estimated.
- any suitable system may be used.
- the method for estimating a traffic scenario as described above has been found to be particularly advantageous and to provide accurate and useful results.
- the estimated traffic scenario may include estimation of the upcoming road shape only, or in combination with estimation of other scenario information such as the surrounding traffic situation, whether an overtaking took place etc., which could be used as additional variables for determining the ability of the driver to plan ahead.
- the concept of calculating the planned path will be described in connection with the method for estimating a traffic situation. It is to be understood, that the method for determining a measure for evaluation of the behaviour of a driver is not restricted to be used with this particular method for estimating a traffic scenario. Instead, other methods for estimating traffic scenarios could be suitable for the application. However, the method for estimating a traffic scenario as described herein is particularly suitable, since it provides a relatively high accuracy as compared to previously known methods.
- FIG. 1a A vehicle 1 is illustrated at a first instant t1 in time.
- the vehicle 1 is positioned in a lane, having lateral lane markings 2, at the first instant t1.
- the method aims to estimate the traffic situation of the vehicle 1, more particularly, the traffic situation including objects that the vehicle will reach an estimation period ⁇ t TS forward in time.
- the term "traffic situation” is to be understood as the situation surrounding the vehicle. It could include the curvature of the road upon which the vehicle is travelling, the location and speed of surrounding traffic, the location of stationary objects etc.
- focus may be made on various aspects of the situation. Thus it is possible to select a number of different factors that should be evaluated in the situation, and to disregard others.
- the estimation period ⁇ t TS is > 0, meaning that the method is not a method using real-time calculations.
- the estimated traffic situation at the first instant t1 is determined some time after the first instant t1, and is not, as in real-time systems, determined essentially at the same first instant t1.
- the estimation period ⁇ t TS may be > 0.5 s or even ⁇ t TS > 2 s.
- Data representative of the vehicle's state and of the environment surrounding the vehicle is retrieved and stored at the first instant t1.
- Data representative of the state of the vehicle are data giving information about the vehicle.
- the vehicle's speed and yaw rate are included in the data regarding the state of the vehicle.
- other variables may also be included, such as current deceleration or acceleration of the vehicle.
- the data representative of the surrounding environment may advantageously include information regarding surrounding dynamic objects, such as vehicles, and regarding surrounding stationary objects such as lane markings and/or road curves.
- the vehicle's position may be included in, or calculated from, the data representative of the environment of the vehicle, e.g. the vehicle's position in relation to a road or lane.
- Information regarding dynamic objects may in particular be used to take the surrounding traffic into account when estimating the traffic situation.
- the vehicle 1 After the instant t1, the vehicle 1 continues its path 4 during the estimation period ⁇ t TS .
- Data representative of the surrounding environment and of the vehicle's state is retrieved and stored during the drive along the path 4.
- the data representative of the surrounding environment during the estimation period ⁇ t TS may include information regarding e.g. the shape of the road or lane, the surrounding traffic and/or weather conditions, depending on which characteristics of the traffic scenario are selected for the estimation.
- the data retrieved during the estimation period ⁇ t TS is used to estimate the traffic situation of the vehicle at the first instant t1.
- the traffic situation may be evaluated including information gathered during the entire period ⁇ t TS , or for parts thereof.
- the estimated traffic situation at the first instant t1 may be used for a number of different purposes.
- the state of the vehicle at the first instant may be evaluated in view of the estimated traffic situation.
- the estimated traffic situation is used to evaluate the behaviour of a driver of a vehicle at the first instant t1.
- the behaviour of the driver is reflected in the state of the vehicle such as its speed and yaw rate as described above, but could alternatively or additionally include other aspects such as e.g. whether the driver was making a telephone call.
- the data retrieved during the estimation period may be used to estimate the traffic scenario during the estimation period.
- traffic scenario is used for describing the context of the traffic situation, e.g. if the driver is performing an overtaking, is in a line of vehicles, is giving way for another vehicle, is changing lanes or is selecting a side road etc.
- the traffic scenario estimation may be selected so as to focus primarily on selected aspects of different traffic scenarios.
- the data representative of the surrounding environment as well as of the vehicle's state may include data from different systems and sensors.
- it may include data from a lane-tracking system, preferably including a camera.
- the above-described method for estimating a traffic situation When the above-described method for estimating a traffic situation is used together with the method for evaluating the state of the vehicle/behaviour of the driver, it will include calculation of a planned path of the vehicle from the first instant t1.
- the planned path is a path that the vehicle would be expected to follow from said instant t1, calculated using the data considering the state of the vehicle obtained at the first instant t1.
- the calculation may be made using different assumptions regarding the driver's behaviour.
- the planned path may be calculated using the presumption that the vehicle's speed and yaw rate are held constant from the instant t1.
- the acceleration of the vehicle at the first instant t1 may be taken into account, either assuming that the acceleration is held constant during the future drive, or that it forms part of some assumed driving pattern.
- the planned path is determined using information obtained at the first instant t1, and not thereafter.
- the planned path 3 is shown in a dotted line.
- the actual path 4 followed by the vehicle after the instant t1 need not be identical to the planned path 3, since the actual state of the vehicle after the first instant t1 may differ from the assumptions made due to measures taken by the driver along the way.
- the data regarding the state of the vehicle at the first instant t1 includes the lateral position of the vehicle 1 in relation to a lane at the first instant t1, and e.g. the speed and yaw rate measured at that first instant. This data is stored. Thereafter, the vehicle travels along the road during an estimation period ⁇ t TS , and data representative of the vehicle's state and of the surrounding environment is gathered and stored.
- the data representative of the surrounding environment includes in particular information regarding the position of the lane markings 2 of the actual road.
- the planned path of the vehicle is calculated for an interval ⁇ tp D from the first instant t1 to a second instant t2.
- the planned path interval ⁇ t PD is in this case a portion of the estimation period used for the traffic situation estimation ⁇ t TS .
- the planned path 3 is calculated using the lateral position LP1 retrieved at the first instant t1 and the speed and yaw rate measured at the first instant t1.
- the planned path interval ⁇ t PD may advantageously be selected so as to reflect a relevant time/distance of planning ahead.
- the planned path interval ⁇ t PD may be selected differently as compared to when the vehicle is travelling with a lower speed.
- the length of the planned path interval ⁇ t PD may be set in relation to one or more of vehicle or environment variables, such as the current speed of the vehicle, the surrounding traffic situation, whether the road is straight or curved, etc.
- the planned path interval ⁇ t PD may be updated in accordance with changes in the relevant variables.
- the planned lateral position PLP2 at the second instant t2 is determined by comparing the planned path 3 with the estimated traffic situation obtained previously, including data about the road shape that have been collected during the estimation period ⁇ t TS . Accordingly, the planned lateral position PLP2 at the second instant t2 may be determined with very high accuracy.
- the calculations of the planned lateral position can not be made in real time. For purposes of determining driver drowsiness, however, this is not a problem. Driver drowsiness is a slow process, on the minute-scale, and hence it is not a problem to have a delay of a few seconds in the calculations of the planned lateral position.
- the planned lateral position may be determined in real time if real-time methods are used for the estimation of an upcoming traffic situation.
- Information regarding the environment surrounding the vehicle may advantageously be gathered by a lane tracking system, preferably using a camera such as a forward looking monocamera, for determining the lateral position of the vehicle.
- a camera such as a forward looking monocamera
- other sensors may be used to obtain information regarding the traffic situation, whether a take-over takes place etc.
- the planned deviation, PD being the difference between the planned lateral position PLP2 and the lateral position LP1 at the first instant t1 may be determined.
- the PD values can be both positive and negative, depending on the current lateral position of the vehicle and how the driver "aims". It is in many cases, however, only the magnitude of the PD values that is interesting, which is why the absolute values of the PD values may advantageously be used for evaluation.
- the planned deviation is advantageously determined at a selected frequency during a drive.
- the selected frequency is advantageously selected such that a new planned deviation calculation is initiated several times during the estimation period ⁇ t PD .
- the planned deviation measures may be analysed for evaluation of the behaviour of a driver.
- impaired drivers have higher planned deviation values than alert drivers. This can be explained by the impaired drivers tending to plan the future vehicle path worse than alert drivers.
- a number of planned deviation measures are then compiled, e.g. by forming a mean over the planned deviation measures, a sum thereof, obtaining a distribution thereof, a filtration or other compilation resulting in a measure representative of a number of planned deviation measures.
- this measure will be referred to as a Mean Planned Deviation measure (MPD), although it shall be understood from the above that this measure need not strictly be a mean of a number of planned deviations measures.
- MPD Mean Planned Deviation measure
- the MPD values tend to increase over time (as the driver gets more and more impaired), whereas for alert drivers the MPD values stay relatively constant. This property of the MPD signal can be used to detect impaired drivers in a very accurate way.
- a threshold may be determined by gathering planned deviation measures or MPD for the driver during a selected portion of drive, such as the start of the drive, when the driver should generally not be impaired, or during a portion of the drive where the driver is found to drive particularly well.
- a threshold for the remaining part of the drive may be set in relation to the planned deviation measures/MPD during the selected portion.
- a warning system may be arranged for warning a driver of impairment if the planned deviation measures/MPD measures exceeds the threshold, or repeatedly exceeds the threshold during a certain time interval.
- a linear bicycle model may be used, which will be described in the following with reference to Figs 2 and 3.
- the yaw rate and the speed of the vehicle at that instant may be used to establish a good approximation.
- the angle ⁇ 0 is the current angle of the vehicle in a global xy- coordinate system
- v 0 is the current speed of the vehicle
- R is the turn radius of the vehicle
- S is the distance (along the circumference of a circle with radius R) between the current position of the vehicle and the position where the planned lateral position should be calculated
- ⁇ is the vehicle turning angle
- ( x 0 , y 0 ) is the current position of the vehicle
- ( x p , y p ) is the planned position of the vehicle
- ( x c , y c ) is the centre of the circle that the vehicle is turning along.
- the angle ⁇ 0 , the velocity v 0 , the radius R and the vehicle position ( x 0 , y 0 ) are known from the vehicle path calculation algorithm and the arc length S is predetermined, but the other variables must be calculated.
- the planned lateral position can be calculated. Since the lane markings next to the planned vehicle path are known from the lane tracking system, these can be used to obtain the planned lateral position.
- the distance d to the lane markings is calculated as the distance between the points ( x l , y l ) and ( x p , y p ).
- d ( x l ⁇ x p ) 2 + ( y l ⁇ y p ) 2
- the two vectors P (which points in the direction of the planned vehicle path in the point ( x p , y p )) and L (which points from point ( x p , y p ) to point ( x l , y l )) are calculated.
- L the vector product
- a third dimension must be added to the vectors, i.e. a zero is added as a third element in the vectors L and P. If the sign is positive, that means that the lane markings are located to the right of the vehicle and a negative sign means that the lane markings are located to the left.
- Fig. 5 is a flow schedule, illustrating an embodiment of a method for estimating a traffic situation when used in an embodiment of a method for determining a measure for the behaviour of a driver as described above.
- the traffic situation estimation is performed in the first block of the schedule, named "preprocessing":
- the DIMON Controller receives indata representative of the vehicle's state and of the surrounding environment.
- the DIMON Controller also receives interaction data regarding the interaction between the driver and the vehicle.
- Other data regarding the driver such as e.g. whether he receives a telephone call may also be received by the DIMON Controller.
- the data preprocessing stage the data is gathered and processed for performing the estimation of a traffic situation.
- indata is retrieved during estimation periods ⁇ t TS after subsequent instants t1 in order to estimate the traffic situations at the first instants t1.
- the instants t1 may be selected with a constant time delay being substantially shorter than the estimation period ⁇ t TS .
- a suitable frequency could be about 10 Hz.
- the indata is preprocessed so as to be suitable for the following calculations to be performed.
- the planned path is calculated intervals ⁇ t PD being at least portions of the estimation periods ⁇ t TS .
- the data from the data preprocessing stage may advantageously be used for adapting the time horizon, i.e. adapting ⁇ t PD for the planned path calculations.
- the relevant ⁇ t PD depends on the present traffic situation and could suitably be selected so as to reflect the time horizon in which an alert driver is normally capable to plan ahead.
- the planned path is used in an embodiment of a method for determining a planned deviation measure for evaluation of the driver.
- the lateral position of the vehicle in relation to a lane and the state of the vehicle at the first instant is suitably reflected in the processed data coming from the data preprocessing stage.
- the planned deviation being the difference between the planned lateral position at the end of the planned path calculation interval ⁇ t PD and the lateral position at the first instant t1, is calculated, giving the planned deviation PD.
- the resulting PD measures are in this embodiment evaluated by the forming of a Mean Planned Deviation value, using a number of PD measures.
- the PD measures obtained during about a minute's time could be used to form the Mean Planned Deviation measure for evaluation.
- the Mean Planned Deviation value may advantageously be continuously updated.
- the PD value may be used in other alternative evaluation algorithms, e.g. filters distributions etc, as indicated in a dashed line in Fig. 5.
- the MPD value may also be used for updating a threshold for whether a warning to the driver should be issued or not.
- the threshold adaptation may be made so as to always set the threshold in relation to the smallest MPD values obtained during a certain time period of a drive, i. e. a period during which the driver was planning his path well.
- the MPD value and/or other evaluation algorithm values are compared to the threshold in order to make a decision whether to issue a warning to the driver or not.
- the warning could preferably be a warning suitable for attracting the attention of an impaired driver, such as an audible warning. Even though the warning could advantageously function so as to temporary wake up a drowsy driver, the purpose of the warning is to indicate to the driver that he should stop driving as soon as possible and take a rest.
- the described embodiment is of the preferred type where data representative of the state and the surrounding environment of the vehicle is retrieved and stored during an estimation period ⁇ t TS , and data from an interval ⁇ t PD is used to obtain a planned deviation measure
- the method of the invention may be used also in combination with systems where the situation within the time interval ⁇ t PD is estimated in advance, as an upcoming road situation from the first instant t1.
- the variables used to determine the state of the vehicle and the planned path may be varied, and could include e.g. acceleration or deceleration.
- the lateral positions are believed to be most accurately determined if a lane-tracking system comprising a camera is used for determining the position of lane markings, but also other systems for lane tracking are possible.
- a system using the method according to the invention may optionally be integrated or used in combination with other systems such as an Adaptive Cruise Control system, a Lane Departure Warning system or a Lane Keeping Assist system.
- other systems such as an Adaptive Cruise Control system, a Lane Departure Warning system or a Lane Keeping Assist system.
Landscapes
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
- The present invention relates to a method for determining a measure useful for evaluating the behaviour of a driver of a vehicle.
- Driver impairment due to e.g. drowsiness, illness or intoxication, is a major accident cause that craves a high number of lives each year. Although the number of safety features in a vehicle increases, the availability of systems that are able to reliably determine levels of impairment is still very limited. Although research has been going on for more than 40 years, there is still no off-the-shelf solution available. This is due to the fact that most systems are not reliable enough.
- Several systems are known which attempt to evaluate a driver's behaviour in order to determine whether it is adequate or not, which in turn may be used to determine whether the driver is impaired due to e.g. drowsiness, illness, distraction or intoxication.
- One type of current solution is based on driver monitoring with a camera where the eye-lid and head/gaze behaviour of the driver is analysed. Although this approach uses a direct measurement of the driver, it suffers from reliability issues due to light conditions, glasses and facial features of the driver.
- Another type of current solution is based on analysis of the driver's performance in the lane keeping task.
- US 5 745 031 describes a safety driving system for detecting a driver's alertness comprising an operation detecting section which updates monotonousness each time one of the driver-operated devices is operated, a steering section for deriving a steering amount and a running position detecting section for detecting a zigzag amount denoting a deviation of white lines detected based on an image of a road surface. Information from the different sections is used to determine the driver's alertness.
- US 5 821 860 describes a driving condition-monitoring apparatus for monitoring a driving condition of a driver. A sensed yaw rate and speed are used to calculate a reference line of a lane along which the vehicle should travel. Also a parameter indicative of the deviation of the vehicle from this reference line is calculated, based on the sensed yaw rate and vehicle speed. The driving condition of the driver is calculated based on the deviation from the reference line.
- US 6 335 689 describes a method in which the lateral displacement of a vehicle is detected consecutively and subjected to a frequency conversion to obtain a frequency component power. A driver's arousal level is judged based on an evaluation value obtained from performing integrations of the frequency component power.
- US 5 925 082 describes a method in which the alertness of the vehicle operator is determined by collecting data on manual steering torque applied to the manual steering input means. The occurrences of abrupt corrective steering operations are counted and used to evaluate the alertness of the driver. In addition, when the alertness is low, a steering control system takes control over the steering of the vehicle.
- A problem with prior art systems based on analysis of the driver's performance is that they do not provide a sufficiently high performance level, and may lead to non-conclusive results. Sometimes, these approaches suffer from misinterpretation of the driver's wobblings within the lane markings and do not show how well the driver actually behaves on the road.
- In view of the above, it is an object of the present invention to provide a method for determining a measure useful for evaluating the impairment of a driver of a vehicle that is more reliable than prior art methods.
- This object is achieved according to the invention by a method for determining a measure for evaluation of the behaviour of a driver of a vehicle comprising
determining the lateral position of the vehicle in relation to a lane and the state of the vehicle at a first instant,
determining the planned path which the vehicle would be expected to follow from said first instant considering the state at said first instant,
determining the planned lateral position of the vehicle in relation to a lane at a second instant being a time interval after said first instant, if said planned path were followed, and
determining a planned deviation being the difference between the planned lateral position at the second instant and the lateral position at the first instant. - Thus, a new impairment measure namely the "planned deviation" is provided according to the invention. This impairment measure is intended to be used to evaluate slow impairment processes like drowsiness or fatigue.
- The "state of the vehicle" may be described using variables indicating the way in which the driver controls the vehicle. The state of the vehicle may include the current speed and yaw rate, but also other variables such as acceleration or deceleration.
- Since the planned path is the path that the vehicle would follow considering the state of the vehicle at the first instant, there is a possibility of adapting the system by selecting the variables used to describe the state. If for example only the speed and yaw rate of the vehicle are used to describe its state, the planned path will be the path followed if speed and yaw rate are held constant from the first instant. In a more complicated model, the acceleration of the vehicle could also be used, and the planned path would be calculated not using a constant speed, but assuming a constant acceleration.
- The lateral position of the vehicle is the lateral position of the vehicle in relation to a road or lane. The lateral position may be determined using various lane tracking or GPS systems; particularly advantageous alternatives for determining the lateral position will however be described in the following.
- The planned lateral position is the lateral position to which the vehicle would arrive a certain time/distance ahead in case the vehicle state is held constant from a current lateral position. The path followed by the vehicle if the vehicle state is held constant is referred to as the planned path. The planned path and the planned lateral position may be determined using a number of different methods. In the following, a method giving particularly good results will be described.
- By comparing a current lateral position at a certain time with the planned lateral position a certain interval of time ahead if the vehicle were to continue on the planned path, the planned deviation being useful as a measure of the driver's ability to plan ahead is obtained. All drivers make steering corrections based on the upcoming road shape and traffic situation. Impaired drivers lose the ability to plan ahead to some extent. The inventors have discovered that the variability and/or magnitude of the planned deviation measure increases with increasing drowsiness of the driver. Accordingly, the variability and/or magnitude of the planned deviation may be studied to evaluate the driver's impairment.
- Although in this application reference is made to a first and a second instant, and to a time interval, this is to be understood to be equivalent to referring to a first and a second distance, and to a distance interval. The person skilled in the art will readily translate the description being made using time as a variable so as to involve distance measures instead.
- Calculations of the planned deviation measure may preferably be performed at subsequent instances having a selected frequency. This frequency would preferably selected such that the time gap between the instances is considerably less than the time period between the first and the second instant used in the planned deviation calculation. The frequency may for instance be selected in the order of magnitude of 10 Hz.
- Preferably, a number of planned deviation measures may be calculated at subsequent instants and the deviation measures may be used for the evaluation. Advantageously, the planned deviation measures are then compiled, e.g. by forming a mean over the planned deviation measures, a sum thereof, obtaining a distribution thereof, a filtration or other compilation resulting in a measure representative of a number of planned deviation measures. In the following, this measure will be referred to as a Mean Planned Deviation measure (MPD), although it shall be understood from the above that this measure need not strictly be a mean of a number of planned deviation measures.
- For impaired drivers, the MPD values tend to increase over time (as the driver gets more and more impaired), whereas for alert drivers the MPD values stay relatively constant, This property of the MPD signal can be used to detect impaired drivers in a very accurate way.
- Advantageously, the planned deviation measures or MPD may be compared with a threshold value in order to determine whether the driver is impaired or not.
- The threshold value may be individually adapted for the driver. Advantageously, a threshold determining algorithm may be used wherein the driver's normal mean planned deviation is determined during a selected interval of a ride, and a threshold value for that driver is set in relation thereto. If desired, the threshold value may be updated during the ride.
- As will be shown in the following examples, the Mean Planned Deviation with a self-adapting threshold algorithm has been found to be highly useful for drawing correct conclusions regarding the driver's state in numerous test drives performed.
- The data representative of the state of the vehicle may advantageously comprise data representative of the vehicle' s speed and yaw rate. The planned path may be calculated using the vehicle's position, speed and yaw rate at the first instant t1 as indata. In this case, the planned path may advantageously be calculated using a linear bicycle model.
The lateral positions may advantageously be determined using a lane-tracking system including a camera. - In a particularly advantageous embodiment of the invention, the method comprises retrieving and storing data representative of the vehicle's state and retrieving and storing data representative of the surrounding environment at a first instant t1, retrieving and storing data representative of the vehicle's state and retrieving and storing data representative of the surrounding environment of the vehicle during an estimation period after said first instant, and using the data retrived and stored during the estimation period for determining the planned lateral position of the vehicle at the second instant.
- This embodiment has the advantage that the actual road situation is accounted for in that data of the surrounding environment and vehicle's state during the estimation period is used in order to evaluate the behaviour of the driver at the start of the interval.
- Thus, many disadvantages due to incorrect estimation of an upcoming road situation, as might occur in many prior art systems, are avoided. With the suggested method, the evaluation of the driver's behaviour cannot be made in real time, since an estimation period must elapse before the behaviour at the beginning of the time interval may be evaluated. For purposes of determining driver impairments such as drowsiness, however, this is not a problem. Driver drowsiness is a slow process, on the minutes-scale, and hence a delay of a few seconds in the evaluation is not crucial.
- The estimation period ΔtTS may be at least 0.5 s, preferably at least 2 s, most preferred at least 5 s.
- Further, the data representative of the surrounding environment may include information regarding surrounding movable objects, such as vehicles, and stationary objects. Accordingly, the surrounding traffic situation of the vehicle during the interval may also be taken into account when evaluating the driver's behaviour.
- In a second aspect, the invention relates to a system for warning a driver using a method for determining a measure of a driver's behaviour as described above, and issuing or not issuing a warning based on said measure.
- In a third aspect, the invention relates to a device having means for performing a method as described above.
- Additional features and advantages of the invention will appear more clearly from the following detailed description of a preferred embodiment of the invention, which is given by way of non-limiting example only and with reference to the accompanying drawings.
-
- Figs. 1a and 1b illustrate the current lateral position and the planned vehicle path of a vehicle.
- Fig. 2 is a schematic picture of the planned vehicle path, from (x 0, y 0) to (x p , y p ) along a circle arc of length S with radius R.
- Fig. 3 is an overview of the variables used for the planned lateral position calculation.
- Fig. 4 is a diagram illustrating absolute Planned Deviation values for a driver when alert (top) and drowsy (bottom).
- Fig. 5 is a flow chart illustrating an embodiment of a system using a method for estimating a traffic scenario according to the invention.
- The method of the invention will now be described in relation to an embodiment where it is used in combination with a method for estimating a traffic situation. It is to be understood that the method for determining a measure for evaluation of the behaviour of a driver is not limited to this particular embodiment, although it has been found to be particularly advantageous.
An embodiment of a method for determining a measure for evaluation of the behaviour of a driver will first be described in relation to Figs. 1a and 1b.
The inventors have found that, generally, drivers being impaired by e. g. drowsiness, illness, distraction or intoxication seem to plan the path of the vehicle worse than alert drivers do. In other words, an impaired driver cannot estimate the upcoming road situation and/or cannot adapt his driving to the upcoming road situation as accurately as an alert driver can. - Thus, by calculating the planned path at the instant t1 for an interval ΔTPD ahead of the vehicle, and comparing it to the estimated traffic scenario at the instant t1, the state of the vehicle and/or the behaviour of the driver at the first instant t1 may be evaluated.
- The measure for evaluation of a driver makes use of the finding that the
planned path 3 of impaired drivers often varies largely in relation to thelane markings 2. For alert drivers, this is not nearly as common. This suggests that impaired drivers seem to concentrate on keeping the vehicle on the road, and are not able to plan ahead in view of a traffic situation in the same way as alert drivers do. - The method for determining a measure for evaluation of a driver compares the lateral position LP1 of a
vehicle 1 in relation to a lane at a first instant t1 with a planed lateral position PLP2 to which the vehicle would arrive at a second instant t2 if the planned path calculated from t1 were followed. Thereafter, a measure called "planned deviation" is determined, being the difference between the planned lateral position PLP2 at the second instant t2 and the lateral position LP1 at the first instant. - For calculating the planned lateral position PLP2 at the second instant t2, following a planned path from the first instant t1, the road shape following the first instant t1 must be estimated. For this estimation any suitable system may be used. However, the method for estimating a traffic scenario as described above has been found to be particularly advantageous and to provide accurate and useful results. In this case, the estimated traffic scenario may include estimation of the upcoming road shape only, or in combination with estimation of other scenario information such as the surrounding traffic situation, whether an overtaking took place etc., which could be used as additional variables for determining the ability of the driver to plan ahead.
- In the following, the concept of calculating the planned path will be described in connection with the method for estimating a traffic situation. It is to be understood, that the method for determining a measure for evaluation of the behaviour of a driver is not restricted to be used with this particular method for estimating a traffic scenario. Instead, other methods for estimating traffic scenarios could be suitable for the application. However, the method for estimating a traffic scenario as described herein is particularly suitable, since it provides a relatively high accuracy as compared to previously known methods.
- Thus, the embodiment for describing a method for estimating a traffic situation will now be described in relation to Fig. 1a. A
vehicle 1 is illustrated at a first instant t1 in time. In this embodiment, thevehicle 1 is positioned in a lane, havinglateral lane markings 2, at the first instant t1. Now, the method aims to estimate the traffic situation of thevehicle 1, more particularly, the traffic situation including objects that the vehicle will reach an estimation period ΔtTS forward in time. - In this context, the term "traffic situation" is to be understood as the situation surrounding the vehicle. It could include the curvature of the road upon which the vehicle is travelling, the location and speed of surrounding traffic, the location of stationary objects etc. When estimating the traffic situation, focus may be made on various aspects of the situation. Thus it is possible to select a number of different factors that should be evaluated in the situation, and to disregard others.
- The estimation period ΔtTS is > 0, meaning that the method is not a method using real-time calculations. In other words, the estimated traffic situation at the first instant t1 is determined some time after the first instant t1, and is not, as in real-time systems, determined essentially at the same first instant t1. Depending on the situation, the estimation period ΔtTS may be > 0.5 s or even ΔtTS > 2 s.
Data representative of the vehicle's state and of the environment surrounding the vehicle is retrieved and stored at the first instant t1. - Data representative of the state of the vehicle are data giving information about the vehicle. Preferably, the vehicle's speed and yaw rate are included in the data regarding the state of the vehicle. However, other variables may also be included, such as current deceleration or acceleration of the vehicle..
The data representative of the surrounding environment may advantageously include information regarding surrounding dynamic objects, such as vehicles, and regarding surrounding stationary objects such as lane markings and/or road curves. Advantageously, the vehicle's position may be included in, or calculated from, the data representative of the environment of the vehicle, e.g. the vehicle's position in relation to a road or lane. Information regarding dynamic objects may in particular be used to take the surrounding traffic into account when estimating the traffic situation. - After the instant t1, the
vehicle 1 continues its path 4 during the estimation period ΔtTS. Data representative of the surrounding environment and of the vehicle's state is retrieved and stored during the drive along the path 4. The data representative of the surrounding environment during the estimation period ΔtTS may include information regarding e.g. the shape of the road or lane, the surrounding traffic and/or weather conditions, depending on which characteristics of the traffic scenario are selected for the estimation. Thus, the data retrieved during the estimation period ΔtTS is used to estimate the traffic situation of the vehicle at the first instant t1. The traffic situation may be evaluated including information gathered during the entire period ΔtTS, or for parts thereof. - The estimated traffic situation at the first instant t1 may be used for a number of different purposes. Advantageously, the state of the vehicle at the first instant may be evaluated in view of the estimated traffic situation. Thus, it is possible to evaluate whether parameters such as the vehicle speed and yaw rate at the first instant t1 were suitable for the traffic situation or not.
- In this application, the estimated traffic situation is used to evaluate the behaviour of a driver of a vehicle at the first instant t1. The behaviour of the driver is reflected in the state of the vehicle such as its speed and yaw rate as described above, but could alternatively or additionally include other aspects such as e.g. whether the driver was making a telephone call.
- Further, the data retrieved during the estimation period may be used to estimate the traffic scenario during the estimation period. Herein, the term "traffic scenario" is used for describing the context of the traffic situation, e.g. if the driver is performing an overtaking, is in a line of vehicles, is giving way for another vehicle, is changing lanes or is selecting a side road etc. The traffic scenario estimation may be selected so as to focus primarily on selected aspects of different traffic scenarios.
- The data representative of the surrounding environment as well as of the vehicle's state may include data from different systems and sensors. Advantageously, it may include data from a lane-tracking system, preferably including a camera.
- When the above-described method for estimating a traffic situation is used together with the method for evaluating the state of the vehicle/behaviour of the driver, it will include calculation of a planned path of the vehicle from the first instant t1. The planned path is a path that the vehicle would be expected to follow from said instant t1, calculated using the data considering the state of the vehicle obtained at the first instant t1. The calculation may be made using different assumptions regarding the driver's behaviour. As an example, the planned path may be calculated using the presumption that the vehicle's speed and yaw rate are held constant from the instant t1. In another model, the acceleration of the vehicle at the first instant t1 may be taken into account, either assuming that the acceleration is held constant during the future drive, or that it forms part of some assumed driving pattern.
- However, the planned path is determined using information obtained at the first instant t1, and not thereafter. In Fig. 1a, the
planned path 3 is shown in a dotted line. As seen in Fig. 1a, the actual path 4 followed by the vehicle after the instant t1 need not be identical to theplanned path 3, since the actual state of the vehicle after the first instant t1 may differ from the assumptions made due to measures taken by the driver along the way. - When calculating the planned deviation measure using the method for estimation of a traffic situation as described above, the data regarding the state of the vehicle at the first instant t1 includes the lateral position of the
vehicle 1 in relation to a lane at the first instant t1, and e.g. the speed and yaw rate measured at that first instant. This data is stored. Thereafter, the vehicle travels along the road during an estimation period ΔtTS, and data representative of the vehicle's state and of the surrounding environment is gathered and stored. The data representative of the surrounding environment includes in particular information regarding the position of thelane markings 2 of the actual road. - Next, the planned path of the vehicle is calculated for an interval ΔtpD from the first instant t1 to a second instant t2. The planned path interval ΔtPD is in this case a portion of the estimation period used for the traffic situation estimation ΔtTS. The
planned path 3 is calculated using the lateral position LP1 retrieved at the first instant t1 and the speed and yaw rate measured at the first instant t1. - Since a driver of a vehicle must adapt his driving behaviour to a traffic situation including e.g. stationary and dynamic objects which the vehicle will reach within a certain time period, the planned path interval ΔtPD may advantageously be selected so as to reflect a relevant time/distance of planning ahead. Thus, if the vehicle travels at a relatively high speed, the planned path interval ΔtPD may be selected differently as compared to when the vehicle is travelling with a lower speed.
- The length of the planned path interval ΔtPD may be set in relation to one or more of vehicle or environment variables, such as the current speed of the vehicle, the surrounding traffic situation, whether the road is straight or curved, etc. Advantageously, the planned path interval ΔtPD may be updated in accordance with changes in the relevant variables.
- The planned lateral position PLP2 at the second instant t2 is determined by comparing the
planned path 3 with the estimated traffic situation obtained previously, including data about the road shape that have been collected during the estimation period ΔtTS. Accordingly, the planned lateral position PLP2 at the second instant t2 may be determined with very high accuracy. - Using the suggested method, the calculations of the planned lateral position can not be made in real time. For purposes of determining driver drowsiness, however, this is not a problem. Driver drowsiness is a slow process, on the minute-scale, and hence it is not a problem to have a delay of a few seconds in the calculations of the planned lateral position.
- However, the planned lateral position may be determined in real time if real-time methods are used for the estimation of an upcoming traffic situation.
- Information regarding the environment surrounding the vehicle may advantageously be gathered by a lane tracking system, preferably using a camera such as a forward looking monocamera, for determining the lateral position of the vehicle. However, also other sensors may be used to obtain information regarding the traffic situation, whether a take-over takes place etc.
- Once the planned lateral position PLP2 has been determined, the planned deviation, PD, being the difference between the planned lateral position PLP2 and the lateral position LP1 at the first instant t1 may be determined. Thus, the PD values can be both positive and negative, depending on the current lateral position of the vehicle and how the driver "aims". It is in many cases, however, only the magnitude of the PD values that is interesting, which is why the absolute values of the PD values may advantageously be used for evaluation.
- What the PD values could look like for a driver when alert and impaired, respectively, is shown in Fig 4.
- For evaluating the behaviour of a driver, the planned deviation is advantageously determined at a selected frequency during a drive. The selected frequency is advantageously selected such that a new planned deviation calculation is initiated several times during the estimation period ΔtPD.
- The planned deviation measures may be analysed for evaluation of the behaviour of a driver. In general, impaired drivers have higher planned deviation values than alert drivers. This can be explained by the impaired drivers tending to plan the future vehicle path worse than alert drivers.
- Advantageously, a number of planned deviation measures are then compiled, e.g. by forming a mean over the planned deviation measures, a sum thereof, obtaining a distribution thereof, a filtration or other compilation resulting in a measure representative of a number of planned deviation measures. In the following, this measure will be referred to as a Mean Planned Deviation measure (MPD), although it shall be understood from the above that this measure need not strictly be a mean of a number of planned deviations measures.
- For impaired drivers, the MPD values tend to increase over time (as the driver gets more and more impaired), whereas for alert drivers the MPD values stay relatively constant. This property of the MPD signal can be used to detect impaired drivers in a very accurate way.
- Since different drivers have different driving patterns, a general limit indicating that a driver is impaired when the planned deviation measures or MPD exceeds the limit might be difficult to set. Instead, a threshold may be determined by gathering planned deviation measures or MPD for the driver during a selected portion of drive, such as the start of the drive, when the driver should generally not be impaired, or during a portion of the drive where the driver is found to drive particularly well. Thus, a threshold for the remaining part of the drive may be set in relation to the planned deviation measures/MPD during the selected portion. In addition, a warning system may be arranged for warning a driver of impairment if the planned deviation measures/MPD measures exceeds the threshold, or repeatedly exceeds the threshold during a certain time interval.
- For determining the planned path of the vehicle, a linear bicycle model may be used, which will be described in the following with reference to Figs 2 and 3.
- In order to determine the planned path from an instant, the yaw rate and the speed of the vehicle at that instant may be used to establish a good approximation. The radius R of the vehicle path can be calculated as
where v is the vehicle speed [m/s] and Ψ̇ [rad/s] is the yaw rate rate of the vehicle. - In Fig. 2, the angle θ 0 is the current angle of the vehicle in a global xy-coordinate system, v 0 is the current speed of the vehicle, R is the turn radius of the vehicle, S is the distance (along the circumference of a circle with radius R) between the current position of the vehicle and the position where the planned lateral position should be calculated, γ is the vehicle turning angle, (x 0, y 0) is the current position of the vehicle, (x p , y p ) is the planned position of the vehicle and, finally, (x c , y c ) is the centre of the circle that the vehicle is turning along. The angle θ 0, the velocity v 0, the radius R and the vehicle position (x 0, y 0) are known from the vehicle path calculation algorithm and the arc length S is predetermined, but the other variables must be calculated. First, the angle γ and the coordinates (x c , y c ) are calculated as
-
- Now that the planned position of the vehicle is known, the planned lateral position can be calculated. Since the lane markings next to the planned vehicle path are known from the lane tracking system, these can be used to obtain the planned lateral position. The tangent to the detected lane markings closest to the planned vehicle position (on the form y = k lane · x + m lane ) is calculated as
where x lane,k , x lane,k-1 , y lane,k and y lane,k-1 are the coordinates of the two sampled points on the lane markings that are closest to (x p , y p ), this is displayed in Fig. 3. -
-
-
- Finally, it only remains to determine the sign of the lateral position, i. e. what side of the vehicle (in the global xy-coordinate system) the point (x l , y l ) is. This is needed, because the planned vehicle path might be so different from the road shape that the point (x p , y p ) is placed outside the lane markings.
- To determine the sign of the lateral position, the two vectors P (which points in the direction of the planned vehicle path in the point (x p , y p )) and L (which points from point (x p , y p ) to point (x l , y l )) are calculated. By calculating the vector product, L×P, between these two vectors and studying the sign of this product, it is possible to determine what side of the vehicle that the point (x l , y l ) is. In order to perform the calculation of the vector product, a third dimension must be added to the vectors, i.e. a zero is added as a third element in the vectors L and P. If the sign is positive, that means that the lane markings are located to the right of the vehicle and a negative sign means that the lane markings are located to the left.
- Fig. 5 is a flow schedule, illustrating an embodiment of a method for estimating a traffic situation when used in an embodiment of a method for determining a measure for the behaviour of a driver as described above. The traffic situation estimation is performed in the first block of the schedule, named "preprocessing":
- In Fig. 5, the process illustrated within the square is referred to as the DIMON Controller, a Driver Impairment MONitor Controller. The DIMON controller may be influenced by the action of other processes, such as the exemplified DIMON Mode manager and DIMON HMI manager. The DIMON Mode manager may control the mode of the DIMON e.g. whether the DIMON Controller is in active state or not or whether a re-initialisation of parameters should be made, in view of information regarding other processes and states of the vehicle. The DIMON HMI manager may control whether it is suitable to display a possible warning from the DIMON Controller to or not to the driver, depending e.g. of other warnings or information that the driver need to pay attention to in a particular situation.
- The DIMON Controller receives indata representative of the vehicle's state and of the surrounding environment. In the embodiment described, the DIMON Controller also receives interaction data regarding the interaction between the driver and the vehicle. Other data regarding the driver such as e.g. whether he receives a telephone call may also be received by the DIMON Controller. In the data preprocessing stage, the data is gathered and processed for performing the estimation of a traffic situation. In this case, indata is retrieved during estimation periods ΔtTS after subsequent instants t1 in order to estimate the traffic situations at the first instants t1. The instants t1 may be selected with a constant time delay being substantially shorter than the estimation period ΔtTS. A suitable frequency could be about 10 Hz. The indata is preprocessed so as to be suitable for the following calculations to be performed. In the DIMON Controller illustrated in Fig. 5, the planned path is calculated intervals ΔtPD being at least portions of the estimation periods ΔtTS.
- The data from the data preprocessing stage may advantageously be used for adapting the time horizon, i.e. adapting ΔtPD for the planned path calculations. As explained previously, the relevant ΔtPD depends on the present traffic situation and could suitably be selected so as to reflect the time horizon in which an alert driver is normally capable to plan ahead.
- In the illustrated embodiment, the planned path is used in an embodiment of a method for determining a planned deviation measure for evaluation of the driver. In this case, the lateral position of the vehicle in relation to a lane and the state of the vehicle at the first instant is suitably reflected in the processed data coming from the data preprocessing stage. Thus, in the planned deviation computation stage, the planned deviation, being the difference between the planned lateral position at the end of the planned path calculation interval ΔtPD and the lateral position at the first instant t1, is calculated, giving the planned deviation PD.
- The resulting PD measures are in this embodiment evaluated by the forming of a Mean Planned Deviation value, using a number of PD measures. For estimating impairments such as drowsiness, the PD measures obtained during about a minute's time could be used to form the Mean Planned Deviation measure for evaluation. The Mean Planned Deviation value may advantageously be continuously updated.
- In addition to, or as an alternative to, the MPD computation, the PD value may be used in other alternative evaluation algorithms, e.g. filters distributions etc, as indicated in a dashed line in Fig. 5.
- The MPD value may also be used for updating a threshold for whether a warning to the driver should be issued or not. As an example, the threshold adaptation may be made so as to always set the threshold in relation to the smallest MPD values obtained during a certain time period of a drive, i. e. a period during which the driver was planning his path well.
- In a final step, the MPD value and/or other evaluation algorithm values are compared to the threshold in order to make a decision whether to issue a warning to the driver or not. The warning could preferably be a warning suitable for attracting the attention of an impaired driver, such as an audible warning. Even though the warning could advantageously function so as to temporary wake up a drowsy driver, the purpose of the warning is to indicate to the driver that he should stop driving as soon as possible and take a rest.
- Although the described embodiment is of the preferred type where data representative of the state and the surrounding environment of the vehicle is retrieved and stored during an estimation period ΔtTS, and data from an interval ΔtPD is used to obtain a planned deviation measure, it is to be understood that the method of the invention may be used also in combination with systems where the situation within the time interval ΔtPD is estimated in advance, as an upcoming road situation from the first instant t1. Also, the variables used to determine the state of the vehicle and the planned path may be varied, and could include e.g. acceleration or deceleration. The lateral positions are believed to be most accurately determined if a lane-tracking system comprising a camera is used for determining the position of lane markings, but also other systems for lane tracking are possible. A system using the method according to the invention may optionally be integrated or used in combination with other systems such as an Adaptive Cruise Control system, a Lane Departure Warning system or a Lane Keeping Assist system. In addition, the person skilled in the art may readily imagine other alternative embodiments without departing from the invention.
Claims (16)
- Method for determining a measure for evaluation of the behaviour of a driver of a vehicle comprising
determining the lateral position of the vehicle in relation to a lane and the state of the vehicle at a first instant (t1),
determining the planned path which the vehicle would be expected follow from said first instant t1 considering the state of the vehicle at said first instant (t1),
determining the planned lateral position of the vehicle in relation to a lane at a second instant (t2) being a time interval (ΔtPD) after t1, if said planned path were followed, and
determining a planned deviation being the difference between the planned lateral position at the second instant (t2) and the lateral position at the first instant (t1). - Method according to claim 1, including calculating a number of planned deviation measures for evaluating the driver's ability.
- Method according to claim 2, including compiling said planned deviation measures to form a Mean Planned Deviation measure (MPD).
- Method according to claim 2 or 3, wherein said planned deviation measures are calculated at a selected frequency.
- Method according to any one of the claims 2 to 4, comprising comparing said planned deviation values or Mean Planned Deviation measure with a threshold value for classifying the driver's ability.
- Method according to claim 5, comprising a threshold determining algorithm wherein the driver's planned deviation values are determined during a selected interval of a ride, and said threshold value for that driver is set in relation to the planned deviation values obtained during the selected interval.
- Method according to any one of the previous claims, wherein the data representative of the state of the vehicle comprises data representative of the vehicle's speed and yaw rate.
- Method according to claim 7, wherein said planned path is calculated using the vehicle's position, speed and yaw rate at the first instant (t1) as indata.
- Method according to claim 8, wherein the planned path is calculated using a linear bicycle model.
- Method according to any one of the previous claims, wherein a lane-tracking system including a camera is used to determine the lateral positions.
- Method according to any one of the previous claims, comprising retrieving and storing data representative of the vehicle's state and retrieving and storing data representative of the surrounding environment of the vehicle at a first instant (t1), retrieving and storing data representative of the vehicle's state and retrieving and storing data representative of the surrounding environment of the vehicle during at least the interval (ΔTPD) after said first instant (t1),
using the data retrieved and stored during the interval (ΔtPD), for determining the planned lateral position of the vehicle at the second instant (t2). - Method according to any one of the previous claims, wherein the interval ΔtPD is >0 s, preferably > 0.5 s, most preferred > 2 s.
- Method according to any one of the previous claims, wherein the interval ΔtPD is selected in relation to traffic situation factors such as e.g. the vehicle's speed, the shape of the road travelled or the surrounding traffic.
- Method according to any one of the previous claims, wherein said data representative of the surrounding environment includes information regarding surrounding dynamic objects, such as surrounding traffic, and/or stationary objects.
- System for warning a driver using a method for determining a measure of a driver's behaviour according to any one of the preceding claims, and issuing or not issuing a warning based on said measure.
- Device for determining a measure for evaluation of the behaviour of a driver comprising means for performing the method according to any one of the claims 1 to 14.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP20040030208 EP1674375B1 (en) | 2004-12-20 | 2004-12-20 | Method for determining a measure for evaluating the behaviour of a driver of a vehicle |
DE200460019953 DE602004019953D1 (en) | 2004-12-20 | 2004-12-20 | Method for determining a measure for evaluating the behavior of a motor vehicle driver |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP20040030208 EP1674375B1 (en) | 2004-12-20 | 2004-12-20 | Method for determining a measure for evaluating the behaviour of a driver of a vehicle |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1674375A1 true EP1674375A1 (en) | 2006-06-28 |
EP1674375B1 EP1674375B1 (en) | 2009-03-11 |
Family
ID=34927879
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP20040030208 Active EP1674375B1 (en) | 2004-12-20 | 2004-12-20 | Method for determining a measure for evaluating the behaviour of a driver of a vehicle |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP1674375B1 (en) |
DE (1) | DE602004019953D1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009037029A1 (en) * | 2007-09-14 | 2009-03-26 | Robert Bosch Gmbh | Method for controlling a driver assistance system |
US20120277957A1 (en) * | 2010-04-15 | 2012-11-01 | Satoru Inoue | Driving assist device |
JP2013089233A (en) * | 2011-10-17 | 2013-05-13 | Hyundai Motor Co Ltd | Driving concentration degree determination method for vehicle operation state information base and system therefor |
CN117217422A (en) * | 2023-11-07 | 2023-12-12 | 国汽(北京)智能网联汽车研究院有限公司 | Vehicle motion control capability assessment method, system, device and medium thereof |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102015208208A1 (en) * | 2015-05-04 | 2016-11-10 | Robert Bosch Gmbh | Method and device for detecting a tiredness of a driver of a vehicle |
DE102020132607A1 (en) | 2020-12-08 | 2022-06-09 | Honda Motor Co., Ltd. | VEHICLE WITH ENHANCED LANE KEEPING ASSISTANCE SYSTEM |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5821860A (en) * | 1996-05-20 | 1998-10-13 | Honda Giken Kogyo Kabushiki Kaisha | Driving condition-monitoring apparatus for automotive vehicles |
US5991675A (en) * | 1993-06-02 | 1999-11-23 | Honda Giken Kogyo Kabushiki Kaisha | Vehicle control system based on estimation of the driving skill of a vehicle operator |
EP0999520A2 (en) * | 1998-10-16 | 2000-05-10 | Fuji Jukogyo Kabushiki Kaisha | Driver's arousal level estimating apparatus for vehicle and method of estimating arousal level |
-
2004
- 2004-12-20 DE DE200460019953 patent/DE602004019953D1/en active Active
- 2004-12-20 EP EP20040030208 patent/EP1674375B1/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5991675A (en) * | 1993-06-02 | 1999-11-23 | Honda Giken Kogyo Kabushiki Kaisha | Vehicle control system based on estimation of the driving skill of a vehicle operator |
US5821860A (en) * | 1996-05-20 | 1998-10-13 | Honda Giken Kogyo Kabushiki Kaisha | Driving condition-monitoring apparatus for automotive vehicles |
EP0999520A2 (en) * | 1998-10-16 | 2000-05-10 | Fuji Jukogyo Kabushiki Kaisha | Driver's arousal level estimating apparatus for vehicle and method of estimating arousal level |
Non-Patent Citations (4)
Title |
---|
CHIU-FENG LIN ET AL: "Vehicle dynamics and external disturbance estimation for vehicle path prediction", IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY IEEE USA, vol. 8, no. 3, May 2000 (2000-05-01), pages 508 - 518, XP002329365, ISSN: 1063-6536 * |
LEBLANC D J ET AL: "CAPC: an implementation of a road-departure warning system", CONTROL APPLICATIONS, 1996., PROCEEDINGS OF THE 1996 IEEE INTERNATIONAL CONFERENCE ON DEARBORN, MI, USA 15-18 SEPT. 1996, NEW YORK, NY, USA,IEEE, US, 15 September 1996 (1996-09-15), pages 590 - 595, XP010199456, ISBN: 0-7803-2975-9 * |
P. H. BATAVIA, D. A. POMERLEAU, C. E. THORPE.: "Predicting lane position for roadway departure prevention", IEEE INTELLIGENT VEHICLES 1998 SYMPOSIUM, 28 October 1998 (1998-10-28) - 30 October 1998 (1998-10-30), STUTTGART, GERMANY, pages 5 - 10 * |
P. H. BATAVIA, D. A. POMERLEAU, C. E. THORPE.: "Predicting lane position for roadway departure prevention", October 1998 (1998-10-01), XP002329364, Retrieved from the Internet <URL:http://www-2.cs.cmu.edu/~parag/research/papers/IV98/0152.pdf> [retrieved on 20050523] * |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009037029A1 (en) * | 2007-09-14 | 2009-03-26 | Robert Bosch Gmbh | Method for controlling a driver assistance system |
US8364341B2 (en) | 2007-09-14 | 2013-01-29 | Robert Bosch Gmbh | Method for controlling a driver assistance system |
CN101801753B (en) * | 2007-09-14 | 2014-09-03 | 罗伯特·博世有限公司 | Method for controlling a driver assistance system |
US20120277957A1 (en) * | 2010-04-15 | 2012-11-01 | Satoru Inoue | Driving assist device |
JP2013089233A (en) * | 2011-10-17 | 2013-05-13 | Hyundai Motor Co Ltd | Driving concentration degree determination method for vehicle operation state information base and system therefor |
CN117217422A (en) * | 2023-11-07 | 2023-12-12 | 国汽(北京)智能网联汽车研究院有限公司 | Vehicle motion control capability assessment method, system, device and medium thereof |
CN117217422B (en) * | 2023-11-07 | 2024-03-22 | 国汽(北京)智能网联汽车研究院有限公司 | Vehicle motion control capability assessment method, system, device and medium thereof |
Also Published As
Publication number | Publication date |
---|---|
EP1674375B1 (en) | 2009-03-11 |
DE602004019953D1 (en) | 2009-04-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11113970B2 (en) | Apparatus and method of safety support for vehicle | |
US11164459B2 (en) | Apparatus and method of safety support for vehicle | |
JP7173105B2 (en) | AUTOMATIC OPERATION CONTROL DEVICE, AUTOMATIC OPERATION CONTROL METHOD, PROGRAM, AND AUTOMATIC OPERATION CONTROL SYSTEM | |
US9623874B2 (en) | System and method for managing dangerous driving index for vehicle | |
EP3059134B1 (en) | Drive assist apparatus | |
EP2495713B1 (en) | Driving support device | |
US7266438B2 (en) | Method of assisting driver to negotiate a roadway | |
EP2201496B1 (en) | Inattentive state determination device and method of determining inattentive state | |
US8924074B2 (en) | Driving assistance system for vehicle and vehicle equipped with driving assistance system for vehicle | |
US7610121B2 (en) | Vehicle operation support apparatus | |
US8260501B2 (en) | Awake state estimation device | |
CN110531661B (en) | Automatic following control method, device and equipment for vehicle | |
US20080186154A1 (en) | Method and Device for Driver Support | |
US20110320163A1 (en) | Method and system for determining road data | |
CN110688877B (en) | Danger early warning method, device, equipment and storage medium | |
JPH08178712A (en) | Rambling-drive detection apparatus | |
JP4529394B2 (en) | Driver's vehicle driving characteristic estimation device | |
EP1674375B1 (en) | Method for determining a measure for evaluating the behaviour of a driver of a vehicle | |
JP3319201B2 (en) | Inattentive driving judgment device | |
JP2004149035A (en) | Vehicle follow-driving control device | |
US20190147264A1 (en) | Concentration determination apparatus, concentration determination method, and program for concentration determination | |
EP1672389B1 (en) | Method for estimating a traffic situation | |
CN115257813A (en) | Intelligent driving control method through construction obstacle and vehicle | |
JP2018094294A (en) | State estimation system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR LV MK YU |
|
17P | Request for examination filed |
Effective date: 20061222 |
|
AKX | Designation fees paid |
Designated state(s): DE GB SE |
|
17Q | First examination report despatched |
Effective date: 20070419 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: LEVIN, DANIEL Inventor name: BRAENNSTROEM, MATTIAS Inventor name: BIRK, WOLFGANG |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: LEVIN, DANIEL Inventor name: BRAENNSTROEM, MATTIAS Inventor name: BIRK, WOLFGANG |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE GB SE |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REF | Corresponds to: |
Ref document number: 602004019953 Country of ref document: DE Date of ref document: 20090423 Kind code of ref document: P |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20091214 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20111020 AND 20111025 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602004019953 Country of ref document: DE Representative=s name: MEISSNER, BOLTE & PARTNER GBR, DE |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602004019953 Country of ref document: DE Representative=s name: MEISSNER, BOLTE & PARTNER GBR, DE Effective date: 20120207 Ref country code: DE Ref legal event code: R081 Ref document number: 602004019953 Country of ref document: DE Owner name: VOLVO CAR CORPORATION, SE Free format text: FORMER OWNER: FORD GLOBAL TECHNOLOGIES, LLC, DEARBORN, MICH., US Effective date: 20120207 Ref country code: DE Ref legal event code: R081 Ref document number: 602004019953 Country of ref document: DE Owner name: VOLVO CAR CORPORATION, SE Free format text: FORMER OWNER: FORD GLOBAL TECHNOLOGIES, LLC, DEARBORN, US Effective date: 20120207 Ref country code: DE Ref legal event code: R082 Ref document number: 602004019953 Country of ref document: DE Representative=s name: MEISSNER BOLTE PATENTANWAELTE RECHTSANWAELTE P, DE Effective date: 20120207 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SE Payment date: 20191113 Year of fee payment: 16 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20191108 Year of fee payment: 16 |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: EUG |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20201220 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201220 Ref country code: SE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201221 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20221122 Year of fee payment: 19 |