CN116834751A - Active fatigue driving monitoring and early warning method, device and equipment - Google Patents
Active fatigue driving monitoring and early warning method, device and equipment Download PDFInfo
- Publication number
- CN116834751A CN116834751A CN202310770871.0A CN202310770871A CN116834751A CN 116834751 A CN116834751 A CN 116834751A CN 202310770871 A CN202310770871 A CN 202310770871A CN 116834751 A CN116834751 A CN 116834751A
- Authority
- CN
- China
- Prior art keywords
- early warning
- vehicle
- triggering
- time
- driver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000012544 monitoring process Methods 0.000 title claims abstract description 35
- 238000001514 detection method Methods 0.000 claims abstract description 38
- 230000001960 triggered effect Effects 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 8
- 206010016256 fatigue Diseases 0.000 description 34
- 230000008569 process Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 6
- 230000001276 controlling effect Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001105 regulatory effect Effects 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 206010048232 Yawning Diseases 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000003542 behavioural effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 210000001097 facial muscle Anatomy 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 230000006461 physiological response Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
- B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
- B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
- B60K28/063—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver preventing starting of vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
- B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
- B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
- B60K28/066—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver actuating a signalling device
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K31/00—Vehicle fittings, acting on a single sub-unit only, for automatically controlling vehicle speed, i.e. preventing speed from exceeding an arbitrarily established velocity or maintaining speed at a particular velocity, as selected by the vehicle operator
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W50/16—Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3679—Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3679—Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities
- G01C21/3685—Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities the POI's being parking facilities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
- B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Mechanical Engineering (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Transportation (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Emergency Management (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses an active fatigue driving monitoring and early warning method, device, equipment and storage medium, which comprises the following steps: when the starting of the vehicle is detected and the vehicle is in a running state, acquiring the vehicle state comprising the speed per hour and the gear of the vehicle, and acquiring face images of a driver through a camera at preset interval time; when the driving time length reaches the early warning detection time, judging that the acquired face image and the vehicle state meet the early warning condition, and triggering corresponding risk early warning measures according to the early warning detection time; and after the driver is confirmed to correspondingly execute the risk early warning measures, the starting or closing of the vehicle engine is managed in preset time according to preset starting conditions. The fatigue driving possibility can be actively stopped, multiple fatigue driving accidents can be radically stopped, potential risks are reduced, and driving safety of a driver is improved.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to an active fatigue driving monitoring and early warning method, device and equipment.
Background
According to the 'road traffic safety law enforcement regulation', the motor vehicle is driven to stop for more than 4 hours for no less than 20 minutes, the regulation is formulated to be active intervention on fatigue driving, and the method belongs to early prevention, but because each person has insufficient cognition on the person and overestimates the ability of the person, the driving time is considered to be irrelevant, and the safety regulation is observed less, which is one of the root causes of frequent accidents caused by fatigue driving.
However, according to incomplete statistics, more than 60% of traffic accidents are related to fatigue driving each year, based on this, a fatigue driving early warning system (DMS) is generated, and the current DMS principle is a monitoring technology based on that a camera recognizes physiological response characteristics (such as eyeballs, facial muscles, yawns, etc.) of a driver, because the system recognizes physiological characteristics of the face of the driver after fatigue driving behavior has occurred, and thus, the system performs early warning on the recognized physiological characteristics of the face of the driver after fatigue occurrence, and belongs to a passive fatigue driving early warning system, which has the following disadvantages: because of individual differences, each person reacts differently to the behavioral characteristics exhibited by fatigue, and thus the system may risk misjudgement or unrecognizable deep fatigue of the person's underlying layer; the system belongs to post-monitoring early warning, actual fatigue driving already occurs, and fatigue process (such as mild-moderate-physical fatigue reaction derived from physiology) of a driver cannot be effectively interfered.
Disclosure of Invention
In view of the above, the invention aims to provide an active fatigue driving monitoring and early warning method, device and equipment, which aim to solve the problems that the existing fatigue driving early warning belongs to a passive type and can not effectively interfere with the driving process of a driver.
In order to achieve the above purpose, the present invention provides an active fatigue driving monitoring and early warning method, which comprises:
when the starting of the vehicle is detected and the vehicle is in a running state, acquiring the vehicle state comprising the speed per hour and the gear of the vehicle, and acquiring face images of a driver through a camera at preset interval time;
when the driving time length reaches the early warning detection time, judging that the acquired face image and the vehicle state meet the early warning condition, and triggering corresponding risk early warning measures according to the early warning detection time;
and after the driver is confirmed to correspondingly execute the risk early warning measures, the starting or closing of the vehicle engine is managed in preset time according to preset starting conditions.
Preferably, when the face image and the vehicle state obtained by the judgment meet the early warning condition, triggering a corresponding risk early warning measure according to the early warning detection time, including:
and when the obtained face image is the same person and the vehicle speed is greater than 0km/h and the ratio is greater than a first preset ratio in the driving duration, triggering corresponding risk early warning measures according to early warning detection time.
Preferably, when the face image and the vehicle state obtained by the judgment meet the early warning condition, triggering a corresponding risk early warning measure according to the early warning detection time, including:
and when the obtained face image is judged to be the same person and the vehicle gear is in the forward gear state in the driving time length, the corresponding risk early warning measures are triggered according to the early warning detection time.
Preferably, the triggering the corresponding risk early warning measures according to the early warning detection time includes:
when the driving duration reaches the first time, triggering a first risk early warning measure, wherein the first risk early warning measure comprises triggering a loudspeaker to conduct voice reminding and triggering a navigation module to automatically search a nearby service area or parking lot and conduct voice broadcasting through the loudspeaker to corresponding positions and distances.
Preferably, the triggering the corresponding risk early warning measures according to the early warning detection time includes:
when the driving duration reaches a second time, triggering a second risk early warning measure, wherein the second risk early warning measure comprises triggering a loudspeaker to carry out voice reminding, triggering a navigation module to automatically search a nearby service area or parking lot, carrying out voice broadcasting corresponding position and distance through the loudspeaker, controlling steering wheel vibration and limiting the speed of the vehicle to a first speed.
Preferably, the triggering the corresponding risk early warning measures according to the early warning detection time includes:
when the driving duration reaches a third time, triggering a third risk early warning measure, wherein the third risk early warning measure comprises triggering a loudspeaker to carry out voice reminding, triggering a navigation module to automatically search a nearby service area or parking lot, carrying out voice broadcasting corresponding position and distance through the loudspeaker, controlling steering wheel vibration, limiting the speed of a vehicle to a second speed, tensioning a safety belt and opening a double-flash warning.
Preferably, after the driver is confirmed to execute the risk early warning measures, the vehicle engine is started or closed according to a preset starting condition within a preset time, including:
after the driver is confirmed to reach the parking position and the engine is closed, when the closing time of the engine is judged to not reach the preset time, the camera is triggered to collect the face image of the driver and identify whether the face image is the same person, if so, the vehicle engine cannot be started until the closing time of the engine reaches the preset time.
In order to achieve the above purpose, the present invention further provides an active fatigue driving monitoring and early warning device, which comprises:
the system comprises an acquisition unit, a camera and a control unit, wherein the acquisition unit is used for acquiring the vehicle state including the speed per hour and the gear of the vehicle when the vehicle is detected to be started and in a running state, and acquiring face images of a driver through the camera at preset interval time;
the monitoring unit is used for judging that the acquired face image and the vehicle state meet the early warning conditions when the driving duration reaches the early warning detection time, and triggering corresponding risk early warning measures according to the early warning detection time;
and the management unit is used for confirming that the driver carries out corresponding execution according to the risk early warning measures and then managing the starting or closing of the vehicle engine according to preset starting conditions within preset time.
In order to achieve the above objective, the present invention further provides an apparatus, which includes a processor, a memory, and a computer program stored in the memory, where the computer program is executed by the processor to implement the steps of an active fatigue driving monitoring and early warning method according to the above embodiment.
In order to achieve the above objective, the present invention further provides a computer readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the steps of an active fatigue driving monitoring and early warning method according to the above embodiment.
The beneficial effects are that:
according to the scheme, the vehicle state and the face image of the driver are acquired in the driving process, when the early warning detection time is reached during driving, whether the acquired face image and the vehicle state meet the early warning condition is judged, and then the corresponding risk early warning measures are triggered according to the early warning detection time to perform early warning, so that the possibility of fatigue driving can be actively stopped, multiple fatigue driving accidents can be fundamentally stopped, the potential risk is reduced, and the driving safety of the driver is improved.
According to the scheme, corresponding risk early warning measures are triggered according to the preset different early warning detection times, and the vehicle can be managed to execute different degrees of processing strategies according to different time points reached by the driving duration, so that the flexibility of fatigue driving early warning is improved.
According to the scheme, after the driver is confirmed to reach the parking position and the engine is closed, whether the closing time of the engine reaches the preset time is judged, if not, whether the face image of the driver is the same as the face image of the driver before closing is further recognized, if so, the face image of the driver cannot be started, the rest time of the driver is at least the preset time, and the reliability of fatigue driving monitoring and the driving safety of the driver are improved.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of an active fatigue driving monitoring and early warning method according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of an active fatigue driving monitoring and early warning device according to an embodiment of the present invention.
The realization of the object, the functional characteristics and the advantages of the invention will be further described with reference to the accompanying drawings in connection with the embodiments.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments. All other embodiments, based on the embodiments of the invention, which are apparent to those of ordinary skill in the art without inventive faculty, are intended to be within the scope of the invention. Thus, the following detailed description of the embodiments of the invention, as presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, based on the embodiments of the invention, which are apparent to those of ordinary skill in the art without inventive faculty, are intended to be within the scope of the invention.
In the description of the present invention, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature.
The following describes the invention in detail with reference to examples.
Referring to fig. 1, a flow chart of an active fatigue driving monitoring and early warning method according to an embodiment of the invention is shown.
In this embodiment, the method includes:
s11, when the starting of the vehicle is detected and the vehicle is in a running state, the vehicle state comprising the speed per hour and the gear of the vehicle is collected, and face images of a driver are collected through a camera at preset interval time.
In this embodiment, the vehicle-mounted host is installed in the center console, the camera is installed behind the steering wheel or in front of the driver capable of recognizing the face of the driver, after the vehicle is started, the automobile is in the D gear, after the vehicle-mounted host recognizes the D gear, the camera synchronously collects the face of the driver, for example, the camera is controlled to collect the face image of the driver every 10 minutes, and in the running process of the vehicle (before the vehicle is stopped and the engine is turned off), the vehicle-mounted host recognizes and records information including the speed of the vehicle and the gear where the vehicle is located in the time period in real time.
And S12, when the driving duration reaches the early warning detection time, judging that the acquired face image and the vehicle state meet the early warning condition, and triggering corresponding risk early warning measures according to the early warning detection time.
When the face image and the vehicle state obtained by judgment meet the early warning condition, triggering corresponding risk early warning measures according to the early warning detection time, wherein the method comprises the following steps:
and when the obtained face image is the same person and the vehicle speed is greater than 0km/h and the ratio is greater than a first preset ratio in the driving duration, triggering corresponding risk early warning measures according to early warning detection time. Or alternatively, the process may be performed,
and when the obtained face image is judged to be the same person and the vehicle gear is in the forward gear state in the driving time length, the corresponding risk early warning measures are triggered according to the early warning detection time.
In this embodiment, the monitoring time module built in the vehicle-mounted host monitors the continuous driving time of the driver, and the module presets early warning at various different time points, and each time point can be adjusted according to the actual requirement of the user, for example, the first time point is included: engine start time exceeded 3 hours, second time point: engine start time exceeded 3.5 hours, third time point: the engine starting time exceeds 4 hours; and further triggering risk early warning measures of different grades according to different time points so as to control the vehicle to make corresponding reactions and prompt the user in time.
Specifically, when the driving duration of the vehicle reaches the time point preset by the monitoring time module, further judging that the face image acquired by the camera in the time period is the same person, and synchronously identifying and recording the recording information that the speed per hour of the vehicle in the time period is greater than 0km/h by the vehicle-mounted host machine every 10 minutes, wherein the ratio of the recording information is greater than the preset ratio, if the ratio is greater than 90% (assuming that the vehicle running time at the first time point is 3 hours, the host machine collects the vehicle speed every 10 minutes, and the total vehicle speed records of 18 times are collected for 3 hours, if 17 times of speed records are greater than 0km/h, namely the recording ratio of greater than 0km/h is 17/18=94%, the ratio is greater than 90%); or when the face images acquired by the cameras in the time period are judged to be the same person, and vehicle gear information in the time period is synchronously identified and recorded every 10 minutes through the vehicle-mounted host, wherein the gear is the gear of the vehicle with the D gear with the ratio being larger than a preset proportion, for example, the gear is larger than 90% (assuming that the vehicle driving time at the first time point is 3 hours, the host acquires the vehicle gear information every 10 minutes, 18 times of vehicle gear records are acquired in total in 3 hours, and if 17 times of gear records are in the D gear, namely, the gear record accounts for 17/18=94%, the gear is larger than 90%), and corresponding risk early warning measures are triggered according to early warning monitoring time. In practical application, other shorter time intervals can be set according to practical requirements to make acquisition interval time, theoretically, the shorter the acquisition interval time is, the more information records are acquired, the more the calculated occupancy value is close to the practical driving condition, so that the reliability of early warning is improved.
Further, the triggering the corresponding risk early warning measures according to the early warning detection time includes:
when the driving duration reaches the first time, triggering a first risk early warning measure, wherein the first risk early warning measure comprises triggering a loudspeaker to conduct voice reminding and triggering a navigation module to automatically search a nearby service area or parking lot and conduct voice broadcasting through the loudspeaker to corresponding positions and distances.
Further, the triggering the corresponding risk early warning measures according to the early warning detection time includes:
when the driving duration reaches a second time, triggering a second risk early warning measure, wherein the second risk early warning measure comprises triggering a loudspeaker to carry out voice reminding, triggering a navigation module to automatically search a nearby service area or parking lot, carrying out voice broadcasting corresponding position and distance through the loudspeaker, controlling steering wheel vibration and limiting the speed of the vehicle to a first speed.
Further, the triggering the corresponding risk early warning measures according to the early warning detection time includes:
when the driving duration reaches a third time, triggering a third risk early warning measure, wherein the third risk early warning measure comprises triggering a loudspeaker to carry out voice reminding, triggering a navigation module to automatically search a nearby service area or parking lot, carrying out voice broadcasting corresponding position and distance through the loudspeaker, controlling steering wheel vibration, limiting the speed of a vehicle to a second speed, tensioning a safety belt and opening a double-flash warning.
In this embodiment, when the driving time reaches a preset first time early warning point after the engine is started, and the acquired face image and the vehicle state are judged to meet the early warning condition, a primary risk early warning measure is triggered; for example, the corresponding primary risk early warning measures include: the voice broadcasting module triggers, the loudspeaker broadcasts the voice that the driving time is more than 3 hours, please find the parking position nearby to rest ", synchronously issues the instruction to the central control to trigger the navigation module, navigation searches the nearby service area or parking area information, and the navigation voice recommends the nearest service area or parking area and inquires whether to go to? And actively broadcasting information such as information materials, distance, expected arrival time and the like of the associated position.
When the driving time reaches a preset second time early warning point after the engine is started, triggering a medium-level risk early warning measure by judging that the acquired face image and the vehicle state meet the early warning conditions; for example, the corresponding medium risk early warning measures include: the voice broadcasting module triggers, the loudspeaker voice broadcasts that the driving time is more than 3.5 hours, fatigue driving is warned and a parking position rest is found nearby as soon as possible, the steering wheel vibration module triggers the steering wheel vibration/host to issue instructions, the steering wheel speed limiting module triggers, the vehicle is limited to 80km/h, the vehicle owner is reminded of voice that the vehicle is at risk of fatigue driving currently, the vehicle is regulated to 80km/h, the central control issues instruction and the navigation module triggers, navigation synchronously searches for information of a nearby service area or parking lot, and navigation voice recommends the nearest service area or parking lot and inquires whether to go to? And actively broadcasting information such as information, distance, arrival time and the like of the associated position.
When the driving time reaches a preset third time early warning point after the engine is started, and the acquired face image and the vehicle state are judged to meet the early warning condition, triggering advanced risk early warning measures, for example, the corresponding advanced risk early warning measures comprise: the voice broadcasting module triggers, the loudspeaker voice broadcasts that the driving time is more than 4 hours, and according to the 'regulations of road traffic safety law', for the personal safety of you and families, please keep safe driving and find the rest/host of the parking position nearby to issue instructions, the steering wheel speed limiting module triggers, the speed limit of the vehicle is limited to 60km/h, the voice prompts the owner that the vehicle is currently involved in fatigue driving, the vehicle is regulated to be limited to 60km/h, the safety belt pre-tightening control device triggers, the pre-tightening device works, the safety belt is tightened, the restraint force on the passenger is strengthened, the webbing is locked to prevent the body of the passenger from tilting forward, so as to effectively protect the safety of the passenger, the vehicle is opened by double flashing, the surrounding vehicles are warned by double flashing, the navigation module triggers are issued synchronously, the navigation searches for the information of the nearby service area or parking lot, and the information of the relevant position, the distance, the arrival time and the like are recommended by the navigation voice and the information of the relevant position/the vehicle is broadcasted actively.
The first time and the second time early warning points belong to pre-precaution early warning, mainly play a role in reminding a driver, and if the corresponding early warning measures are implemented, the driver continues to travel without executing other processing measures; after the advanced risk early warning measures corresponding to the third time early warning point are implemented, the vehicle double-flashing instruction continues to be executed and can not be closed before the driver reaches the parking position and the engine is not closed, and the voice warning driver's speed limiting module of the vehicle will execute speed limiting reduction by 10km/h every 5 minutes until the vehicle is stopped', so as to prompt the driver to stop and rest at the right speed.
And S13, after the driver is confirmed to correspondingly execute the risk early warning measures, the starting or closing of the vehicle engine is managed within preset time according to preset starting conditions.
Further, after the driver is confirmed to execute the risk early warning measures, the vehicle engine is started or closed according to a preset starting condition within a preset time, including:
after the driver is confirmed to reach the parking position and the engine is closed, when the closing time of the engine is judged to not reach the preset time, the camera is triggered to collect the face image of the driver and identify whether the face image is the same person, if so, the vehicle engine cannot be started until the closing time of the engine reaches the preset time.
In this embodiment, after the risk early warning measures are triggered, the driver reaches the parking position and turns off the engine, and after the engine is turned off in a preset manner, if the preset time (such as 20 minutes) for turning off the engine is not met, the driver needs to start the engine again, the camera is powered on first by default and triggered first, the face of the driver is collected through the camera, if the camera identifies the same driver, the engine cannot be started, if the camera identifies different drivers, the engine can be started, and if the engine is turned off for 20 minutes, the engine can be directly started.
Referring to fig. 2, a schematic structural diagram of an active fatigue driving monitoring and early warning device according to an embodiment of the present invention is shown.
In this embodiment, the apparatus 20 includes:
the acquisition unit 21 is used for acquiring the vehicle state including the speed per hour and the gear of the vehicle when the vehicle is detected to be started and in a running state, and acquiring face images of a driver through a camera at preset interval time;
the monitoring unit 22 is configured to trigger a corresponding risk early warning measure according to the early warning detection time when the driving duration reaches the early warning detection time and the acquired face image and the vehicle state are judged to meet the early warning condition;
and the management unit 23 is used for managing the starting or closing of the vehicle engine according to the preset starting condition in the preset time after confirming that the driver performs corresponding execution according to the risk early warning measures.
The respective unit modules of the apparatus 20 may perform the corresponding steps in the above method embodiments, so that the detailed description of the respective unit modules is omitted herein.
The embodiment of the invention also provides equipment, which comprises the active fatigue driving monitoring and early warning device, wherein the active fatigue driving monitoring and early warning device can adopt the structure of the embodiment of fig. 2, correspondingly, the technical scheme of the embodiment of the method shown in fig. 1 can be executed, the implementation principle and the technical effect are similar, and detailed description can be referred to relevant records in the embodiment, and the details are not repeated.
The apparatus comprises: a device with a photographing function such as a mobile phone, a digital camera or a tablet computer, or a device with an image processing function, or a device with an image display function. The device may include a memory, a processor, an input unit, a display unit, a power source, and the like.
The memory may be used to store software programs and modules, and the processor executes the software programs and modules stored in the memory to perform various functional applications and data processing. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (e.g., an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created according to the use of the device, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory may also include a memory controller to provide access to the memory by the processor and the input unit.
The input unit may be used to receive input digital or character or image information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. Specifically, the input unit of the present embodiment may include a touch-sensitive surface (e.g., a touch display screen) and other input devices in addition to the camera.
The display unit may be used to display information entered by a user or provided to a user as well as various graphical user interfaces of the device, which may be composed of graphics, text, icons, video and any combination thereof. The display unit may include a display panel, and alternatively, the display panel may be configured in the form of an LCD (Liquid Crystal Display ), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch-sensitive surface may overlay the display panel, and upon detection of a touch operation thereon or thereabout, the touch-sensitive surface is communicated to the processor to determine the type of touch event, and the processor then provides a corresponding visual output on the display panel based on the type of touch event.
The embodiment of the present invention also provides a computer readable storage medium, which may be a computer readable storage medium contained in the memory in the above embodiment; or may be a computer-readable storage medium, alone, that is not assembled into a device. The computer readable storage medium stores at least one instruction, and the instruction is loaded and executed by the processor to realize the active fatigue driving monitoring and early warning method shown in fig. 1. The computer readable storage medium may be a read-only memory, a magnetic disk or optical disk, etc.
It should be noted that, in the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described as different from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other. For the device embodiments, the apparatus embodiments and the storage medium embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.
Also, herein, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
While the foregoing description illustrates and describes the preferred embodiments of the present invention, it is to be understood that the invention is not limited to the forms disclosed herein, but is not to be construed as limited to other embodiments, but is capable of use in various other combinations, modifications and environments and is capable of changes or modifications within the scope of the inventive concept, either as described above or as a matter of skill or knowledge in the relevant art. And that modifications and variations which do not depart from the spirit and scope of the invention are intended to be within the scope of the appended claims.
Claims (10)
1. An active fatigue driving monitoring and early warning method is characterized by comprising the following steps:
when the starting of the vehicle is detected and the vehicle is in a running state, acquiring the vehicle state comprising the speed per hour and the gear of the vehicle, and acquiring face images of a driver through a camera at preset interval time;
when the driving time length reaches the early warning detection time, judging that the acquired face image and the vehicle state meet the early warning condition, and triggering corresponding risk early warning measures according to the early warning detection time;
and after the driver is confirmed to correspondingly execute the risk early warning measures, the starting or closing of the vehicle engine is managed in preset time according to preset starting conditions.
2. The method for monitoring and early warning of active fatigue driving according to claim 1, wherein when the face image and the vehicle state obtained by the judgment meet the early warning condition, triggering the corresponding risk early warning measures according to the early warning detection time comprises:
and when the obtained face image is the same person and the vehicle speed is greater than 0km/h and the ratio is greater than a first preset ratio in the driving duration, triggering corresponding risk early warning measures according to early warning detection time.
3. The method for monitoring and early warning of active fatigue driving according to claim 1, wherein when the face image and the vehicle state obtained by the judgment meet the early warning condition, triggering the corresponding risk early warning measures according to the early warning detection time comprises:
and when the obtained face image is judged to be the same person and the vehicle gear is in the forward gear state in the driving time length, the corresponding risk early warning measures are triggered according to the early warning detection time.
4. The method for active fatigue driving monitoring and early warning according to claim 1, wherein the triggering the corresponding risk early warning measures according to the early warning detection time comprises:
when the driving duration reaches the first time, triggering a first risk early warning measure, wherein the first risk early warning measure comprises triggering a loudspeaker to conduct voice reminding and triggering a navigation module to automatically search a nearby service area or parking lot and conduct voice broadcasting through the loudspeaker to corresponding positions and distances.
5. The method for active fatigue driving monitoring and early warning according to claim 1, wherein the triggering the corresponding risk early warning measures according to the early warning detection time comprises:
when the driving duration reaches a second time, triggering a second risk early warning measure, wherein the second risk early warning measure comprises triggering a loudspeaker to carry out voice reminding, triggering a navigation module to automatically search a nearby service area or parking lot, carrying out voice broadcasting corresponding position and distance through the loudspeaker, controlling steering wheel vibration and limiting the speed of the vehicle to a first speed.
6. The method for active fatigue driving monitoring and early warning according to claim 1, wherein the triggering the corresponding risk early warning measures according to the early warning detection time comprises:
when the driving duration reaches a third time, triggering a third risk early warning measure, wherein the third risk early warning measure comprises triggering a loudspeaker to carry out voice reminding, triggering a navigation module to automatically search a nearby service area or parking lot, carrying out voice broadcasting corresponding position and distance through the loudspeaker, controlling steering wheel vibration, limiting the speed of a vehicle to a second speed, tensioning a safety belt and opening a double-flash warning.
7. The method for monitoring and early warning of active fatigue driving according to claim 1, wherein after the driver is confirmed to perform corresponding execution according to the risk early warning measure, the method for managing starting or closing of the vehicle engine according to a preset starting condition within a preset time comprises:
after the driver is confirmed to reach the parking position and the engine is closed, when the closing time of the engine is judged to not reach the preset time, the camera is triggered to collect the face image of the driver and identify whether the face image is the same person, if so, the vehicle engine cannot be started until the closing time of the engine reaches the preset time.
8. An active fatigue driving monitoring and early warning device, which is characterized by comprising:
the system comprises an acquisition unit, a camera and a control unit, wherein the acquisition unit is used for acquiring the vehicle state including the speed per hour and the gear of the vehicle when the vehicle is detected to be started and in a running state, and acquiring face images of a driver through the camera at preset interval time;
the monitoring unit is used for judging that the acquired face image and the vehicle state meet the early warning conditions when the driving duration reaches the early warning detection time, and triggering corresponding risk early warning measures according to the early warning detection time;
and the management unit is used for confirming that the driver carries out corresponding execution according to the risk early warning measures and then managing the starting or closing of the vehicle engine according to preset starting conditions within preset time.
9. An apparatus comprising a processor, a memory, and a computer program stored in the memory, the computer program being executable by the processor to perform the steps of an active fatigue driving monitoring and warning method according to any one of claims 1 to 7.
10. A computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and the computer program is executed by a processor to implement the steps of an active fatigue driving monitoring and early warning method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310770871.0A CN116834751A (en) | 2023-06-28 | 2023-06-28 | Active fatigue driving monitoring and early warning method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310770871.0A CN116834751A (en) | 2023-06-28 | 2023-06-28 | Active fatigue driving monitoring and early warning method, device and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116834751A true CN116834751A (en) | 2023-10-03 |
Family
ID=88169971
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310770871.0A Pending CN116834751A (en) | 2023-06-28 | 2023-06-28 | Active fatigue driving monitoring and early warning method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116834751A (en) |
-
2023
- 2023-06-28 CN CN202310770871.0A patent/CN116834751A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11407426B2 (en) | Collision warning method and apparatus | |
| CN1802273B (en) | Method and arrangement for controlling vehicular subsystems based on interpreted driver activity | |
| US11851077B2 (en) | Secondary disengage alert for autonomous vehicles | |
| CA2775819C (en) | System and method for integrating smartphone technology into a safety management platform to improve driver safety | |
| WO2018135318A1 (en) | Vehicle control apparatus and vehicle control method | |
| US8131440B2 (en) | Vehicle control system | |
| US9296299B2 (en) | Behavioral tracking and vehicle applications | |
| EP2513882B1 (en) | A predictive human-machine interface using eye gaze technology, blind spot indicators and driver experience | |
| US20210070309A1 (en) | Exhaustive Driving Analytical Systems and Modelers | |
| WO2014042571A1 (en) | Method and system for providing a tutorial message to a driver of a vehicle | |
| Morando et al. | Visual attention and steering wheel control: From engagement to disengagement of Tesla Autopilot | |
| US20220051340A1 (en) | System and Method Using Crowd-Sourced Data to Evaluate Driver Performance | |
| US11285966B2 (en) | Method and system for controlling an autonomous vehicle response to a fault condition | |
| Young et al. | What are Australian drivers doing behind the wheel?: An overview of secondary task data from the Australian naturalistic driving study | |
| US20200094820A1 (en) | Automatically assessing and reducing vehicular incident risk | |
| CN109541600A (en) | A kind of heavy type commercial automobile safe and intelligent driving assistance system | |
| CN113569698A (en) | Vehicle monitoring method, vehicle and computer readable storage medium | |
| CN116834751A (en) | Active fatigue driving monitoring and early warning method, device and equipment | |
| Xing et al. | The accuracy of Toyota vehicle control history data during autonomous emergency braking | |
| Karlsson | Evaluating driver distraction countermeasures | |
| CN104636723A (en) | Driving early warning method for analyzing particular object images based on video images | |
| CN116853265A (en) | Vehicle control method and device, vehicle and storage medium | |
| Shinde et al. | Rash driving detection system | |
| CN116524622A (en) | Omnibearing automatic driving recording method and device | |
| Carsten et al. | Driver Attentiveness to the Driving Task During ADAS Use |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |