CN112966664A - Fatigue driving detection method, system and device and readable storage medium - Google Patents
Fatigue driving detection method, system and device and readable storage medium Download PDFInfo
- Publication number
- CN112966664A CN112966664A CN202110356417.1A CN202110356417A CN112966664A CN 112966664 A CN112966664 A CN 112966664A CN 202110356417 A CN202110356417 A CN 202110356417A CN 112966664 A CN112966664 A CN 112966664A
- Authority
- CN
- China
- Prior art keywords
- fatigue driving
- face
- driver
- posture
- human eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 33
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims abstract description 22
- 238000000034 method Methods 0.000 claims abstract description 21
- 238000010521 absorption reaction Methods 0.000 claims abstract description 19
- 238000004590 computer program Methods 0.000 claims description 10
- 230000001815 facial effect Effects 0.000 abstract description 4
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Ophthalmology & Optometry (AREA)
- Traffic Control Systems (AREA)
Abstract
The application discloses a fatigue driving detection method, a system, a device and a computer readable storage medium, comprising: acquiring an infrared image of a preset area; analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to near infrared light; and judging whether the driver is fatigue driving or not by using the position of the face. The method and the device have the advantages that the absorption rate of water to near infrared light is different, the facial infrared image of the driver is accurately analyzed, the face position and the face state of the driver can be effectively judged, the accuracy of judging whether the driver is in fatigue driving according to the face position is improved subsequently, and the fatigue driving detection efficiency is improved.
Description
Technical Field
The invention relates to the field of automobiles, in particular to a method, a system and a device for detecting fatigue driving and a computer readable storage medium.
Background
With the development of technology, in order to improve driving safety, various high-technology products aiming at driving safety are gradually popularized.
At present, in traffic accidents, accidents caused by fatigue driving account for a large part, and the harmfulness of fatigue driving is promoted and popularized by traffic departments.
In order to further prevent fatigue driving, an efficient fatigue driving detection method is needed, which can detect fatigue driving of a driver in time so as to give an alarm in the following.
Disclosure of Invention
In view of the above, the present invention provides a method, a system, a device and a computer readable storage medium for detecting fatigue driving, which can efficiently detect fatigue driving of a driver. The specific scheme is as follows:
a method of detecting fatigue driving, comprising:
acquiring an infrared image of a preset area;
analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to near infrared light;
and judging whether the driver is in fatigue driving or not by using the position of the face.
Optionally, the process of analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to near infrared light includes:
the human face contour and the human eye position in the infrared image are identified by the absorption rate of water to the near infrared light of 1.94 um.
Optionally, after the position of the face is used to determine whether the driver is tired, the method further includes:
and if the driver is judged to be in fatigue driving, a prompt tone is given to warn the driver.
Optionally, the process of determining whether the driver is tired of driving by using the position of the face includes:
judging whether the face pose is in a preset face pose range or not by using the face contour;
judging whether the human eye posture is in a preset human eye posture range by using the human eye position;
and if the human face posture and the human eye posture are not in a preset range, judging that the driver is in fatigue driving.
The invention also discloses a fatigue driving detection system, which comprises:
the infrared image acquisition module is used for acquiring an infrared image of a preset area;
the human face position analysis module is used for analyzing the position of the human face of the driver in the infrared image by utilizing the absorptivity of water to near infrared light;
and the fatigue driving judging module is used for judging whether the driver is in fatigue driving by utilizing the position of the face.
Optionally, the face position analysis module is specifically configured to identify a face contour and a position of a human eye in the infrared image by using an absorption rate of water to 1.94um near-infrared light.
Optionally, the method further includes:
and the warning module is used for sending out a warning sound to warn the driver if the fatigue driving judgment module judges that the driver is in fatigue driving.
Optionally, the fatigue driving determination module includes:
the human face posture judging unit is used for judging whether the human face posture is in a preset human face posture range by utilizing the human face contour;
the human eye posture judging unit is used for judging whether the human eye posture is in a preset human eye posture range by utilizing the human eye position;
and the fatigue driving judging unit is used for judging the fatigue driving of the driver if the human face posture and the human eye posture are not in a preset range.
The invention also discloses a fatigue driving detection device, which comprises:
a memory for storing a computer program;
a processor for executing the computer program to implement the fatigue driving detection method as described above.
The invention also discloses a computer readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a fatigue driving detection method as described above.
The fatigue driving detection method comprises the following steps: acquiring an infrared image of a preset area; analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to near infrared light; and judging whether the driver is fatigue driving or not by using the position of the face.
According to the method, the infrared image of the face of the driver is accurately analyzed by utilizing different absorption rates of water to near infrared light, the face position and the face state of the driver can be effectively judged, the accuracy of judging whether the driver is in fatigue driving according to the face position subsequently is improved, and the fatigue driving detection efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic flow chart of a method for detecting fatigue driving according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of another fatigue driving detection method disclosed in the embodiment of the present invention;
fig. 3 is a schematic structural diagram of a fatigue driving detection system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention discloses a fatigue driving detection method, which is shown in figure 1 and comprises the following steps:
s11: and acquiring an infrared image of the preset area.
Specifically, whether the driver is in fatigue driving is judged according to changes of facial details and facial positions of the driver during normal driving and fatigue driving, and therefore an infrared image of a preset area is obtained to obtain a facial image of the driver.
Specifically, the preset region may be a region where the head is located when the driver drives normally, which is summarized according to historical experience.
S12: and analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to the near infrared light.
Specifically, the absorption rate of the near infrared light by water is different, areas with different moisture on the infrared image have chromaticity differences, processing such as binaryzation can be utilized, areas with much moisture and areas with little moisture are distinguished, for the human face, human eyes moisture is more, therefore, the position of the human eyes can be judged by analyzing the infrared image, the human face has more moisture content relative to the background in the vehicle, the outline of the human face in the vehicle can be judged, therefore, through analyzing the infrared image, the position of the human face of the driver can be obtained.
S13: and judging whether the driver is fatigue driving or not by using the position of the face.
Specifically, according to the historical summary rule, it is determined whether the position of the face is fatigue driving, for example, whether the face is too low, too far forward, or even whether the face is in the image, and whether the eyes are open, whether the opening degree is in a normal state, or not.
Therefore, the embodiment of the invention accurately analyzes the face infrared image of the driver by utilizing the different absorption rates of water to near infrared light, can effectively judge the face position and the face state of the driver, further improves the accuracy of judging whether the driver is in fatigue driving according to the face position subsequently, and improves the fatigue driving detection efficiency.
The embodiment of the invention discloses a specific method, and compared with the previous embodiment, the embodiment further explains and optimizes the technical scheme. Referring to fig. 2, specifically:
s21: acquiring an infrared image of a preset area;
s22: the human face contour and the human eye position in the infrared image are identified by the absorption rate of water to the near infrared light of 1.94 um.
Specifically, can utilize the high absorptivity of water to 1.94um near-infrared light, use 1.94 um's near-infrared light to shoot infrared image, and then improve infrared image's definition, in addition, also can consider to utilize 1.4um near-infrared light and 3um near-infrared light to carry out infrared image acquisition.
S23: and judging whether the face pose is in a preset face pose range or not by using the face contour.
Specifically, the preset human face posture is the position of the human face when the driver drives normally, and whether the position of the human face changes due to dozing caused by fatigue driving can be judged by judging whether the human face is low or not and judging whether the human face posture is different from the preset human face posture.
S24: and judging whether the human eye posture is in a preset human eye posture range by using the human eye position.
Specifically, the preset human eye posture range may be a size of opening of a person when the driver drives normally, and whether the driver drives due to fatigue can be determined by determining the size of opening of the person, for example, closing of human eyes due to squinting due to fatigue driving can be detected.
S25: and if the human face posture and the human eye posture are not in the preset range, judging that the driver is in fatigue driving.
Specifically, in order to ensure the accuracy of the detection results, it can be ensured that both the detection results are not in the preset range and then determined as fatigue driving, and when the determination mode is determined according to the actual application requirements, the person can change the determination mode, for example, fatigue driving is performed when any one of the detection results meets the requirement.
S26: if the driver is judged to be fatigue driving, a warning sound is given to warn the driver.
Specifically, after fatigue driving is judged, a prompt tone is played through corresponding playing equipment to warn a driver of current fatigue driving, and the driver is guided to pay attention to the state of the driver to carry out corresponding precautionary measures.
Correspondingly, the embodiment of the invention also discloses a fatigue driving detection system, which is shown in fig. 3 and comprises:
the infrared image acquisition module 11 is used for acquiring an infrared image of a preset area;
the human face position analysis module 12 is used for analyzing the position of the human face of the driver in the infrared image by utilizing the absorption rate of water to near infrared light;
and the fatigue driving judging module 13 is used for judging whether the driver is in fatigue driving according to the position of the face.
Therefore, the embodiment of the invention accurately analyzes the face infrared image of the driver by utilizing the different absorption rates of water to near infrared light, can effectively judge the face position and the face state of the driver, further improves the accuracy of judging whether the driver is in fatigue driving according to the face position subsequently, and improves the fatigue driving detection efficiency.
Specifically, the face position analysis module 12 is specifically configured to identify a face contour and a human eye position in the infrared image by using an absorption rate of water to near-infrared light of 1.94 um.
Specifically, the system can also comprise an alarm module; wherein,
and the warning module is used for giving out a prompt sound to warn the driver if the fatigue driving judging module 13 judges that the driver is in fatigue driving.
Specifically, the fatigue driving determination module 13 may include a human face posture determination unit, a human eye posture determination unit, and a fatigue driving determination unit; wherein,
the human face posture judging unit is used for judging whether the human face posture is in a preset human face posture range by using the human face contour;
the human eye posture judging unit is used for judging whether the human eye posture is in a preset human eye posture range by utilizing the human eye position;
and the fatigue driving judging unit is used for judging the fatigue driving of the driver if the human face posture and the human eye posture are not in the preset range.
In addition, the embodiment of the invention also discloses a fatigue driving detection device, which comprises:
a memory for storing a computer program;
a processor for executing a computer program to implement the fatigue driving detection method as described above.
In addition, the embodiment of the invention also discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and when being executed by a processor, the computer program realizes the fatigue driving detection method.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The technical content provided by the present invention is described in detail above, and the principle and the implementation of the present invention are explained in this document by applying specific examples, and the above description of the examples is only used to help understanding the method of the present invention and the core idea thereof; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A fatigue driving detection method, characterized by comprising:
acquiring an infrared image of a preset area;
analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to near infrared light;
and judging whether the driver is in fatigue driving or not by using the position of the face.
2. The fatigue driving detection method according to claim 1, wherein the process of analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to near-infrared light includes:
the human face contour and the human eye position in the infrared image are identified by the absorption rate of water to the near infrared light of 1.94 um.
3. The fatigue driving detection method according to claim 2, wherein after determining whether the driver is fatigued by using the position of the face, the method further comprises:
and if the driver is judged to be in fatigue driving, a prompt tone is given to warn the driver.
4. The fatigue driving detection method according to any one of claims 1 to 3, wherein the process of determining whether the driver is fatigue driving by using the position of the face includes:
judging whether the face pose is in a preset face pose range or not by using the face contour;
judging whether the human eye posture is in a preset human eye posture range by using the human eye position;
and if the human face posture and the human eye posture are not in a preset range, judging that the driver is in fatigue driving.
5. A fatigue driving detection system, comprising:
the infrared image acquisition module is used for acquiring an infrared image of a preset area;
the human face position analysis module is used for analyzing the position of the human face of the driver in the infrared image by utilizing the absorptivity of water to near infrared light;
and the fatigue driving judging module is used for judging whether the driver is in fatigue driving by utilizing the position of the face.
6. The fatigue driving detection system of claim 5, wherein the face position analysis module is specifically configured to identify a face contour and a human eye position in the infrared image by using an absorption rate of water to near infrared light of 1.94 um.
7. The fatigue driving detection system of claim 6, further comprising:
and the warning module is used for sending out a warning sound to warn the driver if the fatigue driving judgment module judges that the driver is in fatigue driving.
8. The fatigue driving detection system according to any one of claims 5 to 7, wherein the fatigue driving determination module includes:
the human face posture judging unit is used for judging whether the human face posture is in a preset human face posture range by utilizing the human face contour;
the human eye posture judging unit is used for judging whether the human eye posture is in a preset human eye posture range by utilizing the human eye position;
and the fatigue driving judging unit is used for judging the fatigue driving of the driver if the human face posture and the human eye posture are not in a preset range.
9. A fatigue driving detecting device, characterized by comprising:
a memory for storing a computer program;
a processor for executing the computer program to implement the fatigue driving detection method according to any one of claims 1 to 6.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the fatigue driving detection method according to any one of claims 1 to 6.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110356417.1A CN112966664A (en) | 2021-04-01 | 2021-04-01 | Fatigue driving detection method, system and device and readable storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110356417.1A CN112966664A (en) | 2021-04-01 | 2021-04-01 | Fatigue driving detection method, system and device and readable storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN112966664A true CN112966664A (en) | 2021-06-15 |
Family
ID=76280823
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110356417.1A Pending CN112966664A (en) | 2021-04-01 | 2021-04-01 | Fatigue driving detection method, system and device and readable storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112966664A (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104881956A (en) * | 2015-06-17 | 2015-09-02 | 上海大学 | Fatigue driving early warning system |
CN105069448A (en) * | 2015-09-29 | 2015-11-18 | 厦门中控生物识别信息技术有限公司 | True and false face identification method and device |
CN105769120A (en) * | 2016-01-27 | 2016-07-20 | 深圳地平线机器人科技有限公司 | Fatigue driving detection method and device |
CN106530623A (en) * | 2016-12-30 | 2017-03-22 | 南京理工大学 | Fatigue driving detection device and method |
-
2021
- 2021-04-01 CN CN202110356417.1A patent/CN112966664A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104881956A (en) * | 2015-06-17 | 2015-09-02 | 上海大学 | Fatigue driving early warning system |
CN105069448A (en) * | 2015-09-29 | 2015-11-18 | 厦门中控生物识别信息技术有限公司 | True and false face identification method and device |
CN105769120A (en) * | 2016-01-27 | 2016-07-20 | 深圳地平线机器人科技有限公司 | Fatigue driving detection method and device |
CN106530623A (en) * | 2016-12-30 | 2017-03-22 | 南京理工大学 | Fatigue driving detection device and method |
Non-Patent Citations (2)
Title |
---|
丁晓雯等: "《食品分析》", 31 August 2016 * |
丁轶峰等: "《掌纹掌脉融合识别技术及其在范地铁环境中的应用》", 31 January 2017 * |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5942761B2 (en) | Driving support device and driving support method | |
CN107697069B (en) | Intelligent control method for fatigue driving of automobile driver | |
CN109937152B (en) | Driving state monitoring method and device, driver monitoring system and vehicle | |
CN107554528B (en) | Fatigue grade detection method and device for driver and passenger, storage medium and terminal | |
CN110194174B (en) | Fatigue driving monitoring system | |
JP6754368B2 (en) | A method performed by a device for determining fatigue and / or sleep of a vehicle driver | |
CN105286802B (en) | Driver Fatigue Detection based on video information | |
JP5712968B2 (en) | Human detection device | |
US7868771B2 (en) | Doze-off warning apparatus for vehicle | |
JP4529394B2 (en) | Driver's vehicle driving characteristic estimation device | |
CN110879973A (en) | Driver fatigue state facial feature recognition and detection method | |
CN202088896U (en) | Motor vehicle safety control system based on driver face recognition | |
WO2013186984A1 (en) | Person detection device | |
JP7154959B2 (en) | Apparatus and method for recognizing driver's state based on driving situation judgment information | |
Lashkov et al. | Driver dangerous state detection based on OpenCV & dlib libraries using mobile video processing | |
KR102433668B1 (en) | Driver Monitoring System and method thereof | |
JP5349350B2 (en) | Eye opening degree determination device and eye opening degree determination method | |
JP4760113B2 (en) | Driver state estimation device | |
CN112966664A (en) | Fatigue driving detection method, system and device and readable storage medium | |
KR20190056520A (en) | Analysis Method for Forward Concentration using a Facial Expression Recognition Technology | |
JP6565305B2 (en) | Vehicle safe driving promotion method and vehicle safe driving promotion device | |
JP2018194961A (en) | Driver monitoring device, driver monitoring method, and driver monitoring program | |
KR101710007B1 (en) | Methods for linguistically modeling of driver's behavior and recognizing of driver's behavior, and systems for performing the same | |
JP2011086186A (en) | Sleepiness determination apparatus | |
JP2016207176A (en) | Vehicle safe driving promotion method and vehicle safe driving promotion device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210615 |