CN110910610A - Fatigue driving early warning system based on DSP - Google Patents

Fatigue driving early warning system based on DSP Download PDF

Info

Publication number
CN110910610A
CN110910610A CN201911159452.3A CN201911159452A CN110910610A CN 110910610 A CN110910610 A CN 110910610A CN 201911159452 A CN201911159452 A CN 201911159452A CN 110910610 A CN110910610 A CN 110910610A
Authority
CN
China
Prior art keywords
video
module
dsp
conversion module
driver
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911159452.3A
Other languages
Chinese (zh)
Inventor
王雨虹
吴振鑫
迟一璇
徐岩
闫恩增
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Liaoning Technical University
Original Assignee
Liaoning Technical University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Liaoning Technical University filed Critical Liaoning Technical University
Priority to CN201911159452.3A priority Critical patent/CN110910610A/en
Publication of CN110910610A publication Critical patent/CN110910610A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a fatigue driving early warning system based on DSP, comprising: the video acquisition module is used for acquiring a video picture of a driver; the video A/D conversion module is connected with the video acquisition module and is used for converting the analog video signal obtained by the video acquisition module into a digital video signal; the DSP data processing module is used for carrying out image preprocessing on the digital video signals converted by the video A/D conversion module, extracting human face characteristics and identifying and judging the fatigue degree of a driver through an algorithm; the loudspeaker assembly is used for carrying out sound alarm; and the braking module is used for decelerating the automobile. The invention uses the characteristics of the DSP to detect the human face and eyes, advances the characteristic parameters and analyzes the fatigue state of the driver through the characteristic parameters by using the DSP-based data processing technology, thereby realizing the real-time detection of the fatigue state of the driver, carrying out early warning processing by using signals such as sound and light and the like in time when the driving state is abnormal, and effectively improving the driving safety.

Description

Fatigue driving early warning system based on DSP
Technical Field
The invention belongs to the technical field of safe driving, and particularly relates to a fatigue driving early warning system based on a DSP.
Background
The motor vehicle as a product of social development, human civilization and scientific and technological progress makes a great contribution to the human civilization progress and the social and economic development. However, with the rapid development of the automobile industry, the safety of driving is becoming one of the most important concerns while continuously meeting various requirements.
According to incomplete statistics, the number of people died due to road traffic accidents worldwide is more than 50 thousands, the problem of the road traffic safety is a very important issue for governments worldwide, and fatigue driving is one of the main hidden troubles of the road traffic accidents.
Disclosure of Invention
Based on the defects of the prior art, the invention provides a fatigue driving early warning system based on a DSP (digital signal processor), which can detect the fatigue state of a driver in real time, carry out early warning processing in time when the driving state is abnormal, and effectively improve the driving safety.
In order to solve the technical problems, the invention is realized by the following technical scheme: the invention provides a fatigue driving early warning system based on DSP, comprising:
the video acquisition module is used for acquiring a video picture of a driver;
the video A/D conversion module is connected with the video acquisition module and is used for converting the analog video signal obtained by the video acquisition module into a digital video signal;
the DSP data processing module is connected with the video A/D conversion module and is used for carrying out image preprocessing on the digital video signals converted by the video A/D conversion module, extracting human face characteristics and identifying and judging the fatigue degree of a driver through an algorithm;
the loudspeaker assembly is connected with the DSP data processing module and used for carrying out sound alarm;
and the braking module is connected with the DSP data processing module and is used for decelerating the automobile.
Optionally, the video processing system further comprises a video D/a conversion module connected to the video a/D conversion module, and configured to convert a digital video signal into an analog video signal, where the video D/a conversion module is connected to a video output module.
And the logic controller is connected with the DSP data processing module, the video A/D conversion module and the video D/A conversion module, and is used for receiving signals of the DSP data processing module, sending instructions to the video A/D conversion module and the video D/A conversion module and controlling the video A/D conversion module and the video D/A conversion module to work.
Optionally, the video acquisition module includes a CMOS camera, and the CMOS camera is disposed at a front side of the driver and is configured to acquire a face picture of the driver.
Further, the image preprocessing comprises illumination compensation, median filtering, skin color feature detection and false face removal. The extracted human face features are eyes, and the fatigue degree is judged according to the eye closing time, the half-open and half-close duration and the blinking frequency.
Therefore, the fatigue driving early warning system based on the DSP provided by the invention utilizes the characteristics of the data processing technology based on the DSP to detect the face and eyes, advances the characteristic parameters, analyzes the fatigue state of the driver through the characteristic parameters, realizes the real-time detection of the fatigue state of the driver, carries out early warning processing by using signals such as sound and light and the like in time when the driving state is abnormal, and effectively improves the driving safety.
The foregoing description is only an overview of the technical solutions of the present invention, and in order to make the technical means of the present invention more clearly understood, the present invention may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present invention more clearly understood, the following detailed description is given in conjunction with the preferred embodiments, together with the accompanying drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings of the embodiments will be briefly described below.
FIG. 1 is a schematic structural diagram of a fatigue driving warning system based on DSP according to the present invention;
fig. 2 is a flowchart of the fatigue driving warning method based on DSP according to the present invention.
1. A DSP data processing module; 2. a logic controller; 3. a video A/D conversion module; 4. a video D/A conversion module; 5. a video acquisition module; 6. a speaker assembly; 7. and a brake module.
Detailed Description
Other aspects, features and advantages of the present invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, which form a part of this specification, and which illustrate, by way of example, the principles of the invention. In the referenced drawings, the same or similar components in different drawings are denoted by the same reference numerals.
Referring to fig. 1-2, the DSP-based fatigue driving warning system of the present invention includes: the system comprises a DSP data processing module 1 for processing image data, a logic controller 2 for processing signals, a video A/D conversion module 3 for converting analog signals into digital signals, a video D/A conversion module 4 for converting digital signals into analog signals, and a video acquisition module 5 for acquiring video pictures.
The DSP data processing module 1 is connected with the logic controller 2, the logic controller 2 is electrically connected with the video A/D conversion module 3 and the video D/A conversion module 4, and the video A/D conversion module 3 is electrically connected with the DSP data processing module 1 and the video D/A conversion module 4; the DSP data processing module 1 is connected with a loudspeaker assembly 6 and a brake module 7, the video A/D conversion module 3 is connected with a video acquisition module 5, and the video D/A conversion module 4 is connected with a video output module.
Further, the video acquisition module 5 includes a CMOS camera, and the CMOS camera is disposed in front of the driver to acquire a face image of the driver. The video A/D conversion module 3 converts the analog video signal obtained by the video acquisition module 5 into a digital video signal, the digital video signal is transmitted to the DSP data processing module 1 and the video D/A conversion module 4, and the video D/A conversion module 4 converts the digital video signal into the analog video signal.
The DSP data processing module 1 of the invention carries out image preprocessing on the digital video signal converted by the video A/D conversion module 3, extracts the human face characteristics and identifies and judges the fatigue degree through an algorithm. The image preprocessing includes but is not limited to illumination compensation, median filtering, skin color feature detection, false face removal. The extracted human face features are eyes, and the fatigue degree is judged according to the eye closing time, the half-open and half-close duration and the blinking frequency.
The logic controller 2 of the invention receives the signal of the DSP data processing module 1, and sends the signal to the video A/D conversion module 3 and the video D/A conversion module 4 to control the work thereof.
Correspondingly, the invention also provides an early warning method of the fatigue driving early warning system based on the DSP, which comprises the following steps,
s1: a video acquisition module 5 is used for acquiring a video picture of a driver;
s2: the video A/D conversion module 3 performs data conversion on the analog video signal obtained by the video acquisition module 5;
s3: the DSP data processing module 1 processes the picture and judges the fatigue state;
s4: the speaker assembly 6 and the brake module 7 react early.
If the fatigue state is judged in step S3, the warning response in step S4 is performed, and if the fatigue state is not judged, step S1 is repeated to perform the loop.
Further, the speaker assembly 6 performs an audio alarm in step S4, and the brake module 7 decelerates the vehicle through the brake of the vehicle.
The working principle is as follows: in the actual use process, the camera of the video acquisition module 5 is used for monitoring the picture of a driver, the video A/D conversion module 3 is used for converting an analog video signal into a digital video signal, the digital video signal is transmitted to the DSP data processing module 1 for image preprocessing, the human face characteristics are extracted, and the fatigue degree is identified and judged through an algorithm; after fatigue driving is judged, signals are sent to the loudspeaker assembly 6 and the brake module 7 to control the work of the loudspeaker assembly 6, the loudspeaker assembly 6 gives an alarm in a sound mode, and the brake module 7 decelerates the automobile so as to ensure driving safety; and judging whether the driving is fatigue driving, repeating the work of the video acquisition module 5 for acquiring the picture, and performing in a circulating manner.
In the above process, the DSP data processing module 1 sends an instruction to the logic controller 2, and the logic controller 2 controls the video a/D conversion module 3 and the video D/a conversion module 4 according to the instruction. The video D/a conversion module 4 receives the digital video signal transmitted by the video a/D conversion module 3 and converts the digital video signal into an analog video signal, so that the digital video signal can be played through the video output module.
The specific processes of image preprocessing by the DSP data processing module 1 are illumination compensation, median filtering, skin color feature detection and false face removal, and the definition degree of a picture is ensured; meanwhile, the eye characteristics are extracted, and the fatigue degree is judged according to the eye closing time, the half-open and half-close duration and the blinking frequency.
While the foregoing is directed to the preferred embodiment of the present invention, other and further embodiments of the invention may be devised without departing from the basic scope thereof, and the scope thereof is determined by the claims that follow.

Claims (6)

1. A fatigue driving early warning system based on DSP is characterized by comprising:
the video acquisition module (5) is used for acquiring a video picture of a driver;
the video A/D conversion module (3) is connected with the video acquisition module (5) and is used for converting the analog video signal obtained by the video acquisition module (5) into a digital video signal;
the DSP data processing module (1) is connected with the video A/D conversion module (3) and is used for carrying out image preprocessing on the digital video signals converted by the video A/D conversion module (3), extracting human face characteristics and identifying and judging the fatigue degree of a driver through an algorithm;
the loudspeaker assembly (6) is connected with the DSP data processing module (1) and is used for giving out sound alarm;
and the braking module (7) is connected with the DSP data processing module (1) and is used for decelerating the automobile.
2. The DSP-based fatigue driving warning system as set forth in claim 1, further comprising a video D/a conversion module (4) connected to the video a/D conversion module (3) for converting a digital video signal into an analog video signal, the video D/a conversion module (4) being connected to a video output module.
3. The DSP-based fatigue driving warning system according to claim 2, further comprising a logic controller (2) connected to the DSP data processing module (1), the video A/D conversion module (3) and the video D/A conversion module (4) for receiving signals from the DSP data processing module (1) and sending commands to the video A/D conversion module (3) and the video D/A conversion module (4) to control the operation of the video A/D conversion module (3) and the video D/A conversion module (4).
4. The DSP-based fatigue driving warning system according to claim 1, wherein the video capture module (5) comprises a CMOS camera, and the CMOS camera is disposed in front of the driver for obtaining a face picture of the driver.
5. The DSP-based fatigue driving warning system of claim 1, wherein the image pre-processing includes illumination compensation, median filtering, skin color feature detection, and false face removal.
6. The DSP-based fatigue driving warning system of claim 1, wherein the extracted human face feature is eyes, and the fatigue degree is judged according to an eye closing time, a half-open and half-closed duration, and a blink frequency.
CN201911159452.3A 2019-11-22 2019-11-22 Fatigue driving early warning system based on DSP Pending CN110910610A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911159452.3A CN110910610A (en) 2019-11-22 2019-11-22 Fatigue driving early warning system based on DSP

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911159452.3A CN110910610A (en) 2019-11-22 2019-11-22 Fatigue driving early warning system based on DSP

Publications (1)

Publication Number Publication Date
CN110910610A true CN110910610A (en) 2020-03-24

Family

ID=69819089

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911159452.3A Pending CN110910610A (en) 2019-11-22 2019-11-22 Fatigue driving early warning system based on DSP

Country Status (1)

Country Link
CN (1) CN110910610A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112116784A (en) * 2020-08-17 2020-12-22 东风电驱动***有限公司 Distributed fatigue driving early warning system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2284582A (en) * 1993-11-22 1995-06-14 Toad Innovations Ltd Vehicle safety device to warn driver of fatigue
CN201681470U (en) * 2010-05-07 2010-12-22 深圳市飞瑞斯科技有限公司 Drowsy driving warning system
CN104240446A (en) * 2014-09-26 2014-12-24 长春工业大学 Fatigue driving warning system on basis of human face recognition
CN104537806A (en) * 2014-11-11 2015-04-22 奇瑞汽车股份有限公司 Camera based real-time driving fatigue detection system
CN104881956A (en) * 2015-06-17 2015-09-02 上海大学 Fatigue driving early warning system
CN110322132A (en) * 2019-06-24 2019-10-11 东莞市天佑运输服务有限公司 A kind of personnel's fatigue management-control method and system based on management platform
CN110427830A (en) * 2019-07-08 2019-11-08 太航常青汽车安全***(苏州)股份有限公司 Driver's abnormal driving real-time detection system for state and method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2284582A (en) * 1993-11-22 1995-06-14 Toad Innovations Ltd Vehicle safety device to warn driver of fatigue
CN201681470U (en) * 2010-05-07 2010-12-22 深圳市飞瑞斯科技有限公司 Drowsy driving warning system
CN104240446A (en) * 2014-09-26 2014-12-24 长春工业大学 Fatigue driving warning system on basis of human face recognition
CN104537806A (en) * 2014-11-11 2015-04-22 奇瑞汽车股份有限公司 Camera based real-time driving fatigue detection system
CN104881956A (en) * 2015-06-17 2015-09-02 上海大学 Fatigue driving early warning system
CN110322132A (en) * 2019-06-24 2019-10-11 东莞市天佑运输服务有限公司 A kind of personnel's fatigue management-control method and system based on management platform
CN110427830A (en) * 2019-07-08 2019-11-08 太航常青汽车安全***(苏州)股份有限公司 Driver's abnormal driving real-time detection system for state and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
韩相军 等: "基于DSP的疲劳驾驶实时监测***研究", 《计算机技术与发展》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112116784A (en) * 2020-08-17 2020-12-22 东风电驱动***有限公司 Distributed fatigue driving early warning system

Similar Documents

Publication Publication Date Title
CN107633684B (en) Special vehicle identification method for unmanned vehicle
US11215999B2 (en) Data pipeline and deep learning system for autonomous driving
CN110751051B (en) Abnormal driving behavior detection method based on machine vision
CN105448041B (en) A kind of falling over of human body intelligence control system and its method
CN106627589A (en) Vehicle driving safety auxiliary method and system and vehicle
CN109977930B (en) Fatigue driving detection method and device
CN1830389A (en) Device for monitoring fatigue driving state and its method
CN109740477B (en) Driver fatigue detection system and fatigue detection method thereof
EP1397268A1 (en) Method and device for identifying the drowsiness of drivers of moving objects
CN111355902A (en) Method for acquiring images in vehicle by using camera and vehicle-mounted monitoring camera
CN108937923A (en) A kind of real-time driving fatigue monitoring system based on EEG signals, electro-ocular signal and electromyography signal
CN110910610A (en) Fatigue driving early warning system based on DSP
CN109190600A (en) A kind of driver's monitoring system of view-based access control model sensor
CN104574816A (en) Anti-fatigue driving system for electric automobile
CN110303884B (en) Fatigue driving prevention method, system and device
CN104715235A (en) Train driver state recognizing and alarming method
CN115690887A (en) Driver emotion intelligent recognition method based on multi-mode network
CN110329156B (en) Method and device for identifying vehicle front information of vehicle backlight blind area
CN110807444A (en) Pedestrian abnormal behavior detection system and method based on DSP edge calculation
CN111731979A (en) Automatic staircase takes advantage of personnel identification system that tumbles based on computer vision
KR101669447B1 (en) System and the method for recognizing drowsiness
CN112307920B (en) High-risk worker behavior early warning device and method
CN112193250B (en) Method for monitoring vehicle running state, vehicle and computer readable storage medium
CN211509165U (en) Vehicle-mounted monitoring camera
CN114841999B (en) Method and system for adjusting monitoring image of welding area

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200324