CN114228734B - Automatic reminding method and device based on deep learning - Google Patents

Automatic reminding method and device based on deep learning Download PDF

Info

Publication number
CN114228734B
CN114228734B CN202111633211.5A CN202111633211A CN114228734B CN 114228734 B CN114228734 B CN 114228734B CN 202111633211 A CN202111633211 A CN 202111633211A CN 114228734 B CN114228734 B CN 114228734B
Authority
CN
China
Prior art keywords
driving state
vehicle
driver
reminding
automatically
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111633211.5A
Other languages
Chinese (zh)
Other versions
CN114228734A (en
Inventor
兰雨晴
乔孟阳
余丹
王丹星
邢智焕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Standard Intelligent Security Technology Co Ltd
Original Assignee
China Standard Intelligent Security Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Standard Intelligent Security Technology Co Ltd filed Critical China Standard Intelligent Security Technology Co Ltd
Priority to CN202111633211.5A priority Critical patent/CN114228734B/en
Publication of CN114228734A publication Critical patent/CN114228734A/en
Application granted granted Critical
Publication of CN114228734B publication Critical patent/CN114228734B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
    • B60H1/00—Heating, cooling or ventilating [HVAC] devices
    • B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
    • B60H1/00735—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models
    • B60H1/00742—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models by detection of the vehicle occupants' presence; by detection of conditions relating to the body of occupants, e.g. using radiant heat detectors
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
    • B60H1/00—Heating, cooling or ventilating [HVAC] devices
    • B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
    • B60H1/00814—Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation
    • B60H1/00878—Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation the components being temperature regulating devices
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
    • B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
    • B60Q1/52—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking for indicating emergencies
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B60W2040/0836—Inactivity or incapacity of driver due to alcohol
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143—Alarm means

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • Transportation (AREA)
  • Thermal Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Mathematical Physics (AREA)
  • Traffic Control Systems (AREA)

Abstract

The application provides an automatic reminding method and device based on deep learning, and relates to the technical field of data processing. The automatic reminding method based on the deep learning comprises the steps of obtaining a driving image of a driver in the driving process; identifying the driving image through a deep learning algorithm to identify the driving state of a driver; and when the recognized driving state is the designated driving state, automatically making a sound for reminding. It can be seen that the abnormal driving state can be timely reminded, the safety of the vehicle in the driving process is improved, and traffic accidents are reduced.

Description

Automatic reminding method and device based on deep learning
Technical Field
The application relates to the technical field of data processing, in particular to an automatic reminding method and device based on deep learning.
Background
With the development of economy and the gradual improvement of living standard of people, automobiles become an indispensable part of people going out, and meanwhile, the safety problem of vehicle running is more and more concerned. At present, with the increase of the automobile reserves, the number of traffic accidents increases year by year, but some accidents are intentionally caused by non-subjective control, but result of abnormal driving state of drivers, such as fatigue driving, drunk driving and the like, cause serious loss to lives and properties of people, and therefore, the problem needs to be solved urgently.
Disclosure of Invention
In view of the above problems, the present application is provided to provide an automatic reminding method and apparatus based on deep learning, which overcome or at least partially solve the above problems, and can remind the driver of an abnormal driving state in time, improve the safety of the driver during driving, and reduce the occurrence of traffic accidents.
The technical scheme is as follows:
in a first aspect, an automatic reminding method based on deep learning is provided, which includes the following steps:
acquiring a driving image of a driver in a driving process;
identifying the driving image through a deep learning algorithm to identify the driving state of a driver;
and when the recognized driving state is the designated driving state, automatically making a sound for reminding.
In one possible implementation, after automatically sounding for the reminder, the method further includes:
and controlling the volume of the automatically emitted sound according to the duration of the identified driving state as the specified driving state.
In one possible implementation, the volume of the automatically emitted sound is controlled according to the duration of the identified driving state as the designated driving state using the following formula:
Figure BDA0003441657640000021
wherein e (t) represents a volume value of the automatically emitted sound at the current time; t represents the current time; e max A maximum volume value representing the automatically emitted sound; f (t) is a driving state output value of the driver identified by the deep learning algorithm, and if the driving state at the present time is dozing, f (t) is 1, whereas if the driving state at the present time is not dozing, f (t) is 0; t is t 0 Indicating a timing at which the driving state of the driver recognized for the first time is dozing; t represents a preset fatigue time.
In one possible implementation, after automatically sounding for the reminder, the method further comprises:
if the duration that the driving state that discerns is appointed driving state exceeds preset threshold value, then the two flashing lights of automatic control vehicle and then remind other vehicles of coming and going, then the control opens the air conditioning of vehicle.
In one possible implementation, the double flash and cool air enable of the vehicle is controlled according to the length of time that the identified driving state is the designated driving state using the following equations:
Figure BDA0003441657640000022
wherein D (t) represents the double flashing and cold air enabling control values of the vehicle at the current moment;
if D (t) is 0, the control of double flashing and cold air of the vehicle is not needed to be opened at the current moment;
if d (t) is 1, it indicates that double flashing and cooling of the vehicle need to be controlled to be turned on at the present time.
In one possible implementation, the vehicle cool air temperature is controlled according to the current time and the cool air enabled and recognized driver's driving state using the following formula:
Figure BDA0003441657640000023
wherein q (t) represents a cool air temperature control value of the vehicle at the present time; q max Represents a maximum value of temperature within a cool air controllable range of the vehicle; q min Indicating a minimum value of the temperature within the cool air controllable range of the vehicle.
In a second aspect, an automatic reminding device based on deep learning is provided, which includes:
the acquisition module is used for acquiring a driving image of a driver in the driving process;
the recognition module is used for recognizing the driving image through a deep learning algorithm and recognizing the driving state of a driver;
and the reminding module is used for automatically making a sound for reminding when the identified driving state is the designated driving state.
In one possible implementation manner, the reminding module is further configured to:
and after the automatic sound is emitted for reminding, controlling the volume of the automatically emitted sound according to the time length of the identified driving state as the specified driving state.
In one possible implementation manner, the reminding module is further configured to:
controlling the volume of the automatically emitted sound according to the duration of the identified driving state as the designated driving state by using the following formula:
Figure BDA0003441657640000031
wherein e (t) represents a volume value of the automatically emitted sound at the current time; t represents the current time; e max A maximum volume value representing the automatically emitted sound; (f) (t) represents a driving state output value of the driver recognized by the deep learning algorithm, and if the driving state at the present time is dozing, f (t) is 1, whereas if the driving state at the present time is not dozing, f (t) is 0; t is t 0 Indicating a time at which the driving state of the driver recognized for the first time is dozing; t represents a preset fatigue time.
In a possible implementation manner, the reminding module is further configured to:
after the vehicle is automatically sounded for reminding, if the duration of the identified driving state which is the appointed driving state exceeds a preset threshold value, the double flashing lights of the vehicle are automatically controlled to further remind other vehicles coming and going, and then the cold air of the vehicle is controlled to be opened.
By means of the technical scheme, the automatic reminding method and device based on deep learning provided by the embodiment of the application firstly obtain the driving image of a driver in the driving process; identifying the driving image through a deep learning algorithm to identify the driving state of a driver; and when the recognized driving state is the designated driving state, automatically making a sound for reminding. It can be seen that the abnormal driving state can be timely reminded, the safety of the vehicle in the driving process is improved, and traffic accidents are reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings used in the description of the embodiments of the present application will be briefly described below.
Fig. 1 shows a flowchart of an automatic reminding method based on deep learning according to an embodiment of the present application;
fig. 2 shows a structure diagram of an automatic reminding device based on deep learning according to an embodiment of the application.
Detailed Description
Exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the accompanying drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that such uses are interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the term "include" and its variants are to be read as open-ended terms meaning "including, but not limited to".
The embodiment of the application provides an automatic reminding method based on deep learning, which can be applied to electronic equipment such as a mobile terminal, a personal computer, a tablet personal computer and an intelligent watch. As shown in fig. 1, the automatic reminding method based on deep learning may include the following steps S101 to S103:
step S101, acquiring a driving image of a driver in a driving process;
step S102, identifying the driving image through a deep learning algorithm, and identifying the driving state of a driver;
and step S103, when the recognized driving state is the designated driving state, automatically making a sound for reminding.
In the embodiment of the application, the driving image of the driver in the driving process can be acquired in real time through the camera in the driving cab, and the real time can be a specified time interval, such as 2 seconds. The deep learning algorithm may be an artificial intelligence algorithm for face recognition, which is not limited in the embodiment of the present application. In addition, the specified driving state mentioned in step S103 may be determined according to actual conditions, such as dozing fatigue driving, drunk driving, and the like, which is not limited in the embodiment of the present application.
The method comprises the steps of firstly, acquiring a driving image of a driver in the driving process; identifying the driving image through a deep learning algorithm to identify the driving state of a driver; and when the recognized driving state is the designated driving state, automatically making a sound for reminding. It can be seen that the abnormal driving state can be timely reminded, the safety of the vehicle in the driving process is improved, and traffic accidents are reduced.
In the embodiment of the present application, a possible implementation manner is provided, and after the step S103 automatically sounds for reminding, the volume of the automatically emitted sound may be controlled according to the duration of the identified driving state as the specified driving state. The sound which can be automatically emitted in the embodiment of the application is larger and larger along with the time until the driver is detected not to be dozing.
The embodiment of the present application provides a possible implementation manner, and the following formula can be used to control the volume of the automatically emitted sound according to the duration of the identified driving state as the specified driving state:
Figure BDA0003441657640000051
wherein e (t) represents the volume value of the sound automatically emitted at the present time; t represents the current time; e max A maximum volume value representing an automatically emitted sound; (f) (t) represents a driving state output value of the driver recognized by the deep learning algorithm, and if the driving state at the present time is dozing, f (t) is 1, whereas if the driving state at the present time is not dozing, f (t) is 0; t is t 0 Indicating a time at which the driving state of the driver recognized for the first time is dozing; t represents a preset fatigue time.
The volume of the sound automatically emitted in the embodiment of the application can be increased along with the timeline of the fatigue state, and then the volume of the sound can be increased along with the longer time of the fatigue state of the driver, so that the intelligent reminding effect can be achieved according to the dozing times of the driver.
According to the embodiment of the application, the volume of the sound automatically sent out can be controlled according to the driving state of the driver detected by the camera, the driver is reminded through the sound, and the sound volume can be gradually increased along with the increase of the dozing times of the driver, so that the driver can keep awake to the maximum extent.
After the sound is automatically sent out to remind in the step S103, if the duration of the identified driving state being the specified driving state exceeds the preset threshold, the double flashing lights of the vehicle are automatically controlled to remind other vehicles coming and going, and then the cold air of the vehicle is controlled to be turned on. The preset threshold, for example, 5 seconds, may be set according to actual requirements, which is not limited in the embodiment of the present application.
The embodiment of the application provides a possible implementation manner, and the following formula can be utilized to control the double flashing and the cold air enabling of the vehicle according to the time length of the identified driving state as the specified driving state:
Figure BDA0003441657640000061
wherein D (t) represents the double flashing and cold air enabling control values of the vehicle at the current moment;
if D (t) is 0, the control of double flashing and cold air of the vehicle is not needed to be opened at the current moment;
if d (t) is 1, it indicates that double flashing and cooling of the vehicle need to be controlled to be turned on at the present time.
In the embodiment of the application, the double flashes and the cold air are started only when the fatigue degree of the driver and the reminding of the maximum volume cannot enable the driver to be awake, so that the vehicle can keep a normal driving state when the driver dozes off occasionally, and the cold air intelligent control can save part of energy consumption.
In the embodiment of the application, can be according to the two flashing and the air conditioning of the driver's that camera history detected drive state control vehicle enable, and then when long-time dozing off appears, the system can open the two flashing and the air conditioning of vehicle, and then reminds other vehicles nearby to and remind the driver through the air conditioning secondary and need keep clear-headed, improve the security of vehicle driving in-process, reduce the emergence of traffic accident.
The embodiment of the present application provides a possible implementation manner, and the vehicle cool air temperature can be controlled according to the current time and the driving state of the cool air enabled and recognized driver by using the following formula:
Figure BDA0003441657640000062
wherein q (t) represents a cool air temperature control value of the vehicle at the present time; q max Represents a maximum value of temperature within a cool air controllable range of the vehicle; q min Indicating a minimum value of the temperature within the cool air controllable range of the vehicle.
According to the embodiment of the application, the cold air temperature of the vehicle can be controlled according to the current time and the cold air enable and the state of the driver detected by the camera, and then the cold air temperature is lower along with the longer time that the driver dozes off, so that the driver can keep awake physiologically.
It should be noted that, in practical applications, all the possible embodiments described above may be combined in a combined manner at will to form possible embodiments of the present application, and details are not described here again.
Based on the automatic reminding method based on deep learning provided by each embodiment, the embodiment of the application also provides an automatic reminding device based on deep learning based on the same inventive concept.
Fig. 2 shows a structure diagram of an automatic reminding device based on deep learning according to an embodiment of the application. As shown in fig. 2, the automatic reminding apparatus based on deep learning may include an obtaining module 210, an identifying module 220 and a reminding module 230.
An obtaining module 210, configured to obtain a driving image of a driver during driving;
the recognition module 220 is configured to recognize the driving image through a deep learning algorithm, and recognize a driving state of a driver;
and the reminding module 230 is configured to automatically make a sound for reminding when the identified driving state is the designated driving state.
In the embodiment of the present application, a possible implementation manner is provided, and the reminding module 230 shown in fig. 2 is further configured to:
and after automatically making a sound for reminding, controlling the volume of the automatically made sound according to the duration of the identified driving state as the designated driving state.
In the embodiment of the present application, a possible implementation manner is provided, and the reminding module 230 shown in fig. 2 is further configured to:
controlling the volume of the automatically emitted sound according to the duration of the identified driving state as the designated driving state by using the following formula:
Figure BDA0003441657640000071
wherein e (t) represents a volume value of the automatically emitted sound at the current time; t represents the current time; e max Is shown inA maximum volume value of the automatically emitted sound; f (t) is a driving state output value of the driver identified by the deep learning algorithm, and if the driving state at the present time is dozing, f (t) is 1, whereas if the driving state at the present time is not dozing, f (t) is 0; t is t 0 Indicating a time at which the driving state of the driver recognized for the first time is dozing; t represents a preset fatigue time.
In the embodiment of the present application, a possible implementation manner is provided, and the reminding module 230 shown in fig. 2 is further configured to:
after the vehicle is automatically sounded for reminding, if the duration of the identified driving state which is the appointed driving state exceeds a preset threshold value, the double flashing lights of the vehicle are automatically controlled to further remind other vehicles coming and going, and then the cold air of the vehicle is controlled to be opened.
In the embodiment of the present application, a possible implementation manner is provided, and the reminding module 230 shown in fig. 2 is further configured to:
controlling the double-flashing and cold air enabling of the vehicle according to the duration of the identified driving state as the designated driving state by using the following formula:
Figure BDA0003441657640000081
wherein D (t) represents a double flashing and cold air enable control value of the vehicle at the present time;
if d (t) is 0, it means that the double flashing and the cold air of the vehicle do not need to be controlled to be opened at the current time;
if d (t) is 1, it indicates that the double flashing and the cooling of the vehicle need to be controlled to be turned on at the present time.
In the embodiment of the present application, a possible implementation manner is provided, and the reminding module 230 shown in fig. 2 is further configured to:
controlling the vehicle cool air temperature according to the current time and the cool air enable and recognized driving state of the driver using the following formula:
Figure BDA0003441657640000082
wherein q (t) represents a cool air temperature control value of the vehicle at the present time; q max Represents a maximum value of temperature within a cool air controllable range of the vehicle; q min Indicating a minimum value of temperature within a cool air controllable range of the vehicle.
The automatic reminding device based on the deep learning provided by the embodiment of the application firstly obtains a driving image of a driver in the driving process; identifying the driving image through a deep learning algorithm to identify the driving state of a driver; and when the recognized driving state is the designated driving state, automatically making a sound for reminding. It can be seen that the abnormal driving state can be timely reminded, the safety of the vehicle in the driving process is improved, and traffic accidents are reduced.
It can be clearly understood by those skilled in the art that the specific working processes of the system, the apparatus, and the module described above may refer to the corresponding processes in the foregoing method embodiments, and for the sake of brevity, the detailed description is omitted here.
Those of ordinary skill in the art will understand that: the technical solution of the present application may be essentially or wholly or partially embodied in the form of a software product, where the computer software product is stored in a storage medium and includes program instructions for enabling an electronic device (e.g., a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application when the program instructions are executed. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, an optical disk, or the like.
Alternatively, all or part of the steps of implementing the foregoing method embodiments may be implemented by hardware (an electronic device such as a personal computer, a server, or a network device) associated with program instructions, which may be stored in a computer-readable storage medium, and when the program instructions are executed by a processor of the electronic device, the electronic device executes all or part of the steps of the method described in the embodiments of the present application.
The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments can be modified or some or all of the technical features can be equivalently replaced within the spirit and principle of the present application; such modifications or substitutions do not depart from the scope of the present application.

Claims (2)

1. An automatic reminding method based on deep learning is characterized by comprising the following steps:
acquiring a driving image of a driver in a driving process;
identifying the driving image through a deep learning algorithm to identify the driving state of a driver;
when the recognized driving state is the designated driving state, automatically making a sound for reminding;
after the automatic sounding for reminding, the method further comprises the following steps:
controlling the volume of the automatically emitted sound according to the duration of the identified driving state as the specified driving state;
wherein the volume of the automatically emitted sound is controlled according to the duration of the identified driving state as the designated driving state by using the following formula:
Figure FDA0003707035740000011
wherein e (t) represents a volume value of the automatically emitted sound at the current time; t represents the current time; e max A maximum volume value representing the automatically emitted sound; f (t) is a value indicating the driving state output of the driver recognized by the deep learning algorithm, and if the driving state is dozing at the present timeIf the driving state at the current moment is not dozing, f (t) is output as 1, otherwise, f (t) is output as 0; t is t 0 Indicating a time at which the driving state of the driver recognized for the first time is dozing; t represents a preset fatigue time;
after the automatic sounding for reminding, the method further comprises the following steps:
if the recognized driving state is that the duration of the specified driving state exceeds a preset threshold value, automatically controlling double flashing lights of the vehicle to remind other vehicles in the coming and going directions, and then controlling to turn on the cold air of the vehicle;
wherein the double flashing and cold air enabling of the vehicle is controlled according to the duration of the identified driving state as the designated driving state by using the following formula:
Figure FDA0003707035740000012
wherein D (t) represents a double flashing and cold air enable control value of the vehicle at the present time;
if D (t) is 0, the control of double flashing and cold air of the vehicle is not needed to be opened at the current moment;
if D (t) is 1, the double flashing and the cold air of the vehicle need to be controlled and opened at the current moment;
wherein the vehicle cold air temperature is controlled according to the current time and the cold air enable and recognized driving state of the driver using the following formula:
Figure FDA0003707035740000021
wherein q (t) represents a cool air temperature control value of the vehicle at the present time; q max Represents a maximum value of temperature within a cool air controllable range of the vehicle; q min Indicating a minimum value of the temperature within the cool air controllable range of the vehicle.
2. An automatic reminding device based on deep learning, comprising:
the acquisition module is used for acquiring a driving image of a driver in the driving process;
the recognition module is used for recognizing the driving image through a deep learning algorithm and recognizing the driving state of a driver;
the reminding module is used for automatically making a sound for reminding when the identified driving state is the designated driving state;
wherein, the reminding module is also used for:
after automatically making a sound for reminding, controlling the volume of the automatically made sound according to the duration of the identified driving state as the specified driving state;
wherein, the reminding module is also used for:
controlling the volume of the automatically emitted sound according to the duration of the identified driving state as the designated driving state by using the following formula:
Figure FDA0003707035740000022
wherein e (t) represents a volume value of the automatically emitted sound at the current time; t represents the current time; e max A maximum volume value representing the automatically emitted sound; f (t) is a driving state output value of the driver identified by the deep learning algorithm, and if the driving state at the present time is dozing, f (t) is 1, whereas if the driving state at the present time is not dozing, f (t) is 0; t is t 0 Indicating a time at which the driving state of the driver recognized for the first time is dozing; t represents a preset fatigue time;
wherein, the reminding module is also used for:
after the vehicle is automatically sounded for reminding, if the duration of the identified driving state is the specified driving state exceeds a preset threshold, automatically controlling double flashing lights of the vehicle to remind other vehicles coming and going, and then controlling to turn on the cold air of the vehicle;
wherein, the reminding module is also used for: controlling the double-flashing and cold air enabling of the vehicle according to the duration of the identified driving state as the designated driving state by using the following formula:
Figure FDA0003707035740000031
wherein D (t) represents the double flashing and cold air enabling control values of the vehicle at the current moment;
if d (t) is 0, it means that the double flashing and the cold air of the vehicle do not need to be controlled to be opened at the current time;
if D (t) is 1, the double flash and the cold air of the vehicle need to be controlled to be opened at the current moment;
wherein, the reminding module is also used for: controlling the vehicle cool air temperature according to the current time and the cool air enable and recognized driving state of the driver using the following formula:
Figure FDA0003707035740000032
wherein q (t) represents a cool air temperature control value of the vehicle at the present time; q max Represents a maximum value of temperature within a cool air controllable range of the vehicle; q min Indicating a minimum value of temperature within a cool air controllable range of the vehicle.
CN202111633211.5A 2021-12-29 2021-12-29 Automatic reminding method and device based on deep learning Active CN114228734B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111633211.5A CN114228734B (en) 2021-12-29 2021-12-29 Automatic reminding method and device based on deep learning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111633211.5A CN114228734B (en) 2021-12-29 2021-12-29 Automatic reminding method and device based on deep learning

Publications (2)

Publication Number Publication Date
CN114228734A CN114228734A (en) 2022-03-25
CN114228734B true CN114228734B (en) 2022-08-19

Family

ID=80744104

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111633211.5A Active CN114228734B (en) 2021-12-29 2021-12-29 Automatic reminding method and device based on deep learning

Country Status (1)

Country Link
CN (1) CN114228734B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108407813A (en) * 2018-01-25 2018-08-17 惠州市德赛西威汽车电子股份有限公司 A kind of antifatigue safe driving method of vehicle based on big data
CN111098860A (en) * 2019-12-16 2020-05-05 东风汽车有限公司 Automobile driving fatigue relieving method, electronic equipment, fatigue driving judging method and server
CN111354161A (en) * 2018-12-20 2020-06-30 奥迪股份公司 Fatigue driving reminding method and device, computer equipment and storage medium
WO2021106024A1 (en) * 2019-11-25 2021-06-03 Vdproject S.R.L. Automatic guidance system substituting the driver in case of malaise or critical conditions

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5634527A (en) * 1979-08-29 1981-04-06 Nissan Motor Co Ltd Car safety device
US7113100B2 (en) * 2003-03-20 2006-09-26 Denso Corporation Vehicle tiredness alleviating system
JP2016020177A (en) * 2014-07-15 2016-02-04 株式会社デンソー Driving control device
CN105730370A (en) * 2014-12-11 2016-07-06 鸿富锦精密工业（深圳）有限公司 Automobile driving system and control method
DE102015001248B4 (en) * 2015-01-31 2020-06-04 Audi Ag Method and system for operating a motor vehicle
CN104986160A (en) * 2015-06-16 2015-10-21 北京亿利智慧能源科技有限公司 Electric automobile driving behavior guide instrument
KR102026806B1 (en) * 2017-04-28 2019-09-30 쌍용자동차 주식회사 Health care apparatus with a passenger physical condition measurement in a vehicle
KR20190050633A (en) * 2017-11-03 2019-05-13 주식회사 만도 System and method for controlling vehicle based on condition of driver
CN108372785B (en) * 2018-04-25 2023-06-23 吉林大学 Image recognition-based automobile unsafe driving detection device and detection method
CN108961681B (en) * 2018-07-23 2021-02-02 奇瑞汽车股份有限公司 Fatigue driving reminding method and device and storage medium
CN109272764B (en) * 2018-09-30 2020-12-08 广州鹰瞰信息科技有限公司 Dangerous driving reminding method and system
KR102143211B1 (en) * 2019-01-09 2020-08-11 (주)씨앤아이피 A method and system for preventing drowsiness driving and keeping vehicle safe
CN110097783A (en) * 2019-05-15 2019-08-06 芜湖汽车前瞻技术研究院有限公司 Vehicle early warning method and system
CN110667593B (en) * 2019-09-06 2022-05-17 中国平安财产保险股份有限公司 Driving reminding method, device and equipment based on deep learning and storage medium
CN110962591B (en) * 2019-11-29 2021-08-17 浙江大华技术股份有限公司 Fatigue driving detection method, device, computer equipment and storage medium
JP2021096696A (en) * 2019-12-18 2021-06-24 パナソニックＩｐマネジメント株式会社 Condition notification device for vehicle and condition notification method for vehicle
CN111829783A (en) * 2020-07-21 2020-10-27 上海振华重工(集团)股份有限公司 Real-time defect detection system for variable-speed rotating mechanism
CN112950900A (en) * 2021-01-27 2021-06-11 吉林云帆智能工程有限公司 Driver behavior monitoring and detecting method
CN113479211B (en) * 2021-07-27 2022-03-18 广东机电职业技术学院 Method and system for identifying and reminding automobile driving safety behaviors based on machine vision

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108407813A (en) * 2018-01-25 2018-08-17 惠州市德赛西威汽车电子股份有限公司 A kind of antifatigue safe driving method of vehicle based on big data
CN111354161A (en) * 2018-12-20 2020-06-30 奥迪股份公司 Fatigue driving reminding method and device, computer equipment and storage medium
WO2021106024A1 (en) * 2019-11-25 2021-06-03 Vdproject S.R.L. Automatic guidance system substituting the driver in case of malaise or critical conditions
CN111098860A (en) * 2019-12-16 2020-05-05 东风汽车有限公司 Automobile driving fatigue relieving method, electronic equipment, fatigue driving judging method and server

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
基于LabVIEW***的汽车驾驶员防困与预警***;王剑等;《中国科技信息》;20180129;131-133 *
现代汽车自动空调***探讨;吴艳等;《科技与企业》;20130606(第11期);364 *

Also Published As

Publication number Publication date
CN114228734A (en) 2022-03-25

Similar Documents

Publication Publication Date Title
WO2019095937A1 (en) Collision warning method and device
CN113345204B (en) Vehicle-mounted remote fatigue awakening method and awakening system thereof
US20090268022A1 (en) Wakefulness level estimation apparatus
CN110588548A (en) Method for preventing fatigue driving and vehicle driving management system
JPH10315800A (en) Traveling auxiliary device for vehicle
CN110395260A (en) Vehicle, safe driving method and device
CN111492420B (en) Doze alarm device
CN114049677B (en) Vehicle ADAS control method and system based on driver emotion index
CN105678961A (en) Anti-fatigue driving automobile safety warning system and warning method
CN109801475A (en) Method for detecting fatigue driving, device and computer readable storage medium
JP2008099884A (en) Condition estimating apparatus
DE102021101561A1 (en) APPROXIMATE VEHICLE SAFETY SYSTEMS AND PROCEDURES
JPH11339200A (en) Detector for driving vehicle asleep
CN113331841A (en) Bus risk coefficient evaluation method, algorithm box and system
CN111145750A (en) Control method and device for vehicle-mounted intelligent voice equipment
CN114228734B (en) Automatic reminding method and device based on deep learning
CN111976626A (en) Mode control method, device, vehicle and computer readable storage medium
CN114463940A (en) Method and equipment for warning abnormal driving behavior of driver by lamplight
CN212709241U (en) Safety reminding device for preventing fatigue driving
CN113168758B (en) Method of determining a level of drowsiness of a driver of a vehicle
EP3000395A1 (en) System and method for monitoring a subject's eye
CN108162899B (en) Control method and device for vehicle-mounted intelligent equipment
CN115352450A (en) Vehicle driving assistance method and device, vehicle and storage medium
CN113516015B (en) Emotion recognition method, driving assisting device and application
CN209343500U (en) A kind of timely fatigue alarm set

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant