CN114228734B - Automatic reminding method and device based on deep learning - Google Patents
Automatic reminding method and device based on deep learning Download PDFInfo
- Publication number
- CN114228734B CN114228734B CN202111633211.5A CN202111633211A CN114228734B CN 114228734 B CN114228734 B CN 114228734B CN 202111633211 A CN202111633211 A CN 202111633211A CN 114228734 B CN114228734 B CN 114228734B
- Authority
- CN
- China
- Prior art keywords
- driving state
- vehicle
- driver
- reminding
- automatically
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H1/00—Heating, cooling or ventilating [HVAC] devices
- B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
- B60H1/00735—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models
- B60H1/00742—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models by detection of the vehicle occupants' presence; by detection of conditions relating to the body of occupants, e.g. using radiant heat detectors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H1/00—Heating, cooling or ventilating [HVAC] devices
- B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
- B60H1/00814—Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation
- B60H1/00878—Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation the components being temperature regulating devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/52—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking for indicating emergencies
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
- B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
- B60W2040/0836—Inactivity or incapacity of driver due to alcohol
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Automation & Control Theory (AREA)
- Physics & Mathematics (AREA)
- Transportation (AREA)
- Thermal Sciences (AREA)
- Human Computer Interaction (AREA)
- Mathematical Physics (AREA)
- Traffic Control Systems (AREA)
Abstract
The application provides an automatic reminding method and device based on deep learning, and relates to the technical field of data processing. The automatic reminding method based on the deep learning comprises the steps of obtaining a driving image of a driver in the driving process; identifying the driving image through a deep learning algorithm to identify the driving state of a driver; and when the recognized driving state is the designated driving state, automatically making a sound for reminding. It can be seen that the abnormal driving state can be timely reminded, the safety of the vehicle in the driving process is improved, and traffic accidents are reduced.
Description
Technical Field
The application relates to the technical field of data processing, in particular to an automatic reminding method and device based on deep learning.
Background
With the development of economy and the gradual improvement of living standard of people, automobiles become an indispensable part of people going out, and meanwhile, the safety problem of vehicle running is more and more concerned. At present, with the increase of the automobile reserves, the number of traffic accidents increases year by year, but some accidents are intentionally caused by non-subjective control, but result of abnormal driving state of drivers, such as fatigue driving, drunk driving and the like, cause serious loss to lives and properties of people, and therefore, the problem needs to be solved urgently.
Disclosure of Invention
In view of the above problems, the present application is provided to provide an automatic reminding method and apparatus based on deep learning, which overcome or at least partially solve the above problems, and can remind the driver of an abnormal driving state in time, improve the safety of the driver during driving, and reduce the occurrence of traffic accidents.
The technical scheme is as follows:
in a first aspect, an automatic reminding method based on deep learning is provided, which includes the following steps:
acquiring a driving image of a driver in a driving process;
identifying the driving image through a deep learning algorithm to identify the driving state of a driver;
and when the recognized driving state is the designated driving state, automatically making a sound for reminding.
In one possible implementation, after automatically sounding for the reminder, the method further includes:
and controlling the volume of the automatically emitted sound according to the duration of the identified driving state as the specified driving state.
In one possible implementation, the volume of the automatically emitted sound is controlled according to the duration of the identified driving state as the designated driving state using the following formula:
wherein e (t) represents a volume value of the automatically emitted sound at the current time; t represents the current time; e max A maximum volume value representing the automatically emitted sound; f (t) is a driving state output value of the driver identified by the deep learning algorithm, and if the driving state at the present time is dozing, f (t) is 1, whereas if the driving state at the present time is not dozing, f (t) is 0; t is t 0 Indicating a timing at which the driving state of the driver recognized for the first time is dozing; t represents a preset fatigue time.
In one possible implementation, after automatically sounding for the reminder, the method further comprises:
if the duration that the driving state that discerns is appointed driving state exceeds preset threshold value, then the two flashing lights of automatic control vehicle and then remind other vehicles of coming and going, then the control opens the air conditioning of vehicle.
In one possible implementation, the double flash and cool air enable of the vehicle is controlled according to the length of time that the identified driving state is the designated driving state using the following equations:
wherein D (t) represents the double flashing and cold air enabling control values of the vehicle at the current moment;
if D (t) is 0, the control of double flashing and cold air of the vehicle is not needed to be opened at the current moment;
if d (t) is 1, it indicates that double flashing and cooling of the vehicle need to be controlled to be turned on at the present time.
In one possible implementation, the vehicle cool air temperature is controlled according to the current time and the cool air enabled and recognized driver's driving state using the following formula:
wherein q (t) represents a cool air temperature control value of the vehicle at the present time; q max Represents a maximum value of temperature within a cool air controllable range of the vehicle; q min Indicating a minimum value of the temperature within the cool air controllable range of the vehicle.
In a second aspect, an automatic reminding device based on deep learning is provided, which includes:
the acquisition module is used for acquiring a driving image of a driver in the driving process;
the recognition module is used for recognizing the driving image through a deep learning algorithm and recognizing the driving state of a driver;
and the reminding module is used for automatically making a sound for reminding when the identified driving state is the designated driving state.
In one possible implementation manner, the reminding module is further configured to:
and after the automatic sound is emitted for reminding, controlling the volume of the automatically emitted sound according to the time length of the identified driving state as the specified driving state.
In one possible implementation manner, the reminding module is further configured to:
controlling the volume of the automatically emitted sound according to the duration of the identified driving state as the designated driving state by using the following formula:
wherein e (t) represents a volume value of the automatically emitted sound at the current time; t represents the current time; e max A maximum volume value representing the automatically emitted sound; (f) (t) represents a driving state output value of the driver recognized by the deep learning algorithm, and if the driving state at the present time is dozing, f (t) is 1, whereas if the driving state at the present time is not dozing, f (t) is 0; t is t 0 Indicating a time at which the driving state of the driver recognized for the first time is dozing; t represents a preset fatigue time.
In a possible implementation manner, the reminding module is further configured to:
after the vehicle is automatically sounded for reminding, if the duration of the identified driving state which is the appointed driving state exceeds a preset threshold value, the double flashing lights of the vehicle are automatically controlled to further remind other vehicles coming and going, and then the cold air of the vehicle is controlled to be opened.
By means of the technical scheme, the automatic reminding method and device based on deep learning provided by the embodiment of the application firstly obtain the driving image of a driver in the driving process; identifying the driving image through a deep learning algorithm to identify the driving state of a driver; and when the recognized driving state is the designated driving state, automatically making a sound for reminding. It can be seen that the abnormal driving state can be timely reminded, the safety of the vehicle in the driving process is improved, and traffic accidents are reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings used in the description of the embodiments of the present application will be briefly described below.
Fig. 1 shows a flowchart of an automatic reminding method based on deep learning according to an embodiment of the present application;
fig. 2 shows a structure diagram of an automatic reminding device based on deep learning according to an embodiment of the application.
Detailed Description
Exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the accompanying drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that such uses are interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the term "include" and its variants are to be read as open-ended terms meaning "including, but not limited to".
The embodiment of the application provides an automatic reminding method based on deep learning, which can be applied to electronic equipment such as a mobile terminal, a personal computer, a tablet personal computer and an intelligent watch. As shown in fig. 1, the automatic reminding method based on deep learning may include the following steps S101 to S103:
step S101, acquiring a driving image of a driver in a driving process;
step S102, identifying the driving image through a deep learning algorithm, and identifying the driving state of a driver;
and step S103, when the recognized driving state is the designated driving state, automatically making a sound for reminding.
In the embodiment of the application, the driving image of the driver in the driving process can be acquired in real time through the camera in the driving cab, and the real time can be a specified time interval, such as 2 seconds. The deep learning algorithm may be an artificial intelligence algorithm for face recognition, which is not limited in the embodiment of the present application. In addition, the specified driving state mentioned in step S103 may be determined according to actual conditions, such as dozing fatigue driving, drunk driving, and the like, which is not limited in the embodiment of the present application.
The method comprises the steps of firstly, acquiring a driving image of a driver in the driving process; identifying the driving image through a deep learning algorithm to identify the driving state of a driver; and when the recognized driving state is the designated driving state, automatically making a sound for reminding. It can be seen that the abnormal driving state can be timely reminded, the safety of the vehicle in the driving process is improved, and traffic accidents are reduced.
In the embodiment of the present application, a possible implementation manner is provided, and after the step S103 automatically sounds for reminding, the volume of the automatically emitted sound may be controlled according to the duration of the identified driving state as the specified driving state. The sound which can be automatically emitted in the embodiment of the application is larger and larger along with the time until the driver is detected not to be dozing.
The embodiment of the present application provides a possible implementation manner, and the following formula can be used to control the volume of the automatically emitted sound according to the duration of the identified driving state as the specified driving state:
wherein e (t) represents the volume value of the sound automatically emitted at the present time; t represents the current time; e max A maximum volume value representing an automatically emitted sound; (f) (t) represents a driving state output value of the driver recognized by the deep learning algorithm, and if the driving state at the present time is dozing, f (t) is 1, whereas if the driving state at the present time is not dozing, f (t) is 0; t is t 0 Indicating a time at which the driving state of the driver recognized for the first time is dozing; t represents a preset fatigue time.
The volume of the sound automatically emitted in the embodiment of the application can be increased along with the timeline of the fatigue state, and then the volume of the sound can be increased along with the longer time of the fatigue state of the driver, so that the intelligent reminding effect can be achieved according to the dozing times of the driver.
According to the embodiment of the application, the volume of the sound automatically sent out can be controlled according to the driving state of the driver detected by the camera, the driver is reminded through the sound, and the sound volume can be gradually increased along with the increase of the dozing times of the driver, so that the driver can keep awake to the maximum extent.
After the sound is automatically sent out to remind in the step S103, if the duration of the identified driving state being the specified driving state exceeds the preset threshold, the double flashing lights of the vehicle are automatically controlled to remind other vehicles coming and going, and then the cold air of the vehicle is controlled to be turned on. The preset threshold, for example, 5 seconds, may be set according to actual requirements, which is not limited in the embodiment of the present application.
The embodiment of the application provides a possible implementation manner, and the following formula can be utilized to control the double flashing and the cold air enabling of the vehicle according to the time length of the identified driving state as the specified driving state:
wherein D (t) represents the double flashing and cold air enabling control values of the vehicle at the current moment;
if D (t) is 0, the control of double flashing and cold air of the vehicle is not needed to be opened at the current moment;
if d (t) is 1, it indicates that double flashing and cooling of the vehicle need to be controlled to be turned on at the present time.
In the embodiment of the application, the double flashes and the cold air are started only when the fatigue degree of the driver and the reminding of the maximum volume cannot enable the driver to be awake, so that the vehicle can keep a normal driving state when the driver dozes off occasionally, and the cold air intelligent control can save part of energy consumption.
In the embodiment of the application, can be according to the two flashing and the air conditioning of the driver's that camera history detected drive state control vehicle enable, and then when long-time dozing off appears, the system can open the two flashing and the air conditioning of vehicle, and then reminds other vehicles nearby to and remind the driver through the air conditioning secondary and need keep clear-headed, improve the security of vehicle driving in-process, reduce the emergence of traffic accident.
The embodiment of the present application provides a possible implementation manner, and the vehicle cool air temperature can be controlled according to the current time and the driving state of the cool air enabled and recognized driver by using the following formula:
wherein q (t) represents a cool air temperature control value of the vehicle at the present time; q max Represents a maximum value of temperature within a cool air controllable range of the vehicle; q min Indicating a minimum value of the temperature within the cool air controllable range of the vehicle.
According to the embodiment of the application, the cold air temperature of the vehicle can be controlled according to the current time and the cold air enable and the state of the driver detected by the camera, and then the cold air temperature is lower along with the longer time that the driver dozes off, so that the driver can keep awake physiologically.
It should be noted that, in practical applications, all the possible embodiments described above may be combined in a combined manner at will to form possible embodiments of the present application, and details are not described here again.
Based on the automatic reminding method based on deep learning provided by each embodiment, the embodiment of the application also provides an automatic reminding device based on deep learning based on the same inventive concept.
Fig. 2 shows a structure diagram of an automatic reminding device based on deep learning according to an embodiment of the application. As shown in fig. 2, the automatic reminding apparatus based on deep learning may include an obtaining module 210, an identifying module 220 and a reminding module 230.
An obtaining module 210, configured to obtain a driving image of a driver during driving;
the recognition module 220 is configured to recognize the driving image through a deep learning algorithm, and recognize a driving state of a driver;
and the reminding module 230 is configured to automatically make a sound for reminding when the identified driving state is the designated driving state.
In the embodiment of the present application, a possible implementation manner is provided, and the reminding module 230 shown in fig. 2 is further configured to:
and after automatically making a sound for reminding, controlling the volume of the automatically made sound according to the duration of the identified driving state as the designated driving state.
In the embodiment of the present application, a possible implementation manner is provided, and the reminding module 230 shown in fig. 2 is further configured to:
controlling the volume of the automatically emitted sound according to the duration of the identified driving state as the designated driving state by using the following formula:
wherein e (t) represents a volume value of the automatically emitted sound at the current time; t represents the current time; e max Is shown inA maximum volume value of the automatically emitted sound; f (t) is a driving state output value of the driver identified by the deep learning algorithm, and if the driving state at the present time is dozing, f (t) is 1, whereas if the driving state at the present time is not dozing, f (t) is 0; t is t 0 Indicating a time at which the driving state of the driver recognized for the first time is dozing; t represents a preset fatigue time.
In the embodiment of the present application, a possible implementation manner is provided, and the reminding module 230 shown in fig. 2 is further configured to:
after the vehicle is automatically sounded for reminding, if the duration of the identified driving state which is the appointed driving state exceeds a preset threshold value, the double flashing lights of the vehicle are automatically controlled to further remind other vehicles coming and going, and then the cold air of the vehicle is controlled to be opened.
In the embodiment of the present application, a possible implementation manner is provided, and the reminding module 230 shown in fig. 2 is further configured to:
controlling the double-flashing and cold air enabling of the vehicle according to the duration of the identified driving state as the designated driving state by using the following formula:
wherein D (t) represents a double flashing and cold air enable control value of the vehicle at the present time;
if d (t) is 0, it means that the double flashing and the cold air of the vehicle do not need to be controlled to be opened at the current time;
if d (t) is 1, it indicates that the double flashing and the cooling of the vehicle need to be controlled to be turned on at the present time.
In the embodiment of the present application, a possible implementation manner is provided, and the reminding module 230 shown in fig. 2 is further configured to:
controlling the vehicle cool air temperature according to the current time and the cool air enable and recognized driving state of the driver using the following formula:
wherein q (t) represents a cool air temperature control value of the vehicle at the present time; q max Represents a maximum value of temperature within a cool air controllable range of the vehicle; q min Indicating a minimum value of temperature within a cool air controllable range of the vehicle.
The automatic reminding device based on the deep learning provided by the embodiment of the application firstly obtains a driving image of a driver in the driving process; identifying the driving image through a deep learning algorithm to identify the driving state of a driver; and when the recognized driving state is the designated driving state, automatically making a sound for reminding. It can be seen that the abnormal driving state can be timely reminded, the safety of the vehicle in the driving process is improved, and traffic accidents are reduced.
It can be clearly understood by those skilled in the art that the specific working processes of the system, the apparatus, and the module described above may refer to the corresponding processes in the foregoing method embodiments, and for the sake of brevity, the detailed description is omitted here.
Those of ordinary skill in the art will understand that: the technical solution of the present application may be essentially or wholly or partially embodied in the form of a software product, where the computer software product is stored in a storage medium and includes program instructions for enabling an electronic device (e.g., a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application when the program instructions are executed. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, an optical disk, or the like.
Alternatively, all or part of the steps of implementing the foregoing method embodiments may be implemented by hardware (an electronic device such as a personal computer, a server, or a network device) associated with program instructions, which may be stored in a computer-readable storage medium, and when the program instructions are executed by a processor of the electronic device, the electronic device executes all or part of the steps of the method described in the embodiments of the present application.
The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments can be modified or some or all of the technical features can be equivalently replaced within the spirit and principle of the present application; such modifications or substitutions do not depart from the scope of the present application.
Claims (2)
1. An automatic reminding method based on deep learning is characterized by comprising the following steps:
acquiring a driving image of a driver in a driving process;
identifying the driving image through a deep learning algorithm to identify the driving state of a driver;
when the recognized driving state is the designated driving state, automatically making a sound for reminding;
after the automatic sounding for reminding, the method further comprises the following steps:
controlling the volume of the automatically emitted sound according to the duration of the identified driving state as the specified driving state;
wherein the volume of the automatically emitted sound is controlled according to the duration of the identified driving state as the designated driving state by using the following formula:
wherein e (t) represents a volume value of the automatically emitted sound at the current time; t represents the current time; e max A maximum volume value representing the automatically emitted sound; f (t) is a value indicating the driving state output of the driver recognized by the deep learning algorithm, and if the driving state is dozing at the present timeIf the driving state at the current moment is not dozing, f (t) is output as 1, otherwise, f (t) is output as 0; t is t 0 Indicating a time at which the driving state of the driver recognized for the first time is dozing; t represents a preset fatigue time;
after the automatic sounding for reminding, the method further comprises the following steps:
if the recognized driving state is that the duration of the specified driving state exceeds a preset threshold value, automatically controlling double flashing lights of the vehicle to remind other vehicles in the coming and going directions, and then controlling to turn on the cold air of the vehicle;
wherein the double flashing and cold air enabling of the vehicle is controlled according to the duration of the identified driving state as the designated driving state by using the following formula:
wherein D (t) represents a double flashing and cold air enable control value of the vehicle at the present time;
if D (t) is 0, the control of double flashing and cold air of the vehicle is not needed to be opened at the current moment;
if D (t) is 1, the double flashing and the cold air of the vehicle need to be controlled and opened at the current moment;
wherein the vehicle cold air temperature is controlled according to the current time and the cold air enable and recognized driving state of the driver using the following formula:
wherein q (t) represents a cool air temperature control value of the vehicle at the present time; q max Represents a maximum value of temperature within a cool air controllable range of the vehicle; q min Indicating a minimum value of the temperature within the cool air controllable range of the vehicle.
2. An automatic reminding device based on deep learning, comprising:
the acquisition module is used for acquiring a driving image of a driver in the driving process;
the recognition module is used for recognizing the driving image through a deep learning algorithm and recognizing the driving state of a driver;
the reminding module is used for automatically making a sound for reminding when the identified driving state is the designated driving state;
wherein, the reminding module is also used for:
after automatically making a sound for reminding, controlling the volume of the automatically made sound according to the duration of the identified driving state as the specified driving state;
wherein, the reminding module is also used for:
controlling the volume of the automatically emitted sound according to the duration of the identified driving state as the designated driving state by using the following formula:
wherein e (t) represents a volume value of the automatically emitted sound at the current time; t represents the current time; e max A maximum volume value representing the automatically emitted sound; f (t) is a driving state output value of the driver identified by the deep learning algorithm, and if the driving state at the present time is dozing, f (t) is 1, whereas if the driving state at the present time is not dozing, f (t) is 0; t is t 0 Indicating a time at which the driving state of the driver recognized for the first time is dozing; t represents a preset fatigue time;
wherein, the reminding module is also used for:
after the vehicle is automatically sounded for reminding, if the duration of the identified driving state is the specified driving state exceeds a preset threshold, automatically controlling double flashing lights of the vehicle to remind other vehicles coming and going, and then controlling to turn on the cold air of the vehicle;
wherein, the reminding module is also used for: controlling the double-flashing and cold air enabling of the vehicle according to the duration of the identified driving state as the designated driving state by using the following formula:
wherein D (t) represents the double flashing and cold air enabling control values of the vehicle at the current moment;
if d (t) is 0, it means that the double flashing and the cold air of the vehicle do not need to be controlled to be opened at the current time;
if D (t) is 1, the double flash and the cold air of the vehicle need to be controlled to be opened at the current moment;
wherein, the reminding module is also used for: controlling the vehicle cool air temperature according to the current time and the cool air enable and recognized driving state of the driver using the following formula:
wherein q (t) represents a cool air temperature control value of the vehicle at the present time; q max Represents a maximum value of temperature within a cool air controllable range of the vehicle; q min Indicating a minimum value of temperature within a cool air controllable range of the vehicle.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111633211.5A CN114228734B (en) | 2021-12-29 | 2021-12-29 | Automatic reminding method and device based on deep learning |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111633211.5A CN114228734B (en) | 2021-12-29 | 2021-12-29 | Automatic reminding method and device based on deep learning |
Publications (2)
Publication Number | Publication Date |
---|---|
CN114228734A CN114228734A (en) | 2022-03-25 |
CN114228734B true CN114228734B (en) | 2022-08-19 |
Family
ID=80744104
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111633211.5A Active CN114228734B (en) | 2021-12-29 | 2021-12-29 | Automatic reminding method and device based on deep learning |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114228734B (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108407813A (en) * | 2018-01-25 | 2018-08-17 | 惠州市德赛西威汽车电子股份有限公司 | A kind of antifatigue safe driving method of vehicle based on big data |
CN111098860A (en) * | 2019-12-16 | 2020-05-05 | 东风汽车有限公司 | Automobile driving fatigue relieving method, electronic equipment, fatigue driving judging method and server |
CN111354161A (en) * | 2018-12-20 | 2020-06-30 | 奥迪股份公司 | Fatigue driving reminding method and device, computer equipment and storage medium |
WO2021106024A1 (en) * | 2019-11-25 | 2021-06-03 | Vdproject S.R.L. | Automatic guidance system substituting the driver in case of malaise or critical conditions |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS5634527A (en) * | 1979-08-29 | 1981-04-06 | Nissan Motor Co Ltd | Car safety device |
US7113100B2 (en) * | 2003-03-20 | 2006-09-26 | Denso Corporation | Vehicle tiredness alleviating system |
JP2016020177A (en) * | 2014-07-15 | 2016-02-04 | 株式会社デンソー | Driving control device |
CN105730370A (en) * | 2014-12-11 | 2016-07-06 | 鸿富锦精密工业(深圳)有限公司 | Automobile driving system and control method |
DE102015001248B4 (en) * | 2015-01-31 | 2020-06-04 | Audi Ag | Method and system for operating a motor vehicle |
CN104986160A (en) * | 2015-06-16 | 2015-10-21 | 北京亿利智慧能源科技有限公司 | Electric automobile driving behavior guide instrument |
KR102026806B1 (en) * | 2017-04-28 | 2019-09-30 | 쌍용자동차 주식회사 | Health care apparatus with a passenger physical condition measurement in a vehicle |
KR20190050633A (en) * | 2017-11-03 | 2019-05-13 | 주식회사 만도 | System and method for controlling vehicle based on condition of driver |
CN108372785B (en) * | 2018-04-25 | 2023-06-23 | 吉林大学 | Image recognition-based automobile unsafe driving detection device and detection method |
CN108961681B (en) * | 2018-07-23 | 2021-02-02 | 奇瑞汽车股份有限公司 | Fatigue driving reminding method and device and storage medium |
CN109272764B (en) * | 2018-09-30 | 2020-12-08 | 广州鹰瞰信息科技有限公司 | Dangerous driving reminding method and system |
KR102143211B1 (en) * | 2019-01-09 | 2020-08-11 | (주)씨앤아이피 | A method and system for preventing drowsiness driving and keeping vehicle safe |
CN110097783A (en) * | 2019-05-15 | 2019-08-06 | 芜湖汽车前瞻技术研究院有限公司 | Vehicle early warning method and system |
CN110667593B (en) * | 2019-09-06 | 2022-05-17 | 中国平安财产保险股份有限公司 | Driving reminding method, device and equipment based on deep learning and storage medium |
CN110962591B (en) * | 2019-11-29 | 2021-08-17 | 浙江大华技术股份有限公司 | Fatigue driving detection method, device, computer equipment and storage medium |
JP2021096696A (en) * | 2019-12-18 | 2021-06-24 | パナソニックIpマネジメント株式会社 | Condition notification device for vehicle and condition notification method for vehicle |
CN111829783A (en) * | 2020-07-21 | 2020-10-27 | 上海振华重工(集团)股份有限公司 | Real-time defect detection system for variable-speed rotating mechanism |
CN112950900A (en) * | 2021-01-27 | 2021-06-11 | 吉林云帆智能工程有限公司 | Driver behavior monitoring and detecting method |
CN113479211B (en) * | 2021-07-27 | 2022-03-18 | 广东机电职业技术学院 | Method and system for identifying and reminding automobile driving safety behaviors based on machine vision |
-
2021
- 2021-12-29 CN CN202111633211.5A patent/CN114228734B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108407813A (en) * | 2018-01-25 | 2018-08-17 | 惠州市德赛西威汽车电子股份有限公司 | A kind of antifatigue safe driving method of vehicle based on big data |
CN111354161A (en) * | 2018-12-20 | 2020-06-30 | 奥迪股份公司 | Fatigue driving reminding method and device, computer equipment and storage medium |
WO2021106024A1 (en) * | 2019-11-25 | 2021-06-03 | Vdproject S.R.L. | Automatic guidance system substituting the driver in case of malaise or critical conditions |
CN111098860A (en) * | 2019-12-16 | 2020-05-05 | 东风汽车有限公司 | Automobile driving fatigue relieving method, electronic equipment, fatigue driving judging method and server |
Non-Patent Citations (2)
Title |
---|
基于LabVIEW***的汽车驾驶员防困与预警***;王剑等;《中国科技信息》;20180129;131-133 * |
现代汽车自动空调***探讨;吴艳等;《科技与企业》;20130606(第11期);364 * |
Also Published As
Publication number | Publication date |
---|---|
CN114228734A (en) | 2022-03-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019095937A1 (en) | Collision warning method and device | |
CN113345204B (en) | Vehicle-mounted remote fatigue awakening method and awakening system thereof | |
US20090268022A1 (en) | Wakefulness level estimation apparatus | |
CN110588548A (en) | Method for preventing fatigue driving and vehicle driving management system | |
JPH10315800A (en) | Traveling auxiliary device for vehicle | |
CN110395260A (en) | Vehicle, safe driving method and device | |
CN111492420B (en) | Doze alarm device | |
CN114049677B (en) | Vehicle ADAS control method and system based on driver emotion index | |
CN105678961A (en) | Anti-fatigue driving automobile safety warning system and warning method | |
CN109801475A (en) | Method for detecting fatigue driving, device and computer readable storage medium | |
JP2008099884A (en) | Condition estimating apparatus | |
DE102021101561A1 (en) | APPROXIMATE VEHICLE SAFETY SYSTEMS AND PROCEDURES | |
JPH11339200A (en) | Detector for driving vehicle asleep | |
CN113331841A (en) | Bus risk coefficient evaluation method, algorithm box and system | |
CN111145750A (en) | Control method and device for vehicle-mounted intelligent voice equipment | |
CN114228734B (en) | Automatic reminding method and device based on deep learning | |
CN111976626A (en) | Mode control method, device, vehicle and computer readable storage medium | |
CN114463940A (en) | Method and equipment for warning abnormal driving behavior of driver by lamplight | |
CN212709241U (en) | Safety reminding device for preventing fatigue driving | |
CN113168758B (en) | Method of determining a level of drowsiness of a driver of a vehicle | |
EP3000395A1 (en) | System and method for monitoring a subject's eye | |
CN108162899B (en) | Control method and device for vehicle-mounted intelligent equipment | |
CN115352450A (en) | Vehicle driving assistance method and device, vehicle and storage medium | |
CN113516015B (en) | Emotion recognition method, driving assisting device and application | |
CN209343500U (en) | A kind of timely fatigue alarm set |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |