CN113911095A - Failure-preventing voice braking system and method - Google Patents
Failure-preventing voice braking system and method Download PDFInfo
- Publication number
- CN113911095A CN113911095A CN202111343761.3A CN202111343761A CN113911095A CN 113911095 A CN113911095 A CN 113911095A CN 202111343761 A CN202111343761 A CN 202111343761A CN 113911095 A CN113911095 A CN 113911095A
- Authority
- CN
- China
- Prior art keywords
- voice
- driver
- brake
- braking
- pedal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000001815 facial effect Effects 0.000 claims abstract description 18
- 230000003993 interaction Effects 0.000 claims abstract description 10
- 230000008921 facial expression Effects 0.000 claims abstract description 9
- 238000012544 monitoring process Methods 0.000 claims description 49
- 230000008569 process Effects 0.000 claims description 11
- 230000008859 change Effects 0.000 claims description 2
- 230000004044 response Effects 0.000 claims description 2
- 206010039740 Screaming Diseases 0.000 description 5
- 239000012141 concentrate Substances 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000002265 prevention Effects 0.000 description 3
- 102100034112 Alkyldihydroxyacetonephosphate synthase, peroxisomal Human genes 0.000 description 2
- 101000799143 Homo sapiens Alkyldihydroxyacetonephosphate synthase, peroxisomal Proteins 0.000 description 2
- 238000000848 angular dependent Auger electron spectroscopy Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004399 eye closure Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60T—VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
- B60T17/00—Component parts, details, or accessories of power brake systems not covered by groups B60T8/00, B60T13/00 or B60T15/00, or presenting other characteristic features
- B60T17/18—Safety devices; Monitoring
- B60T17/22—Devices for monitoring or checking brake systems; Signal devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W40/09—Driving style or behaviour
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/12—Brake pedal position
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Regulating Braking Force (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a voice braking system and a method for preventing failure, wherein the system comprises: the system comprises a camera, a face recognition system, a voice recognition system and a brake execution system, wherein the camera monitors the state of a brake pedal; the facial recognition system monitors facial expressions of the driver; the voice recognition system responds to a voice command, switches among voice, full force and pedal braking modes according to brake pedal state information, driver face information and interaction information with a driver, and obtains a percentage braking signal based on the voice command in the voice braking mode; the brake execution system is used for braking according to the percentage brake signal in the voice brake mode; performing a maximum percentage braking in a full force braking mode; and pedal braking in the pedal braking mode. The voice brake system and the method for preventing failure provided by the invention provide standby voice control aiming at the damage condition of the brake pedal; after the driver can not control the vehicle, the vehicle brake is automatically switched on, and the safety is guaranteed.
Description
Technical Field
The invention relates to the technical field of vehicle safety, in particular to a voice braking system and method for preventing failure.
Background
The current brake systems all use a mechanical brake pedal as the input (percentage signal) of the braking intention of a driver; however, in reality, some product quality defects exist, so that the pedal is broken when the brake system is greatly stepped, and the brake system cannot be used. In addition, in some current market cases, some inexperienced drivers fail to operate the accelerator pedal as a brake due to tension at the moment of an accident, and the drivers only call for help loudly in the panic process, so that the drivers give up operating the vehicle.
Aiming at the condition of brake pedal breakage, a driver can only realize side parking by lowering the accelerator and downshifting, but cannot realize braking if sudden accidents occur. Aiming at the situation that a driver calls for help loudly and gives up operating a vehicle in an unexpected situation, the automatic emergency braking can be realized by mainly adopting ADAS technologies such as AEB (automatic emergency braking system) and the like at present, but a radar, a camera sensor and an ADAS controller are required to be added, the cost is higher, and the popularization rate is still not high at present.
Therefore, a voice braking system and method for preventing failure is needed.
Disclosure of Invention
The invention aims to provide a voice braking system and a voice braking method for preventing failure, which are used for solving the problems in the prior art, can assist in realizing automatic braking and are beneficial to reducing accident risks.
The invention provides a voice brake system for preventing failure, which comprises:
the system comprises a pedal operation monitoring camera, a driver face recognition system, a voice recognition system and a brake execution system, wherein the pedal operation monitoring camera and the driver face recognition system are connected with the voice recognition system, and the voice recognition system is connected with the brake execution system, wherein:
the pedal operation monitoring camera is used for monitoring the working state of the brake pedal to obtain the state information of the brake pedal;
the driver face recognition system is used for monitoring the facial expression of the driver to obtain the facial information of the driver;
the voice recognition system is used for responding to an active switching voice command, and/or switching among a voice braking mode, a full-force braking mode and a pedal braking mode according to the brake pedal state information, and/or the facial information of the driver, and/or the interaction information with the driver, recognizing the voice braking command in the voice braking mode, obtaining a percentage brake pedal signal according to the recognized voice braking command, and outputting the percentage brake pedal signal through voice;
the brake execution system is used for braking the whole vehicle according to the percentage brake pedal signal in the voice brake mode; in the full-force braking mode, automatically executing maximum percentage braking; in the pedal braking mode, braking is performed by a brake pedal.
The fail-safe voice brake system as described above, wherein preferably, the fail-safe voice brake system further includes a system start/stop switch connected to the pedal operation monitoring camera, the driver face recognition system, and the voice recognition system.
The voice brake system for preventing failure as described above, wherein preferably, the pedal operation monitoring camera is specifically configured to monitor an operating state of the brake pedal in the pedal braking mode, and automatically switch to the voice braking mode in case of failure of the brake pedal.
The voice brake system for preventing a malfunction as described above, wherein it is preferable that the driver face recognition system is specifically configured to determine whether the driver is in a startle or long-time eye closure state based on the driver face information.
The voice brake system for preventing failure as described above, wherein preferably, the brake execution system is further configured to perform instant brake reminding to remind the driver to take over the vehicle when the driver is in a panic state or a long-time eye-closing state;
the voice recognition system is also used for carrying out instant voice reminding when the driver is in a terrorist or long-time eye-closing state so as to remind the driver to take over the vehicle, recognizing voice feedback information of the driver aiming at the instant brake reminding or voice reminding, and detecting whether the driver calls for help aloud or not after the voice feedback information is not received.
The voice brake system for preventing failure as described above, wherein preferably, the pedal operation monitoring camera is further used for detecting whether the brake pedal is changed when the voice recognition system detects that the driver calls for help loudly.
The voice brake system for preventing failure as described above, wherein preferably, the voice recognition system is further configured to switch the pedal braking mode to the full-force braking mode when the driver calls for help with a loud voice and the pedal operation monitoring camera detects that the brake pedal is unchanged, and to report the current braking state through voice so as to determine whether to interrupt the braking process according to the voice feedback information of the driver and return to the pedal braking mode.
The invention also provides a failure prevention voice braking method adopting the system, which comprises the following steps:
monitoring the working state of a brake pedal to obtain the state information of the brake pedal;
monitoring the facial expression of a driver to obtain facial information of the driver;
responding to an active switching voice command, and/or switching among a voice braking mode, a full-force braking mode and a pedal braking mode according to the brake pedal state information, and/or the facial information of the driver, and/or the interaction information with the driver, identifying the voice braking command in the voice braking mode, obtaining a percentage brake pedal signal according to the identified voice braking command, and outputting the percentage brake pedal signal through voice;
in the voice braking mode, braking the whole vehicle according to the percentage brake pedal signal; in the full-force braking mode, automatically executing maximum percentage braking; in the pedal braking mode, braking is performed by a brake pedal.
The voice braking method for preventing failure as described above, wherein preferably, the monitoring the operating state of the brake pedal to obtain the brake pedal state information specifically includes:
monitoring the working state of a brake pedal in the pedal braking mode, and automatically switching to the voice braking mode under the condition that the brake pedal is invalid;
when the driver is detected to call for help loudly, whether the brake pedal is changed is detected,
the monitoring of the facial expression of the driver to obtain the facial information of the driver specifically comprises:
whether the driver is in a panic state or a state of closing eyes for a long time is determined based on the face information of the driver.
The voice brake method for preventing failure as described above, wherein preferably, the switching among the voice brake mode, the full force brake mode and the pedal brake mode in response to actively switching the voice command and/or according to the brake pedal state information, and/or the driver face information, and/or the interaction information with the driver, and in the voice brake mode, recognizing the voice brake command, obtaining the percentage brake pedal signal according to the recognized voice brake command, and outputting the percentage brake pedal signal by voice, specifically comprises:
when the driver is in a panic state or a long-time eye-closing state, instant voice reminding is carried out to remind the driver to take over the vehicle, voice feedback information of the driver for instant braking reminding or voice reminding is identified, and whether the driver calls for help aloud is detected after the voice feedback information is not received;
when the driver calls for help with loud voice and the brake pedal is unchanged, the brake mode of the pedal is switched to the full-force brake mode, the current brake state is broadcasted through voice, whether the brake process is interrupted or not is determined according to the voice feedback information of the driver, the brake mode of the pedal is returned,
in the voice braking mode, braking the whole vehicle according to the percentage brake pedal signal; in the full-force braking mode, automatically executing maximum percentage braking; in the pedal braking mode, braking is performed through a brake pedal, and the method specifically comprises the following steps:
in the voice braking mode, braking the whole vehicle based on a percentage brake pedal signal obtained by a voice braking instruction of a driver;
in the full-force braking mode, automatically executing 100% braking;
in the pedal braking mode, braking is carried out through a brake pedal;
and when the driver is in a terror or eyes-closed state for a long time, instant braking reminding is carried out to remind the driver to take over the vehicle.
The voice brake system and the method for preventing failure provide a standby voice control scheme aiming at the condition that the brake pedal is damaged, and simultaneously, a driver can actively switch voice control and completely control the brake effect through the voice; after the pedal operation monitoring camera, the driver face recognition system and the voice recognition system judge that the driver loses the capability of controlling the vehicle, the brake of the vehicle is automatically switched in, so that the safety is guaranteed; the driver can interrupt the progress of voice brake control or full-force brake control by voice and return to pedal control; the voice backup braking function except the physical brake pedal is provided, a driver can actively switch to voice control according to own requirements, and the control of the brake pedal under the foot is omitted; after the brake pedal is damaged or the foot is injured by accident, an additional control scheme is provided; whether a driver has the ability to control the vehicle is judged through a pedal operation monitoring camera, a voice recognition system and a driver face recognition system, and when the driver is judged not to concentrate on driving, instant braking reminding and voice prompt can be provided, so that the driver takes over the vehicle; if the driver does not take over, the driver can be further judged to lose the capability of controlling the vehicle, the full force is decelerated, and the accident hazard is prevented or reduced.
Drawings
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described with reference to the accompanying drawings, in which:
FIG. 1 is a block diagram of an embodiment of a voice braking system for failure prevention provided by the present invention;
FIG. 2 is a flow chart of a voice braking method for failure prevention provided by the present invention;
fig. 3 is a schematic diagram of a voice braking method for preventing failure according to the present invention.
Detailed Description
Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. The description of the exemplary embodiments is merely illustrative and is in no way intended to limit the disclosure, its application, or uses. The present disclosure may be embodied in many different forms and is not limited to the embodiments described herein. These embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art. It should be noted that: the relative arrangement of parts and steps, the composition of materials, numerical expressions and numerical values set forth in these embodiments are to be construed as merely illustrative, and not as limitative, unless specifically stated otherwise.
As used in this disclosure, "first", "second": and the like, do not denote any order, quantity, or importance, but rather are used to distinguish one element from another. The word "comprising" or "comprises", and the like, means that the element preceding the word covers the element listed after the word, and does not exclude the possibility that other elements are also covered. "upper", "lower", and the like are used merely to indicate relative positional relationships, and when the absolute position of the object being described is changed, the relative positional relationships may also be changed accordingly.
In the present disclosure, when a specific component is described as being located between a first component and a second component, there may or may not be intervening components between the specific component and the first component or the second component. When it is described that a specific component is connected to other components, the specific component may be directly connected to the other components without having an intervening component, or may be directly connected to the other components without having an intervening component.
All terms (including technical or scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs unless specifically defined otherwise. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail, but are intended to be part of the specification where appropriate.
As shown in fig. 1, the voice brake system for preventing failure according to this embodiment includes: the system comprises a pedal operation monitoring camera 1, a driver face recognition system 2, a voice recognition system 3 and a brake execution system 4, wherein the pedal operation monitoring camera 1 and the driver face recognition system 2 are connected with the voice recognition system 3, the voice recognition system 3 is connected with the brake execution system 4, and the system comprises:
the pedal operation monitoring camera 1 is used for monitoring the working state of the brake pedal to obtain the state information of the brake pedal;
the driver face recognition system 2 is used for monitoring the facial expression of the driver to obtain the facial information of the driver;
the voice recognition system 3 is used for responding to an active switching voice command, and/or switching among a voice braking mode, a full-force braking mode and a pedal braking mode according to the brake pedal state information, and/or the facial information of the driver, and/or the interaction information with the driver, recognizing the voice braking command in the voice braking mode, obtaining a percentage brake pedal signal according to the recognized voice braking command, and outputting the percentage brake pedal signal through voice;
the brake execution system 4 is used for braking the whole vehicle according to the percentage brake pedal signal in the voice brake mode; in the full-force braking mode, automatically executing maximum percentage braking; in the pedal braking mode, braking is performed by a brake pedal.
The pedal operation monitoring camera 1 is specifically configured to monitor an operating state of a brake pedal in the pedal braking mode, and automatically switch to the voice braking mode when the brake pedal fails (for example, the brake pedal is disconnected due to damage). The driver face recognition system 2 is specifically configured to determine whether the driver is in a panic state or a long-time eye-closing state based on the driver face information.
Further, the voice brake system for preventing failure further comprises a system start-stop switch 5 connected with the pedal operation monitoring camera 1, the driver face recognition system 2 and the voice recognition system 3. The system can be activated and deactivated by means of a system start-stop switch 5.
Furthermore, the brake execution system 4 is further configured to perform an instant brake prompt (for example, 50% brake percentage and 0.5s duration) to prompt the driver to take over the vehicle when the driver is in a panic state or a long-time eye closing state.
Further, the voice recognition system 3 is further configured to perform instant voice reminding when the driver is in a panic state (capable of detecting whether the eyes of the driver are open or large) or in a state of closing the eyes for a long time, so as to remind the driver to take over the vehicle, recognize voice feedback information of the driver for the instant brake reminding or the voice reminding, and detect whether the driver calls for help aloud after the driver does not receive the voice feedback information (for example, the driver does not have explicit voice feedback and can recognize whether the driver refuses to intervene through keywords) (for example, whether the driver has obvious scream sound greater than 70 db or scream sound including keywords such as "life saving" keyword or scream sound emitting keywords such as "ao" lasting for more than 2 seconds) can be detected.
Further, the pedal operation monitoring camera 1 is further configured to detect whether there is a change in the brake pedal when the voice recognition system 3 detects that the driver calls for help loudly.
Furthermore, the voice recognition system 3 is further configured to, when the driver calls for help with a loud voice and the pedal operation monitoring camera 1 detects that the brake pedal is unchanged (at this time, it may be determined that the current state is an emergency state and the driver has lost the ability to operate the vehicle), switch from the pedal braking mode to the full-force braking mode, and broadcast the current braking state through voice so as to determine whether to interrupt the braking process according to the voice feedback information of the driver, and return to the pedal braking mode. At this time, the driver may interrupt the braking process by voice to return the vehicle to the pedal braking mode.
In the working process, the pedal is monitored by the monitoring camera 1 operated by the pedal, if the pedal is damaged and disconnected, the voice braking mode is automatically switched, and the pedal is switched by voice broadcasting; the driver can also send an active switching voice command via the voice recognition system 3. In the voice braking mode, the driver can judge and output a percentage braking pedal signal through a specific percentage of braking values (such as 50% braking, 30% braking and the like) by the voice recognition system 3, the output form is such as broadcasting through voice, and the braking execution system 4 refers to the pedal values of the percentage braking pedal signal to realize the corresponding braking of the whole vehicle. After the fact that the driver loses vehicle control is judged through facial recognition and voice recognition according to brake pedal state information, driver facial information and interaction information of the driver, the brake of the vehicle is automatically switched in, and a pedal brake mode is switched to a full-force brake mode, so that the vehicle is stopped as soon as possible, and safety is guaranteed.
The voice brake system for preventing failure provided by the embodiment of the invention provides a standby voice control scheme aiming at the condition that a brake pedal is damaged, and meanwhile, a driver can actively switch voice control and completely control the brake effect through voice; after the pedal operation monitoring camera, the driver face recognition system and the voice recognition system judge that the driver loses the capability of controlling the vehicle, the brake of the vehicle is automatically switched in, so that the safety is guaranteed; the driver can interrupt the progress of voice brake control or full-force brake control by voice and return to pedal control; the voice backup braking function except the physical brake pedal is provided, a driver can actively switch to voice control according to own requirements, and the control of the brake pedal under the foot is omitted; after the brake pedal is damaged or the foot is injured by accident, an additional control scheme is provided; whether a driver has the ability to control the vehicle is judged through a pedal operation monitoring camera, a voice recognition system and a driver face recognition system, and when the driver is judged not to concentrate on driving, instant braking reminding and voice prompt can be provided, so that the driver takes over the vehicle; if the driver does not take over, the driver can be further judged to lose the capability of controlling the vehicle, the full force is decelerated, and the accident hazard is prevented or reduced.
As shown in fig. 2, in the actual implementation process of the voice braking method for preventing failure provided in this embodiment, the method specifically includes:
and step S1, monitoring the working state of the brake pedal to obtain the state information of the brake pedal.
In an embodiment of the voice braking method for preventing failure according to the present invention, the step S1 may specifically include:
and step S11, monitoring the working state of the brake pedal in the pedal braking mode, and automatically switching to the voice braking mode when the brake pedal fails (for example, the brake pedal is disconnected due to damage).
And step S12, detecting whether the brake pedal is changed when the driver calls for help loudly.
And step S2, monitoring the facial expression of the driver to obtain the facial information of the driver.
Specifically, it is determined whether the driver is in a startle or long-time eye-closed state based on the driver face information.
And step S3, responding to an active switching voice command, and/or switching among a voice braking mode, a full-force braking mode and a pedal braking mode according to the brake pedal state information, and/or the driver face information, and/or the interaction information with the driver, identifying the voice braking command in the voice braking mode, obtaining a percentage brake pedal signal according to the identified voice braking command, and outputting the percentage brake pedal signal through voice.
In an embodiment of the voice braking method for preventing failure according to the present invention, the step S3 may specifically include:
and step S31, when the driver is in a panic state or a long-time eye-closing state, performing instant voice reminding to remind the driver to take over the vehicle, recognizing the voice feedback information of the driver aiming at the instant brake reminding or the voice reminding, and detecting whether the driver calls for help aloud or not after the driver does not receive the voice feedback information (for example, the driver does not have clear voice feedback and can recognize whether the driver refuses to intervene through keywords).
Step S32, when the driver makes a loud call for help (for example, it may be detected whether the driver has a scream sound with a sound level greater than 70 db or whether the duration of the scream sound including a keyword "save" or a keyword "a" is emitted by the driver is greater than 2 seconds), and the brake pedal is unchanged, the brake pedal mode is switched to the full-force brake mode, and the current brake state is broadcasted through voice, so as to determine whether to interrupt the brake process according to the voice feedback information of the driver, and then the brake pedal mode is returned.
Step S4, braking the whole vehicle according to the percentage brake pedal signal in the voice brake mode; in the full-force braking mode, automatically executing maximum percentage braking; in the pedal braking mode, braking is performed by a brake pedal.
In an embodiment of the voice braking method for preventing failure according to the present invention, the step S4 may specifically include:
and step S41, braking the whole vehicle based on the percentage brake pedal signal obtained by the voice brake instruction of the driver in the voice brake mode.
And step S42, automatically executing 100% braking in the full-force braking mode.
And step S43, in the pedal braking mode, braking is performed by a brake pedal.
Step S44, when the driver is in a panic state or a long-time eye-closing state, an instant braking prompt (for example, the braking percentage is 50%, and the duration is 0.5S) is performed to prompt the driver to take over the vehicle.
Further, in some embodiments of the present invention, before step S1, the voice brake method for preventing failure further includes step S0 of turning on a system function switch.
As shown in FIG. 3, the present invention, in one embodiment, first, opens the function switch to enable and disable the system;
then, monitoring the pedal through a monitoring camera operated by the pedal, if the pedal is damaged and disconnected, automatically switching to a voice braking mode, and switching through voice broadcasting; the driver can also send an active switching voice command through the voice recognition system for actively switching to the voice braking mode;
then, in the voice braking mode, the driver can judge and output a percentage braking pedal signal through a voice recognition system according to the braking numerical value of a specific percentage, and a braking execution system refers to the pedal numerical value broadcasted through voice to realize corresponding braking of the whole vehicle.
In another embodiment of the invention, whether the driver is in a panic or long-time eye-closing state can be judged by the driver face recognition system; the method comprises the following steps of reminding a driver to take over a vehicle through instant braking reminding (for example, the braking percentage is 50%, and the duration is 0.5s) and voice, and if the driver has no clear voice feedback (for example, whether intervention is refused through keyword recognition), continuously judging whether the driver has obvious screaming (for example, whether the driver has obvious screaming sound larger than 70 decibels or screaming sound of keywords such as 'lifesaving' in screaming words or the duration of screaming sound of keywords such as 'e' is larger than 2 s) is detected; meanwhile, whether the brake pedal is changed or not is judged, if the brake pedal is still unchanged, the current state is judged to be an emergency state, at the moment, the driver loses the capability of operating the vehicle, and the voice recognition system is automatically switched to a full-force braking mode to ensure that the vehicle stops as soon as possible; meanwhile, the current braking state is broadcasted through voice, a driver can interrupt the braking process through the voice, and the vehicle returns to the pedal for braking.
According to the voice braking method for preventing failure, provided by the embodiment of the invention, a standby voice control scheme is provided aiming at the condition that a brake pedal is damaged, and meanwhile, a driver can actively switch voice control and completely control the braking effect through voice; after the pedal operation monitoring camera, the driver face recognition system and the voice recognition system judge that the driver loses the capability of controlling the vehicle, the brake of the vehicle is automatically switched in, so that the safety is guaranteed; the driver can interrupt the progress of voice brake control or full-force brake control by voice and return to pedal control; the voice backup braking function except the physical brake pedal is provided, a driver can actively switch to voice control according to own requirements, and the control of the brake pedal under the foot is omitted; after the brake pedal is damaged or the foot is injured by accident, an additional control scheme is provided; whether a driver has the ability to control the vehicle is judged through a pedal operation monitoring camera, a voice recognition system and a driver face recognition system, and when the driver is judged not to concentrate on driving, instant braking reminding and voice prompt can be provided, so that the driver takes over the vehicle; if the driver does not take over, the driver can be further judged to lose the capability of controlling the vehicle, the full force is decelerated, and the accident hazard is prevented or reduced.
Thus, various embodiments of the present disclosure have been described in detail. Some details that are well known in the art have not been described in order to avoid obscuring the concepts of the present disclosure. It will be fully apparent to those skilled in the art from the foregoing description how to practice the presently disclosed embodiments.
Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the foregoing examples are for purposes of illustration only and are not intended to limit the scope of the present disclosure. It will be understood by those skilled in the art that various changes may be made in the above embodiments or equivalents may be substituted for elements thereof without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.
Claims (10)
1. A fail-safe voice brake system, comprising:
the system comprises a pedal operation monitoring camera, a driver face recognition system, a voice recognition system and a brake execution system, wherein the pedal operation monitoring camera and the driver face recognition system are connected with the voice recognition system, and the voice recognition system is connected with the brake execution system, wherein:
the pedal operation monitoring camera is used for monitoring the working state of the brake pedal to obtain the state information of the brake pedal;
the driver face recognition system is used for monitoring the facial expression of the driver to obtain the facial information of the driver;
the voice recognition system is used for responding to an active switching voice command, and/or switching among a voice braking mode, a full-force braking mode and a pedal braking mode according to the brake pedal state information, and/or the facial information of the driver, and/or the interaction information with the driver, recognizing the voice braking command in the voice braking mode, obtaining a percentage brake pedal signal according to the recognized voice braking command, and outputting the percentage brake pedal signal through voice;
the brake execution system is used for braking the whole vehicle according to the percentage brake pedal signal in the voice brake mode; in the full-force braking mode, automatically executing maximum percentage braking; in the pedal braking mode, braking is performed by a brake pedal.
2. The fail-safe voice brake system of claim 1, further comprising a system start stop switch coupled to the pedal operation monitoring camera, the driver face recognition system, and the voice recognition system.
3. The fail-safe voice brake system according to claim 1, wherein the pedal operation monitoring camera is specifically configured to monitor an operating state of a brake pedal in the pedal braking mode and automatically switch to the voice braking mode in case of brake pedal failure.
4. Fail-safe voice brake system according to claim 1, characterized in that the driver facial recognition system is specifically adapted to determine whether the driver is in a panic or long eye-closing state based on driver facial information.
5. The failure-prevention voice brake system according to claim 4, wherein the brake execution system is further configured to perform instant brake reminding to remind the driver to take over the vehicle when the driver is in a panic state or a long-time eye-closing state;
the voice recognition system is also used for carrying out instant voice reminding when the driver is in a terrorist or long-time eye-closing state so as to remind the driver to take over the vehicle, recognizing voice feedback information of the driver aiming at the instant brake reminding or voice reminding, and detecting whether the driver calls for help aloud or not after the voice feedback information is not received.
6. The fail-safe voice brake system of claim 5, wherein the pedal operation monitoring camera is further configured to detect whether there is a change in a brake pedal when the voice recognition system detects a driver call for help loud.
7. The voice brake system for preventing failure according to claim 6, wherein the voice recognition system is further configured to switch the pedal braking mode to the full-force braking mode when the driver calls for help with a loud voice and the pedal operation monitoring camera detects that the brake pedal is unchanged, and to report the current braking state through voice so as to determine whether to interrupt the braking process according to the voice feedback information of the driver and return to the pedal braking mode.
8. A fail-safe voice brake method using the system of any one of claims 1-7, comprising the steps of:
monitoring the working state of a brake pedal to obtain the state information of the brake pedal;
monitoring the facial expression of a driver to obtain facial information of the driver;
responding to an active switching voice command, and/or switching among a voice braking mode, a full-force braking mode and a pedal braking mode according to the brake pedal state information, and/or the facial information of the driver, and/or the interaction information with the driver, identifying the voice braking command in the voice braking mode, obtaining a percentage brake pedal signal according to the identified voice braking command, and outputting the percentage brake pedal signal through voice;
in the voice braking mode, braking the whole vehicle according to the percentage brake pedal signal; in the full-force braking mode, automatically executing maximum percentage braking; in the pedal braking mode, braking is performed by a brake pedal.
9. The voice brake method for preventing failure according to claim 8, wherein the monitoring the operating state of the brake pedal to obtain the brake pedal state information specifically comprises:
monitoring the working state of a brake pedal in the pedal braking mode, and automatically switching to the voice braking mode under the condition that the brake pedal is invalid;
when the driver is detected to call for help loudly, whether the brake pedal is changed is detected,
the monitoring of the facial expression of the driver to obtain the facial information of the driver specifically comprises:
whether the driver is in a panic state or a state of closing eyes for a long time is determined based on the face information of the driver.
10. The fail-safe voice brake method according to claim 9, wherein the switching among a voice brake mode, a full force brake mode and a pedal brake mode is performed in response to an active switching voice command, and/or according to the brake pedal state information, and/or the driver face information, and/or the interaction information with the driver, and in the voice brake mode, a voice brake command is recognized, a percentage brake pedal signal is obtained according to the recognized voice brake command, and the percentage brake pedal signal is output by voice, specifically comprising:
when the driver is in a panic state or a long-time eye-closing state, instant voice reminding is carried out to remind the driver to take over the vehicle, voice feedback information of the driver for instant braking reminding or voice reminding is identified, and whether the driver calls for help aloud is detected after the voice feedback information is not received;
when the driver calls for help with loud voice and the brake pedal is unchanged, the brake mode of the pedal is switched to the full-force brake mode, the current brake state is broadcasted through voice, whether the brake process is interrupted or not is determined according to the voice feedback information of the driver, the brake mode of the pedal is returned,
in the voice braking mode, braking the whole vehicle according to the percentage brake pedal signal; in the full-force braking mode, automatically executing maximum percentage braking; in the pedal braking mode, braking is performed through a brake pedal, and the method specifically comprises the following steps:
in the voice braking mode, braking the whole vehicle based on a percentage brake pedal signal obtained by a voice braking instruction of a driver;
in the full-force braking mode, automatically executing 100% braking;
in the pedal braking mode, braking is carried out through a brake pedal;
and when the driver is in a terror or eyes-closed state for a long time, instant braking reminding is carried out to remind the driver to take over the vehicle.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111343761.3A CN113911095A (en) | 2021-11-13 | 2021-11-13 | Failure-preventing voice braking system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111343761.3A CN113911095A (en) | 2021-11-13 | 2021-11-13 | Failure-preventing voice braking system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113911095A true CN113911095A (en) | 2022-01-11 |
Family
ID=79246398
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111343761.3A Pending CN113911095A (en) | 2021-11-13 | 2021-11-13 | Failure-preventing voice braking system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113911095A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114312818A (en) * | 2022-01-29 | 2022-04-12 | 中国第一汽车股份有限公司 | Vehicle control method and device, vehicle and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102269656A (en) * | 2010-08-04 | 2011-12-07 | 长安大学 | Measuring apparatus for operation behavior on pedal by driver and monitoring method thereof |
| CN103287362A (en) * | 2013-06-25 | 2013-09-11 | 安科智慧城市技术（中国）有限公司 | Vehicle-mounted voice control system and method and electric automobile |
| CN107507395A (en) * | 2016-11-24 | 2017-12-22 | 四川大学 | A kind of fatigue driving detecting system and method |
| CN109094458A (en) * | 2018-08-20 | 2018-12-28 | 特治（深圳）智能科技实业有限公司 | The control method of safe driving of vehicle and control device for safe driving of vehicle |
| CN109572705A (en) * | 2018-12-11 | 2019-04-05 | 武汉格罗夫氢能汽车有限公司 | A kind of driver's motion management method, equipment and storage equipment |
| CN112078590A (en) * | 2019-05-27 | 2020-12-15 | 郑州宇通客车股份有限公司 | Driving behavior monitoring method and system |
-
2021
- 2021-11-13 CN CN202111343761.3A patent/CN113911095A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102269656A (en) * | 2010-08-04 | 2011-12-07 | 长安大学 | Measuring apparatus for operation behavior on pedal by driver and monitoring method thereof |
| CN103287362A (en) * | 2013-06-25 | 2013-09-11 | 安科智慧城市技术（中国）有限公司 | Vehicle-mounted voice control system and method and electric automobile |
| CN107507395A (en) * | 2016-11-24 | 2017-12-22 | 四川大学 | A kind of fatigue driving detecting system and method |
| CN109094458A (en) * | 2018-08-20 | 2018-12-28 | 特治（深圳）智能科技实业有限公司 | The control method of safe driving of vehicle and control device for safe driving of vehicle |
| CN109572705A (en) * | 2018-12-11 | 2019-04-05 | 武汉格罗夫氢能汽车有限公司 | A kind of driver's motion management method, equipment and storage equipment |
| CN112078590A (en) * | 2019-05-27 | 2020-12-15 | 郑州宇通客车股份有限公司 | Driving behavior monitoring method and system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114312818A (en) * | 2022-01-29 | 2022-04-12 | 中国第一汽车股份有限公司 | Vehicle control method and device, vehicle and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110626336B (en) | Control system for automatic driving of L3-grade vehicle | |
| US8618922B2 (en) | Method and system for ensuring operation of limited-ability autonomous driving vehicles | |
| US20200361428A1 (en) | Brake System for a Motor Vehicle and Method for Operating a Brake System | |
| CN110737192A (en) | Automobile driving redundancy control system and method thereof | |
| US20190168734A1 (en) | Emergency stop system and emergency stop method | |
| CN109689465A (en) | Driving mode transition controller, method and program | |
| CN113442894B (en) | Method and device for controlling vehicle brake, storage medium and vehicle | |
| CN111824173A (en) | Grading processing method and device suitable for faults of intelligent driving system | |
| CN113911095A (en) | Failure-preventing voice braking system and method | |
| CN112109724B (en) | Adaptive cruise control system activation method, vehicle, and readable storage medium | |
| US20120191317A1 (en) | Method and Device for Controlling the Operation of an Internal Combustion Engine | |
| JP2013086611A (en) | Brake light control device | |
| CN113247020A (en) | Vehicle take-over control method and system based on L3-level automatic driving | |
| CN111252080A (en) | Method for realizing unexpected power-off protection processing of high-speed running of vehicle | |
| US10179577B2 (en) | Method for controlling operation of a braking system independent of the state of an electronic stability control system | |
| US9062618B2 (en) | System and method for controlling an automatic stop-start engine system in an automotive vehicle having an electric parking brake | |
| CN113119967B (en) | Intelligent driving assisting method, device, equipment and storage medium | |
| CN110606086A (en) | Follow-up parking protection method and device, vehicle and storage medium | |
| CN113830085A (en) | Vehicle follow-up stop and start method, device, equipment and computer readable storage medium | |
| KR102224805B1 (en) | Advanced Emergency Braking System and Method for controlling thereof | |
| US11679787B2 (en) | Autonomous driving control method and device | |
| CN110901622A (en) | Vacuum pump control method and device | |
| US20230271595A1 (en) | Secondary brake control | |
| CN113200050B (en) | Control method of engineering vehicle, engineering vehicle and readable storage medium | |
| CN109624983B (en) | Fault processing system and method for gear signal failure |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220111 |
|
| RJ01 | Rejection of invention patent application after publication |