CN115762048A - Emergency call method and device, vehicle-mounted terminal and storage medium - Google Patents

Emergency call method and device, vehicle-mounted terminal and storage medium Download PDF

Info

Publication number
CN115762048A
CN115762048A CN202211166491.8A CN202211166491A CN115762048A CN 115762048 A CN115762048 A CN 115762048A CN 202211166491 A CN202211166491 A CN 202211166491A CN 115762048 A CN115762048 A CN 115762048A
Authority
CN
China
Prior art keywords
emergency
vehicle
emergency call
strategy
call
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211166491.8A
Other languages
Chinese (zh)
Inventor
王亚坤
贺磊
王泉
王恒华
赖树煜
李松
刘超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huizhou Desay SV Automotive Co Ltd
Original Assignee
Huizhou Desay SV Automotive Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huizhou Desay SV Automotive Co Ltd filed Critical Huizhou Desay SV Automotive Co Ltd
Priority to CN202211166491.8A priority Critical patent/CN115762048A/en
Publication of CN115762048A publication Critical patent/CN115762048A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Alarm Systems (AREA)

Abstract

The invention discloses an emergency call-for-help method, an emergency call-for-help device, a vehicle-mounted terminal and a storage medium. Wherein, the method comprises the following steps: and generating emergency call prompt information when an emergency trigger event is detected, determining an emergency strategy according to a response result of drivers and conductors aiming at the emergency call prompt information, and executing emergency call according to the emergency strategy. The embodiment of the invention solves the technical problem of single emergency strategy under emergency conditions in the prior art, realizes that the vehicle determines the corresponding emergency strategy according to different emergency trigger events, and further shortens the emergency time of drivers and conductors.

Description

Emergency call method and device, vehicle-mounted terminal and storage medium
Technical Field
The invention relates to the technical field of automotive electronics, in particular to an emergency call method, an emergency call device, a vehicle-mounted terminal and a storage medium.
Background
Automobiles play an extremely important role in national production, life and transportation, and have become an indispensable part of the life of contemporary people. As the time of people moving on the automobile increases, traffic accidents caused by vehicle failures and abnormal physical states of drivers and passengers occur frequently, and thus, driving safety and emergency calls about the automobile are particularly important at present.
Currently, a Telematics BOX (TBOX) in an automobile can implement two call modes, i.e., a normal call mode and an emergency call mode. The common calling mode is triggered passively by drivers and passengers, and the emergency calling mode is triggered actively by the vehicle body according to the damage degree of the vehicle body and the popping of the safety air bag. However, in practical applications, the following two situations are encountered: firstly, the vehicle stops due to abnormal physical states of drivers and conductors (such as syncope, sudden death and the like), but the emergency call function cannot be triggered; secondly, after a vehicle accident occurs, drivers and passengers may be in an injured or tense state, so that the current conditions inside or outside the vehicle cannot be expressed normally, the operator cannot accurately position the accident site, and the rescue time is delayed. Most of the existing emergency call methods can only provide early warning prompts and cannot determine corresponding emergency strategies according to different emergency situations, so that the emergency time of drivers and passengers is prolonged.
Disclosure of Invention
The invention provides an emergency call-for-help method, an emergency call-for-help device, a vehicle-mounted terminal and a storage medium, which are used for determining a corresponding emergency strategy according to different emergency trigger events and shortening the emergency time of drivers and passengers.
In a first aspect, an embodiment of the present invention provides an emergency call method, including:
generating emergency call prompt information when an emergency trigger event is detected;
determining an emergency strategy according to the response result of the driver and the passenger aiming at the emergency call prompt information;
and executing emergency call according to the emergency strategy.
In a second aspect, an embodiment of the present invention further provides an emergency call device, including:
the emergency call prompt module is used for generating emergency call prompt information when an emergency trigger event is detected;
the response detection module is used for determining an emergency strategy according to the response result of the driver and the crew for the emergency call-for-help prompt information;
and the emergency execution module is used for executing emergency call according to the emergency strategy.
In a third aspect, an embodiment of the present invention further provides a vehicle-mounted terminal, where the vehicle-mounted terminal includes:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the emergency call method according to any of the embodiments of the invention.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where computer instructions are stored, and the computer instructions are configured to, when executed by a processor, implement the emergency call-for-help method according to any embodiment of the present invention.
According to the technical scheme of the embodiment of the invention, the emergency call-for-help prompt information is generated when the emergency trigger event is detected, the emergency strategy is determined according to the response result of the driver and the passenger aiming at the emergency call-for-help prompt information, and then the emergency call-for-help is executed according to the emergency strategy. The embodiment of the invention solves the technical problem of single emergency strategy under emergency conditions in the prior art, realizes that the vehicle determines the corresponding emergency strategy according to different emergency trigger events, and further shortens the emergency time of drivers and passengers.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present invention, nor do they necessarily limit the scope of the invention. Other features of the present invention will become apparent from the following description.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart of an emergency call method according to an embodiment of the present invention;
fig. 2 is a flowchart of an emergency call method according to a second embodiment of the present invention;
fig. 3 is a flowchart of an emergency call method according to a third embodiment of the present invention;
fig. 4 is a block diagram of a process for determining whether a driver or a passenger is in an abnormal state according to a human body state sensor and an in-vehicle camera provided by a third embodiment of the present invention;
fig. 5 is a flowchart of another emergency call method according to a third embodiment of the present invention;
fig. 6 is a block diagram of a flow chart for triggering different call modes according to a CAN bus signal according to a third embodiment of the present invention;
fig. 7 is a schematic diagram of an operation mode of a backup battery module according to a third embodiment of the invention;
fig. 8 is a schematic structural diagram of an emergency call device according to a fourth embodiment of the present invention;
fig. 9 is a schematic structural diagram of a vehicle-mounted terminal for implementing the emergency call-for-help method according to the embodiment of the present invention;
fig. 10 is a schematic structural diagram of another vehicle-mounted terminal for implementing the emergency call-for-help method according to the embodiment of the invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example one
Fig. 1 is a flowchart of an emergency call method according to an embodiment of the present invention, where the embodiment is applicable to a situation where a vehicle determines a corresponding emergency policy according to different emergency trigger events, and the method may be executed by an emergency call device, where the emergency call device may be implemented in a form of hardware and/or software, and the emergency call device may be configured in a vehicle-mounted terminal. As shown in fig. 1, the method includes:
and S110, generating emergency call-for-help prompt information when an emergency trigger event is detected.
In the present embodiment, the emergency trigger event may be understood as an event for triggering an emergency call, and for example, the emergency trigger event may include a vehicle fault, an abnormal state of an occupant, and the like. The vehicle faults can comprise engine faults, transmission faults, steering wheel faults and the like; abnormal conditions of the driver and the passenger can include long-time closed eyes, upper half body lying on a steering wheel, left and right side falling coma and the like. The emergency call-for-help prompt information can be understood as corresponding call-for-help prompt information generated by the vehicle-mounted terminal when an emergency trigger event is detected. For example, the emergency call-for-help prompt message may be played and/or displayed on a voice playing device and/or a display device. In one implementation, when an emergency trigger event is detected, a word of "SOS" is displayed on the display device, and ring warning is performed through the voice playing device. In another implementation, when an emergency trigger event is detected, the voice-playing device plays "vehicle failed, please check immediately! "," driver and passenger status is abnormal, please check immediately! And the like prompt voice.
Specifically, the vehicle-mounted terminal generates corresponding emergency call prompt information according to the detected emergency trigger event, so that a corresponding emergency strategy can be determined subsequently according to the emergency call prompt information.
And S120, determining an emergency strategy according to the response result of the driver and the passenger to the emergency call prompt information.
In this embodiment, the response result may be understood as a result of determining whether the driver and the passenger perform corresponding feedback operations after the vehicle-mounted terminal generates the emergency call prompt information. Illustratively, the response result can comprise two results of the driver and the passenger having feedback response and no feedback response. The emergency strategy can be understood as a corresponding emergency call strategy determined by the vehicle-mounted terminal after the driver and the passengers make corresponding response operation according to the emergency call prompt information. Exemplary contingency policies may include, without limitation, several: firstly, when the vehicle breaks down but the damage condition is light, for example, drivers and passengers are not injured or are slightly injured, the vehicle-mounted terminal sends out a common call signal, audio communication equipment on the vehicle is opened according to instructions of the drivers and passengers to communicate with background personnel (operators or emergency units), and the background personnel provide on-site rescue guidance; secondly, when the vehicle breaks down but the damage is serious, for example, the driver and the passengers are faint, the vehicle-mounted terminal can send an emergency call signal, and can automatically start the video call equipment and the satellite positioning equipment on the vehicle, and the background personnel provide reasonable rescue equipment according to the field condition; thirdly, when the state of the driver and the passengers is abnormal but the serious conditions such as syncope do not occur, the vehicle-mounted terminal can send out voice alarm to remind the driver and the passengers to pay attention; and fourthly, when the state of the driver and the passengers is abnormal and severe conditions such as syncope occur, the vehicle-mounted terminal can send out an emergency call signal, the video call device and the satellite positioning device on the vehicle can be automatically started, and the background personnel provide reasonable rescue equipment according to the field conditions.
Specifically, after the vehicle-mounted terminal generates the emergency call prompt information, a corresponding emergency strategy is determined according to a response result of the driver and the passenger aiming at the emergency call prompt information, so that the corresponding emergency call is conveniently executed according to the emergency strategy.
And S130, executing emergency call according to the emergency strategy.
Specifically, according to the determined emergency strategies of different levels, the vehicle-mounted terminal executes corresponding emergency call measures. Illustratively, when the vehicle-mounted terminal detects that drivers and passengers are in an abnormal state or detects the state information of the popping of the safety airbag and the conditions of shock, syncope and the like occur, the vehicle-mounted terminal triggers an emergency call mechanism, at the moment, the vehicle-mounted terminal can send an emergency call signal and automatically start a video call device and a satellite positioning device on a vehicle, and background personnel provide reasonable rescue equipment according to the field conditions.
According to the technical scheme, the emergency call prompt information is generated when the emergency trigger event is detected, the emergency strategy is determined according to the response result of the driver and the passenger to the emergency call prompt information, and then the emergency call is executed according to the emergency strategy. The embodiment of the invention solves the technical problem of single emergency strategy under emergency conditions in the prior art, realizes that the vehicle determines the corresponding emergency strategy according to different emergency trigger events, and further shortens the emergency time of drivers and conductors.
Example two
Fig. 2 is a flowchart of an emergency call-for-help method provided in the second embodiment of the present invention, which is further optimized and expanded based on the foregoing embodiment, and may be combined with various optional technical solutions in the foregoing embodiment. As shown in fig. 2, the emergency call method provided in the second embodiment specifically includes the following steps:
and S210, controlling the image acquisition device to identify the postures of the drivers and passengers when the emergency trigger event is determined to be detected.
In this embodiment, the image capturing device may be understood as a software/hardware device for capturing the posture of the driver and the passenger, the image capturing device may be disposed inside or outside the vehicle, and the image capturing device may include a camera, a depth camera, a camera, and the like. For example, the number of the image acquisition devices may be multiple, the installation positions may be set according to actual conditions, and full coverage of posture information recognition of drivers and passengers may be achieved, which is not limited in the embodiment of the present invention. The posture can be understood as the physical form of the driver and the passenger, and exemplarily, the posture can include the eye state, the face state, the body posture and the like of the driver and the passenger. The method for recognizing the postures of the driver and the crew can comprise a traditional computer vision algorithm, a currently rapidly developed deep learning algorithm and the like, and the embodiment of the invention is not limited to this. Illustratively, the posture information of the driver and the passenger can be acquired through the image acquisition device, then a plurality of characteristic areas, such as eye areas, limb trunk areas and the like, are segmented from the posture information by utilizing a deep learning algorithm, and then the posture of the driver and the passenger at the moment is identified according to a corresponding identification algorithm, for example, the states of the driver and the passenger, such as dull eyesight, long eye closure and the like, are identified through eye characteristics, and the states of the driver and the passenger, such as long-time head lowering, long-time head bending over on a steering wheel or left and right side collapse and the like, are identified through limb trunk characteristics.
In some embodiments, the detection of the emergency trigger event comprises at least one of: detecting user calling information acquired by voice acquisition equipment; detecting abnormal state data of drivers and passengers acquired by a human body state sensor; vehicle fault information collected by a vehicle sensor is detected.
The voice acquisition device can be understood as a device for acquiring voice call information of drivers and passengers, the voice acquisition device can be arranged inside or outside the vehicle, and the voice acquisition device can comprise a microphone, a recorder and the like. The human body state sensor may be understood as a device capable of converting biological data of a human body into an electrical signal, and may include, for example, a heart rate sensor, a blood pressure sensor, a blood oxygen sensor, and the like. Vehicle sensors may be understood as devices capable of acquiring information about various operating conditions of the vehicle, and may include, for example, a total gas flow sensor, a throttle position sensor, a temperature sensor, an engine camshaft position sensor, an engine crankshaft position sensor, a speed per hour sensor, an engine knock sensor, an oxygen sensor, and the like.
Specifically, when the situation that at least one of the following situations is determined to occur, namely the vehicle-mounted terminal detects user calling information acquired by the voice acquisition device, detects abnormal state data of the driver and the passenger acquired by the human body state sensor or detects vehicle fault information acquired by the vehicle sensor, the vehicle-mounted terminal controls to open an image acquisition device in the vehicle to identify the posture of the driver and the passenger.
And S220, generating emergency call prompt information when the posture of the driver and the passengers is determined to be an abnormal posture.
In the present embodiment, the abnormal posture may be understood as an abnormal posture that may threaten the driving safety of the vehicle and/or the physical health of the driver and the passenger. For example, the abnormal posture may include a driver or a passenger leaving the steering wheel with one or both hands due to coma, long head-lowering, and the like. In some embodiments, the abnormal posture may be determined comprehensively according to the biological characteristic information collected by the human body state sensor and/or the posture information of the driver and passenger collected by the image collecting device. For example, when the biometric information acquired by the human body state sensor is greatly different from the data in the normal state, the vehicle-mounted terminal may actively control the image acquisition device to acquire the posture information of the driver and passenger, and if the driver and passenger are identified to be faint from the posture information, the current posture of the driver and passenger may be determined to be an abnormal posture.
Specifically, when the biological characteristic information acquired by the human body state sensor and/or the posture information of the driver and passengers acquired by the image acquisition device are abnormal, the vehicle-mounted terminal generates corresponding emergency call prompt information.
And S230, controlling the voice playing equipment to play the emergency call prompt information.
In the present embodiment, the voice playing device may be understood as a device for playing voice information, and exemplarily, the voice playing device may include a wired connection, a bluetooth connected car speaker, and the like.
Specifically, when the posture of the driver and the passengers is detected to be abnormal, the vehicle-mounted terminal controls the voice playing device in the vehicle to play emergency call prompt information to early warn the driver and the passengers.
And S240, detecting whether the voice acquisition equipment acquires the response information of the driver and the crew for the emergency call prompt information.
In this embodiment, the response information may be understood as a feedback operation made by the driver and the passenger for the emergency call prompt information. Illustratively, the response information can comprise the presence or absence of corresponding feedback operation of the driver and the passenger for the emergency call prompt information. In some embodiments, after the driver and the passenger receive the emergency call prompt information played by the voice playing device, if the awareness state of the driver and the passenger is good at the moment, the driver and the passenger can actively close the voice playing device and feed back the voice playing device to the voice collecting device, for example, a vehicle-mounted terminal controls the voice playing device in the vehicle to play the voice of 'alarm release'; if the consciousness state of the driver and the passenger is poor and the driver and the passenger have the activity ability, the voice acquisition equipment can be actively started to actively call; if the driver and the passenger completely lose consciousness and activity ability, such as shock, syncope and the like, the voice acquisition equipment cannot acquire any feedback operation of the driver and the passenger.
Specifically, after the voice playing device plays the emergency call prompt message, the vehicle-mounted terminal detects whether the voice collecting device collects the response message of the driver and the crew, so as to determine a corresponding emergency strategy according to different response results.
And S250, determining the emergency strategy as a first-level emergency strategy under the condition that the response result is that the response information is collected.
Specifically, after the emergency call device detects that the voice acquisition device has acquired the response information, a next series of emergency measures are determined as a first-level emergency strategy.
And S260, determining the emergency strategy as a second-level emergency strategy under the condition that the response information is not acquired in the response result.
And S270, starting the vehicle rescue equipment according to the voice command of the driver and the passenger under the condition that the emergency strategy is the first-level emergency strategy.
In some embodiments, the vehicle rescue apparatus comprises at least one of: satellite positioning equipment, audio call equipment and video call equipment. Illustratively, after the voice acquisition device acquires the response information of the driver and the crew, the driver and the crew can open the voice call between the audio call device and the background personnel, and select whether to open the satellite positioning device, the video call device and the like according to the actual situation on site.
Specifically, after the emergency call device detects that the voice acquisition device has acquired the response information, the emergency call device can further control the start of the satellite positioning device, the audio communication device, the video communication device and other devices according to the actual needs of the driver and passengers.
And S280, forcibly starting the internal and external image acquisition equipment to acquire the internal and external environment data of the vehicle under the condition that the emergency strategy is a second-level emergency strategy, and uploading the internal and external environment data of the vehicle to the cloud emergency platform.
In the present embodiment, the inside-outside image capturing apparatus may be understood as an apparatus for capturing inside-outside environment data of the vehicle. Illustratively, the inside and outside image capturing apparatus may include an inside camera, a rear camera, a front camera, a side camera, a surround camera, and the like installed inside and outside the vehicle. The vehicle internal and external environment data may include posture information of the driver and the passenger, the state of the airbag, damage condition of the vehicle body, vehicle surrounding environment information, and the like. The cloud emergency platform can be understood as being used for storing vehicle internal and external environment data acquired by internal and external image acquisition equipment, analyzing and processing the data and further providing corresponding rescue measures.
Specifically, after the vehicle-mounted terminal does not detect that the voice acquisition device acquires the response information, the vehicle-mounted terminal can forcibly start the internal and external image acquisition devices to acquire internal and external environment data of the vehicle, upload the data to the cloud emergency platform, and finally provide corresponding rescue measures after the cloud emergency platform analyzes and processes the data.
According to the technical scheme of the embodiment, the posture of the driver and the crew is identified by controlling the image acquisition device when the emergency trigger event is determined to be detected; generating emergency call prompt information when the posture of the driver and the passenger is determined to be abnormal; controlling voice playing equipment to play emergency call prompt information; detecting whether the voice acquisition equipment acquires the response information of the driver and the passenger aiming at the emergency call prompt information; determining the emergency strategy as a first-level emergency strategy under the condition that the response result is that the response information is acquired; determining the emergency strategy as a second-level emergency strategy under the condition that the response information is not acquired in the response result; under the condition that the emergency strategy is a first-level emergency strategy, starting vehicle rescue equipment according to the voice instruction of drivers and conductors; and under the condition that the emergency strategy is a second-level emergency strategy, forcibly starting the internal and external image acquisition equipment to acquire the internal and external environment data of the vehicle, and uploading the internal and external environment data of the vehicle to the cloud emergency platform. The embodiment of the invention solves the technical problem of single emergency strategy in emergency situations in the prior art, realizes that the vehicle determines the corresponding reasonable emergency strategy according to the response information corresponding to different emergency trigger events, achieves the purpose of intelligent calling, and shortens the emergency time of drivers and conductors.
EXAMPLE III
Fig. 3 is a flowchart of an emergency call-for-help method according to a third embodiment of the present invention. In the present embodiment, in addition to the above-described embodiments, the vehicle-mounted terminal is taken as a TBOX system as an example, and a process of emergency call is described. As shown in fig. 3, an emergency call method provided in the third embodiment of the present invention specifically includes the following steps:
and S310, when drivers and passengers are in the vehicle, the human body state sensor collects the state data of the drivers and passengers in real time.
In this embodiment, the status data collected by the human body status sensor may include the heart rate, blood oxygen, blood pressure and other biological characteristic information of the driver and passenger.
S320, comparing the acquired real-time state data of the drivers and passengers with corresponding state data in a normal state, and judging whether the real-time state data of the drivers and passengers are abnormal or not; the camera can be further matched to collect attitude data of drivers and conductors, normal state data and attitude data are combined, and whether the states of the drivers and conductors are abnormal or not is comprehensively judged.
Fig. 4 shows a flow chart for judging whether the state of the driver and the passenger is abnormal according to the human body state sensor and the camera in the vehicle.
Specifically, the SOC (System on Chip) operation module may pre-store the biometric information of the common drivers and conductors in the normal state. Furthermore, after receiving the real-time state data processed by the human body state sensor through the sensor data processing module, the SOC operation module can be further used for comparing the real-time state data with the pre-stored normal state data and judging whether the real-time state data of the driver and the passenger is abnormal. Furthermore, when a large difference exists between the real-time state data and the normal state data, the SOC operation module can also analyze the video data processed by the video processing module of the camera in the vehicle, recognize the real-time posture of the driver and the passenger through a built-in image recognition algorithm, and accurately judge the real-time state of the driver and the passenger by combining the comparison result of the real-time state data.
S330, judging whether the driver and the crew are in a shock or faint state, if so, sending an emergency call by the emergency call device, and turning on a video; otherwise, the emergency call device controls the loudspeaker to send out voice alarm reminding.
Specifically, when the driver and the passenger are judged to be in abnormal states such as shock and faint states, the TBOX system immediately sends out an emergency call, forcibly turns on the inside/outside camera of the vehicle, uploads information such as a field picture and a vehicle position shot by the inside/outside camera of the vehicle to the cloud emergency platform, the information is analyzed and processed by the cloud emergency platform, and finally corresponding emergency equipment such as a rescue water boat and a rescue helicopter is configured according to the field states; when the driver and the crew are judged not to be in abnormal states such as shock, faint state and the like, the emergency call-for-help device can control the loudspeaker to give out voice alarm reminding.
As shown in fig. 5, another emergency call method provided in the third embodiment of the present invention specifically includes the following steps:
and S510, the CAN controller collects CAN bus signals in real time and sends out early warning according to different states.
Fig. 6 shows a block diagram of a process for triggering different call modes according to a CAN bus signal.
In this embodiment, a Controller Area Network (CAN) Controller may send an acquired CAN bus signal to a Micro Controller Unit (MCU) for processing, and may also be configured to receive data transmitted by the MCU. For example, the CAN bus signal may include a collision signal, an airbag state, a vehicle body damage state, and the like.
S520, when the common early warning signal is received, the voice communication equipment is opened to communicate with background personnel and guide on-site rescue according to the instructions of the driver and the passengers; when the emergency call signal is received, the human body sensor is matched with the camera in the vehicle to judge the state of the driver and the passengers, and actively starts audio and video to be processed in the background, and the background personnel give corresponding emergency equipment according to the field state.
In some embodiments, when a normal call is detected, the audio call device is started to communicate with background personnel (such as operators, emergency departments, and the like) according to an instruction of the driver and the passenger, the driver and the passenger can select whether to start the video call device according to actual needs of a site, and the background personnel guide the site for rescue according to the communication situation.
In some embodiments, when a CAN bus signal acquired by a CAN controller contains a collision signal, an emergency call is immediately triggered, background personnel firstly generate prompt information for judging whether to start a video call device for communication, and the prompt information is displayed on a display device; if the backstage person does not receive the response information of the driver and the passenger within the preset time (generally, the time can be set to be, but is not limited to be 3 seconds), the inside/outside camera of the vehicle can be forced to be opened, and the backstage person can directly observe the body state, the vehicle body damage condition and other information of the driver and the passenger in the vehicle; background personnel can sooth the tension of drivers and conductors through the video call equipment, and finally, after effective communication and accurate understanding of the field situation, reasonable first-aid measures are formulated, and corresponding rescue equipment is dispatched.
Fig. 7 shows a schematic diagram of the operation mode of the battery backup module.
Specifically, under normal conditions of the automobile, the power supply of the automobile is used for supplying power to the whole TBOX system and charging the spare battery; when the automobile has an emergency, the standby battery supplies power to the TBOX system, so that the normal work of the rescue distress function at the emergency is guaranteed. When the voltage of the standby battery is less than or equal to 4V, the standby battery is charged by the automobile power supply; and when the automobile power supply voltage is less than or equal to 4.5 volts, switching the standby battery to supply power to the whole TBOX system.
In some embodiments, an encryption algorithm can be further arranged on the SOC operation module and the wireless communication module to realize double encryption, so that the security of the TBOX system is improved. For example, the normal state data of the driver and passenger collected by the human body state sensor may be encrypted and stored in the SOC operation module as the historical state data. Illustratively, the encryption algorithm may include a symmetric encryption algorithm, an asymmetric encryption algorithm, and the like.
According to the technical scheme of the embodiment, when drivers and passengers are in the vehicle, the human body state sensor acquires state data of the drivers and passengers in real time; comparing the acquired real-time state data of the drivers and passengers with corresponding state data in a normal state, acquiring attitude data of the drivers and passengers by matching with a camera, and comprehensively judging whether the states of the drivers and passengers are abnormal or not; and triggering emergency call or voice alarm reminding according to the state of the driver and the passengers. According to the technical scheme of the embodiment, CAN bus signals are collected in real time through the CAN controller, and early warning is sent out according to different states; and when the common early warning signal is received, the voice communication equipment is opened to communicate with background personnel and guide on-site rescue according to the instructions of the drivers and conductors. When the emergency call signal is received, the human body sensor is matched with the camera in the vehicle to judge the state of the driver and the passengers, the audio and the video are actively turned on to be processed in the background, and the background personnel provide corresponding emergency equipment according to the field state. The embodiment of the invention solves the technical problem of single emergency strategy in emergency in the prior art, realizes that the vehicle determines the corresponding reasonable emergency strategy according to the response information corresponding to different emergency trigger events, and achieves the purpose of intelligent calling. Meanwhile, the encryption algorithm arranged on the SOC operation module and the wireless communication module improves the safety of the TBOX system. In addition, the standby battery module effectively ensures that the rescue distress function at the emergency time works normally.
Example four
Fig. 8 is a schematic structural diagram of an emergency call-for-help device according to a fourth embodiment of the present invention. As shown in fig. 8, the apparatus includes:
and the distress call prompt module 81 is used for generating emergency distress call prompt information when an emergency trigger event is detected.
And the response detection module 82 is used for determining an emergency strategy according to the response result of the driver and the passenger for the emergency call-for-help prompt information.
And the emergency execution module 83 is used for executing emergency call according to the emergency strategy.
According to the technical scheme of the embodiment of the invention, the emergency call-for-help prompting information is generated by the call-for-help prompting module when the emergency triggering event is detected; the response detection module determines an emergency strategy according to a response result of the driver and the crew for the emergency call-for-help prompt message; and the emergency execution module executes emergency call according to the emergency strategy. The embodiment of the invention solves the technical problem of single emergency strategy under emergency conditions in the prior art, realizes that the vehicle determines the corresponding emergency strategy according to different emergency trigger events, and further shortens the emergency time of drivers and conductors.
Further, the distress call module 81 includes:
and the posture recognition unit is used for controlling the image acquisition device to recognize the posture of the driver and the passenger when the emergency trigger event is determined to be detected.
And the distress prompt generating unit is used for generating emergency distress prompt information when the posture of the driver and the passengers is determined to be an abnormal posture.
Further, the response detection module 82 includes:
and the call-for-help prompt playing unit is used for controlling the voice playing equipment to play the emergency call-for-help prompt information.
And the response information detection unit is used for detecting whether the voice acquisition equipment acquires the response information of the driver and the passenger aiming at the emergency call-for-help prompt information.
And the first-level emergency strategy determining unit is used for determining the emergency strategy as the first-level emergency strategy under the condition that the response result is that the response information is acquired.
And the second-level emergency strategy determining unit is used for determining the emergency strategy as the second-level emergency strategy under the condition that the response information is not acquired in the response result.
Further, the emergency execution module 83 includes:
and the first-level emergency strategy executing unit is used for starting the vehicle rescue equipment according to the voice command of the driver and passenger under the condition that the emergency strategy is the first-level emergency strategy.
And the second-level emergency strategy execution unit is used for forcibly starting the internal and external image acquisition equipment to acquire the internal and external environmental data of the vehicle under the condition that the emergency strategy is the second-level emergency strategy, and uploading the internal and external environmental data of the vehicle to the cloud emergency platform.
The emergency call-for-help device provided by the embodiment of the invention can execute the emergency call-for-help method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
EXAMPLE five
Fig. 9 shows a schematic configuration diagram of a vehicle-mounted terminal 90 that can be used to implement an embodiment of the present invention. Vehicle terminals are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The in-vehicle terminal may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 9, the in-vehicle terminal 90 includes at least one processor 91, and a memory communicatively connected to the at least one processor 91, such as a Read Only Memory (ROM) 92, a Random Access Memory (RAM) 93, and the like, where the memory stores a computer program executable by the at least one processor, and the processor 91 may perform various appropriate actions and processes according to the computer program stored in the Read Only Memory (ROM) 92 or the computer program loaded from the storage unit 98 into the Random Access Memory (RAM) 93. In the RAM 93, various programs and data necessary for the operation of the in-vehicle terminal 90 can also be stored. The processor 91, ROM 92 and RAM 93 are connected to each other by a bus 94. An input/output (I/O) interface 95 is also connected to bus 94.
A plurality of components in the in-vehicle terminal 90 are connected to the I/O interface 95, including: an input unit 96 such as a keyboard, a mouse, or the like; an output unit 97 such as various types of displays, speakers, and the like; a storage unit 98 such as a magnetic disk, an optical disk, or the like; and a communication unit 99 such as a network card, modem, wireless communication transceiver, etc. The communication unit 99 allows the in-vehicle terminal 90 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.
Processor 91 may be a variety of general and/or special purpose processing components with processing and computing capabilities. Some examples of processor 91 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The processor 91 performs the various methods and processes described above, such as the emergency call method.
In some embodiments, the emergency call-for-help method may be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 98. In some embodiments, part or all of the computer program may be loaded and/or installed onto the in-vehicle terminal 90 via the ROM 92 and/or the communication unit 99. When the computer program is loaded into RAM 93 and executed by processor 91, one or more steps of the emergency call method described above may be performed. Alternatively, in other embodiments, the processor 91 may be configured to perform the emergency call-for-help method by any other suitable means (e.g., by way of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be performed. A computer program can execute entirely on a machine, partly on a machine, as a stand-alone software package partly on a machine and partly on a remote machine or entirely on a remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here may be implemented on a vehicle terminal having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the in-vehicle terminal. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome.
In some embodiments, fig. 10 is a schematic structural diagram of another vehicle-mounted terminal for implementing the emergency call-for-help method according to the embodiment of the present invention. In the present embodiment, a vehicle-mounted terminal that implements an emergency call method is described using the vehicle-mounted terminal as a TBOX system as an example, in addition to the above-described embodiments.
In the embodiment, the TBOX system comprises an SOC operation module, an MCU, a 4/5G wireless module, an audio processing module, a sensor data processing module, a video processing module, a CAN controller, a standby battery and a power supply system. An antenna, a microphone, a horn, a human body state sensor, an in-vehicle/outside camera, and a display device are terminal devices connected to the TBOX system.
The SOC operation module is used for analyzing and processing information sent by the MCU, the 4/5G wireless module, the audio processing module, the sensor data processing module and the video processing module and returning a processing result to corresponding equipment.
And the MCU is used for controlling the SOC operation module, the CAN control and the standby battery and CAN identify and judge the calling modes (active calling or emergency calling) of the drivers and passengers.
And the 4/5G wireless module is used for realizing network communication of the vehicle-mounted terminal.
And the audio processing module is used for acquiring and sending audio signals and realizing voice communication between drivers and passengers and background personnel.
And the sensor data processing module is used for processing the biological characteristic information acquired by the human body state sensor and sending the processed data to the SOC operation module.
And the video processing module is used for acquiring and sending video signals and realizing video communication between drivers and conductors and background personnel.
And the CAN controller is used for acquiring CAN bus signals.
And the standby battery is used for supplying power to the TBOX system by the standby battery when the vehicle is in an emergency, so that the normal work of the emergency rescue calling function is ensured.
And the power supply system is used for supplying power to the SOC operation module, the MCU, the 4/5G wireless module, the audio processing module, the sensor data processing module, the video processing module and the CAN controller.
And the microphone is used for collecting the voice call signals of the driver and the passengers.
And the loudspeaker is used for playing the rescue communication voice signal of the background personnel.
And the human body state sensor is used for acquiring the biological characteristic information of the drivers and passengers.
And the inside/outside camera is used for acquiring the inside/outside field pictures of the vehicle.
And the display equipment is used for displaying the scene pictures of the inside and outside of the vehicle and background personnel.
The vehicle battery is used for supplying power to the whole TBOX system under the normal condition of the vehicle, and charging the spare battery.
In some embodiments, the SOC operation module is connected to the MCU through an SPI (Serial Peripheral Interface) bus, connected to the audio processing module through an I2S (Inter-IC Sound, integrated circuit built-in audio bus), connected to the video processing module through an LVDS (Low Voltage Differential Signaling) bus, and electrically connected to the 4/5G wireless module and the sensor data processing module.
The MCU is connected with the CAN controller through a UART (Universal Asynchronous Receiver Transmitter) bus, and is electrically connected with the standby battery.
And the 4/5G wireless module is electrically connected with the antenna.
The audio processing module is connected with the microphone through an MIC IN (microphone input) port and connected with the loudspeaker through an SPK OUT (loudspeaker output) port.
The sensor data processing module is electrically connected with the human body state sensor.
The video processing module is connected with the inside/outside camera and the display device through an LVDS bus.
The CAN controller is connected with a bus of the vehicle body.
The power supply system is respectively and electrically connected with the SOC operation module, the MCU, the 4/5G wireless module, the audio processing module, the sensor data processing module, the video processing module and the CAN controller.
It should be understood that various forms of the flows shown above, reordering, adding or deleting steps, may be used. For example, the steps described in the present invention may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired result of the technical solution of the present invention can be achieved.
The above-described embodiments should not be construed as limiting the scope of the invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. An emergency call method, comprising:
generating emergency call prompt information when an emergency trigger event is detected;
determining an emergency strategy according to the response result of the driver and the passenger aiming at the emergency call prompt information;
and executing emergency call for help according to the emergency strategy.
2. The method of claim 1, wherein the detection of the emergency trigger event comprises at least one of:
detecting user call information acquired by voice acquisition equipment;
detecting abnormal state data of drivers and passengers acquired by a human body state sensor;
vehicle fault information collected by a vehicle sensor is detected.
3. The method according to claim 1 or 2, wherein the generating of the emergency call prompt message when the emergency trigger event is detected comprises:
controlling an image acquisition device to identify the posture of the driver and passenger when the emergency trigger event is determined to be detected;
and generating the emergency call-for-help prompt message when the posture of the driver and the crew is determined to be an abnormal posture.
4. The method according to claim 1, wherein the determining an emergency strategy according to the response result of the driver and the passenger to the emergency call-for-help prompt message comprises:
controlling voice playing equipment to play the emergency call prompt information;
detecting whether the voice acquisition equipment acquires response information of the user for the emergency call-for-help prompt information;
determining the emergency strategy as a first-level emergency strategy under the condition that the response result is that the response information is acquired;
and determining the emergency strategy to be a second-level emergency strategy under the condition that the response information is not acquired in the response result.
5. The method of claim 1, wherein the performing emergency call for help according to the emergency policy comprises:
starting vehicle rescue equipment according to the voice command of the driver and passenger under the condition that the emergency strategy is the first-level emergency strategy;
and under the condition that the emergency strategy is the second-level emergency strategy, forcibly starting internal and external image acquisition equipment to acquire internal and external environment data of the vehicle, and uploading the internal and external environment data of the vehicle to a cloud emergency platform.
6. The method of claim 5, wherein the vehicle rescue apparatus comprises at least one of: satellite positioning equipment, audio call equipment and video call equipment.
7. The method of claim 2, wherein the encrypted state data is stored as historical state data.
8. An emergency call device, the device comprising:
the emergency call prompt module is used for generating emergency call prompt information when an emergency trigger event is detected;
the response detection module is used for determining an emergency strategy according to the response result of the driver and the passenger aiming at the emergency call-for-help prompt information;
and the emergency execution module is used for executing emergency call according to the emergency strategy.
9. A vehicle-mounted terminal, characterized in that the vehicle-mounted terminal comprises:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein, the first and the second end of the pipe are connected with each other,
the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the emergency call-for-help method of any one of claims 1-7.
10. A computer readable storage medium having stored thereon computer instructions for causing a processor to, when executed, implement the emergency call-for-help method of any one of claims 1-7.
CN202211166491.8A 2022-09-23 2022-09-23 Emergency call method and device, vehicle-mounted terminal and storage medium Pending CN115762048A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211166491.8A CN115762048A (en) 2022-09-23 2022-09-23 Emergency call method and device, vehicle-mounted terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211166491.8A CN115762048A (en) 2022-09-23 2022-09-23 Emergency call method and device, vehicle-mounted terminal and storage medium

Publications (1)

Publication Number Publication Date
CN115762048A true CN115762048A (en) 2023-03-07

Family

ID=85351883

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211166491.8A Pending CN115762048A (en) 2022-09-23 2022-09-23 Emergency call method and device, vehicle-mounted terminal and storage medium

Country Status (1)

Country Link
CN (1) CN115762048A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117079415A (en) * 2023-10-10 2023-11-17 中普达技术(西安)有限公司 Medical care patient calling method and system based on 5G dual-domain private network

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117079415A (en) * 2023-10-10 2023-11-17 中普达技术(西安)有限公司 Medical care patient calling method and system based on 5G dual-domain private network

Similar Documents

Publication Publication Date Title
EP3675121B1 (en) Computer-implemented interaction with a user
US10647252B2 (en) Portable electronic device and operating method therefor
CN112660157B (en) Multifunctional remote monitoring and auxiliary driving system for barrier-free vehicle
CN107933471A (en) The method and vehicle-mounted automatic help system of accident active call rescue
CN109118714B (en) Alarming method, device, equipment and storage medium based on eye movement information
CN105023394A (en) Dangerous driving reminding and controlling method based on portable intelligent device
US20190221052A1 (en) Vehicle operation management system
CN112269865A (en) Method, device, equipment and storage medium for generating information
CN108711202A (en) A kind of Traffic Accident Rescue System based on big data
CN112885031B (en) Intelligent alarm system and method based on Internet of vehicles
US11285966B2 (en) Method and system for controlling an autonomous vehicle response to a fault condition
KR20210042860A (en) Method, device and system for outputting information
CN112396824A (en) Vehicle monitoring method and system and vehicle
CN115762048A (en) Emergency call method and device, vehicle-mounted terminal and storage medium
WO2019143919A1 (en) Occupant awareness monitoring for autonomous vehicles
CN205722310U (en) A kind of train driver Activity recognition system based on video sequence
CN112450538A (en) Safety helmet
CN116824737A (en) Multi-sensor fusion monitoring system and method in sentry mode
CN111292493A (en) Vibration reminding method, device, electronic equipment and system
WO2023065998A1 (en) Vehicle control method and apparatus, and vehicle and storage medium
CN110059650A (en) Information processing method, device, computer storage medium and electronic equipment
CN210639724U (en) Fatigue detection and driving behavior recognition early warning system
Raja et al. Alcohol Detection and Emergency Alert System using IoT
CN113183971B (en) Driver state monitoring method and device, vehicle-mounted terminal and readable storage medium
CN211455291U (en) Bus video monitoring system based on GPS navigation system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination