CN117173855A

CN117173855A - Method and device for automatically alarming vehicle, electronic equipment and storage medium

Info

Publication number: CN117173855A
Application number: CN202210577481.7A
Authority: CN
Inventors: 邹勇; 周盼; 陈伟
Original assignee: Beijing Co Wheels Technology Co Ltd
Current assignee: Beijing Co Wheels Technology Co Ltd
Priority date: 2022-05-25
Filing date: 2022-05-25
Publication date: 2023-12-05

Abstract

The invention discloses a method and a device for automatically alarming a vehicle, the vehicle, electronic equipment and a storage medium, and the main technical scheme comprises the following steps: determining whether the collected voice information contains a first alarm awakening word, if so, determining whether the first voice print feature is a registered voice print feature based on the first voice print feature in the voice information, if so, judging whether a preset alarm condition is met through semantics corresponding to the in-vehicle image information and/or the voice information, and if so, triggering an in-vehicle alarm instruction. After a user wakes up the automatic vehicle alarm system through a voiceprint technology, the vehicle judges the semantic analysis result of the current in-vehicle image information and/or voice information, and selects whether to alarm or not.

Description

Method and device for automatically alarming vehicle, electronic equipment and storage medium

Technical Field

The disclosure relates to the technical field of vehicles, in particular to a method and a device for automatically alarming a vehicle, the vehicle, electronic equipment and a storage medium.

Background

Along with the rapid development of the economy in China, the living standard of people is also increasingly improved, and an automobile as one of the most widely used riding tools gradually goes into the life of people, so that the travel of people is greatly facilitated; with the development of internet technology in recent years, the internet taxi reservation technology can meet the vehicle demands of people.

In daily driving, a driver, especially a driver in a taxi/internet taxi, may possibly generate a hijacked danger, and currently, when the hijacked danger occurs, the driver can give an alarm in a touch alarm mode such as a manual touch hidden alarm button or a handheld electronic device to execute related anti-hijacking operation.

However, in practical application, when the driver is hijacked, the behavior of the driver may be restrained or the driver may be irritated by lawbreakers when alarming in the contact mode, so that the driver cannot alarm, and personal safety threat may be increased.

Disclosure of Invention

The disclosure provides a method and a device for automatically alarming a vehicle, electronic equipment and a storage medium. The main purpose is to realize the automatic alarm of the vehicle when the dangerous situation in the vehicle is confirmed.

According to a first aspect of the present disclosure, there is provided a method of automatically alerting a vehicle, comprising:

determining whether the collected voice information contains a first alarm wake-up word;

if the first alarm wake word is included, determining whether the first voiceprint feature is a registered voiceprint feature or not based on the first voiceprint feature in the voice information;

if the first voiceprint feature is determined to be the registered voiceprint feature, judging whether a preset alarm condition is met or not through the semantics corresponding to the in-vehicle image information and/or the voice information;

and if the preset alarm condition is met, triggering an in-vehicle alarm instruction so as to alarm according to the in-vehicle alarm instruction.

Optionally, the determining whether the preset alarm condition is met according to the in-vehicle image information and/or the semantics corresponding to the voice information includes:

acquiring the image information in the vehicle, and determining whether the image information in the vehicle accords with a first preset alarm condition;

carrying out semantic analysis on the voice information, and determining whether a semantic analysis result is a second preset alarm condition or not;

if the in-vehicle image information is determined to be in accordance with the first preset alarm condition and/or the semantic analysis result is determined to be in accordance with the second preset alarm condition, determining that the preset alarm condition is met;

If the in-vehicle image information is determined to be not in accordance with the first preset alarm condition and the semantic analysis result is determined to be not in accordance with the second preset alarm condition, determining that the preset alarm condition is not met.

Optionally, the method further comprises:

if the voice information does not contain the first alarm awakening word, the acquired voice information is ignored;

if the voice information contains a first alarm awakening word, but the first voiceprint features are unregistered voiceprint features, the acquired voice information is ignored;

if the voice information comprises a first alarm awakening word and the first voiceprint feature is a registered voiceprint feature, but the in-car image information and the semantics corresponding to the voice information do not meet the preset alarm condition, the acquired voice information is ignored.

Optionally, the triggering the in-vehicle alarm instruction so as to alarm according to the in-vehicle alarm instruction includes:

acquiring state information and position information of a vehicle;

transmitting and alarming state information and position information of the vehicle through a preset alarm channel; the preset alarm channel comprises at least one of a preset alarm number and a parent number.

Optionally, the method further comprises:

responding to a voiceprint input request, and receiving wake-up voice to be registered, which is acquired based on a microphone;

identifying a second alarm awakening keyword in the awakening voice to be registered;

extracting voiceprint features in the wake-up voice to be registered;

and establishing an association relation between the second alarm awakening keywords and the second voice characteristics, completing voice print registration, and storing the voice print registration in a preset registration voice print library.

Optionally, the determining whether the image information in the vehicle meets the first preset alarm condition includes:

analyzing the image information in the vehicle;

and determining whether any one of the first preset alarm conditions is met according to the analysis result, wherein the first preset alarm condition is that a passenger in the vehicle has limb contact, face shielding and a hand-held sharp tool.

According to a second aspect of the present disclosure, there is provided an apparatus for automatically alarming a vehicle, comprising:

the first determining unit is used for determining whether the collected voice information contains a first alarm awakening word or not;

a second determining unit, configured to determine, when the first alert wake word is included, whether the first voiceprint feature is a registered voiceprint feature based on a first voiceprint feature in the voice information;

The judging unit is used for judging whether preset alarm conditions are met or not through the semantics corresponding to the in-vehicle image information and/or the voice information;

and the alarm unit is used for triggering an in-vehicle alarm instruction when the preset alarm condition is met so as to alarm according to the in-vehicle alarm instruction.

Optionally, the judging unit includes:

the acquisition module is used for acquiring the image information in the vehicle;

the first determining module is used for determining whether the image information in the vehicle accords with a first preset alarm condition or not;

the analysis module is used for carrying out semantic analysis on the voice information;

the second determining module is used for determining whether the semantic analysis result is a second preset alarm condition or not;

the third determining module is used for determining that the preset alarm condition is met when the image information in the vehicle is determined to be in accordance with the first preset alarm condition and/or the semantic analysis result is determined to be in accordance with the second preset alarm condition;

and the fourth determining module is used for determining that the preset alarm condition is not met when the image information in the vehicle is determined to be not in accordance with the first preset alarm condition and the semantic analysis result is determined to be not in accordance with the second preset alarm condition.

Optionally, the apparatus further includes:

the first neglecting unit is used for neglecting the collected voice information when the voice information does not contain the first alarm awakening word;

the second neglecting unit is used for neglecting the collected voice information when the voice information contains a first alarm awakening word and the first voiceprint feature is unregistered voiceprint feature;

and the third neglecting unit is used for neglecting the collected voice information when the voice information contains a first alarm awakening word and the first voiceprint characteristic is a registered voiceprint characteristic, but the in-car image information and the semantics corresponding to the voice information do not meet the preset alarm condition.

Optionally, the alarm unit includes:

the acquisition module is used for acquiring the state information and the position information of the vehicle;

the alarm module is used for sending and alarming the state information and the position information of the vehicle through a preset alarm channel; the preset alarm channel comprises at least one of a preset alarm number and a parent number.

Optionally, the apparatus further includes:

the receiving unit is used for responding to the voiceprint input request and receiving wake-up voice to be registered, which is acquired based on the microphone;

The identification unit is used for identifying a second alarm awakening keyword in the awakening voice to be registered;

the extraction unit is used for extracting voiceprint features in the wake-up voice to be registered;

the establishing unit is used for establishing the association relation between the second alarm awakening key words and the second voice characteristics, completing voice print registration and storing the voice print registration into a preset registration voice print library.

Optionally, the judging unit includes:

the analysis module is used for analyzing the in-vehicle image information;

the determining module is used for determining whether any one of the first preset alarm conditions is met according to the analysis result, wherein the preset alarm conditions are limb contact, facial shielding and hand-held sharp tool of the passenger in the vehicle.

In a third aspect of the present disclosure, there is provided a vehicle including the adjustment device of the vehicle seat of the foregoing second aspect.

According to a fourth aspect of the present disclosure, there is provided an electronic device comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of the first aspect.

According to a fifth aspect of the present disclosure, there is provided a non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of the preceding first aspect.

According to a sixth aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the method of the first aspect described above.

The method and device for automatically alarming the vehicle, the electronic equipment and the storage medium comprise the steps of firstly determining whether collected voice information contains a first alarm awakening word, if so, determining whether the first voiceprint feature is a registered voiceprint feature based on the first voiceprint feature in the voice information, secondly, judging whether a preset alarm condition is met through in-vehicle image information and/or semantics corresponding to the voice information, and finally, triggering an in-vehicle alarm instruction if the preset alarm condition is met so as to alarm according to the in-vehicle alarm instruction. Compared with the related art, after a user wakes up the automatic vehicle alarm system through the voiceprint technology, the vehicle judges the semantic analysis result of the current in-vehicle image information and/or voice information, and selects whether to alarm or not.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the application or to delineate the scope of the application. Other features of the present application will become apparent from the description that follows.

Drawings

The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

FIG. 1 is a flow chart of a method for automatically alerting a vehicle according to an embodiment of the present disclosure;

fig. 2 is a flowchart of a method for determining whether a preset alarm condition is satisfied according to semantics corresponding to image information and/or voice information in a vehicle according to an embodiment of the present disclosure;

FIG. 3 is a flow chart of a method of alerting provided by an embodiment of the present disclosure;

FIG. 4 is a schematic diagram of a method for registering a user voiceprint according to an embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of a device for automatically alarming a vehicle according to an embodiment of the present disclosure;

FIG. 6 is a schematic structural view of another vehicle automatic warning device according to an embodiment of the present disclosure;

fig. 7 is a schematic block diagram of an example electronic device 600 provided by an embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

Fig. 1 is a flowchart of a method for automatically alarming a vehicle according to an embodiment of the disclosure.

Step 101, determining whether the collected voice information contains a first alarm wake-up word.

The vehicle collects and analyzes the voice information in real time or according to a preset collection period (such as two minutes) based on the vehicle-mounted microphone to obtain a sound signal which can be identified by the vehicle, then determines whether the sound signal contains a first alarm wake-up word, and regarding an analysis method for confirming whether the sound signal contains the first alarm wake-up word, the method can refer to any method in the related art, and the embodiment of the application is not repeated one by one.

The first wake-up word is set in advance for the user, and when the first wake-up word is set, the user can set according to system recommendation in consideration of the specificity of a scene using the first wake-up word (the obvious alarm behavior can cause personal injury to passengers when the scene is clamped by a person), or set a proper first alarm keyword which is not easy to cause robbery attention in consideration of the use scene.

Step 102, if the first alert wake word is included, determining whether the first voiceprint feature is a registered voiceprint feature based on the first voiceprint feature in the voice message.

If the voice information is detected to have the first alarm awakening word, extracting first voiceprint features of the first alarm awakening word, comparing the first voiceprint features with registered voiceprints in a registered voiceprint library, and determining whether the first voiceprint features are registered voiceprints or not, so as to determine whether a user corresponding to the first voiceprint features is a registered user or not.

The resonance mode characteristics, the voice purity characteristics, the average pitch characteristics and the voice domain characteristics of different users when speaking are different, so that the distribution conditions of formants of the voices of different users in the spectrogram are different, and the first voiceprint characteristics are the distribution characteristics of the formants of the voices of the users in the spectrogram.

The similarity between the first voiceprint feature and the registered voiceprint feature can be defined by setting a preset similarity threshold, if the preset similarity threshold is set to 100%, the first voiceprint feature and the second voiceprint feature must be identical, in practical application, the voiceprints of the same person in different periods may have certain differences, and if the preset similarity threshold is set too high (e.g. 100%), the user identity cannot be confirmed when the user identity is confirmed based on the voiceprint feature. If the preset similarity threshold is set to 10%, the situation that other users can trigger the automatic alarm of the vehicle can occur if the preset similarity threshold is too low, the probability of false alarm can be increased, and the vehicle using experience of the users can be reduced.

Therefore, when the preset similarity threshold is set, the preset similarity threshold can be set to 85% or 90% or the like, the preset similarity threshold is a tested value, and the preset similarity threshold can be flexibly set according to the self requirement, and the numerical value of the preset similarity threshold is not limited in the embodiment of the application.

Step 103, if it is determined that the first voiceprint feature is a registered voiceprint feature, judging whether a preset alarm condition is met or not according to in-vehicle image information and/or semantics corresponding to the voice information.

After the vehicle collects the image information in the vehicle based on the vehicle-mounted camera, judging whether the image information in the vehicle meets preset alarm conditions. And when the acquired in-vehicle image information contains one or more of the preset alarm conditions, the preset alarm conditions are considered to be met. The preset alarm conditions include, but are not limited to: limb contact between passengers, holding sharp objects, face shielding of passengers and the like.

As a feasible scheme of the embodiment of the application, in order to prevent robbers from being hidden or being in a camera blind area when hijacking the user, the method cannot judge through the in-car image information, and after determining that the first voiceprint features are registered voiceprint features, the voice information is subjected to semantic analysis. The vehicle immediately collects voice information in the vehicle based on the vehicle-mounted microphone without interruption, and carries out semantic analysis on the voice information to identify voice content.

The voice alarm word is a keyword in a dialogue which may occur in a hijacked state, for example: help seeking or threat words, such as life saving. The embodiment of the application does not specifically limit the semantic parsing word.

It should be noted that, whether the preset alarm condition is satisfied is determined according to the image information in the vehicle, and/or whether the preset alarm condition is satisfied is determined according to the semantics corresponding to the voice information, one of the two judgment modes may be selected according to different application scenarios for implementation, or both the two judgment modes are adopted at the same time, which is not particularly limited in the embodiment of the present application.

And 104, triggering an in-vehicle alarm instruction if the preset alarm condition is met, so as to alarm according to the in-vehicle alarm instruction.

After the alarm condition is met, the passenger is not required to confirm, and the vehicle can automatically send the information such as position information, in-vehicle image information and the like to a preset alarm contact person or relatives and friends set by the passenger in advance to alarm.

When the vehicle automatic alarming is executed, firstly, whether the collected voice information contains a first alarming awakening word is determined, if the collected voice information contains the first alarming awakening word, whether the first voice print feature is a registered voice print feature is determined based on the first voice print feature in the voice information, secondly, if the first voice print feature is determined to be the registered voice print feature, whether a preset alarming condition is met or not is judged through in-vehicle image information and/or semantics corresponding to the voice information, and finally, if the preset alarming condition is met, an in-vehicle alarming instruction is triggered so as to alarm according to the in-vehicle alarming instruction. Compared with the related art, after a user wakes up the automatic vehicle alarm system through the voiceprint technology, the vehicle judges the semantic analysis result of the current in-vehicle image information and/or voice information, and selects whether to alarm or not.

As a refinement of the embodiment of the foregoing application, when analyzing the in-vehicle image information, the method specifically includes: determining whether any one of the preset alarm conditions is met according to the analysis result, wherein the preset alarm conditions comprise: there are conditions such as limb contact, face shielding, hand-held sharp tool among passengers in the car.

In order to understand the specific implementation process of step 103 more clearly, an embodiment of the present application provides a method for determining whether a preset alarm condition is satisfied by using in-vehicle image information and/or semantics corresponding to the voice information, as shown in fig. 2, fig. 2 includes:

step 201, acquiring the image information in the vehicle, and determining whether the image information in the vehicle meets a first preset alarm condition.

In order to improve the detection efficiency of the image information in the vehicle, before the step is executed, the image information is collected aiming at different positions in the vehicle and different preset alarm conditions based on the vehicle camera, and the collected image information is trained to obtain a preset judgment model. After the vehicle acquires the image information in the vehicle based on the vehicle-mounted camera, the image information in the vehicle is sent into a preset judgment model to be identified, and whether the preset alarm condition is met is judged. And when the acquired in-vehicle image information contains one or more of the first preset alarm conditions, the first preset alarm conditions are considered to be met. The first preset alarm condition includes, but is not limited to: limb contact between passengers, holding sharp objects, face shielding of passengers and the like.

Step 202, carrying out semantic analysis on the voice information, and determining whether a semantic analysis result is a second preset alarm condition or not.

In the embodiment of the present application, any feasible manner in the related art may be adopted for the semantic analysis method of the voice information, which is not limited by the embodiment of the present application.

The second preset alarm condition is an empirical value, including but not limited to a specific vocabulary, or the number of times a certain vocabulary appears, etc.

Step 203, if it is determined that the image information in the vehicle meets the first preset alarm condition and/or the semantic analysis result meets the second preset alarm condition, it is determined that the preset alarm condition is met.

In order to improve the safety of a driver in a vehicle, when at least one of a first preset alarm condition and a second preset alarm condition is met, the preset alarm condition is determined to be met.

Step 204, if it is determined that the image information in the vehicle does not meet the first preset alarm condition and the semantic analysis result does not meet the second preset alarm condition, determining that the preset alarm condition is not met.

In order to prevent passengers in a vehicle from being limited by the clamping behaviors and being unable to alarm or confirm the alarm through the interactive behaviors, the alarm method provided by the embodiment of the application can automatically alarm without manual confirmation, so that the accuracy of the vehicle to dangerous situations in the vehicle is required to be improved, the condition of false alarm is prevented, the following conditions are required to be met simultaneously, namely, the voice information comprises a first alarm awakening word, the first voice print characteristic is a registered voice print characteristic, the image information in the vehicle meets preset alarm conditions and the corresponding semantic meaning of the voice information meets the preset alarm conditions, the alarm is triggered, and the received voice information is ignored under the following conditions:

scene one: and if the voice information does not contain the first alarm awakening word, ignoring the acquired voice information.

The vehicle analyzes the collected voice information, when the voice information does not contain the first alarm awakening words, the vehicle ignores the voice information, continues to collect the voice information in the vehicle for analysis, and repeats circularly until the collected voice information contains the first alarm awakening words.

Scene II: if the voice information contains a first alarm awakening word, but the first voiceprint features are unregistered voiceprint features, the acquired voice information is ignored.

When the voiceprint characteristics of the first alarm awakening word are not matched with the voiceprint characteristics in the registered voiceprint library, the first alarm awakening word is not spoken by the registered user, the alarm condition is not met, and the voice information is ignored.

Scene III: if the voice information comprises a first alarm awakening word and the first voiceprint feature is a registered voiceprint feature, but the in-car image information and the semantics corresponding to the voice information do not meet the preset alarm condition, the acquired voice information is ignored.

When the image information in the vehicle and the semantics corresponding to the voice information do not meet the preset alarm conditions, the alarm is not carried out, and the voice information is ignored.

In order to facilitate the rescue of the preset alert contacts or relatives and friends, when the automatic alert of the vehicle is performed, the alert may be performed in the following manner, and fig. 3 is a flow chart of an alert method according to an embodiment of the present application, including:

step 301, acquiring state information and position information of a vehicle;

acquiring current position information of a vehicle according to a vehicle navigation system, and acquiring state information of the current vehicle according to a vehicle sensor, wherein the state information comprises: information such as a vehicle navigation destination, a current running state (parking, running), a current vehicle speed, and the like.

Step 302, sending and alarming state information, position information and image information in the vehicle through a preset alarm channel; the preset alarm channel comprises at least one of a preset alarm number and a parent number.

After the alarm is finished, the vehicle can also acquire the position information of the vehicle according to a preset time interval (such as two minutes) and upload the position information to a preset alarm number or a parent through a preset alarm channel, so that the preset alarm contact can track the vehicle and find the alarm person, and the aim of quick rescue is fulfilled.

The application further provides a method for registering the voiceprint of the user, as shown in fig. 4, which comprises the following steps:

in step 401, in response to the voiceprint entry request, wake-up speech to be registered acquired based on a microphone is received.

When the user needs to record the voiceprint features, the voiceprint registration system can be entered on the vehicle central control operation panel, and the voiceprint registration system can guide the user to record the second alarming keywords for 3-5 times, so that the accuracy of the extracted voiceprint features is ensured. It should be noted that the 3-5 times are only exemplary descriptions, and the number and the content of the wake-up instruction are not limited in the embodiment of the present application.

And step 402, identifying a second alarm awakening keyword in the awakening voice to be registered.

After the second alarming keywords are recorded, the vehicle can detect the recorded second alarming keywords, detect whether the recording environment has noise, record clearly and detect whether the alarming keywords are recorded correctly.

Step 403, extracting voiceprint features in the wake-up voice to be registered.

And when the wake-up keyword is detected to be correctly recorded and the environmental noise cannot have influence on the extraction of the voiceprint characteristics, extracting the second voiceprint characteristics of the second wake-up instruction.

And step 404, establishing an association relation between the second alarm awakening key word and the second voiceprint feature, completing voiceprint registration, and storing the voiceprint registration in a preset registered voiceprint library.

Fig. 5 is a schematic structural diagram of a device for automatically alarming a vehicle according to an embodiment of the present disclosure, as shown in fig. 5, including:

a first determining unit 51, configured to determine whether the collected voice information includes a first alarm wake-up word;

a second determining unit 52, configured to determine, when the first alert wake word is included, whether the first voiceprint feature is a registered voiceprint feature based on a first voiceprint feature in the voice information;

A judging unit 53, configured to judge whether a preset alarm condition is satisfied by using in-vehicle image information and/or semantics corresponding to the voice information;

and the alarm unit 54 is used for triggering an in-vehicle alarm instruction when the preset alarm condition is met so as to alarm according to the in-vehicle alarm instruction.

When the vehicle automatic alarming device is used for executing the vehicle automatic alarming, firstly, whether the collected voice information contains a first alarming awakening word or not is determined, if the collected voice information contains the first alarming awakening word, whether the first voice characteristic is a registered voice characteristic or not is determined based on the first voice characteristic in the voice information, secondly, if the first voice characteristic is determined to be the registered voice characteristic, whether a preset alarming condition is met or not is judged through in-vehicle image information and/or semantics corresponding to the voice information, and finally, if the preset alarming condition is met, an in-vehicle alarming instruction is triggered so as to alarm according to the in-vehicle alarming instruction. Compared with the related art, after a user wakes up the automatic vehicle alarm system through the voiceprint technology, the vehicle judges the semantic analysis result of the current in-vehicle image information and/or voice information, and selects whether to alarm or not.

Further, as an implementation manner of the embodiment of the present application, as shown in fig. 6, the determining unit 53 includes:

the acquisition module 531 is used for acquiring the image information in the vehicle;

a first determining module 532, configured to determine whether the image information in the vehicle meets a first preset alarm condition;

a parsing module 533, configured to perform semantic parsing on the voice information;

a second determining module 534, configured to determine whether the semantic parsing result is a second preset alarm condition;

a third determining module 535, configured to determine that the preset alarm condition is satisfied when it is determined that the in-vehicle image information meets the first preset alarm condition and/or the semantic analysis result meets the second preset alarm condition;

a fourth determining module 536, configured to determine that the preset alarm condition is not satisfied when it is determined that the in-vehicle image information does not conform to the first preset alarm condition and the semantic analysis result does not conform to the second preset alarm condition.

Further, as an implementation manner of the embodiment of the present application, as shown in fig. 6, the apparatus further includes:

a first ignoring unit 55, configured to ignore the collected voice information when the voice information does not include the first alert wake-up word;

A second ignoring unit 56, configured to ignore the collected voice information when the voice information includes a first alert wake-up word but the first voiceprint feature is an unregistered voiceprint feature;

and a third ignoring unit 57, configured to ignore the collected voice information when the voice information includes a first alarm wake-up word and the first voiceprint feature is a registered voiceprint feature, but the in-vehicle image information and semantics corresponding to the voice information do not meet a preset alarm condition.

Further, as an implementation manner of the embodiment of the present application, as shown in fig. 6, the alarm unit 54 includes:

an acquisition module 541, configured to acquire status information and position information of a vehicle;

the alarm module 542 is configured to send and alarm the state information and the position information of the vehicle through a preset alarm channel; the preset alarm channel comprises at least one of a preset alarm telephone and a parent number.

a receiving unit 58, configured to receive a wake-up voice to be registered, which is collected based on a microphone, in response to a voiceprint entry request;

The identifying unit 59 is configured to identify a second alarm wake-up keyword in the wake-up voice to be registered;

an extracting unit 510, configured to extract voiceprint features in the wake-up voice to be registered;

the establishing unit 511 is configured to establish an association between the second alert wake-up keyword and the second voiceprint feature, complete voiceprint registration, and store the second alert wake-up keyword and the second voiceprint feature in a preset registered voiceprint library.

the analysis module 531 is configured to analyze the in-vehicle image information;

the determining module 532 is configured to determine whether any one of the first preset alarm conditions is met according to the analysis result, where the preset alarm conditions are limb contact, facial occlusion, and hand-held sharp tool of the passenger in the vehicle.

The foregoing explanation of the method embodiment is also applicable to the apparatus of this embodiment, and the principle is the same, and this embodiment is not limited thereto.

According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

Fig. 7 illustrates a schematic block diagram of an example electronic device 600 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 7, the apparatus 600 includes a computing unit 601 that can perform various appropriate actions and processes according to a computer program stored in a ROM (Read-Only Memory) 602 or a computer program loaded from a storage unit 608 into a RAM (Random Access Memory ) 603. In the RAM 603, various programs and data required for the operation of the device 600 may also be stored. The computing unit 601, ROM 602, and RAM 603 are connected to each other by a bus 604. An I/O (Input/Output) interface 605 is also connected to bus 604.

Various components in the device 600 are connected to the I/O interface 605, including: an input unit 606 such as a keyboard, mouse, etc.; an output unit 607 such as various types of displays, speakers, and the like; a storage unit 608, such as a magnetic disk, optical disk, or the like; and a communication unit 609 such as a network card, modem, wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.

The computing unit 601 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing units 601 include, but are not limited to, a CPU (Central Processing Unit ), a GPU (Graphic Processing Units, graphics processing unit), various dedicated AI (Artificial Intelligence ) computing chips, various computing units running machine learning model algorithms, DSPs (Digital Signal Processor, digital signal processors), and any suitable processors, controllers, microcontrollers, and the like. The computing unit 601 performs the various methods and processes described above, such as a method of automatically alerting a vehicle. For example, in some embodiments, the method of vehicle autoalarm may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 600 via the ROM 602 and/or the communication unit 609. When the computer program is loaded into RAM 603 and executed by the computing unit 601, one or more steps of the method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to perform the aforementioned method of vehicle autoalarm by any other suitable means (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit System, FPGA (Field Programmable Gate Array ), ASIC (Application-Specific Integrated Circuit, application-specific integrated circuit), ASSP (Application Specific Standard Product, special-purpose standard product), SOC (System On Chip ), CPLD (Complex Programmable Logic Device, complex programmable logic device), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, RAM, ROM, EPROM (Electrically Programmable Read-Only-Memory, erasable programmable read-Only Memory) or flash Memory, an optical fiber, a CD-ROM (Compact Disc Read-Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., CRT (Cathode-Ray Tube) or LCD (Liquid Crystal Display ) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: LAN (Local Area Network ), WAN (Wide Area Network, wide area network), internet and blockchain networks.

The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service ("Virtual Private Server" or simply "VPS") are overcome. The server may also be a server of a distributed system or a server that incorporates a blockchain.

It should be noted that, artificial intelligence is a subject of studying a certain thought process and intelligent behavior (such as learning, reasoning, thinking, planning, etc.) of a computer to simulate a person, and has a technology at both hardware and software level. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing, and the like; the artificial intelligence software technology mainly comprises a computer vision technology, a voice recognition technology, a natural language processing technology, a machine learning/deep learning technology, a big data processing technology, a knowledge graph technology and the like.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel or sequentially or in a different order, provided that the desired results of the technical solutions of the present disclosure are achieved, and are not limited herein.

The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.

Claims

1. A method for automatically alerting a vehicle, comprising:

and if the preset alarm condition is met, triggering an in-vehicle alarm instruction.

2. The method according to claim 1, wherein the determining whether the preset alarm condition is satisfied by the semantics corresponding to the in-vehicle image information and/or the voice information includes:

3. The method according to claim 1, wherein the method further comprises:

4. The method of claim 1, wherein the triggering an in-vehicle alarm command comprises:

acquiring state information and position information of a vehicle;

5. The method according to claim 1, wherein the method further comprises:

extracting voiceprint features in the wake-up voice to be registered;

6. The method of claim 2, wherein determining whether the in-vehicle image information meets a first preset alert condition comprises:

analyzing the image information in the vehicle;

7. An apparatus for automatically alarming a vehicle, comprising:

The acquisition unit is used for acquiring in-vehicle image information when the first voiceprint feature is determined to be the registered voiceprint feature;

and the alarm unit is used for triggering an in-vehicle alarm instruction when the preset alarm condition is met.

8. A vehicle, characterized in that the vehicle comprises an adjustment device of a vehicle seat according to claim 7.

9. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-6.

10. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-6.

11. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any of claims 1-6.