CN108095720B

CN108095720B - Drunk driving early warning method based on intelligent glasses and intelligent glasses

Info

Publication number: CN108095720B
Application number: CN201711340604.0A
Authority: CN
Inventors: 蔡任轩
Original assignee: Guangzhou Deco Cci Capital Ltd
Current assignee: Guangzhou Deco Cci Capital Ltd
Priority date: 2017-12-14
Filing date: 2017-12-14
Publication date: 2020-03-06
Anticipated expiration: 2037-12-14
Also published as: WO2019114018A1; CN108095720A

Abstract

A drunk driving early warning method based on intelligent glasses and the intelligent glasses comprise the following steps: the intelligent glasses detect whether a user vehicle in communication connection with the intelligent glasses receives an unlocking command, and if the user vehicle receives the unlocking command, the intelligent glasses detect an electric signal output by an alcohol sensor on the intelligent glasses; the intelligent glasses analyze and process the electric signals to obtain the alcohol concentration of the blood of the user, and judge whether the alcohol concentration is greater than a concentration threshold value; if the number of the drunk driving accidents is larger than the preset value, the intelligent glasses acquire a first real scene captured by a camera on the intelligent glasses, and acquire a first virtual scene, which is evolved from the drunk driving accident and is matched with the first real scene, from the server side according to the first real scene; the intelligent glasses project the first virtual scene to eyeballs of the user so that the user sees a mixed scene formed by overlapping the first real scene and the first virtual scene. By implementing the embodiment of the invention, drunk driving can be detected in time, the danger of drunk driving can be early warned to the user in time, the prevention consciousness of the user is improved, and the occurrence of drunk driving accidents is reduced.

Description

Drunk driving early warning method based on intelligent glasses and intelligent glasses

Technical Field

The invention relates to the technical field of electronic equipment, in particular to a drunk driving early warning method based on intelligent glasses and the intelligent glasses.

Background

In daily life, many traffic accidents are related to drunk driving, which has been listed as a main cause of death in car accidents. In china, traffic accidents caused by drunk driving are tens of thousands of times each year, and more than 50% of the dead traffic accidents are related to drunk driving, which has become the first killer of traffic accidents. In practice, people often have a lucky psychology after drinking wine, are weak in drunk driving consciousness and cannot stop drunk driving behaviors in time, and irretrievable life and property losses are caused when people are late after drunk driving accidents occur.

Disclosure of Invention

The embodiment of the invention discloses a drunk driving early warning method based on intelligent glasses and the intelligent glasses, which can detect drunk driving behaviors in time through the intelligent glasses and early warn users of the tragic consequences of drunk driving, are beneficial to improving the prevention awareness of the users, reduce the occurrence of drunk driving accidents and maintain the life and property safety of the users.

The embodiment of the invention discloses a drunk driving early warning method based on intelligent glasses, which comprises the following steps:

the intelligent glasses detect whether a user vehicle in communication connection with the intelligent glasses receives an unlocking command, if so, an electric signal output by an alcohol sensor on the intelligent glasses is detected, and the alcohol sensor converts alcohol molecules permeating from the surface of the skin of a human body into the electric signal;

the intelligent glasses analyze and process the electric signals to obtain the alcohol concentration in the blood of the user and judge whether the alcohol concentration is greater than a concentration threshold value;

if the concentration is larger than the concentration threshold, the intelligent glasses acquire a first real scene captured by a camera on the intelligent glasses, and acquire a first virtual scene of the evolution of the drunk driving accident matched with the first real scene from a server side according to the first real scene;

the intelligent glasses project the first virtual scene to eyeballs of a user so that the user can see a mixed scene formed by overlapping the first real scene and the first virtual scene.

As an optional implementation manner, in the first aspect of this embodiment of the present invention, the method further includes:

if the alcohol concentration is less than or equal to the concentration threshold value, the smart glasses detect whether a driver seat of the user vehicle is in a stressed state;

if the intelligent glasses are in the pressed state, the intelligent glasses detect the current brain wave frequency of the user;

the intelligent glasses match the current brain wave frequency with a pre-stored brain wave frequency table to obtain a current mental fatigue index corresponding to the current brain wave frequency, wherein the pre-stored brain wave frequency table comprises a brain wave frequency range and a mental fatigue index corresponding to the brain wave frequency range;

the intelligent glasses judge whether the current mental fatigue index is larger than a safety index threshold value, and if the current mental fatigue index is larger than the safety index threshold value, whether the user vehicle is in a driving state is detected;

if the intelligent glasses are not in the driving state, the intelligent glasses project an avatar representing that driving is forbidden to the eyeballs of the user, and a second real scene captured by a camera on the intelligent glasses is obtained;

the intelligent glasses identify whether an automobile windshield exists in the second real scene or not, and if so, determine the area of the automobile windshield to serve as a second fusion area;

the intelligent glasses acquire a second virtual scene matched with the second fusion area from the server side according to the current mental fatigue index, wherein the second virtual scene comprises a scene of a traffic accident caused by driving under the current mental fatigue index;

the smart glasses project the second virtual scene to the user's eyes so that the user sees a mixed scene that overlays the second virtual scene at the second fusion zone.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the smart glasses project the second virtual scene to the eyeballs of the user so that the user sees a mixed scene in which the second virtual scene is superimposed at the second fusion region, the method further includes:

the smart glasses project a travel advice virtual scene to the eyes of the user so that the user sees a mixed scene in which the travel advice virtual scene is superimposed at the second fusion area, the travel advice virtual scene including one or more of a navigation avatar, a phonebook avatar, and a rest advice avatar;

the intelligent glasses detect an operation instruction triggered by a user aiming at an avatar in the travel suggestion virtual scene, and identify the type of the avatar corresponding to the operation instruction, wherein the type of the avatar comprises any one of a navigation avatar, a telephone book avatar and a rest suggestion avatar;

the intelligent glasses generate a target virtual scene matched with the second fusion area according to the type of the virtual image, and project the target virtual scene to eyeballs of a user, so that the user sees a mixed scene overlapping the target virtual scene at the second fusion area.

if the current mental fatigue index is smaller than or equal to the safety index threshold value, the intelligent glasses send a fault detection instruction to the user vehicle, so that the user vehicle can detect a braking system of the user vehicle and a steering system of the user vehicle according to the fault detection instruction;

the intelligent glasses receive a detection report sent by the user vehicle, wherein the detection report comprises a fault coefficient of a braking system of the user vehicle and a fault coefficient of a steering system of the user vehicle;

the intelligent glasses acquire a fault reminding virtual scene from the server according to the detection report, wherein the fault reminding virtual scene comprises a brake system fault virtual image matched with a fault coefficient of a brake system of the user vehicle and a steering system fault virtual image matched with a fault coefficient of a steering system of the user vehicle;

and the intelligent glasses project the fault reminding virtual scene to eyeballs of the user.

The second aspect of the embodiment of the present invention discloses a pair of smart glasses, including:

the first detection unit is used for detecting whether a user vehicle in communication connection with the intelligent glasses receives an unlocking command;

the detection and analysis unit is used for detecting an electric signal output by an alcohol sensor on the intelligent glasses when the first detection unit detects that the user vehicle receives the unlocking command, converting alcohol molecules permeating from the surface of the skin of a human body into the electric signal by the alcohol sensor, and analyzing and processing the electric signal to obtain the alcohol concentration in the blood of the user;

a first judging unit, configured to judge whether the alcohol concentration obtained by the detection and analysis unit is greater than a concentration threshold;

the first obtaining unit is used for obtaining a first real scene captured by a camera on the intelligent glasses and triggering and starting a second obtaining unit when the first judging unit judges that the alcohol concentration is greater than the concentration threshold;

the second acquisition unit is used for acquiring a first virtual scene of the drunk driving accident evolution matched with the first real scene from the server side according to the first real scene acquired by the first acquisition unit;

and the projection unit is used for projecting the first virtual scene acquired by the second acquisition unit to the eyeball of the user so that the user sees a mixed scene in which the first real scene and the first virtual scene are superposed.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the method further includes:

the second detection unit is used for detecting whether a driving seat of the user vehicle is in a pressed state or not when the first judgment unit judges that the alcohol concentration is smaller than or equal to the concentration threshold value; and detecting a current brainwave frequency of the user when it is detected that a driver seat of the user vehicle is in the pressed state;

a matching unit, configured to match the current brain wave frequency detected by the second detecting unit with a pre-stored brain wave frequency table, so as to obtain a current mental fatigue index corresponding to the current brain wave frequency, where the pre-stored brain wave frequency table includes a brain wave frequency range and a mental fatigue index corresponding to the brain wave frequency range;

the second judging unit is used for judging whether the current mental fatigue index obtained by the matching unit is larger than a safety index threshold value or not;

the second detecting unit is further configured to detect whether the user vehicle is in a driving state when the second judging unit judges that the current mental fatigue index is greater than the safety index threshold;

the projection unit is further used for projecting an avatar representing that driving is forbidden to a user eyeball when the second detection unit detects that the user vehicle is not in the driving state;

the first acquisition unit is further used for acquiring a second real scene captured by a camera on the intelligent glasses;

the identification unit is used for identifying whether an automobile windshield exists in the second real scene acquired by the first acquisition unit;

a determining unit, configured to determine, when the identifying unit identifies that the automobile windshield exists in the second real scene, an area of the automobile windshield as a second fusion area;

the third obtaining unit is further configured to obtain a second virtual scene matched with the second fusion area from the server according to the current mental fatigue index obtained by the matching unit, where the second virtual scene includes a scene of a traffic accident caused by driving under the current mental fatigue index;

the projection unit is further configured to project the second virtual scene acquired by the third acquisition unit to eyeballs of a user, so that the user sees a mixed scene in which the second virtual scene is superimposed at the second fusion region.

As an alternative implementation, in the second aspect of the embodiment of the present invention, the projecting unit is further configured to project the second virtual scene to the user eyeballs, so that after the user sees the mixed scene in which the second virtual scene is superimposed at the second fusion region, a travel suggestion virtual scene matched with the second fusion region is projected to the user eyeballs, so that the user sees the mixed scene in which the travel suggestion virtual scene is superimposed at the second fusion region, where the travel suggestion virtual scene includes one or more of a navigation avatar, a phone book avatar, and a rest suggestion avatar;

the smart glasses further include:

the third detection unit is used for detecting an operation instruction triggered by a user aiming at an avatar in the travel suggestion virtual scene and identifying the type of the avatar corresponding to the operation instruction, wherein the type of the avatar comprises any one of a navigation avatar, a telephone book avatar and a rest suggestion avatar;

the projection unit is further configured to generate a target virtual scene matched with the second fusion area according to the type of the avatar identified by the third detection unit, and project the target virtual scene to eyeballs of a user, so that the user sees a mixed scene in which the target virtual scene is superimposed at the second fusion area.

a sending unit, configured to send a fault detection instruction to the user vehicle when the second determining unit determines that the current mental fatigue index is less than or equal to the safety index threshold, so that the user vehicle detects a braking system of the user vehicle and a steering system of the user vehicle according to the fault detection instruction;

the receiving unit is used for receiving a detection report sent by the user vehicle, wherein the detection report comprises a fault coefficient of a braking system of the user vehicle and a fault coefficient of a steering system of the user vehicle;

the third obtaining unit is further configured to obtain a fault reminding virtual scene from the server according to the detection report received by the receiving unit, where the fault reminding virtual scene includes a braking system fault avatar matched with a fault coefficient of a braking system of the user vehicle and a steering system fault avatar matched with a fault coefficient of a steering system of the user vehicle;

the projection unit is further configured to project the fault prompting virtual scene acquired by the third acquisition unit to eyeballs of the user.

A third aspect of an embodiment of the present invention discloses an intelligent glasses, including:

a memory storing executable program code;

a processor coupled with the memory;

the processor calls the executable program code stored in the memory to execute part or all of the steps of any one of the methods disclosed in the first aspect of the embodiments of the present invention.

A fourth aspect of the present embodiments discloses a computer-readable storage medium storing a program code, where the program code includes instructions for performing some or all of the steps of any one of the methods disclosed in the first aspect of the present embodiments.

A fifth aspect of the embodiments of the present invention discloses a computer program product, which, when running on a computer, causes the computer to perform part or all of the steps of any one of the methods disclosed in the first aspect of the embodiments of the present invention.

A sixth aspect of the present embodiment discloses an application publishing platform, where the application publishing platform is configured to publish the computer program product, and when the computer program product runs on a computer, the computer is caused to perform part or all of the steps of any one of the methods disclosed in the first aspect of the present embodiment.

Compared with the prior art, the embodiment of the invention has the following beneficial effects:

in the embodiment of the invention, the intelligent glasses firstly detect whether a user vehicle in communication connection with the intelligent glasses receives an unlocking command, if the unlocking command is received, the user vehicle is indicated to be used by the user for going out, when a person drinks, alcohol molecules can permeate from the skin surface, the alcohol sensor can convert the alcohol molecules permeating from the skin surface of a human body into an electric signal, at the moment, the intelligent glasses detect the electric signal output by the alcohol sensor on the intelligent glasses, then the intelligent glasses analyze and process the electric signal to obtain the alcohol concentration of the blood of the user, further, the intelligent glasses judge whether the alcohol concentration is greater than a concentration threshold value, if the alcohol concentration is greater than the concentration threshold value, the alcohol concentration in the blood of the user is too high, at the moment, the intelligent glasses are not suitable for driving, the intelligent glasses acquire a first real scene captured by a camera on the intelligent glasses, acquiring a first virtual scene of the evolution of the drunk driving accident matched with the first real scene from the server side according to the first real scene; still further, the smart glasses project the first virtual scene to the eyeballs of the user, so that the user sees a mixed scene in which the first real scene and the first virtual scene are superimposed. Therefore, the drunk driving behavior can be detected in time by implementing the embodiment of the invention, the first virtual scene of the drunk driving accident evolution can be integrated into the real scene through the intelligent glasses, the user can really experience the tragic result caused by drunk driving, the prevention consciousness of the user can be improved, the drunk driving behavior can be stopped in time, the drunk driving accident can be reduced, and the life and property safety of the user can be maintained.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

FIG. 1 is a schematic model diagram of a pair of smart glasses according to an embodiment of the present invention;

fig. 2 is a schematic flow chart of another drunk driving early warning method based on intelligent glasses according to the embodiment of the invention;

fig. 3 is a schematic flow chart of another drunk driving early warning method based on intelligent glasses according to the embodiment of the invention;

fig. 4 is a schematic flow chart of another drunk driving early warning method based on intelligent glasses according to the embodiment of the invention;

fig. 5 is a schematic structural diagram of a pair of smart glasses according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of another pair of smart glasses according to the present disclosure;

FIG. 7 is a schematic structural diagram of another pair of smart glasses according to the present disclosure;

fig. 8 is a schematic structural diagram of another smart glasses disclosed in the embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It is to be noted that the terms "comprises" and "comprising" and any variations thereof in the embodiments and drawings of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

The embodiment of the invention discloses a drunk driving early warning method based on intelligent glasses and the intelligent glasses, which can detect drunk driving behaviors in time through the intelligent glasses and early warn users of the tragic consequences of drunk driving, are beneficial to improving the prevention awareness of the users, reduce the occurrence of drunk driving accidents and maintain the life and property safety of the users. The following are detailed below.

Referring to fig. 1, fig. 1 is a schematic diagram of a model of smart glasses according to an embodiment of the present invention. As shown in fig. 1, the smart glasses include a sensor a, a sensor B, a micro projector B, and a camera D.

In the embodiment of the invention, the sensor A is an alcohol sensor, and the alcohol sensor is positioned on one side of the glasses legs of the intelligent glasses, which is close to the skin, and can be in direct contact with the skin of a user. After the people drunk, the alcohol molecule can permeate out on the skin surface, and the alcohol inductor can utilize biological enzyme to turn into the signal of telecommunication with the alcohol molecule that human skin surface permeates out, and intelligent glasses can detect the signal of telecommunication of sensor A output on this intelligent glasses afterwards to carry out analysis processes to this signal of telecommunication, can obtain user's blood alcohol concentration, and sensitivity is high, and convenient and reliable can real time monitoring user blood alcohol concentration.

In the embodiment of the invention, the sensor B can detect the current brain wave frequency of the user. The sensor B can adopt a ThinkGear AM chip, the chip adopts a dry electrode sensor, extremely weak electroencephalogram signals can be detected, the noise elimination and anti-interference capacity is good, the current brain wave frequency of a user can be accurately detected, errors are reduced, the measurement precision is improved, and the user experience is optimized.

As an alternative embodiment, the pico projector C may project the image directly onto the retina of the wearer; the micro projector C can also project a virtual scene to be projected onto the semi-transparent prism, and then the virtual scene is reflected on the retina of the human body by the semi-transparent prism; the micro projector C may also project the virtual scene onto a micro screen loaded in front of the micro projector C, and the user may view the content projected by the micro projector at the upper right corner of the field of view.

In the embodiment of the invention, the camera D is positioned at the outer side of the intelligent glasses, and the real scene seen by the human eyes can be acquired, wherein the real scene seen by the human eyes is the same as the real scene captured by the camera D.

As an optional implementation manner, the cameras D equipped on the smart glasses may be a pair of binocular cameras, the obtained real scene is more matched with the real scene seen by human eyes, and meanwhile, the smart glasses may determine the projection area according to the obtained real scene, which is beneficial to improving user experience.

Example one

Referring to fig. 2, fig. 2 is a schematic flow chart of a drunk driving warning method based on smart glasses according to an embodiment of the present invention. As shown in fig. 2, the drunk driving early warning method based on the intelligent glasses may include the following steps:

101. the intelligent glasses detect whether a user vehicle in communication connection with the intelligent glasses receives an unlocking command, and if so, the steps 102 to 103 are executed; if not, executing step 101 to continuously detect whether the user vehicle in communication connection with the smart glasses receives an unlocking command.

In the embodiment of the invention, the intelligent glasses are provided with an independent operating system, and programs provided by software service providers such as application software installed by users can be run on the operating system. Meanwhile, the intelligent glasses can complete corresponding operations such as adding schedules, map navigation, interacting with friends, taking pictures and videos, and performing video calls with friends according to voice instructions input by a recognition user or gesture action instructions of a detection user, and can realize wireless network access through a mobile communication network.

102. The intelligent glasses detect the electric signals output by the alcohol sensor on the intelligent glasses, and analyze and process the electric signals to obtain the alcohol concentration in the blood of the user.

In the embodiment of the invention, the alcohol sensor can convert alcohol molecules permeating from the surface of human skin into an electric signal by using biological enzyme.

103. The intelligent glasses judge whether the alcohol concentration is greater than a concentration threshold value, and if so, the step 104 to the step 105 are executed; if not, executing step 102 to step 103.

In the embodiment of the invention, the drunk driving means that the alcohol content in the blood of a driver driving a vehicle is more than or equal to 20mg/100ml and less than 80mg/100 ml; drunk driving means that the alcohol content in the blood of a driver driving a vehicle is greater than or equal to 80mg/100 ml. When a person drinks, alcohol is absorbed but not digested, and a part of the alcohol permeates through the skin. The concentration threshold may be set to 20mg/100ml, and the like, and the embodiment of the present invention is not limited.

104. The intelligent glasses acquire a first virtual scene of the evolution of the drunk driving accident matched with the first real scene from the server side according to the first real scene.

In the embodiment of the invention, the intelligent glasses can match out a proper first virtual scene according to the difference of the first real scene. The first virtual scene can be a dynamic accident scene caused by drunk driving, and meanwhile, the virtual scene can be matched with matched background sound to cause a sense of thriving, so that a warning effect can be provided for a user. The first real scene obtained by the intelligent glasses can also be a scene that a driver causing a trouble after drinking is rescued, and meanwhile, the scene that the family members are worried and worried outside the emergency room can cause the family responsibility of the user, and the driving behavior after drinking can be reduced.

In the embodiment of the invention, the first virtual scenes presented by the intelligent glasses each time can be different, so that the problem of reduced warning effect caused by repeated appearance of the same scene can be avoided.

105. The intelligent glasses project the first virtual scene to eyeballs of the user so that the user sees a mixed scene formed by overlapping the first real scene and the first virtual scene.

Therefore, by implementing the method described in fig. 2, drunk driving behaviors can be monitored in real time by detecting the alcohol concentration in blood of the user in real time, and the first virtual scene of the evolution of drunk driving accidents can be integrated into the real scene through the intelligent glasses, so that the user can truly experience the disastrous consequences caused by drunk driving, the prevention consciousness of the user can be improved, drunk driving behaviors can be stopped in time, the occurrence of drunk driving accidents can be reduced, and the life and property safety of the user can be maintained.

Example two

Referring to fig. 3, fig. 3 is a schematic flow chart of another drunk driving warning method based on smart glasses according to an embodiment of the present invention. As shown in fig. 3, the drunk driving early warning method based on the intelligent glasses may include the following steps:

201. the intelligent glasses detect whether a user vehicle in communication connection with the intelligent glasses receives an unlocking command, and if so, step 202 is executed; if not, executing step 201 to continuously detect whether the user vehicle in communication connection with the smart glasses receives an unlocking command.

202. The intelligent glasses detect the electric signals output by the alcohol sensor on the intelligent glasses, and analyze and process the electric signals to obtain the alcohol concentration in the blood of the user.

In the embodiment of the invention, the intelligent glasses can be in communication connection with the user vehicle of the user, and the user can control the user vehicle to execute unlocking operation by inputting an unlocking command to the intelligent glasses; or the user can control the user vehicle to execute unlocking operation through a key matched with the user vehicle, when the user vehicle receives an unlocking instruction triggered by the user through the key matched with the user vehicle, a signal of receiving the unlocking instruction can be sent to the intelligent glasses in communication connection with the user vehicle, and at the moment, the intelligent glasses can immediately detect an electric signal output by an alcohol sensor on the intelligent glasses after receiving the signal.

203. The intelligent glasses judge whether the alcohol concentration is greater than a concentration threshold value, and if the alcohol concentration is greater than the concentration threshold value, step 204-step 209 are executed; if less than or equal to the concentration threshold, step 210 is performed.

204. The smart glasses recognize all vehicles in the first real scene and extract vehicle features of each vehicle.

In this embodiment of the present invention, the vehicle characteristic includes one or more of a type of the vehicle, a color of the vehicle, a brand category of the vehicle, and a marker of the vehicle, and the embodiment of the present invention is not limited thereto.

205. The intelligent glasses compare the vehicle characteristics of the user vehicle in communication connection with the intelligent glasses with the vehicle characteristics of each vehicle respectively to obtain each vehicle characteristic comparison result.

206. And the intelligent glasses determine the user vehicle from all the vehicles according to the obtained comparison result of all the vehicle characteristics.

In the embodiment of the present invention, the first real scene matches the scene that the user sees at this time, and when a plurality of vehicles exist in the first real scene, the user vehicle of the user can be identified from the plurality of vehicles in the first scene by executing the above steps 204 to 206.

207. The intelligent glasses determine the area of the user vehicle in the first real scene, and determine a first fusion area in the first real scene according to the area of the user vehicle.

208. The intelligent glasses acquire a first virtual scene of the evolution of the drunk driving accident matched with the first fusion area from the server side, and the first virtual scene is used as a first virtual scene of the evolution of the drunk driving accident matched with the first real scene.

In the embodiment of the present invention, the intelligent glasses executing the steps 204 to 208 may obtain, from the server side according to the first real scene, a first virtual scene of the drunk driving accident evolution matched with the first real scene.

209. The intelligent glasses project the first virtual scene to eyeballs of the user so that the user can see a mixed scene formed by overlapping the first real scene and the first virtual scene, and the process is finished.

In the embodiment of the invention, because the user is in a drinking state at the moment, when the unlocking instruction is sent to the user vehicle, the attention of the user is mainly focused on the user vehicle, so that the user can immediately see the first virtual scene superposed at the position of the user vehicle after the first virtual scene is projected to the eyeball of the user by the intelligent glasses, the attention of the user can be attracted, and the warning effect is favorably improved.

As an optional implementation manner, the drunk driving early warning method based on the smart glasses may further include the following steps:

210. the intelligent glasses detect whether a driver seat of the user vehicle is in a pressed state, and if the driver seat is in the pressed state, the steps 211 to 212 are executed; if not, the process is ended.

211. The intelligent glasses detect the current brain wave frequency of the user, and match the current brain wave frequency with a pre-stored brain wave frequency table to obtain a current mental fatigue index corresponding to the current brain wave frequency.

In the embodiment of the invention, the pre-stored brain wave frequency table comprises a brain wave frequency range and a mental fatigue index corresponding to the brain wave frequency range.

According to the embodiment of the invention, brain waves are also called brain waves, and mainly record electric wave changes during brain activities, and are the total reflection of electrophysiological activities of brain nerve cells on the surface of a cerebral cortex or a scalp, wherein the brain waves are some spontaneous rhythmic nerve electrical activities, the frequency variation range of the spontaneous rhythmic nerve electrical activities is 1-30 times per second, and the spontaneous rhythmic nerve electrical activities can be divided into four wave bands, namely delta (1-3 Hz), theta (4-7 Hz), α (8-13 Hz) and β (14-30 Hz), wherein the brain wave frequencies detected by the intelligent glasses are within the frequency range of 1-3 Hz when an adult is in an extremely tired, sleepy or anaesthetized state, the brain wave frequencies detected by the intelligent glasses are within the frequency range of 4-7 Hz when the adult is in a willed, depressed and psychologically sick state, the brain wave frequencies detected by the intelligent glasses are within the frequency range of 8-13 Hz when the adult is in a waking and calm normal state, and the brain wave frequencies detected by the intelligent glasses are within the frequency range of 14-30 Hz when the adult is in a nervous, excited, or excited state.

212. The smart glasses judge whether the current mental fatigue index is greater than a safety index threshold value, if so, the step 213 is executed; if the safety index is less than or equal to the safety index threshold value, the flow is ended.

In the embodiment of the invention, when the intelligent glasses judge that the current mental fatigue index is greater than the safety threshold, the user is in a fatigue state at the moment, and is not suitable for driving to go out; when the intelligent glasses judge that the current mental fatigue index is smaller than or equal to the safety threshold value, the fact that the user is not in a fatigue state at the moment is indicated, and the intelligent glasses are suitable for driving to go out.

As an alternative embodiment, when the mental fatigue index is 10 at most, if the current brain wave frequency is in the frequency range of 1-3 Hz, the mental fatigue index corresponding to the frequency range can be set to 10; if the current brain wave frequency is in the frequency range of 4-7 Hz, the mental fatigue index corresponding to the frequency range can be set to be 9; if the current brain wave frequency is in the frequency range of 8-13 Hz, the mental fatigue index corresponding to the frequency range can be set to be 2; if the current brain wave frequency is in a frequency range of 14-30 Hz, the mental fatigue index corresponding to the frequency range can be set to be 5, and the safety index threshold value can be set to be 6. The intelligent glasses can also output different early warning prompts according to different mental fatigue indexes.

213. The intelligent glasses detect whether the vehicle of the user is in a driving state, and if the vehicle of the user is not in the driving state, the steps 214 to 215 are executed; if the vehicle is in a driving state, the process is ended.

As an optional implementation manner, when the smart glasses determine that the user vehicle is in a driving state, the method may further include the following steps:

the intelligent glasses output fatigue driving voice early warning to prompt a user that the current fatigue state is not suitable for driving;

the intelligent glasses detect a parking instruction input by a user, and acquire a first position of the intelligent glasses according to the parking instruction;

the intelligent glasses inquire a parking point closest to the first position according to the first position and generate a parking navigation scheme;

the intelligent glasses play the parking navigation scheme in a voice playing mode and control the user vehicle to open the ventilation device.

214. The intelligent glasses project an avatar representing the prohibition of driving to eyeballs of the user, and a second real scene captured by a camera on the intelligent glasses is obtained.

215. The intelligent glasses identify whether the automobile windshield exists in the second real scene or not, and if so, the step 216 to the step 218 are executed; if the automobile windshield does not exist, the process is ended.

216. The intelligent glasses determine the area of the automobile windshield as a second fusion area.

217. And the intelligent glasses acquire a second virtual scene matched with the second fusion area from the server side according to the current mental fatigue index.

In an embodiment of the present invention, the second virtual scene includes a scene of a traffic accident caused by driving under the current mental fatigue index. The intelligent glasses can acquire different second virtual scenes from the server according to different current mental fatigue indexes, and therefore the warning strength and the user experience are improved.

218. The smart glasses project the second virtual scene to the user's eyes so that the user sees a mixed scene that overlays the second virtual scene at the second fusion zone.

Therefore, the implementation of the method described in fig. 3 can detect drunk driving behaviors in time, and can integrate the first virtual scene of the drunk driving accident evolution in a real scene through intelligent glasses, so that the user can truly experience the disastrous consequences caused by drunk driving, the prevention awareness of the user can be improved, the drunk driving behaviors can be stopped in time, and the drunk driving accidents can be reduced; when the fact that the user is not in the drinking state is detected, the current mental state of the user can be detected by detecting the brain wave frequency, when the fact that the current mental state of the user is in the fatigue state is detected, the harm of fatigue driving of the user can be warned in time, dangerous driving behaviors of the user are reminded in time, the danger is avoided, and the life and property safety of the user is maintained.

EXAMPLE III

Referring to fig. 4, fig. 4 is a schematic flowchart of another drunk driving warning method based on smart glasses according to an embodiment of the present invention. As shown in fig. 4, the drunk driving early warning method based on the intelligent glasses may include the following steps:

301. the intelligent glasses detect whether a user vehicle in communication connection with the intelligent glasses receives an unlocking command, and if so, step 302 is executed; if not, executing step 301 to continuously detect whether the user vehicle in communication connection with the smart glasses receives an unlocking command.

302. The intelligent glasses detect the electric signals output by the alcohol sensor on the intelligent glasses, and analyze and process the electric signals to obtain the alcohol concentration in the blood of the user.

303. The intelligent glasses judge whether the alcohol concentration is greater than a concentration threshold value, and if the alcohol concentration is greater than the concentration threshold value, the step 304 to the step 305 are executed; if less than or equal to the concentration threshold, step 306 is performed.

304. The intelligent glasses acquire a first virtual scene of the evolution of the drunk driving accident matched with the first real scene from the server side according to the first real scene.

As an optional implementation manner, the acquiring, by the smart glasses, the first virtual scene of the evolution of the drunk driving accident matched with the first real scene from the server according to the first real scene may include the following steps:

the smart glasses identify all vehicles in the first real scene and extract vehicle characteristics of each vehicle, the vehicle characteristics including one or more of a type of the vehicle, a color of the vehicle, a brand category of the vehicle, and an identifier of the vehicle.

The intelligent glasses compare the vehicle characteristics of the user vehicle in communication connection with the intelligent glasses with the vehicle characteristics of each vehicle respectively to obtain a comparison result of each vehicle characteristic;

the intelligent glasses determine the user vehicle from all the vehicles according to the obtained comparison result of all the vehicle characteristics;

the intelligent glasses determine the area of the user vehicle in the first real scene, and determine a first fusion area in the first real scene according to the area of the user vehicle;

the intelligent glasses acquire a first virtual scene of the evolution of the drunk driving accident matched with the first fusion area from the server side, and the first virtual scene is used as a first virtual scene of the evolution of the drunk driving accident matched with the first real scene.

305. The intelligent glasses project the first virtual scene to eyeballs of the user so that the user can see a mixed scene formed by overlapping the first real scene and the first virtual scene, and the process is finished.

306. the intelligent glasses detect whether the driver seat of the user vehicle is in a pressed state, and if so, the step 307 is executed; if not, execution of step 306 continues by detecting whether the driver's seat of the user's vehicle is in a stressed state.

307. The intelligent glasses detect the current brain wave frequency of the user, and match the current brain wave frequency with a pre-stored brain wave frequency table to obtain a current mental fatigue index corresponding to the current brain wave frequency.

308. The smart glasses judge whether the current mental fatigue index is greater than a safety index threshold value, if so, execute step 309; if the safety index is less than or equal to the safety index threshold, steps 315 to 318 are executed.

309. The intelligent glasses detect whether the vehicle of the user is in a driving state, and if the vehicle of the user is in the driving state, the process is ended; if not, executing step 310 to step 311.

310. The intelligent glasses project an avatar representing the prohibition of driving to eyeballs of the user, and a second real scene captured by a camera on the intelligent glasses is obtained.

311. The intelligent glasses identify whether the automobile windshield exists in the second real scene or not, and if so, the steps 312 to 318 are executed; if not, the flow ends.

In the embodiment of the present invention, when it is recognized that no automobile partition glass exists in the second real scene, the smart glasses may select the default region as the second fusion region, where the default region is a default fusion region of the smart glasses, and the size and the position of the default region are set by an engineer who manufactures the smart glasses, which is not limited in the embodiment of the present invention.

312. The intelligent glasses determine the area of the automobile windshield as a second fusion area.

313. And the intelligent glasses acquire a second virtual scene matched with the second fusion area from the server side according to the current mental fatigue index.

In an embodiment of the present invention, the second virtual scene includes a scene of a traffic accident caused by driving under the current mental fatigue index.

314. The smart glasses project the second virtual scene to the user's eyes so that the user sees a mixed scene that overlays the second virtual scene at the second fusion zone.

As an optional implementation, after the smart glasses project the second virtual scene to the eyes of the user so that the user sees a mixed scene in which the second virtual scene is superimposed at the second fusion area, the method may further include the following steps:

the intelligent glasses project the travel suggestion virtual scene to the eyeballs of the user so that the user sees a mixed scene overlapping the travel suggestion virtual scene at the second fusion area, wherein the travel suggestion virtual scene can comprise one or more of a navigation virtual image, a telephone book virtual image and a rest suggestion virtual image;

the intelligent glasses detect an operation instruction triggered by a user aiming at the virtual image in the travel suggestion virtual scene, and identify the type of the virtual image corresponding to the operation instruction, wherein the type of the virtual image comprises any one of a navigation virtual image, a telephone book virtual image and a rest suggestion virtual image;

the intelligent glasses generate a target virtual scene matched with the second fusion area according to the type of the virtual image, and project the target virtual scene to eyeballs of the user, so that the user sees a mixed scene overlapping the target virtual scene at the second fusion area.

In the embodiment of the invention, a user can see a travel suggestion virtual scene in the area of the automobile windshield, the travel suggestion virtual scene at least comprises a navigation virtual image, a telephone book virtual image and a rest suggestion virtual image, and the user can trigger an operation instruction aiming at one virtual image according to the own needs. The mode that the user triggers the operation instruction can be voice triggering, action gesture triggering, eye movement tracking triggering and the like, the intelligent glasses can recognize the operation instruction input by the user in a voice mode through voice recognition, can recognize the gesture action of the user, can recognize the operation instruction output by the user in a gesture mode, and can recognize the virtual image which the user wants to select through recognizing the sight attention point of eyeballs of the user.

As an alternative embodiment, if it is recognized that the type of the avatar is a navigation avatar, the following steps may be further included:

the intelligent glasses acquire the current position of the intelligent glasses and detect a destination input by a user;

the intelligent glasses generate an optimal travel scheme according to the current position and the destination;

the intelligent glasses generate a target virtual scene matched with the second fusion area according to the travel scheme, the target virtual scene comprises a travel mode virtual image and a route map virtual image corresponding to the travel mode virtual image, and the travel scheme comprises one or more of a walking scheme, a public transportation scheme and a network-based car-booking scheme;

the smart glasses project the target virtual scene to the user's eyes so that the user sees a mixed scene overlaying the target virtual scene at the second fusion zone.

In the embodiment of the invention, when the avatar selected by the user is identified to be the navigation avatar, the intelligent glasses can recommend the optimal scheme for the user to reach the destination according to the current position of the intelligent glasses and the destination input by the user, and the optimal scheme does not include a self-driving scheme.

As another alternative embodiment, if it is recognized that the type of the avatar is a phone book avatar, the following steps may be further included:

the intelligent glasses generate a target virtual scene matched with the second fusion area according to a pre-stored telephone directory, wherein the target virtual scene comprises a telephone number virtual image and a contact person virtual image corresponding to the telephone number virtual image;

In the embodiment of the invention, when the avatar selected by the user is identified to be the telephone directory avatar, the user is indicated to have urgent need to contact others at the moment, the intelligent glasses can display the telephone directory for the user and can provide the user with functions of video call and the like, and the user can send the user to a required place by contacting with familiar people, so that the user experience is improved.

As another alternative embodiment, if it is recognized that the type of the avatar is a rest suggestion avatar, the following steps may be further included:

the intelligent glasses obtain the current position of the intelligent glasses, and obtain all rest places, the position of each rest place and the virtual image of each rest place in the peripheral range from the server side, wherein the peripheral range is a range obtained by drawing a circle by taking the current position as the center and by using a preset radius;

the intelligent glasses acquire a map virtual scene which comprises the current position and is matched with the second fusion area from the server side;

the intelligent glasses add the virtual image of the rest place corresponding to the position of the rest place to the map virtual scene according to the position of each rest place to obtain a target virtual scene;

In the embodiment of the invention, when the avatar selected by the user is identified to be the rest suggestion thin avatar, the fact that the user may need to have a short rest at the moment is indicated, the intelligent glasses may recommend a place for rest nearby, the place for rest may be a public place or a payment place provided by a merchant, and the embodiment of the invention is not limited.

In the embodiment of the invention, the intelligent glasses not only can warn the user of the harm of fatigue driving, but also can provide multiple effective and possible schemes for the user when the user is in a fatigue state and is not suitable for driving a vehicle, thereby providing convenience for the user, improving the user experience degree and simultaneously reducing the occurrence of dangerous accidents caused by fatigue driving.

315. the intelligent glasses send fault detection instructions to the user vehicle, so that the user vehicle can detect a braking system and a steering system of the user vehicle according to the fault detection instructions.

In the embodiment of the invention, the braking system on the automobile is mainly used for ensuring that the automobile can be decelerated and stopped according to the requirement of a driver during running, ensuring that the automobile is reliably parked and ensuring the safety of the automobile and the driver; meanwhile, a steering system on the automobile can control the driving direction of the automobile according to the intention of a driver, and the system is important for the driving safety of the automobile. The automobile steering system and the brake system are two systems which must be considered as important for automobile safety, so that the real-time detection of the brake system and the steering system of a user automobile is particularly important.

316. And the intelligent glasses receive the detection report sent by the vehicle of the user.

In an embodiment of the invention, the detection report comprises a failure coefficient of a braking system of the user vehicle and a failure coefficient of a steering system of the user vehicle. The user vehicle can automatically detect the performances of the braking system and the steering system according to the fault detection instruction sent by the intelligent glasses, can compare the detected performance data with the pre-stored standard performance data to obtain the fault coefficient of the braking system and the fault coefficient of the steering system, and generates a detection report to send to the intelligent glasses.

317. And the intelligent glasses acquire the fault reminding virtual scene from the server according to the detection report.

In the embodiment of the invention, the fault reminding virtual scene comprises a brake system fault virtual image matched with the fault coefficient of the brake system of the user vehicle and a steering system fault virtual image matched with the fault coefficient of the steering system of the user vehicle.

318. The intelligent glasses project the fault reminding virtual scene to eyeballs of the user.

In the embodiment of the invention, the intelligent glasses can detect whether the user drinks and is in a fatigue state in real time, when the intelligent glasses detect that the user is in a non-drinking and non-fatigue state at the moment, the intelligent glasses can also acquire a matched fault reminding virtual scene from the server according to the detected fault coefficient of the braking system of the vehicle of the user and the fault coefficient of the steering system of the vehicle of the user, and the user can know whether the braking system and the steering system of the vehicle of the user have faults through the fault reminding virtual scene, so that potential danger can be effectively avoided, and the occurrence of accidents is reduced.

Therefore, the method described in the figure 4 can be implemented to monitor the drunk driving behavior of the user in real time and the fatigue driving behavior of the user in real time, and meanwhile, the detection report is obtained by controlling the self-checking of the vehicle of the user, and the corresponding fault reminding virtual scene can be obtained from the server side according to the detection report, so that the precaution consciousness of the user is improved, the dangerous driving behavior of the user is warned in time, the occurrence of driving accidents is reduced, and the life and property safety of the user is maintained.

Example four

Referring to fig. 5, fig. 5 is a schematic structural diagram of a pair of smart glasses according to an embodiment of the present invention. Wherein, as shown in fig. 5, the smart glasses may include:

a first detecting unit 401, configured to detect whether the user vehicle in communication connection with the smart glasses receives an unlocking command.

The detection and analysis unit 402 is configured to detect an electrical signal output by an alcohol sensor on the smart glasses when the first detection unit 401 detects that the user vehicle receives the unlocking command, where the alcohol sensor converts alcohol molecules permeating through the surface of the skin of the human body into an electrical signal, and analyzes and processes the electrical signal to obtain the alcohol concentration in the blood of the user.

A first judging unit 403, configured to judge whether the alcohol concentration obtained by the detection and analysis unit 402 is greater than a concentration threshold.

The first obtaining unit 404 is configured to obtain a first real scene captured by a camera on the smart glasses when the first determining unit 403 determines that the alcohol concentration is greater than the concentration threshold, and trigger to start the second obtaining unit 405.

The second obtaining unit 405 is configured to obtain, from the server side according to the first real scene obtained by the first obtaining unit 404, a first virtual scene of the drunk driving accident evolution matched with the first real scene.

The projecting unit 406 is configured to project the first virtual scene acquired by the second acquiring unit 405 to the eyeball of the user, so that the user sees a mixed scene in which the first real scene and the first virtual scene are superimposed.

In the intelligent glasses described in fig. 5, after a person drinks, alcohol molecules permeate from the skin surface, the alcohol sensor on the intelligent glasses can convert the alcohol molecules permeating from the skin surface of the person into electrical signals, at this time, the detection and analysis unit 402 detects the electrical signals output by the alcohol sensor on the intelligent glasses, analyzes and processes the electrical signals to obtain the alcohol concentration of the blood of the user, the first judgment unit 403 may then judge whether the alcohol concentration is greater than the concentration threshold, and if so, it indicates that the alcohol concentration in the blood of the user is too high, and it is not suitable for driving, the first obtaining unit 404 will obtain the first real scene captured by the camera on the smart glasses, meanwhile, the second obtaining unit 405 may obtain, from the server side, a first virtual scene of the evolution of the drunk driving accident matched with the first real scene according to the first real scene; further, the projection unit 406 projects the first virtual scene to the eyes of the user, so that the user sees a mixed scene in which the first real scene and the first virtual scene are superimposed. Therefore, when drunk driving behaviors are detected, the intelligent glasses described in the figure 5 can enable a user to see a first virtual scene integrated with the evolution of drunk driving accidents under a real scene, so that the user can really experience the disastrous consequences caused by drunk driving, the prevention awareness of the user can be improved, the drunk driving behaviors can be stopped in time, the drunk driving accidents are reduced, and the life and property safety of the user is maintained.

EXAMPLE five

Referring to fig. 6, fig. 6 is a schematic structural diagram of another smart glasses according to the embodiment of the present invention. The smart glasses shown in fig. 6 are optimized from the smart glasses shown in fig. 5. The second acquisition unit 405 shown in fig. 5 includes:

the first sub-unit 4051 is configured to identify all vehicles in the first real scene acquired by the first acquiring unit 404, and extract vehicle features of each vehicle; the intelligent glasses are also used for comparing the vehicle characteristics of the user vehicle in communication connection with the intelligent glasses with the vehicle characteristics of each vehicle respectively to obtain each vehicle characteristic comparison result; the vehicle characteristic comparison module is also used for determining a user vehicle from all vehicles according to the obtained vehicle characteristic comparison results; and the system is further used for determining the area of the vehicle of the user in the first real scene, and determining a first fusion area in the first real scene according to the area of the vehicle of the user, wherein the vehicle characteristics comprise one or more of the type of the vehicle, the color of the vehicle, the brand category of the vehicle and the identifier of the vehicle.

In this embodiment of the present invention, the first sub-unit 4051 may identify the user vehicle in communication connection with the smart glasses in the first real scene.

The second sub-unit 4052 is configured to acquire, from the server, the first virtual scene of the evolution of the drunk driving accident that matches the first fusion area determined by the first sub-unit 4051, as the first virtual scene of the evolution of the drunk driving accident that matches the first real scene.

As an alternative embodiment, as shown in fig. 6, the smart glasses may further include:

a second detection unit 407 for detecting whether the driver's seat of the user's vehicle is in a pressed state when the first judgment unit 403 judges that the alcohol concentration is less than or equal to the concentration threshold value; and detecting the current brain wave frequency of the user when the driver seat of the vehicle of the user is detected to be in a pressed state.

The matching unit 408 is configured to match the current brain wave frequency detected by the second detecting unit 407 with a pre-stored brain wave frequency table to obtain a current mental fatigue index corresponding to the current brain wave frequency, where the pre-stored brain wave frequency table includes a brain wave frequency range and a mental fatigue index corresponding to the brain wave frequency range.

The second determining unit 409 is configured to determine whether the current mental fatigue index obtained by the matching unit 408 is greater than the safety index threshold.

The second detecting unit 407 is further configured to detect whether the user vehicle is in a driving state when the second determining unit 409 determines that the current mental fatigue index is greater than the safety index threshold.

And a projecting unit 406, configured to project an avatar indicating that driving is prohibited to the eyes of the user when the second detecting unit 407 detects that the user vehicle is not in a traveling state.

In the embodiment of the present invention, the projection unit 406 may further trigger the activation of the first obtaining unit 404 after projecting the avatar representing the prohibition of driving to the eyeball of the user.

The first obtaining unit 404 is further configured to obtain a second real scene captured by a camera on the smart glasses.

And an identifying unit 410, configured to identify whether an automobile windshield exists in the second real scene acquired by the first acquiring unit 404.

A determining unit 411, configured to determine, when the identifying unit 410 identifies that the automobile windshield exists in the second real scene, an area of the automobile windshield as the second fusion area.

The third obtaining unit 412 is further configured to obtain, from the server, a second virtual scene matched with the second fusion area determined by the determining unit 411 according to the current mental fatigue index obtained by the matching unit 408, where the second virtual scene includes a scene where a traffic accident is caused by driving under the current mental fatigue index.

The projecting unit 406 is further configured to project the second virtual scene acquired by the third acquiring unit 412 to the user eyeball, so that the user sees a mixed scene in which the second virtual scene is superimposed at the second fusion region.

As can be seen, by implementing the method described in fig. 3, the detection and analysis unit 402 can detect the alcohol concentration in the blood of the user in real time, and can enable the user to truly experience the disastrous consequences caused by drunk driving by integrating the first virtual scene of the evolution of the drunk driving accident in the real scene when the first judgment unit 403 judges that the drunk driving behavior exists in the user, that is, when the alcohol concentration in the blood of the user is greater than the concentration threshold, which is beneficial to improving the prevention awareness of the user, stopping the drunk driving behavior in time, and reducing the occurrence of drunk driving accidents; meanwhile, the second determination unit 409 may further detect the current mental state of the user by detecting the brain wave frequency of the user to determine whether the user is in a fatigue state, and when the current mental state of the user is detected to be in a fatigue state, the projection unit 406 may project a corresponding early warning virtual scene to eyeballs of the user to early warn the user of the danger of fatigue driving in time, so as to prompt the user of dangerous driving behaviors in time and maintain the life and property safety of the user.

EXAMPLE six

Referring to fig. 7, fig. 7 is a schematic structural diagram of another smart glasses according to the embodiment of the present invention. The smart glasses shown in fig. 7 are optimized from the smart glasses shown in fig. 6. As shown in fig. 7:

the projecting unit 406 is further configured to project, after projecting the second virtual scene to the user eyeballs so that the user sees a mixed scene in which the second virtual scene is superimposed at the second fusion region, a travel suggestion virtual scene matching the second fusion region determined by the determining unit 411 to the user eyeballs so that the user sees a mixed scene in which a travel suggestion virtual scene including one or more of a navigation avatar, a phonebook avatar, and a rest suggestion avatar is superimposed at the second fusion region.

As shown in fig. 7, the smart glasses may further include:

a third detecting unit 413, configured to detect an operation instruction triggered by the user for an avatar in the travel suggestion virtual scene, and identify a type of the avatar corresponding to the operation instruction, where the type of the avatar includes any one of a navigation avatar, a phonebook avatar, and a rest suggestion avatar.

In this embodiment of the present invention, after the projection unit 406 projects the travel suggestion virtual scene to the eyeball of the user, so that the user sees a mixed scene in which the travel suggestion virtual scene is superimposed at the second fusion region, the third detection unit 413 may also be triggered and started.

The projecting unit 406 is further configured to generate a target virtual scene matching the second fusion area determined by the determining unit 411 according to the type of the avatar identified by the third detecting unit 413, and project the target virtual scene to the user's eyeball, so that the user sees a mixed scene in which the target virtual scene is superimposed at the second fusion area.

As an alternative embodiment, as shown in fig. 7, the smart glasses may further include:

a sending unit 414, configured to send a fault detection instruction to the user vehicle when the second determining unit 409 determines that the current mental fatigue index is less than or equal to the safety index threshold, so that the user vehicle detects its braking system and its steering system according to the fault detection instruction.

A receiving unit 415, configured to receive a detection report sent by the user vehicle, where the detection report includes a failure coefficient of a braking system of the user vehicle and a failure coefficient of a steering system of the user vehicle.

The third obtaining unit 412 is further configured to obtain, according to the detection report received by the receiving unit 415, a fault notification virtual scene from the server, where the fault notification virtual scene includes a brake system fault avatar matching a fault coefficient of a brake system of the user vehicle and a steering system fault avatar matching a fault coefficient of a steering system of the user vehicle.

The projecting unit 406 is further configured to project the fault prompting virtual scene acquired by the third acquiring unit 412 to the eyeballs of the user.

Therefore, by implementing the method described in fig. 4, not only can drunk driving behaviors of the user be monitored in real time, but also fatigue driving behaviors of the user can be monitored in real time, so that the prevention awareness of the user is improved, dangerous driving behaviors of the user are warned in time, and the occurrence of driving accidents is reduced.

Referring to fig. 8, fig. 8 is a schematic structural diagram of another smart glasses according to the embodiment of the present invention. As shown in fig. 8, the smart glasses may include:

a memory 501 in which executable program code is stored.

A processor 502 coupled to a memory 501.

The processor 502 calls the executable program code stored in the memory 501 to execute any one of the drunk driving warning methods based on the smart glasses in fig. 2 to 4.

The embodiment of the invention discloses a computer-readable storage medium which stores a computer program, wherein the computer program enables a computer to execute any one of the drunk driving early warning method based on intelligent glasses in figures 2-4.

The embodiment of the invention discloses a computer program product, which enables a computer to execute any one of the drunk driving early warning methods based on intelligent glasses in figures 2-4 when the computer program product runs on the computer.

The embodiment of the invention discloses an application release platform which is used for releasing a computer program product, wherein when the computer program product runs on a computer, the computer is enabled to execute any one of the drunk driving early warning method based on intelligent glasses in the figures 2-4.

It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by instructions associated with a program, which may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), compact disc-Read-Only Memory (CD-ROM), or other Memory, magnetic disk, magnetic tape, or magnetic tape, Or any other medium which can be used to carry or store data and which can be read by a computer.

The drunk driving early warning method based on the intelligent glasses and the intelligent glasses disclosed by the embodiment of the invention are described in detail, a specific example is applied in the method to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A drunk driving early warning method based on intelligent glasses is characterized by comprising the following steps:

2. The method according to claim 1, wherein the smart glasses obtain a first virtual scene of the evolution of the drunk driving accident matched with the first real scene from a server according to the first real scene, and the method comprises the following steps:

the intelligent glasses identify all vehicles in the first real scene and extract vehicle characteristics of each vehicle, wherein the vehicle characteristics comprise types of the vehicles and/or identifiers of the vehicles;

the intelligent glasses determine the user vehicle from all the vehicles according to the obtained comparison results of all the vehicle characteristics;

and the intelligent glasses acquire a first virtual scene of the evolution of the drunk driving accident matched with the first fusion area from the server side, and the first virtual scene is used as a first virtual scene of the evolution of the drunk driving accident matched with the first real scene.

3. The method of claim 1, further comprising:

4. The method of claim 3, wherein the smart glasses project the second virtual scene to the user's eyes such that the user sees after a blended scene that overlays the second virtual scene at the second blending region, the method further comprising:

5. The method according to claim 3 or 4, characterized in that the method further comprises:

6. A smart eyewear, comprising:

7. The smart glasses according to claim 6, wherein the second obtaining unit includes:

the first sub-unit is used for identifying all vehicles in the first real scene acquired by the first acquisition unit and extracting the vehicle characteristics of each vehicle; the intelligent glasses are further used for comparing the vehicle characteristics of the user vehicle in communication connection with the intelligent glasses with the vehicle characteristics of each vehicle respectively to obtain each vehicle characteristic comparison result; the vehicle identification system is also used for determining the user vehicle from all the vehicles according to the obtained comparison results of all the vehicle characteristics; the system is further used for determining an area of the user vehicle in the first real scene and determining a first fusion area in the first real scene according to the area of the user vehicle, wherein the vehicle characteristics comprise the type of the vehicle and/or an identifier of the vehicle;

and the second subunit is used for acquiring the first virtual scene of the drunk driving accident evolution matched with the first fusion area determined by the first subunit from the server side, and taking the first virtual scene as the first virtual scene of the drunk driving accident evolution matched with the first real scene.

8. The smart eyewear of claim 6, further comprising:

a third obtaining unit, configured to obtain, from the server, a second virtual scene matched with the second fusion area according to the current mental fatigue index obtained by the matching unit, where the second virtual scene includes a scene in which a traffic accident is caused by driving under the current mental fatigue index;

9. The smart glasses according to claim 8, wherein the projection unit is further configured to project the second virtual scene to user eyeballs so that after the user sees the mixed scene in which the second virtual scene is superimposed at the second fusion region, a travel suggestion virtual scene matched with the second fusion region is projected to user eyeballs so that the user sees the mixed scene in which the travel suggestion virtual scene is superimposed at the second fusion region, wherein the travel suggestion virtual scene includes one or more of a navigation avatar, a phone book avatar, and a rest suggestion avatar;

the smart glasses further include:

10. The smart eyewear of claim 8 or claim 9, further comprising: