CN114185435A

CN114185435A - Emergency training device and method based on virtual reality equipment

Info

Publication number: CN114185435A
Application number: CN202111514236.3A
Authority: CN
Inventors: 于清; 吾守尔·斯拉木; 余超; 徐振威; 赵一江; 刘彦男; 伊萍萍; 吴昌坤; 李业; 于里托孜·阿曼泰
Original assignee: Xinjiang University
Current assignee: Xinjiang University
Priority date: 2021-12-13
Filing date: 2021-12-13
Publication date: 2022-03-15
Anticipated expiration: 2041-12-13
Also published as: CN114185435B

Abstract

The invention discloses an emergency training device and method based on virtual reality equipment, and relates to the technical field of virtual reality, wherein the device comprises a VR head display and a handle; a plurality of virtual first-aid scenes are implanted in the VR head display; each virtual first-aid scene comprises a virtual character model and a virtual first-aid equipment model corresponding to the virtual first-aid scene; the virtual character model at least comprises a rescued person model and a rescuer model; the handle is connected with the VR head display; the handle is used for operating the rescuer model and the virtual first-aid equipment model in the virtual first-aid scene to carry out first-aid on the rescued person model, and the VR head is used for acquiring and displaying changes of the virtual character model and the virtual first-aid equipment model in the first-aid process. The invention can provide on-line and immersive experience for first aid training.

Description

Emergency training device and method based on virtual reality equipment

Technical Field

The invention relates to the technical field of virtual reality, in particular to an emergency training device and method based on virtual reality equipment.

Background

The popularization of first-aid knowledge not only includes the wide spread of first-aid theoretical knowledge, but also includes the wide mastery of first-aid skills. With the development of information technology, the first-aid knowledge transmission media are gradually changed from traditional printed matters such as first-aid manuals, books and publicity columns to information technology products such as first-aid websites and medical software. In contrast, the ordinary people have more and more chances of contacting with the first-aid theoretical knowledge, and the acquired first-aid theoretical knowledge is more and more abundant. The popularization of first aid knowledge is becoming more and more mature, but the popularization of first aid knowledge cannot be only on theoretical knowledge, and more importantly, the popularization of first aid skills is becoming more important.

In real life, the popularization of first aid skills needs to be enhanced. In the face of a patient who falls down suddenly, the first problem is how to rescue, and the lack of actual first aid skills is often in a mess, so that great risks are brought to the life safety of the injured person. At present, the training of the emergency skills of residents is only conducted by the offline guidance of the Hondeca meeting and the emergency hospital in China. The mode has the advantages that beneficial people are few, emergency training can not be basically achieved in rural areas and other areas, in addition, a lot of manpower and material resources are consumed for organizing one-time emergency training, in addition, the training effect is greatly reduced due to the reason of language in the training process, and the mode has obvious performance in areas where multiple nationalities inhabit, such as Xinjiang and Tibet. For the Chinese red cross and emergency hospitals, related personnel are required to be specially organized to prepare corresponding training materials to develop emergency training courses; it is necessary for the learner to draw a lot of time to receive training in a specific place, and simultaneously, problems of language obstruction, wrong understanding and the like are considered.

Based on the problems of offline emergency training, there is a need in the art for an emergency training device and method that provides online and immersive emergency training.

Disclosure of Invention

The invention aims to provide an emergency training device and method based on virtual reality equipment, which can provide on-line and immersive experience emergency training.

In order to achieve the purpose, the invention provides the following scheme:

an emergency training apparatus based on virtual reality equipment, the apparatus comprising a VR head display and a handle;

a plurality of virtual first-aid scenes are implanted in the VR head display; each virtual emergency scene comprises a virtual character model and a virtual emergency equipment model corresponding to the virtual emergency scene; the virtual character model at least comprises a rescuee model and a rescuer model;

the handle is connected with the VR head display; the handle is used for operating the rescuer model and the virtual first-aid equipment model in the virtual first-aid scene to carry out first-aid on the rescued person model, and the VR head is used for acquiring and displaying changes of the virtual character model and the virtual first-aid equipment model in the process of first-aid.

Optionally, a plurality of the virtual first aid scenarios are constructed based on a 3D modeling tool and Unity 3D.

Optionally, the plurality of said virtual first aid scenarios comprises a virtual home first aid scenario, a virtual public place first aid scenario, a virtual field first aid scenario, a virtual emergency wrap scenario and a virtual medical office first aid scenario.

Optionally, the virtual first aid device model comprises a public place arranged first aid device model; the first aid equipment models deployed in public places include an automated external defibrillator model, a family first aid kit model, and an ambulance model.

Optionally, the change of the virtual character model includes a posture change of the virtual character model, an action change of the virtual character model, a position change of the virtual character model and a state change of the virtual character model.

Optionally, the change in the virtual first aid device model comprises a change in position of the virtual first aid device model and a change in state of the virtual first aid device model.

Optionally, the VR headset has a language pack implanted therein; the language package is designed and manufactured by utilizing a machine translation model; the language pack is used for performing language conversion on the text information displayed in the virtual emergency scene.

The invention also provides the following scheme:

a virtual reality equipment-based emergency training method is applied to the virtual reality equipment-based emergency training device, and comprises the following steps:

acquiring various virtual first-aid scenes; the virtual first aid scenario is acquired based on a VR head display;

acquiring an operation action; the operation action is acquired based on a handle;

acquiring changes of a virtual character model and a virtual emergency equipment model in the virtual emergency scene according to the operation action;

judging whether the emergency process is correct or not according to the change of the virtual character model and the virtual emergency equipment model;

if yes, displaying that the operation action is correct;

if not, sending a vibration signal and displaying an error prompt; the vibration signal is used for vibrating the handle; the error prompt is for display in the virtual first aid scenario.

Optionally, the determining whether the emergency process is correct according to the change of the virtual character model and the virtual emergency equipment model specifically includes:

comparing the change of the virtual character model with the change of a preset virtual character model, and comparing the change of the virtual emergency equipment model with the change of the preset virtual emergency equipment model to obtain a comparison result;

if the comparison results are the same, determining that the emergency process is correct;

and if the comparison results are different, determining that the emergency process is incorrect.

According to the specific embodiment provided by the invention, the invention discloses the following technical effects:

according to the emergency training device and method based on the virtual reality equipment, the virtual emergency scene constructed by the 3D modeling tool and the Unity3D is implanted into the VR head display, and the rescuer model and the virtual emergency equipment model in the virtual emergency scene are operated by the handle to carry out emergency treatment on the rescued model, so that the emergency training of online and immersive experience is realized.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.

FIG. 1 is a block diagram of an embodiment of an emergency training apparatus based on virtual reality devices according to the present invention;

fig. 2 is a flowchart of a virtual first aid course constructing method according to an embodiment of the present invention;

fig. 3 is a flowchart of emergency skill training provided by an embodiment of the invention;

fig. 4 is a block diagram illustrating a virtual first aid training apparatus according to an embodiment of the present invention;

FIG. 5 is a block diagram of another virtual first aid training apparatus according to an embodiment of the present invention;

fig. 6 is a block diagram illustrating an electronic device for emergency skill training in a virtual emergency scenario according to an embodiment of the present invention;

FIG. 7 is a flowchart of an embodiment of a virtual reality device-based emergency training method according to the present invention;

fig. 8 is a flowchart of a new first aid training method according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

Fig. 1 is a block diagram of an embodiment of the emergency training apparatus based on virtual reality equipment. Referring to fig. 1, the emergency training apparatus based on virtual reality equipment comprises a VR head display 1 and a handle 2.

A plurality of virtual first-aid scenes are implanted in the VR head display 1; each virtual first-aid scene comprises a virtual character model and a virtual first-aid equipment model corresponding to the virtual first-aid scene; the virtual character model at least comprises a rescued person model and a rescuer model;

the handle 2 is connected with the VR head display 1; the handle 2 is used for operating a rescuer model and a virtual first-aid equipment model in a virtual first-aid scene to carry out first-aid on the rescued person model, and the VR head display 1 is used for acquiring and displaying changes of the virtual character model and the virtual first-aid equipment model in the first-aid process.

According to the invention, multiple virtual emergency scenes are implanted in the VR head display 1, which is equal to downloading application software on a mobile phone, and the relationship between the VR head display and the virtual emergency scenes is equal to the relationship between the mobile phone and the Taobao (the mobile phone is a hardware device, and the Taobao is a system developed based on hardware). A virtual training system (virtual emergency scene) developed by the invention is distributed on the Internet, a user accesses the Internet by using a VR head display 1, the virtual training system is accessed and installed, and the virtual training system can be rendered into a plurality of emergency scenes during operation.

In particular, a variety of virtual emergency scenarios are constructed based on the 3D modeling tool and Unity 3D.

The virtual first-aid scene, the virtual first-aid device and the virtual first-aid figure are designed and manufactured by using a 3D modeling tool such as 3D MAX and Blender. The interaction between the virtual emergency scene and the user (handle 2) is realized based on the Unity3D technology, that is, the virtual character model changes in the virtual emergency scene, and the virtual emergency equipment model changes in the virtual emergency scene are all constructed based on the Unity3D technology.

The plurality of virtual first-aid scenarios include a virtual home first-aid scenario, a virtual public-occasion first-aid scenario, a virtual field first-aid scenario, a virtual emergency binder scenario, and a virtual hospital room first-aid scenario.

The virtual first aid device model comprises a public place deployed first aid device model; public place deployed emergency equipment models include an automated external defibrillator model, a home first aid kit model, and an ambulance model.

The change of the virtual character model comprises the posture change of the virtual character model, the action change of the virtual character model, the position change of the virtual character model and the state change of the virtual character model.

The changes to the virtual first aid device model include changes in the location of the virtual first aid device model and changes in the state of the virtual first aid device model.

A language bag is implanted in the VR head display 1; the language package is designed and manufactured by utilizing a machine translation model; the language pack is used for performing language conversion on the character information displayed in the virtual emergency scene.

Implanting a language package into the VR head display 1, namely downloading the language package to the inner side of the VR head display 1, wherein the VR head display 1 can load the language package; the language pack at least comprises Chinese, English, Uygur and Kazakh and is used for carrying out language conversion on the character interaction information in the virtual training system.

In addition, a machine translation model can be implanted into the VR head display 1 to achieve language conversion of the text information displayed in the virtual emergency scene, but the loading of the mode is slow, and user experience is affected.

The invention provides an emergency training device based on virtual reality equipment, and provides an emergency knowledge popularization and emergency skill training method, as shown in figure 2, the method comprises the following steps:

step 101: and designing and manufacturing a virtual 3D model.

Designing and manufacturing the virtual 3D model specifically includes:

and designing and manufacturing a virtual character model and a virtual emergency equipment model, wherein the virtual character model at least comprises a rescuer model (a rescuee model) and a rescuer model which adapt to different emergency implementation processes. The virtual first aid equipment models include at least public place deployed first aid equipment models, such as an automated external defibrillator model, a home first aid kit model, and an ambulance model.

And displaying different emergency situations to the user according to the postures and behaviors of the characters in the virtual character model virtual real world.

According to the virtual emergency equipment model, emergency equipment in the real world is virtualized, and the use modes of different emergency equipment are displayed for users.

Designing and manufacturing different actions which can be carried out by the character model and the first-aid equipment model. Such as: models designed for emergency packing skills include: a rescuer model, a wounded character model, a disinfectant model, a tweezers model, a scissors model, a gauze model, a cotton swab model and a medicine box model. The actions of the rescuer model comprise walking, moving the fingers up and down, grabbing and moving the left hand and the right hand in parallel and oppositely. The actions of the wounded model include making a sound, basic facial expression. The actions of the disinfectant model comprise rotation, front and back up and down movement. The gauze movement includes left and right back and forth movement. The movement of the cotton swab model comprises up and down movement.

The designed and manufactured virtual 3D model at least comprises a character model and an emergency equipment model, and comprises a caller model and a rescuer model which adapt to different emergency implementation processes.

Step 102: and designing and manufacturing a virtual first-aid scene.

Designing and manufacturing a virtual first-aid scene specifically comprises the following steps:

the posture, the action, the position, the moving track and the moving range of the character model are preset aiming at a specific virtual emergency scene.

The position and the state of the virtual emergency equipment are preset aiming at a specific virtual emergency scene.

The change process of the virtual first aid implementation environment is preset for a specific virtual first aid scene.

Designing and manufacturing the virtual first-aid scene further comprises:

the virtual first aid scenario includes at least a virtual first aid implementation environment, a virtual first aid equipment model, a character model, and an interactive system. The emergency implementation environment includes at least a home emergency environment, a public emergency environment, and a field emergency environment.

The virtual first aid scenario is designed and manufactured based on first aid skills. According to the scene with the most possible emergency skills, virtual emergency scenes are designed and manufactured, wherein the virtual models are included, and the virtual emergency implementation environment and the interaction between the models are realized. The virtual first-aid implementation environment can be made by real-scene shooting. Such as virtual emergency wrap scenarios including models of emergency wrap skill design, virtual emergency delivery environments may be a medical office or home, and interactions between models may be all steps required for emergency wrap to occur.

Step 103: the design realizes virtual scene interaction monitoring system (interaction supervision system).

The interactive monitoring system specifically comprises:

when the character models are interacted, changes of the postures, the actions and the positions of the character models are monitored.

When the character model and the virtual first-aid equipment model are interacted, the position and the state of the virtual first-aid equipment are monitored.

When the character model interacts with the virtual emergency application environment, changes in the state, position and action of the character model are monitored.

When the virtual first-aid equipment and the virtual first-aid implementing environment are interacted, the state and position of the first-aid equipment are monitored.

When the character model interacts with the virtual first aid application environment, changes to the virtual first aid application environment are monitored.

And after the user enters a virtual emergency scene, monitoring the interactive process, and feeding back the user by vibration and text prompt.

The interactive system further comprises:

and designing corresponding virtual emergency equipment models, character models and virtual emergency implementation environments based on emergency knowledge to form corresponding emergency scenes.

Compiling interactions in an emergency scenario based on a game engine, including at least:

interactions between character models.

Interaction between the character model and the virtual first aid device model.

Interaction between the character model and the virtual first aid delivery environment.

Interaction between a virtual first aid device and a virtual first aid delivery environment.

The interaction modes at least comprise clicking, sliding and position changing.

The virtual emergency scene interactive supervision system at least comprises: monitoring the action of the character model, the interaction logic of the character model and the virtual environment, the interaction logic of the character model and the emergency equipment model, and the position of the model in the virtual environment;

the interactive record of the character model in the virtual emergency scene can truly reflect the mastering degree of a user for a certain emergency skill. By designing the character model in the emergency scene, the interaction monitoring system can record some specific interactions of the user, and finally provides a basis for evaluating the mastering degree of the emergency skills of the user. Such as: monitoring whether interaction of a rescuer model for canceling venom, taking a cotton swab, coating a disinfectant, taking gauze, winding, taking scissors, intercepting the gauze and the like occurs or not and occurrence sequence in a virtual emergency bandaging scene, and reflecting the emergency bandaging capability of a user.

By combining the virtual 3D model, the virtual first-aid scene and the virtual scene interactive supervision system, a virtual first-aid training course with first-aid knowledge as a core is obtained.

And translating the text in the emergency training course according to the language of the user. Translating text in the emergency training lesson according to the user language further comprises:

the machine translation model is obtained by using a large amount of multilingual corpus training.

And setting the default target language of the user as Chinese and the default target language number as Chinese number.

When the user enters the virtual emergency scene, a request for selecting the system language is submitted, and the request contains the target language number.

The system judges whether the request target language label is a Chinese number or not, and if the system language selected by the user is Chinese, the system directly enters a virtual emergency scene for learning. Otherwise, the system language selected by the user is used as the target language, the Chinese text in the virtual emergency scene is used as the input of the machine translation model, the translation model outputs the translation result of the target language, and the corresponding Chinese text is replaced by the translation model to be the target language text.

And modifying the default target language number of the user, and automatically translating the virtual emergency scene text into the target language when learning is started next time.

When a learning starting request submitted by a user is received, translation of an emergency course is selected according to the user language, the learning process of the user is recorded, and the mastering conditions of emergency knowledge and emergency skills of the user are fed back.

Step 104: testing a virtual first-aid scene and interacting a monitoring system.

The first-aid knowledge popularization and first-aid skill training method further comprises the following steps:

and presetting a search box.

When a user search request is received, fuzzy query is carried out according to search contents in the request; and feeding back all matched first aid knowledge, first aid skills and virtual first aid courses in a paging mode.

and presetting a recommendation button.

And when user information submitted by a user is received, triggering a recommendation button.

According to a preset user information template, user information at least including nationality, occupation, family member health conditions and whether a residence is in a city is obtained.

And feeding back the results of the virtual first-aid course library and the first-aid knowledge library to the user according to the user information.

and presetting an emergency knowledge learning window.

And displaying the first-aid knowledge to the user by receiving the operation of triggering the access first-aid knowledge learning window by the user.

The method shown in fig. 2 is a method for developing a virtual first aid training course, which is based on a virtual reality technology, and a user experiences a first aid scene in a first visual manner. And combining with a machine translation technology, providing multilingual emergency courses for users with different languages.

The invention relates to an emergency training device based on virtual reality equipment, and also provides an emergency skill training method, namely, a mode of optimizing the prior emergency knowledge popularization and emergency skill training by combining virtual reality and machine translation technologies is combined to improve the awareness of people with different languages on emergency knowledge and the mastering degree of emergency skills, as shown in fig. 3, the method comprises the following steps:

step 201: the user enters a virtual first aid scenario.

Step 202: the user clicks to select the virtual scene language.

Step 203: an instruction for a user to select a target language is received.

Step 204: and selecting a target language.

The default user target language is chinese, and in the language selection option, if the user selected target language is chinese, the chinese is set as the default language, as shown in step 204 b. If the target language selected by the user is not Chinese, the translation model is run to translate the text in the virtual scene into the target language, and the current target language is set as the default language, as shown in step 204 a.

The translation model comprises the steps of collecting Chinese language materials in the emergency field, submitting translation requests to translation websites such as Goole translation and Baidu translation by taking Chinese texts as request contents, receiving the translation contents in responses, and obtaining parallel language materials of Chinese dimensional language, Chinese English, Chinese Kazakh and Chinese Russian by the method. The Chinese text is used as request content to submit translation requests for translating Chinese into the same language to different translation websites, response information is received, translation results of the different translation websites are encoded by using a pre-training sentence encoder of Google, and the similarity of the different translation results is calculated by using a Pearson correlation coefficient. If the semantics of different translation results are very similar, receiving the translation results for constructing parallel corpora; otherwise, recording the Chinese and the translated text of the translation, and then carrying out manual inspection or translation. A neural network translation model such as a Transformer model is trained by using parallel corpora, and translation quality of the translation model is evaluated by using BLUE values.

And according to the language selected by the user as a target language for translation, taking the Chinese text in the virtual emergency scene as the input of a translation model, and outputting the text of the target language by the model to replace the Chinese text in the virtual emergency scene.

Step 205: the user interacts with the virtual environment, the virtual emergency equipment and the virtual character model in the virtual emergency environment.

Step 206: by monitoring the interaction of the user, the completion degree of the key emergency treatment steps is recorded, and the mastering condition of the user on a certain emergency treatment skill is evaluated.

Step 207: and (4) collecting the interactive information, and feeding back the learning degree to the user through comparison with the correct emergency skill implementation step, and recording.

Further, as an implementation of the method shown in fig. 2 and fig. 3, the emergency training apparatus based on virtual reality equipment according to the present invention further provides a virtual emergency training system, that is, a virtual emergency training apparatus (an emergency knowledge popularization and emergency skill training apparatus) corresponding to the method shown in fig. 2 and fig. 3, which is capable of implementing all the contents of the embodiment of the method shown in fig. 2 and fig. 3 correspondingly, and is applied to an emergency training service, and specifically shown in fig. 4, the apparatus includes:

a model loading module (model design creation module) 301 for loading a specific 3D model and for creating a virtual 3D model, the virtual 3D model including at least a character model and an emergency equipment model.

A scene loading module (scene design making module) 302 for loading specific virtual emergency scenes and also for designing and making virtual emergency scenes, wherein the virtual emergency scenes at least comprise a virtual emergency implementation environment, a virtual emergency equipment model, a character model and an interactive system. The emergency implementation environment includes at least a home emergency environment, a public emergency environment, and a field emergency environment.

The translation module 303 is configured to translate the emergency knowledge text and the interactive information in the virtual emergency scene according to the target language of the user, and is further configured to translate the text in the virtual emergency scene to the target language according to the target language selected by the user. The translation model can at least realize the translation functions of Chinese to Vietnamese, Chinese to Kazakh and Chinese to English.

The monitoring module 304 is used for monitoring the interaction of the user in the virtual emergency scene, and also for monitoring all interactions in the virtual emergency scene, including monitoring the posture, the action and the change of the position of the character model when the character model interacts with the virtual emergency equipment model, monitoring the position and the change of the state of the virtual emergency equipment when the character model interacts with the virtual emergency implementation environment, monitoring the state, the position and the change of the action of the character model when the character model interacts with the virtual emergency implementation environment, monitoring the state and the change of the position of the emergency equipment when the virtual emergency equipment interacts with the virtual emergency implementation environment, monitoring the change of the virtual emergency implementation environment when the character model interacts with the virtual emergency implementation environment, and monitoring the interaction process after the user enters the virtual emergency scene to prompt the user in a vibration and a text way.

The evaluation module 305 is configured to evaluate the user mastery degree by comparing the interaction of the user in the virtual emergency scene with the preset steps for emergency skills, and is further configured to evaluate the user mastery degree by comparing the emergency knowledge points according to the interaction of the user in the virtual emergency scene.

A feedback module 306 for feeding back the first aid knowledge and the first aid skill mastering level (situation) to the user.

The virtual first aid training device (virtual first aid skill training device) further comprises a recording module for recording interaction records of the user in the virtual first aid scene with the first person scale.

Further, as shown in fig. 5, the model design making module 301 specifically includes:

a design unit 3011 for determining a desired character model and emergency equipment model based on emergency skills, wiring using a modeling tool such as 3DMAX, building a rough outline of the model, and generating a low model.

A thinning unit 3012 for introducing the low pattern with a small number of facets into a low pattern engraving tool such as ZBrush4R6, and then processing with reference to the real object to engrave a high pattern. Then, a special model topology software is used to topology the high modulus into the low modulus, obtaining a model that can be imported into the game engine.

And a mapping unit 3013, configured to perform normal mapping, UV mapping rendering, diffuse reflection mapping, and normal mapping comparison on the low-modulus obtained from the high-modulus topology.

And the action design unit 3014 is used to design basic actions of different character models, such as walking, running, squatting, pressing, pulling and the like.

The scene design making module 302 specifically includes:

a virtual emergency implementation environment rendering unit 3021, configured to preset a virtual emergency implementation environment based on an application scenario of emergency skills, and invoke execution when a user enters the virtual emergency implementation environment.

And a loading unit 3022, configured to invoke execution when the user enters a virtual emergency scenario, and load the relevant 3D model.

An interaction setting unit 3023 for setting specific actions and orders and system interactions based on the rescue skills.

The translation module 303 specifically includes:

the data collection unit 3031 is configured to collect the chinese corpus in the emergency field, submit a translation request to a translation website such as Goole translation and Baidu translation with the chinese text as a request content, receive the translation content in a response, and obtain parallel corpus of the chinese dimension, the chinese english, the chinese hassaxak, and the chinese russian by this method.

A checking unit 3032, configured to submit translation requests for translating chinese into the same language to different translation websites with chinese text as request content, receive response information, encode translation results of different translation websites by using a pre-trained sentence encoder of ***, and calculate similarities of different translation results by using pearson correlation coefficients. If the semantics of different translation results are very similar, receiving the translation results for constructing parallel corpora; otherwise, recording the Chinese and the translated text of the translation, and then carrying out manual inspection or translation.

A constructing unit 3033, configured to train the neural network translation model using the parallel corpus, and evaluate the translation quality of the translation model using the BLUE value.

And a translation unit 3034, configured to take the chinese text in the virtual emergency scene as an input of a translation model according to a language selected by the user as a target language for translation, where the model outputs the text in the target language to replace the chinese text in the virtual emergency scene.

The first recording unit 3035 is configured to record a target language currently selected by the user, automatically detect whether the target language of the user is a chinese language when the user enters the virtual emergency scene again, and automatically translate the text into the target language if the target language is not the chinese language.

The monitoring module 304 specifically includes:

a monitoring unit 3041, configured to monitor actions of the user in the virtual emergency scenario and other interactions with the system.

A second recording unit 3042 for recording the actions and sequence of the user in the virtual emergency scenario and other interactions with the system.

The evaluation module 305 specifically comprises a comparison unit 3051 and a third recording unit 3052. The comparison unit 3051 is configured to, when the user exits the virtual emergency scene, compare the result of the second recording unit in the monitoring module with the content preset in the action setting unit in the scene design and creation module, so as to evaluate the quality of the user emergency training with the degree of completion of the preset content.

The emergency training device (virtual emergency training device) comprises a processor, a memory, a sensor and a lens, wherein the model loading module, the scene loading module, the translation module, the monitoring module, the evaluation module, the feedback module and the like are stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions. Wherein the model and scene design are stored in the memory after the fabrication is completed.

The processor comprises a kernel, and the kernel calls the corresponding program unit from the memory. The kernel can be set to be one or more, the traditional pre-hospital emergency treatment mode is optimized by adjusting the kernel parameters and combining the information technology, the timeliness of pre-hospital emergency treatment is improved, reasonable allocation of emergency treatment resource utilization is realized, and the quality of pre-hospital emergency treatment is improved.

The invention also provides a storage medium on which a program is stored, wherein the program is executed by a processor to realize a pre-hospital emergency method.

The invention also provides a processor, which is used for running a program, wherein the program runs to execute a pre-hospital emergency method.

The invention provides an emergency training device based on virtual reality equipment, and also provides electronic equipment, as shown in fig. 6, the equipment comprises at least one processor 501, at least one memory 502 connected with the processor 501, a bus 503, a sensor 504, a lens 505 and an input device 506; the processor 501, the memory 502, the sensor 504, the lens 505 and the input device 506 are communicated with each other through the bus 503; processor 501 is used to call program instructions in memory 502 to perform a pre-hospital emergency method.

The device in the invention can be a VR head display or the like.

In addition, the invention also provides a first-aid knowledge popularization and first-aid skill training system which comprises a data collection unit 3031 and an inspection unit 3032 in the translation module 303.

The present invention also provides an electronic device, the device at least comprising: the system comprises a memory, a processor, a lens, a sensor, an input device (a display card) and a program which is stored on the memory and can run on the processor, wherein when the processor executes the program, the method for popularizing emergency knowledge and training emergency skill by using a virtual technology and a machine translation model is realized.

Wherein, the processor and the memory are communicated with each other through the bus.

The processor is to call program instructions in the memory to perform a pre-hospital emergency method.

The invention also provides a computer readable storage medium, on which a computer program is stored, which when running implements a method for first aid knowledge popularization and first aid skill training using virtual techniques and machine translation models.

Fig. 7 is a flowchart of an embodiment of the emergency training method based on virtual reality equipment. Referring to fig. 7, the emergency training method based on virtual reality equipment is applied to the emergency training apparatus based on virtual reality equipment according to the embodiment of the emergency training apparatus based on virtual reality equipment of the present invention, and the emergency training method based on virtual reality equipment includes:

step S1: acquiring various virtual first-aid scenes; the virtual emergency scene is acquired based on the VR head display.

Step S2: acquiring an operation action; the operation action is acquired based on the handle.

Step S3: and acquiring the change of the virtual character model and the virtual emergency equipment model in the virtual emergency scene according to the operation action.

Step S4: and judging whether the emergency process is correct or not according to the change of the virtual character model and the virtual emergency equipment model.

In the emergency process, namely the emergency operation executed by the user through the handle, the virtual character model and the virtual emergency equipment model are changed in the emergency process, and the change is the executed emergency operation.

If the output of the step S4 is YES, execute the step S5: and displaying that the operation action is correct.

If the output of the step S4 is no, execute step S6: sending a vibration signal and displaying an error prompt; the vibration signal is used for vibrating the handle; the error prompt is for display in a virtual emergency scenario.

The display operation action is also displayed in the virtual emergency scene.

Wherein, step S4 specifically includes:

and comparing the change of the virtual character model with the change of a preset virtual character model, and comparing the change of the virtual emergency equipment model with the change of the preset virtual emergency equipment model to obtain a comparison result.

And if the comparison result is the same, determining that the emergency process is correct.

The invention provides a novel emergency training method and a novel emergency training device, namely a method, a device and a system for emergency knowledge popularization and emergency ability training, relates to the field of public health safety knowledge popularization and the field of machine translation, optimizes the existing emergency knowledge popularization and emergency skill training mode by combining virtual reality and machine translation technologies, improves the awareness of social groups to emergency knowledge and the mastering degree of emergency skills, is beneficial to a first witness in an emergency scene to quickly and correctly carry out emergency actions before an ambulance arrives at the emergency scene, and reduces the death rate of emergency accidents. As shown in FIG. 8, the novel emergency training method of the invention designs and manufactures virtual 3D models (the virtual 3D models at least comprise character models and emergency equipment models), virtual emergency scenes (the virtual emergency scenes at least comprise square emergency scenes, family emergency scenes and field emergency scenes), interaction of the virtual emergency scenes and the models, and designs and realizes a virtual emergency scene interaction supervision system (the virtual emergency scene interaction supervision system at least comprises actions of a supervision character model, interaction logics of the supervision character model and a virtual environment, interaction logics of the supervision character model and the emergency equipment models and positions of the supervision models in the virtual environment), translates the virtual emergency scenes according to a user target language, takes texts in the virtual environment as model input, the translation models output texts in different languages according to actual needs, and at least can realize language from Chinese to Viburni, the translation function from Chinese to Kazakstan and from Chinese to English highlights the existing extensive first-aid knowledge through an interactive virtual first-aid scene, and a user learns the first-aid knowledge in immersive experience and masters the first-aid skill; the user enters a specific emergency scene by wearing the virtual display equipment, and the purposes of learning emergency knowledge and emergency skills are achieved by selecting different languages and virtual environments for interaction.

The invention can be widely applied to social first-aid knowledge popularization and first-aid skill popularization. The invention mainly aims to make full use of the advantages of a virtual reality technology in simulating a real emergency scene and the advantages of a machine translation technology in multilingual translation compared with manual translation, construct a multilingual virtual emergency scene based on emergency skills, provide immersive experience for emergency skill learners, enable the learners to accept emergency skill training more economically and conveniently, further master emergency knowledge and emergency skills, break language barriers in emergency training, and provide a platform for learning emergency knowledge and exercising emergency skills for more people.

Compared with the prior art, the invention has at least the following advantages:

on the one hand, the user can be provided with the maximum learning freedom, and the user can select the emergency training content according to personal interests or family actual conditions at a proper place without being limited to the emergency training place and emergency schedule. Meanwhile, the problems of high cost of organization training activities, poor training effect, purchase of emergency training equipment, maintenance cost and the like of the existing emergency skill training mechanism are solved.

On the other hand, the beneficial population of the invention is wider. In the invention, considering the situations that the rural multi-nationality residences such as Sinkiang, Tibet and the like are gathered, the Putonghua popularization rate is low, and the existing training mode is difficult to develop, a machine translation model is constructed aiming at the same virtual emergency scene, and according to the target language selected by a user, the Chinese text in the virtual emergency scene is translated into the emergency training resource of the target language version, so that the problem of weak rural emergency strength is relieved, and the popularization degree of emergency knowledge and emergency skills is greatly improved.

Finally, the user experience of the invention is better. The key point of the invention is to fully utilize the advantages of the virtual reality technology in the simulation reality of the emergency scene, so that a user can learn the emergency skills in the virtual emergency scene in a first person manner and practice and use the emergency skills without limitation. Immersive experience is easier and more easily accepted compared with offline emergency training. Meanwhile, the user can exercise for multiple times in the virtual emergency scene, and the training effect is better.

The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

The principles and embodiments of the present invention have been described herein using specific examples, which are provided only to help understand the method and the core concept of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed. In view of the above, the present disclosure should not be construed as limiting the invention.

Claims

1. An emergency training device based on virtual reality equipment, which is characterized by comprising a VR head display and a handle;

2. The virtual reality equipment-based emergency training apparatus as recited in claim 1, wherein a plurality of virtual emergency scenarios are constructed based on a 3D modeling tool and Unity 3D.

3. The virtual reality device-based emergency training apparatus of claim 1, wherein the plurality of virtual emergency scenarios comprises a virtual home emergency scenario, a virtual public place emergency scenario, a virtual field emergency scenario, a virtual emergency binder scenario, and a virtual medical office emergency scenario.

4. The virtual reality equipment-based emergency training apparatus of claim 1, wherein the virtual emergency equipment model comprises a public place deployed emergency equipment model; the first aid equipment models deployed in public places include an automated external defibrillator model, a family first aid kit model, and an ambulance model.

5. The virtual reality device-based emergency training apparatus as claimed in claim 1, wherein the change of the virtual character model includes a posture change of the virtual character model, a motion change of the virtual character model, a position change of the virtual character model, and a state change of the virtual character model.

6. The virtual reality equipment-based emergency training apparatus as recited in claim 1, wherein the changes to the virtual emergency equipment model include changes in position of the virtual emergency equipment model and changes in state of the virtual emergency equipment model.

7. The virtual reality device-based emergency training apparatus of claim 1, wherein the VR headset has a language pack implanted therein; the language package is designed and manufactured by utilizing a machine translation model; the language pack is used for performing language conversion on the text information displayed in the virtual emergency scene.

8. A method for emergency training based on virtual reality equipment, which is applied to the device of any one of claims 1-7, and is characterized in that the method comprises the following steps:

if yes, displaying that the operation action is correct;

9. The method for training first aid based on virtual reality equipment according to claim 8, wherein the determining whether the first aid process is correct according to the changes of the virtual character model and the virtual first aid equipment model specifically comprises: