A kind of medical simulation training system and method
Technical field
The present invention relates to technical field of virtual reality, and in particular to a kind of medical simulation training system and method.
Background technology
In medical domain, traditional medical simulation training for example, surgical operation practical operation teaching is very simple and crude, substantially less than
Clinical practice level, some medical colleges and schools and hospital are imparted knowledge to students using simulated organ rubber, are broadcast by the demonstration of operation video
Put, explained using organ sample in kind, autopsy teaching, and the form such as expert's surgery observation, for surgical training,
The teaching links such as the medical science such as preview, clinical diagnosis, remote operation, rehabilitation of performing the operation auxiliary.
This method there are many deficiencies:1st, simulated organ is imparted knowledge to students, the easy aging of itself rubber material, using excessive
It is accomplished by changing after secondary, the price of rubber organ is higher, often changes teaching aid and considerably increase instruction cost.2nd, it is autopsied
Teaching, student is imparted knowledge to students by being autopsied under lab, this human dissection teaching method, and often cost is high, and corpse
There is larger gap with live body, it is impossible to which playing makes student complete directly perceived, easily study and hands-on.3rd, expert's surgery observation shape
Formula, is understood by a variety of sense organs such as audiovisual tactile and learns various operation practical operations, for young doctor or intern
For, it can not in person operate and be compared in time with expert's operating method, discover one's mistakes and not enough, undoubtedly cause training
Instruct young medical staff and waste mint of money and time, it is impossible to obtain good effect of undergoing training, also severely impact exercise effect
Rate.
In summary, existing medical simulation training technique scheme, training cost is higher, training effect is not good and efficiency compared with
It is low.
The content of the invention
The invention provides a kind of medical simulation training system and method, instructed with solving existing medical simulation in the prior art
Practice technical scheme, training cost is higher, the not good and less efficient technical problem of training effect.
According to an aspect of the invention, there is provided system described in a kind of medical simulation training system includes:
Object model structure module, the three-dimensional stereo model data for gathering human body privileged site, and based on collection
Three-dimensional stereo model data build corresponding three dimensional virtual models object, and the three dimensional virtual models object of structure is sent to model
Database;
Model database, for storing three dimensional virtual models object data;
Sensor tracing module, the real-time position of institute's holder tool is gathered for the sensor by being set on user institute holder tool
The sensor tracking put in data and pressure data, and the three-dimensional stereo model acted on by the apparatus gathers 3 D stereo mould
The position data and pressure data of type;
Data processing module, the position data and pressure data gathered to sensor tracing module is handled, and obtains three
Tie up three-dimensional model shape data and user to the peration data of three-dimensional stereo model, and by the shape number of three-dimensional stereo model
According to this and user is exported to the peration data of three-dimensional stereo model to image generation module;
Image generation module, according to the operand of the shape data of three-dimensional stereo model and user to three-dimensional stereo model
Include the three-dimensional virtual image of simulated operation object information according to generation, the three-dimensional virtual image of generation is sent to display module;
Display module, simulated operation result is checked for display output three-dimensional virtual image for user.
According to another aspect of the present invention there is provided a kind of medical simulation training method, method includes:
Gather the three-dimensional stereo model data of human body privileged site, and the structure pair of the three-dimensional stereo model data based on collection
The three dimensional virtual models object answered;
Store the three dimensional virtual models object built;
By the sensor that is set on user institute holder tool gather the real time position data and pressure data of institute's holder tool with
And the sensor tracking in the three-dimensional stereo model acted on by the apparatus gathers the position data and pressure of three-dimensional stereo model
Data;
Position data and pressure data to collection are handled, and obtain shape data and the user of three-dimensional stereo model
To the peration data of three-dimensional stereo model;
Peration data generation according to the shape data of three-dimensional stereo model and user to three-dimensional stereo model includes mould
Intend the three-dimensional virtual image of operation result information;
Display output three-dimensional virtual image, simulated operation result is checked for user.
The beneficial effect of the embodiment of the present invention is:This medical simulation training system and method for the embodiment of the present invention, profit
The three-dimensional stereo model data of human body privileged site are gathered with virtual reality technology and dummy model object is built, and receive user couple
The peration data of three-dimensional stereo model and by generating corresponding virtual reality image according to peration data, by the virtual existing of generation
Real image is presented in virtual reality display device, facilitates user to watch operating result.Thus, by being operated in realistic space
Apparatus and operation object on sensor is set, the peration data of collection user, and makes corresponding three-dimension virtual reality in real time
Image, provides the user simulation tactilely-perceptible and analog vision is perceived, and improves the feeling of immersion of user, interactivity is strong.Can directly it adopt
Collect peration data and real-time update, true feedback operation result improves training effect.Meet medical educational and operation training
Need, and simply, it is efficient, easily operated, facilitate clinical expansion and popularization, with higher application value.
Brief description of the drawings
Fig. 1 is a kind of structured flowchart of medical simulation training system of one embodiment of the invention;
Fig. 2 is a kind of structured flowchart of intravenous injection simulated training system of one embodiment of the invention;
Fig. 3 is a kind of structured flowchart of surgical simulators training system of one embodiment of the invention;
Fig. 4 is a kind of flow chart of medical simulation training method of one embodiment of the invention.
Embodiment
Virtual reality (Virtual Reality) technology, also referred to as virtual reality is the new technology quickly grown in recent years.It is empty
It is on vision, the sense of hearing, tactile etc. using the virtual world of computer simulation one three dimensions of generation there is provided user to intend reality
The simulation of sense organ, allows user as being personally on the scene, and the things in three-dimensional space can be observed in time, without limitation.Should
Technology is using series of computation machine related science technologies such as computer graphics, human-computer interaction technology, 3D modelings, by existing
The simulation of the real space, and behavior (such as body movement, head rotation) of the sensing people in virtual environment, and to its behavior in time
Timely fed back, so as to simulate real scene to greatest extent.
The design concept of the present invention is:Virtual reality technology is trained applied to medical simulation, passes through virtual reality skill
Art, generates the 3-D view of Virtual Space, and 3 D stereo mould of the collection user to human body privileged site in real world in real time
The peration data of type, operating result data is calculated according to real time operating data, and by operating result data and dummy model object
Superposition, so that the virtual image including operating result data is generated, and display output is checked to user for user.So there is provided
The simulation of the sense organ such as user's vision and tactile, allows user as being personally on the scene, and in time, observes three dimensions without limitation
Interior model object, improves the effect of medical training, and need not buy the training equipment of costliness, saves cost.
Embodiment one
Fig. 1 is a kind of structured flowchart of medical simulation training system of one embodiment of the invention, referring to Fig. 1, this implementation
Example medical simulation training system 10 includes:
Object model builds module 101, the three-dimensional stereo model data for gathering human body privileged site, and is based on collection
Three-dimensional stereo model data build corresponding three dimensional virtual models object, the three dimensional virtual models object of structure is sent to mould
Type database 104;
Model database 104, for storing three dimensional virtual models object data;
Sensor tracing module 103, the reality of institute's holder tool is gathered for the sensor by being set on user institute holder tool
When position data and pressure data, and the three-dimensional stereo model acted on by the apparatus in sensor tracking collection it is three-dimensional vertical
The position data and pressure data of body Model;
Data processing module 102, the data to collection are handled, and obtain the shape data and use of three-dimensional stereo model
Family is to the peration data of three-dimensional stereo model, and by the shape data of three-dimensional stereo model and user to three-dimensional stereo model
Peration data is exported to image generation module 105;
Image generation module 105, according to the behaviour of the shape data of three-dimensional stereo model and user to three-dimensional stereo model
Making data generation includes the three-dimensional virtual image of simulated operation object information, and the three-dimensional virtual image of generation is sent into display mould
Block 106;
Display module 106, simulated operation result is checked for display output three-dimensional virtual image for user.
Understand as shown in Figure 1, the medical simulation training system based on virtual reality of the present embodiment, it is special by gathering human body
Determine the three-dimensional stereo model data at position, and the three-dimensional stereo model data based on collection build corresponding three dimensional virtual models pair
As the three dimensional virtual models object of structure being sent to model database, then user can be to the three-dimensional in model database
Dummy model object is selected, using virtual reality technology, when user in real world the apparatus such as operation knife to three
When dimension three-dimensional model is operated, the peration data of each step can pass through the sensor on the apparatuses such as scalpel and three-dimensional
Sensor on three-dimensional model is collected, and these data collected are sent to data processing module, data processing module meter
Calculate and identify each step peration data of user (for example, operating force data, operate the position of bearing data and operation
Data etc.), image generation unit is then sent to, image generation unit generates corresponding three-dimensional manipulating result according to peration data
Image, then by the display of three dimensional display, user is that each step can be seen to operate the operating result on dummy model object,
Improve the effect of medical training and reduce training cost, facilitate large-scale promotion application.
In one embodiment of the invention, image generation module 105, specifically for the shape according to three-dimensional stereo model
Data, identify the corresponding three-dimensional stereo model of shape data in model database set in advance, and according to user to three
The peration data of three-dimensional model is tieed up, calls 3-D view to handle storehouse, generation includes the 3-D view of simulated operation object information.
Object model builds module 101 in one embodiment of the invention, for gathering human arm and internal organs
Three-dimensional stereo model data, and the human arm based on collection and internal organs three-dimensional stereo model data build human body hand
The corresponding three dimensional virtual models object of arm, and the corresponding three dimensional virtual models object of each internal organs.
User institute holder tool includes in one embodiment of the invention:Virtual reality scalpel or virtual reality injection
Device, sensor tracing module 103 for gathering the real time position data of user institute holder tool by position sensor, and passes through
The real-time operation position data of the three-dimensional stereo model of position sensor collection apparatus effect;And, adopted by pressure sensor
Collect the real-time pressure data of user institute holder tool, and the real-time of the three-dimensional stereo model that apparatus is acted on is gathered by pressure sensor
Pressure data.
In one embodiment of the invention, camera is provided with display module 106, for following the trail of user eyeball fortune
It is dynamic, or, acceleration transducer is provided with display module, for gathering the head that user's head exercise data tracks user in real time
Portion is moved, and determines according to eye movement or head movement the viewpoint of user in real time,
When receiving the three-dimensional virtual image of the transmission of image generation module 105, according to regarding for the user determined in real time
Point, adjusts the display output position of three-dimensional virtual image.Display module 106 is virtual reality in one embodiment of the invention
Glasses or virtual implementing helmet.
In one embodiment of the invention, image generation module 105 is additionally operable to according to virtual reality glasses or virtual existing
The optical characteristics of eyeglass in the real helmet, before three-dimensional virtual image to virtual reality glasses or virtual implementing helmet are sent,
Distortion correction is carried out to three-dimensional virtual image.
This medical simulation based on virtual reality of the present invention is trained below in conjunction with two specific application scenarios and is
System structure is specifically described.The two specific application scenarios are respectively:The simulated training of surgical operation and nursing vein note
Penetrate simulated training.
Embodiment two
The nursing intravenous injection simulated training based on virtual reality is provided in the present embodiment, specifically, based on virtual existing
Real intravenous injection simulated training system needs to use following instrument when applying:
It is injected intravenously simulated training arm three-dimensional stereo model, i.e. the object of user's operation;
Syringe, i.e. user institute holder tool;
Computer, computer is used for model data store and data processing, image generation, data transfer etc.;
VR display devices (such as VR glasses), for display virtual real 3-D view.
The principle that intravenous injection simulated training system based on virtual reality is realized is:In arm three-dimensional stereo model internal model
Intend blood vessel (or intramuscular injection region) placement sensor, gather Vessels of hand tendency dynamic data, the data to collection collect
Middle storage.Vessels of hand tendency dynamic data can be classified according to different age group in the present embodiment, the data to collection are entered
Row is centrally stored, builds complete arm physiological metabolism model database, and intramuscular injection region in model and important blood vessels are set
The data collected are reached in VR glasses, then virtually noted by programming realization once touching by sensor, all sensors
The object model of operation is penetrated, operator is by wearing 3D glasses in virtual reality space to arm models progress intravenous injection mould
Intend, in addition, skin histology fat thickness, blood vessel thickness freely can also switch in model database, pass through sensor
The tactile being connected, vein (muscle) injection effect is truly fed back to VR glasses.The technical scheme feeling of immersion of the embodiment of the present invention
By force, interactivity is strong, and simply, it is efficient, easily operated.
Fig. 2 is a kind of structured flowchart of intravenous injection simulated training system of one embodiment of the invention, referring to Fig. 2, sheet
The intravenous injection simulated training system 20 of embodiment includes:
Object model construction unit 201, arm three-dimensional stereo model data are gathered using virtual reality technology, set one
Meeting in the virtual three-dimensional arm models of situation, the computer that deposit object model construction unit 201 is run is used to simulate behaviour
Make.In addition, 3D models can also be supplied to 3D Application Program Interfaces, for vein (muscle) injection side in actual application
The design of case.
Data processing unit 202, the data transmitted for processing data transmission unit 204, and obtain information therein:Example
Such as:User view information Viewport, operation object positional information Position, action message Motion, the letter that will identify that
Breath passes to the generation that image generation unit 203 carries out three-dimensional virtual image, and virtual scene is generated according to corresponding injection operation.
Wherein, view information Viewport, can be gathered in the following way:Camera is provided with VR helmets to enter
The tracking of row user eyeball motion, the viewpoint of user is determined according to the motion of eyeball.
When user, which wears the VR helmets, is in intravenous injection simulated training virtual scene, human arm model is utilized
On sensor sensing, sensor sensing on syringe recognize the action of user, action command is transferred to the number of computer
According in processing unit.
Image generation unit 203, receives the view information, positional information, movable information of the transmission of data processing unit 202
Deng, and information is handled, shape (contour of object) information of the three-dimensional stereo model of user's operation is extracted, then pre-
The corresponding object model data of the object-by shape information are identified in the model database first set, and call 3D rendering to handle storehouse
(for example, OpenGL or Direct3D), the generation for carrying out the structure and 3-D view of threedimensional model is rendered.
OpenGL (Open Graphics Library) refers to that define one connects across programming language, cross-platform programming
The professional graphic package interface of mouthful specification, it is used for 3-D view (two-dimentional also can), is that One function is powerful, calls conveniently
Underlying graphics storehouse.
Direct 3D are the 3D figure API of the general object pattern COM (Common Object Mode) based on Microsoft,
The bottom operation that graphical display interface (GDI) is directly supported the various hardware of the API is can bypass, the speed of service is improved, fitted
Close the extensive and practical 3D graphics calculations such as multimedia, amusement, instant 3D animations.
Data transmission unit 204, the information that real-time reception object sensing tracing unit 206 is sent, and be sent at data
Reason unit 202 is handled, and (note, syringe here is the equipment in equipment access unit to tracking syringe, i.e. syringe is needed
It is linked into computer and is communicated with data transmission unit, data transfer list is given by the sensor data transmission in syringe
Member so that data transmission unit transmits these information to data processing unit) operation information, pass to data processing unit and enter
Row processing, for generation three-dimensional virtual image.
Data processing unit is settable in a computer, and the computer provides equipment access interface and facilitates syringe and three-dimensional
Subject sensor tracing unit 206 transmits data in three-dimensional model.
Subject sensor tracing unit 206, is arranged in arm three-dimensional stereo model and syringe, during practical operation, by
Multiple sensors are distributed in arm three-dimensional stereo model and syringe, once the blood on syringe insertion arm three-dimensional stereo model
Pipe, the information that data processing unit is provided according to sensor in syringe and arm three-dimensional stereo model sensor determines user
Whether current operation is correct, if the operation of user currently is incorrect, current operation data is reached after VR display devices, VR
Angiorrhoxis bleeding is presented in display device immediately, and red and swollen three-dimensional virtual image reaches most true simulation effect.In addition,
Various form arms simulation effect data can be stored to the model database of computer, it is standby when practising for user.
Here sensor includes:Position sensor and pressure sensor, during practical application, are gathered by position sensor
The real time position data of user institute holder tool, and the real-time behaviour of the three-dimensional stereo model acted on by position sensor collection apparatus
Make position data;And, the real-time pressure data of user institute holder tool is gathered by pressure sensor, and pass through pressure sensor
Gather the real-time pressure data of the three-dimensional stereo model of apparatus effect.
Display unit 207, for receiving the 3D rendering data of the generation of image generation unit 203 and being shown in display device
In, such as VR glasses, user can check operation simulation effect by wearing VR glasses on virtual reality interactive operation platform;This
In VR glasses can be replaced the VR helmets, it is without limitation.
Alternatively, the intravenous injection simulated training system based on virtual reality of the present embodiment also includes:Authentication unit
205, authentication unit is pressed according to the peration data of user, the number of times of recording user operation mistake, the then operation to user
Operation according to the weight assignment and work quantity evaluation information set in model database to user is scored and graded, for subsequently looking into
See and refer to, improve operation success rate.
The specific work process bag of the intravenous injection simulated training system based on virtual reality technology of the embodiment of the present invention
Include:
Start the intravenous injection simulated training system based on virtual reality technology, into initial work, user can select
Select operation object (that is, specific human arm model).
Step 201:User picks up syringe and operated, the incoming positional information of subject sensor tracing unit 206 and dynamic
Make information, in real time sensing, data processing unit 202 carries out the work such as gesture identification, according to the corresponding operating identified, notifies figure
As generation unit 203 generates 3-D view.
Step 202:In injection manipulation, subject sensor tracing unit 207 is handed over data transmission unit 204
Mutually track injection operation and obtain injection operation information, and pass to data processing unit 202 and handled.Further, it is also possible to by institute
The data collected periodically send and update request to subject sensor tracing unit 207, so as to follow the trail of single from subject sensor
Newest data are obtained in member 207, to gather the action command of user, user's operation information are precisely collected.
Step 203:The data that the processing data transmission unit 204 of data processing unit 202 is transmitted, and in user to real empty
Between in arm three-dimensional stereo model perform injection operation after, image generation unit 203 start computer in virtual environment son
Program and the data for calling arm three dimensional virtual models, make three dimensional virtual models carry out the action command of operator anti-in time
Feedback, so that simulated injection operating result is presented in into user at the moment.
Step 204:After the completion of being operated by simulated injection, according to time of the total degree of the operation of record and operating mistake
It is several that simulated injection operation is evaluated, get and refer to score value.
Compared with existing intravenous injection model, the present embodiment has repeatable utilization rate height, cost low, vein simulating degree
High, venipuncture analog result intuitively advantage, it is few to solve medical worker's venipuncture opportunity to study such as nurse, operates not yet done
The problems such as practicing.Instruction cost and medical-risk are reduced, training resource has been saved, improved the quality of teaching, and simply, efficiently, easily
In operation, facilitate clinical expansion and popularization, with higher application value and meaning.
Embodiment three
The surgical simulators training system based on virtual reality is provided in the present embodiment.Specifically, based on virtual existing
Real surgical simulators training system needs to use following instrument when applying:
(1) Virtual Reality scalpel (alternatively also include surgical glove), here VR surgical kits contain sensor, can be with
Data acquisition and action induction are carried out using sensor, to carry out gesture identification, the surgical action of user is identified.Here biography
Sensor includes:Position sensor and pressure sensor, during practical application, the reality of user institute holder tool is gathered by position sensor
When position data, and by position sensor gather apparatus act on three-dimensional stereo model real-time operation position data;And,
The real-time pressure data of user institute holder tool is gathered by pressure sensor, and apparatus is acted on three are gathered by pressure sensor
Tie up the real-time pressure data of three-dimensional model.
(2) surgical object (i.e. human body certain organs three-dimensional stereo model), system can preset human body three-dimensional tridimensional
Model data, for user select human organ three-dimensional model as surgical object, and the model organ main positions with
And major multiple sensors of vascular distribution.In this way, in user's operating process, once scalpel touches some blood vessel, then passing
Sensor will send induction information and carry out further Data Analysis Services to data processing unit.
(3) computer, computer is used for implementation model data storage and data processing, image generation, data transfer etc.
Function;
(4) VR display devices (such as VR glasses or the VR helmets), for display virtual real 3-D view.
Virtual technology is applied to surgical simulators training by the present invention has three big advantages:First, physiology is truly presented
Dynamic process is metabolized, different age group organ metabolite data speed, altitude simulation surgical site is adjusted.Second, it is anti-in real time
Advances of operative technique is presented, the surgical outcome of operator is answered using model sense Sense of Technology, surgical procedure is truly fed back, it is good to be that operator establishes
Good practical operation technology, improves success rate of operation.3rd, reduce clinical operation instruction cost.
Fig. 3 is a kind of structured flowchart of surgical simulators training system of one embodiment of the invention, referring to Fig. 3, should
Surgical simulators training system 30 includes:
Viewpoint determining unit 301, viewpoint determining unit here includes two subelements, is that eye movement tracking is true respectively
Determine viewpoint subelement and head movement tracking determines viewpoint subelement, in virtual reality display device, for example, being set in the VR helmets
Camera is put, eyeball tracking is carried out using camera, the current viewpoint of user is determined according to the real-time motion data of user eyeball;
Or, camera and specific sensor (for example, acceleration transducer) are set in the VR helmets, head movement position is carried out
Follow the trail of, so that it is determined that viewpoint.It should be noted that the mode of the determination viewpoint of the present embodiment can be using prior art come real
Now, thus in more detailed implementation the present embodiment relating to how to determine viewpoint explanation is not repeated, reference can be made to existing skill
Associated description in art.
Surgical object model 302, surgical object model here is that the graphics processing unit in computer is selected according to user
The human organ three-dimensional model correspondence generation selected.For example, user have selected a lung organ model progress in realistic space
Surgical operation, then, image generation unit in the surgical simulators training system based on virtual reality of the present embodiment is from hand
The model data of corresponding lung organ is selected in art model database, three dimensional virtual models are built, and it is aobvious to be presented on virtual reality
Show in equipment.
Hand motion collecting unit 303, hand motion collecting unit here is i.e. using on scalpel or surgical glove
Sensor completes the collection of user's hand motion, for example, the position that user's hand is presently in, the directional information of user's operation,
Dynamics information etc., the information of the sensor collection in the three-dimensional stereo model of these information and human body privileged site
Determine the position of the surgical object model of user's operation.Example is connected, user currently carries out surgical operation to lung organ, then existing
Sensor collection user on 3 D stereo lung organ model in the real space holds whether scalpel contacts the lung organ
On blood vessel, if contact, then sensor can collect this data immediately and this peration data is sent into data
Processing unit, is then sent to image generation unit, image generation unit is according to user couple after data processing unit progress data
The operation of blood vessel, generates corresponding virtual reality 3-D view, is presented on user at the moment.
Surgery models database 304, the organ model for the various human body privileged sites that are stored with surgery models database
Data, are selected for user.
Data processing unit 305, data processing unit utilize in organ (e.g., lung) model multiple sensors for being distributed with
And the data for the sensor transmissions being distributed on scalpel carry out Data Analysis Services.Once scalpel touches sensor corresponding positions
Put, the information provided according to sensor determine current procedure operation it is whether correct, sensor sensing to data reach the data
Processing unit carries out data analysis:For example, once touching pulmonary vascular, data processing unit knows the operation for touching blood vessel
Data, are sent to image generation unit, and image generation unit, which generates the 3-D view of angiorrhoxis and is sent to display unit, is in
It is existing.
Image generation unit 306, for generating three-dimensional organ model, and according to the transmission of data processing unit 305
Data generate and rendered corresponding three-dimensional virtual image.
Further, since in VR helmets eyeglass optical characteristics (being concavees lens, pattern distortion can be produced during display),
The image of 306 pairs of generations of image generation unit enters line distortion processing in the present embodiment, i.e., sent out by the three-dimensional virtual image of generation
Give and distortion correction is carried out to image before display unit, to reach expected display effect.
Virtual reality display unit 307, for being shown to the three-dimensional virtual image that image generation unit 306 is generated,
User sees the simulated operation effect and VR surgical scenes of true operation by wearing the virtual reality display unit 307.
The specific work process bag of the surgical simulators training system based on virtual reality technology of the embodiment of the present invention
Include:
Step 301:User puts on VR helmets, picks up scalpel.
Step 302:Surgical object of the graphics processing unit in realistic space in computer generates corresponding operation
The incoming VR display devices of dummy model image.
Step 303:User is operated, and carries out surgical action identification.
Step 304:VR helmets judge that user's head position or the eyeball to user are tracked, and determine viewpoint.
Step 305:In operative process, the sensor sensing user on scalpel and human body stereo threedimensional model is held
Scalpel is fed back to the surgical cut point of surgical object.
Step 306:Incoming VR helmets after 3-D view generation are carried out according to feedack to show.
So far, the surgical simulators training system based on virtual reality technology of the present embodiment passes through virtual reality technology
There is provided vision, touching simulation to perceive, simulate real operation technique, interactivity is strong.Instruction cost and medical-risk are reduced, is saved
About medical training resource, improves quality of instruction, and simply, it is efficient, easily operated, conveniently popularize.
Example IV
Fig. 4 is a kind of flow chart of medical simulation training method of one embodiment of the invention.Referring to Fig. 4, the present embodiment
The medical simulation training method based on virtual reality comprise the following steps:
Step S401, gathers the three-dimensional stereo model data of human body privileged site, and the three-dimensional stereo model based on collection
Data build corresponding three dimensional virtual models object, store the three dimensional virtual models object built;
Step S402, the real time position data and pressure of institute's holder tool are gathered by the sensor set on user institute holder tool
Sensor tracking in force data and the three-dimensional stereo model acted on by the apparatus gathers the positional number of three-dimensional stereo model
According to and pressure data;
Step S403, position data and pressure data to collection are handled, and obtain the shape number of three-dimensional stereo model
According to this and user is to the peration data of three-dimensional stereo model;
Step S404, gives birth to according to the shape data of three-dimensional stereo model and user to the peration data of three-dimensional stereo model
Into including the three-dimensional virtual image of simulated operation object information;
Step S405, display output three-dimensional virtual image checks simulated operation result for user.
In one embodiment of the invention, step S404, according to the shape data of three-dimensional stereo model and user
The three-dimensional virtual image that peration data generation includes simulated operation object information includes:
According to the shape data of three-dimensional stereo model, shape data correspondence is identified in model database set in advance
Three-dimensional stereo model, and according to peration data of the user to three-dimensional stereo model, call 3-D view to handle storehouse, generation includes
The 3-D view of simulated operation object information.
In one embodiment of the invention, step S401, gathers the three-dimensional stereo model packet of human body privileged site
Include:
The three-dimensional stereo model data of human arm and internal organs are gathered,
User institute holder tool includes:Virtual reality scalpel or virtual reality syringe,
Sensor in the three-dimensional stereo model acted on by the sensor set on user institute holder tool and the apparatus
Tracking collection user includes to the peration data of three-dimensional stereo model:
The real time position data of user institute holder tool is gathered by position sensor, and apparatus is gathered by position sensor
The real-time operation position data of the three-dimensional stereo model of effect;And, the reality of user institute holder tool is gathered by pressure sensor
When pressure data, and by pressure sensor gather apparatus act on three-dimensional stereo model real-time pressure data.
In one embodiment of the invention, method further comprises shown in Fig. 4:User eyeball motion is followed the trail of, or, it is real
When collection user's head exercise data track the head movement of user, and determined according to eye movement or head movement to use in real time
The viewpoint at family, when receiving three-dimensional virtual image, according to the viewpoint of the user determined in real time, adjustment three-dimensional virtual image
Display output position.
Display output three-dimensional virtual image includes three-dimensional empty by virtual reality glasses or virtual implementing helmet display output
Intend image.
Step S404 in one embodiment of the invention, according to the shape data of three-dimensional stereo model and the behaviour of user
Make data generation and include the three-dimensional virtual image of simulated operation object information also to include:According to virtual reality glasses or virtual reality
The optical characteristics of eyeglass in the helmet is right before three-dimensional virtual image to virtual reality glasses or virtual implementing helmet are sent
Three-dimensional virtual image carries out distortion correction.
In summary, the medical simulation training method of the present embodiment, human body privileged site is gathered using virtual reality technology
Three-dimensional stereo model data and build dummy model object, receive user to the peration data of three-dimensional stereo model and pass through root
Corresponding virtual reality image is generated according to peration data, the virtual reality image of generation is presented on virtual reality display device
In, facilitate user to watch operating result.Thus, sensed by being set on the apparatus and operation object that are operated in realistic space
The peration data of device, in real time collection user, and corresponding three-dimensional virtual reality map picture is made, provide the user simulation tactilely-perceptible
Perceived with analog vision, improve the feeling of immersion of user, interactivity is strong.Can directly acquisition operations data and real-time update, it is true anti-
Operating result is presented, training effect is improved.The need for meeting medical educational and operation training, and simply, it is efficient, easily operated,
Facilitate clinical expansion and popularization, with higher application value.
The foregoing is only a specific embodiment of the invention, under the above-mentioned teaching of the present invention, those skilled in the art
Other improvement or deformation can be carried out on the basis of above-described embodiment.It will be understood by those skilled in the art that above-mentioned tool
The purpose of the present invention is simply preferably explained in body description, and protection scope of the present invention is defined by scope of the claims.