CN106293082A - A kind of human dissection interactive system based on virtual reality - Google Patents
A kind of human dissection interactive system based on virtual reality Download PDFInfo
- Publication number
- CN106293082A CN106293082A CN201610634221.3A CN201610634221A CN106293082A CN 106293082 A CN106293082 A CN 106293082A CN 201610634221 A CN201610634221 A CN 201610634221A CN 106293082 A CN106293082 A CN 106293082A
- Authority
- CN
- China
- Prior art keywords
- model
- human
- user
- virtual reality
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/08—Volume rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/21—Collision detection, intersection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Graphics (AREA)
- Human Computer Interaction (AREA)
- Geometry (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Hardware Design (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of human dissection interactive system based on virtual reality, relate to medical treatment, medical science, human body scientific research field.This system is made up of head-mounted display apparatus, host computer system, tracing system, controller equiment, utilizes the characteristic of VR to set up out complete three-dimensional virtual environment, and after importing complete 3D digital human body anatomical structure in virtual environment, display is among virtual scene.Make user by controller, model be picked up in virtual scene completely, rotate, the interactive operation such as hide, just as being personally on the scene in the middle of scene.User can be assisted to carry out learning and studying by this system, improve teaching and Efficiency, reduce the cost in teaching and research.
Description
Technical field
The present invention is a kind of man-machine interactive system based on virtual reality technology, refers more particularly in virtual scene complete
Show 3D human dissection mathematical model from inside to outside, and the human dissection interactive system that can interact.
Background technology
Human-computer interaction technology is one of field of quickly growing in current user interface techniques, has obtained numerous studies
Really, including laying particular emphasis on the touching display screen of multimedia technology, collapsible e-book display screen, 3D display and retina image-forming
Display etc..Virtual reality, as an emerging human-computer interaction technology, has broader practice prospect.Virtual reality
(Virtual Reality is called for short VR) technology is to have developed along with the further investigation of Computer Graphics Simulation technology the eighties
The new research field come, people utilize it to create on the computer systems and the experiencing virtual world.Virtual world is complete
Body virtual environment (Virtual Environment is called for short VE) or the entirety of given simulation object, and virtual environment is by computer
Produce, act on user by vision, hearing, touch feel etc. and be allowed to produce the interactive visual analogue system of sensation on the spot in person.Generally
Virtual reality system is made up of intelligent glasses, control unit, human action capture unit etc., but presents in interactive and vision
Poor effect.
The application in medical domain of the existing virtual reality technology, mainly by X ray computer fault imaging
(CT), the Medical Imaging Technology such as nuclear magnetic resonance, NMR (MRI), human body live body or corpse are carried out omnibearing scanning, thus obtain people
Soma's organ information, then the anthropometric dummy of scanning is directly set up by three-dimensional reconstruction, application virtual reality technology and equipment will
Dummy model is presented among scene, makes user see the scanning organization of human body of a three-dimensional reduction in the scene.But it is such
All there is individual difference in organization of human body, the live subject such as scanned is the most fat between Different Individual or between live body and corpse
Or the thinnest, there is pathological changes in histoorgan, and for example corpse scanning time, exist and difference during live body, have passed through in addition physics and
Chemical treatment, absent-mindedness degree can increase, thus produces bigger deformation.The human body the most directly rebuilding out by 3-D scanning
Structure is limited to model application effect truly, it is impossible to using a capping as standardized human body's structure.
Additionally, though the research about vision synthesis is more at present, relatively fewer for the product of medical treatment medical domain,
Most bottleneck is all stuck in the fine degree of anthropometric dummy, and the technical deficiency of power touching simulation.The essence of anthropometric dummy
Fineness has prominent superiority in virtual reality environments, and it makes reality environment become true, has more substitution sense,
Enhance visualization greatly and present effect.It addition, force feedback is also an indispensable part in virtual reality, it is to use
Family can receive surrounding input, simultaneously can be to the perceptual channel of surrounding output.But virtual reality system is equal the most mostly
The most single visual stereoscopic or sense of touch are three-dimensional, it is impossible to realize the simultaneously match of vision and sense of touch, substitute into sense the strongest.If can be real
The now synchronization of the two renders and coordinates, the standardized data resource being correlated with in combination with medical science, medical field, will increase undoubtedly
Strong user and dummy model and environment mutual, and make to experience contacting and power of producing alternately with virtual objects, formation is to void
The complete cognition of analog model, as biconditional operation real-world object, makes man-machine interaction experience truer, accurately.
Furthermore, user can move in virtual environment the most rapidly, follows the trail of possibility not in place such as picture in moving process
Smear can be produced or fall the phenomenon of frame, making user produce spinning sensation and even cause human body uncomfortable.
Summary of the invention
Based on the problems referred to above, it is an object of the invention to provide a kind of human dissection interactive system based on virtual reality,
Set up complete three-dimensional virtual environment by VR, make user and anthropometric dummy interact operation.This system includes:
Head-mounted display apparatus, is worn on user's head, makes user pass through the display in described head-mounted display apparatus
Viewing virtual environment and 3 D human body mathematical model；
Host computer system, for for described head-mounted display apparatus provide function ensure, described head-mounted display apparatus according to
Self is intelligent and automaticity utilizes host computer system；
Tracing system, for catching the motion of user, and returns to information described head-mounted display apparatus, thus creates
A kind of immersion VR experiences；
Controller, described controller is handheld device, for following the trail of action or the gesture of user；
Auxiliary visible system, including: visualization bulletin board and dynamic visual effect generator；
Described system also includes: by certain in host computer system real-time judge sensor location and virtual scene
Organization of human body position, if any contact or collision, then carries out different dynamics feedbacks according to the character of contact or colliding object.
Preferably, described tracing system includes built-in sensors, gyroscope and magnetometer, described sensor and HMD device
Separate, use Internal camera head or LED.
Preferably, described controller is also equipped with sense of touch trigger module, it is provided that tactile experience, makes user feel vibrations.
Preferably, described controller includes:
Left handle, is controlled described system by the control station of described left handle；
Right handles, is controlled described system by the functional keys of described right handles.
Preferably, described left handle includes:
VR receptor, gyroscope equipment and one piece of solid plate, solid plate and VR receptor form integral structure and hold in a left side
Hands, carries out level by gyroscope equipment and upset judges, breathes out the control in virtual scene when left handle is in level
Platform processed, closing control platform when left handle departs from level.
Further, the functional keys of described right handles includes: trigger, button, left direction button, right direction button.
Preferably, described trigger includes:
Trigger: trigger includes function activation button, can operate the control station of left handle,
Wherein, described operation includes, carries out capturing work, further to after arbitrary model contact of 6 groups of anthropometric dummies:
Press trigger to determine to be in and catch state, be in and catch the model under state can rotate with the rotation of handle；
Unclamping trigger and cancel crawl, model rests on changing coordinates point.
Preferably, described button has the model being contacted handle and carries out single restoring function.
Preferably, described LR-button has the model group being in cursor circle carries out left rotation and right rotation function, all in group
Model starts to rotate along scene Y coordinate.
Preferably, the characteristic of left and right handle includes: when moving coordinate in virtual scene, the attribute of detection collision in real time.
Preferably, described visualization bulletin board, when any model is in seized condition, is sat in the crawled model world
The target upper left corner occurs that transparent mode describes interface, shows the Chinese of current crawled model, English name, and other in interface
Model associated description.
Preferably, described dynamic visual effect generator is when all models stand on original coordinate points in scene, for dynamic
States model renders dynamic effect.
Preferably, the structure of described 3 D human body mathematical model comprises the following steps:
1) human medical image is obtained；
2) use Volume Rendering Techniques, set up human digit solution to model and cut open data base；
3) instructed by medical expert, according to individual variation and the deficiency of human body, adjust the deviation of human digit model, obtain
Obtain human digit model accurately；
4) by manual drawing step 3) the human digit model that obtains, set up organization of human body model accurately.
Preferably, step 2) set up mathematical model for build respectively according to men and women's size difference.
Preferably, the structure of above-mentioned human digit model uses time generation 3D digital modeling method.
Described system also includes: in order to reduce the spinning sensation of user in VR environment, use following arbitrary adjustment mode or its
Combination:
Static object of reference is added within sweep of the eye user；Suitably reduce the field range of user or avoid the frequent of the visual field
Conversion；Increase the refreshing frame per second of display picture；Prompting user is at the uniform velocity movable in VR environment.
According to above-mentioned each mode, the present invention can make user obtain more fine interactive experience accurately.In virtual scene
User is it will be seen that have and the 3D somatic data of normal person's peer body lattice, such as height, chest measurement, upper lower part of the body ratio etc.；With
Time directly can disassemble fractionation to organization of human body arbitrary in virtual scene by controller, and without again by extra
External device.Further, it is different from the single visual stereoscopic of existing virtual reality system or sense of touch three-dimensional, or haptic effect is simple
Simulation, the present invention is directed to different tissues and carries out different dynamics feedbacks, make user experience the sense of touch of different tissues, knot simultaneously
Structure character, form and suppleness etc..
Further, the model resource of the present invention breaks traditions three-dimensional reconstruction, is drawn by twice organization of human body,
Converting primitive medicine data, utilization time 3D digital modeling techniques from generation to generation and PBR workflow make and obtain accurate, standard
The anthropometric dummy structure changed.
Additionally, the present invention is from user's own experience, it is contemplated that the persistency that user uses, have employed effective adjustment
Measure, prevents and reduces the spinning sensation of user.
Accompanying drawing explanation
Fig. 1 is present system structural representation.
Fig. 2 is the schematic diagram of right handles.
Fig. 3 is Digital human model schematic diagram.
Fig. 4 and Fig. 5 is that the force feedback in present system describes schematic diagram.
Fig. 6 is human body spinning sensation producing cause schematic diagram.
Detailed description of the invention
Hereinafter, with reference to the accompanying drawings to describe embodiments of the invention in detail.
Fig. 1 is present system structural representation.
Wherein, host computer system includes smart mobile phone, PC or video game machine.This medical anatomy interactive system tracing system can
The VR creating a kind of immersion experiences, such as, if user puts on HMD device and looks at the sky, HMD screen also can be to same side
To motion, in order to allow user see target.Tracing system can be integrated in HMD device, or the peripheral hardware as HMD device.For
Improve the accuracy of tracing system, sensor in tracing system can be separated with HMD device, and use Internal camera head or
LED.
Controller includes left and right handle, and wherein left handle includes: VR receptor and one piece of solid plate, the size of solid plate is
37cm*25cm.Solid plate requires light, and gravity is lighter.
Solid plate and left hand VR receptor form integral structure and hold in left hand, carry out water by the gyroscope equipment of handle
Gentle upset judges, breathes out the control station in virtual scene when handle is in level, and handle closes when departing from level
Close control station.In virtual scene, the control station of display is tabular operating board, and control station at least includes 6 model icons, point
Not: skeleton model, muscle model, Visceral models, Blood Model, neural model, lymph model, user can pass through right handles
The icon shown with control station interacts, and the icon such as shown control station selects, switches.Additionally, Visceral models
Translatable copying places single eyeball phantom and a complete set of brain model by a heart model, neural model.Meanwhile, by a left side
Handle has dynamic effect when activating control station and closing control platform.
The control station of left handle also includes that model button, model button have: activation, un-activation, three kinds of states of hovering,
While activator button, recall the model structure of correspondence, otherwise, activate model structure and then close.Have under each model button
One labeled button (totally 6), labeled button represents and chooses this model group.Labeled button is followed user and is clicked on, and judges
Now under which model group.By activate mark circle shown by labeled button can only by one single presented in.Simultaneously
Program is that each model group puts a box, utilizes right hand handle, utilizes what handle release went out to penetrate while pressing directionkeys
Line detects which group model chosen and rotates, and plays the function of mark circle.
Meanwhile, model button also includes 1 overall " Integral Restoration " button, can enter the model group being under mark circle
Row entirety reduction.Model button can also pass through ray detection model group, stirs other function key reset block mold groups.
Fig. 2 is the schematic diagram of right handles.
The function activation of right handles controls to include: trigger, button, left direction button, right direction button.
Wherein, trigger includes a function activation button, can operate the control station of left handle.Operation includes: to 6 groups
Carry out capturing work after arbitrary model contact of anthropometric dummy, when pressing trigger and determining to be in and catch state, be in and catch shape
Model under state can rotate with the rotation of handle, unclamps trigger and cancels crawl, and model rests on changing coordinates point.
Button, has the model being contacted handle and carries out single restoring function.
LR-button has the model group being in cursor circle carries out left rotation and right rotation function, and in group, all models are along scene Y
Coordinate starts to rotate.
Handle takes the form of true hands, or glove modalities.In grasping movement and click button actions, right handles
Form can in standby, grasping movement, refer to select in action and switch over.
The characteristic of left and right handle includes: when moving coordinate in virtual scene, the attribute of detection collision in real time.
Corresponding model information will be read when contacting or collide human tissue structure, and judge according to model information, and be given
FORCE FEEDBACK corresponding to corresponding model classification pulls the corresponding informance of power.FORCE FEEDBACK passes to hand receptor, and user is according to contact
Or the character of colliding object obtains different FORCE FEEDBACK information, the texture and the dynamics that reach real world stop sensation.By closing
The combination of reason, different force feedback technique, it is achieved feed back to the dynamics that user is different after human body different structure is analyzed
Conflict and experience.Certain human body locations of structures in sensor location and virtual scene is sentenced in real time by computer
Disconnected, if any collision, then carry out different dynamics feedbacks according to the character of colliding object.As collided obstruction dynamics and the fat of skeleton
Obstruction dynamics different, or the thickness sense of contact blood is the most different.
Auxiliary visible system, auxiliary visible system includes: visualization bulletin board and dynamic visual effect generator.
Visualization bulletin board, when any model is in seized condition, goes out in the upper left corner of crawled model world coordinates
Existing transparent mode describes interface, shows the Chinese of current crawled model, English name in interface, and other models are correlated with and are retouched
State.
Dynamic visual effect generator, when all models stand on original coordinate points in scene, renders dynamic for dynamic model
State effect.Human body has the organ being much kept in motion, the heart of state of such as beating, the lobe of the lung in breathing state, blood
Blood in Guan Liyou flowing, enterokinesia and gastric peristalsis etc..For increasing the mutual innervation in scene, when certain model departs from original seat
During punctuate, the model departing from coordinate points stops dynamic effect.
Fig. 3 is schematic diagram in 3D Digital human model, and 3D Digital human model is built by following steps:
1) obtain radiology department medical image, as cadaver sample resources bank and abundant human body CT MRI scan data etc.；
2) utilize 3D imaging system, use Volume Rendering Techniques based on light projecting algorithm, set up 3D Digital human model
Anatomical data storehouse, overlap three-dimensional digital model with complete and comprehensive, authoritative, fine anatomical data output men and women two；
3) instructed by medical expert, according to individual variation and the deficiency of human body, adjust the deviation of human digit model, obtain
Obtain human digit model accurately；
4) through the manual drawing step 3 of some fine arts personnel) model that obtains, set up out each a set of standard of men and women
Organization of human body.
Above-mentioned human digit model uses time generation 3D digital modeling techniques, and the establishment face number of average each model is 6000
(Mesh), on, texture mapping uses the full accuracy of 4096 (px) x 4096 (px) to make standard, to ensure each model
Fully reduction human body each system precision details, and arbitrarily can observe with 360 degree of angles.
By the 3D digital human body anatomical structure of dual drafting compared to the organization of human body only obtained by scanning, have more
Research and teaching.The threedimensional model directly reconstructing and being applied to system after scanning has individuation difference, and such human body is tied
Structure model can only represent body one by one, it is impossible to a capping.And the human digit model of Freehandhand-drawing is by somatic data storehouse, data
Obtain after many-sided resource consolidation such as scanning, three-dimensional reconstruction, expert's guidance, be that medical science most presses close to idealization and Medicine standard
Digital human body structural model.
It addition, in virtual scene, digital human body structural model can make user more finely interact body accurately
Test, user in virtual scene it will be seen that have and the 3D somatic data of normal person's peer body lattice, as height, chest measurement, on
Lower part of the body ratio etc..Directly can disassemble fractionation, no to organization of human body arbitrary in virtual scene by controller simultaneously
With again by extra external device.
Further, the model resource of the present invention breaks traditions three-dimensional reconstruction, by CG manufacturing technology, applies to
Medical education field.By primitive medicine data are converted, use time generation 3D digital modeling techniques and PBR workflow (base
Rendering in physical process) make accuracy, standardized anthropometric dummy structure.
Use primitive medicine data genaration primary mold, use time 3D digital modeling techniques drafting from generation to generation by modeling software
High-precision human model structure, organization of human body can be carried out high accuracy reduce and not by face numerical control system.Reference in conversion process
Many-sided specialized medical data, various dimensions, control model accuracy and standardization, set up out the organization of human body of perfect standard type.
Use PBR workflow, based on physical process render, simulate true illumination, make 4096 (px) x 4096
(px) high accuracy pinup picture.The organ structure drawn out is more nearly real human body, avoids conventional cadaver sample simultaneously and is difficult to
The drawback such as preserve, structure is unintelligible and live body difference is big.
The principle of secondary generation 3D model is to be mated by Gao Mo and low mould to produce multiple details pinup pictures, record in described pinup picture
Detailed information contained in high mould, and the normal pinup picture bakeed by high mould replies to the topic on low mould, to reduce the waste in face, simultaneously
Low mould page can show the visual effect of Gao Mo in engine in time, thus makes model performance more true, reaches movie-level essence
Degree, it is achieved the effect of high details, strong texture performance.
Above-mentioned model can be applicable to teaching shows and dissects training that the content that can require according to syllabus makes multiple
Sectional model, student can be by transparent or hiding operation, and observing and nursing internal anatomy and Morphological Features, to emphasis, difficulty
Point study position is simulated the operation of real anatomy, helps student to understand and grasps knowledge point, also improving teacher's simultaneously
Quality of instruction.
Fig. 4 and Fig. 5 is that the force feedback in present system describes schematic diagram.
As shown in Figure 4 and Figure 5, by the combination of rational, different force feedback techniques, it is achieved human body different structure is entered
Row feeds back to user different dynamics conflict after analyzing is experienced.Certain human body knot in sensor location and virtual scene
Structure position carries out real-time judge by computer, if any collision, then carries out different dynamics feedbacks according to the character of colliding object.
As different with the obstruction dynamics of fat in collided the obstruction dynamics of skeleton, or the thickness sense of contact blood is the most different.
Wherein, Fig. 4 shows the flow chart obtaining force feedback.
User touches anthropometric dummy by mobile both hands, when touching, activates and captures function, and right handles is in crawl shape
State, when user moves both hands again, just can show the movement locus capturing model further, obtain according to the action of user
The information of the corresponding model in human body or display capture the state of model.
Wherein, when user's both hands touch anthropometric dummy, carry out collision detection, and detection information is sent back to main frame system
System, to calculate feedback dynamics further, and returns to sense of touch trigger module by the dynamics of feedback, and sense of touch trigger module provides sense of touch
Experience, make user feel vibrations.
When user activates crawl function and is in seized condition, for dynamic organ, such as heart, blood vessel etc., pass through
Both hands coordinate and speed, calculate the force feedback information that human tissue structure is corresponding, and the force information of model returned to sense of touch
Trigger module, it is further provided tactile experience.
Fig. 5 further illustrates force feedback signal input/output relation in the system.
Virtual scene models show object receives the movement locus coordinate of hand exercise generation and carries out the dynamic posture of hand
Identify.Force feedback signal is by extracting counter stress feedback Resistance Pressure information and being sent to virtual scene mould after FORCE FEEDBACK signal processing
Type display object.The signal of head display simultaneously obtains the move of user by head display signal processing flow, also by it
It is sent to virtual scene models show object.Virtual scene models show object calculates the power to hand position further and returns
Feedforward information, and it is returned to sense of touch trigger module, it is further provided tactile experience.
In VR film, the image of acute variation is had easily to cause the spinning sensation of user in space.Meanwhile, these changes
Always attract the attention of user.With reference to Fig. 6, in the visual field of user, first area is that most suitable user observes, the secondth district
Territory belongs to remaining light region, the visual field, and user can be attracted because of the change of yellow area generation, thus changes Visual Observations Observations position.
3rd region is the insignificant part of vision, only when having picture generation acutely to reflect or the judgement of brain subconsciousness is dangerous information
People just can be made to have reflected.And now, the image of edge can be left in the basket, if reducing the visual field, Consumer's Experience is affected not
Greatly.Significantly picture change and subconscious danger signal source can be avoided in processing procedure so building at scenic picture,
Oneself is all the time in a safety and quiet environment to make brain think.Such environment avoids user significantly or quickly to move
Animation face, thus reduce user and produce the situation of dizzy effect.Therefore, can be by suitably reducing the user visual field (FOV), suitably subtracting
Lack the field range of user or avoid the frequent conversion etc. in the visual field, reducing the spinning sensation of user, strengthening Consumer's Experience.
It addition, VR equipment inter-frame delay does not catches up with the motion of people, when people has accomplished that corresponding motion picture does not also have
Refresh out, have small delay sense, i.e. sense organ and can produce spinning sensation with frame per second is asynchronous.If increasing equipment to picture
Refresh frame per second, as reached higher level (60Hz etc.), then user self moves at moving-head and virtual environment picture
Time, the delay of picture can be greatly reduced, to such an extent as to user is hardly it can be seen that effectively reduce spinning sensation.The present invention utilizes special
Processing mode reduce model face number while ensure that the precision of model, thus increase the refreshing frequency in virtual scene.
Can also user increase within sweep of the eye the health of oneself, a sterilizing room helmet or static object of reference frame (as
Head up displays) as object of reference, it is effectively reduced spinning sensation, feeling of immersion can also be increased in some cases.
Claims (9)
1. a human dissection interactive system based on virtual reality, sets up three-dimensional virtual environment and 3 D human body numeral by VR
Model, makes user and anthropometric dummy interact operation, and this system includes:
Head-mounted display apparatus, is worn on user's head, makes the display viewing that user passes through in described head-mounted display apparatus
Virtual environment and 3 D human body mathematical model；
Host computer system, for providing function to ensure for described head-mounted display apparatus, described head-mounted display apparatus and main frame system
System interacts；
Tracing system, for catching the motion of user, and returns to information described head-mounted display apparatus, thus creates and immerse
Formula V R is experienced；
Controller, described controller is handheld device, for following the trail of action or the gesture of user；
Described controller farther includes left handle and right handles；Wherein,
Described interactive system is controlled by the control station that left handle can be transferred in virtual scene；Described left handle includes:
VR receptor, gyroscope equipment and solid plate, solid plate and VR receptor form integral structure and hold in left hand, pass through top
Spiral shell instrument apparatus carries out level and upset judges, breathes out the control station in virtual scene, left hand when left handle is in level
Closing control platform when handle departs from level；Described interactive system is controlled by right handles by the functional keys of described right handles
System；
Auxiliary visible system, including: visualization bulletin board and dynamic visual effect generator；
Described system also includes: by certain human body in host computer system real-time judge sensor location and virtual scene
Locations of structures, if any contact or collision, then carries out different dynamics feedbacks according to the character of contact or colliding object.
Human dissection interactive system based on virtual reality the most according to claim 1, it is characterised in that:
Described tracing system includes that built-in sensors, gyroscope and magnetometer, described sensor separate with HMD device, in using
Portion's photographic head or LED.
Human dissection interactive system based on virtual reality the most according to claim 1 and 2, it is characterised in that:
Described controller is also equipped with sense of touch trigger module, it is provided that tactile experience, makes user feel vibrations；Specifically,
Read corresponding model information when contacting or collide human tissue structure, judge according to model information, and provide correspondence
FORCE FEEDBACK corresponding to model classification pulls the corresponding informance of power；
FORCE FEEDBACK passes to hand receptor, and according to user's contact or the Properties of Objects of collision, host computer system is to described object
The dynamics conflict feeding back to user after being analyzed different is experienced, and makes user obtain different FORCE FEEDBACK information, reaches true generation
The texture on boundary and dynamics stop sensation；
Certain human body locations of structures in sensor location and virtual scene carries out real-time judge by host computer system, as
There is collision, then carry out different dynamics feedbacks according to the character of colliding object.
4. according to the human dissection interactive system based on virtual reality described in any one of claim 1-3, it is characterised in that institute
The functional keys stating right handles includes: trigger, button, left direction button, right direction button；Wherein,
Described trigger includes: function activation button, can operate the control station that left handle is corresponding, wherein, and described operation bag
Include, after arbitrary model of multiple anthropometric dummies is contacted, carry out capturing work, further, press trigger and determine to be in and catch shape
State, is in and catches the model under state can rotate with the rotation of handle, unclamps trigger and cancels crawl, and model rests on currently
In coordinate points；
Described button has the model being contacted right handles and carries out single restoring function；
The model group that described left direction button and right direction button right button have being in cursor circle carries out left rotation and right rotation function,
In group, all models start to rotate along scene Y coordinate.
Human dissection interactive system based on virtual reality the most according to claim 1, it is characterised in that described left handle
Include with the characteristic of right handles: when moving in virtual scene, the attribute of detection collision in real time.
Human dissection interactive system based on virtual reality the most according to claim 1, it is characterised in that:
Described visualization bulletin board, when any model is in seized condition, goes out in the upper left corner of crawled model world coordinates
Existing transparent interface, shows the description information of current crawled model in interface；
Described dynamic visual effect generator, when all models stand on original coordinate points in scene, renders dynamic for dynamic model
State effect.
Human dissection interactive system based on virtual reality the most according to claim 1, it is characterised in that described three-dimensional people
The structure of body mathematical model comprises the following steps:
1) human medical image is obtained；
2) use Volume Rendering Techniques, set up human digit solution to model and cut open data base；
3) instructed by medical expert, according to individual variation and the deficiency of human body, adjust the deviation of human digit model, it is thus achieved that accurate
True human digit model；
4) manual drawing step 3) the human digit model that obtains, and import described system and render, it is thus achieved that three-dimensional accurately
Human digit model；Wherein, described step 2) set up human digit model for build respectively according to men and women's size difference.
Human dissection interactive system based on virtual reality the most according to claim 7, it is characterised in that described three-dimensional people
The structure of body mathematical model uses time generation 3D digital modeling method.
Human dissection interactive system based on virtual reality the most according to claim 1, it is characterised in that in order to reduce VR
The spinning sensation of user in environment, described system also includes following arbitrary adjustment mode or a combination thereof:
Static object of reference is added within sweep of the eye user；Reduce the field range of user or reduce the conversion frequency in the visual field；Increase
Add the refreshing frame per second of display picture；Prompting user is at the uniform velocity movable in VR environment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610634221.3A CN106293082A (en) | 2016-08-05 | 2016-08-05 | A kind of human dissection interactive system based on virtual reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610634221.3A CN106293082A (en) | 2016-08-05 | 2016-08-05 | A kind of human dissection interactive system based on virtual reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106293082A true CN106293082A (en) | 2017-01-04 |
Family
ID=57665014
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610634221.3A Pending CN106293082A (en) | 2016-08-05 | 2016-08-05 | A kind of human dissection interactive system based on virtual reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106293082A (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106873775A (en) * | 2017-01-16 | 2017-06-20 | 深圳中科呼图电子商务有限公司 | A kind of implementation method of virtual reality interaction, system and MR gloves |
| CN107844197A (en) * | 2017-11-28 | 2018-03-27 | 歌尔科技有限公司 | Virtual reality scenario display methods and equipment |
| CN107862912A (en) * | 2017-12-20 | 2018-03-30 | 四川纵横睿影医疗技术有限公司 | Medical educational system based on VR technologies |
| CN108668050A (en) * | 2017-03-31 | 2018-10-16 | 深圳市掌网科技股份有限公司 | Video capture method and apparatus based on virtual reality |
| CN108831233A (en) * | 2018-05-28 | 2018-11-16 | 中南民族大学 | A kind of MRI virtual simulated training system and method |
| CN109147414A (en) * | 2018-09-29 | 2019-01-04 | 南昌航空大学 | A kind of Virtual Reality Training System and method can be used for ray DR image checking |
| WO2019062314A1 (en) * | 2017-09-30 | 2019-04-04 | 复旦大学 | Virtual-real combination-based human anatomical structure display and interaction method |
| CN109584348A (en) * | 2018-10-29 | 2019-04-05 | 天津大学 | A kind of design method of the virtual painting system of Qin's figurines based on virtual reality technology |
| CN110033847A (en) * | 2019-05-24 | 2019-07-19 | 宋晓明 | A kind of structures and methods of magnetic resonance map automatic identification |
| CN110366746A (en) * | 2017-02-24 | 2019-10-22 | 维拉达公司 | Diagnostic imaging exercise device and method based on virtual reality |
| CN110364051A (en) * | 2019-07-26 | 2019-10-22 | 苏州千火信息科技有限公司 | Virtual experimental system based on VR technology |
| CN111047935A (en) * | 2018-10-15 | 2020-04-21 | 北京蔚来高科技术有限公司 | Intelligent interactive teaching and training system for exercise rehabilitation |
| CN111243413A (en) * | 2020-03-06 | 2020-06-05 | 吉林大学 | Modeling method and teaching system for facial anatomy teaching |
| CN111278383A (en) * | 2017-10-23 | 2020-06-12 | 直观外科手术操作公司 | System and method for presenting augmented reality in a display of a remote operating system |
| CN111882941A (en) * | 2020-08-11 | 2020-11-03 | 中南大学湘雅二医院 | Heart great vessel anatomy teaching system and method based on virtual reality |
| CN112053656A (en) * | 2019-06-05 | 2020-12-08 | Tcl集团股份有限公司 | Method and device for controlling refreshing of rotary LED lamp strip and display equipment |
| CN112258612A (en) * | 2019-08-01 | 2021-01-22 | 北京灵医灵科技有限公司 | Method and system for observing virtual anatomical object based on tomogram |
| CN115472055A (en) * | 2022-09-21 | 2022-12-13 | 南开大学 | Virtual simulation teaching system with virtual-real binding force feedback |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102568288A (en) * | 2010-12-23 | 2012-07-11 | 于福东 | Endoscopy virtual surgery system with force feedback |
| CN103903487A (en) * | 2013-11-26 | 2014-07-02 | 深圳市唯特视科技有限公司 | Endoscope minimally invasive surgery 3D simulation system based on 3D force feedback technology |
| WO2015042274A1 (en) * | 2013-09-18 | 2015-03-26 | Sharp Vision Software Llc | Systems and methods for providing software simulation of human anatomy and endoscopic guided procedures |
| CN104618712A (en) * | 2015-02-13 | 2015-05-13 | 北京维阿时代科技有限公司 | Head wearing type virtual reality equipment and virtual reality system comprising equipment |
| CN105023295A (en) * | 2015-08-05 | 2015-11-04 | 成都嘉逸科技有限公司 | Human anatomy unit 3D model establishment method and teaching system |
| CN105096670A (en) * | 2014-05-23 | 2015-11-25 | 香港理工大学 | Intelligent immersed teaching system and device used for nasogastric tube operating training |
| CN105741356A (en) * | 2016-02-06 | 2016-07-06 | 鹤壁职业技术学院 | Human anatomy teaching system |
-
2016
- 2016-08-05 CN CN201610634221.3A patent/CN106293082A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102568288A (en) * | 2010-12-23 | 2012-07-11 | 于福东 | Endoscopy virtual surgery system with force feedback |
| WO2015042274A1 (en) * | 2013-09-18 | 2015-03-26 | Sharp Vision Software Llc | Systems and methods for providing software simulation of human anatomy and endoscopic guided procedures |
| CN103903487A (en) * | 2013-11-26 | 2014-07-02 | 深圳市唯特视科技有限公司 | Endoscope minimally invasive surgery 3D simulation system based on 3D force feedback technology |
| CN105096670A (en) * | 2014-05-23 | 2015-11-25 | 香港理工大学 | Intelligent immersed teaching system and device used for nasogastric tube operating training |
| CN104618712A (en) * | 2015-02-13 | 2015-05-13 | 北京维阿时代科技有限公司 | Head wearing type virtual reality equipment and virtual reality system comprising equipment |
| CN105023295A (en) * | 2015-08-05 | 2015-11-04 | 成都嘉逸科技有限公司 | Human anatomy unit 3D model establishment method and teaching system |
| CN105741356A (en) * | 2016-02-06 | 2016-07-06 | 鹤壁职业技术学院 | Human anatomy teaching system |
Non-Patent Citations (1)
| Title |
|---|
| 李小龙: "基于Kinect手势识别的虚拟人体解剖教学***的设计与实现", 《信息科技辑》 * |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106873775A (en) * | 2017-01-16 | 2017-06-20 | 深圳中科呼图电子商务有限公司 | A kind of implementation method of virtual reality interaction, system and MR gloves |
| US11157131B2 (en) | 2017-02-24 | 2021-10-26 | Vrad Inc. | Virtual reality-based radiology practice apparatus and method |
| CN110366746A (en) * | 2017-02-24 | 2019-10-22 | 维拉达公司 | Diagnostic imaging exercise device and method based on virtual reality |
| CN108668050B (en) * | 2017-03-31 | 2021-04-27 | 深圳市掌网科技股份有限公司 | Video shooting method and device based on virtual reality |
| CN108668050A (en) * | 2017-03-31 | 2018-10-16 | 深圳市掌网科技股份有限公司 | Video capture method and apparatus based on virtual reality |
| WO2019062314A1 (en) * | 2017-09-30 | 2019-04-04 | 复旦大学 | Virtual-real combination-based human anatomical structure display and interaction method |
| CN109597478A (en) * | 2017-09-30 | 2019-04-09 | 复旦大学 | A kind of human anatomic structure displaying and exchange method based on actual situation combination |
| CN111278383A (en) * | 2017-10-23 | 2020-06-12 | 直观外科手术操作公司 | System and method for presenting augmented reality in a display of a remote operating system |
| CN107844197A (en) * | 2017-11-28 | 2018-03-27 | 歌尔科技有限公司 | Virtual reality scenario display methods and equipment |
| CN107862912A (en) * | 2017-12-20 | 2018-03-30 | 四川纵横睿影医疗技术有限公司 | Medical educational system based on VR technologies |
| CN108831233A (en) * | 2018-05-28 | 2018-11-16 | 中南民族大学 | A kind of MRI virtual simulated training system and method |
| CN109147414B (en) * | 2018-09-29 | 2024-03-12 | 南昌航空大学 | Virtual reality training system and method for ray DR imaging detection |
| CN109147414A (en) * | 2018-09-29 | 2019-01-04 | 南昌航空大学 | A kind of Virtual Reality Training System and method can be used for ray DR image checking |
| CN111047935A (en) * | 2018-10-15 | 2020-04-21 | 北京蔚来高科技术有限公司 | Intelligent interactive teaching and training system for exercise rehabilitation |
| CN109584348A (en) * | 2018-10-29 | 2019-04-05 | 天津大学 | A kind of design method of the virtual painting system of Qin's figurines based on virtual reality technology |
| CN110033847A (en) * | 2019-05-24 | 2019-07-19 | 宋晓明 | A kind of structures and methods of magnetic resonance map automatic identification |
| CN112053656B (en) * | 2019-06-05 | 2021-11-19 | Tcl科技集团股份有限公司 | Method and device for controlling refreshing of rotary LED lamp strip and display equipment |
| CN112053656A (en) * | 2019-06-05 | 2020-12-08 | Tcl集团股份有限公司 | Method and device for controlling refreshing of rotary LED lamp strip and display equipment |
| CN110364051A (en) * | 2019-07-26 | 2019-10-22 | 苏州千火信息科技有限公司 | Virtual experimental system based on VR technology |
| CN112258612A (en) * | 2019-08-01 | 2021-01-22 | 北京灵医灵科技有限公司 | Method and system for observing virtual anatomical object based on tomogram |
| CN112258612B (en) * | 2019-08-01 | 2022-04-22 | 北京灵医灵科技有限公司 | Method and system for observing virtual anatomical object based on tomogram |
| CN111243413A (en) * | 2020-03-06 | 2020-06-05 | 吉林大学 | Modeling method and teaching system for facial anatomy teaching |
| CN111243413B (en) * | 2020-03-06 | 2021-07-02 | 吉林大学 | Modeling method and teaching system for facial anatomy teaching |
| CN111882941A (en) * | 2020-08-11 | 2020-11-03 | 中南大学湘雅二医院 | Heart great vessel anatomy teaching system and method based on virtual reality |
| CN115472055A (en) * | 2022-09-21 | 2022-12-13 | 南开大学 | Virtual simulation teaching system with virtual-real binding force feedback |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106293082A (en) | A kind of human dissection interactive system based on virtual reality | |
| CN107067856B (en) | Medical simulation training system and method | |
| Krichenbauer et al. | Augmented reality versus virtual reality for 3d object manipulation | |
| Reiner | The role of haptics in immersive telecommunication environments | |
| CN106327983A (en) | Acupuncture acupoint determination auxiliary teaching system | |
| CN109389669A (en) | Human 3d model construction method and system in virtual environment | |
| CN208156892U (en) | Intelligent accurate Chinese medicine skills training checking system | |
| CN106980383A (en) | A kind of dummy model methods of exhibiting, module and the virtual human body anatomical model display systems based on the module | |
| CN110021445A (en) | A kind of medical system based on VR model | |
| Li et al. | Design and evaluation of personalized percutaneous coronary intervention surgery simulation system | |
| Sherstyuk et al. | Mixed reality manikins for medical education | |
| CN111276022A (en) | Gastroscope simulation operation system based on VR technique | |
| Hamza-Lup et al. | Medical Simulation and Training:" Haptic" Liver | |
| CN113903424A (en) | Virtual reality function rehabilitation training system | |
| Wagner et al. | Intraocular surgery on a virtual eye | |
| CN116631252A (en) | Physical examination simulation system and method based on mixed reality technology | |
| CN207886596U (en) | A kind of VR rehabilitation systems based on mirror neuron | |
| Born et al. | Increasing presence in a mixed reality application by integrating a real time tracked full body representation | |
| Souza et al. | Development of a vr simulator for medical training using free tools: A case study | |
| CN114937379A (en) | Construction method of interactive Chinese pronunciation teaching system based on virtual reality technology | |
| Nesamalar et al. | An introduction to virtual reality techniques and its applications | |
| Nowak et al. | Mixed Reality in Action-Exploring Applications for Professional Practice | |
| Chen et al. | A system design for virtual reality visualization of medical image | |
| Bolton et al. | BodiPod: interacting with 3d human anatomy via a 360 cylindrical display | |
| Lanzoni et al. | A design procedure for the development of VR platforms for the rehabilitation of patients after stroke |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190424 Address after: 610000 Fortune International Ninth Floor, 75 Xiaotianzhu Street, Wuhou District, Chengdu City, Sichuan Province Applicant after: CHENGDU CTC TIANFU DIGITAL TECHNOLOGY INC. Applicant after: People health electronic audio visual Publishing Co., Ltd. Address before: 610000 Fortune International Ninth Floor, 75 Xiaotianzhu Street, Wuhou District, Chengdu City, Sichuan Province Applicant before: CHENGDU CTC TIANFU DIGITAL TECHNOLOGY INC. |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170104 |
|
| RJ01 | Rejection of invention patent application after publication |