CN107633724A - Auscultation training system based on motion capture - Google Patents
Auscultation training system based on motion capture Download PDFInfo
- Publication number
- CN107633724A CN107633724A CN201710840922.7A CN201710840922A CN107633724A CN 107633724 A CN107633724 A CN 107633724A CN 201710840922 A CN201710840922 A CN 201710840922A CN 107633724 A CN107633724 A CN 107633724A
- Authority
- CN
- China
- Prior art keywords
- auscultation
- digitlization
- training
- sound
- simulated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Instructional Devices (AREA)
Abstract
The present invention relates to a kind of auscultation training system based on motion capture, including auscultation simulated object, digitlization 3D model treatments system and optics motion capture system, digitizing 3D model treatments system includes digitlization 3D modeling unit, model case matching unit and database, and optics motion capture system includes collecting unit and digitlization 3D calculation processing units.Simple auscultation simulated object is converted to the digitlization object of size matching therewith and establishes the case associated with the auscultation position for digitizing object and sound by the present invention, stethoscopic space three-dimensional positioning is carried out with reference to optics motion capture technology, actual auscultated sound under each auscultation position of simulated implementation, and it can directly observe the digitlization object in digitlization scene, person easy to operation realizes anatomical structure corresponding to auscultation position during exercise, Learner diagnosis technical ability is helped, improves auscultation training quality and effect.
Description
Technical field
The present invention relates to simulation medical educational field, and in particular to a kind of auscultation training system based on motion capture.
Background technology
Implement the very important basic link that physical examination is doctor diagnosis and treatment patient to patient, doctor is gathering
The physical examination implemented on the basis of patient history, it is that doctor verifies patient symptom, obtains the important sources of physical signs of patient, because
This, comprehensively, complete, correctly implementation physical examination could cause clinician to make correct diagnosis, so as to treat pole because of disease
To be important.
During medico changes to Doctor's role, it is a very important ring that medical science, which is learned on the job, and physical examination is doctor
The basic training of clinical position, physical examination training are the important steps of clinical medical education.Auscultation operation is usually used in Medicine disease
Check, such as heart, lung etc., because the internals such as heart, lung are complicated, noise mechanism of production is also very complicated, auscultation
Content is more, thus it is high to the accuracy requirement of auscultation operation, make emphasis and difficult point in physical examination training.
Driven in general, disease symptomses and sign that the physical examination carried out on normal human is gathered are physiology
It is dynamic.By cardiac auscultation for example, in recent years, as the incidence of disease of rheumatic heart disease, congenital heart disease is reduced year by year, suffer from
Person's sense of self-protection gradually strengthens, and majority is no longer ready with the pathogeny that is fated so that heart murmur auscultation pathogeny is fewer and fewer, institute
Clinically to practise without enough patients for student, cardiac auscultation training also becomes more and more difficult.
Start to introduce the Modern educational methodologies such as multimedia teaching for this medical education worker, although multimedia teaching picture and text
And cyclopentadienyl, but make it difficult for medico to carry out the interaction with patient, operation of learning on the job is carried out, still can not be improved the quality of teaching.Then people
Contemplate the method that true man patient is replaced with computer simulation people, for example have cardiopulmonary computer simulation people, computer simulation people uses silicon
The materials such as glue, PVC make, and internal corresponding site is provided with a variety of sensor devices, and presets different cases not
With sound or effect, sound, picture, influence and word are combined together, thus diagnose people and " being diagnosed people " (electricity to realize
Brain modeling people) interactive feedback, be diagnosed to be the different symptom of different parts, show different signs and sound, also can be for student
Multiple skill training.
Simulative medicine industry traditional at present realizes auscultation, palpation using electromagnetic induction, pressure sensing technology to simulation people
Etc. training program, i.e., sensor is set in simulation people, carries out simulated training, but because the normal of human body can not be simulated completely
Physiology drives, and training is still unable to reach satisfied effect.Its shortcoming is as follows：1st, it is only capable of simulating the local sound of a certain disease, nothing
Method simulates the overall symptom of patient；2nd, sign is more can not show in body surface, internal sign, and auscultation has that noise is more, poor effect；
3rd, to diagnose various different parts difference cases, a large amount of computer simulation people must be just produced, cost is quite high；4th, interior arrangement constructs
Various, complex operation, operating rate is slow；4th, auscultated sound has very big distortion；5th, doctors and patients' interaction feedback can not be realized；6th, people is simulated
Interior sensor is only capable of sensing when stethoscope touches the sensing point, and when stethoscope is located at other points even in sensing point
The point on side can not all sense, therefore effect is discrete type, but in fact the auscultation of physical examination position when around check point
And have sound, it is vibration and the tone of sound of gradual change, i.e., in continous way effect.To sum up, at present each side all in effort
The physical examination simulation people of the various drivings (including physiology driving) of research and development, no matter in palpation, P＆A, or nerveous system
All many-sides such as system inspection, can not all meet the basic demand of clinician's professional training.
The content of the invention
The problem of present invention can not meet the training requirement of auscultation for simulation medical training equipment traditional at present,
A kind of auscultation training system based on motion capture is provided, simple auscultation simulated object is converted to the number of size matching therewith
Word object simultaneously establishes the case associated with the auscultation position for digitizing object and sound, enters with reference to optics motion capture technology
The stethoscopic space three-dimensional positioning of row, the actual auscultated sound at simulated implementation auscultation position, and can directly observe digitlization field
Digitlization object in scape, person easy to operation realize anatomical structure corresponding to auscultation position during exercise, help Learner diagnosis
Technical ability, improve auscultation training quality and effect.
Technical scheme is as follows：
Auscultation training system based on motion capture, it is characterised in that at auscultation simulated object, digitlization 3D models
Reason system and optics motion capture system, the digitlization 3D model treatments system include digitlization 3D modeling unit, model disease
Example matching unit and database, the digitlization 3D modeling unit utilization digitize 3D modeling technology and change auscultation simulated object
To digitize object, the digitlization object matches with auscultation simulated object size, and the database purchase has each auscultation position
Case and sound during different cases, the model case matching unit be connected with database for according to digitlization object
Auscultation position establish associated case and sound；The optics motion capture system includes collecting unit and digitlization 3D meters
Processing unit is calculated, the collecting unit catches point, the digitlization by the optics set on some camera acquisition stethoscopes
3D calculation processing units catch point according to the optics of collection and carry out 3 d space coordinate calculating processing, obtain stethoscope digital empty
Between operating position and show the position in the digitlization object and send corresponding sound.
Also include auscultation Training valuation system, the auscultation Training valuation system connection digitlization 3D model treatment systems
Model case matching unit and database, for by set auscultation Teaching Case guide operator in auscultation simulated object it is complete
Into operation and policer operation person's study condition.
The model case matching unit sets the central point of auscultation position institute overlay area and according to the auscultation position
The far and near sound that gradual change is set of the distance of central point is arrived in institute overlay area, is covered when certain region is related to by multiple auscultation positions
When the sound that sets be that each sound mix as corresponding to each related auscultation position forms.
Some optics are set to catch point on the stethoscope, the digitlization 3D modeling unit, which utilizes, digitizes 3D modeling
Stethoscope is converted to digitlization auscultation equipment by technology.
The auscultation simulated object is arranged on the auscultation sick bed of diagnosis space, and the digitlization 3D modeling unit also utilizes
Diagnosis space and auscultation sick bed are respectively converted into digital virtual space and digitized hospital bed by digitlization 3D modeling technology, described
Digital virtual space matches with diagnosis space size, it is described it is digitized hospital bed matched with auscultation sick bed size, and pass through optics
Motion capture system is digitized Virtual Space and digitized hospital bed positioning.
The auscultation Training valuation system includes teaching cases and records column, course broadcasting study column, simulated operation instruction
Practice column, column and case editing machine are assessed in examination, the teaching cases recording column, course broadcasting study column, simulation behaviour
It is interrelated with case editing machine to make training column, examination assessment column, and the relevant information and database synchronization of each plate
Renewal, standardized by the case editing machine and edit and call clinical practice auscultation teaching cases.
Emulation shows each auscultation position of human body on the digitlization object, and the auscultation Training valuation system is according to training
Demand shows or covered each auscultation position.
The simple space that the diagnosis space is real ward or classroom or four sides enclosing is built, the auscultation sick bed is true
Positive sick bed builds the simple sick bed of formula；The auscultation simulated object be eliminate internal structure low-cost die it is anthropomorphic or other simple
Simulated object.
The collecting unit catches point by the optics set on some camera acquisition stethoscopes, also carries out action collection
Pretreatment, the action collection pretreatment includes the seizure point information of two field picture and movement locus prediction before and after, to obscuring
Or the target point blocked uses the method automatic straightening of multi-frame analysis, then use signal smoothing algorithm automatic the bounce for catching point
Data are smoothed；The digitlization 3D calculation processing units catch point according to the optics of collection and carry out space three-dimensional seat
Calculating processing is marked, obtains auscultation point of the stethoscope in digital space, and by calculating the position at auscultation position, simulated implementation auscultation
The actual auscultated sound of the band of position at position, so as to carry out auscultation operational simulation in the digitlization object.
The video camera uses high definition video camera, and some high definition video cameras arrange around diagnosis space,
High definition camera coverage overlapping region is auscultation simulated object and stethoscope actuating range, multiple high definition video cameras
Continuous quick shooting stethoscope operational motion simultaneously records, and the high definition video camera capture rate is not less than 90 frame per second.
The technique effect of the present invention is as follows：
The present invention relates to a kind of auscultation training system based on motion capture, including auscultation simulated object, digitlization 3D
Model treatment system and optics motion capture system, digitlization 3D model treatments system are converted to simple auscultation simulated object
What size matched therewith digitizes object and establishes the case associated with the auscultation position for digitizing object and sound, with reference to light
Learn motion capture system and carry out stethoscopic space three-dimensional positioning using optics motion capture technology, simulated implementation auscultation position exists
Actual auscultated sound during different cases, and the digitlization object in digitlization scene can be directly observed, person easy to operation is real
Anatomical structure corresponding to auscultation position during now practising, help Learner diagnosis technical ability.Auscultation simulated object provides for medico
Faster learning track, fundamentally solve the problems, such as that student is more, sufferer is few, also solve traditional simulative medicine industry
The drawbacks of auscultation training is present is carried out to simulation people using electromagnetic induction, pressure sensing technology, the present invention breaks the normal procedure thinking,
Sensor need not be set in auscultation simulated object, and auscultation simulated object can eliminate the low-cost die personification of internal structure, very
Extremely can be any other simple simulated object, a such as plate, screen etc., auscultation simulated object is built by digitizing 3D
Mould technology is converted to digitlization object, or perhaps is converted to digitalized artificial manikin, and medico can directly observe this
Digitalized artificial manikin.On the basis of capture technique is acted, it is combined with numeral with simulation, virtually mutually melts with reality
The modern technologies of conjunction, research and develop physical examination training system, to capture in physical examination training process the action occurred, position,
Sound etc. is unable to the global problem of precise synchronization, is existed by optics motion capture system for auscultation simulated object, stethoscope
3 d space coordinate is calculated, and is obtained accurate auscultation point with this, is matched the virtual mould in digital virtual scene
Type --- on digitlization object, to realize that auscultation operates accurate simulation, enhancing operator and the interactive experience of " sufferer ", simplify instruction
Practice flow, improve training quality, and the related data for digitizing object can be repeated several times utilization, improve application efficiency, it is abundant to listen
Operation case is examined, the cost of auscultation training is greatly reduced, improves auscultation training quality and effect.
Auscultation training system of the present invention is preferably provided with auscultation Training valuation system, for by setting auscultation Teaching Case to draw
Lead operator and operation and policer operation person's study condition are completed in auscultation simulated object, can also be further used for whole system
Account, parameter, operating process, the management of safety and the examination to students ' learning performance of system are assessed, in virtual combination reality
In scene, medico can interactive experience auscultation operation and observation case performance, excite the dense learning interest of medico, improve
Auscultation training quality and effect, demand is trained according to auscultation, the repeated multiple times study of medico and operation, lifting can be allowed to start
Auscultation ability, save auscultation training cost, while students ' learning performance can be test in real time, marking is assessed, improve training with
Check and accept efficiency.
Preferably, the central point of auscultation position institute overlay area can be set in model case matching unit and is listened according to described
The far and near sound that gradual change is set for the distance that central point is arrived in position institute overlay area is examined, when certain region is related to by multiple auscultation portions
The sound set during the covering of position is that each sound mix as corresponding to each related auscultation position forms, and such structure design obtains
Further optimization, auscultation position is arranged to regional, it is most strong in central point vibration and sound, got in the same area from central point
Remote vibration and sound gradually decays, and different distance produces different vibration and sound, that is, continuity effect is presented, and traditional
Simulative medicine industry is only capable of progress discrete type sensing by sensor more essential difference, present invention reduction true man so that listen
Examine training more to emulate, further improve training quality and improve training effect.
Brief description of the drawings
Fig. 1 is the structured flowchart of the auscultation training system of the invention based on motion capture.
Fig. 2 is the preferred structure block diagram of the auscultation training system of the invention based on motion capture.
Fig. 3 is the preferred effect displaying figure of digitlization 3D model treatment systems.
Fig. 4 is the overall preferred effect displaying figure of the auscultation training system of the invention based on motion capture.
Fig. 5 is the preferred working state figure of auscultation Training valuation system.
Each label lists as follows in figure：
101- video cameras；102- optics catches point；103- auscultation simulated objects；104- stethoscopes；
201- digitizes object；202- is digitized hospital bed；203- digital virtuals space；204- digitlization auscultations are set
It is standby.
Embodiment
The present invention will be described below in conjunction with the accompanying drawings.
The present invention relates to a kind of auscultation training system based on motion capture, its structure including auscultation as shown in figure 1, simulate
Object, digitlization 3D model treatments system and optics motion capture system, wherein, digitlization 3D model treatments system includes numeral
Change 3D modeling unit, model case matching unit and database, the unit utilization of digitlization 3D modeling digitizes 3D modeling technology will
Auscultation simulated object is converted to digitlization object, and the digitlization object matches with auscultation simulated object size, database purchase
There is the sound when case at each auscultation position and different cases, model case matching unit is connected with database for according to number
Associated case and sound are established in the auscultation position of word object；Optics motion capture system includes collecting unit and digitlization
3D calculation processing units, collecting unit catch point, digitlization 3D meters by the optics set on some camera acquisition stethoscopes
Calculate processing unit and point progress 3 d space coordinate calculating processing is caught according to the optics of collection, obtain stethoscope in digital space
Operating position simultaneously shows the position in the digitlization object and sends corresponding sound.
Auscultation training system of the present invention based on motion capture is described in detail below, is preferable to carry out as shown in Figure 2
Example, preferable auscultation training system also include auscultation Training valuation system, auscultation Training valuation system connection digitlization 3D models
The model case matching unit and database of processing system, auscultation Training valuation system is by setting auscultation Teaching Case guiding behaviour
Author completes operation and policer operation person's study condition in auscultation simulated object.Further, auscultation Training valuation system bag
Include teaching cases recording column, course plays study column, simulated operation trains column, examines assessment column and case editor
Device, the teaching cases record column, course plays study column, simulated operation training column, examination assess column with disease
Example editing machine is interrelated, and the relevant information of each plate updates with database synchronization, is standardized by the case editing machine
Editor and calling clinical practice auscultation teaching cases.Auscultation Training valuation system is also used for account, parameter, behaviour to whole system
Make flow, the management of safety and the examination to students ' learning performance to assess.Auscultation Training valuation system can use such as APP, net
Page end etc. various ways show, and also support self-defined pattern, can personalized customization difference in functionality column, such as account as needed
Course row class that family rights management, contract management, student attend class, school timetable distribution, the examination point arrangement of student examination, examination management,
Electronic scoring etc., adaptability is stronger, and administration interface more adding system becomes apparent from, and facilitates training management.
Auscultation simulated object and stethoscopic structure in auscultation training system of the present invention are all simplified, equal nothing
Sensor need to be set, auscultation simulated object be not understood as eliminating internal structure low-cost die is anthropomorphic or other simple simulations pair
As, auscultation simulated object is arranged on the auscultation sick bed of diagnosis space, diagnosis space described here can be real ward,
The simple space that classroom or four sides enclosing are built, auscultation sick bed can be real sick bed or build the simple sick bed of formula.Such as Fig. 2 institutes
Show, arrange some video cameras 101 in diagnosis space surrounding, it is preferable that video camera 101 uses high definition video camera, Ruo Gansuo
State high definition video camera around diagnosis space arrange, high definition camera coverage overlapping region be auscultation simulated object and
Stethoscope actuating range, multiple high definition video cameras continuously quickly shoot stethoscope operational motion and recorded, and the high definition is red
Outer video camera capture rate is not less than 90 frame per second.As shown in Fig. 2 setting some optics to catch point 102 on stethoscope, such as scheme
The displaying figure of system whole structure shown in 4, can set 3-4 optics to catch point on stethoscope, and stethoscope 104 is simulated to auscultation
Object 103 carries out auscultation at each auscultation position such as heart and lungs.
Digitlization 3D modeling unit in digitlization 3D model treatment systems, which utilizes, digitizes 3D modeling technology by auscultation mould
Intend object and be converted to digitlization object, stethoscope is converted into digitlization auscultation equipment, also profit using 3D modeling technology is digitized
Diagnosis space and auscultation sick bed are respectively converted into digital virtual space and digitized hospital bed, number with digitlization 3D modeling technology
Word Virtual Space matches with diagnosis space size, it is described it is digitized hospital bed matched with auscultation sick bed size, and moved by optics
Make seizure system and be digitized Virtual Space and digitized hospital bed positioning.Digitlization 3D model treatments system as shown in Figure 3
The preferred effect displaying figure of system, it is understood that to be the design sketch in virtual scene, a virtual operation room is illustrated, including
Digitlization object 201 (i.e. a virtual human model or perhaps digitized humans), digitized hospital bed 202 and digitlization
Virtual Space 203.
The model case matching unit digitized in 3D model treatment systems is established according to the auscultation position of digitlization object
Associated case and sound, i.e., go matching that different sound is set according to the different state of an illness, different point positions.If case is auscultation
When whether having pleurisy, in chest area, different sound can be set gradually according to normal, slight and menace level.It is preferred that set
Put the central point of auscultation position institute overlay area and according to the remote of the distance that central point is arrived in auscultation position institute overlay area
The nearly sound that gradual change is set, the sound set when certain region, which is related to, to be covered by multiple auscultation positions be by each related auscultation
Each sound mix is formed corresponding to position, and such structure design is further optimized, and auscultation position is arranged into regional,
Central point vibrates and sound is most strong, gradually decays in the same area vibration more remote from central point and sound, and different distance produces
Different vibrations and sound, that is, continuity effect is presented, form can be established alternative sounds are set according to the different state of an illness according to area, this
Being only capable of progress discrete type sensing by sensor with traditional simulative medicine industry has more essential difference, and present invention reduction is very
People so that auscultation training more emulates, and further improves training quality and improves training effect.
Optics motion capture system is used for seizure, analysis and the processing of auscultation action, and its collecting unit passes through some shootings
The optics set on machine collection stethoscope catches point, therefore includes some video cameras and some optics seizure point in collecting unit, respectively
Optics catches point and is arranged in stethoscope front end, and luminous point mark can be directly sticked in stethoscope front end, therefore is construed as auscultation behaviour
Make position tracking device, the positional information of point is caught for tracking optics；Video camera is construed as auscultative signal trap setting,
For catching the positional information of collection auscultation operating position tracks of device and then carrying out stethoscopic positioning.Worked in collecting unit
Action collection pretreatment is also carried out afterwards, specifically may include the seizure point information of two field picture and movement locus prediction before and after, it is right
Obscure or the target point that blocks uses the method automatic straightening of multi-frame analysis, signal smoothing algorithm is then used to the bounce for catching point
Automatically data are smoothed, eliminate shake, ensure information gathering quality.Digitlization 3D in optics motion capture system
Calculation processing unit catches point according to the optics of collection and auscultation simulated object carries out 3 d space coordinate calculating processing, obtains
Stethoscope obtains auscultation point of the stethoscope in digital space in digital space operating position, and by calculate heart, lungs, chest,
The position at the auscultation such as back position, the actual auscultated sound of the band of position at simulated implementation auscultation position, so as in the numeral
Change and auscultation operational simulation is carried out in object.
Fig. 4 is the overall preferred effect displaying figure of the auscultation training system of the invention based on motion capture, includes reality
Scene (lower right corner) and virtual scene, there are operator and auscultation simulated object 103 in reality scene, operator holds stethoscope
104, set optics to catch point on stethoscope 104, auscultation is carried out to auscultation simulated object 103 by stethoscope 104.Pass through number
Digitlization 3D modeling cell formation virtual scene in word 3D model treatment systems, including personage's modeling, scene modeling and listen
Device modeling is examined, constitutes digitlization object 201, digitized hospital bed 202, digital virtual space 203 and digitlization auscultation equipment
204.Data are called from database with according to digitlization by digitizing the model case matching unit in 3D model treatment systems
Associated case and sound are established in the auscultation position of object.By optics motion capture system to auscultation simulated object and auscultation
Device carries out 3 d space coordinate calculating processing, obtains accurate auscultation point, is assessed so as to carry out auscultation operational simulation and operation, together
When show the position in the digitlization object and send corresponding sound.
Auscultation Training valuation system is by setting auscultation Teaching Case to guide operator to complete behaviour in auscultation simulated object
Make simultaneously policer operation person's study condition, can be standardized editor and calling clinical practice auscultation teaching cases by case editing machine,
I.e. different parts, the case of different symptoms are write in standardization, and abundant case storehouse simultaneously can be added and call at any time, be selected with reference to teacher
Different cases is selected, different sign changes can be showed on virtual human model (digitizing object), thoroughly realizes and listens
Examine the simulation operations training of diagnostic skill.As shown in Figure 3 and Figure 4, it can emulate display on the digitlization object human body is each listens
Position is examined, auscultation Training valuation system can show or cover each auscultation position according to training demand, such as show in teaching and training
Show each auscultation position, each auscultation position is covered in examination or test.Fig. 5 is the preferred working condition of auscultation Training valuation system
Figure, it will be appreciated that to be operation interface that simulated operation trains column, heart or lung such as may be selected, case is related to master during such as heart
Arterial valve is narrow, the closing of aortic incompetence, arterial duct, splitting of second heart sound, second heart sound enhancing and pericardium friction
Sound etc., and display area may be selected, whether breastbone transparent, whether left lung transparent etc. sets, be easy to teaching and training etc. various
Demand.Column is assessed in examination can effectively test the results of learning of medico, take an exam and score, and change traditional auscultation religion
And examination pattern, improve quality of instruction and results of learning.
Auscultation training system of the invention based on motion capture, on the basis of action captures, using simulation and digital phase
With reference to, virtually with the technology that blends of reality, multi-level, various dimensions training is presented needed for content, realize to greatest extent dynamic
Work, position, the in good time of sound three, synchronization, the perfect presentation of high-fidelity, it is achieved thereby that consistent with physiology driving infinite approach
Effect.Simple auscultation simulated object is converted to the digitlization object of size matching therewith, action of going forward side by side is bound, preset
Corresponding normal or abnormality sound effect, it is possible to by the auscultation in reality scene simulate people and stethoscopic statement with
Action is shown in virtual scene is realized by virtual human model and digitlization auscultation equipment, and can further be showed
Body surface that auscultation simulated object can not show wound, face expression etc., can provide faster learning track for medico, from basic
On solve the problems, such as that student is more, sufferer is few, optics motion capture system of the present invention carries out motion capture and obtained in virtual scene
In position and positioning, obtain accurate auscultation operating position, match on the digitized humans in virtual scene, with reality
The existing accurate simulation of auscultation operation, enhancing operator and the interactive experience of " sufferer ", simplify training flow, improve training quality, and
Digital model data can be repeated several times utilization with action data, improve application efficiency, with reference to auscultation Training valuation system, enrich
Auscultation operates case, greatly reduces the cost of auscultation training.
It should be pointed out that embodiment described above can make those skilled in the art that the present invention be more fully understood
Create, but do not limit the invention in any way is created.Therefore, although this specification is created with embodiment to the present invention referring to the drawings
Make and have been carried out being described in detail, it will be understood by those skilled in the art, however, that still can be modified to the invention
Or equivalent substitution, in a word, all do not depart from the technical scheme of the spirit and scope of the invention and its improvement, and it all should contain
Cover among the protection domain of the invention patent.
Claims (10)
1. the auscultation training system based on motion capture, it is characterised in that including auscultation simulated object, digitlization 3D model treatments
System and optics motion capture system, the digitlization 3D model treatments system include digitlization 3D modeling unit, model case
Matching unit and database, the digitlization 3D modeling unit are converted to auscultation simulated object using 3D modeling technology is digitized
Object is digitized, the digitlization object matches with auscultation simulated object size, and the database purchase has each auscultation position
Sound when case and different cases, the model case matching unit are connected with database for according to digitlization object
Associated case and sound are established in auscultation position；The optics motion capture system includes collecting unit and digitlization 3D is calculated
Processing unit, the collecting unit catch point, the digitlization 3D by the optics set on some camera acquisition stethoscopes
Calculation processing unit catches point according to the optics of collection and carries out 3 d space coordinate calculating processing, obtains stethoscope in digital space
Operating position and show the position in the digitlization object and send corresponding sound.
2. auscultation training system according to claim 1, it is characterised in that described also including auscultation Training valuation system
The model case matching unit and database of auscultation Training valuation system connection digitlization 3D model treatment systems, for by setting
Put auscultation Teaching Case guiding operator and operation and policer operation person's study condition are completed in auscultation simulated object.
3. auscultation training system according to claim 1 or 2, it is characterised in that the model case matching unit is set
The central point of auscultation position institute overlay area and according in auscultation position institute overlay area arrive central point distance distance
Set gradual change sound, the sound set when certain region, which is related to, to be covered by multiple auscultation positions be by each related auscultation portion
Each sound mix corresponding to position forms.
4. auscultation training system according to claim 3, it is characterised in that set some optics to catch on the stethoscope
Catch a little, stethoscope is converted to digitlization auscultation equipment by the digitlization 3D modeling unit using 3D modeling technology is digitized.
5. auscultation training system according to claim 4, it is characterised in that it is empty that the auscultation simulated object is arranged on diagnosis
Between auscultation sick bed on, the digitlization 3D modeling unit is also using digitizing 3D modeling technology by diagnosis space and auscultation sick bed
Digital virtual space and digitized hospital bed is respectively converted into, the digital virtual space matches with diagnosis space size, institute
State it is digitized hospital bed matched with auscultation sick bed size, and Virtual Space and numeral are digitized by optics motion capture system
Change the positioning of sick bed.
6. auscultation training system according to claim 2, it is characterised in that the auscultation Training valuation system includes teaching
Case records column, course plays study column, simulated operation trains column, column and case editing machine are assessed in examination, described
Teaching cases record column, course play study column, simulated operation training column, examination assess column with case editing machine
It is interrelated, and the relevant information of each plate updates with database synchronization, is standardized by the case editing machine and edits and adjust
With clinical practice auscultation teaching cases.
7. auscultation training system according to claim 6, it is characterised in that emulation shows people on the digitlization object
Each auscultation position of body, the auscultation Training valuation system show or covered each auscultation position according to training demand.
8. auscultation training system according to claim 5, it is characterised in that the diagnosis space is real ward or classroom
Or the simple space that four sides enclosing is built, the auscultation sick bed are real sick bed or build the simple sick bed of formula；The auscultation simulation
Object be eliminate internal structure low-cost die is anthropomorphic or other simple simulated objects.
9. auscultation training system according to claim 5, it is characterised in that the collecting unit is adopted by some video cameras
The optics set on collection stethoscope catches point, also carries out action collection pretreatment, and the action collection pretreatment is included before
The seizure point information of two field picture and movement locus prediction afterwards, use the method for multi-frame analysis automatic the target point obscured or blocked
Correction, the bounce for catching point is then smoothed to data automatically using signal smoothing algorithm；The digitlization 3D is calculated
Processing unit catches point according to the optics of collection and carries out 3 d space coordinate calculating processing, obtains stethoscope listening in digital space
Examine a little, and by calculating the position at auscultation position, the actual auscultated sound of the band of position at simulated implementation auscultation position, so as to
Auscultation operational simulation is carried out in the digitlization object.
10. auscultation training system according to claim 9, it is characterised in that the video camera is imaged using high definition
Machine, some high definition video cameras arrange around diagnosis space, and high definition camera coverage overlapping region is auscultation mould
Intend object and stethoscope actuating range, multiple high definition video cameras continuously quickly shoot stethoscope operational motion and recorded,
The high definition video camera capture rate is not less than 90 frame per second.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710840922.7A CN107633724B (en) | 2017-09-18 | 2017-09-18 | Auscultation training system based on motion capture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710840922.7A CN107633724B (en) | 2017-09-18 | 2017-09-18 | Auscultation training system based on motion capture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107633724A true CN107633724A (en) | 2018-01-26 |
| CN107633724B CN107633724B (en) | 2021-04-20 |
Family
ID=61102854
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710840922.7A Active CN107633724B (en) | 2017-09-18 | 2017-09-18 | Auscultation training system based on motion capture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107633724B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111508298A (en) * | 2020-04-10 | 2020-08-07 | 广东工业大学 | Auscultation training system and method based on flexible touch screen |
| CN113344335A (en) * | 2021-05-11 | 2021-09-03 | 深圳市医养护教育服务有限公司 | Health assessment teaching system and method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101799863A (en) * | 2009-02-06 | 2010-08-11 | 天津市医学堂科技有限公司 | Image recognition algorithm and application thereof |
| CN105096670A (en) * | 2014-05-23 | 2015-11-25 | 香港理工大学 | Intelligent immersed teaching system and device used for nasogastric tube operating training |
| CN105931283A (en) * | 2016-04-22 | 2016-09-07 | 南京梦宇三维技术有限公司 | Three-dimensional digital content intelligent production cloud platform based on motion capture big data |
| CN106295198A (en) * | 2016-08-16 | 2017-01-04 | 南京美卡数字科技有限公司 | Standard patient system and method based on VR virtual reality technology |
| US20170162079A1 (en) * | 2015-12-03 | 2017-06-08 | Adam Helybely | Audio and Visual Enhanced Patient Simulating Mannequin |
| CN107067856A (en) * | 2016-12-31 | 2017-08-18 | 歌尔科技有限公司 | A kind of medical simulation training system and method |
| JP2017153640A (en) * | 2016-03-01 | 2017-09-07 | 株式会社国際電気通信基礎技術研究所 | Auscultation training system and simulation sound collection part |
-
2017
- 2017-09-18 CN CN201710840922.7A patent/CN107633724B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101799863A (en) * | 2009-02-06 | 2010-08-11 | 天津市医学堂科技有限公司 | Image recognition algorithm and application thereof |
| CN105096670A (en) * | 2014-05-23 | 2015-11-25 | 香港理工大学 | Intelligent immersed teaching system and device used for nasogastric tube operating training |
| US20170162079A1 (en) * | 2015-12-03 | 2017-06-08 | Adam Helybely | Audio and Visual Enhanced Patient Simulating Mannequin |
| JP2017153640A (en) * | 2016-03-01 | 2017-09-07 | 株式会社国際電気通信基礎技術研究所 | Auscultation training system and simulation sound collection part |
| CN105931283A (en) * | 2016-04-22 | 2016-09-07 | 南京梦宇三维技术有限公司 | Three-dimensional digital content intelligent production cloud platform based on motion capture big data |
| CN106295198A (en) * | 2016-08-16 | 2017-01-04 | 南京美卡数字科技有限公司 | Standard patient system and method based on VR virtual reality technology |
| CN107067856A (en) * | 2016-12-31 | 2017-08-18 | 歌尔科技有限公司 | A kind of medical simulation training system and method |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111508298A (en) * | 2020-04-10 | 2020-08-07 | 广东工业大学 | Auscultation training system and method based on flexible touch screen |
| CN113344335A (en) * | 2021-05-11 | 2021-09-03 | 深圳市医养护教育服务有限公司 | Health assessment teaching system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107633724B (en) | 2021-04-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107527542A (en) | Percussion training system based on motion capture | |
| CN107111894B (en) | Augmented or virtual reality simulator for professional and educational training | |
| CN101996507B (en) | Method for constructing surgical virtual operation teaching and training system | |
| JP2713789B2 (en) | Expert system simulator for modeling realistic internal environments and movements | |
| Chopra et al. | The Leiden anaesthesia simulator | |
| CN107369352A (en) | Intelligent accurate traditional Chinese medical science skills training checking system | |
| CN104271066A (en) | Hybrid image/scene renderer with hands free control | |
| CN105225562A (en) | A kind of general practitioner's training checking system and method | |
| WO2015027286A1 (en) | A medical training simulation system and method | |
| CN111833682A (en) | Virtual physical examination teaching method and device based on VR technology | |
| CN109147529A (en) | The standard patient simulation system of achievable humane examination based on artificial intelligence | |
| CN108961902A (en) | A kind of virtual emulation hospital care teaching training system and its application method | |
| CN115527645A (en) | Clinical simulation virtual patient system for teaching and examination | |
| CN107633724A (en) | Auscultation training system based on motion capture | |
| Pavlović et al. | The application of simulation in medical education-our experience “from improvisation to simulation” | |
| Balcombe | Medical training using simulation: toward fewer animals and safer patients | |
| CN117576969A (en) | Cardiopulmonary auscultation virtual simulation training system and method | |
| CN205541521U (en) | General practitioner trains checking system | |
| US20080137877A1 (en) | Subject actuated system and method for simulating normal and abnormal medical conditions | |
| WO2020047761A1 (en) | Medical simulator, and medical training system and method | |
| McKenzie et al. | Augmented standardized patients now virtually a reality | |
| Pereira Santos et al. | Embodied Agents for Obstetric Simulation Training | |
| Pereira et al. | Digital auscultation: challenges and perspectives | |
| Yang et al. | Development and application of nursing operation virtual simulation training system | |
| Pretto et al. | Experiences using augmented reality environment for training and evaluating medical students |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |