CN106527698A - Immersive simulation training real-time correction system - Google Patents

Immersive simulation training real-time correction system Download PDF

Info

Publication number
CN106527698A
CN106527698A CN201610945187.1A CN201610945187A CN106527698A CN 106527698 A CN106527698 A CN 106527698A CN 201610945187 A CN201610945187 A CN 201610945187A CN 106527698 A CN106527698 A CN 106527698A
Authority
CN
China
Prior art keywords
real
action
module
data
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610945187.1A
Other languages
Chinese (zh)
Other versions
CN106527698B (en
Inventor
谢尉尉
吴泽顺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shaanxi Sheng'er Ya Xin Electronic Technology Co Ltd
Original Assignee
Shaanxi Sheng'er Ya Xin Electronic Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shaanxi Sheng'er Ya Xin Electronic Technology Co Ltd filed Critical Shaanxi Sheng'er Ya Xin Electronic Technology Co Ltd
Priority to CN201610945187.1A priority Critical patent/CN106527698B/en
Publication of CN106527698A publication Critical patent/CN106527698A/en
Application granted granted Critical
Publication of CN106527698B publication Critical patent/CN106527698B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education
    • G06Q50/205Education administration or guidance

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Educational Technology (AREA)
  • Educational Administration (AREA)
  • Human Computer Interaction (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • General Business, Economics & Management (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses an immersive simulation training real-time correction system. The real-time correction system is composed of a standard animation data module, an action real-time capturing module, an action data reading module, a data comparison analysis algorithm module, a training result analysis module and an immersive image output module. The standard animation data module, the action real-time capturing module and the action data reading module are simultaneously connected with the input end of the data comparison analysis algorithm module. The training result analysis module and the immersive image output module are connected with the output end of the data comparison analysis algorithm module. According to the system, through application of the real-time action capturing device and an action comparison analysis algorithm, actions of a trainee can be visualized in real time, through real-time analysis comparison of the algorithm, a correction method is fed back to the trainee in real time, and a real-time correction effect is achieved.

Description

A kind of real-time correction system of immersion simulation training
Technical field:
The invention belongs to electronic applications, are related to a kind of virtual emulation training correction checking system, especially a kind of immersion The real-time correction system of simulation training.
Background technology:
The simulation training correction checking system that the country uses at present, some are drawn using 2 D animation, three-dimensional animation etc. Teaching is led, using computer screen, projection etc. as visual presentation device in some designs, some input equipment photographic head, video The equipment such as harvester, due to the defect which designs, cause to lack in use the limb action to student's simulation training and lack Weary effective real-time visual is synchronously corrected, or the low problem of Data Comparison accuracy, have impact on simulation training correction Practicality and result of training.
The content of the invention:
It is an object of the invention to overcome the shortcoming of above-mentioned prior art, there is provided a kind of immersion simulation training is corrected in real time System, can synchronous trainee in real time limb action, and pass through algorithm and standard teaching gesture and carry out real time contrast, pass through The data feedback that Algorithm Analysis draw corrects student's action in real time, and viewing study can be carried out in immersive environment.
A kind of real-time correction system of immersion simulation training, the real-time correction system is by standard animation data module, dynamic Capture module, action data read module, date comprision algoritic module, training result analysis module and immersion when putting into effect Picture output module is constituted;Standard animation data module, action real-time capture module and action data read module simultaneously with number According to the connection of relative analyses algoritic module input, training result analysis module and immersion picture output module and and Data Comparison Parser module outfan connects.
The standard animation data module is referred to according to the training attitude of standard using the dynamic standard operation for catching equipment capture Storehouse, maneuver library think that animated is presented, and are stored with data mode.
The action real-time capture module is that by adopting inertial sensor, the motion to human body major skeletal position is carried out Measure in real time, student's action is captured in software system in real time, the real-time synchronization of action is realized, action includes the limbs of people Action.
The action data read module is that the data of motion capture are converted in real time and read in system, and by data Storehouse records.
Real-time action data is analyzed by the date comprision algoritic module with standard animation data, it is indicated that Deviation is simultaneously exported to student with data mode.
The training result analysis system is to write algorithm according to the certain service features of training, is trained by Algorithm Analysis Result and digitization;
The picture of system is output as whole immersion picture by described immersion picture output module, matches immersion VR The helmet carries out 360 degree of immersion experience.
The method that the system carries out simulation training correction in real time, comprises the steps:
Step 0:Start immersion simulation training;
Step 1:Output immersion picture;
Step 2:Training standard action is caught using the dynamic equipment of catching of whole body, standard operation is built into stock and is entered in data base;
Step 3:Real-time motion capture is carried out using the dynamic equipment of catching of whole body, action includes upper limks movements, lower limb movement, handss Finger action, waist action;
Step 4:Enter action to catch the reading of data and be stored into data base;
Step 5:The action data file of reference system standard, catches data and carries out data analysiss and contrast to dynamic, after contrast Judged, if qualified turn to step 4, if unqualified turn to step 1, until action it is qualified;
Step 6:After completing everything, system carries out result evaluation according to the specific transactions algorithm of training, and with fraction Form is exported.
The beneficial effects of the present invention is:The present invention catches equipment and action relative analyses algorithm by dynamic in real time, will can learn The action real-time visual of member, and the real-time analysis contrast of algorithm can be passed through, by antidote Real-time Feedback to student, play reality When the effect corrected.
Description of the drawings:
Fig. 1 is the correction system schematic diagram of the present invention;
Fig. 2 is the correction system flow chart of the present invention.
Specific embodiment:
Below in conjunction with the accompanying drawings the present invention is described in further detail:
Fig. 1 is referred to, and a kind of method that utilization said system carries out simulation training correction in real time is introduced below in conjunction with Fig. 1, Comprise the steps:
Step 0:Start immersion simulation training;
Step 1:Output immersion picture.
Step 2:Training standard action is caught using the dynamic equipment of catching of whole body, standard operation is built into stock and is entered in data base;
Step 3:Real-time motion capture is carried out using the dynamic equipment of catching of whole body, action includes upper limks movements, lower limb movement, handss Finger action, waist action;
Step 4:Enter action to catch the reading of data and be stored into data base;
Step 5:The action data file of reference system standard, catches data and carries out data analysiss and contrast to dynamic, after contrast Judged, if qualified turn to step 4, if unqualified turn to step 1, until action it is qualified.
Step 6:After completing everything, system carries out result evaluation according to the specific transactions algorithm of training, and with fraction Form is exported.
The system includes standard animation data 1, action real-time capture system 2, action data and reads 3, Data Comparison Parser 4, training result analysis system 5, immersion picture output 6 etc.
The standard animation data 1 referred to according to the training attitude of standard using the dynamic standard operation storehouse for catching equipment capture, Maneuver library thinks that animated is presented, and is stored with data mode;
The action real-time capture system 2 is that by adopting inertial sensor, the motion to human body major skeletal position is entered Row is measured in real time, and student's action is captured in software system in real time, the real-time synchronization of action is realized, action includes the limb of people Body action (upper limb, lower limb, waist, head, finger);
It is that the data of motion capture are converted in real time and read in system that the action data reads 3, and by data base Record;
The date comprision algorithm 4 is that real-time action data is analyzed with standard animation data, it is indicated that Deviation is simultaneously exported to student with data mode (data such as the angle of limbs key point, height);
The training result analysis system 5 is to write algorithm according to the certain service features of training, is instructed by Algorithm Analysis Experienced result digitization;
Described immersion picture output 6 is that the picture of system is output as whole immersion picture, can match immersion The VR helmets carry out 360 degree of immersion experience.
The above, is only presently preferred embodiments of the present invention, not makees any pro forma restriction to the present invention, though So the present invention is disclosed above with preferred embodiment, but is not limited to the present invention, any to be familiar with this professional technology people Member, in the range of without departing from technical solution of the present invention, when using the method and technology contents of the disclosure above make it is a little more Equivalent embodiments that are dynamic or being modified to equivalent variations, as long as being the content without departing from technical solution of the present invention, according to the present invention's Any simple modification, equivalent variations and modification that technical spirit is made to above example, still fall within technical solution of the present invention In the range of.

Claims (8)

1. the real-time correction system of a kind of immersion simulation training, it is characterised in that:The real-time correction system is by standard animation number According to module, action real-time capture module, action data read module, date comprision algoritic module, training result analysis mould Block and immersion picture output module are constituted;Standard animation data module, action real-time capture module and action data read mould Block is connected with date comprision algoritic module input simultaneously, training result analysis module and immersion picture output module with It is connected with date comprision algoritic module outfan.
2. as claim 1 tells the real-time correction system of immersion simulation training, it is characterised in that:The standard animation data mould Block refers to according to the training attitude of standard that using the dynamic standard operation storehouse for catching equipment capture maneuver library thinks that animated is presented, Stored with data mode.
3. as claim 1 tells the real-time correction system of immersion simulation training, it is characterised in that:The action real-time capture mould Block is that by adopting inertial sensor, the motion to human body major skeletal position is measured in real time, will be student's action real-time Capture in software system, realize the real-time synchronization of action, action includes the limb action of people.
4. as claim 1 tells the real-time correction system of immersion simulation training, it is characterised in that:The action data reads mould Block is that the data of motion capture are converted in real time and read in system, and by data-base recording.
5. as claim 1 tells the real-time correction system of immersion simulation training, it is characterised in that:The date comprision is calculated Real-time action data is analyzed by method module with standard animation data, it is indicated that deviation is simultaneously exported to data mode Member.
6. as claim 1 tells the real-time correction system of immersion simulation training, it is characterised in that:The training result analysis system System is to write algorithm according to the certain service features of training, the result simultaneously digitization trained by Algorithm Analysis.
7. as claim 1 tells the real-time correction system of immersion simulation training, it is characterised in that:Described immersion picture is defeated Go out module and the picture of system is output as into whole immersion picture, matching the immersion VR helmets carries out 360 degree of immersion experience.
8. the method for carrying out simulation training correction in real time based on system described in claim 1, comprises the steps:
Step 0:Start immersion simulation training;
Step 1:Output immersion picture;
Step 2:Training standard action is caught using the dynamic equipment of catching of whole body, standard operation is built into stock and is entered in data base;
Step 3:Real-time motion capture is carried out using the dynamic equipment of catching of whole body, action includes that upper limks movements, lower limb movement, finger are moved Work, waist action;
Step 4:Enter action to catch the reading of data and be stored into data base;
Step 5:The action data file of reference system standard, catches data and carries out data analysiss and contrast to dynamic, carry out after contrast Judge, if qualified turn to step 4, if unqualified turn to step 1, until action it is qualified;
Step 6:After completing everything, system carries out result evaluation according to the specific transactions algorithm of training, and with fractional form Output.
CN201610945187.1A 2016-11-02 2016-11-02 Immersive simulation training real-time correction system Active CN106527698B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610945187.1A CN106527698B (en) 2016-11-02 2016-11-02 Immersive simulation training real-time correction system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610945187.1A CN106527698B (en) 2016-11-02 2016-11-02 Immersive simulation training real-time correction system

Publications (2)

Publication Number Publication Date
CN106527698A true CN106527698A (en) 2017-03-22
CN106527698B CN106527698B (en) 2020-01-17

Family

ID=58292444

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610945187.1A Active CN106527698B (en) 2016-11-02 2016-11-02 Immersive simulation training real-time correction system

Country Status (1)

Country Link
CN (1) CN106527698B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110109532A (en) * 2018-06-11 2019-08-09 成都思悟革科技有限公司 A kind of human action Compare System obtaining system based on human body attitude

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202662011U (en) * 2011-04-22 2013-01-09 安徽寰智信息科技股份有限公司 Physical education teaching auxiliary system based on motion identification technology
CN102908772A (en) * 2012-10-16 2013-02-06 东南大学 Upper limb rehabilitation training system by using augmented reality technology
CN105999682A (en) * 2016-06-14 2016-10-12 郑州华信学院 Sports training monitoring system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202662011U (en) * 2011-04-22 2013-01-09 安徽寰智信息科技股份有限公司 Physical education teaching auxiliary system based on motion identification technology
CN102908772A (en) * 2012-10-16 2013-02-06 东南大学 Upper limb rehabilitation training system by using augmented reality technology
CN105999682A (en) * 2016-06-14 2016-10-12 郑州华信学院 Sports training monitoring system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110109532A (en) * 2018-06-11 2019-08-09 成都思悟革科技有限公司 A kind of human action Compare System obtaining system based on human body attitude

Also Published As

Publication number Publication date
CN106527698B (en) 2020-01-17

Similar Documents

Publication Publication Date Title
CN108777081B (en) Virtual dance teaching method and system
CN105374251A (en) Mine virtual reality training system based on immersion type input and output equipment
CN104656890A (en) Virtual realistic intelligent projection gesture interaction all-in-one machine
Chen et al. Using real-time acceleration data for exercise movement training with a decision tree approach
Zaletelj Estimation of students' attention in the classroom from kinect features
CN108109440A (en) A kind of more people's Dancing Teaching interaction method and devices
CN114967937B (en) Virtual human motion generation method and system
He et al. Immersive and collaborative Taichi motion learning in various VR environments
Cordeiro et al. ARZombie: A mobile augmented reality game with multimodal interaction
CN112331001A (en) Teaching system based on virtual reality technology
Liu et al. A real-time interactive tai chi learning system based on vr and motion capture technology
Corbi et al. Intelligent framework for learning physics with aikido (martial art) and registered sensors
Song et al. An immersive VR system for sports education
CN111477055A (en) Virtual reality technology-based teacher training system and method
CN108815845B (en) The information processing method and device of human-computer interaction, computer equipment and readable medium
CN110841266A (en) Auxiliary training system and method
US20200034606A1 (en) Facial mirroring in virtual and augmented reality
CN104933278B (en) A kind of multi-modal interaction method and system for disfluency rehabilitation training
KR102482841B1 (en) Artificial intelligence mirroring play bag
CN106527698A (en) Immersive simulation training real-time correction system
TWI431562B (en) Stability evaluate method for minimal invasive surgery training and device thereof
TWI687904B (en) Interactive training and testing apparatus
CN116611969A (en) Intelligent learning and scoring system for traditional martial arts
AU2020102908A4 (en) IOTM- Class Monitoring System: IoT and AI based Monitoring System for Faculty and their Course Materials Availability
CN205486164U (en) Novel people's face 3D expression action identification system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant