CN106153077A - A kind of initialization of calibration method for M IMU human motion capture system - Google Patents

A kind of initialization of calibration method for M IMU human motion capture system Download PDF

Info

Publication number
CN106153077A
CN106153077A CN201610841974.1A CN201610841974A CN106153077A CN 106153077 A CN106153077 A CN 106153077A CN 201610841974 A CN201610841974 A CN 201610841974A CN 106153077 A CN106153077 A CN 106153077A
Authority
CN
China
Prior art keywords
coordinate system
human body
body coordinate
calibration
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610841974.1A
Other languages
Chinese (zh)
Other versions
CN106153077B (en
Inventor
张永安
刘玉焘
刘盛羽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Kanglian Medical Technology Co ltd
Original Assignee
Suzhou Tantela Automation Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Tantela Automation Technology Co Ltd filed Critical Suzhou Tantela Automation Technology Co Ltd
Priority to CN201610841974.1A priority Critical patent/CN106153077B/en
Publication of CN106153077A publication Critical patent/CN106153077A/en
Application granted granted Critical
Publication of CN106153077B publication Critical patent/CN106153077B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C25/00Manufacturing, calibrating, cleaning, or repairing instruments or devices referred to in the other groups of this subclass
    • G01C25/005Manufacturing, calibrating, cleaning, or repairing instruments or devices referred to in the other groups of this subclass initial alignment, calibration or starting-up of inertial devices
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1126Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Biomedical Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Physiology (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Manufacturing & Machinery (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

A kind of initialization of calibration method for M IMU human motion capture system, the present invention relates to the initialization of calibration method of human motion capture system.The present invention is to solve that prior art exists the problems such as operation is complicated, precision is low.Step of the present invention is: one: human body limb is divided into 17 parts and numbers, and defines coordinate system;Two: M IMU sensor is fixed on 17 limbs;Three: set three kinds of calibration postures;Four: accumulate average in the data obtained are done, obtain the average measurement of M IMU sensor under three kinds of calibration postures;Five: obtain the relative rotation matrices of trunk sensor coordinate system and human body coordinate systemSix: obtain the trunk human body coordinate system spin matrix relative to reference frameStep 7: be calculatedStep 8: obtain the sensor coordinate system relative rotation matrices relative to human body coordinate system of each limbsThe present invention is applied to limbs attitude measurement field.

Description

A kind of initialization of calibration method for M-IMU human motion capture system
Technical field
The present invention relates to the initialization of calibration method for M-IMU human motion capture system.
Background technology
Human motion capture is widely used in man-machine interaction, virtual reality, athletic training, medical diagnosis are controlled with rehabilitation The fields such as treatment, robot control, Film Animation making.The most conventional human motion capture system has optical profile type, video image Formula, mechanical type, M-IMU, electromagnetic type, infrared type, sound wave type, but these systems have shortcoming more or less, it is impossible to completely Cover above-mentioned application.Along with the development and progress of science and technology, micro-electro-mechanical sensors (MEMS) is at miniaturization, precision and cost On had a great breakthrough, human motion capture system attractive based on the MEMS research of numerous scholars.M-IMU sensor system System is made up of a three axis accelerometer, a three-axis gyroscope and three axle magnetometers, and these sensors can be integrated In the least a piece of chip, thus reduce size and the weight of system, be arranged on limbs and also just will not hinder human body Often motion.
Human motion capture system based on M-IMU needs to install an IMU/M-IMU on each limbs of human body and passes Sensor, by measuring and estimating that the attitude of limbs obtains the movable information of human body.But, the survey of sensor under normal conditions Amount coordinate system is misaligned with corresponding human body coordinate system, and such motion measurement is nonsensical, it is necessary to by suitable Body motion information could be converted into the biological parameters such as joint angle by initialization of calibration program.Initialization of calibration program is used for counting Calculate the relative rotation matrices between sensor coordinate system and human body coordinate system, and then turning based on the measurement under sensor coordinate system Change into based on the kinematics information under human body coordinate system, be the M-IMU requisite process of human motion capture system.
Initialization of calibration algorithm of the prior art is broadly divided into three classes:
First kind initialization of calibration method is to be installed by accurately sensor, makes measurement coordinate system and the human body of sensor Coordinate system is completely superposed.Owing to the limbs surface of human body is irregular, the limited precision of this calibration steps.On the other hand, From the point of view of user uses angle, it is a complicated task that accurate sensor is installed, and is not suitable in daily life.
Equations of The Second Kind initialization of calibration method is to be completed by aid, and this aid passes through skeleton index point Measure the rotary shaft of human synovial, and then obtain the sensor coordinate system spin matrix relative to human body coordinate system.This side Method needs certain anatomical knowledge, and process is loaded down with trivial details.
3rd class initialization of calibration method is to be completed by a series of calibration posture and action.People under calibration posture One axle of body coordinate system is parallel with gravity, it is possible to use the acceleration of gravity of accelerometer measures obtains.In calibration actions The joint of lower human body rotates around another axle, it is possible to use the angular velocity that gyroscope is measured obtains.Last axle can be in order to Obtain with orthogonality principle.This calibration steps is simple, convenient, it is adaptable to daily life, but the calibration of this method Precision depends on calibrating posture and the standard degree of calibration actions.
In sum, there is the defects such as operation is complicated, precision is low in existing initialization of calibration method.
Summary of the invention
The present invention is to solve the problems such as prior art existence operation is complicated, precision is low, and the one proposed is for M- The initialization of calibration method of IMU human motion capture system.
A kind of initialization of calibration method for M-IMU human motion capture system realizes according to the following steps:
Step one: according to kinesiology's model and human anatomy, human body limb be divided into 17 parts and number, and Each part of human body is set up human body coordinate systemWith corresponding sensor coordinate systemSet up reference frame simultaneouslyWherein i=1,2,3 ..., 17;
Step 2: M-IMU sensor is fixed on 17 corresponding limbs;
Step 3: set three kinds of calibration postures, i.e. calibration posture 1, calibration posture 2 and calibration posture 3;Record every kind of calibration Sensor measurement data under postureWhereinInstitute StateOn respectively 17 limbs, sensor coordinate system is relative to the spin matrix data of reference frame,The sensor coordinate system that respectively n time measurement obtains is relative to the spin matrix data of reference frame;
Step 4: the M-IMU sensor measurement data obtained step 3 under every kind of calibration posture accumulates average in doing, Average measurement to M-IMU sensor under three kinds of calibration posturesWherein DescribedIt is respectivelyAverage magnitude measured value;
Step 5: calculating the relative rotation matrices of shoulder joint under three kinds of calibration postures, the M-IMU that integrating step four obtains passes The average magnitude measured value of sensor, utilizes what hand and eye calibrating algorithm obtained trunk sensor coordinate system and human body coordinate system to rotate against square Battle array
Step 6: the trunk sensor coordinate system obtained according to step 5 obtains with the relative rotation matrices of human body coordinate system Trunk human body coordinate system is relative to the spin matrix of reference frame
Step 7: calibrating posture 1 time, the human body coordinate system of trunk, basin bone, head, left upper extremity and left lower extremity is the most flat OK, i.e.The human body coordinate system of right upper extremity and right lower extremity be parallel to each other and with the human body coordinate of trunk System's one relative rotation matrices of differenceI.e.Wherein said For trunk, basin bone, head, left upper extremity and left lower extremity limbs human body coordinate system relative to the spin matrix of reference frame,For the human body coordinate system of right upper extremity and right lower extremity relative to the spin matrix of reference frame;
Step 8: the sensor measurement under calibration posture 1 obtained according to step 4 And the human body coordinate system that obtains of step 7 is relative to the spin matrix of reference frameObtain the sensor of each limbs Coordinate system is relative to the relative rotation matrices of human body coordinate system
Invention effect:
(1) relative rotation matrices obtained between sensor coordinate system and human body coordinate system can be calibrated, reduce installation position Putting the inaccurate error brought, compared with not carrying out calibration actions, the precision of action capture is its 3 times.
(2) calibrating mode is simple, the shortest, and only then sensor need to be arranged on each dismemberent of health does three standard appearances Gesture can realize calibration, it is to avoid loaded down with trivial details action calibration, and because the nonstandard error brought of action.
(3) cheap, it is not necessary to by other equipment, utilize IMU sensor can realize calibration.According to sides such as optics Method is calibrated, and needs to increase extra optical device, is greatly improved calibration cost.This method can be substantially reduced and be calibrated to This.
(4) accumulate in have employed average algorithm to sensor acquisition to data carried out pretreatment, ensure follow-up calibration The reliability of algorithm.
Accompanying drawing explanation
Fig. 1 human body limb is numbered
Fig. 2 reference frame and human body coordinate system schematic diagram;
Fig. 3 calibrates posture 1 illustraton of model;
Fig. 4 calibrates posture 2 illustraton of model;
Fig. 5 calibrates posture 3 illustraton of model.
Detailed description of the invention
Detailed description of the invention one: a kind of initialization of calibration method following steps for M-IMU human motion capture system:
Hinged multi-rigid model is widely used in human motion analysis and biomechanics Research, and this model is by human body Each limbs regard rigid body as, ignore the translational motion of human synovial, only consider its rotary motion.Simplify anthropometric dummy by head, Trunk, basin bone, upper limb and lower limb composition.
Step one: according to kinesiology's model and human anatomy, human body limb be divided into 17 parts and number, as Shown in Fig. 1, and each part of human body is set up human body coordinate systemWith corresponding sensor coordinate systemSet up ginseng simultaneously Examine coordinate systemWherein i=1,2,3 ..., 17;
Step 2: M-IMU sensor is fixed on 17 corresponding limbs;
Step 3: set three kinds of calibration postures, i.e. calibration posture 1, calibration posture 2 and calibration posture 3;Record every kind of calibration Sensor measurement data under postureWhereinInstitute StateOn respectively 17 limbs, sensor coordinate system is relative to the spin matrix data of reference frame,The sensor coordinate system that respectively n time measurement obtains is relative to the spin matrix data of reference frame;
Step 4: the M-IMU sensor measurement data obtained step 3 under every kind of calibration posture accumulates average in doing, Average measurement to M-IMU sensor under three kinds of calibration posturesWherein DescribedIt is respectivelyAverage magnitude measured value;
Step 5: calculating the relative rotation matrices of shoulder joint under three kinds of calibration postures, the M-IMU that integrating step four obtains passes The average measurement of sensor, utilizes hand and eye calibrating algorithm to obtain the relative rotation matrices of trunk sensor coordinate system and human body coordinate system
Step 6: the trunk sensor coordinate system obtained according to step 5 obtains with the relative rotation matrices of human body coordinate system Trunk human body coordinate system is relative to the spin matrix of reference frame
Step 7: calibrating posture 1 time, the human body coordinate system of trunk, basin bone, head, left upper extremity and left lower extremity is the most flat OK, i.e.The human body coordinate system of right upper extremity and right lower extremity be parallel to each other and with the human body coordinate of trunk System's one relative rotation matrices of differenceI.e.Wherein said For trunk, basin bone, head, left upper extremity and left lower extremity human body coordinate system relative to the spin matrix of reference frame,For the human body coordinate system of right upper extremity and right lower extremity relative to the spin matrix of reference frame;
Step 8: the sensor measurement under calibration posture 1 obtained according to step 4With And the human body coordinate system that obtains of step 7 is relative to the spin matrix of reference frameThe sensor obtaining each limbs is sat Mark system is relative to the relative rotation matrices of human body coordinate system
Detailed description of the invention two: present embodiment is unlike detailed description of the invention one: to human body in described step one Each part set up human body coordinate systemWith corresponding sensor coordinate systemSet up reference frame simultaneouslySpecifically For:
According to kinesiology's model, human body it is divided into 17 parts and numbers;Motion morphology in conjunction with human body defines human body Coordinate system, in body erect, both hands are flattened when health both sides, set up people on trunk, basin bone, head, left upper extremity, left lower extremity Body coordinate system, x-axis sensing health front, y-axis sensing left side of body, z-axis is vertically upward;The human body coordinate of right upper extremity and right lower extremity System be parallel to each other but with the human body coordinate system specular of left limb, the x-axis of the human body coordinate system of right upper extremity and right lower extremity Pointing to health front, y-axis points to right side of body, and z-axis is vertically downward;Reference frame is terrestrial coordinate system, and X* axle points to earth magnetism North, Y* axle points to east, and Z* axle is vertically downward.The schematic diagram of reference frame and human body coordinate system schematic diagram is as shown in Figure 2.Sensing Device coordinate systemBeing determined by the installation site of sensor internal gyroscope, M-IMU sensor is arbitrarily installed in each part.
Other step and parameter are identical with detailed description of the invention one.
Detailed description of the invention three: present embodiment is unlike detailed description of the invention one or two: described step 3 lieutenant colonel Quasi-posture 1, calibration posture 2 and calibration posture 3 particularly as follows:
Calibration posture 1 is for keeping health and lower limb upright, and both feet close up, and both arms naturally droop, and the centre of the palm is towards inside health;
Calibration posture 2 is for keeping health and lower limb upright, and both feet close up, and both hands are flattened to health both sides, and the centre of the palm is downward;
Calibration posture 3 is for keeping health and lower limb upright, and both feet close up, and both arms stretch forward flat with shoulder, and the centre of the palm is downward.
User performs three kinds of calibration postures successively, and every kind of calibration posture keeps ten seconds, at every kind of posture lower sensor Data are gathered with the sample frequencys of 10 hertz.Three kinds of calibration postures are as shown in Fig. 3, Fig. 4 and Fig. 5.
Other step and parameter are identical with detailed description of the invention one or two.
Detailed description of the invention four: present embodiment is unlike one of detailed description of the invention one to three: described step 4 In step 3 is accumulate under every kind of calibration posture, the M-IMU sensor measurement data that obtains does average, obtain three kinds of calibrations The average measurement of M-IMU sensor under postureParticularly as follows:
User inevitably shakes when performing calibration posture, accumulates average algorithm and survey sensor in utilization Amount is averaged.
As a example by the measurement of one of them sensor, n group is measuredDo average:
R ‾ = arg min R ∈ G Σ t = 1 N d 2 ( R t , R ) - - - ( 1 )
Wherein R is spin matrix, RtFor measure every time spin matrix.
This interior core accumulateing average algorithm is will to utilize logarithmic mapping that from Lie group SO (3), spin matrix is transformed into Lie algebra In so (3), then doing averagely at so (3), be finally transformed into SO (3), algorithm is as follows:
Calculate the error matrix on SO (3)Error matrix is converted to so (3) from SO (3):
Δθ t = cos - 1 ( t r a c e ( ΔR t ) - 1 2 )
Δr t = 0 Δθ t = 0 Δθ t 2 sinΔθ t ( ΔR t - ΔR t T ) Δθ t ≠ 0
Wherein Δ θtFor the anglec of rotation of each limbs sensor, Δ r in so (3)tPass for each limbs in so (3) The skew symmetric matrix form of the rotary shaft vector of sensor.
It is averaging error matrix at so (3):
Δ r ‾ = 1 N Σ t = 1 N Δr t
Mean error matrix is transformed into SO (3) from so (3):
Δ θ ‾ = 1 2 T r a c e ( Δ r ‾ T Δ r ‾ )
Δ R = e Δ r ‾ = I 3 Δ θ ‾ = 0 I 3 + sin Δ θ ‾ Δ θ ‾ Δ r ‾ + 1 - cos Δ θ ‾ Δ θ ‾ 2 Δ r ‾ 2 Δ θ ‾ ≠ 0
WhereinAverage for Δ θ.
SO (3) calculates mean matrix:
R ‾ = R ‾ Δ R
Other step and parameter are identical with one of detailed description of the invention one to three.
Detailed description of the invention five: present embodiment is unlike one of detailed description of the invention one to four: described step 5 The relative rotation matrices of shoulder joint under middle calculating three kinds calibration posture, the average survey of the M-IMU sensor that integrating step four obtains Amount, utilizes hand and eye calibrating algorithm to obtain the relative rotation matrices of trunk sensor coordinate system and human body coordinate systemConcrete mistake Cheng Wei:
When calibrating posture 1, the human body coordinate system of left upper extremity is counterclockwise around X-axis relative to trunk human body coordinate system 90-degree rotation, now the spin matrix of shoulder joint is:
R 1 B 2 B 4 = 1 0 0 0 0 - 1 0 1 0
When calibrating posture 2, the human body coordinate system of left upper extremity is parallel with trunk human body coordinate system, now shoulder joint Spin matrix be:
R 2 B 2 B 4 = 1 0 0 0 1 0 0 0 1
When calibrating posture 3, the human body coordinate system of left upper extremity is the most counterclockwise relative to trunk human body coordinate system 90-degree rotation, now the spin matrix of shoulder joint is:
R 3 B 2 B 4 = 0 - 1 0 1 0 0 0 0 1
Under three kinds of calibration postures, the kinematical equation of left shoulder joint is as follows:
R ‾ eS 2 k R S 2 B 2 R B 2 B 4 k = R ‾ eS 4 k R S 4 B 4 , k = 1 , 2 , 3 - - - ( 2 )
It is hand and eye calibrating equation by formula (2) abbreviation:
A j X = XB j , j = 1 , 2 X = R S 1 B 1 A j = ( R eS 1 j + 1 ) T R eS 2 j + 1 ( R eS 2 j ) T R eS 1 j B j = R B 1 B 2 j + 1 ( R B 1 B 2 j ) T - - - ( 3 )
WhereinFor trunk human body coordinate system relative to the spin matrix of basin bone human body coordinate system;
The relative rotation matrices of trunkBy using method of least square to obtain in Lie group:
A ~ = α 1 α 2 α 1 × α 2 B ~ = β 1 β 2 β 1 × β 2 X = A ~ B ~ - 1 - - - ( 4 )
Wherein vector αjj, j=1,2 is matrix Aj,Bj, j=1, the normalized index coordinates of 2, by the following method Calculate and obtain:
a j / b j = cos - 1 ( t r a c e ( A j / B j ) - 1 2 ) α j , β j = 1 2 sin ( a j / b j ) R 32 - R 23 R 13 - R 31 R 21 - R 12 , R = A j / B j - - - ( 5 )
The relative rotation matrices of trunk sensor coordinate system and human body coordinate system is:
R S 2 B 2 = ( R ‾ eS 2 1 ) T R ‾ eS 1 1 R S 1 B 1 R B 1 B 2 1 - - - ( 6 ) .
Other step and parameter are identical with one of detailed description of the invention one to four.
Detailed description of the invention six: present embodiment is unlike one of detailed description of the invention one to five: described according to step The trunk human body coordinate system spin matrix relative to reference frame is obtained in rapid sixParticularly as follows:
R eB 2 = R eS 2 R S 2 B 2 - - - ( 7 ) .
Other step and parameter are identical with one of detailed description of the invention one to five.
Detailed description of the invention seven: present embodiment is unlike one of detailed description of the invention one to six: described step 7 The human body coordinate system of middle right upper extremity and right lower extremity is parallel to each other and differs one with the human body coordinate system of trunk and rotates against square Battle arrayI.e.Particularly as follows:
The human body coordinate system of right upper extremity and right lower extremity is parallel to each other and differs a rotation with the human body coordinate system of trunk Matrix
R B L R = 1 0 0 0 1 0 0 0 1
The human body coordinate system of right upper extremity and right lower extremity relative to the spin matrix of reference frame is:
Other step and parameter are identical with one of detailed description of the invention one to six.
Detailed description of the invention eight: present embodiment is unlike one of detailed description of the invention one to seven: described step 8 In obtain the sensor coordinate system relative rotation matrices relative to human body coordinate system of each limbsDetailed process be:
The sensor coordinate system of trunk and left limb relative to the relative rotation matrices of human body coordinate system is:
R S i 1 B 1 = ( R eS i 1 ) T R eB 2 , i 1 = 1 , 2 , ... , 10 - - - ( 8 )
The sensor coordinate system of trunk and right side limbs relative to the relative rotation matrices of human body coordinate system is:
R S i 2 B 1 = ( R eS i 2 ) T R eB 2 R B L R , i 2 = 11 , 12 , ... , 17 - - - ( 9 ) .
Other step and parameter are identical with one of detailed description of the invention one to seven.
Embodiment one:
Because the reason of mounting means, on each limbs of human body, sensor coordinate system and corresponding human body coordinate system are not weigh Close.In order to improve the precision of capturing movement, so needing that it is carried out initialization of calibration to obtain sensor coordinate system and human body The relative rotation matrices of coordinate system.In order to ask for this relative rotation matrices we firstly the need of each by sensor measurement human body The attitude data of individual limbs.Sensor uses adding of 3 axis accelerometers, 3 axle gyroscopes and the 3 axle each limbs of magnetometer measures human body Speed, angular speed and Geomagnetism Information.According to human skeleton model, only sensor is placed at skeleton and just can be compared More accurate data, but it is because the restriction of mounting means, the position fewer with human body skin can only be installed, as far as possible Place with skeleton laminating.Research shows that laying of sensor should reduce the impact that soft tissue brings as far as possible.In consideration State principle, when person upright's both arms naturally droop, the sensor of large arm is placed in the flesh of triceps brachii and elbow joint junction Tendon position, little arm sensor is placed in forearm back, and the sensor of palm is placed in the back of the hand center.Leg sensor also in compliance with Same principle so that it is fit with skeleton.
Three standard gestures i.e. standard gestures 1, standard gestures 2, standard gestures 3 is taken turns doing after installing sensor.Sensing Device measures many group acceleration of each limbs, angular velocity and Geomagnetism Information.Then by Kalman filtering by sensor measurement Data carry out merging the spin matrix obtaining each limbs sensor coordinate system relative to reference frame Because human body can produce shake unavoidably when doing standard gestures, so we accumulate flat in asking it by the multi-group data measuring it Equal method obtains a meansigma methodsThis algorithm utilizes logarithmic mapping by spin matrix It is transformed into Lie algebra so (3) from Lie group SO (3), then does averagely at so (3), reconvert to SO (3).Finally obtain sensor Coordinate system is relative to the meansigma methods of the spin matrix of reference frame.Under three standard gestures, we can obtain shoulder joint phase Spin matrix for reference frameThen in conjunction with kinematical equationBy its abbreviation it is Method of least square is being used to obtain trunk sensor coordinate system relative to human body coordinate system in Lie group after hand and eye calibrating equation Spin matrixThen the trunk human body coordinate system spin matrix relative to reference frame is tried to achieveAt standard gestures 1 The human body coordinate system of head portion, trunk, basin bone and left limb is parallel to each other, and the rotating against of known right-hand limbs and trunk Quaternary number.So finally can obtain each in the hope of the human body coordinate system of each limbs relative to the spin matrix of reference frame The sensor coordinate system of individual limbs is relative to the spin matrix of human body coordinate system

Claims (8)

1. the initialization of calibration method for M-IMU human motion capture system, it is characterised in that described for M-IMU The initialization of calibration method of human motion capture system comprises the following steps:
Step one: according to kinesiology's model and human anatomy, human body limb be divided into 17 parts and number, and to people Each part of body sets up human body coordinate systemWith corresponding sensor coordinate systemSet up reference frame simultaneouslyIts Middle i=1,2,3 ..., 17;
Step 2: M-IMU sensor is fixed on 17 corresponding limbs;
Step 3: set three kinds of calibration postures, i.e. calibration posture 1, calibration posture 2 and calibration posture 3;Record every kind of calibration posture Under sensor measurement dataWherein DescribedOn respectively 17 limbs, sensor coordinate system is relative to the spin matrix number of reference frame According to,The sensor coordinate system that respectively n time measurement obtains is relative to the spin matrix number of reference frame According to;
Step 4: the M-IMU sensor measurement data obtained step 3 under every kind of calibration posture accumulates average in doing, obtain The average measurement of M-IMU sensor under three kinds of calibration posturesWherein saidIt is respectivelyAverage magnitude measured value;
Step 5: calculate the relative rotation matrices of shoulder joint, the M-IMU sensor that integrating step four obtains under three kinds of calibration postures Average magnitude measured value, utilize hand and eye calibrating algorithm to obtain the relative rotation matrices of trunk sensor coordinate system and human body coordinate system
Step 6: the trunk sensor coordinate system obtained according to step 5 obtains trunk with the relative rotation matrices of human body coordinate system Human body coordinate system is relative to the spin matrix of reference frame
Step 7: calibrating posture 1 time, the human body coordinate system of trunk, basin bone, head, left upper extremity and left lower extremity is parallel to each other, i.e.The human body coordinate system of right upper extremity and right lower extremity be parallel to each other and with the human body coordinate system phase of trunk Differ from a relative rotation matricesI.e.Wherein saidFor Trunk, basin bone, head, left upper extremity and left lower extremity limbs human body coordinate system relative to the spin matrix of reference frame,For the human body coordinate system of right upper extremity and right lower extremity relative to the spin matrix of reference frame;
Step 8: the sensor measurement under calibration posture 1 obtained according to step 4With And the human body coordinate system that obtains of step 7 is relative to the spin matrix of reference frameThe sensor obtaining each limbs is sat Mark system is relative to the relative rotation matrices of human body coordinate system
A kind of initialization of calibration method for M-IMU human motion capture system the most according to claim 1, its feature Being, in described step one, each part to human body sets up human body coordinate systemWith corresponding sensor coordinate systemWith Shi Jianli reference frameParticularly as follows:
In body erect, both hands are flattened when health both sides, set up human body on trunk, basin bone, head, left upper extremity, left lower extremity Coordinate system, x-axis sensing health front, y-axis sensing left side of body, z-axis is vertically upward;The human body coordinate system of right upper extremity and right lower extremity X-axis point to health front, y-axis point to right side of body, z-axis is vertically downward;Reference frame is terrestrial coordinate system, and X* axle points to Magnetic north, Y* axle points to east, and Z* axle is vertically downward.
A kind of initialization of calibration method for M-IMU human motion capture system the most according to claim 2, its feature Be, described step 3 alignment posture 1, calibration posture 2 and calibration posture 3 particularly as follows:
Calibration posture 1 is for keeping health and lower limb upright, and both feet close up, and both arms naturally droop, and the centre of the palm is towards inside health;
Calibration posture 2 is for keeping health and lower limb upright, and both feet close up, and both hands are flattened to health both sides, and the centre of the palm is downward;
Calibration posture 3 is for keeping health and lower limb upright, and both feet close up, and both arms stretch forward flat with shoulder, and the centre of the palm is downward.
A kind of initialization of calibration method for M-IMU human motion capture system the most according to claim 3, its feature Being, the M-IMU sensor measurement data obtained step 3 under every kind of calibration posture in described step 4 accumulates average in doing, Obtain the average measurement of M-IMU sensor under three kinds of calibration posturesParticularly as follows:
N group is measuredDo average:
R ‾ = argmin R ∈ G Σ t = 1 N d 2 ( R t , R ) - - - ( 1 )
Wherein R is spin matrix, RtFor the spin matrix measured every time.
A kind of initialization of calibration method for M-IMU human motion capture system the most according to claim 4, its feature It is, described step 5 calculates the relative rotation matrices of shoulder joint, the M-IMU that integrating step four obtains under three kinds of calibration postures The average measurement of sensor, utilizes what hand and eye calibrating algorithm obtained trunk sensor coordinate system and human body coordinate system to rotate against square Battle arrayDetailed process be:
When calibrating posture 1, the human body coordinate system of left upper extremity rotates around X-axis counterclockwise relative to trunk human body coordinate system 90 degree, now the spin matrix of shoulder joint is:
When calibrating posture 2, the human body coordinate system of left upper extremity is parallel with trunk human body coordinate system, the now rotation of shoulder joint Torque battle array is:
When calibrating posture 3, the human body coordinate system of left upper extremity rotates the most counterclockwise relative to trunk human body coordinate system 90 degree, now the spin matrix of shoulder joint is:
Under three kinds of calibration postures, the kinematical equation of left shoulder joint is as follows:
R ‾ eS 2 k R S 2 B 2 R B 2 B 4 k = R ‾ eS 4 k R S 4 B 4 , k = 1 , 2 , 3 - - - ( 2 )
It is hand and eye calibrating equation by formula (2) abbreviation:
AjX=XBj, j=1,2 (3)
X = R S 1 B 1
A j = ( R eS 1 j + 1 ) T R eS 2 j + 1 ( R eS 2 j ) T R eS 1 j
B j = R B 1 B 2 j + 1 ( R B 1 B 2 j ) T
WhereinFor trunk human body coordinate system relative to the spin matrix of basin bone human body coordinate system;
The relative rotation matrices of trunkBy using method of least square to obtain in Lie group:
A ~ = α 1 α 2 α 1 × α 2 B ~ = β 1 β 2 β 1 × β 2 X = A ~ B ~ - 1 - - - ( 4 )
Wherein vector αjj, j=1,2 is matrix Aj,Bj, j=1, the normalized index coordinates of 2, calculate by the following method and obtain :
a j / b j = cos - 1 ( t r a c e ( A j / B j ) - 1 2 ) α j , β j = 1 2 sin ( a j / b j ) R 32 - R 23 R 13 - R 31 R 21 - R 12 , R = A j / B j - - - ( 5 )
The relative rotation matrices of trunk sensor coordinate system and human body coordinate system is:
R S 2 B 2 = ( R ‾ eS 2 1 ) T R ‾ eS 1 1 R S 1 B 1 R B 1 B 2 1 - - - ( 6 ) .
A kind of initialization of calibration method for M-IMU human motion capture system the most according to claim 5, its feature It is, described according to step 6 obtains the trunk human body coordinate system spin matrix relative to reference frameParticularly as follows:
R eB 2 = R eS 2 R S 2 B 2 - - - ( 7 ) .
A kind of initialization of calibration method for M-IMU human motion capture system the most according to claim 6, its feature Being, in described step 7, the human body coordinate system of right upper extremity and right lower extremity is parallel to each other and differs with the human body coordinate system of trunk One relative rotation matricesI.e.Particularly as follows:
The human body coordinate system of right upper extremity and right lower extremity is parallel to each other and differs a spin matrix with the human body coordinate system of trunk
R B L R = 1 0 0 0 1 0 0 0 1
The human body coordinate system of right upper extremity and right lower extremity relative to the spin matrix of reference frame is:
A kind of initialization of calibration method for M-IMU human motion capture system the most according to claim 7, its feature It is, described step 8 obtains the sensor coordinate system relative rotation matrices relative to human body coordinate system of each limbs Detailed process be:
The sensor coordinate system of trunk and left limb relative to the relative rotation matrices of human body coordinate system is:
R S i 1 B 1 = ( R eS i 1 ) T R eB 2 , i 1 = 1 , 2 , ... , 10 - - - ( 8 )
The sensor coordinate system of trunk and right side limbs relative to the relative rotation matrices of human body coordinate system is:
R S i 2 B 1 = ( R eS i 2 ) T R eB 2 R B L R , i 2 = 11 , 12 , ... , 17 - - - ( 9 ) .
CN201610841974.1A 2016-09-22 2016-09-22 A kind of initialization of calibration method for M-IMU human motion capture system Active CN106153077B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610841974.1A CN106153077B (en) 2016-09-22 2016-09-22 A kind of initialization of calibration method for M-IMU human motion capture system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610841974.1A CN106153077B (en) 2016-09-22 2016-09-22 A kind of initialization of calibration method for M-IMU human motion capture system

Publications (2)

Publication Number Publication Date
CN106153077A true CN106153077A (en) 2016-11-23
CN106153077B CN106153077B (en) 2019-06-14

Family

ID=57340876

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610841974.1A Active CN106153077B (en) 2016-09-22 2016-09-22 A kind of initialization of calibration method for M-IMU human motion capture system

Country Status (1)

Country Link
CN (1) CN106153077B (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106871928A (en) * 2017-01-18 2017-06-20 北京工业大学 Strap-down inertial Initial Alignment Method based on Lie group filtering
CN106918352A (en) * 2017-05-02 2017-07-04 桂林电子科技大学 A kind of correction of course method of hand-held MEMS magnetometers
CN107314778A (en) * 2017-08-04 2017-11-03 广东工业大学 A kind of scaling method of relative attitude, apparatus and system
CN107340889A (en) * 2017-06-30 2017-11-10 华勤通讯技术有限公司 A kind of positioning initialization method and device
CN108030496A (en) * 2017-12-02 2018-05-15 北京工业大学 A kind of human upper limb shoulder Glenohumeral joint pivot and upper arm lifting angle coupled relation measuring method
CN108324282A (en) * 2018-01-31 2018-07-27 北京工业大学 A kind of shoulders of human body Glenohumeral joint rotation center movable information detecting system
CN108378854A (en) * 2018-02-07 2018-08-10 北京摩高科技有限公司 Computational methods and attitude measurement capture analysis system
CN108852360A (en) * 2018-03-16 2018-11-23 北京工业大学 A kind of human body lower limbs hip and knee angle detection system and method
CN109211267A (en) * 2018-08-14 2019-01-15 广州虚拟动力网络技术有限公司 A kind of inertia action captures posture quick calibration method and system
CN109407840A (en) * 2018-10-18 2019-03-01 看见故事(苏州)影视文化发展有限公司 A kind of visual angle effect method of motion capture technology
CN109711302A (en) * 2018-12-18 2019-05-03 北京诺亦腾科技有限公司 Model parameter calibration method, device, computer equipment and storage medium
CN110398256A (en) * 2019-06-19 2019-11-01 北京摩高科技有限公司 A kind of initial calibration method of the single posture of human body
CN110502107A (en) * 2019-07-26 2019-11-26 森博迪(深圳)科技有限公司 Wearable real-time action instructs system and method
CN111895997A (en) * 2020-02-25 2020-11-06 哈尔滨工业大学 Human body action acquisition method based on inertial sensor without standard posture correction
WO2021114666A1 (en) * 2019-12-11 2021-06-17 山东大学 Human body safety evaluation method and system in human-machine collaboration

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101799934A (en) * 2010-04-02 2010-08-11 北京大学软件与微电子学院无锡产学研合作教育基地 Real time human movement capture system based on micro electro mechanical inertia sensing network
CN103517741A (en) * 2011-05-05 2014-01-15 高通股份有限公司 A proximity sensor mesh for motion capture
CN103813771A (en) * 2011-09-26 2014-05-21 索尼公司 Movement assisting device and movement assisting method, computer program, and program storage medium
CN104147770A (en) * 2014-07-24 2014-11-19 燕山大学 Inertial-sensor-based wearable hemiplegia rehabilitation apparatus and strap-down attitude algorithm
CN104457741A (en) * 2014-12-08 2015-03-25 燕山大学 Human arm movement tracing method based on ant colony algorithm error correction
CN105551059A (en) * 2015-12-08 2016-05-04 国网山西省电力公司技能培训中心 Power transformation simulation human body motion capturing method based on optical and inertial body feeling data fusion

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101799934A (en) * 2010-04-02 2010-08-11 北京大学软件与微电子学院无锡产学研合作教育基地 Real time human movement capture system based on micro electro mechanical inertia sensing network
CN103517741A (en) * 2011-05-05 2014-01-15 高通股份有限公司 A proximity sensor mesh for motion capture
CN103813771A (en) * 2011-09-26 2014-05-21 索尼公司 Movement assisting device and movement assisting method, computer program, and program storage medium
CN104147770A (en) * 2014-07-24 2014-11-19 燕山大学 Inertial-sensor-based wearable hemiplegia rehabilitation apparatus and strap-down attitude algorithm
CN104457741A (en) * 2014-12-08 2015-03-25 燕山大学 Human arm movement tracing method based on ant colony algorithm error correction
CN105551059A (en) * 2015-12-08 2016-05-04 国网山西省电力公司技能培训中心 Power transformation simulation human body motion capturing method based on optical and inertial body feeling data fusion

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106871928A (en) * 2017-01-18 2017-06-20 北京工业大学 Strap-down inertial Initial Alignment Method based on Lie group filtering
CN106871928B (en) * 2017-01-18 2020-09-25 北京工业大学 Strap-down inertial navigation initial alignment method based on lie group filtering
CN106918352A (en) * 2017-05-02 2017-07-04 桂林电子科技大学 A kind of correction of course method of hand-held MEMS magnetometers
CN107340889A (en) * 2017-06-30 2017-11-10 华勤通讯技术有限公司 A kind of positioning initialization method and device
CN107340889B (en) * 2017-06-30 2020-05-12 华勤通讯技术有限公司 Positioning initialization method and device
CN107314778A (en) * 2017-08-04 2017-11-03 广东工业大学 A kind of scaling method of relative attitude, apparatus and system
CN107314778B (en) * 2017-08-04 2023-02-10 广东工业大学 Calibration method, device and system for relative attitude
CN108030496A (en) * 2017-12-02 2018-05-15 北京工业大学 A kind of human upper limb shoulder Glenohumeral joint pivot and upper arm lifting angle coupled relation measuring method
CN108324282A (en) * 2018-01-31 2018-07-27 北京工业大学 A kind of shoulders of human body Glenohumeral joint rotation center movable information detecting system
CN108324282B (en) * 2018-01-31 2021-02-05 北京工业大学 Human body shoulder pelvis brachial joint rotation center motion information detection system
CN108378854A (en) * 2018-02-07 2018-08-10 北京摩高科技有限公司 Computational methods and attitude measurement capture analysis system
CN108378854B (en) * 2018-02-07 2021-10-29 北京摩高科技有限公司 Attitude measurement capturing and analyzing system and calculation method thereof
CN108852360A (en) * 2018-03-16 2018-11-23 北京工业大学 A kind of human body lower limbs hip and knee angle detection system and method
CN109211267A (en) * 2018-08-14 2019-01-15 广州虚拟动力网络技术有限公司 A kind of inertia action captures posture quick calibration method and system
CN109407840A (en) * 2018-10-18 2019-03-01 看见故事(苏州)影视文化发展有限公司 A kind of visual angle effect method of motion capture technology
CN109711302A (en) * 2018-12-18 2019-05-03 北京诺亦腾科技有限公司 Model parameter calibration method, device, computer equipment and storage medium
CN110398256B (en) * 2019-06-19 2021-12-03 北京摩高科技有限公司 Initial correction method for single posture of human body
CN110398256A (en) * 2019-06-19 2019-11-01 北京摩高科技有限公司 A kind of initial calibration method of the single posture of human body
CN110502107A (en) * 2019-07-26 2019-11-26 森博迪(深圳)科技有限公司 Wearable real-time action instructs system and method
WO2021114666A1 (en) * 2019-12-11 2021-06-17 山东大学 Human body safety evaluation method and system in human-machine collaboration
CN111895997A (en) * 2020-02-25 2020-11-06 哈尔滨工业大学 Human body action acquisition method based on inertial sensor without standard posture correction

Also Published As

Publication number Publication date
CN106153077B (en) 2019-06-14

Similar Documents

Publication Publication Date Title
CN106153077A (en) A kind of initialization of calibration method for M IMU human motion capture system
CN108939512B (en) Swimming posture measuring method based on wearable sensor
CN104757976B (en) A kind of Human Body Gait Analysis method and system based on Multi-sensor Fusion
US9622686B1 (en) Gait perturbation system and a method for testing and/or training a subject using the same
CN104613963B (en) Pedestrian navigation system and navigation locating method based on human cinology's model
US20150149104A1 (en) Motion Tracking Solutions Using a Self Correcting Three Sensor Architecture
Liu et al. A wearable human motion tracking device using micro flow sensor incorporating a micro accelerometer
US20100194879A1 (en) Object motion capturing system and method
KR101214227B1 (en) method of motion tracking.
US20130310711A1 (en) Joint motion measuring apparatus and measuring method thereof
CN102670217A (en) Wearable sensor measuring device and method for lower limb joint acting force and moment
CN103175502A (en) Attitude angle detecting method based on low-speed movement of data glove
Ueda et al. Measurement of angular motion in golf swing by a local sensor at the grip end of a golf club
CN110609621B (en) Gesture calibration method and human motion capture system based on microsensor
CN116027905A (en) Double kayak upper limb motion capturing method based on inertial sensor
Scapellato et al. In-use calibration of body-mounted gyroscopes for applications in gait analysis
Cotton et al. Wearable monitoring of joint angle and muscle activity
CN202932930U (en) Wearable sensor measurement device for acting forces and moments related to lower limb joints of human body
CN109297507B (en) Human body limb movement capturing method free of alignment action based on inertial sensor
Esfahani et al. Sharif-Human movement instrumentation system (SHARIF-HMIS): Development and validation
JP6993866B2 (en) Golf swing evaluation system and golf swing evaluation method
Hermanis et al. Grid shaped accelerometer network for surface shape recognition
Viegas et al. NUI therapeutic serious games with metrics validation based on wearable devices
Zhang et al. 3D upper limb motion modeling and estimation using wearable micro-sensors
Galinski et al. Evaluation of initialization procedures for estimating upper limb kinematics with MARG sensors

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 215625 Jinnan Road Science and Technology Pioneer Park A01, Jinfeng Town, Zhangjiagang City, Suzhou City, Jiangsu Province

Applicant after: Suzhou Tantra Intelligent Technology Co.,Ltd.

Address before: 215625 Jinnan Road Science and Technology Pioneer Park A01, Jinfeng Town, Zhangjiagang City, Suzhou City, Jiangsu Province

Applicant before: SUZHOU TANTRA AUTOMATION TECHNOLOGY CO.,LTD.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20230111

Address after: Room 1702, building 1, No. 188, Fuchunjiang Road, high tech Zone, Suzhou, Jiangsu 215000

Patentee after: Suzhou Kanglian Medical Technology Co.,Ltd.

Address before: 215625 Jinnan Road Science and Technology Pioneer Park A01, Jinfeng Town, Zhangjiagang City, Suzhou City, Jiangsu Province

Patentee before: Suzhou Tantra Intelligent Technology Co.,Ltd.

TR01 Transfer of patent right