CN105690386A - Teleoperation system and teleoperation method for novel mechanical arm - Google Patents
Teleoperation system and teleoperation method for novel mechanical arm Download PDFInfo
- Publication number
- CN105690386A CN105690386A CN201610168048.2A CN201610168048A CN105690386A CN 105690386 A CN105690386 A CN 105690386A CN 201610168048 A CN201610168048 A CN 201610168048A CN 105690386 A CN105690386 A CN 105690386A
- Authority
- CN
- China
- Prior art keywords
- finger
- current time
- attitude
- joint
- mechanical arm
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1679—Programme controls characterised by the tasks executed
- B25J9/1689—Teleoperation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1628—Programme controls characterised by the control loop
- B25J9/1635—Programme controls characterised by the control loop flexible-arm control
Landscapes
- Engineering & Computer Science (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Manipulator (AREA)
Abstract
The invention relates to a teleoperation system and a teleoperation method for a novel mechanical arm. The teleoperation system for the novel mechanical arm comprises a data glove, a data processing and displaying unit, a mechanical arm control unit, a mechanical arm and a manipulator, wherein the data processing and displaying unit is used for resolving motion information received from the data glove to obtain postures of a big arm, a small arm, a hand back and various fingers of a human body, and converting the postures into control instructions; the mechanical arm control unit performs teleoperation on the mechanical arm and the manipulator, so that the condition that the arms and the hand of the human body control the mechanical arm and the fingers control the manipulator is realized; by using a mode of separately controlling the mechanical arm and the manipulator, respective movement characteristics of the mechanical arm and the manipulator can be fully exerted, so that the mechanical arm can finish complex operation like a human hand; the skillful movement of the human arm can be reproduced in real time by performing teleoperation on the mechanical arm by the human arms; and the mechanical arm does not need offline motion trajectory planning, so that relevant tasks are realized more quickly.
Description
Technical field
The invention discloses a kind of mechanical arm remote control system and teleoperation method, it is possible to by human hand movement real-time operation mechanical arm, belong to robotics。
Background technology
Human-computer interaction technology fast development in recent years, it carries out interaction mainly by the various actions action of relevant device identification people, body gesture etc. with computer virtual environment, it is achieved the functions such as game, operation training, body-building。It is wherein crucial for catching human motion。At present, human motion capture technology major part is based on image recognition technology, it is necessary to image first-class external equipment, is vulnerable to the impact of the condition such as illumination, environment。
The patent No. of applicant's earlier application is the patent of 201510271805.4, which disclose a kind of donning system for catching human upper limb locomotion information, including sensor, central processing unit, power supply, wireless module and display, and show in particular modules function and in human body large arm, forearm and set-up mode on hand, this system can completely catch upper extremity exercise information, man-machine interaction can be applied to, the fields such as remote operating, but there is modules and arrange unreasonable, dress inconvenient defect, in addition this patent solution process does not take into full account the feature of people's upper limb model, solution process is set forth insufficient。
Mechanical arm is the combination of mechanical arm and mechanical hand, is widely used, the process and assemble of factory, the operation of hazardous environment, space capsule maintenance and repair etc. in。Remote operating is control device the most frequently used in mechanical arm。Mostly all adopt the mode of keyboard or handle to carry out remote operating at present, control process single, be difficult to the remote operating of compound action, and interactive process is unnatural。
Summary of the invention
It is an object of the invention to overcome the above-mentioned deficiency of prior art, a kind of novel mechanical arm remote control system is provided, by staff, mechanical arm is carried out remote operating, make mechanical arm can complete the operation of complexity as staff, the mechanical arm remote operating by human arm, reappearing the dexterous motion of human arm in real time, mechanical arm, without carrying out the Motion trajectory of off-line, realizes inter-related task more quickly。
Another object of the present invention is in that to provide a kind of novel mechanical arm teleoperation method。
The above-mentioned purpose of the present invention is achieved mainly by following technical scheme:
A kind of novel mechanical arm remote control system, processes display unit, mechanical arm control unit, mechanical arm and mechanical hand including data glove, data, wherein:
Data glove: include several sensors and microprocessor, several sensors described are separately positioned between the large arm of human body, forearm, the back of the hand and each joint of each finger, for gathering the movable information of human upper limb different parts;Microprocessor is arranged on human body wrist, for receiving movable information from sensor, and described movable information is sent to data process display unit;Described movable information includes the angular velocity of finger part, acceleration and magnetic field value between human body large arm, forearm, the back of the hand and each joint of each finger;
Wherein the concrete method to set up of several sensors is: respectively arrange a sensor on the large arm of human body, forearm, one sensor is respectively set between root joint and the middle joint of middle finger, between middle joint and end joint and between end joint and finger tip, and with the back of the hand on arrange a sensor, totally four sensors are formed and are connected in series, in all the other fingers between root joint and the middle joint of each finger, respectively arranging a sensor between middle joint and end joint and between end joint and finger tip, three sensors on each finger are formed and are connected in series;
Data process display unit;The movable information that real-time reception microprocessor sends resolves, obtain the attitude of human body large arm, forearm, the back of the hand and each finger, and the attitude of wherein large arm, forearm and the back of the hand is converted into the control instruction of mechanical arm, the attitude of wherein each finger is converted into the control instruction of mechanical hand, and the control instruction of described mechanical arm and the control instruction of mechanical hand are sent to mechanical arm control unit in real time;
Mechanical arm control unit: real-time reception data process the control instruction of the described mechanical arm that display unit sends and the control instruction of mechanical hand, respectively mechanical arm and mechanical hand are carried out remote operating, the attitude making mechanical arm is consistent with the attitude of current time human body large arm, forearm and the back of the hand so that the attitude of mechanical hand is consistent with the attitude of current time human finger。
In above-mentioned novel mechanical arm remote control system, data process the movable information of display unit real-time reception microprocessor transmission and resolve, and the concrete grammar of the attitude obtaining human body large arm, forearm, the back of the hand and each finger is as follows:
(2.1) the attitude T of current time human body large arm, is calculated1,k, concrete formula is as follows:
T1,k=λ1×A1,k+(1-λ1)×B1,k
Wherein: A1,kFor the high frequency attitude of current time large arm, B1,kFor the low frequency attitude of current time large arm, λ1For complementary coefficient, value is 0≤λ1≤ 1;K is moment sequence, and value is the positive integer of >=1;
(2.2), calculating the attitude of current time human body forearm, the attitude of human body forearm is by relative angle T between forearm and large arm2,kRepresenting, concrete formula is as follows:
Wherein: a2x,kFor along the axial acceleration of human body forearm, a1x,kFor along the axial acceleration of human body large arm, g is acceleration of gravity;
(2.3) the attitude T of current time human body hands, is calculated3,k, concrete formula is as follows:
T3,k=λ3×A3,k+(1-λ3)×B3,k
Wherein: A3,kThe high frequency attitude of current moment hands, B3,kThe low frequency attitude of current time hands, λ3For complementary coefficient, value is 0≤λ3≤ 1;
(2.4) the attitude T of finger part between current time human finger root joint and middle joint, is calculated4,k, concrete formula is as follows:
T4,k=λ4×A4,k+(1-λ4)×B4,k
Wherein: A4,kFor the high frequency attitude of finger part, B between current moment finger root joint and middle joint4,kFor the low frequency attitude of finger part, λ between current time finger root joint and middle joint4For complementary coefficient, value is 0≤λ4≤ 1;
(2.5), the attitude of finger part between joint (6) and end joint (7) is calculated in current time human finger, by the angle T of finger part between finger root joint (5) and middle joint (6)5,kRepresenting, concrete formula is as follows:
Wherein: a5x,kFor joint along finger and the acceleration in finger part direction, a between end joint4x,kFor along the acceleration in finger part direction between finger root joint and middle joint;
(2.6), the attitude of finger part between current time human finger end joint (7) and finger tip is calculated, by the angle T of finger part between joint in finger (6) and end joint (7)6,kRepresenting, concrete formula is as follows:
Wherein: a6x,kFor along the acceleration in finger part direction between finger tips joint and finger tip。
In above-mentioned novel mechanical arm remote control system, the high frequency attitude A of current time large arm in step (2.1)1,kObtained by equation below:
A1,k=T1,k-1+g1,k×Δt
Wherein: T1,k-1For the attitude of a upper moment large arm, g1,kFor the angular velocity of current time large arm, Δ t is the resolving cycle;
The low frequency attitude B of described current time large arm1,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B1,k)=[GMG × M]/[a1,km1,ka1,k×m1,k]
Wherein: G is gravitational vectors, M is ground magnetic vector, a1,kFor the acceleration of current time large arm, m1,kFor the magnetic field value of current time large arm, C (B1,k) for B1,kAttitude matrix。
In above-mentioned novel mechanical arm remote control system, the high frequency attitude A of current time hands in step (2.3)3,kObtained by equation below:
A3,k=T3,k-1+(g3,k-g2,k)×Δt
Wherein: T3,k-1For the attitude of a upper moment hands, g3,kFor the angular velocity of current time hands, g2,kFor the angular velocity of current time forearm, Δ t is the resolving cycle;
The low frequency attitude B of described current time hands3,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B3,k)=[GMG × M]/[a3,k-a2,km3,k-m2,k(a3,k-a2,k)×(m3,k-m2,k)]
Wherein: G is gravitational vectors, M is ground magnetic vector, a3,kFor the acceleration of current time hands, a2,kFor the acceleration of current time forearm, m3,kFor the magnetic field value of current time hands, m2,kFor the magnetic field value of current time forearm, C (B3,k) for B3,kAttitude matrix。
In above-mentioned novel mechanical arm remote control system, the high frequency attitude A of finger part between current time finger root joint (5) and middle joint (6) in step (2.4)4,kObtained by equation below:
A4,k=T4,k-1+(g4,k-g3,k)×Δt
Wherein: T4,k-1For the attitude of finger part, g between a upper moment human finger root joint and middle joint4,kFor the angular velocity of finger part, g between current time finger root joint and middle joint3,kThe angular velocity of current time hands, Δ t is the resolving cycle;
The low frequency attitude B of finger part between current time finger root joint (5) and middle joint (6)4,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B4,k)=[GMG × M]/[a4,k-a3,km4,k-m3,k(a4,k-a3,k)×(m4,k-m3,k)]
Wherein: G is gravitational vectors, M is ground magnetic vector, a4,kThe acceleration of finger part, a between current time finger root joint and middle joint3,kFor the acceleration of current time hands, m4,kFor the magnetic field value of finger part, m between current time finger root joint and middle joint3,kFor the magnetic field value of current time hands, C (B4,k) for B4,kAttitude matrix。
In above-mentioned novel mechanical arm remote control system, λ1、λ3And λ4Value be: 0.2≤λ1≤ 0.5,0.2≤λ3≤ 0.5,0.2≤λ4≤ 0.5;The value of described resolving period Δ t is 0.001-0.1s。
In above-mentioned novel mechanical arm remote control system, human body the back of the hand and the sensor on each finger are arranged on glove, and glove donning is at human body on hand。
In above-mentioned novel mechanical arm remote control system, adopting soft arranging wire to be connected in data glove between each sensor and between sensor with microprocessor, microprocessor and data process between display unit by wirelessly or non-wirelessly connecting;Described data glove also includes power supply unit, and power supply unit is arranged on the bottom of microprocessor, is used for as microprocessor and sensor power。
A kind of novel mechanical arm teleoperation method, realized by mechanical arm remote control system, described mechanical arm remote control system includes data glove, data process display unit, mechanical arm control unit, mechanical arm and mechanical hand, wherein data glove includes several sensors and microprocessor, microprocessor is arranged on human body wrist, several sensors are separately positioned on the large arm of human body, forearm, between each joint of the back of the hand and each finger, concrete method to set up is: the large arm of human body, forearm respectively arranges a sensor, between root joint and the middle joint of middle finger, one sensor is respectively set between middle joint and end joint and between end joint and finger tip, and with the back of the hand on arrange a sensor, totally four sensors are formed and are connected in series, in all the other fingers between root joint and the middle joint of each finger, one sensor is respectively set between middle joint and end joint and between end joint and finger tip, three sensors on each finger are formed and are connected in series;
Concrete methods of realizing is as follows:
Step (one), data are processed display unit, mechanical arm control unit, mechanical arm and mechanical hand it is attached;
Step (two), mechanical arm remote control system initialization operation, specifically include following steps:
(1), data process display unit and the attitude of the initial time human body large arm of storage inside, forearm and the back of the hand are converted into the control instruction of mechanical arm, the attitude of each finger of initial time human body of storage inside is converted into the control instruction of mechanical hand, and the control instruction of described mechanical arm and the control instruction of mechanical hand are sent to mechanical arm control unit in real time;
(2), mechanical arm control unit real-time reception data process the control instruction of the described mechanical arm that display unit sends and the control instruction of mechanical hand, respectively mechanical arm and mechanical hand are carried out remote operating, the attitude making mechanical arm is consistent with the attitude of initial time human body large arm, forearm and the back of the hand so that the attitude of mechanical hand is consistent with the attitude of initial time human finger;
Step (three), mechanical arm remote control system real-time pursuit movement, specifically include following steps:
(1), the movable information of the sensor acquisition current time human upper limb different parts in data glove;The movable information of the described current time received from sensor is sent to data and processes display unit by microprocessor;Described movable information includes the angular velocity of finger part, acceleration and magnetic field value between human body large arm, forearm, the back of the hand and each joint of each finger;
(2), the movable information of the current time that data process the transmission of display unit real-time reception microprocessor resolves, obtain the attitude of current time human body large arm, forearm, the back of the hand and each finger, the attitude of wherein large arm, forearm and the back of the hand is converted into the control instruction of mechanical arm, the attitude of wherein each finger is converted into the control instruction of mechanical hand, and the control instruction of described mechanical arm and the control instruction of mechanical hand are sent to mechanical arm control unit in real time;
(3), mechanical arm control unit real-time reception data process the control instruction of the described mechanical arm that display unit sends and the control instruction of mechanical hand, respectively mechanical arm and mechanical hand are carried out remote operating, the attitude making mechanical arm is consistent with the attitude of current time human body large arm, forearm and the back of the hand so that the attitude of mechanical hand is consistent with the attitude of current time human finger。
In above-mentioned novel mechanical arm teleoperation method, in (2) of step (three), the concrete grammar that the movable information of current time is resolved by data process display unit is as follows:
(10.1) the attitude T of current time human body large arm, is calculated1,k, concrete formula is as follows:
T1,k=λ1×A1,k+(1-λ1)×B1,k
Wherein: A1,kFor the high frequency attitude of current time large arm, B1,kFor the low frequency attitude of current time large arm, λ1For complementary coefficient, value is 0≤λ1≤ 1;K is moment sequence, and value is the positive integer of >=1;
(10.2), calculating the attitude of current time human body forearm, the attitude of human body forearm is by relative angle T between forearm and large arm2,kRepresenting, concrete formula is as follows:
Wherein: a2x,kFor along the axial acceleration of human body forearm, a1x,kFor along the axial acceleration of human body large arm, g is acceleration of gravity;
(10.3) the attitude T of current time human body hands, is calculated3,k, concrete formula is as follows:
T3,k=λ3×A3,k+(1-λ3)×B3,k
Wherein: A3,kThe high frequency attitude of current moment hands, B3,kThe low frequency attitude of current time hands, λ3For complementary coefficient, value is 0≤λ3≤ 1;
(10.4) the attitude T of finger part between current time human finger root joint and middle joint, is calculated4,k, concrete formula is as follows:
T4,k=λ4×A4,k+(1-λ4)×B4,k
Wherein: A4,kFor the high frequency attitude of finger part, B between current moment finger root joint and middle joint4,kFor the low frequency attitude of finger part, λ between current time finger root joint and middle joint4For complementary coefficient, value is 0≤λ4≤ 1;
(10.5), the attitude of finger part between joint and end joint is calculated in current time human finger, by the angle T of finger part between finger root joint and middle joint5,kRepresenting, concrete formula is as follows:
Wherein: a5x,kFor joint along finger and the acceleration in finger part direction, a between end joint4x,kFor along the acceleration in finger part direction between finger root joint and middle joint;
(10.6), the attitude of finger part between current time human finger end joint and finger tip is calculated, by joint in finger and the angle T of finger part between end joint6,kRepresenting, concrete formula is as follows:
Wherein: a6x,kFor along the acceleration in finger part direction between finger tips joint and finger tip。
In above-mentioned novel mechanical arm teleoperation method, the high frequency attitude A of current time large arm in step (10.1)1,kObtained by equation below:
A1,k=T1,k-1+g1,k×Δt
Wherein: T1,k-1For the attitude of a upper moment large arm, g1,kFor the angular velocity of current time large arm, Δ t is the resolving cycle;
The low frequency attitude B of described current time large arm1,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B1,k)=[GMG × M]/[a1,km1,ka1,k×m1,k]
Wherein: G is gravitational vectors, M is ground magnetic vector, a1,kFor the acceleration of current time large arm, m1,kFor the magnetic field value of current time large arm, C (B1,k) for B1,kAttitude matrix。
In above-mentioned novel mechanical arm teleoperation method, the high frequency attitude A of current time hands in step (10.3)3,kObtained by equation below:
A3,k=T3,k-1+(g3,k-g2,k)×Δt
Wherein: T3,k-1For the attitude of a upper moment hands, g3,kFor the angular velocity of current time hands, g2,kFor the angular velocity of current time forearm, Δ t is the resolving cycle;
The low frequency attitude B of described current time hands3,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B3,k)=[GMG × M]/[a3,k-a2,km3,k-m2,k(a3,k-a2,k)×(m3,k-m2,k)]
Wherein: G is gravitational vectors, M is ground magnetic vector, a3,kFor the acceleration of current time hands, a2,kFor the acceleration of current time forearm, m3,kFor the magnetic field value of current time hands, m2,kFor the magnetic field value of current time forearm, C (B3,k) for B3,kAttitude matrix。
In above-mentioned novel mechanical arm teleoperation method, the high frequency attitude A of finger part between current time finger root joint (5) and middle joint (6) in step (10.4)4,kObtained by equation below:
A4,k=T4,k-1+(g4,k-g3,k)×Δt
Wherein: T4,k-1For the attitude of finger part, g between a upper moment human finger root joint and middle joint4,kFor the angular velocity of finger part, g between current time finger root joint and middle joint3,kFor the angular velocity of current time hands, Δ t is the resolving cycle;
The low frequency attitude B of finger part between current time finger root joint (5) and middle joint (6)4,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B4,k)=[GMG × M]/[a4,k-a3,km4,k-m3,k(a4,k-a3,k)×(m4,k-m3,k)]
Wherein: G is gravitational vectors, M is ground magnetic vector, a4,kThe acceleration of finger part, a between current time finger root joint and middle joint3,kFor the acceleration of current time hands, m4,kFor the magnetic field value of finger part, m between current time finger root joint and middle joint3,kFor the magnetic field value of current time hands, C (B4,k) for B4,kAttitude matrix。
In above-mentioned novel mechanical arm teleoperation method, λ1、λ3And λ4Value be: 0.2≤λ1≤ 0.5,0.2≤λ3≤ 0.5,0.2≤λ4≤ 0.5;The value of described resolving period Δ t is 0.001-0.1s。
In above-mentioned novel mechanical arm teleoperation method, human body the back of the hand and the sensor on each finger are arranged on glove, and glove donning is at human body on hand。
In above-mentioned novel mechanical arm teleoperation method, adopting soft arranging wire to be connected in data glove between each sensor and between sensor with microprocessor, microprocessor and data process between display unit by wirelessly or non-wirelessly connecting;Described data glove also includes power supply unit, and power supply unit is arranged on the bottom of microprocessor, is used for as microprocessor and sensor power。
In above-mentioned novel mechanical arm teleoperation method; when human arm generation jerk or jerky motion cause the control instruction threshold value that the control instruction that data process display unit conversion exceedes mechanical arm and mechanical hand; described control instruction threshold value is sent to mechanical arm control unit by data processing unit, mechanical arm control unit mechanical arm and mechanical hand are carried out remote operating。
The present invention compared with prior art has the advantages that
(1), mechanical arm remote control system of the present invention includes data glove, data process display unit, mechanical arm control unit, mechanical arm and mechanical hand, the movable information received from data glove is carried out resolving and obtains human body large arm by data process display unit, forearm, the attitude of the back of the hand and each finger, and attitude is converted into control instruction by mechanical arm control unit, mechanical arm and mechanical hand is carried out remote operating, realize human arm, hand control mechanical arm, finger controls mechanical hand, by the difference control mode to mechanical arm and mechanical hand, mechanical arm can be given full play to, the respective kinetic characteristic of mechanical hand, make its task that effectively fulfils assignment;
(2), in mechanical arm remote control system of the present invention, human arm is more natural, friendly, easily mechanical arm is carried out remote operating so that mechanical arm can realize the operational motion of complexity as staff;
(3), the mechanical arm of the present invention remote operating by human arm, the dexterous motion of human arm can be reappeared in real time, mechanical arm, without carrying out the Motion trajectory of off-line, realizes inter-related task more quickly;
(4), the data glove system of the present invention includes several sensors, microprocessor and data process display unit, this glove system takes into full account the feature of human upper limb, each functional module is optimized design and rational deployment, wearing being used convenient, comfortable, stability is higher;
(5), the novel data gloves system that the present invention proposes takes into full account the characteristic of sensor, feature in conjunction with human upper limb, design the movable information calculation method of a kind of efficiently and accurately, make calculation result more accurately and reliably, it is possible to be better applied to the multiple fields such as man-machine interaction, remote operating, upper limb healing monitoring;
(6), movable information calculation method process of the present invention is simple, it is easy to accomplish, there is stronger practicality;
(7), novel data gloves system of the present invention, first-class work is can be carried out as imaged without external equipment, do not affected by ambient lighting, block etc., adaptive faculty is strong, it is convenient to dress, adapt to different human body upper limb, the movable informations such as arm, palm and the acceleration of each finger, speed, attitude and position can be caught in real time, completely, rapidly。
Accompanying drawing explanation
Fig. 1 is the structural representation of novel mechanical arm remote control system of the present invention;
Fig. 2 is the theory diagram of data glove of the present invention。
Detailed description of the invention
Below in conjunction with the drawings and specific embodiments, the present invention is described in further detail:
It is illustrated in figure 1 the structural representation of novel mechanical arm remote control system of the present invention, mechanical arm remote control system of the present invention includes data glove 11 as seen from the figure, data process display unit 4, mechanical arm control unit 8, mechanical arm 9 and mechanical hand 10, wherein:
Data glove 11 includes several sensors 1 and microprocessor 2, and several sensors 1 are separately positioned between the large arm of human body, forearm, the back of the hand and each joint of each finger, for gathering the movable information of human upper limb different parts;Microprocessor 2 is arranged on human body wrist, for receiving movable information from sensor 1, and described movable information is sent to data process display unit 4。Soft arranging wire 3 is adopted to be connected between each sensor 1 and between sensor 1 with microprocessor 2, microprocessor 2 and data process by wirelessly or non-wirelessly connecting between display unit 4, and in the embodiment of the present invention, microprocessor 2 and data process between display unit 4 as wireless telecommunications。Above-mentioned movable information includes between human body large arm, forearm, the back of the hand and each joint of each finger the angular velocity of finger part, acceleration and magnetic field value between finger part and end joint and finger tip。
As shown in Figure 1 each arm of human body of the present invention arranges 18 sensors 1, concrete method to set up is: the large arm of human body, forearm respectively arranges a sensor 1, between root joint 5 and the middle joint 6 of middle finger, one sensor 1 is respectively set between middle joint 6 and end joint 7 and between end joint 7 and finger tip, and with the back of the hand on arrange a sensor 1, totally four sensors 1 are formed and are connected in series, in all the other fingers between root joint 5 and the middle joint 6 of each finger, one sensor 1 is respectively set between middle joint 6 and end joint 7 and between end joint 7 and finger tip, three sensors 1 on each finger are formed and are connected in series。
The sensor 1 can be arranged directly on the upper limb part of human body, can also the sensor 1 on human body the back of the hand and each finger be arranged on glove, glove donning is at human body on hand, glove donning human body on hand after, between the back of the hand of position respectively human body and each joint of each finger of each sensor 1 correspondence。These glove are soft glove。
Data glove system of the present invention also includes power supply unit, and power supply unit is arranged on the bottom of microprocessor 2, and for powering for microprocessor 2 and each sensor 1, power supply unit can be battery or other power supply。It is illustrated in figure 2 the theory diagram of data glove of the present invention。
Data process the movable information of display unit 4 real-time reception microprocessor 2 transmission and resolve, obtain human body large arm, forearm, the back of the hand and each finger (include finger part between each finger root joint and middle joint, finger part between middle joint and end joint, finger part between end joint and finger tip) attitude, and by wherein large arm, the attitude of forearm and the back of the hand is converted into the control instruction of mechanical arm 9, the attitude of wherein each finger is converted into the control instruction of mechanical hand 10, and the control instruction of this mechanical arm 9 and the control instruction of mechanical hand 10 are sent to mechanical arm control unit 8 in real time。
Mechanical arm control unit 8 real-time reception data process the control instruction of this mechanical arm 9 that display unit 4 sends and the control instruction of mechanical hand 10, respectively mechanical arm 9 and mechanical hand 10 are carried out remote operating, the attitude making mechanical arm 6 is consistent with the attitude of current time human body large arm, forearm and the back of the hand so that the attitude of mechanical hand 7 is consistent with the attitude of current time human finger。
Mechanical arm 9 and mechanical hand 10, move under the control of mechanical arm control unit 8。
The present invention adopts the concrete grammar that above-mentioned novel mechanical arm remote control system carries out remote operating as follows:
Step (one), data are processed display unit 4, mechanical arm control unit 8, mechanical arm 9 and mechanical hand 10 it is attached, as shown in Figure 1。
Step (two), mechanical arm remote control system initialization operation, specifically include following steps:
(1), data process the attitude (include between the root joint of each finger and middle joint, the attitude of finger part between middle joint and end shutdown, between end joint and finger tip) of display unit 4 storage inside initial time human body large arm, forearm, the back of the hand and each finger, the attitude of wherein large arm, forearm and the back of the hand is converted into the control instruction of mechanical arm 9, the attitude of wherein each finger is converted into the control instruction of mechanical hand 10, and the control instruction of described mechanical arm 9 and the control instruction of mechanical hand 10 are sent to mechanical arm control unit 8 in real time。Can adopt common Linear Mapping that attitude is converted into control instruction。
(2), mechanical arm control unit 8 real-time reception data process the control instruction of the described mechanical arm 9 that display unit 4 sends and the control instruction of mechanical hand 10, respectively mechanical arm 9 and mechanical hand 10 are carried out remote operating, the attitude making mechanical arm 6 is consistent with the attitude of initial time human body large arm, forearm and the back of the hand so that the attitude of mechanical hand 7 is consistent with the attitude of initial time human finger。
Step (three), mechanical arm remote control system real-time pursuit movement, specifically include following steps:
(1), the sensor 1 in data glove 11 gathers the movable information of current time human upper limb different parts;The movable information of the described current time received from sensor 1 is sent to data and processes display unit 4 by microprocessor 2。Above-mentioned movable information includes the angular velocity of finger part, acceleration and magnetic field value between human body large arm, forearm, the back of the hand and each joint of each finger。
(2), the movable information of the current time that data process the transmission of display unit 4 real-time reception microprocessor 2 resolves, obtain the attitude of current time human body large arm, forearm, the back of the hand and each finger, the attitude of wherein large arm, forearm and the back of the hand is converted into the control instruction of mechanical arm 9, the attitude of wherein each finger is converted into the control instruction of mechanical hand 10, and the control instruction of described mechanical arm 9 and the control instruction of mechanical hand 10 are sent to mechanical arm control unit 8 in real time。
(3), mechanical arm control unit 8 real-time reception data process the control instruction of the described mechanical arm 9 that display unit 4 sends and the control instruction of mechanical hand 10, respectively mechanical arm 9 and mechanical hand 10 are carried out remote operating, the attitude making mechanical arm 6 is consistent with the attitude of current time human body large arm, forearm and the back of the hand so that the attitude of mechanical hand 7 is consistent with the attitude of current time human finger。
In above-mentioned steps (2), the movable information of the current time that data process the transmission of display unit 4 real-time reception microprocessor 2 resolves, and the concrete grammar of the attitude obtaining current time human body large arm, forearm, the back of the hand and each finger is as follows:
(2.1), the angular velocity g of the current time large arm that the sensing tolerance 1 of large arm records1,k, acceleration a1,k, magnetic field value m1,k, calculate the attitude T of current time human body large arm1,k, concrete formula is as follows:
T1,k=λ1×A1,k+(1-λ1)×B1,k
Wherein: A1,kFor the high frequency attitude of current time large arm, B1,kFor the low frequency attitude of current time large arm, λ1For complementary coefficient, value is 0≤λ1≤ 1, it is preferable that 0.2≤λ1≤0.5。
The high frequency attitude A of current time large arm1,kAngular velocity g according to current time large arm1,k, obtained by equation below:
A1,k=T1,k-1+g1,k×Δt
Wherein: T1,k-1For the attitude of a upper moment large arm, g1,kFor the angular velocity of current time large arm, Δ t is the resolving cycle。λ in the present embodiment1It is 0.3;In the present embodiment, Δ t value is 0.02s。
The low frequency attitude B of current time large arm1,kAccording to gravitational vectors, magnetic vector, the acceleration of current time large arm and the magnetic field value of current time large arm be determined by sexual stance filtering algorithm and obtain, be 3 × 1 matrixes, obtain with specific reference to following conversion formula:
C(B1,k)=[GMG × M]/[a1,km1,ka1,k×m1,k]
Wherein: G is gravitational vectors, M is ground magnetic vector, a1,kFor the acceleration of current time large arm, m1,kFor the magnetic field value of current time large arm, C (B1,k) for B1,kAttitude matrix。
(2.2), the attitude of human body forearm is by the relative angle T between forearm and large arm2,kRepresent, the angular velocity g of the current time forearm that the sensing tolerance 1 of forearm records2,k, acceleration a2,k, magnetic field value m2,k, then relative angle speed is g2,k-g1,k, relative acceleration is a2,k-a1,k, relative magnetic field value is m2,k-m1,k, take and wherein obtain relative angle T along the axial relative acceleration of forearm and acceleration of gravity resolving2,k, concrete formula is as follows:
Wherein: a2x,kFor along the axial acceleration of human body forearm, a1x,kFor along the axial acceleration of human body large arm, g is that gravity accelerates。
The current time forearm angular velocity g that the sensing tolerance 1 of forearm records2,k, acceleration a2,k, magnetic field value m2,kIt is three axis angular rate vector g2,k, 3-axis acceleration vector a2,kWith three-axle magnetic field value vector m2,k, wherein a2x,kFor along the axial acceleration of human body forearm, it is possible to directly measure and obtain。In like manner, a1x,kFor along the axial acceleration of human body large arm, it is possible to directly measure and obtain。
(2.3) the angular velocity g of the current time human body hands that, the sensing tolerance 1 of human body the back of the hand records3,k, acceleration a3,k, magnetic field value m3,k, then relative angle speed is g3,k-g2,k, relative acceleration be a3,k-a2,k, relative magnetic field value be m3,k-m2,k, calculate the attitude T of current time human body hands3,k, concrete formula is as follows:
T3,k=λ3×A3,k+(1-λ3)×B3,k
Wherein: A3,kThe high frequency attitude of current moment hands, B3,kThe low frequency attitude of current time hands, λ3For complementary coefficient, value is 0≤λ3≤ 1;Preferably 0.2≤λ3≤0.5。
The high frequency attitude A of current time hands3,kAccording to relative angle speed g3,k-g2,k, obtained by equation below:
A3,k=T3,k-1+(g3,k-g2,k)×Δt
Wherein: T3,k-1For the attitude of a upper moment hands, g3,kFor the angular velocity of current time hands, g2,kFor the angular velocity of current time forearm, Δ t is the resolving cycle。In the present embodiment, Δ t value is 0.02s, λ in the present embodiment3Value is 0.3。
The low frequency attitude B of current time hands3,kAccording to gravitational vectors, magnetic vector, relative acceleration a3,k-a2,kWith relative magnetic field value m3,k-m2,k, it is determined by sexual stance filtering algorithm and obtains, obtain especially by equation below:
C(B3,k)=[GMG × M]/[a3,k-a2,km3,k-m2,k(a3,k-a2,k)×(m3,k-m2,k)]
Wherein: G is gravitational vectors, M is ground magnetic vector, a3,kFor the acceleration of current time hands, a2,kFor the acceleration of current time forearm, m3,kFor the magnetic field value of current time hands, m2,kFor the magnetic field value of current time forearm, C (B3,k) for B3,kAttitude matrix。
(2.4), the sensor 1 arranged between human finger root joint 5 and middle joint 6 records the angular velocity g of finger part between current time finger root joint 5 and middle joint 64,k, the acceleration a of finger part between finger root joint 5 and middle joint 64,k, the magnetic field value m of finger part between finger root joint 5 and middle joint 64,k, then relative angle speed is g4,k-g3,k, relative acceleration be a4,k-a3,k, relative magnetic field value be m4,k-m3,k, calculate the attitude T of finger part between current time human finger root joint and middle joint4,k, concrete formula is as follows:
T4,k=λ4×A4,k+(1-λ4)×B4,k
Wherein: A4,kFor the high frequency attitude of finger part, B between current moment finger root joint and middle joint4,kFor the low frequency attitude of finger part, λ between current time finger root joint and middle joint4For complementary coefficient, value is 0≤λ4≤ 1, it is preferable that 0.2≤λ4≤0.5。
The high frequency attitude A of finger part between current time finger root joint and middle joint4,kAccording to relative angle speed g4,k-g3,k, obtained by equation below:
A4,k=T4,k-1+(g4,k-g3,k)×Δt
Wherein: T4,k-1For the attitude of finger part, g between a upper moment human finger root joint and middle joint4,kFor the angular velocity of finger part, g between current time finger root joint and middle joint3,kThe angular velocity of current time hands, Δ t is the resolving cycle。In the present embodiment, Δ t value is 0.02s, λ in the present embodiment4Value is 0.3。
The low frequency attitude B of finger part between current time finger root joint and middle joint4,kAccording to gravitational vectors, magnetic vector, relative acceleration a4,k-a3,k, relative magnetic field value m4,k-m3,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B4,k)=[GMG × M]/[a4,k-a3,km4,k-m3,k(a4,k-a3,k)×(m4,k-m3,k)]
Wherein: G is gravitational vectors, M is ground magnetic vector, a4,kThe acceleration of finger part, a between current time finger root joint and middle joint3,kFor the acceleration of current time hands, m4,kFor the magnetic field value of finger part, m between current time finger root joint and middle joint3,kFor the magnetic field value of current time hands, C (B4,k) for B4,kAttitude matrix。
(2.5), the attitude of finger part between joint 6 and end joint 7 in human finger, by the relative angle T of finger part between finger root joint 5 and middle joint 65,kRepresenting, the sensor 1 arranged between joint 6 and end joint 7 in human finger records the angular velocity g of finger part between joint 6 and end joint 7 in current time finger5,k, the acceleration a of finger part between joint 6 and end joint 7 in finger5,k, the magnetic field value m of finger part between joint 6 and end joint 7 in finger5,k, then relative angle speed is g5,k-g4,k, relative acceleration be a5,k-a4,k, relative magnetic field value be m5,k-m4,k, take wherein along joint in finger and between end joint the relative acceleration in finger part direction and acceleration of gravity resolve and obtain relative angle T5,k, concrete formula is as follows:
Wherein: a5x,kFor joint along finger and the acceleration in finger part direction, a between end joint4x,kFor along the acceleration in finger part direction between finger root joint and middle joint。
The sensor 1 arranged between joint 6 and end joint 7 in human finger records the angular velocity g of finger part between joint 6 and end joint 7 in current time finger5,k, the acceleration a of finger part between joint 6 and end joint 7 in finger5,k, the magnetic field value m of finger part between joint 6 and end joint 7 in finger5,kIt is three axis angular rate vector g5,k, 3-axis acceleration vector a5,kWith three-axle magnetic field value vector m5,k, wherein a5x,kFor joint along finger and the acceleration in finger part direction between end joint, it is possible to directly measure and obtain。In like manner, a4x,kFor along the acceleration in finger part direction between finger root joint and middle joint, it is possible to directly measure and obtain。
(2.6), the attitude of finger part between human finger end joint 7 and finger tip, by the relative angle T of finger part between joint 6 and end joint 7 in this finger part and finger6,kRepresenting, the sensor 1 arranged between human finger end joint 7 and finger tip records the angular velocity g of finger part between current time finger tips joint 7 and finger tip6,k, the acceleration a of finger part between finger tips joint 7 and finger tip6,k, the magnetic field value m of finger part between finger tips joint 7 and finger tip6,k, then relative angle speed is g6,k-g5,k, relative acceleration be a6,k-a5,k, relative magnetic field value be m6,k-m5,k, take wherein to resolve along the relative acceleration in finger part direction between finger tips joint and finger tip and acceleration of gravity and obtain relative angle T6,k, concrete formula is as follows:
Wherein: a6x,kFor along the acceleration in finger part direction, a between finger tips joint and finger tip5x,kFor joint along finger and the acceleration in finger part direction between end joint。Wherein a5x,k、a6x,kAll directly measure and obtain。
λ in the present invention1、λ3And λ4Value can be identical or different, in the embodiment of the present invention, three is identical, and value is 0.3, and Δ t value is 0.02s。
In the present invention, between initial time human body large arm, forearm, the back of the hand and each joint of each finger, between finger part and end joint and finger tip, the attitude of finger part can be setting value。
System safety operation and shutdown; if human arm generation jerk or jerky motion cause the control instruction threshold value that the control instruction that data process display unit 4 conversion exceedes mechanical arm 6 and mechanical hand 7; described control instruction threshold value is sent to mechanical arm control unit 8 as control instruction by data processing unit 4, mechanical arm control unit 8 mechanical arm 6 and mechanical hand 7 are carried out remote operating。By control instruction is carried out certain constraint, it is prevented that the speed of mechanical arm is excessive or moment of torsion is excessive, it is ensured that the safe operation of mechanical arm 6 and mechanical hand 7 and safe shutdown。
Mechanical arm is carried out remote operating by staff by the present invention, make mechanical arm can complete the operation of complexity as staff, the mechanical arm remote operating by human arm, the dexterous motion of human arm can be reappeared in real time, mechanical arm, without carrying out the Motion trajectory of off-line, realizes inter-related task more quickly。In addition data glove takes into full account the feature of human upper limb model, each functional module is carried out rational deployment, make to dress use convenient, comfortable, stability is higher, and taking into full account the calculation method of design in human upper limb feature base, make calculation result more accurately and reliably, and the direction caught is more, more multidimensional, can better be applied to the multiple fields such as man-machine interaction, remote operating, upper limb healing monitoring, the such as attitude information according to human body large arm, forearm, hands and each finger, Real Time Drive human upper limb phantom。
The attitude accuracy obtained in the embodiment of the present invention improves 20% than traditional method。
The above; being only the detailed description of the invention that the present invention is best, but protection scope of the present invention is not limited thereto, any those familiar with the art is in the technical scope that the invention discloses; the change that can readily occur in or replacement, all should be encompassed within protection scope of the present invention。
The content not being described in detail in description of the present invention belongs to the known technology of professional and technical personnel in the field。
Claims (17)
1. a novel mechanical arm remote control system, it is characterized in that: include data glove (11), data process display unit (4), mechanical arm control unit (8), mechanical arm (9) and mechanical hand (10), wherein:
Data glove (11): include several sensors (1) and microprocessor (2), described several sensors (1) are separately positioned between the large arm of human body, forearm, the back of the hand and each joint of each finger, for gathering the movable information of human upper limb different parts;Microprocessor (2) is arranged on human body wrist, for receiving movable information from sensor (1), and described movable information is sent to data process display unit (4);Described movable information includes the angular velocity of finger part, acceleration and magnetic field value between human body large arm, forearm, the back of the hand and each joint of each finger;
Wherein the concrete method to set up of several sensors (1) is: the large arm of human body, forearm respectively arranges a sensor (1), between root joint (5) and middle joint (6) of middle finger, one sensor (1) is respectively set between middle joint (6) and end joint (7) and between end joint (7) and finger tip, and with the back of the hand on arrange a sensor (1), totally four sensors (1) are formed and are connected in series, in all the other fingers between root joint (5) and middle joint (6) of each finger, one sensor (1) is respectively set between middle joint (6) and end joint (7) and between end joint (7) and finger tip, three sensors (1) on each finger are formed and are connected in series;
Data process display unit (4);The movable information that real-time reception microprocessor (2) sends resolves, obtain the attitude of human body large arm, forearm, the back of the hand and each finger, and the attitude of wherein large arm, forearm and the back of the hand is converted into the control instruction of mechanical arm (9), the attitude of wherein each finger is converted into the control instruction of mechanical hand (10), and the control instruction of described mechanical arm (9) and the control instruction of mechanical hand (10) are sent to mechanical arm control unit (8) in real time;
Mechanical arm control unit (8): real-time reception data process the control instruction of the described mechanical arm (9) that display unit (4) sends and the control instruction of mechanical hand (10), respectively mechanical arm (9) and mechanical hand (10) are carried out remote operating, the attitude making mechanical arm (6) is consistent with the attitude of current time human body large arm, forearm and the back of the hand so that the attitude of mechanical hand (7) is consistent with the attitude of current time human finger。
2. a kind of novel mechanical arm remote control system according to claim 1, it is characterized in that: the movable information that described data process display unit (4) real-time reception microprocessor (2) send resolves, and the concrete grammar of the attitude obtaining human body large arm, forearm, the back of the hand and each finger is as follows:
(2.1) the attitude T of current time human body large arm, is calculated1,k, concrete formula is as follows:
T1,k=λ1×A1,k+(1-λ1)×B1,k
Wherein: A1,kFor the high frequency attitude of current time large arm, B1,kFor the low frequency attitude of current time large arm, λ1For complementary coefficient, value is 0≤λ1≤ 1;K is moment sequence, and value is the positive integer of >=1;
(2.2), calculating the attitude of current time human body forearm, the attitude of human body forearm is by relative angle T between forearm and large arm2,kRepresenting, concrete formula is as follows:
Wherein: a2x,kFor along the axial acceleration of human body forearm, a1x,kFor along the axial acceleration of human body large arm, g is acceleration of gravity;
(2.3) the attitude T of current time human body hands, is calculated3,k, concrete formula is as follows:
T3,k=λ3×A3,k+(1-λ3)×B3,k
Wherein: A3,kThe high frequency attitude of current moment hands, B3,kThe low frequency attitude of current time hands, λ3For complementary coefficient, value is 0≤λ3≤ 1;
(2.4) the attitude T of finger part between current time human finger root joint (5) and middle joint (6), is calculated4,k, concrete formula is as follows:
T4,k=λ4×A4,k+(1-λ4)×B4,k
Wherein: A4,kFor the high frequency attitude of finger part, B between current moment finger root joint and middle joint4,kFor the low frequency attitude of finger part, λ between current time finger root joint and middle joint4For complementary coefficient, value is 0≤λ4≤ 1;
(2.5), the attitude of finger part between joint (6) and end joint (7) is calculated in current time human finger, by the angle T of finger part between finger root joint (5) and middle joint (6)5,kRepresenting, concrete formula is as follows:
Wherein: a5x,kFor joint along finger and the acceleration in finger part direction, a between end joint4x,kFor along the acceleration in finger part direction between finger root joint and middle joint;
(2.6), the attitude of finger part between current time human finger end joint (7) and finger tip is calculated, by the angle T of finger part between joint in finger (6) and end joint (7)6,kRepresenting, concrete formula is as follows:
Wherein: a6x,kFor along the acceleration in finger part direction between finger tips joint and finger tip。
3. a kind of novel mechanical arm remote control system according to claim 2, it is characterised in that: the high frequency attitude A of current time large arm in described step (2.1)1,kObtained by equation below:
A1,k=T1,k-1+g1,k×Δt
Wherein: T1,k-1For the attitude of a upper moment large arm, g1,kFor the angular velocity of current time large arm, Δ t is the resolving cycle;
The low frequency attitude B of described current time large arm1,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B1,k)=[GMG × M]/{ a1,km1,ka1,k×m1,k]
Wherein: G is gravitational vectors, M is ground magnetic vector, a1,kFor the acceleration of current time large arm, m1,kFor the magnetic field value of current time large arm, C (B1,k) for B1,kAttitude matrix。
4. a kind of novel mechanical arm remote control system according to claim 2, it is characterised in that: the high frequency attitude A of current time hands in described step (2.3)3,kObtained by equation below:
A3,k=T3,k-1+(g3,k-g2,k)×Δt
Wherein: T3,k-1For the attitude of a upper moment hands, g3,kFor the angular velocity of current time hands, g2,kFor the angular velocity of current time forearm, Δ t is the resolving cycle;
The low frequency attitude B of described current time hands3,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B3,k)=[GMG × M]/[a3,k-a2,km3,k-m2,k(a3,k-a2,k)×(m3,k-m2,k)]
Wherein: G is gravitational vectors, M is ground magnetic vector, a3,kFor the acceleration of current time hands, a2,kFor the acceleration of current time forearm, m3,kFor the magnetic field value of current time hands, m2,kFor the magnetic field value of current time forearm, C (B3,k) for B3,kAttitude matrix。
5. a kind of novel mechanical arm remote control system according to claim 2, it is characterised in that: the high frequency attitude A of finger part between current time finger root joint (5) and middle joint (6) in described step (2.4)4,kObtained by equation below:
A4,k=T4,k-1+(g4,k-g3,k)×Δt
Wherein: T4,k-1For the attitude of finger part, g between a upper moment human finger root joint and middle joint4,kFor the angular velocity of finger part, g between current time finger root joint and middle joint3,kThe angular velocity of current time hands, Δ t is the resolving cycle;
The low frequency attitude B of finger part between current time finger root joint (5) and middle joint (6)4,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B4,k)=[GMG × M]/[a4,k-a3,km4,k-m3,k(a4,k-a3,k)×(m4,k-m3,k)]
Wherein: G is gravitational vectors, M is ground magnetic vector, a4,kThe acceleration of finger part, a between current time finger root joint and middle joint3,kFor the acceleration of current time hands, m4,kFor the magnetic field value of finger part, m between current time finger root joint and middle joint3,kFor the magnetic field value of current time hands, C (B4,k) for B4,kAttitude matrix。
6. according to a kind of novel mechanical arm remote control system one of claim 2-5 Suo Shu, it is characterised in that: described λ1、λ3And λ4Value be: 0.2≤λ1≤ 0.5,0.2≤λ3≤ 0.5,0.2≤λ4≤ 0.5;The value of described resolving period Δ t is 0.001-0.1s。
7. according to a kind of novel mechanical arm remote control system one of claim 1-5 Suo Shu, it is characterised in that: the sensor (1) on described human body the back of the hand and each finger is arranged on glove, and glove donning is at human body on hand。
8. according to a kind of novel mechanical arm remote control system one of claim 1-5 Suo Shu, it is characterized in that: adopt soft arranging wire (3) to be connected between each sensor (1) and between sensor (1) with microprocessor (2) in described data glove (11), microprocessor (2) and data process between display unit (4) by wirelessly or non-wirelessly connecting;Described data glove (11) also includes power supply unit, and power supply unit is arranged on the bottom of microprocessor (2), for powering for microprocessor (2) and sensor (1)。
9. a novel mechanical arm teleoperation method, it is characterized in that: realized by mechanical arm remote control system, described mechanical arm remote control system includes data glove (11), data process display unit (4), mechanical arm control unit (8), mechanical arm (9) and mechanical hand (10), wherein data glove (11) includes several sensors (1) and microprocessor (2), microprocessor (2) is arranged on human body wrist, several sensors (1) are separately positioned on the large arm of human body, forearm, between each joint of the back of the hand and each finger, concrete method to set up is: the large arm of human body, forearm respectively arranges a sensor (1), between root joint (5) and middle joint (6) of middle finger, one sensor (1) is respectively set between middle joint (6) and end joint (7) and between end joint (7) and finger tip, and with the back of the hand on arrange a sensor (1), totally four sensors (1) are formed and are connected in series, in all the other fingers between root joint (5) and middle joint (6) of each finger, one sensor (1) is respectively set between middle joint (6) and end joint (7) and between end joint (7) and finger tip, three sensors (1) on each finger are formed and are connected in series;
Concrete methods of realizing is as follows:
Step (one), data are processed display unit (4), mechanical arm control unit (8), mechanical arm (9) and mechanical hand (10) it is attached;
Step (two), mechanical arm remote control system initialization operation, specifically include following steps:
(1), data process display unit (4) and the attitude of the initial time human body large arm of storage inside, forearm and the back of the hand are converted into the control instruction of mechanical arm (9), the attitude of each finger of initial time human body of storage inside is converted into the control instruction of mechanical hand (10), and the control instruction of described mechanical arm (9) and the control instruction of mechanical hand (10) are sent to mechanical arm control unit (8) in real time;
(2), mechanical arm control unit (8) real-time reception data process the control instruction of the described mechanical arm (9) that display unit (4) sends and the control instruction of mechanical hand (10), respectively mechanical arm (9) and mechanical hand (10) are carried out remote operating, the attitude making mechanical arm (6) is consistent with the attitude of initial time human body large arm, forearm and the back of the hand so that the attitude of mechanical hand (7) is consistent with the attitude of initial time human finger;
Step (three), mechanical arm remote control system real-time pursuit movement, specifically include following steps:
(1), the sensor (1) in data glove (11) gathers the movable information of current time human upper limb different parts;The movable information of the described current time received from sensor (1) is sent to data and processes display unit (4) by microprocessor (2);Described movable information includes the angular velocity of finger part, acceleration and magnetic field value between human body large arm, forearm, the back of the hand and each joint of each finger;
(2), the movable information of the current time that data process display unit (4) real-time reception microprocessor (2) send resolves, obtain the attitude of current time human body large arm, forearm, the back of the hand and each finger, the attitude of wherein large arm, forearm and the back of the hand is converted into the control instruction of mechanical arm (9), the attitude of wherein each finger is converted into the control instruction of mechanical hand (10), and the control instruction of described mechanical arm (9) and the control instruction of mechanical hand (10) are sent to mechanical arm control unit (8) in real time;
(3), mechanical arm control unit (8) real-time reception data process the control instruction of the described mechanical arm (9) that display unit (4) sends and the control instruction of mechanical hand (10), respectively mechanical arm (9) and mechanical hand (10) are carried out remote operating, the attitude making mechanical arm (6) is consistent with the attitude of current time human body large arm, forearm and the back of the hand so that the attitude of mechanical hand (7) is consistent with the attitude of current time human finger。
10. a kind of novel mechanical arm teleoperation method according to claim 9, it is characterized in that: in (2) of described step (three), the concrete grammar that the movable information of current time is resolved by data process display unit (4) is as follows:
(10.1) the attitude T of current time human body large arm, is calculated1,k, concrete formula is as follows:
T1,k=λ1×A1,k+(1-λ1)×B1,k
Wherein: A1,kFor the high frequency attitude of current time large arm, B1,kFor the low frequency attitude of current time large arm, λ1For complementary coefficient, value is 0≤λ1≤ 1;K is moment sequence, and value is the positive integer of >=1;
(10.2), calculating the attitude of current time human body forearm, the attitude of human body forearm is by relative angle T between forearm and large arm2,kRepresenting, concrete formula is as follows:
Wherein: a2x,kFor along the axial acceleration of human body forearm, a1x,kFor along the axial acceleration of human body large arm, g is acceleration of gravity;
(10.3) the attitude T of current time human body hands, is calculated3,k, concrete formula is as follows:
T3,k=λ3×A3,k+(1-λ3)×B3,k
Wherein: A3,kThe high frequency attitude of current moment hands, B3,kThe low frequency attitude of current time hands, λ3For complementary coefficient, value is 0≤λ3≤ 1;
(10.4) the attitude T of finger part between current time human finger root joint (5) and middle joint (6), is calculated4,k, concrete formula is as follows:
T4,k=λ4×A4,k+(1-λ4)×B4,k
Wherein: A4,kFor the high frequency attitude of finger part, B between current moment finger root joint and middle joint4,kFor the low frequency attitude of finger part, λ between current time finger root joint and middle joint4For complementary coefficient, value is 0≤λ4≤ 1;
(10.5), the attitude of finger part between joint (6) and end joint (7) is calculated in current time human finger, by the angle T of finger part between finger root joint (5) and middle joint (6)5,kRepresenting, concrete formula is as follows:
Wherein: a5x,kFor joint along finger and the acceleration in finger part direction, a between end joint4x,kFor along the acceleration in finger part direction between finger root joint and middle joint;
(10.6), the attitude of finger part between current time human finger end joint (7) and finger tip is calculated, by the angle T of finger part between joint in finger (6) and end joint (7)6,kRepresenting, concrete formula is as follows:
Wherein: a6x,kFor along the acceleration in finger part direction between finger tips joint and finger tip。
11. a kind of novel mechanical arm teleoperation method according to claim 10, it is characterised in that: the high frequency attitude A of current time large arm in described step (10.1)1,kObtained by equation below:
A1,k=T1,k-1+g1,k×Δt
Wherein: T1,k-1For the attitude of a upper moment large arm, g1,kFor the angular velocity of current time large arm, Δ t is the resolving cycle;
The low frequency attitude B of described current time large arm1,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B1,k)=[GMG × M]/[a1,km1,ka1,k×m1,k]
Wherein: G is gravitational vectors, M is ground magnetic vector, a1,kFor the acceleration of current time large arm, m1,kFor the magnetic field value of current time large arm, C (B1,k) for B1,kAttitude matrix。
12. a kind of novel mechanical arm teleoperation method according to claim 10, it is characterised in that: the high frequency attitude A of current time hands in described step (10.3)3,kObtained by equation below:
A3,k=T3,k-1+(g3,k-g2,k)×Δt
Wherein: T3,k-1For the attitude of a upper moment hands, g3,kFor the angular velocity of current time hands, g2,kFor the angular velocity of current time forearm, Δ t is the resolving cycle;
The low frequency attitude B of described current time hands3,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B3,k)=[GMG × M]/[a3,k-a2,km3,k-m2,k(a3,k-a2,k)×(m3,k-m2,k)]
Wherein: G is gravitational vectors, M is ground magnetic vector, a3,kFor the acceleration of current time hands, a2,kFor the acceleration of current time forearm, m3,kFor the magnetic field value of current time hands, m2,kFor the magnetic field value of current time forearm, C (B3,k) for B3,kAttitude matrix。
13. a kind of novel mechanical arm teleoperation method according to claim 10, it is characterised in that: the high frequency attitude A of finger part between current time finger root joint (5) and middle joint (6) in described step (10.4)4,kObtained by equation below:
A4,k=T4,k-1+(g4,k-g3,k)×Δt
Wherein: T4,k-1For the attitude of finger part, g between a upper moment human finger root joint and middle joint4,kFor the angular velocity of finger part, g between current time finger root joint and middle joint3,kFor the angular velocity of current time hands, Δ t is the resolving cycle;
The low frequency attitude B of finger part between current time finger root joint (5) and middle joint (6)4,kIt is determined by sexual stance filtering algorithm to obtain, obtains especially by equation below:
C(B4,k)=[GMG × M]/[a4,k-a3,km4,k-m3,k(a4,k-a3,k)×(m4,k-m3,k)]
Wherein: G is gravitational vectors, M is ground magnetic vector, a4,kThe acceleration of finger part, a between current time finger root joint and middle joint3,kFor the acceleration of current time hands, m4,kFor the magnetic field value of finger part, m between current time finger root joint and middle joint3,kFor the magnetic field value of current time hands, C (B4,k) for B4,kAttitude matrix。
14. according to a kind of novel mechanical arm teleoperation method one of claim 10-13 Suo Shu, it is characterised in that: described λ1、λ3And λ4Value be: 0.2≤λ1≤ 0.5,0.2≤λ3≤ 0.5,0.2≤λ4≤ 0.5;The value of described resolving period Δ t is 0.001-0.1s。
15. according to a kind of novel mechanical arm teleoperation method one of claim 9-13 Suo Shu, it is characterised in that: the sensor (1) on described human body the back of the hand and each finger is arranged on glove, and glove donning is at human body on hand。
16. according to a kind of novel mechanical arm teleoperation method one of claim 9-13 Suo Shu, it is characterized in that: adopt soft arranging wire (3) to be connected between each sensor (1) and between sensor with microprocessor (2) in described data glove (11), microprocessor (2) and data process between display unit (4) by wirelessly or non-wirelessly connecting;Described data glove (11) also includes power supply unit, and power supply unit is arranged on the bottom of microprocessor (2), for powering for microprocessor (2) and sensor (1)。
17. according to a kind of novel mechanical arm teleoperation method one of claim 9-13 Suo Shu; it is characterized in that: when human arm generation jerk or jerky motion cause the control instruction threshold value that the control instruction that data process display unit (4) convert exceedes mechanical arm (6) and mechanical hand (7); described control instruction threshold value is sent to mechanical arm control unit (8) by data processing unit (4), mechanical arm control unit (8) mechanical arm (6) and mechanical hand (7) are carried out remote operating。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610168048.2A CN105690386B (en) | 2016-03-23 | 2016-03-23 | A kind of mechanical arm remote control system and teleoperation method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610168048.2A CN105690386B (en) | 2016-03-23 | 2016-03-23 | A kind of mechanical arm remote control system and teleoperation method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105690386A true CN105690386A (en) | 2016-06-22 |
CN105690386B CN105690386B (en) | 2019-01-08 |
Family
ID=56231716
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610168048.2A Active CN105690386B (en) | 2016-03-23 | 2016-03-23 | A kind of mechanical arm remote control system and teleoperation method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105690386B (en) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106003053A (en) * | 2016-07-29 | 2016-10-12 | 北京工业大学 | Teleoperation passive robot control system and control method thereof |
CN108127673A (en) * | 2017-12-18 | 2018-06-08 | 东南大学 | A kind of contactless robot man-machine interactive system based on Multi-sensor Fusion |
CN108500966A (en) * | 2018-03-30 | 2018-09-07 | 阜阳师范学院 | A kind of novel radio mechanical arm and control method |
CN108772839A (en) * | 2018-06-25 | 2018-11-09 | 中国人民解放军第二军医大学 | Master-slave operation and human-machine system |
CN108789454A (en) * | 2018-08-17 | 2018-11-13 | 成都跟驰科技有限公司 | The control system of automobile with mechanical arm |
CN109048950A (en) * | 2018-08-17 | 2018-12-21 | 成都跟驰科技有限公司 | The safety control system of automobile with mechanical arm |
CN109866197A (en) * | 2019-01-25 | 2019-06-11 | 北京戴纳实验科技有限公司 | A kind of intelligent simulation safety operation cabinet |
CN110625591A (en) * | 2019-04-09 | 2019-12-31 | 华南理工大学 | Teleoperation system and method based on exoskeleton data gloves and teleoperation rod |
CN111531545A (en) * | 2020-05-18 | 2020-08-14 | 珠海格力智能装备有限公司 | Robot control method, robot control system, and computer storage medium |
CN112497219A (en) * | 2020-12-06 | 2021-03-16 | 北京工业大学 | Columnar workpiece classification positioning method based on target detection and machine vision |
CN112706158A (en) * | 2019-10-25 | 2021-04-27 | 中国科学院沈阳自动化研究所 | Industrial man-machine interaction system and method based on vision and inertial navigation positioning |
CN114599487A (en) * | 2019-12-10 | 2022-06-07 | 卡普西克斯公司 | Device for defining a sequence of movements on a generic model |
CN113370223B (en) * | 2021-04-19 | 2022-09-02 | 中国人民解放***箭军工程大学 | Following type explosive-handling robot device and control method |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101515198A (en) * | 2009-03-11 | 2009-08-26 | 上海大学 | Human-computer interaction method for grapping and throwing dummy object and system thereof |
US7862522B1 (en) * | 2005-08-08 | 2011-01-04 | David Barclay | Sensor glove |
US20130219586A1 (en) * | 2012-02-29 | 2013-08-29 | The U.S.A. As Represented By The Administrator Of The National Aeronautics And Space Administration | Human grasp assist device soft goods |
CN203171617U (en) * | 2013-03-14 | 2013-09-04 | 吉林大学 | Humanoid synchronous wireless control mechanical hand system |
CN104881118A (en) * | 2015-05-25 | 2015-09-02 | 清华大学 | Wearable system used for capturing upper limb movement information of human body |
CN105150188A (en) * | 2015-10-10 | 2015-12-16 | 花茂盛 | System and method for controlling actions of robot |
CN204997657U (en) * | 2015-09-18 | 2016-01-27 | 广东技术师范学院 | Biomimetic mechanical hand with imitate function |
CN205075053U (en) * | 2015-10-24 | 2016-03-09 | 赵志鑫 | Robot based on technique of controlling is felt to body |
CN105404397A (en) * | 2015-12-21 | 2016-03-16 | 广东工业大学 | Glove controller and control method for same |
-
2016
- 2016-03-23 CN CN201610168048.2A patent/CN105690386B/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7862522B1 (en) * | 2005-08-08 | 2011-01-04 | David Barclay | Sensor glove |
CN101515198A (en) * | 2009-03-11 | 2009-08-26 | 上海大学 | Human-computer interaction method for grapping and throwing dummy object and system thereof |
US20130219586A1 (en) * | 2012-02-29 | 2013-08-29 | The U.S.A. As Represented By The Administrator Of The National Aeronautics And Space Administration | Human grasp assist device soft goods |
CN203171617U (en) * | 2013-03-14 | 2013-09-04 | 吉林大学 | Humanoid synchronous wireless control mechanical hand system |
CN104881118A (en) * | 2015-05-25 | 2015-09-02 | 清华大学 | Wearable system used for capturing upper limb movement information of human body |
CN204997657U (en) * | 2015-09-18 | 2016-01-27 | 广东技术师范学院 | Biomimetic mechanical hand with imitate function |
CN105150188A (en) * | 2015-10-10 | 2015-12-16 | 花茂盛 | System and method for controlling actions of robot |
CN205075053U (en) * | 2015-10-24 | 2016-03-09 | 赵志鑫 | Robot based on technique of controlling is felt to body |
CN105404397A (en) * | 2015-12-21 | 2016-03-16 | 广东工业大学 | Glove controller and control method for same |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106003053A (en) * | 2016-07-29 | 2016-10-12 | 北京工业大学 | Teleoperation passive robot control system and control method thereof |
CN108127673A (en) * | 2017-12-18 | 2018-06-08 | 东南大学 | A kind of contactless robot man-machine interactive system based on Multi-sensor Fusion |
CN108500966A (en) * | 2018-03-30 | 2018-09-07 | 阜阳师范学院 | A kind of novel radio mechanical arm and control method |
CN108772839B (en) * | 2018-06-25 | 2021-07-20 | 中国人民解放军第二军医大学 | Master-slave operation and man-machine integrated system |
CN108772839A (en) * | 2018-06-25 | 2018-11-09 | 中国人民解放军第二军医大学 | Master-slave operation and human-machine system |
CN108789454A (en) * | 2018-08-17 | 2018-11-13 | 成都跟驰科技有限公司 | The control system of automobile with mechanical arm |
CN109048950A (en) * | 2018-08-17 | 2018-12-21 | 成都跟驰科技有限公司 | The safety control system of automobile with mechanical arm |
CN109866197A (en) * | 2019-01-25 | 2019-06-11 | 北京戴纳实验科技有限公司 | A kind of intelligent simulation safety operation cabinet |
CN110625591A (en) * | 2019-04-09 | 2019-12-31 | 华南理工大学 | Teleoperation system and method based on exoskeleton data gloves and teleoperation rod |
CN112706158A (en) * | 2019-10-25 | 2021-04-27 | 中国科学院沈阳自动化研究所 | Industrial man-machine interaction system and method based on vision and inertial navigation positioning |
CN114599487A (en) * | 2019-12-10 | 2022-06-07 | 卡普西克斯公司 | Device for defining a sequence of movements on a generic model |
CN111531545A (en) * | 2020-05-18 | 2020-08-14 | 珠海格力智能装备有限公司 | Robot control method, robot control system, and computer storage medium |
CN112497219A (en) * | 2020-12-06 | 2021-03-16 | 北京工业大学 | Columnar workpiece classification positioning method based on target detection and machine vision |
CN112497219B (en) * | 2020-12-06 | 2023-09-12 | 北京工业大学 | Columnar workpiece classifying and positioning method based on target detection and machine vision |
CN113370223B (en) * | 2021-04-19 | 2022-09-02 | 中国人民解放***箭军工程大学 | Following type explosive-handling robot device and control method |
Also Published As
Publication number | Publication date |
---|---|
CN105690386B (en) | 2019-01-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105690386A (en) | Teleoperation system and teleoperation method for novel mechanical arm | |
CN104881118B (en) | A kind of donning system for being used to capture human upper limb locomotion information | |
CN106826838B (en) | Interaction bionic mechanical arm control method based on Kinect visual depth sensor | |
CN202572399U (en) | Synchronous smart mechanical arm of robot | |
CN111645093B (en) | Force sense feedback data glove for teleoperation | |
CN103170960A (en) | Human-imitation synchronous wireless control mechanical arm system | |
Paik et al. | Development of an anthropomorphic robotic arm and hand for interactive humanoids | |
CN108127673A (en) | A kind of contactless robot man-machine interactive system based on Multi-sensor Fusion | |
CN103895022A (en) | Wearable type somatosensory control mechanical arm | |
CN111773027A (en) | Flexibly-driven hand function rehabilitation robot control system and control method | |
CN104802181A (en) | Three-finger flexible hand performing device of robot | |
CN109529274B (en) | Upper limb joint active rehabilitation system based on redundant mechanical arm and training method thereof | |
Liu et al. | HIT prosthetic hand based on tendon-driven mechanism | |
CN203171617U (en) | Humanoid synchronous wireless control mechanical hand system | |
CN110625591A (en) | Teleoperation system and method based on exoskeleton data gloves and teleoperation rod | |
Jiang et al. | A modular multisensory prosthetic hand | |
CN206869888U (en) | A kind of mobile machine arm system based on surface electromyogram signal | |
Zhao et al. | Development of a multi-DOF anthropomorphic prosthetic hand | |
CN212421309U (en) | Remote control device of foot type robot | |
CN104924308B (en) | A kind of external frame type data glove detecting hand motion | |
CN109801709A (en) | A kind of system of hand gestures capture and health status perception for virtual environment | |
Zaidan et al. | Design and implementation of upper prosthetic controlled remotely by flexible sensor glove | |
CN105843388A (en) | Novel data glove system | |
CN111496803A (en) | Tai Ji pushing robot | |
CN108127667B (en) | Mechanical arm somatosensory interaction control method based on joint angle increment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CB03 | Change of inventor or designer information | ||
CB03 | Change of inventor or designer information |
Inventor after: Fan Liming Inventor after: Fang Bin Inventor after: Zhang Taoyi Inventor before: Fang Bin Inventor before: Zhang Taoyi Inventor before: Fan Liming |