CN112587242B - Master hand simulation method of surgical robot, master hand and application - Google Patents
Master hand simulation method of surgical robot, master hand and application Download PDFInfo
- Publication number
- CN112587242B CN112587242B CN202011464511.0A CN202011464511A CN112587242B CN 112587242 B CN112587242 B CN 112587242B CN 202011464511 A CN202011464511 A CN 202011464511A CN 112587242 B CN112587242 B CN 112587242B
- Authority
- CN
- China
- Prior art keywords
- muscle
- target
- electromyographic signals
- electromyographic
- upper limb
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 67
- 238000004088 simulation Methods 0.000 title claims abstract description 22
- 210000003205 muscle Anatomy 0.000 claims abstract description 188
- 210000001364 upper extremity Anatomy 0.000 claims abstract description 75
- 230000004913 activation Effects 0.000 claims abstract description 66
- 210000003857 wrist joint Anatomy 0.000 claims abstract description 62
- 230000033001 locomotion Effects 0.000 claims abstract description 55
- 210000000811 metacarpophalangeal joint Anatomy 0.000 claims abstract description 49
- 238000007781 pre-processing Methods 0.000 claims abstract description 23
- 230000003183 myoelectrical effect Effects 0.000 claims abstract description 11
- 238000012545 processing Methods 0.000 claims description 30
- 238000013016 damping Methods 0.000 claims description 25
- 238000004458 analytical method Methods 0.000 claims description 23
- 210000000707 wrist Anatomy 0.000 claims description 22
- 230000008602 contraction Effects 0.000 claims description 21
- 230000009471 action Effects 0.000 claims description 20
- 230000004118 muscle contraction Effects 0.000 claims description 16
- 238000003860 storage Methods 0.000 claims description 15
- 238000001914 filtration Methods 0.000 claims description 14
- 230000015654 memory Effects 0.000 claims description 11
- 230000001537 neural effect Effects 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 7
- 230000008859 change Effects 0.000 claims description 5
- 230000001133 acceleration Effects 0.000 claims description 3
- 230000003321 amplification Effects 0.000 claims description 3
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 3
- 239000000126 substance Substances 0.000 claims 7
- 210000003811 finger Anatomy 0.000 description 25
- 238000010586 diagram Methods 0.000 description 19
- 230000008569 process Effects 0.000 description 15
- 210000003813 thumb Anatomy 0.000 description 14
- 238000004590 computer program Methods 0.000 description 10
- 238000005520 cutting process Methods 0.000 description 9
- 238000004364 calculation method Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 210000000623 ulna Anatomy 0.000 description 6
- 210000000245 forearm Anatomy 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 5
- 230000003387 muscular Effects 0.000 description 5
- 238000001356 surgical procedure Methods 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 241000208011 Digitalis Species 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000002324 minimally invasive surgery Methods 0.000 description 3
- 210000005036 nerve Anatomy 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 108010001267 Protein Subunits Proteins 0.000 description 2
- 241001227561 Valgus Species 0.000 description 2
- 241000469816 Varus Species 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 241000282414 Homo sapiens Species 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 208000015181 infectious disease Diseases 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000000284 resting effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
- A61B34/37—Master-slave robots
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/25—User interfaces for surgical systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/70—Manipulators specially adapted for use in surgery
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/70—Manipulators specially adapted for use in surgery
- A61B34/74—Manipulators with manual electric input means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1121—Determining geometric values, e.g. centre of rotation or angular range of movement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/22—Ergometry; Measuring muscular strength or the force of a muscular blow
- A61B5/224—Measuring muscular strength
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/22—Ergometry; Measuring muscular strength or the force of a muscular blow
- A61B5/224—Measuring muscular strength
- A61B5/225—Measuring muscular strength of the fingers, e.g. by monitoring hand-grip force
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6813—Specially adapted to be attached to a specific body part
- A61B5/6825—Hand
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6813—Specially adapted to be attached to a specific body part
- A61B5/6825—Hand
- A61B5/6826—Finger
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Public Health (AREA)
- Physics & Mathematics (AREA)
- Pathology (AREA)
- Biophysics (AREA)
- Robotics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Physical Education & Sports Medicine (AREA)
- Physiology (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Geometry (AREA)
- Human Computer Interaction (AREA)
- Manipulator (AREA)
Abstract
The present disclosure provides a surgical robot master hand simulation method, a master hand and an application, wherein the surgical robot master hand simulation method comprises: collecting myoelectric signals generated by target muscles of the upper limbs in a time period; preprocessing the electromyographic signals to obtain corresponding amplitudes of the electromyographic signals at different moments; acquiring the activation state of the target muscle of the upper limb according to the corresponding amplitude values of the electromyographic signal at different moments; driving the joint of the Hill-type muscle model to move according to the activation state of the target muscle of the upper limb, and acquiring the muscle force of the target muscle of the upper limb; acquiring the motion angles of the metacarpophalangeal joints and the wrist joints according to the muscle force of the upper limb target muscle; and driving the slave hand end to move according to the movement angles of the metacarpophalangeal joints and the wrist joints.
Description
Technical Field
The disclosure relates to the field of medical equipment and mechanical control, in particular to a muscle-skeleton-model-based surgical robot master hand simulation method, a master hand and application.
Background
In the process of modern society, the robot gradually changes the production and living modes of human beings, improves the production efficiency and product quality of various industries, can perform operations by remotely operating a medical system as an operation robot belonging to high-end and intelligent medical equipment products, has unique advantages in the fields of prevention, diagnosis, treatment, rehabilitation and the like of auxiliary surgical operations, and has huge development potential. The surgical robot combines a teleoperation medical system with a traditional minimally invasive surgery, and can allow a surgeon to indirectly complete the surgical operation by controlling a master hand of the mechanical surgical robot, thereby increasing the accuracy of the surgical operation.
However, the main hand of the mechanical surgical robot in the prior art has some disadvantages, for example, the ZEUS surgical robot system developed by Computer Motion company cannot eliminate the shaking signal generated by the hand, and is easy to have an operation error phenomenon, and the system has a large volume, a small working space and insufficient flexibility, which brings great limitation to the development of the system itself; the Da Vinci Surgical robot developed by intutive Surgical company is high in price, large in system and complex in structure, long-time training needs to be conducted on an operator in the process of operating the master hand of the Surgical robot, and fatigue of the operator is easily caused when the master hand operating lever of the Surgical robot is operated for a long time.
Therefore, the existing mechanical master has the problems of large system, complex structure, long training time, easy fatigue of operators and the like, and a person skilled in the art is urgently needed to overcome the problems.
Disclosure of Invention
Technical problem to be solved
The present disclosure provides a surgical robot master hand simulation method, master hand and application to solve the technical problems set forth above.
(II) technical scheme
According to an aspect of the present disclosure, there is provided a surgical robot master hand simulation method, including:
collecting myoelectric signals generated by target muscles of the upper limbs in a time period;
preprocessing the electromyographic signals to obtain corresponding amplitudes of the electromyographic signals at different moments;
acquiring the activation state of the target muscle of the upper limb according to the corresponding amplitude values of the electromyographic signal at different moments;
driving the joints of the Hill-type muscle model to move according to the activation state of the target muscles of the upper limbs, and acquiring the muscle force of the target muscles of the upper limbs; and
and acquiring the movement angles of the metacarpophalangeal joints and the wrist joints according to the muscle force of the target muscles of the upper limbs so as to drive the movement from the hand end.
In some embodiments of the present disclosure, the performing signal preprocessing on the electromyographic signal, and acquiring corresponding amplitudes of the electromyographic signal at different times includes:
amplifying the electromyographic signals to obtain amplified electromyographic signals;
carrying out filtering processing on the amplified electromyographic signals to obtain filtered electromyographic signals;
rectifying the electromyographic signals after the filtering processing to obtain the electromyographic signals after the rectifying processing; and
and detecting the action time interval of the electromyographic signals after rectification processing, and determining the action effective time interval of the electromyographic signals.
In some embodiments of the present disclosure, the obtaining the activation state of the upper limb target muscle according to the corresponding amplitudes of the electromyographic signal at different times includes:
the neural activation state at time t is:
u(t)=k×A(t)(t-d)-l 1 ×u(t-1)-l 2 ×u(t-2)
wherein A (t) is the corresponding amplitude of the electromyographic signal at t moment, k and l 1 、l 2 Respectively are nerve activation coefficients, d is time delay; wherein the neural activation coefficient satisfies:
l 1 =α 1 +α 2 (|α 1 |<1;|α 2 |<1)
l 2 =α 1 ·α 2 (|α 1 |<1;|α 2 |<1)
k-l 1 -l 2 =1
wherein alpha is 1 And alpha 2 Is electromyographic signal delay coefficient;
the muscle activation state a (t) is:
wherein c, d, m and b are muscle activation coefficients; u (t) is the state of neural activation at time t; and
while muscle activation state a (t) =0, upper limb target muscle is not activated; in the muscle activation state 0 < a (t) < 1, the upper limb target muscle part is activated; in the muscle activation state a (t) =1, the upper limb target muscle is fully activated.
In some embodiments of the present disclosure, said driving the joint of the hilt-type muscle model to generate motion according to the activation state of the upper limb target muscle, and acquiring the upper limb target muscle contraction force includes:
constructing a hill-type muscle model comprising a contracting element, a parallel elastic element and a series elastic element;
calculating the tension generated by the contracting element; wherein the tension force F generated by the contracting element ce Comprises the following steps:
F ce =f(l)f(v)a
wherein f (l) is the instantaneous muscle contraction length coefficient of the contraction element; f (v) is the instantaneous muscle contraction velocity coefficient of the contracting element, a is the upper limb target muscle activation state;
the instantaneous muscle contraction length coefficient f (l) of the contraction element and the instantaneous muscle contraction speed coefficient f (v) of the contraction element satisfy:
f(l)=F max (1-(l ce -l ce0 ) 2 /w 2 (l ce0 ) 2 )
f(v)=(v ce0 -v ce )/(v ce0 +(v ce /c))
wherein, F max Is the maximum equidistant retraction tension of the retraction element; l ce0 Is the optimal length of the contracting elements; l. the ce The length of the contracting element after tension change; w is the range of forces generated by the contracting element; v. of ce0 Is the optimal retraction speed of the retraction element; v. of ce For the contraction speed of the contracting element after being subjected to tension changeDegree, c is a hyperbolic form factor;
calculating the tension generated by the parallel elastic elements; wherein the tension F generated by the parallel elastic elements pee Comprises the following steps:
F pee =K pee (l ce -l ce0 ) 2
wherein, K pee Is the elastic modulus of the parallel elastic element;
calculating a damping force generated by the contracting element; wherein the damping force f generated by the contracting element c Comprises the following steps:
f c =Cv ce
wherein C is a damping coefficient of the contracting element; and
calculating the muscle force generated by the upper limb target muscle according to the tension generated by the contraction element, the tension generated by the parallel elastic element and the damping force generated by the contraction element; wherein the muscular force F generated by the ith target muscle i Comprises the following steps:
F i =F ce +F pee +f c 。
in some embodiments of the present disclosure, the acquiring the movement angles of the metacarpophalangeal joints and the wrist joints according to the upper limb target muscle contraction force includes:
applying a moment to a metacarpophalangeal joint and/or a wrist joint, wherein the metacarpophalangeal joint and/or the wrist joint is configured as a connecting portion connecting any two members; the sum moment Mi of the rotation of the component around the metacarpophalangeal joints and/or the wrist joints is as follows:
M i =∑F i d i +∑M f
wherein, F i A muscle force generated for the ith said target muscle; d i Distance of muscle force from joint point, M f A resisting moment generated for the damping force f;
the damping force f is:
wherein, c i The damping coefficient for the rotation of the member about the metacarpophalangeal joint and/or the wrist joint,the angular velocity at which the member rotates about the metacarpophalangeal joint and/or the wrist joint;
according to the momentum moment model, the sum moment of the rotation of the component around the metacarpophalangeal joint and/or the wrist joint is expressed as:
wherein J is the moment of inertia of each member,angular acceleration of the member about the metacarpophalangeal joint and/or the wrist joint; and
and obtaining the motion angles of the metacarpophalangeal joints and the wrist joints.
In some embodiments of the present disclosure, the target muscle comprises: flexor digitorum superficialis, extensor digitorum, flexor carpi radialis, extensor carpi longus, extensor carpi radialis brevis, extensor carpi ulnaris, flexor carpi pronator, and flexor digitorum cruris.
According to an aspect of the present disclosure, there is provided a surgical robot master hand, comprising:
the electromyographic signal acquisition module is used for acquiring electromyographic signals generated by target muscles of the upper limbs in a time period;
the signal preprocessing module is used for preprocessing the electromyographic signals to acquire corresponding amplitudes of the electromyographic signals at different moments; and
the muscle skeleton model module is used for acquiring the activation state of the upper limb target muscle according to the corresponding amplitude values of the electromyographic signals at different moments; driving the joints of the Hill-type muscle model to move according to the activation state of the target muscles of the upper limbs, and acquiring the muscle force of the target muscles of the upper limbs; and acquiring the motion angles of the metacarpophalangeal joints and the wrist joints according to the muscle force of the target muscles of the upper limbs so as to drive the slave hand end to move.
In some embodiments of the present disclosure, the musculoskeletal model module comprises:
the muscle activation submodule is used for acquiring the activation state of the target muscle of the upper limb according to the corresponding amplitude values of the electromyographic signals at different moments;
the Hill-type muscle model analysis module is used for driving the joint of the Hill-type muscle model to move according to the activation state of the target muscle of the upper limb so as to obtain the muscle force of the target muscle of the upper limb; and
the forward dynamics analysis module is used for acquiring the motion angles of the metacarpophalangeal joints and the wrist joints according to the muscle force of the upper limb target muscle;
wherein the signal preprocessing module comprises:
the signal amplification sub-module is used for amplifying the electromyographic signals to obtain amplified electromyographic signals;
the digital filtering submodule is used for carrying out filtering processing on the amplified electromyographic signals to obtain filtered electromyographic signals;
the signal rectification submodule is used for carrying out rectification processing on the electromyographic signals after the filtering processing to obtain the electromyographic signals after the rectification processing; and
and the action time interval detection submodule is used for carrying out action time interval detection on the electromyographic signals after rectification processing and determining action effective time intervals of the electromyographic signals.
According to an aspect of the present disclosure, there is provided an electronic device including:
one or more processors;
a memory to store one or more instructions;
wherein the one or more instructions, when executed by the one or more processors, cause the one or more processors to implement the above-described method.
According to an aspect of the present disclosure, there is provided a computer-readable storage medium having stored thereon executable instructions that, when executed by a processor, cause the processor to implement the above-described method.
(III) advantageous effects
According to the technical scheme, the main hand simulation method, the main hand and the application of the surgical robot have at least one or part of the following beneficial effects:
(1) The remote synchronous operation is adopted in the method, and in the processes of signal collection, data processing and control from the hand end, because the whole process does not contact the patient, the method avoids the contact of an operator with the patient in the process of minimally invasive surgery, and greatly reduces the possibility of infection of the patient.
(2) The myoelectric joint control system is simple in structure and low in production cost, the myoelectric signal is mapped to the joint movement angle by using the musculoskeletal model only by attaching the myoelectric signal acquisition system to the arm of an operator, the movement of the slave hand end surgical instrument is controlled, the master hand of the existing mechanical surgical robot is replaced, the floor area of the system is reduced, and the manufacturing cost of the surgical instrument is greatly reduced.
(3) The operation of the method is simple, the method is easy to operate, an operator can control the slave hand end to realize the movement of four degrees of freedom by utilizing the actions of four different degrees of freedom, the step that the operator learns and controls the master hand of the mechanical surgical robot is omitted, and the learning burden and the financial expenditure of training of the operator are reduced.
(4) The surgical robot master hand based on the musculoskeletal model can be used as a special surgical robot master hand, can control gestures with four degrees of freedom from a hand end, including flexion and extension of fingers, flexion and extension of wrists, up-and-down cutting of wrists and inner and outer turning of forearms, belongs to a novel surgical robot master hand, can reduce labor intensity of operators, shortens treatment time, and has immeasurable wide market prospect as a novel industry in development.
Drawings
FIG. 1 schematically illustrates an exemplary system architecture to which a surgical robot master hand simulation method and master hand may be applied, according to an embodiment of the disclosure;
fig. 2 schematically illustrates a flow of a surgical robot master hand simulation method provided by an embodiment of the present disclosure;
FIG. 3a is a schematic diagram illustrating the relationship between muscles and joints provided by an embodiment of the present disclosure;
FIG. 3b is a schematic diagram illustrating the relationship between muscles and joints provided by an embodiment of the present disclosure;
FIG. 3c is a schematic diagram illustrating the relationship between muscles and joints provided by an embodiment of the present disclosure;
FIG. 4 schematically shows a flow chart of an electromyographic signal preprocessing method provided by an embodiment of the present disclosure;
fig. 5 schematically shows a flowchart of a method for acquiring an activation state of an upper limb target muscle provided by the embodiment of the disclosure;
fig. 6 schematically illustrates a flowchart of a method for obtaining muscle force of an upper limb target muscle provided by an embodiment of the present disclosure;
fig. 7 schematically illustrates a structural diagram of a hill-type muscle model provided by the embodiment of the disclosure;
fig. 8 schematically illustrates a flowchart of a method for acquiring a motion angle of a metacarpophalangeal joint and a wrist joint provided by an embodiment of the disclosure;
FIG. 9a schematically illustrates a forward dynamics analysis diagram of a musculoskeletal model provided by an embodiment of the present disclosure;
FIG. 9b schematically illustrates a forward dynamics analysis diagram of a musculoskeletal model provided by an embodiment of the present disclosure;
FIG. 9c schematically illustrates a forward dynamics analysis diagram of a musculoskeletal model provided by an embodiment of the present disclosure;
fig. 10 schematically illustrates a block diagram of a surgical robot master hand, in accordance with an embodiment of the present disclosure;
fig. 11 schematically illustrates a block diagram of a computer system suitable for implementing a surgical robot master hand simulation method according to an embodiment of the present disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that these descriptions are illustrative only and are not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.
Where a convention analogous to "at least one of A, B, and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B, and C" would include but not be limited to systems that have A alone, B alone, C alone, A and B together, A and C together, B and C together, and/or A, B, and C together, etc.). In those instances where a convention analogous to "at least one of A, B, or C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B, or C" would include but not be limited to systems that have A alone, B alone, C alone, A and B together, A and C together, B and C together, and/or A, B, and C together, etc.).
The present disclosure provides a surgical robot master hand simulation method, including: collecting myoelectric signals generated by target muscles of the upper limbs in a time period; preprocessing the electromyographic signals to obtain corresponding amplitudes of the electromyographic signals at different moments; acquiring the activation state of the target muscle of the upper limb according to the corresponding amplitude values of the electromyographic signal at different moments; driving the joints of the Hill-type muscle model to move according to the activation state of the target muscle of the upper limb, and acquiring the muscle force of the target muscle of the upper limb; acquiring the motion angles of the metacarpophalangeal joints and the wrist joints according to the muscle force of the target muscles of the upper limbs; the slave hand end is driven to move according to the movement angles of the metacarpophalangeal joints and the wrist joints.
Fig. 1 schematically illustrates an example system architecture 100 to which a surgical robot master hand simulation method and master hand may be applied, according to an embodiment of the disclosure. It should be noted that fig. 1 is only an example of a system architecture to which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, and does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.
As shown in fig. 1, the system architecture 100 according to this embodiment may include terminal devices 101, 102, 103, a network 104 and a server 105. Network 104 is the medium used to provide communication links between terminal devices 101, 102, 103 and server 105. Network 104 may include various connection types, such as wired and/or wireless communication links, and so forth.
The user may use the terminal devices 101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages or the like. The terminal devices 101, 102, 103 may be installed with various information systems, such as a visual feedback system, a database system, and other business systems.
The terminal devices 101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.
The server 105 may be a server providing various services, such as a background management server (for example only) providing support for websites browsed by users using the terminal devices 101, 102, 103. The backend management server may analyze and process the received data such as the user request, and feed back a processing result (for example, a web page, information, or data obtained or generated according to the user request) to the terminal device.
It should be noted that the master hand simulation method for the surgical robot provided in the embodiment of the present disclosure may be generally executed by the server 105. Accordingly, the master surgical robot hand provided by embodiments of the present disclosure may generally be located in the server 105. The master hand simulation method for the surgical robot provided by the embodiment of the present disclosure may also be performed by a server or a server cluster that is different from the server 105 and is capable of communicating with the terminal devices 101, 102, 103 and/or the server 105. Accordingly, the master surgical robot hand provided by the embodiment of the present disclosure may also be disposed in a server or a server cluster that is different from the server 105 and is capable of communicating with the terminal devices 101, 102, 103 and/or the server 105. Alternatively, the surgical robot master hand simulation method provided by the embodiment of the present disclosure may also be executed by the terminal device 101, 102, or 103, or may also be executed by another terminal device different from the terminal device 101, 102, or 103. Accordingly, the master hand of the surgical robot provided by the embodiment of the present disclosure may also be disposed in the terminal device 101, 102, or 103, or in another terminal device different from the terminal device 101, 102, or 103.
For example, the signal preprocessing data related to the electromyogram signal may be originally stored in any one of the terminal apparatuses 101, 102, or 103 (for example, but not limited to the terminal apparatus 101), or stored on an external storage apparatus and may be imported into the terminal apparatus 101. Then, the terminal device 101 may locally perform the surgical robot master simulation method provided by the embodiment of the present disclosure, or transmit the signal preprocessing data related to the electromyographic signal to another terminal device, a server, or a server cluster, and perform the surgical robot master simulation method provided by the embodiment of the present disclosure by another terminal device, a server, or a server cluster that receives the signal preprocessing data related to the electromyographic signal.
It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
The master hand of the surgical robot needs to have extremely high operation accuracy, but when the master hand of the mechanical surgical robot is used for performing surgery, the method for performing the surgery operation by using the master hand operating lever is greatly different from the surgery operation method of the traditional minimally invasive surgery, so that an operator needs to be skilled in the ability of controlling the master hand operating lever of the surgical robot. In addition, when an operator controls the main hand of the mechanical surgical robot, the operator needs to use a large force to operate the main hand of the mechanical surgical robot, so that the labor intensity of the operator is increased, and further some misoperation (such as hand vibration) is caused, and a generated vibration signal causes serious consequences. The intelligent and precise master hand operation system is used for further intelligentizing and accurately performing master hand operation of an operator, so that the problems that an existing mechanical master hand system is large, complex in structure, long in training time, easy to cause fatigue of the operator and the like are effectively solved.
The invention provides a master hand simulation method of a surgical robot and a master hand, wherein eight upper limb target muscles related to four-degree-of-freedom motions of finger flexion and extension, wrist up-down incision and forearm eversion of an operator are selected, and the motion of four degrees of freedom from a hand end can be controlled by utilizing the actions of four different degrees of freedom through establishing mapping between myoelectric signals and joint motion angles, so that the motion of a slave hand end surgical instrument is controlled, the master hand of the existing mechanical surgical robot is replaced, the manufacturing and learning cost of the surgical instrument is greatly reduced, and the accuracy and precision of the operation from the hand end are effectively improved.
Fig. 2 schematically shows a musculoskeletal model diagram of the relationship between muscles and joint structures provided by the embodiment of the disclosure.
As shown in fig. 2, the method includes operations S201 to S205.
In operation S201, in a time period, a myoelectric signal generated by an upper limb target muscle is collected, that is, a myoelectric signal diagram.
According to an embodiment of the present disclosure, as shown in fig. 3a, 3b, and 3c, the upper limb target muscle is selected from eight muscles related to four degrees of freedom motions of the operator such as flexion and extension of fingers, flexion and extension of wrists, upper and lower cutting of wrists, and inner and outer turning of forearms, which are 1 to 5 flexors of superficial fingers, 1 to 6 extensors of fingers, 1 to 7 flexors of radial wrist, 1 to 8 extensors of radial wrist, 1 to 10 extensors of radial wrist, 1 to 11 extensors of ulnar wrist, 1 to 12 flexors of pronator and 1 to 13 supinator, respectively.
According to one embodiment of the present disclosure, as shown in fig. 3a, one end of the metacarpophalangeal joint 1-1 is connected with the tail end of the thumb member 1-3, the other end is connected with the head end of the metacarpophalangeal member 1-4, and the thumb member 1-3 rotates around the metacarpophalangeal joint 1-1 in the axial direction to perform flexion and extension movement of the fingers by means of traction of the superficial flexor 1-5 and the extensor digitorum 1-6. Two ends of the superficial flexors 1-5 and the extensors 1-6 are respectively positioned at the position close to the tail end of the thumb component 1-3 and the head end of the ulnar component 1-9, the superficial flexors 1-5 are positioned at the lower side of the connecting line of the thumb component 1-3, the metacarpophalangeal joint 1-1, the metacarpophalangeal component 1-4, the wrist joint 1-2 and the ulnar component 1-9, and the extensors 1-6 are positioned at the upper side of the connecting line of the thumb component 1-3, the metacarpophalangeal joint 1-1, the metacarpophalangeal component 1-4, the wrist joint 1-2 and the ulnar component 1-9. When the right hand of the operator makes the finger flexion, the muscle activation state is obtained through analysis and calculation, the target muscle superficial flexor 1-5 is driven, the thumb component 1-3 rotates around the axial direction of the metacarpophalangeal joint 1-1 to make the flexion of the finger, the rotation angle of the thumb component 1-3 which bends around the metacarpophalangeal joint 1-1 is determined, and the specific method refers to the following operations S202-S205. When the right hand of the operator makes a finger stretching action, the muscle activation state is obtained through analysis and calculation, the target muscle extensor muscles 1-6 are driven, the thumb member 1-3 rotates around the axial direction of the metacarpophalangeal joint 1-1 to make the stretching movement of the fingers, the rotation angle of the thumb member 1-3 stretching around the metacarpophalangeal joint 1-1 is determined, and the specific method refers to the following operations S202-S205.
According to an embodiment of the present disclosure, as shown in fig. 3a, one end of the wrist joint 1-2 is connected to the tail end of the metacarpophalangeal member 1-4, the other end is connected to the head end of the ulna member 1-9, and the metacarpophalangeal member 1-4 rotates axially around the wrist joint 1-2 to perform wrist flexion and extension movements by means of the flexor carpi radialis 1-7 and the extensor carpi radialis 1-8. Two ends of flexors 1-7 and extensor carpi radialis longus 1-8 are respectively positioned at positions close to the tail end of a metacarpal-phalangeal member 1-4, the head end of an ulnar member 1-9 of radius and between a superficial flexor digitalis 1-5 and an extensor digitalis 1-6, the flexors 1-7 of the wrist radialis are positioned at the lower side of the connecting line of the metacarpal-phalangeal member 1-4, a wrist joint 1-2 and an ulnar member 1-9 of radius, and the extensor digitalis 1-6 is positioned at the upper side of the connecting line of the metacarpal-phalangeal member 1-4, the wrist joint 1-2 and the ulnar member 1-9 of radius. When the right hand of the operator does the wrist buckling movement, the muscle activation state is obtained through analysis and calculation, the target muscle flexor carpi radialis 1-7 is driven, the palm and finger members 1-4 rotate around the wrist joint 1-2 axially to do the wrist buckling movement, the rotation angle of the palm and finger members 1-4 buckling around the wrist joint 1-2 is determined, and the specific method refers to the following operations S202-S205. When the right hand of the operator does the wrist stretching movement, the muscle activation state is obtained through analysis and calculation, the target muscle extensor radialis longus 1-8 is driven, the finger component 1-4 rotates around the wrist joint 1-2 axially to do the wrist stretching movement, the rotation angle of the palm finger component 1-4 stretching around the wrist joint 1-2 is determined, and the specific method refers to the following operations S202-S205.
According to an embodiment of the present disclosure, as shown in fig. 3b, one end of the metacarpophalangeal joint 1-1 is connected to the end of the thumb member 1-3, the other end is connected to the head end of the metacarpophalangeal member 1-4, one end of the wrist joint 1-2 is connected to the end of the metacarpophalangeal member 1-4, the other end is connected to the head end of the ulna member 1-9, and the metacarpophalangeal member 1-4 is drawn by the extensor carpi radialis brevis 1-10 and the extensor carpi ulnaris 1-11 to swing transversely around the wrist joint 1-2 for the upper and lower incisional movement of the wrist. Two ends of extensor carpi radialis brevis 1-10 and extensor carpi ulnaris 1-11 are respectively at a position close to the tail end of the metacarpal finger member 1-4 and a position close to the head end of the ulnar member 1-9, the extensor carpi radialis brevis 1-10 is positioned at the left side of the connecting line of the metacarpal finger member 1-4, the wrist joint 1-2 and the ulnar member 1-9, and the extensor carpi ulnaris 1-11 is positioned at the right side of the connecting line of the metacarpal finger member 1-4, the wrist joint 1-2 and the ulnar member 1-9. When the right hand of an operator does a transverse cutting motion around the wrist joint 1-2, a muscle activation state is obtained through analysis and calculation, a target muscle extensor radialis brevis 1-10 is driven, the palm and finger members 1-4 transversely swing around the wrist joint 1-2 to do a wrist cutting motion, the transverse cutting rotation angle of the palm and finger members 1-4 around the wrist joint 1-2 is determined, and the specific method refers to the following operations S202-S205. When the right hand of the operator makes a downward cutting motion around the wrist joint 1-2, the muscle activation state is obtained through analysis and calculation, the target muscle extensor carpi ulnaris 1-11 is driven, the palm and finger members 1-4 transversely swing around the wrist joint 1-2 to make downward cutting motion of the wrist, the rotation angle of the palm and finger members 1-4 transversely downward cutting around the wrist joint 1-2 is determined, and the specific method refers to the following operations S202-S205.
According to an embodiment of the present disclosure, as shown in fig. 3c, both ends of the circular preformer 1-12 and the circular supinator 1-13 are on the ulnar member 1-9, the circular preformer 1-12 is located on the left side of the ulnar member 1-9, the circular supinator 1-13 is located on the right side of the ulnar member 1-9, and the musculoskeletal model rotates along the axis of the ulnar member 1-9 by the circular preformer 1-12 and the circular supinator 1-13 to complete the varus and valgus movement of the arm. When the right hand of the operator makes an arm inversion action, the muscle activation state is obtained through analysis and calculation, the target muscle is driven to rotate the anterior circular muscle 1-12, the ulna member 1-9 rotates anticlockwise along the axis to make arm inversion movement, and the rotation angle of the ulna member 1-9 in the axis inversion is determined. When the right hand of the operator makes an arm eversion action, a muscle activation state is obtained through analysis and calculation, a target muscle supinator muscle 1-13 is driven, the radius ulna component 1-9 rotates clockwise along the axis to make arm eversion movement, the rotation angle of the radius ulna component 1-9 along the axis eversion is determined, and the specific method refers to the following operations S202-S205.
In operation S202, the electromyographic signal is preprocessed to obtain corresponding amplitudes of the electromyographic signal at different times.
According to an embodiment of the present disclosure, as shown in fig. 4, operation S202 further includes the following steps:
in operation S2021, the electromyographic signal is amplified to obtain an amplified electromyographic signal.
In operation S2022, the amplified electromyographic signal is filtered to obtain a filtered electromyographic signal.
In operation S2023, the filtered electromyographic signal is rectified to obtain a rectified electromyographic signal. Specifically, all the electromyographic signals below the resting baseline in the electromyogram are folded over the baseline.
In operation S2024, the rectified electromyographic signal is subjected to motion period detection to determine a motion valid period of the electromyographic signal.
And operation S203, acquiring the activation state of the target muscle of the upper limb according to the corresponding amplitude values of the electromyographic signal at different moments.
According to an embodiment of the present disclosure, as shown in fig. 5, operation S203 further includes the steps of:
in operation S2031, the nerve activation state at time t is:
u(t)=k×A(t)(t-d)-l 1 ×u(t-1)-l 2 ×u(t-2)
wherein A (t) is the corresponding amplitude of the electromyographic signal at t moment, k and l 1 、l 2 Respectively, a nerve activation coefficient, and d is a time delay; wherein the neural activation coefficient satisfies:
l 1 =α 1 +α 2 (|α 1 |<1;|α 2 |<1)
l 2 =α 1 ·α 2 (|α 1 |<1;|α 2 |<1)
k-l 1 -l 2 =1
wherein alpha is 1 And alpha 2 Is the electromyographic signal delay coefficient;
in operation S2032, the muscle activation state a (t) is:
wherein c, d, m and b are muscle activation coefficients; u (t) is the state of neural activation at time t;
in operation S2033, the upper limb target muscle is not activated while the muscle activation state a (t) = 0.
In operation S2034, the upper limb target muscle portion is activated when the muscle activation state 0 < a (t) < 1.
In operation S2035, the upper limb target muscle is fully activated while the muscle activation state a (t) = 1.
And operation S204, driving the joints of the Hill-type muscle model to move according to the activation state of the target muscles of the upper limbs, and acquiring the muscle force of the target muscles of the upper limbs by combining the kinematic parameters and the muscle anatomical parameters.
According to an embodiment of the present disclosure, as shown in fig. 6, operation S204 further includes the following steps:
operation S2041, a hill-type muscle model is constructed, as shown in fig. 7, the hill-type muscle model including a contraction element 710, a parallel elastic element 720 and a series elastic element 730.
Operation S2042, calculating a tension generated by the contracting element 710; wherein the tension force F generated by the contracting element 710 ce Comprises the following steps:
F ce =f(l)f(v)a
wherein f (l) is the instantaneous muscle contraction length coefficient of the contracting element 710; f (v) is the instantaneous muscle contraction velocity coefficient for contractile element 710, α is the upper limb target muscle activation state;
the instantaneous muscle contraction length coefficient f (l) of the contraction element 710 and the instantaneous muscle contraction velocity coefficient f (v) of the contraction element 710 satisfy:
f(l)=F max (1-(l ce -l ce0 ) 2 /w 2 (l ce0 ) 2 )
f(v)=(v ce0 -v ce )/(v ce0 +(v ce /c))
wherein, F max Maximum isometric contraction tension for the contracting element 710, which is related to maximum muscle force contraction (MVC); l ce0 Is the optimal length of the contracting elements 710; l ce The length of contracting element 710 after being subjected to tension change; w is the range of force generated by the contracting element 710; v. of ce0 Is the optimal retraction speed of the retraction element 710; v. of ce C is a hyperbolic form factor for the rate of contraction of the contracting element 710 after being subjected to a change in tension.
Operation S2043, calculating the tension generated by the parallel elastic element 720; wherein the tension F generated by the parallel elastic element 720 pee Comprises the following steps:
F pee =K pee (l ce -l ce0 ) 2
wherein, K pee Is the modulus of elasticity of the shunt elastic element 720;
operation S2044, calculate the systolic elementThe damping force generated by member 710; wherein the damping force f generated by the contracting element 710 c Comprises the following steps:
f c =Cv ce
where C is the damping coefficient of contracting element 710.
Operation S2045, calculating a muscle force generated by the upper limb target muscle according to the tension generated by the contraction element 710, the tension generated by the parallel elastic element 720, and the damping force generated by the contraction element 710; wherein, the muscle force F generated by the ith target muscle i Comprises the following steps:
F i =F ce +F pee +f c 。
since the series elastic element 730 has a large stiffness and does not greatly affect the muscle force, the tension generated by the series elastic element 730 is equal to the muscle force.
In operation S205, the movement angles of the metacarpophalangeal joints and the wrist joints are obtained according to the muscle force of the target muscle of the upper limb, so as to drive the movement from the hand end.
According to an embodiment of the present disclosure, as shown in fig. 8, operation S205 further includes the following steps:
an operation S2051 of applying a moment to a metacarpophalangeal joint and/or a wrist joint configured as a connecting portion connecting any two members; moment M of sum of rotation of members about metacarpophalangeal joints and/or wrist joints i Comprises the following steps:
M i =∑F i d i +∑M f
wherein, F i The muscle force generated for the ith target muscle; d i Distance of muscle force from joint point, M f The resistive torque generated for the damping force f.
The damping force f is:
wherein, c i Is the damping coefficient for the rotation of the member about the metacarpophalangeal joint and/or the wrist joint,is the angular velocity at which the member rotates about the metacarpophalangeal and/or wrist joints.
Operation S2052, the sum moment of rotation of the member about the metacarpophalangeal joint and/or the wrist joint is expressed as:
wherein J is the moment of inertia of each component,is the angular acceleration of the rotation of the member about the metacarpophalangeal and/or wrist joints.
Operation S2053, solving the motion angle theta of the component around the metacarpophalangeal joint and/or the wrist joint i
Fig. 9a is a force analysis diagram of the process of finger flexion and extension and wrist flexion with two degrees of freedom according to an embodiment of the present disclosure. Referring also to FIGS. 3a to 3c, F 1 Muscular force of the superficial flexor muscles 1-5, F 2 Muscular force of extensor digitorum 1-6, F 3 The muscular force produced by the flexor carpi radialis 1-7, F 4 The muscle force generated by extensor carpi radialis longus 1-8, f 1 Damping force, f, generated for rotation of the thumb member 1-3 about the metacarpophalangeal joint 1-4 2 The angle θ of the rotation of the thumb member 1-3 about the point A (metacarpophalangeal joint 1-1) can be solved for the damping force generated by the rotation of the metacarpophalangeal member 1-4 about the wrist joint 1-2 based on the analysis process of the forward dynamics provided in the steps S2051-S2053 1 The angle theta of the palm and finger component 1-4 rotating around the point B (wrist joint 1-2) 2 。
FIG. 9b is a force analysis diagram of the wrist up-down cutting movement process with one degree of freedom, according to an embodiment of the present disclosure. Referring also to FIGS. 3a to 3c, F 5 The muscle force generated by the extensor carpi radialis muscles 1-10, F 6 The muscle force generated by extensor carpi ulnaris 1-11, f 3 For the damping force generated by the swinging of the thumb component 1-3 and the palm and finger component 1-4 around the wrist joint 1-2 in the wrist bending and stretching process, the angle theta of the swinging of the thumb component 1-3 and the palm and finger component 1-4 around the point B (the wrist joint 1-2) can be solved based on the analysis process which is provided by the step S2051 to the step S2053 and utilizes the forward dynamics 3 。
Fig. 9c is a force analysis graph illustrating the forearm varus and valgus movement with one degree of freedom, according to an embodiment of the present disclosure. Referring also to FIGS. 3a to 3c, F 7 Muscular force produced by the circumflex muscles 1-12, F 8 The muscle force generated by the supinator muscles 1-13, f 4 For the damping force generated by the rotation of the ulnar component 1-9 around the axis of the ulnar component 1-9 during the process of forearm eversion, the angle theta of the ulnar component 1-9 around the o point (the axis of the ulnar component 1-9) can be solved based on the analysis process of the forward dynamics provided by the step S2051-operation S2053 4 。
In operation S2054, the movement angles of the metacarpophalangeal joints and the wrist joints are determined to drive the movement from the hand ends.
In an application scenario of the present disclosure, an operator may configure parameters and set functions in the visual feedback system, the visual feedback system may display a picture of an operation site to the operator in real time through the display, and the operator performs the master hand simulation method of the surgical robot provided by the embodiment of the present disclosure in combination with the displayed picture to drive a surgical instrument at a slave hand end, thereby completing a surgical treatment process.
Fig. 10 schematically illustrates a block diagram of a surgical robot master hand, in accordance with an embodiment of the present disclosure. As shown in fig. 10, the surgical robot master hand includes: an electromyographic signal acquisition module 1010, a signal preprocessing module 1020, and a musculoskeletal model module 1030.
The electromyographic signal acquisition module 1010 is used for acquiring electromyographic signals generated by the target muscles of the upper limbs in a time period.
And a signal preprocessing module 1020, configured to perform signal preprocessing on the electromyographic signals to obtain corresponding amplitudes of the electromyographic signals at different times.
According to an embodiment of the present disclosure, the signal preprocessing module 1020 includes:
and the signal amplification sub-module is used for amplifying the electromyographic signals to obtain the amplified electromyographic signals.
And the digital filtering submodule is used for carrying out filtering processing on the amplified electromyographic signals to obtain the electromyographic signals after the filtering processing.
And the signal rectifier module is used for rectifying the electromyographic signals after the filtering processing to obtain the electromyographic signals after the rectifying processing.
And the action time interval detection submodule is used for carrying out action time interval detection on the electromyographic signals after rectification processing and determining action effective time intervals of the electromyographic signals.
The muscle skeleton model module 1030 is used for acquiring the activation state of the target muscle of the upper limb according to the corresponding amplitude values of the electromyographic signal at different moments; driving the joint of the Hill-type muscle model to move according to the activation state of the target muscle of the upper limb, and acquiring the muscle force of the target muscle of the upper limb by combining the kinematic parameters and the muscle anatomical parameters; according to the muscle force of the target muscle of the upper limb, the movement angles of the metacarpophalangeal joints and the wrist joints are obtained, and the movement from the hand end is driven.
According to an embodiment of the present disclosure, the musculoskeletal model module 1030 comprises:
and the muscle activation submodule is used for acquiring the activation state of the target muscle of the upper limb according to the corresponding amplitude of the electromyographic signal at different moments.
And the Hill-type muscle model analysis module is used for driving the joints of the Hill-type muscle model to generate movement according to the activation state of the target muscles of the upper limbs, and acquiring the muscle force of the target muscles of the upper limbs by combining the kinematic parameters and the muscle anatomical parameters.
And the forward dynamics analysis module is used for acquiring the motion angles of the metacarpophalangeal joints and the wrist joints according to the muscle force of the target muscles of the upper limbs.
Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be implemented at least partly as a computer program module, which when executed, may perform a corresponding function.
For example, any plurality of the electromyographic signal acquisition module 1010, the signal preprocessing module 1020, and the musculoskeletal model module 1030 may be combined and implemented in one module/unit/sub-unit, or any one of the modules/units/sub-units may be split into a plurality of modules/units/sub-units. Alternatively, at least part of the functionality of one or more of these modules/units/sub-units may be combined with at least part of the functionality of other modules/units/sub-units and implemented in one module/unit/sub-unit. According to an embodiment of the present disclosure, at least one of the electromyographic signal acquisition module 1010, the signal preprocessing module 1020, and the musculoskeletal model module 1030 may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or in any one of three implementations of software, hardware, and firmware, or in any suitable combination of any of them. Alternatively, at least one of the electromyographic signal acquisition module 1010, the signal pre-processing module 1020, and the musculoskeletal model module 1030 may be implemented at least in part as a computer program module that, when executed, may perform a corresponding function.
It should be noted that, the data processing system part in the embodiment of the present disclosure corresponds to the data processing method part in the embodiment of the present disclosure, and the description of the data processing system part specifically refers to the data processing method part, which is not described herein again.
Fig. 11 schematically illustrates a block diagram of a computer system suitable for implementing a surgical robot master hand simulation method according to an embodiment of the present disclosure. The computer system illustrated in FIG. 11 is only one example and should not impose any limitations on the functionality or scope of use of embodiments of the disclosure.
As shown in fig. 11, a computer system 1100 according to an embodiment of the present disclosure includes a processor 1101, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 1102 or a program loaded from a storage section 1108 into a Random Access Memory (RAM) 1103. The processor 1101 may comprise, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 1101 may also include on-board memory for caching purposes. The processor 1101 may comprise a single processing unit or a plurality of processing units for performing the different actions of the method flows according to the embodiments of the present disclosure.
In the RAM 1103, various programs and data necessary for the operation of the system 1100 are stored. The processor 1101, the ROM 1102, and the RAM 1103 are connected to each other by a bus 1104. The processor 1101 performs various operations of the method flow according to the embodiments of the present disclosure by executing programs in the ROM 1102 and/or the RAM 1103. It is noted that the programs may also be stored in one or more memories other than the ROM 1102 and RAM 1103. The processor 1101 may also perform various operations of method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.
According to an embodiment of the present disclosure, the method flow according to an embodiment of the present disclosure may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable storage medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication portion 1109 and/or installed from the removable medium 1111. The computer program, when executed by the processor 1101, performs the above-described functions defined in the system of the embodiment of the present disclosure. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.
The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist alone without being assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement a method according to an embodiment of the disclosure.
According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. Examples may include, but are not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
For example, according to an embodiment of the present disclosure, a computer-readable storage medium may include the ROM 1102 and/or the RAM 1103 described above and/or one or more memories other than the ROM 1102 and the RAM 1103.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It will be appreciated by those skilled in the art that various combinations and/or combinations of the features recited in the various embodiments of the disclosure and/or the claims may be made even if such combinations or combinations are not explicitly recited in the disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.
The embodiments of the present disclosure are described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used advantageously in combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the disclosure, and these alternatives and modifications are intended to fall within the scope of the disclosure.
Claims (7)
1. A surgical robotic master hand, comprising: the simulation method comprises an electromyographic signal acquisition module, a signal preprocessing module and a musculoskeletal model module, and comprises the following steps:
acquiring myoelectric signals generated by target muscles of the upper limbs in a time period by using the myoelectric signal acquisition module;
utilizing the signal preprocessing module to perform signal preprocessing on the electromyographic signals to acquire corresponding amplitudes of the electromyographic signals at different moments;
acquiring the activation state of the target muscle of the upper limb by using the muscle skeleton model module according to the corresponding amplitude values of the electromyographic signal at different moments;
driving the joints of the Hill-type muscle model to move according to the activation state of the target muscles of the upper limbs, and acquiring the muscle force of the target muscles of the upper limbs; and
acquiring the motion angles of the metacarpophalangeal joints and the wrist joints according to the muscle force of the target muscles of the upper limbs so as to drive the slave hand end to realize the motion with four degrees of freedom;
wherein the upper limb target muscle comprises: flexor digitorum superficialis, extensor digitorum, flexor carpi radialis, extensor carpi longus, extensor carpi radialis brevis, extensor carpi ulnaris, flexor carpi pronator, and flexor digitorum crudus;
wherein, according to upper limbs target muscle contraction force, acquire the motion angle of metacarpophalangeal joint and wrist joint and include:
applying a moment to a metacarpophalangeal joint and/or a wrist joint, wherein the metacarpophalangeal joint and/or the wrist joint is configured as a connecting portion connecting any two members; sum moment of rotation of said members about metacarpophalangeal and/or wrist jointsComprises the following steps:
wherein the content of the first and second substances,is as followsBlocking a muscle force generated by the target muscle;the distance of the muscle force from the joint point,as a damping forceThe resulting resistive torque;
wherein the content of the first and second substances,the damping coefficient for the rotation of the member about the metacarpophalangeal joint and/or the wrist joint,the angular velocity at which the member rotates about the metacarpophalangeal joint and/or the wrist joint;
according to the momentum moment model, the sum moment of the rotation of the component around the metacarpophalangeal joint and/or the wrist joint is expressed as:
wherein the content of the first and second substances,as the moment of inertia of each member, for example,angular acceleration of rotation of the member about the metacarpophalangeal joint and/or the wrist joint; and
and obtaining the motion angles of the metacarpophalangeal joints and the wrist joints.
2. The master hand of a surgical robot according to claim 1, wherein the signal preprocessing the electromyographic signals to obtain corresponding amplitudes of the electromyographic signals at different times comprises:
amplifying the electromyographic signals to obtain amplified electromyographic signals;
carrying out filtering processing on the amplified electromyographic signals to obtain filtered electromyographic signals;
rectifying the electromyographic signals after the filtering processing to obtain the electromyographic signals after the rectifying processing; and
and detecting the action time period of the electromyographic signals after rectification processing, and determining the action effective time period of the electromyographic signals.
3. The master hand of the surgical robot of claim 1, wherein the obtaining of the activation state of the upper limb target muscle according to the corresponding amplitude of the electromyographic signal at different times comprises:
the neural activation state at time t is:
wherein the content of the first and second substances,is the corresponding amplitude of the electromyographic signal at the time t,、、are the neural activation coefficients, respectively,is a time delay; wherein the neural activation coefficient satisfies:
wherein the content of the first and second substances,andis the electromyographic signal delay coefficient;
wherein, the first and the second end of the pipe are connected with each other,、、andis the muscle activation coefficient;a neural activation state at time t; and
4. The master surgical robot hand of claim 1, wherein the driving of the joints of the Hill-type muscle model to generate motion according to the upper limb target muscle activation state, obtaining the upper limb target muscle contraction force comprises:
constructing a Hill-type muscle model comprising a contracting element, a parallel elastic element and a series elastic element;
calculating the tension generated by the contracting element; wherein the tension generated by the contracting elementComprises the following steps:
wherein, the first and the second end of the pipe are connected with each other,is the instantaneous muscle contraction length coefficient of the contraction element;is the instantaneous muscle contraction rate coefficient of the contraction element,a target muscle activation state for the upper limb;
instantaneous muscle contraction length coefficient of the contraction elementAnd the instantaneous muscle contraction rate coefficient of the contraction elementSatisfies the following conditions:
wherein the content of the first and second substances,is the maximum equidistant retraction tension of the retraction element;is the optimal length of the contracting elements;the length of the contracting element after being subjected to tension change;a range of forces generated for the contracting element;is the optimal retraction speed of the retraction element;for the speed of contraction of the contracting elements after being subjected to a change in tension,is a hyperbolic form factor;
calculating the tension generated by the parallel elastic elements; wherein the tension generated by the parallel elastic elementsComprises the following steps:
wherein, the first and the second end of the pipe are connected with each other,is the elastic modulus of the parallel elastic element;
calculating the damping force generated by the contracting element(ii) a Wherein the damping force generated by the contracting elementComprises the following steps:
wherein the content of the first and second substances,is the damping coefficient of the contracting element; and
calculating the muscle force generated by the upper limb target muscle according to the tension generated by the contraction element, the tension generated by the parallel elastic element and the damping force generated by the contraction element; wherein, the firstBlocking the muscle force generated by the target muscleComprises the following steps:
5. the surgical robotic master hand of claim 1, wherein the musculoskeletal model module comprises:
the muscle activation sub-module is used for acquiring the activation states of the target muscles of the upper limbs according to the corresponding amplitudes of the electromyographic signals at different moments;
the Hill-type muscle model analysis module is used for driving the joints of the Hill-type muscle model to move according to the activation state of the target muscles of the upper limbs so as to obtain the muscle force of the target muscles of the upper limbs; and
the forward dynamics analysis module is used for acquiring the motion angles of the metacarpophalangeal joints and the wrist joints according to the muscle force of the upper limb target muscle;
wherein the signal preprocessing module comprises:
the signal amplification sub-module is used for amplifying the electromyographic signals to obtain amplified electromyographic signals;
the digital filtering submodule is used for carrying out filtering processing on the amplified electromyographic signals to obtain filtered electromyographic signals;
the signal rectification submodule is used for carrying out rectification processing on the electromyographic signals after the filtering processing to obtain the electromyographic signals after the rectification processing; and
and the action time interval detection submodule is used for carrying out action time interval detection on the electromyographic signals after rectification processing and determining action effective time intervals of the electromyographic signals.
6. An electronic device, comprising:
one or more processors;
a memory to store one or more instructions;
wherein the one or more instructions, when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-5.
7. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to carry out the method of any one of claims 1 to 5.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011464511.0A CN112587242B (en) | 2020-12-11 | 2020-12-11 | Master hand simulation method of surgical robot, master hand and application |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011464511.0A CN112587242B (en) | 2020-12-11 | 2020-12-11 | Master hand simulation method of surgical robot, master hand and application |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112587242A CN112587242A (en) | 2021-04-02 |
CN112587242B true CN112587242B (en) | 2023-02-03 |
Family
ID=75192864
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011464511.0A Active CN112587242B (en) | 2020-12-11 | 2020-12-11 | Master hand simulation method of surgical robot, master hand and application |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112587242B (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07223186A (en) * | 1994-02-14 | 1995-08-22 | Atr Ningen Joho Tsushin Kenkyusho:Kk | Robot control device |
WO2014197401A2 (en) * | 2013-06-03 | 2014-12-11 | The Regents Of The University Of Colorado, A Body Corporate | Systems and methods for postural control of a multi-function prosthesis |
CN105288933A (en) * | 2015-11-20 | 2016-02-03 | 武汉理工大学 | Self-adaptation training control method of parallel lower limb rehabilitation robot and rehabilitation robot |
CN106175802A (en) * | 2016-08-29 | 2016-12-07 | 吉林大学 | A kind of in body osteoarthrosis stress distribution detection method |
CN109259739A (en) * | 2018-11-16 | 2019-01-25 | 西安交通大学 | A kind of myoelectricity estimation method of wrist joint motoring torque |
CN110827987A (en) * | 2019-11-06 | 2020-02-21 | 西安交通大学 | Myoelectricity continuous prediction method and system for wrist joint torque in multi-grabbing mode |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6839594B2 (en) * | 2001-04-26 | 2005-01-04 | Biocontrol Medical Ltd | Actuation and control of limbs through motor nerve stimulation |
US7470233B2 (en) * | 2005-01-26 | 2008-12-30 | Medtronic, Inc. | Method and apparatus for muscle function measurement |
US10402517B2 (en) * | 2013-06-26 | 2019-09-03 | Dassault Systémes Simulia Corp. | Musculo-skeletal modeling using finite element analysis, process integration, and design optimization |
US10758379B2 (en) * | 2016-05-25 | 2020-09-01 | Scott MANDELBAUM | Systems and methods for fine motor control of fingers on a prosthetic hand to emulate a natural stroke |
CN109009586B (en) * | 2018-06-25 | 2020-07-28 | 西安交通大学 | Myoelectric continuous decoding method for man-machine natural driving angle of artificial wrist joint |
CN108932890A (en) * | 2018-09-30 | 2018-12-04 | 成都中医药大学 | Human body teaching skeleton pattern |
-
2020
- 2020-12-11 CN CN202011464511.0A patent/CN112587242B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07223186A (en) * | 1994-02-14 | 1995-08-22 | Atr Ningen Joho Tsushin Kenkyusho:Kk | Robot control device |
WO2014197401A2 (en) * | 2013-06-03 | 2014-12-11 | The Regents Of The University Of Colorado, A Body Corporate | Systems and methods for postural control of a multi-function prosthesis |
CN105288933A (en) * | 2015-11-20 | 2016-02-03 | 武汉理工大学 | Self-adaptation training control method of parallel lower limb rehabilitation robot and rehabilitation robot |
CN106175802A (en) * | 2016-08-29 | 2016-12-07 | 吉林大学 | A kind of in body osteoarthrosis stress distribution detection method |
CN109259739A (en) * | 2018-11-16 | 2019-01-25 | 西安交通大学 | A kind of myoelectricity estimation method of wrist joint motoring torque |
CN110827987A (en) * | 2019-11-06 | 2020-02-21 | 西安交通大学 | Myoelectricity continuous prediction method and system for wrist joint torque in multi-grabbing mode |
Non-Patent Citations (1)
Title |
---|
具有交互夹持力感觉的主从触感装置;李群智,王树新,刘丹,贠今天;《天津大学学报》;20060630;644-650 * |
Also Published As
Publication number | Publication date |
---|---|
CN112587242A (en) | 2021-04-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Jiang et al. | Emerging wearable interfaces and algorithms for hand gesture recognition: A survey | |
Shahid et al. | Moving toward soft robotics: A decade review of the design of hand exoskeletons | |
Agarwal et al. | An index finger exoskeleton with series elastic actuation for rehabilitation: Design, control and performance characterization | |
Carbone et al. | Design issues for an inherently safe robotic rehabilitation device | |
Freeman et al. | A model of the upper extremity using FES for stroke rehabilitation | |
Jarque-Bou et al. | A large calibrated database of hand movements and grasps kinematics | |
Reddy et al. | Toward direct biocontrol using surface EMG signals: Control of finger and wrist joint models | |
Chowdhury et al. | Muscle computer interface: A review | |
Zhang et al. | Design of an active and passive control system of hand exoskeleton for rehabilitation | |
Adnan et al. | Measurement of the flexible bending force of the index and middle fingers for virtual interaction | |
Liu et al. | A new IMMU-based data glove for hand motion capture with optimized sensor layout | |
Chen et al. | A review of myoelectric control for prosthetic hand manipulation | |
Chu et al. | A wearable MYO gesture armband controlling sphero BB-8 robot | |
Ribas Neto et al. | Design of tendon-actuated robotic glove integrated with optical fiber force myography sensor | |
CN112587242B (en) | Master hand simulation method of surgical robot, master hand and application | |
Song et al. | Review of sEMG for robot control: techniques and applications | |
Xia et al. | Hand exoskeleton design and human–machine interaction strategies for rehabilitation | |
TW201445493A (en) | A self-care system for assisting quantitative assessment of rehabilitation movement | |
Fortino et al. | A cloud-assisted wearable system for physical rehabilitation | |
Oscari et al. | Design and Construction of a Bilateral Haptic System for the Remote Assessment of the Stiffness and Range of Motion of the Hand | |
CN103815909A (en) | Active dyskinesia rehabilitation training system | |
Imtiaz et al. | Design of portable exoskeleton forearm for rehabilitation of monoparesis patients using tendon flexion sensing mechanism for health care applications | |
Li et al. | Finger Kinematics during Human Hand Grip and Release | |
Widodo et al. | Design and evaluation of upper-arm mouse using inertial sensor for human-computer interaction | |
Gherman et al. | Kinematic design of a parallel robot for elbow and wrist rehabilitation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20220915 Address after: 264211 no.566-1 Qishan Road, caomiaozi Town, Lingang Economic and Technological Development Zone, Weihai City, Shandong Province Applicant after: SHANDONG WEIGAO OPERATION ROBOT CO.,LTD. Address before: No.2, Haitai Huake 5th Road, Huayuan Industrial Park, Binhai New Area, Tianjin, 300384 Applicant before: Institute of medical robot and intelligent system, Tianjin University |
|
GR01 | Patent grant | ||
GR01 | Patent grant |