WO2014159577A1 - Machine to human interfaces for communication from a lower extremity orthotic - Google Patents
Machine to human interfaces for communication from a lower extremity orthotic Download PDFInfo
- Publication number
- WO2014159577A1 WO2014159577A1 PCT/US2014/024244 US2014024244W WO2014159577A1 WO 2014159577 A1 WO2014159577 A1 WO 2014159577A1 US 2014024244 W US2014024244 W US 2014024244W WO 2014159577 A1 WO2014159577 A1 WO 2014159577A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- exoskeleton
- person
- feedback
- orthosis
- information
- Prior art date
Links
- 210000003141 lower extremity Anatomy 0.000 title claims description 21
- 238000004891 communication Methods 0.000 title description 41
- 238000000034 method Methods 0.000 claims description 74
- 230000033001 locomotion Effects 0.000 claims description 42
- 230000009471 action Effects 0.000 claims description 30
- 230000005021 gait Effects 0.000 claims description 29
- 230000000007 visual effect Effects 0.000 claims description 26
- 230000003287 optical effect Effects 0.000 claims description 11
- 230000011664 signaling Effects 0.000 claims 3
- 241000249931 Doronicum maximum Species 0.000 claims 2
- 210000003414 extremity Anatomy 0.000 claims 2
- 210000002683 foot Anatomy 0.000 description 61
- 239000011521 glass Substances 0.000 description 42
- 230000006870 function Effects 0.000 description 21
- 230000008901 benefit Effects 0.000 description 17
- 210000002414 leg Anatomy 0.000 description 10
- 230000003387 muscular Effects 0.000 description 9
- 238000012549 training Methods 0.000 description 9
- 238000005286 illumination Methods 0.000 description 8
- 230000035807 sensation Effects 0.000 description 8
- 230000006735 deficit Effects 0.000 description 7
- 238000013461 design Methods 0.000 description 7
- 210000001624 hip Anatomy 0.000 description 7
- 230000003993 interaction Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 230000000981 bystander Effects 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 6
- 230000006378 damage Effects 0.000 description 6
- 230000008713 feedback mechanism Effects 0.000 description 6
- 210000001503 joint Anatomy 0.000 description 6
- 230000003155 kinesthetic effect Effects 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 239000003086 colorant Substances 0.000 description 5
- 208000014674 injury Diseases 0.000 description 5
- 210000003127 knee Anatomy 0.000 description 5
- 238000002560 therapeutic procedure Methods 0.000 description 5
- 206010040030 Sensory loss Diseases 0.000 description 4
- 208000027418 Wounds and injury Diseases 0.000 description 4
- 230000003278 mimic effect Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000003238 somatosensory effect Effects 0.000 description 4
- 230000001225 therapeutic effect Effects 0.000 description 4
- 210000003423 ankle Anatomy 0.000 description 3
- 238000003491 array Methods 0.000 description 3
- 238000000418 atomic force spectrum Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 239000000470 constituent Substances 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000005484 gravity Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000001953 sensory effect Effects 0.000 description 3
- 230000009155 sensory pathway Effects 0.000 description 3
- 238000010408 sweeping Methods 0.000 description 3
- 208000029578 Muscle disease Diseases 0.000 description 2
- 206010050031 Muscle strain Diseases 0.000 description 2
- 208000021642 Muscular disease Diseases 0.000 description 2
- 208000036366 Sensation of pressure Diseases 0.000 description 2
- 208000006011 Stroke Diseases 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000012508 change request Methods 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000002950 deficient Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 2
- 208000035475 disorder Diseases 0.000 description 2
- 239000012636 effector Substances 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000010438 heat treatment Methods 0.000 description 2
- 210000004394 hip joint Anatomy 0.000 description 2
- 230000001771 impaired effect Effects 0.000 description 2
- 230000001939 inductive effect Effects 0.000 description 2
- 230000000977 initiatory effect Effects 0.000 description 2
- 210000000629 knee joint Anatomy 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000009023 proprioceptive sensation Effects 0.000 description 2
- 238000004904 shortening Methods 0.000 description 2
- 208000020431 spinal cord injury Diseases 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 241001272996 Polyphylla fullo Species 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 210000000544 articulatio talocruralis Anatomy 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000011217 control strategy Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 210000000245 forearm Anatomy 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 230000004220 muscle function Effects 0.000 description 1
- 230000002232 neuromuscular Effects 0.000 description 1
- 210000004197 pelvis Anatomy 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 230000003389 potentiating effect Effects 0.000 description 1
- 230000000452 restraining effect Effects 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
- 230000008736 traumatic injury Effects 0.000 description 1
- 210000000689 upper leg Anatomy 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1124—Determining motor skills
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4851—Prosthesis assessment or monitoring
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6802—Sensor mounted on worn items
- A61B5/6811—External prosthesis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/7405—Details of notification to user or communication with user or patient ; user input means using sound
- A61B5/7415—Sound rendering of measured values, e.g. by pitch or volume variation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/7455—Details of notification to user or communication with user or patient ; user input means characterised by tactile indication, e.g. vibration or electrical stimulation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F5/00—Orthopaedic methods or devices for non-surgical treatment of bones or joints; Nursing devices; Anti-rape devices
- A61F5/01—Orthopaedic devices, e.g. splints, casts or braces
- A61F5/0102—Orthopaedic devices, e.g. splints, casts or braces specially adapted for correcting deformities of the limbs or for supporting them; Ortheses, e.g. with articulations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H1/00—Apparatus for passive exercising; Vibrating apparatus; Chiropractic devices, e.g. body impacting devices, external devices for briefly extending or aligning unbroken bones
- A61H1/02—Stretching or bending or torsioning apparatus for exercising
- A61H1/0237—Stretching or bending or torsioning apparatus for exercising for the lower limbs
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/02—Crutches
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H2003/007—Appliances for aiding patients or disabled persons to walk about secured to the patient, e.g. with belts
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5058—Sensors or detectors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5058—Sensors or detectors
- A61H2201/5061—Force sensors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5058—Sensors or detectors
- A61H2201/5092—Optical sensor
- A61H2201/5094—Optical sensor with patient markers
Definitions
- the present invention relates to a device and method that aids in the rehabilitation and restoration of muscular function in patients with impaired muscular function or control. More particularly, the present invention relates to a device and method suitable for therapeutic use with patients that have impaired neuromuscular/muscular function of the appendages, comprising a motorized system of braces and related control systems that potentiate improved function of the appendages for activities including, but not limited to, walking.
- This disabled state can result from traumatic injury, stroke, or other medical conditions that cause disorders that affect muscular control. Regardless of origin, the onset and continuance of walking impairment can result in additional negative physical and/or psychological outcomes for the afflicted individual.
- the development of devices that can improve or restore walking function is of significant utility to the medical and therapeutic communities. Beyond walking impairment, there are a range of medical conditions that interfere with muscular control of the appendages, resulting in loss of function and other adverse conditions for the affected individual. The development of devices to improve or restore these functions is also of great interest to the medical and therapeutic communities.
- exoskeleton devices are being developed in the medical field to restore and rehabilitate proper muscle function for people with disorders that affect muscle control.
- These exoskeleton devices are a system of motorized braces that can apply forces to the wearer's appendages.
- exoskeletons are typically controlled by a physical therapist who uses one of a plurality of possible input means to command an exoskeleton control system.
- the exoskeleton control system actuates the position of the motorized braces, resulting in the application of force to, and typically movement of, the body of the exoskeleton wearer.
- the exoskeleton may also be similarly controlled by input from either the wearer of the exoskeleton or a combination of both wearer and physical therapist input to the exoskeleton control system.
- Exoskeleton control systems prescribe and control trajectories in the joints of an exoskeleton. These trajectories can be prescribed as position based, force based, or a
- Position based control systems can be modified directly through modification of the prescribed positions.
- Force based control systems can also be modified directly through modification of the prescribed force profiles.
- Exoskeleton control systems receive intent commands from an exoskeleton operator, who may be either a physical therapist or the exoskeleton wearer, and then performs desired actions accordingly. In order to properly execute these actions, a range of sensors are placed throughout the exoskeleton to sense the exoskeleton state. There are a plurality of possible means by which the operator of an exoskeleton, who may be either a physical therapist or the exoskeleton wearer, may input commands into the exoskeleton control system.
- the information is provided intermittently when the device determines interference is warranted.
- the art has not recognized the need for ways that an exoskeleton or powered orthosis needs to communicate its intentions and motion to the person.
- the examples known in the art of exoskeletons are limited to discrete indicators of state, equivalent to dashboard indicators on a car; this invention is directed at continual feedback that allows the person to understand and be involved in the motion of the device, which is more analogous to the force feedback provided through the steering wheel on modern cars.
- the driver is able to feel a portion of the force that the car is applying to the steering so that they perceive the forces acting on the car.
- exoskeleton positions are changing, and for fault prediction/warning alarms.
- the invention disclosed herein comprises novel methods of communicating information from an exoskeleton control system to a physical therapist and/or an exoskeleton user, via an exoskeleton feedback system.
- These exoskeleton-operator communication interface and feedback systems build upon current exoskeleton technology to enable an exoskeleton system to not only restore or enhance human movement, but also restore or enhance human senses.
- the term feedback system is used to differentiate from the broader set of display technologies: here "feedback system" is used to mean a device that is supplying nontextual information; textual display is used to mean a device that is supplying textual
- the primary embodiment of this invention comprises of an exoskeleton device equipped with one or more light emitting diodes or other lighting means in close proximity to the exoskeleton joints.
- the lighting means are connected to the exoskeleton control system and are illuminated proportionally to the torque in the exoskeleton joint.
- the lighting means could alternately be illuminated proportionally to the assistance level provided by the exoskeleton device. This would provide a physical therapist or the exoskeleton wearer with intuitively placed visual feedback system which communicates the human machine interaction beyond the resultant movement that can be seen directly by the physical therapist or the exoskeleton wearer.
- the visual feedback system comprises of an exoskeleton system including one or more light emitting diodes or other lighting means in close proximity to the exoskeleton wearer connection points.
- the exoskeleton wearer connection points contain force sensors, which are connected to the exoskeleton control system, that determine the forces exerted between exoskeleton wearer and the exoskeleton at the exoskeleton wearer connection points.
- the lighting means is connected to the exoskeleton control system and is illuminated proportionally, through modulation of intensity and/or color, to the forces in the connection points as determined force sensors in the exoskeleton wearer connection points. Similarly to the first embodiment, this would allow a physical therapist or the exoskeleton wearer to understand the location of forces transferred between the exoskeleton and the exoskeleton wearer.
- the visual feedback system comprises of an exoskeleton system including an integral laser pointer.
- the laser pointer is connected to the exoskeleton structure through actuated means of controlling pan and tilt of beam projection angle.
- the pan and tilt projection angle actuation means are connected to the exoskeleton control system and controlled such that the laser pointer is aimed at a relevant location to the exoskeleton wearer, such as ideal crutch placement targets, ideal foot placement targets, and next movement target.
- a single laser pointer could be designed to overlay a plurality of simultaneous images on the ground by sweeping back outlines on the ground repeatedly, or alternately multiple laser pointers, possibly in multiple colors, might be utilized to project different images.
- the visual feedback system comprises of an exoskeleton system including a plurality of integral lighting means, with the lighting means projecting one or more images/targets with plurality of colored lighting means that sum to white light, as well as glasses worn by the exoskeleton wearer with an optical filter that removes one of the colors projected, making the image/target a visible colored light to the exoskeleton wearer and simultaneously making the image/target a subtle white light to people who are not wearing glasses with optical filters.
- the lighting means are connected to the exoskeleton structure through actuated means of controlling pan and tilt of lighting means projection.
- the pan and tilt projection angle actuation means are connected to the exoskeleton control system and controlled such that the laser pointer is aimed at a relevant location to the user such as ideal crutch placement targets, ideal foot placement targets, and next movement target.
- This embodiment has the strong advantage of allowing the placement targets to be used in public without bystanders noticing.
- the visual feedback system comprises of glasses worn by the exoskeleton wearer with an integrated display system and a camera system, with the glasses displaying placement targets that result in a "heads-up display" to the exoskeleton wearer.
- the glasses and the cameras are in communication with the exoskeleton control system, and the exoskeleton control system determines the position of the exoskeleton through the plurality of sensors integral to the exoskeleton system that determine exoskeleton pose, while the position of the glasses relative to the exoskeleton system is determined by comparing inertial sensors mounted within the exoskeleton system and inertial sensors mounted within the glasses with integral displays.
- the glasses constitute a feedback system in the sense that they are displaying non-textual information, in this case geometries overlaid onto the terrain.
- a sixth embodiment of this invention comprises of a method and device mounted upon an exoskeleton or the exoskeleton wearer that transmits information from the exoskeleton control system to the exoskeleton wearer that provides feedback on the center of pressure of the exoskeleton device and wearer.
- Knowledge of the center of pressure is used by a person to feel when they are balanced over their feet. For users without sensation of pressure in their feet, however, this information must be presented in other methods. Multiple methods of feedback for the center of pressure are possible.
- a preferred method is to use tactile feedback at an area where the user is able to feel and process that information.
- One embodiment of center of pressure feedback comprises of a wheel that is attached to the exoskeleton or another structure worn by the exoskeleton wearer.
- the wheel moves in a plane parallel to the exoskeleton wearer's body to indicate center of pressure motion.
- the wheel can also be actuated to move in and out providing a varying level of pressure. This the pressure can indicate the speed of the center of pressure, the deviation from ideal, or the difference between the center of pressure and the center of mass. In some embodiments, many such wheels are in contact with the user so that many different the values can be displayed.
- the wheel comprises of a ball and drive by the exoskeleton to move in two dimensions (X-Y) and to push with a varying level of the force, producing a three dimensional display capable of displaying information such as, but not limited to, a mapping of the exoskeleton wearer's center of pressure in the forward and lateral axis, as well as the exoskeleton user's vertical force.
- the center of pressure tactile feedback system comprises of vibratory or other tactile motors that are placed on the exoskeleton wearer's body.
- the motors are in communication with the exoskeleton control system and apply feedback to the exoskeleton wearer by imparting a pushing feel or a sweep to the direction where the
- exoskeleton wearer should move.
- the amplitude of the vibration may indicate information such as the desired speed or degree of motion needed.
- the vibratory feedback could be given on the torso, arms, neck, or head as is appropriate for the feedback and the exoskeleton wearer's level of injury/impairment. These methods may be combined.
- One embodiment includes the tactile actuators on the arms of the exoskeleton wearer that are activated to mimic a push left or right as a physical therapist would give during gait training.
- the actuators on the chest and back (or front and back of shoulders) of the exoskeleton wearer mimic a push forwards or backwards as would be given by a physical therapist.
- arrays of vibration motors may be used to produce relative signals across the exoskeleton wearer's body.
- the center of pressure feedback system comprises a temperature grid connected to the exoskeleton wearer that is in communication with the exoskeleton control system.
- the temperature grid conveys information to the exoskeleton wearer by means of inducing sensations of temperature.
- One embodiment is comprised of a heat grid over the tongue of the exoskeleton wearer.
- the surface of the tongue of the exoskeleton wearer is mapped to the base of the feet of the exoskeleton wearer.
- the center of pressure of the exoskeleton wearer and exoskeleton device is then indicated by heating a node in the same position of the grid as the center of pressure over the foot.
- the degree of the temperature represents the force at the foot.
- the center of pressure feedback system is comprised of an auditory device mounted upon the exoskeleton or the exoskeleton wearer that conveys information from the exoskeleton control system to the exoskeleton wearer by sound.
- the auditory device is comprised of an array of speakers, and the device indicates to the exoskeleton wearer in the direction and magnitude of deviation from the center of pressure. As the exoskeleton wearer shifts left, the speakers would generate increasingly louder sound on left of the exoskeleton wearer.
- the speaker array may simply be comprised of two speakers that are used to give side to side or front to back information in this manner.
- the addition of more speakers to the speaker array results in the ability for more precise position information can be transmitted from the exoskeleton control system to the exoskeleton wearer.
- one or more the speakers with a variety of tones could be used to indicate to the exoskeleton wearer in the direction and magnitude of deviation from center of pressure.
- one or more of the speakers are used to continuously vary frequency as a function of lateral position so as to convey center of pressure information to the exoskeleton wearer.
- a tenth embodiment of this invention comprises a device attached to a walk aid attached to the exoskeleton wearer that conveys information from the exoskeleton control system to the exoskeleton wearer that provides feedback and guidance to the exoskeleton wearer in regards to the use of the walk aid.
- the walk aid comprises a crutch held in each hand of the exoskeleton wearer.
- the crutch handles are equipped with a vibratory motor that is controlled by the exoskeleton control system.
- the crutch handle provides vibratory feedback as to where and to what extent the exoskeleton wearer should shift weight.
- This device is helpful to ensure that the exoskeleton wearer is balanced over their feet rather than relying overly on the walk aid for balance.
- These methods of feedback used for giving the exoskeleton wearer information about center of pressure can also be used to give the exoskeleton wearer information about their overall positioning, such as the location of their hip over the stance foot or their forward and lateral lean.
- These feedback mechanisms could indicate a need to shift forward/backward or left/right as necessary to achieve a desired orientation.
- the feedback mechanism in the crutch handle is electrostatic haptic or any other haptic feedback mechanism.
- Each exoskeleton feedback system comprises an algorithm that converts an exoskeleton control system's data into a "feedback ready" format suitable for communication to an exoskeleton operator, who might be either a physical therapist or the exoskeleton wearer, as well as a method of continuously communicating this "feedback ready" exoskeleton data to an exoskeleton operator.
- "Feedback ready” conversion algorithms have been developed that enable communication of exoskeleton sensor information, communication of exoskeleton state information, communication of current exoskeleton actions, communication of planned exoskeleton actions, communication of performance feedback/training, and communication of exoskeleton control mode changes. Methods of communication from an exoskeleton to an exoskeleton operator have been developed using visual, haptic, auditory and thermal based human sensory pathways.
- feedback ready format suitable for communication to an exoskeleton operator. These concepts were evaluated based upon the utility of the information communicated to the exoskeleton operator.
- the first set of “feedback ready” algorithms utilize information directly from an exoskeleton's various integral sensors that collect data on the exoskeleton state, including but not limited to joint angles and joint torques.
- the expected joint torque can be approximately calculated based on the exoskeleton wearer's weight and exoskeleton device pose; methods of making this calculation are readily apparent to a person skilled in the art of exoskeleton design.
- this expected minus actual torque information provides the exoskeleton wearer with the ability to immediately sense obstacles that are impeding the exoskeleton's movement.
- Another novel "feedback ready" trigger related to joint torque is the assistance level provided by the device when a device is used in rehabilitative training.
- Calculation of assistance level is a function of the interaction forces between the exoskeleton and the exoskeleton wearer and is readily apparent to a person skilled in the art of exoskeleton design.
- This assistance level enables a physical therapist or a rehabilitation patient to understand how much work the machine is doing and how much work the patient is doing. This gives the physical therapist and the patient the target of minimizing the assistance level to maximize rehabilitative benefit.
- this trigger gives the exoskeleton wearer direct feedback as to how much the exoskeleton is modifying their movements and therefore an idea of what their movements would be like without the assistance of an exoskeleton.
- this joint torque based information is communicated to a physical therapist using an exoskeleton device in a rehabilitation setting, it will give the physical therapist an improved understanding of the exoskeleton' s effect on the patient. This understanding will enable the physical therapist to make better decisions about a patient's progression and the exoskeleton device settings required for maximum rehabilitative benefit.
- Another class of "feedback ready” triggers is based on the exoskeleton and the exoskeleton wearer pose information such as center of pressure location, center of gravity location, and relative exoskeleton segment positions.
- these triggers attempt to replace the exoskeleton wearer's kinesthetic or somatosensory sense to restore proper proprioception.
- These embodiments include the positions of the joints relative to each other, which can enable the exoskeleton wearer to understand their position in space more accurately.
- center of pressure can be calculated using force or pressure sensors located under the feet of the exoskeleton wearer or exoskeleton device (in the case of an exoskeleton with feet). Center of mass can be calculated using joint angle sensors, the exoskeleton, and the exoskeleton wearer's segment weights. In order to improve the accuracy of these the calculations, the joint angles should be corrected based on the flex of the exoskeleton structure using strain gauges embedded within the exoskeleton structure. Relative exoskeleton segment positions can also be calculated using joint angles, segment lengths and flex corrections.
- One novel “feedback ready” trigger in the center of pressure class is the relative position of the center of pressure and center of mass of the exoskeleton and exoskeleton wearer system.
- This "feedback ready” trigger signifies a direction in which the system is falling and can also be used to indicate the speed of the fall by the distance between the center of pressure and the center of mass.
- Another novel "feedback ready" trigger useful with a lower body exoskeletons is the height of each foot from the ground. This trigger acts to restore an exoskeleton wearer's kinesthetic sense. This feedback can be sensed in a variety of manners which are evident to those skilled in the art.
- One embodiment utilizes proximity sensors, such as sonar emitters and receivers, to calculate the distance to the ground in conjunction with pressure sensors to determine contact. Alternate embodiments may include cameras or laser distance measurements.
- Another novel "feedback ready” trigger useful with lower body exoskeletons is the distance from the front of each foot to the closest obstacle. This trigger allows an
- exoskeleton wearer to sense if it is safe to proceed with a given action.
- the information fed back to the exoskeleton wearer may include the distance to the obstacle or simply the presence of an obstacle in a given range of the path.
- Another novel "feedback ready" trigger useful with lower body exoskeletons is the predicted end effector positions of a selected action. This trigger both provides an exoskeleton wearer with information about an action about to be performed, but also a training target to aim for in order to complete the action.
- a visual display either by a projected point or a heads-up display, informs the exoskeleton wearer of the end position of their foot after the action is performed.
- the visual display may indicate where to put a crutch or other walk aid in order to prepare for a step.
- Another class of "feedback ready" triggers communicates the control system parameters including current actions, planned actions, and control changes to the exoskeleton wearer.
- triggers provide the exoskeleton wearer with an improved understanding of the status of the exoskeleton control system so that the exoskeleton wearer is always aware of exoskeleton actions before they are carried out. These triggers need to be communicated in a non-impeding fashion. This communication of parameter changes or actions also provides the exoskeleton wearer the opportunity to confirm or acknowledge the changes if necessary.
- Additional "feedback ready" triggers were conceptualized, including hand to walking aid force vectors, walking aid to ground forces, torso forward and back angle, torso side- to-side angle, joint angles, compass heading, mode change requests, mode change confirmations, action initiation, action completion, alerts to unstable positions, and conditional based on functions of individual triggers.
- Figure 1 is a schematic side view of a handicapped individual coupled to an ambulatory exoskeleton.
- Figure 2 is a drawing representing a first embodiment that shows an ambulatory exoskeleton with integral joint lights, as well as a physical therapist and exoskeleton wearer that receive visual feedback from the integral joint lights.
- Figure 3 is a drawing representing a second embodiment that shows an ambulatory exoskeleton with integral exoskeleton-wearer interface point lights, as well as a physical therapist and exoskeleton wearer that receive visual feedback from the integral exoskeleton-wearer interface point lights.
- Figure 4 is a drawing representing a third embodiment that shows an ambulatory exoskeleton with an integral pan/tilt controlled laser pointer, as well as a physical therapist and an exoskeleton wearer that receives visual feedback from the laser pointer, specifically including crutch placement information.
- Figure 5 is a drawing representing a fourth embodiment that shows an ambulatory exoskeleton with an integral projected lights producing placement targets only highly visible to the exoskeleton wearer, who is also wearing special glasses with an optical filter.
- Figure 6 is a drawing representing a fifth embodiment that shows an ambulatory exoskeleton and an exoskeleton wearer with display glasses that contain and integral camera.
- Figure 7 is a drawing representing a sixth embodiment that shows an ambulatory exoskeleton with a wheel device providing center of pressure feedback to the exoskeleton wearer.
- Figure 8 is a drawing representing a seventh embodiment that shows an ambulatory exoskeleton and an exoskeleton user, with a vibratory belt feedback means attached to either the exoskeleton device or the exoskeleton wearer, with the belt providing center of pressure/balance feedback to the exoskeleton wearer.
- Figure 9 is a drawing representing a ninth embodiment that shows an ambulatory exoskeleton and an exoskeleton user, with an auditory feedback means attached to either the exoskeleton device or the exoskeleton wearer, with the auditory feedback means providing center of pressure/balance feedback to the exoskeleton wearer.
- Figure 10 is a drawing representing a tenth embodiment that shows an ambulatory exoskeleton and an exoskeleton user, with a crutch-integrated feedback means held by the exoskeleton user that provides feedback to the exoskeleton user.
- Figure 11 is a drawing of an ambulatory exoskeleton with specific locations that may be used in any embodiment or combination of embodiments for the additional placement of devices encompassed in any embodiment, including but not limited to lighting means, sensors, or laser pointers.
- Figure 12 is a control loop schematic showing an exoskeleton controller based on feeding information to and from the person wearing an exoskeleton device.
- the present invention is used in conjunction with a powered orthotic device that provides for walking motion for the wearer.
- a powered exoskeleton is one example of such a powered orthotic device.
- powered exoskeletons are controlled by a physical therapist who uses one of a plurality of possible input means to command an exoskeleton control system.
- the exoskeleton control system actuates the position of the motorized braces, resulting in the application of force to, and often movement of, the body of the exoskeleton wearer.
- an exoskeleton 100 having a trunk portion 110 and lower leg supports 112 is used in combination with a crutch 102, including a lower, ground engaging tip 101 and a handle 103, by a patient or wearer 109 to walk.
- the wearer 109 is shown to have an upper arm 1 1 1, a lower arm (forearm) 122, a head 123 and lower limbs 124.
- trunk portion 110 is configurable to be coupled to an upper body (not separately labeled) of the wearer 109
- the leg supports 112 are configurable to be coupled to the lower limbs 124 of the wearer 109
- foot supports 161 are configurable to be coupled to the feet of wearer 109 and linked to the ankle joint 160
- actuators generically indicated at 125 but actually interposed between portions of the leg supports 112 as well as between the leg supports 112 and trunk portion 110 in a manner widely known in the art, for shifting of the leg supports 112 relative to the trunk portion 110 to enable movement of the lower limbs 124 of the wearer 109.
- trunk portion 110 may be quite small and comprise a pelvic link wrapping around the pelvis of wearer 109.
- the exoskeleton actuators 125 are specifically shown as a hip actuator 135 which is used to move hip joint 145 in flexion and extension, and as knee actuator 140 which is used to move knee joint 150 in flexion and extension.
- the exoskeleton actuators 125 are controlled by CPU 120, with CPU 120 being a constituent of an exoskeleton control system, in a plurality of ways known to one skilled in the art of exoskeleton control.
- various sensors in communication with CPU 120 are provided so that CPU 120 may monitor the orientation of the device. Such sensors may include without restriction encoders, potentiometers, accelerometer, and
- Exoskeleton control systems prescribe and control trajectories in the joints of an exoskeleton. These trajectories can be prescribed as position based, force based, or a
- Position based control systems can be modified directly through modification of the prescribed positions.
- Force based control systems can also be modified directly through modification of the prescribed force profiles. Since the concepts presented here apply equally to position, force, and hybrid
- exoskeleton trajectories the positions and/or forces prescribed by an exoskeleton control system may be referred to in this disclosure as the exoskeleton trajectories.
- the primary embodiment of this invention comprises of an exoskeleton device equipped with one or more light emitting diodes or other lighting means in close proximity to the exoskeleton joints.
- the lighting means is connected to the exoskeleton control system and is illuminated proportionally to the torque in the exoskeleton joint.
- the lighting means could alternately be illuminated proportionally to the assistance level provided by the exoskeleton device. This would provide a physical therapist or the exoskeleton wearer with intuitively placed visual feedback system which communicates the human machine interaction beyond the resultant movement that can be seen directly by the physical therapist or the exoskeleton wearer.
- the intensity of the light might vary in relation to the signal strength, with signal strength as measured by either internal exoskeleton sensors of force sensors on the exoskeleton wearer, and with this signal strength interpreted by the exoskeleton control system and relayed to the lighting means.
- the light blinking frequency would change in relation to signal strength.
- an array of lights would be used, with the number and position of lights illuminated being relative to the signal strength.
- the color of the lights would be modulated relative to signal strength.
- sensors could be used to measure various exoskeleton or exoskeleton wearer parameters, and each of these may be reported in the various lighting formats. These multiple formats and parameter feedback types might be combined as preferred.
- patient 201 is wearing exoskeleton 204, which is controlled by exoskeleton control system 205.
- Physical therapist 202 is monitoring the performance of exoskeleton 204 and patient 201 in a rehabilitation setting, during which time physical therapist 202 may issue commands to exoskeleton control system 205 through control system input means 203.
- input means 203 is shown here as a computer, this is simply an illustrative example. As input devices are not a particular object of this invention, input means 203 could be any number of devices, including, without limitation, a keypad, voice commands, handles integral to exoskeleton 204, etc.
- Integral joint lights 206 are illuminated in response to a signal from exoskeleton control system 205, with this signal related to exoskeleton 204 state parameters, in this case exoskeleton joint torque at each exoskeleton joint, causing integral joint lights 206 to increase in illumination intensity as joint torque at each location increases, as calculated by exoskeleton control system 205.
- Both physical therapist 202 and exoskeleton wearer 201 see the illumination from integral joint lights 206, allowing physical therapist 202 and exoskeleton wearer 201 to have improved understanding of the forces exerted in this exoskeleton state.
- a physical therapist wanted to modify the gait cycle of an ambulatory exoskeleton in response to the progression of a patient over the course of therapy, it is helpful to physical therapist to know how much force was being applied by the patient at each joint relative to the forces exerted by the exoskeleton over a cyclical motion such as walking. As the patient progresses over the course of treatment, the patient will exert more force relative to the exoskeleton at each joint. However, the movement of the exoskeleton will look the same.
- integral lighting means that provide illumination proportionate to the forces exerted by the exoskeleton at each joint may be used as an indirect reporting means to the forces exerted by the patient - as patient and exoskeleton forces sum over a particular movement.
- the physical therapist might monitor the illumination at the left knee 207 in order to monitor how much joint torque was being exerted at the left knee by the exoskeleton, and thus gain insight as to how much force the patient was able to exert at this left knee at various points over movement cycles and the course of treatment. This information could then be used by the physical therapist to modify exoskeleton trajectories for improved rehabilitative benefit to the patient.
- the visual feedback system comprises of an exoskeleton system including one or more light emitting diodes or other lighting means in close proximity to the exoskeleton wearer connection points.
- the exoskeleton wearer connection points contain force sensors, which are connected to the exoskeleton control system, that determine the forces exerted between exoskeleton wearer and the exoskeleton at the exoskeleton wearer connection points.
- the lighting means is connected the exoskeleton control system and is illuminated proportionally, through modulation of intensity and color, to the forces in the connection points as determined force sensors in the exoskeleton wearer connection points. Similar to the first embodiment, this would allow a physical therapist or the exoskeleton wearer to understand the location of forces transferred between the exoskeleton and the exoskeleton wearer.
- patient 301 is wearing exoskeleton 304, which is controlled by exoskeleton control system 305.
- Physical therapist 302 is monitoring the performance of exoskeleton 304 and patient 301 in a rehabilitation setting, during which time physical therapist 302 may issue commands to exoskeleton control system 305 through control system input means 303.
- Integral interface point lights 306 are illuminated in response to a signal from force sensors on exoskeleton structure located between exoskeleton 304 and patient 301 at the site of each integral interface point light 306, with the force sensors in communication with exoskeleton control system 305, with this signal indicating the forces exerted between exoskeleton 304 and patient 301, causing integral interface point lights 306 to increase in illumination intensity as force at each location increases.
- Both physical therapist 302 and exoskeleton wearer 301 see the illumination from integral interface point lights 306, allowing physical therapist 302 and exoskeleton wearer 301 to have improved understanding of the forces exerted by exoskeleton wearer in this exoskeleton state.
- a physical therapist wanted to modify the gait cycle of an ambulatory exoskeleton in response to the progression of a patient over the course of therapy, it is helpful to physical therapist to know how much force was being applied by the patient at each joint relative to the forces exerted by the exoskeleton over a cyclical motion such as walking. As the patient progresses over the course of treatment, the patient will exert more force relative to the exoskeleton during various movements. However, the movement of the exoskeleton will look the same.
- integral interface point lighting means that provides illumination proportionate to the forces exerted by the patient at one or more exoskeleton-patient interface points allows the physical therapist, or the patient, to receive visual information showing the forces exerted between the exoskeleton and the patient.
- the physical therapist might monitor the illumination at the left shank coupling 307 in order to monitor how much force torque was being exerted at the left shank coupling, and thus gain insight as to how much force the patient was able to exert at this left shank coupling at various points over movement cycles and the course of treatment. This information could then be used by the physical therapist to modify exoskeleton trajectories for improved rehabilitative benefit to the patient.
- Both of the first two embodiments have applications in rehabilitative settings.
- the novel visual feedback provides the physical therapist with intuitively placed feedback describing the interactions between the exoskeleton and the user which allows the physical therapist to improve the quality of the rehabilitation therapy.
- This feedback becomes especially important when the physical therapist is provided with control for the device assistance level; this feedback will enable a physical therapist to set the assistance level much more intelligently.
- Of particular utility to a physical therapist in determining how much relative force exoskeleton and exoskeleton user are exerting over a specific movement is a combination of the first embodiment and the second embodiment, allowing for feedback on both exoskeleton joint torque and exoskeleton-exoskeleton wearer interface force.
- the visual feedback system comprises of an exoskeleton system including an integral laser pointer.
- the laser pointer connected to the exoskeleton structure through actuated means of controlling pan and tilt of beam projection angle.
- the pan and tilt projection angle actuation means connected to the exoskeleton control system and controlled such that the laser pointer is aimed at relevant location to the exoskeleton wearer such as ideal crutch placement targets, ideal foot placement targets, and next movement target. This would allow the exoskeleton wearer to be intuitively trained in exoskeleton operation as well as allow the exoskeleton wearer to judge more accurately where the exoskeleton movements will take them.
- a single laser pointer could be designed to overlay a plurality of simultaneous images on the ground by sweeping back outlines on the ground repeatedly, or alternately multiple laser pointers, possibly in multiple colors, might be utilized to project different images.
- multiple laser pointers sweeping could project duplicate images at the same site, allowing for objects such as a crutch to get in the way of one laser projection without blocking target placement on the ground and disrupting utility to the patient.
- patient 401 is wearing exoskeleton 404, which is controlled by exoskeleton control system 405.
- Physical therapist 402 is monitoring the performance of exoskeleton 404 and patient 401 in a rehabilitation setting.
- Integral laser pointer connected to articulated means controlling pan and tilt 403 is mounted on the structure of exoskeleton 404.
- Integral laser pointer 404 projects laser beam 406 which projects crutch placement targets 407 on support surface 413. Patient 401 sees crutch placement targets 407 on support surface 413, allowing for better understanding of where to place crutches.
- patient 401 uses hand 409 to grip crutch handle 410 to guide crutch 41 1 , which has ground interacting tip 412, in such a way as to place ground interacting tip 412 upon specific crutch placement target 408.
- Physical therapist 402 observes the process and gains better understanding patient 401 's skill with use of the exoskeleton and rehabilitative state, allowing for physical therapist 402 to improve the rehabilitative process for patient 401.
- gait aid besides a crutch, such as walkers and canes, and a crutch is used here as an exemplary embodiment. It will be apparent to one skilled in the art of exoskeleton design that such a laser pointer device is workable with any such gait aid.
- a physical therapist is using an exoskeleton in rehabilitation with a new patient who has no previous experience with
- exoskeleton therapy The patient is unfamiliar with various aspects of exoskeleton operation and crutch use.
- crutch placement targets projected by the integral laser pointers allows for the patient to more quickly become familiar with crutch placement, shortening the time spent by the learning to use the exoskeleton system, allowing for more rapid use in rehabilitation and greater rehabilitative benefit.
- the visual feedback system comprises of an exoskeleton system including a plurality of integral lighting means, with the lighting means projecting one or more images/targets with plurality of colored lighting means that sum to white light, as well as glasses worn by the exoskeleton wearer with an optical filter that removes one of the colors projected, making the image/target a visible colored light to the exoskeleton wearer and simultaneously a subtle white light to people who are not wearing glasses with optical filters.
- the lighting means is connected to the exoskeleton structure through actuated means of controlling pan and tilt of lighting means projection.
- pan and tilt projection angle actuation means connected to exoskeleton control system and controlled such that the projection means is aimed at relevant locations to the user such as ideal crutch placement targets, ideal foot placement targets, and next movement target.
- This embodiment has the strong advantage of allowing the placement targets to be used in public without bystanders noticing.
- patient 501 is wearing exoskeleton 504, which is controlled by exoskeleton control system 505.
- exoskeleton control system 505 Bystander 502 in the vicinity of exoskeleton 504 and patient 501, and is able to observe patient 501 and exoskeleton 504.
- Plurality of integral lighting projection means connected to articulated means controlling pan and tilt, 503 is mounted upon the structure of exoskeleton 504 and is in communication with exoskeleton control system 505.
- Lighting means 503 projects a plurality of colored lighting means that sum to white light, 506, onto support surface 514, resulting in crutch placement targets 507 on support surface 514.
- Patient 501 wears glasses with an optical filter 508, glasses with an optical filter 508 filter and remove one of the colors projected, making targets 507 a visible colored light to patient 501, while targets 507 appear only as subtle white light to bystander 502 who is not wearing glasses with optical filters 508.
- patient 501 uses hand 509 to grip crutch handle 510 to guide crutch 511, which has ground interacting tip 512, in such a way as to place ground interacting tip 512 upon specific crutch placement target 513.
- a patient is wearing and operating an exoskeleton outside of a rehabilitation setting, such as in a public place. Outside of a
- crutch placement targets projected by a plurality of lighting means mounted upon the exoskeleton structure by articulated means and controlled by the exoskeleton control system, greatly assists the patient in the operation of the exoskeleton in this setting.
- the projection of visible crutch targets may prove distracting for bystanders, or embarrassing for the patient.
- glasses with an optical filter in order to see these crutch placement targets overcomes these problems, as placement targets will be invisible to bystanders who are not wearing the glasses, allowing for easier exoskeleton use by the patient in a setting outside of rehabilitation.
- the visual feedback system comprises of glasses worn by the exoskeleton wearer with an integrated display system and a camera system, with the glasses displaying placement targets that result in a "heads-up display" to the exoskeleton wearer.
- the glasses and the cameras are in communication with the exoskeleton control system, and the exoskeleton control system determines the position of the position of the exoskeleton through the plurality of sensors integral to the exoskeleton system that determine exoskeleton pose, while the position of the glasses relative to the exoskeleton system is determined by comparing inertial sensors mounted within the exoskeleton system and inertial sensors mounted within the glasses with integral displays.
- Such glasses have been developed by companies such as Google with their "Google Glasses" which are currently available.
- the position of the glasses with internal displays relative to the exoskeleton system can be determined by comparing inertial sensors such as inertial measurement units mounted within the exoskeleton system and inertial sensors mounted within the glasses with integral displays. Additionally, because the useful information desired to be displayed in often desired to be displayed on the ground, the addition of infrared lights to the exoskeleton feet would improve the foot placement and crutch placement accuracies.
- the exoskeleton control system could project positions relative to the position of the infrared light.
- the camera in the glasses senses the infrared light on the exoskeleton feet and displays a placement trigger on the ground relative to the location of the infrared light as seen in the camera mounted in the glasses.
- the trigger display locations could be adjusted using dead reckoning of accelerometers mounted in the display glasses.
- the display of the trigger could then be slowly faded until the exoskeleton user looks toward the exoskeleton feet again. This avoids one of the primary problems of dead reckoning position sensing; that the position may drift over time.
- the infrared lights mounted to the exoskeleton feet would allow dead reckoning system to recalibrate to an actual position every time the camera can see the feet.
- the estimates of exoskeleton pose could be enhanced using information from the glasses by integrating infrared lights into the exoskeleton structure.
- the camera mounted in the glasses could provide relative position information to the exoskeleton control system whenever the exoskeleton wearer looks at the exoskeleton by calculating the distances between the infrared light sources as seen in the camera in the display glasses.
- patient 601 is wearing exoskeleton 602, which is controlled by exoskeleton control system 603.
- Patient 601 is also wearing glasses with an integrated display system 604.
- Both glasses with an integrated display system 604 and camera 605 are in communication with exoskeleton control system 603.
- Mounted on various points of exoskeleton structure 602 are infrared lights, 608.
- Camera 605 observes light emitted from infrared lights 608, and communicates this information to exoskeleton control system 603.
- Exoskeleton control system 603 uses information from camera 605 to determine the position and direction of glasses with an integrated display system 604 relative to exoskeleton 602, and uses this relative position information to determine the placement of visual images to display in the glasses with an integrated display system 604, including targets for crutch placement, 606, and targets for foot placement 607, with the targets for crutch placement 606 and targets for foot placement 607 being placed on support surface 614.
- Patient 601 then sees these projected targets 606 and 607 through glasses with an integrated display system 604, and patient 601 then uses these projected targets 606 and 607 to aid in exoskeleton operation.
- patient 601 uses hand 609 to grip crutch handle 610 to guide crutch 611, which has ground interacting tip 612, in such a way as to place ground interacting tip 612 upon specific cratch placement target 613.
- a physical therapist is using an exoskeleton in rehabilitation with a new patient who has no previous experience with
- exoskeleton therapy The patient is unfamiliar with various aspects of exoskeleton operation and crutch use.
- crutch and foot placement targets displayed in the glasses with and integral display system allows for the patient to more quickly become familiar with crutch and foot placement, shortening the time spent by the learning to use the exoskeleton system, allowing for more rapid use in rehabilitation and greater rehabilitative benefit.
- these glasses with internal displays could also be used to relay information to the exoskeleton wearer including but not limited to battery level, balance of the exoskeleton system (either center of pressure or center of mass), position of the exoskeleton in a trajectory cycle or group of cycles, movement direction, current action mode, available action modes, error or fault display, or a host of other parameters know by the exoskeleton control system.
- a physical therapist might also wear a similar set of glasses with an integrated display system allowing the physical therapist access to similar information from the exoskeleton control system.
- Another feedback system involves the communication information on the center of pressure of the exoskeleton and the exoskeleton wearer to the user.
- Knowledge of the center of pressure is used by a person to feel when they are balanced over their feet. For users without sensation of pressure in their feet, however, this information must be presented by other means. Multiple methods of feedback for the center of pressure are possible.
- a preferred method is to use tactile feedback at an area where the user is able to feel and process that information.
- a sixth embodiment of this invention comprises of a method and device mounted upon and exoskeleton or the exoskeleton wearer that transmits information from the exoskeleton control system to the exoskeleton wearer that provides feedback on the center of pressure of the exoskeleton device and wearer.
- One embodiment of center of pressure feedback comprises of a wheel that is attached to the exoskeleton or another structure worn by the exoskeleton wearer. The wheel moves in a plane parallel to the exoskeleton wearer's body to indicate center of pressure motion. The wheel can also be actuated to move in and out providing a varying level of pressure. This the pressure can indicate the speed of the center of pressure, the deviation from ideal, or the difference between the center of pressure and the center of mass.
- the wheel comprises of a ball and drive by the exoskeleton to move in two dimensions (X-Y) and to push with a varying level of the force, producing a three dimensional display capable of displaying information such as but not limited to a mapping of the exoskeleton wearer's center of pressure in the forward and lateral axis as well as the exoskeleton user's vertical force.
- patient 701 is wearing exoskeleton 702 which is controlled by exoskeleton control system 703.
- foot structures 705. interact with the floor surface, 706.
- ground force sensors 704 Upon the bottom surface of foot structures 705 are ground force sensors 704 which measures the force by which each foot structure 705 exerts upon the floor 706.
- Ground force sensors 704 are in communication with exoskeleton control system 703, which uses data from ground force sensors 704 and an algorithm to determine center of pressure for exoskeleton 702 and patient 701, shown in Figure 7 specifically for the sagittal plane centered at 710.
- Attached to exoskeleton 702 is a feedback wheel mounting structure 707, which is attached to a motorized wheel 708.
- Motorized wheel 708 is in contact with patient 701, this contact is aided by the adjustable wheel restraining device 709.
- Motorized wheel 708 is in communication with exoskeleton control system 703, which can cause motorized wheel 708 to rotate in the sagittal plane either clockwise, 712, or counterclockwise, 713.
- exoskeleton control system 703 using data from force sensors 704, detects deflection from the center of pressure in the sagittal plane 710 along dashed line 711, motorized wheel 708 is activated to rotate and provide feedback to patient 701 as to deflection from center of pressure 710.
- exoskeleton control system 703 detects a forward deflection in center of pressure along 711 , then motorized wheel 708 rotates clockwise, 712, providing feedback to patient 701 that they should lean back.
- motorized wheel 708 rotates counterclockwise, 713, providing feedback to patient 701 that they should lean forwards.
- wheel mounting structure 707 could be actuated and wheel 708 will roll up and down the neck of the person.
- the position of the roller communicates information to the wearer.
- this class of devices controls the motion of a tactile contact point (i.e., the wheel), the position of which
- the tactile contact point may move in several axes to convey several independent pieces of information to the wearer.
- a patient using an exoskeleton device might have both loss of muscular function in the lower limbs as well as loss of sensation in the lower limbs. Without sensation in the lower limbs, it is difficult for this patient to balance themselves and the exoskeleton device.
- center of pressure information can be transmitted to the patient restoring a sense of, and aptitude for, balance.
- one wheel on the back of the neck of the patient provides front to back center of pressure information, as well as a sense of front back balance, to the patient.
- the addition of one or more wheel(s) on the side(s) of the neck of the patient might similarly be used to provide side to side center of pressure information (in the coronal plane), and restore a sense of side to side balance to the patient.
- side to side center of pressure information in the coronal plane
- the overall balance of the patient is improved.
- the center of pressure tactile feedback system comprises of vibratory or other tactile motors that are placed in contact with the exoskeleton wearer's body.
- the motors are in communication with the exoskeleton control system and apply feedback to the exoskeleton wearer by imparting a pushing feel or a sweep to the direction where the exoskeleton wearer should move.
- the amplitude of the vibration may indicate information such as the desired speed or degree of motion needed.
- the vibratory feedback could be given on the torso, arms, neck, or head as is appropriate for the feedback and the exoskeleton wearer's level of injury/impairment.
- one embodiment includes the tactile actuators on the arms of the exoskeleton wearer that are activated to mimic a push left or right as a physical therapist would give during gait training.
- the actuators on the chest and back (or front and back of shoulders) of the exoskeleton wearer would mimic a push forwards or backwards as would be given by a physical therapist.
- arrays of vibration motors may be used to produce relative signals across the exoskeleton wearer's body.
- patient 801 is wearing exoskeleton 802 which is controlled by exoskeleton control system 803.
- exoskeleton 802 Attached to exoskeleton 802 are foot stmctures 805.
- Foot structures 805 interact with the floor surface, 806.
- ground force sensors 804 Upon the bottom surface of foot structures 805 are ground force sensors 804 which measures the force by which each foot structure 805 exerts upon the floor 806.
- Ground force sensors 804 are in communication with exoskeleton control system 803, which uses data from ground force sensors 804 and an algorithm to determine center of pressure for exoskeleton 802 and patient 801 in both the sagittal and coronal planes.
- Patient 801 is wearing feedback belt 807, which is mounted with and controls eight vibratory motors at increments of 45 degrees around its circumference in the axial plane. Specifically shown in the left panel of Figure 8 are motors at 0 degrees, 808, 315 degrees, 809, 270 degrees, 810, and 225 degrees, 81 1.
- Feedback belt 807 is in communication with exoskeleton control system 803 which can activate motors on feedback belt 807 relative to deflection from center of pressure measured by force sensors 804 and determined by exoskeleton control system 803.
- exoskeleton control system 803 detected a shift in center of pressure towards 300 degrees (300 degrees as shown in Figure 8), exoskeleton control system 803 would signal feedback belt 807 to activate vibratory motors 810 and 809, while leaving vibratory motors 808 and 811 in the off position.
- the activation of vibratory motors 810 and 809 would indicate to patient 801 that their center of pressure was drifting towards the two motors 810 and 809 when activated, prompting patient 801 to lean away from these motors 810 and 809.
- a patient using an exoskeleton device might have both loss of muscular function in the lower limbs as well as loss of sensation in the lower limbs.
- the center of pressure feedback system comprises of a temperature grid connected to the exoskeleton wearer that is in communication with the exoskeleton control system.
- the temperature grid conveys information to the exoskeleton wearer by means of inducing sensations of temperature.
- One embodiment is comprised of a heat grid over the tongue of the exoskeleton wearer.
- the surface of the tongue of the exoskeleton wearer is mapped to the base of the feet of the exoskeleton wearer.
- the center of pressure of the exoskeleton wearer and exoskeleton device is then indicated by heating a node in the same position of the grid as the center of pressure over the foot.
- the degree of the temperature represents the force at the foot.
- a heat grid is placed on the tongue of an exoskeleton wearer with four heated nodes, one in the front of the tongue, one in the back of the tongue, one of the left of the tongue, and one on the right of the tongue.
- This heat grid relays center of pressure information from the exoskeleton control system, which is equipped with center of pressure detection means, to the exoskeleton wearer. If the center of pressure of the exoskeleton and exoskeleton wearer shifts forward, the exoskeleton control system activates the heated node on the front of the users tongue, prompting the exoskeleton wearer to lean back.
- exoskeleton control system detects that the center of pressure is shifting to the left, the heated node on the left of the tongue is activated prompting the exoskeleton wearer to lean right.
- Center of pressure information in both sagittal and coronal planes could be combined, for example if the exoskeleton control system detected a center of pressure shift back and to the right, the heated nodes at the front and at the right of the tongue would be activated, prompting the exoskeleton wearer to lean forward and to the left.
- the center of pressure feedback system is comprised of an auditory device mounted upon the exoskeleton or the exoskeleton wearer that conveys information from the exoskeleton control system to the exoskeleton wearer by sound.
- the auditory device is comprised of an array of speakers, and the device indicates to the exoskeleton wearer the direction and magnitude of deviation from center of the center of pressure.
- the speakers would generate increasingly louder sound on left of the exoskeleton wearer.
- the speakers would generate increasingly louder sound on right of the exoskeleton wearer.
- the speaker array may simply be comprised of two speakers that are used to give side-to-side or front to back information in this manner.
- the addition of more the speakers to the speaker array results in the ability for more precise position information can be transmitted from the exoskeleton control system to the exoskeleton wearer, which is of particular utility in conveying front-to-back position information to the exoskeleton wearer.
- one or more the speakers with a variety of tones could be used to indicate to the exoskeleton wearer the direction and magnitude of deviation from center of pressure.
- one or more the speakers are used to continuously vary frequency as a function of lateral position so as to convey center of pressure information to the exoskeleton wearer.
- one or more the speakers with a variety of tones could be used to indicate direction and magnitude of the position information. It is also possible for one or more speakers to continuously vary its frequency as a function of lateral position so as to convey center of pressure information.
- the speaker could emit a series of clicks, with the frequency of the clicks indicating lean angle similar (i.e., the rate of clicks proportional to lean angle) to the way that a geiger counter conveys information through a series of clicks.
- the auditory device could convey more than one quantity at a time - for example, the relative left/right volume could indicate left/right lean angle and the frequency could indicate front to back lean angle.
- center of pressure and lean angle these are intended as examples, and could be many of the types of information that the machine may wish to convey to the user.
- the conversion between the information that the machine is communicating to the means by which it is communicated e.g., the conversion from lean angle to frequency
- these parameters and the equation itself could be adjusted for different exoskeleton wearer to maximize their ability to understand. It should be noted that in the case of stroke patients there may be significant differences in hearing in the affected and unaffected sides of the body, making it of great utility to be able to adjust parameters of the auditory feedback in such a way as to be more readily interpretable to these patients.
- patient 901 is wearing exoskeleton 902 which is controlled by exoskeleton control system 903, with exoskeleton control system 903 being equipped with center of pressure detection means (as shown in Figures 6-8).
- Attached to patient 901 is auditory device retaining strap 912, which is attached to right auditory device 904 and left auditory device 905.
- Right auditory device 904 contains right speaker 906, which is in communication with exoskeleton control system 903.
- Right speaker 906 emits sound, 908, based on commands from exoskeleton control system 903, which are heard by the right ear, 910, of patient 901.
- Left auditory device 905 contains left speaker 907, which is in communication with exoskeleton control system 903.
- Left speaker 907 emits sound, 909, based on commands from exoskeleton control system 903, which are heard by the left ear, 910, of patient 901.
- exoskeleton control system 903 determines a shift of center of pressure along the coronal plane, a signal is transmitted to right auditory device 904 and left auditory device 905.
- Auditory devices 904 and 905 then cause speakers 906 and 907, respectively, to produce sound 906 and 907, which are heard by patient 901 's right ear 910 and left ear 91 1 , respectively.
- a patient using an exoskeleton device might have both loss of muscular function in the lower limbs as well as loss of sensation in the lower limbs. Without sensation in the lower limbs, it is difficult for this patient to balance themselves and the exoskeleton device.
- Speakers controlled by the exoskeleton control system which is in communication with the speakers and equipped with center of pressure detection means, allow for sound to be used to convey center of pressure information to the patient, which can improve the balance of the patient wearing the exoskeleton device.
- a patient wears an auditory device with left and right speakers that transmit sound to the left and right ears of the patient.
- the left speaker produces an audible chance prompting the patient to lean to the right.
- the right speaker produces an audible chance prompting the patient to lean to the left.
- the auditory feedback can also be used to feedback other cues for walking and balancing.
- One such cue is the lateral shift required before taking a step with the opposite leg.
- the auditory feedback can provide cues as to how far the user is from achieving the lateral shift required to balance on the stance leg.
- the forward shift of the hips over the stance foot could also be indicated by auditory feedback.
- a tenth embodiment of this invention comprises of a device attached to a walk aid attached to or to the exoskeleton wearer that conveys information from the exoskeleton control system to the exoskeleton wearer that provides feedback and guidance to the exoskeleton wearer in regards to the use of the walk aid.
- the walk aid comprises of a cratch held in each hand of the exoskeleton wearer.
- the crutch handles are equipped with a vibratory motor that is in controlled by the exoskeleton control system. During the walking process, as the exoskeleton wearer shifts their weight, the crutch handle provides vibratory feedback as to where and to what extent the exoskeleton wearer should shift weight.
- This device is helpful to ensure that the exoskeleton wearer is balanced over their feet rather than relying overly on the walk aid for balance.
- These methods of feedback used for giving the user information about center of pressure can also be used to give the user information about their overall positioning, such as the location of their hip over the stance foot or their forward and lateral lean.
- These feedback mechanisms could indicate a need to shift forward/backward or left right as necessary to achieve a desired orientation.
- the feedback mechanism in the crutch handle is electrostatic haptic or other any other haptic feedback mechanism.
- patient 1001 is wearing exoskeleton 1002 which is controlled by exoskeleton control system 1003.
- foot structures 1005 attached to exoskeleton 1002 are foot structures 1005.
- Foot structures 1005 interacts with the floor surface, 1006.
- ground force sensors 1004 Upon the bottom surface of foot structures 1005 are ground force sensors 1004 which measures the force by which each foot structure 1005 exerts upon the floor 1006.
- Ground force sensors 1004 are in communication with exoskeleton control system 1003, which uses data from ground force sensors 1004 and an algorithm to determine center of pressure for exoskeleton 1002 and patient 1001.
- Patient 1001 holds crutches 1009 by crutch handles equipped with a vibratory motor, 1008, with crutch handles equipped with a vibratory motor 1008 in communication with exoskeleton control system 1003.
- Crutches 1009 have a ground interacting tip equipped with a pressure sensor, 1010, with ground interacting tip equipped with a pressure sensor 1010 in communication with exoskeleton control system 1003.
- Exoskeleton control system 1010 uses an algorithm to process information from ground interacting tip equipped with a pressure sensor 1010, and based on information from both ground force sensors 1004 and ground interacting tip equipped with a pressure sensor 1010 exoskeleton control system determines information on center of pressure and other balance parameters.
- Exoskeleton control system 1003 then relays guidance and balance shift information to exoskeleton wearer 1001 through crutch handles equipped with a vibratory motor 1008.
- a patient using an exoskeleton device might have both loss of muscular function in the lower limbs as well as loss of sensation in the lower limbs. Without sensation in the lower limbs, it is difficult for this patient to balance themselves and the exoskeleton device.
- the exoskeleton control system can decrease ratio of the patient's weight supported by crutches relative to weight supported by the exoskeleton. In addition, this feedback through vibratory motors in the crutches can improve the patient's overall balance, aiding in the course of rehabilitation.
- Location 1101 comprises of feedback means and/or related systems mounted to the structure of the feet
- location 1102 comprises of feedback means and/or related systems mounted along the shank (shin)
- location 1103 comprises of feedback means and/or related systems mounted at the knee joint
- location 1104 comprises of feedback means and/or related systems mounted along the knee motor housing
- location 1 105 comprises of feedback means and/or related systems mounted along the thigh
- location 1106 comprises of feedback means and/or related systems mounted to the sacral structure
- 1107 comprises of feedback means and/or related systems mounted at the hip joint, location
- location 1108 comprises of feedback means and/or related systems mounted to the hip motor housing
- location 1 109 comprises of feedback means and/or related systems mounted to the torso structure.
- exoskeleton data into a "feedback ready" format suitable for communication to an exoskeleton operator.
- These concepts were evaluated based upon the utility of the information communicated to the exoskeleton operator. In particular, it is important to communicate information to the wearer or operator that is not readily apparent to them. Forces applied by the exoskeleton are difficult for a therapist to see, for example, but the angles of various leg segments are very visible. On the other hand, for the wearer of the device, the angles of the leg segments may not be visible, and it may be helpful to relay some information to them (especially if the gait of the orthosis may be irregular).
- the first set of "feedback ready" algorithms utilize information directly from an exoskeleton's various integral sensors that collect data on the exoskeleton state, including but not limited to joint angles and joint torques.
- the expected joint torque can be approximately calculated based on the exoskeleton wearer's weight and exoskeleton device pose; methods of making this calculation are readily apparent to a person skilled in the art of exoskeleton design.
- this expected minus actual torque information provides the exoskeleton wearer with the ability to immediately sense obstacles that are impeding the exoskeleton' s movement.
- Another novel "feedback ready” trigger related to joint torque is the interaction forces between the exoskeleton and the exoskeleton operator. This force can be measured using common strain gauges or pressure sensors at human-exoskeleton interface points.
- Another novel "feedback ready" trigger related to joint torque is the assistance level provided by the device when a device is used in rehabilitative training.
- Calculation of assistance level is a function of the interaction forces between the exoskeleton and the exoskeleton wearer and is readily apparent to a person skilled in the art of exoskeleton design.
- This assistance level enables a physical therapist or a rehabilitation patient to understand how much work the machine is doing and how much work the patient is doing. This gives the physical therapist and the patient the target of minimizing the assistance level to maximize rehabilitative benefit.
- this trigger gives the exoskeleton wearer direct feedback as to how much the exoskeleton is modifying their movements and therefore an idea of what their movements would be like without the assistance of an exoskeleton.
- this joint torque based information is communicated to a physical therapist using an exoskeleton device in a rehabilitation setting, it will give the physical therapist an improved understand of the exoskeleton' s effect on the patient. This understanding will enable the physical therapist to make better decisions about a patient's progression and the exoskeleton device settings required for maximum rehabilitative benefit.
- Another class of "feedback ready" triggers are based on exoskeleton and exoskeleton wearer pose information such as center of pressure location, center of gravity location, and relative exoskeleton segment positions. When used with sensory deficient patients such as spinal cord injury patients these triggers attempt to replace the exoskeleton wearer's kinesthetic or somatosensory sense to restore proper proprioception. These embodiments include the positions of the joints relative to each other, which can enable the exoskeleton wearer to understand their position in space more accurately.
- the feedback may provide the exoskeleton wearer with information concerning their hip extension angle or the distance of the hip to the ankle. These may be qualitative feedback such as “forward” or “back” or may be quantitative indicating the actual distance forward or back.
- center of pressure can be calculated using force or pressure sensors located under the feet of the exoskeleton wearer or exoskeleton device (in the case of an exoskeleton with feet). Center of mass can be calculated using joint angle sensors, the exoskeleton, and the exoskeleton wearer's segment weights. In order to improve the accuracy of these the calculations, the joint angles should be corrected based on the flex of the exoskeleton structure using strain gauges embedded within the exoskeleton structure. Relative exoskeleton segment positions can also be calculated using joint angles, segment lengths and flex corrections.
- One novel “feedback ready” trigger in the center of pressure class is the relative position of the center of pressure and center of mass of the exoskeleton and exoskeleton wearer system.
- This "feedback ready” trigger signifies which direction in which the system is falling and can also be used to indicate the speed of the fall by the distance between the center of pressure and the center of mass.
- Another novel "feedback ready" trigger useful with a lower body exoskeletons is the height of each foot from the ground. This trigger acts to restore an exoskeleton wearer's kinesthetic sense. This feedback can be sensed in a variety of manners which are evident to those skilled in the art.
- One embodiment utilizes proximity sensors, such as sonar emitters and receivers, to calculate the distance to the ground in conjunction with pressure sensors to determine contact. Alternate embodiments may include cameras or laser distance measurements.
- Another novel "feedback ready” trigger useful with lower body exoskeletons is the distance from the front of each foot to the closest obstacle. This trigger allows an
- exoskeleton wearer to sense if it is safe to proceed with a given action.
- the information fed back to the exoskeleton wearer may include the distance to the obstacle or simply the presence of an obstacle in a given range of the path.
- Another novel "feedback ready" trigger useful with lower body exoskeletons is the predicted end effector positions of a selected action. This trigger both provides an exoskeleton wearer with information about an action about to be performed, but also a training target to aim for in order to complete the action.
- a visual display either by a projected point or a heads-up display informs the exoskeleton wearer of the end position of their foot after the action is performed.
- the visual display may indicate where to put a crutch or other walk aid in order to prepare for a step.
- Another class of "feedback ready" triggers communicates the control system parameters including current actions, planned actions, and control changes to the exoskeleton wearer. These triggers provide the exoskeleton wearer with an improved understanding of the status of the exoskeleton control system so that the exoskeleton wearer is always aware of exoskeleton actions before they are carried out. These triggers need to be communicated in a non-impeding fashion. This communication of parameter changes or actions also provides the exoskeleton wearer the opportunity to confirm or acknowledge the changes if necessary.
- Additional "feedback ready" triggers were conceptualized including hand to walking aid force vectors, walking aid to ground forces, torso forward and back angle, torso side to side angle, joint angles, compass heading, mode change requests, mode change confirmations, action initiation, action completion, alerts to unstable positions, and conditional based on functions of individual triggers.
- the communication means between the exoskeleton sensors and the exoskeleton control system can either be wireless or hardwired.
- the communication means between the feedback systems and the exoskeleton system can either be wireless or hardwired.
- the methods and devices disclosed here in combination with our disclosures in other applications relating to reading human intentions into the machine, could be used to build an exoskeleton system where the patient themselves closes the highest control "loop."
- the methods disclosed in this application could, for example, be used to communicate the center of pressure of the user/machine system to the patient and then the patient could, in methods disclosed in our other applications, indicate how they want the machine to move in real time by moving their gait aids (or fingers, or, hands, or arms, or head to name a few more embodiments).
- the patient who may have both motor and sensory impairments, and possibly complete impairment of both in their legs, could regain a normal gait over which they have complete control.
- Figure 12 includes a control system block diagram that shows this embodiment.
- Center of Pressure and Force 1201 is the center of pressure of force distributed over the support surface, and "Fz,” the vertical force of the human and machine on the support surface.
- Exoskeleton pose estimate 1202 is the exoskeletons internal representation of its orientation in space. Data from both 1201 and 1202, collectively containing information on 1203, which include center of pressure information in both sagittal and coronal planes as well as ankle positions in the sagittal plane, is relayed to feedback system 1204 which continuously transfers information from the patient wearing the exoskeleton device, 1205, to the machine such as those disclosed in this application.
- Patient 1205 uses human machine interface 1206, a system that continuously transfers information from the person to the machine such as those disclosed in our other applications, to convey information of patient 1205's intent, including the desired center of pressure in both the sagittal and coronal planes, 1207, to controller joint coordination module 1208, which is the lower level machine control done in the exoskeleton controller that manipulates the exoskeleton actuators to produce the desired center of pressure position.
- Closed loop control 1208 commands the exoskeleton device, 1209, resulting in changes in exoskeleton trajectories. Using this system, it becomes possible to close the control loop through the person so that the person may directly command the motion of the exoskeleton.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Epidemiology (AREA)
- Physical Education & Sports Medicine (AREA)
- Rehabilitation Therapy (AREA)
- Pain & Pain Management (AREA)
- Vascular Medicine (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Physiology (AREA)
- Transplantation (AREA)
- Orthopedic Medicine & Surgery (AREA)
- Nursing (AREA)
- Rehabilitation Tools (AREA)
Abstract
Description
Claims
Priority Applications (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
ES14775374T ES2912405T3 (en) | 2013-03-14 | 2014-03-12 | Machine-to-person interfaces for communication from a lower extremity orthosis |
CA2900675A CA2900675A1 (en) | 2013-03-14 | 2014-03-12 | Machine to human interfaces for communication from a lower extremity orthotic |
PL14775374T PL2967959T3 (en) | 2013-03-14 | 2014-03-12 | Machine to human interfaces for communication from a lower extremity orthotic |
US14/776,406 US10391016B2 (en) | 2013-03-14 | 2014-03-12 | Machine to human interfaces for communication from a lower extremity orthotic |
AU2014240454A AU2014240454A1 (en) | 2013-03-14 | 2014-03-12 | Machine to human interfaces for communication from a lower extremity orthotic |
CN201480014840.1A CN105142581A (en) | 2013-03-14 | 2014-03-12 | Machine to human interfaces for communication from a lower extremity orthotic |
EP14775374.3A EP2967959B1 (en) | 2013-03-14 | 2014-03-12 | Machine to human interfaces for communication from a lower extremity orthotic |
IL241241A IL241241A0 (en) | 2013-03-14 | 2015-09-07 | Machine to human interfaces for communication from a lower extremity orthotic |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361781347P | 2013-03-14 | 2013-03-14 | |
US61/781,347 | 2013-03-14 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014159577A1 true WO2014159577A1 (en) | 2014-10-02 |
Family
ID=51625205
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2014/024244 WO2014159577A1 (en) | 2013-03-14 | 2014-03-12 | Machine to human interfaces for communication from a lower extremity orthotic |
Country Status (9)
Country | Link |
---|---|
US (1) | US10391016B2 (en) |
EP (1) | EP2967959B1 (en) |
CN (1) | CN105142581A (en) |
AU (1) | AU2014240454A1 (en) |
CA (1) | CA2900675A1 (en) |
ES (1) | ES2912405T3 (en) |
IL (1) | IL241241A0 (en) |
PL (1) | PL2967959T3 (en) |
WO (1) | WO2014159577A1 (en) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105395252A (en) * | 2015-12-10 | 2016-03-16 | 哈尔滨工业大学 | Wearable three-dimensional image navigation device for vascular intervention operation and realizing man-machine interaction |
WO2016077442A1 (en) * | 2014-11-11 | 2016-05-19 | Ekso Bionics, Inc. | Methods of enhancing the rehabilitation or training of an exoskeleton wearer |
RU2598058C1 (en) * | 2015-11-03 | 2016-09-20 | Общество С Ограниченной Ответственностью "Экзоатлет" | Set of user crutches for controlling exoskeleton |
WO2017105762A1 (en) | 2015-12-14 | 2017-06-22 | Parker-Hannifin Corporation | Safety monitoring and control system and methods for a legged mobility exoskeleton device |
WO2017105547A1 (en) | 2015-12-14 | 2017-06-22 | Parker-Hannifin Corporation | Control system utilizing a mobile application for a legged mobility exoskeleton device |
WO2018175004A1 (en) | 2017-03-22 | 2018-09-27 | Parker-Hannifin Corporation | Mobility assistance devices with automated assessment and adjustment control |
IT201700038923A1 (en) * | 2017-04-07 | 2018-10-07 | Absolute Solution Res And Development S R L | EXOSCHELETER FOR MOTOR STIMULATION AND TOGETHER INCLUDING THE EXOSCHELETER |
EP3409424A1 (en) * | 2017-05-29 | 2018-12-05 | Ekso.Teck, Lda. | Robotic-assisted locomotion system |
WO2020112196A1 (en) | 2018-11-30 | 2020-06-04 | Parker-Hannifin Corporation | Cloud-based control system and method enabling interactive clinical care using a powered mobility assistance device |
US10694948B2 (en) | 2015-04-14 | 2020-06-30 | Ekso Bionics | Methods of exoskeleton communication and control |
US10730178B2 (en) | 2015-05-05 | 2020-08-04 | Ekso Bionics, Inc. | Ensuring operator engagement in an exoskeleton bionic device |
US20210015694A1 (en) * | 2019-07-16 | 2021-01-21 | Ecole Polytechnique Federale De Lausanne (Epfl) | Bio-inspired standing balance controller for a full-mobilization exoskeleton |
US20210244320A1 (en) * | 2020-02-11 | 2021-08-12 | Korea Institute Of Science And Technology | Apparatus and method for evaluating force control ability of upper limb and prosthesis |
Families Citing this family (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR3016821B1 (en) * | 2014-01-29 | 2019-08-02 | Robotiques 3 Dimensions | EXOSQUELETTE WITH FRONT PORT AND METHOD OF USING SUCH AN EXOSQUELET. |
WO2015140353A2 (en) * | 2014-03-21 | 2015-09-24 | Wandercraft | Exoskeleton comprising a foot structure |
US20160158593A1 (en) * | 2014-12-04 | 2016-06-09 | Florida Institute for Human and Machine Cognition | Exoskeleton-Based Exercise and Training Device |
KR102384155B1 (en) * | 2015-01-21 | 2022-04-08 | 삼성전자주식회사 | Method and apparatus for assisting walking |
TWI554266B (en) * | 2015-04-24 | 2016-10-21 | Univ Nat Yang Ming | Wearable gait rehabilitation training device and gait training method using the same |
US9675515B2 (en) * | 2015-04-27 | 2017-06-13 | Chimei Medical Center | Mobility aid with rehabilitative and guiding functions and rehabilitation and guiding method thereof |
US10130311B1 (en) * | 2015-05-18 | 2018-11-20 | Hrl Laboratories, Llc | In-home patient-focused rehabilitation system |
US20170156895A1 (en) * | 2015-12-03 | 2017-06-08 | National Chiao Tung University | Movement assistance system and method thereof |
CN105564530A (en) * | 2016-01-15 | 2016-05-11 | 中国矿业大学 | Hybrid power system and optimal control method for mechanical outer skeleton |
EP3402444B1 (en) | 2016-01-17 | 2022-04-06 | Human in Motion Robotics Inc. | System and device for guiding and detecting motions of 3-dof rotational target joint |
CN105796306B (en) * | 2016-05-12 | 2018-08-10 | 彭康明 | Noninvasive intermuscular bone detection of joints, correction, full presciption position treatment system |
EP3496594B1 (en) * | 2016-08-09 | 2024-02-28 | Addasense Health GmbH | System, method and computer readable storage medium for posture and movement regulation |
EP3778140B1 (en) * | 2016-08-17 | 2024-01-31 | Power Assist International Corporation | Wearable assist robot apparatus |
US9717607B1 (en) * | 2016-10-28 | 2017-08-01 | International Business Machines Corporation | Augmented control of robotic prosthesis by a cognitive system |
CN111278398B (en) | 2017-08-29 | 2022-08-23 | 漫游机械人技术公司 | Semi-supervised intent recognition system and method |
CN109124998B (en) * | 2018-06-28 | 2022-04-01 | 东莞英汉思机器人科技有限公司 | Power exoskeleton control method and device, computer equipment and storage medium |
CN109248011B (en) * | 2018-09-18 | 2024-03-22 | 北京宏信农业科技发展有限公司 | Motion control method and device based on tactile feedback and pressure feedback |
CN109498375B (en) * | 2018-11-23 | 2020-12-25 | 电子科技大学 | Human motion intention recognition control device and control method |
EP3718470A1 (en) * | 2019-04-02 | 2020-10-07 | Roche Diabetes Care GmbH | Ambulatory medical device with vibrator |
NL2023588B1 (en) * | 2019-07-29 | 2021-02-18 | Elitac | Vibrotactile feedback arrangement |
IT201900014640A1 (en) * | 2019-08-12 | 2021-02-12 | Quicklypro Srl | Walking support device with position measurement and remote support |
JP2021090516A (en) * | 2019-12-09 | 2021-06-17 | トヨタ自動車株式会社 | Walking state determination device, walking aiding apparatus and control program |
US11931307B2 (en) | 2019-12-13 | 2024-03-19 | Roam Robotics Inc. | Skiing exoskeleton control method and system |
CA3179851A1 (en) * | 2020-05-27 | 2021-12-02 | Robert Stuart | Control system and method for a mobile robot |
US11046457B1 (en) * | 2020-07-29 | 2021-06-29 | Kitty Hawk Corporation | Landing zone indicators |
WO2024128891A1 (en) * | 2022-12-14 | 2024-06-20 | Université Internationale de RABAT | Orthopedic prosthesis containing a micro-vibrator for ground closeness warning |
WO2024126854A1 (en) * | 2022-12-15 | 2024-06-20 | Kurage | Device and method for stimulating at least one of a nerve and a muscle of a patient having a pathological gait |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060200057A1 (en) | 2005-03-07 | 2006-09-07 | Shane Sterling | Orthotic or prosthetic devices with adjustable force dosimeter and sensor |
US20060260620A1 (en) * | 2005-01-18 | 2006-11-23 | The Regents Of University Of California | Lower extremity exoskeleton |
US20060292533A1 (en) * | 2005-06-22 | 2006-12-28 | Selod Omar F | System and method for gait training |
US20070155588A1 (en) | 1998-09-01 | 2007-07-05 | Izex Technologies, Inc. | Remote monitoring of a patient |
US20080071386A1 (en) * | 2006-09-19 | 2008-03-20 | Myomo, Inc. | Powered Orthotic Device and Method of Using Same |
US20080255488A1 (en) * | 2007-04-06 | 2008-10-16 | University Of Delaware | Powered Orthosis |
EP2189136A1 (en) | 2007-08-20 | 2010-05-26 | University of Tsukuba | Action-aiding system for wearable type action-aiding device, wearable type action-aiding device, and action-aiding method for the wearable type action-aiding device |
US20120017147A1 (en) * | 2010-07-16 | 2012-01-19 | John Liam Mark | Methods and systems for interacting with projected user interface |
WO2012044621A1 (en) | 2010-09-27 | 2012-04-05 | Vanderbilt University | Movement assistance device |
US20120157882A1 (en) * | 2005-02-02 | 2012-06-21 | össur hf | Sensing systems and methods for monitoring gait dynamics |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE3521470A1 (en) * | 1985-06-14 | 1987-02-05 | Baehr Heinz | MOTION RAIL |
US5679004A (en) | 1995-12-07 | 1997-10-21 | Movit, Inc. | Myoelectric feedback system |
AU2001236791A1 (en) | 2000-02-09 | 2001-08-20 | Farhad M. Limonadi | Systems for the prevention or treatment of carpal tunnel syndrome |
US6778866B1 (en) | 2000-03-16 | 2004-08-17 | Ted S. Bettwy | Method and apparatus for learning specific body motion |
US6447425B1 (en) | 2000-06-14 | 2002-09-10 | Paracomp, Inc. | Range of motion device |
US7033281B2 (en) | 2002-03-22 | 2006-04-25 | Carnahan James V | Augmented kinematic feedback device and method |
JP4181796B2 (en) | 2002-06-10 | 2008-11-19 | 之男 斎藤 | Limb body rehabilitation training device |
US20080009771A1 (en) | 2006-03-29 | 2008-01-10 | Joel Perry | Exoskeleton |
JP4931123B2 (en) | 2006-10-03 | 2012-05-16 | 学校法人金沢工業大学 | Standing up motion assist device |
US7993291B2 (en) | 2007-05-29 | 2011-08-09 | Microsoft Corporation | Haptic support and virtual activity monitor |
US8475172B2 (en) | 2007-07-19 | 2013-07-02 | Massachusetts Institute Of Technology | Motor learning and rehabilitation using tactile feedback |
EP2180920A1 (en) | 2007-07-20 | 2010-05-05 | Össur HF | Prosthetic or orthopedic device having feedback |
US8096965B2 (en) * | 2008-10-13 | 2012-01-17 | Argo Medical Technologies Ltd. | Locomotion assisting device and method |
US20100262047A1 (en) | 2009-04-08 | 2010-10-14 | Drexel University | Physical therapy systems and methods |
US20110152736A1 (en) * | 2009-05-19 | 2011-06-23 | Djo, Llc | Brace having a Force Indicator |
US9757266B2 (en) | 2010-06-01 | 2017-09-12 | Saebo, Inc. | Orthotic device |
US20130158445A1 (en) | 2010-08-23 | 2013-06-20 | The Regents Of The University Of California | Orthesis system and methods for control of exoskeletons |
JP2012115311A (en) | 2010-11-29 | 2012-06-21 | Equos Research Co Ltd | Walking device and walking program |
KR20120071555A (en) | 2010-12-23 | 2012-07-03 | 한국전자통신연구원 | Apparatus for rehabilitation robot |
-
2014
- 2014-03-12 EP EP14775374.3A patent/EP2967959B1/en active Active
- 2014-03-12 ES ES14775374T patent/ES2912405T3/en active Active
- 2014-03-12 AU AU2014240454A patent/AU2014240454A1/en not_active Abandoned
- 2014-03-12 PL PL14775374T patent/PL2967959T3/en unknown
- 2014-03-12 US US14/776,406 patent/US10391016B2/en active Active
- 2014-03-12 WO PCT/US2014/024244 patent/WO2014159577A1/en active Application Filing
- 2014-03-12 CN CN201480014840.1A patent/CN105142581A/en active Pending
- 2014-03-12 CA CA2900675A patent/CA2900675A1/en not_active Abandoned
-
2015
- 2015-09-07 IL IL241241A patent/IL241241A0/en unknown
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070155588A1 (en) | 1998-09-01 | 2007-07-05 | Izex Technologies, Inc. | Remote monitoring of a patient |
US20060260620A1 (en) * | 2005-01-18 | 2006-11-23 | The Regents Of University Of California | Lower extremity exoskeleton |
US20120157882A1 (en) * | 2005-02-02 | 2012-06-21 | össur hf | Sensing systems and methods for monitoring gait dynamics |
US20060200057A1 (en) | 2005-03-07 | 2006-09-07 | Shane Sterling | Orthotic or prosthetic devices with adjustable force dosimeter and sensor |
US20060292533A1 (en) * | 2005-06-22 | 2006-12-28 | Selod Omar F | System and method for gait training |
US20080071386A1 (en) * | 2006-09-19 | 2008-03-20 | Myomo, Inc. | Powered Orthotic Device and Method of Using Same |
US20080255488A1 (en) * | 2007-04-06 | 2008-10-16 | University Of Delaware | Powered Orthosis |
EP2189136A1 (en) | 2007-08-20 | 2010-05-26 | University of Tsukuba | Action-aiding system for wearable type action-aiding device, wearable type action-aiding device, and action-aiding method for the wearable type action-aiding device |
US20120017147A1 (en) * | 2010-07-16 | 2012-01-19 | John Liam Mark | Methods and systems for interacting with projected user interface |
WO2012044621A1 (en) | 2010-09-27 | 2012-04-05 | Vanderbilt University | Movement assistance device |
Non-Patent Citations (1)
Title |
---|
See also references of EP2967959A4 |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10576008B2 (en) | 2014-11-11 | 2020-03-03 | Ekso Bionics, Inc. | Methods of enhancing the rehabilitation or training of an exoskeleton wearer |
WO2016077442A1 (en) * | 2014-11-11 | 2016-05-19 | Ekso Bionics, Inc. | Methods of enhancing the rehabilitation or training of an exoskeleton wearer |
CN107106398B (en) * | 2014-11-11 | 2024-03-15 | 埃克苏仿生公司 | Method for enhancing rehabilitation or training of exoskeleton wearer |
CN107106398A (en) * | 2014-11-11 | 2017-08-29 | 埃克苏仿生公司 | Strengthen the method for the rehabilitation or training of ectoskeleton wearer |
US10694948B2 (en) | 2015-04-14 | 2020-06-30 | Ekso Bionics | Methods of exoskeleton communication and control |
US10730178B2 (en) | 2015-05-05 | 2020-08-04 | Ekso Bionics, Inc. | Ensuring operator engagement in an exoskeleton bionic device |
RU2598058C1 (en) * | 2015-11-03 | 2016-09-20 | Общество С Ограниченной Ответственностью "Экзоатлет" | Set of user crutches for controlling exoskeleton |
CN105395252A (en) * | 2015-12-10 | 2016-03-16 | 哈尔滨工业大学 | Wearable three-dimensional image navigation device for vascular intervention operation and realizing man-machine interaction |
WO2017105547A1 (en) | 2015-12-14 | 2017-06-22 | Parker-Hannifin Corporation | Control system utilizing a mobile application for a legged mobility exoskeleton device |
US11077556B2 (en) | 2015-12-14 | 2021-08-03 | Parker-Hannifin Corporation | Safety monitoring and control system and methods for a legged mobility exoskeleton device |
WO2017105762A1 (en) | 2015-12-14 | 2017-06-22 | Parker-Hannifin Corporation | Safety monitoring and control system and methods for a legged mobility exoskeleton device |
US20200060921A1 (en) * | 2017-03-22 | 2020-02-27 | Parker-Hannifin Corporation | Mobility assistance devices with automated assessment and adjustment control |
WO2018175004A1 (en) | 2017-03-22 | 2018-09-27 | Parker-Hannifin Corporation | Mobility assistance devices with automated assessment and adjustment control |
US11642272B2 (en) * | 2017-03-22 | 2023-05-09 | Ekso Bionics Holdings, Inc. | Mobility assistance devices with automated assessment and adjustment control |
IT201700038923A1 (en) * | 2017-04-07 | 2018-10-07 | Absolute Solution Res And Development S R L | EXOSCHELETER FOR MOTOR STIMULATION AND TOGETHER INCLUDING THE EXOSCHELETER |
EP3409424A1 (en) * | 2017-05-29 | 2018-12-05 | Ekso.Teck, Lda. | Robotic-assisted locomotion system |
WO2020112196A1 (en) | 2018-11-30 | 2020-06-04 | Parker-Hannifin Corporation | Cloud-based control system and method enabling interactive clinical care using a powered mobility assistance device |
US20210015694A1 (en) * | 2019-07-16 | 2021-01-21 | Ecole Polytechnique Federale De Lausanne (Epfl) | Bio-inspired standing balance controller for a full-mobilization exoskeleton |
US20210244320A1 (en) * | 2020-02-11 | 2021-08-12 | Korea Institute Of Science And Technology | Apparatus and method for evaluating force control ability of upper limb and prosthesis |
Also Published As
Publication number | Publication date |
---|---|
US10391016B2 (en) | 2019-08-27 |
IL241241A0 (en) | 2015-11-30 |
CN105142581A (en) | 2015-12-09 |
CA2900675A1 (en) | 2014-10-02 |
ES2912405T3 (en) | 2022-05-25 |
EP2967959A4 (en) | 2016-09-21 |
PL2967959T3 (en) | 2022-06-20 |
EP2967959B1 (en) | 2022-04-27 |
EP2967959A1 (en) | 2016-01-20 |
AU2014240454A1 (en) | 2015-08-20 |
US20160045386A1 (en) | 2016-02-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10391016B2 (en) | Machine to human interfaces for communication from a lower extremity orthotic | |
Katzschmann et al. | Safe local navigation for visually impaired users with a time-of-flight and haptic feedback device | |
EP2827809B1 (en) | Human machine interface for lower extremity orthotics | |
CN108236560B (en) | Electric walking aid for promoting gait movement and application method thereof | |
KR101694402B1 (en) | System and method for assisting ambulatory rehabilitation using projected image | |
US10206844B2 (en) | Interface for adjusting the motion of a powered orthotic device through externally applied forces | |
EP2616115B1 (en) | Human machine interface for human exoskeleton | |
KR102186859B1 (en) | a walking assist device and a method for controlling the the walking assist device | |
Andrade et al. | Development of a “transparent operation mode” for a lower-limb exoskeleton designed for children with cerebral palsy | |
US20180289579A1 (en) | Powered Walking Assistant and Associated Systems and Methods | |
Chinmilli et al. | A review on wearable inertial tracking based human gait analysis and control strategies of lower-limb exoskeletons | |
KR101882083B1 (en) | Gait training system utilizing tva sense | |
KR101458002B1 (en) | Intelligent wheelchair robot based on biometrics for rehabilitation of upper limb and lower limb | |
US11989351B2 (en) | Virtual, augmented and mixed reality systems with physical feedback | |
KR101697958B1 (en) | Walking System | |
Mineev | Multimodal control system of active lower limb exoskeleton with feedback | |
EP4238711A1 (en) | Method and device for measuring muscular fitness of user by using wearable device | |
JP5392671B2 (en) | Walking measurement device | |
KR20190031936A (en) | Rehabilitation exercise based on random error signal and controlling method thereof | |
Li et al. | Design of a crutch-exoskeleton assisted gait for reducing upper extremity loads✰ | |
TWM503896U (en) | Lower limb rehabilitation mechanism | |
TWI836688B (en) | Mobile multifunctional intelligent gait training machine | |
KR101611474B1 (en) | Walking System | |
TW202419131A (en) | Mobile multifunctional intelligent gait training machine | |
US20190083347A1 (en) | Joint power |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201480014840.1 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14775374 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2900675 Country of ref document: CA |
|
ENP | Entry into the national phase |
Ref document number: 2014240454 Country of ref document: AU Date of ref document: 20140312 Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 241241 Country of ref document: IL |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2014775374 Country of ref document: EP |