JP5811482B2 - EMG data processing device, program thereof, and operation support device - Google Patents

EMG data processing device, program thereof, and operation support device Download PDF

Info

Publication number
JP5811482B2
JP5811482B2 JP2011184380A JP2011184380A JP5811482B2 JP 5811482 B2 JP5811482 B2 JP 5811482B2 JP 2011184380 A JP2011184380 A JP 2011184380A JP 2011184380 A JP2011184380 A JP 2011184380A JP 5811482 B2 JP5811482 B2 JP 5811482B2
Authority
JP
Japan
Prior art keywords
waveform
myoelectric
involuntary
acquired
myoelectric data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2011184380A
Other languages
Japanese (ja)
Other versions
JP2013043028A (en
Inventor
正克 藤江
正克 藤江
洋 小林
洋 小林
健 安藤
健 安藤
雅俊 関
雅俊 関
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Waseda University
Kikuchi Seisakusho Co Ltd
Original Assignee
Waseda University
Kikuchi Seisakusho Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Waseda University, Kikuchi Seisakusho Co Ltd filed Critical Waseda University
Priority to JP2011184380A priority Critical patent/JP5811482B2/en
Publication of JP2013043028A publication Critical patent/JP2013043028A/en
Application granted granted Critical
Publication of JP5811482B2 publication Critical patent/JP5811482B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Manipulator (AREA)
  • Rehabilitation Tools (AREA)

Description

本発明は、筋電データ処理装置、そのプログラム、及び動作支援装置に係り、更に詳しくは、振戦患者等の筋電データから不随意運動の信号成分を除去し、随意運動の信号成分のみを抽出することができる筋電データ処理装置、そのプログラム、及び動作支援装置に関する。   The present invention relates to a myoelectric data processing apparatus, a program thereof, and an operation support apparatus. More specifically, the involuntary movement signal component is removed from the myoelectric data of a tremor patient or the like, and only the voluntary movement signal component is obtained. The present invention relates to a myoelectric data processing device that can be extracted, its program, and an operation support device.

自分の意思に反して手足が振動する振戦と呼ばれる神経疾患がある。当該振戦の一種として、ある動作を行う際やある姿勢を保とうとした場合に周期的に手足などが震える本態性振戦がある。本態性振戦の患者は、生活に必要な様々な器具を持つ手が震えることで、例えば、筆記しにくい、容器に入った飲料を飲みにくい、食事しにくい等の問題を招来する。このような振戦を抑制するには、β遮断薬などの薬の服用や脳深部刺激法(DBS)があるが、副作用をもたらすなど、身体への影響が問題となる。   There is a neurological disorder called tremor in which the limbs vibrate against their will. As one type of tremor, there is an essential tremor in which a limb or the like periodically shakes when performing a certain motion or trying to maintain a certain posture. A patient with essential tremor causes problems such as difficulty in writing, difficulty in drinking a beverage in a container, and difficulty in eating, because hands holding various instruments necessary for daily life shake. In order to suppress such tremors, there are drugs such as β-blockers and deep brain stimulation (DBS). However, the effects on the body such as side effects are problematic.

特許文献1には、身体の手作業の動作を補助する上肢動作補助装置が開示されている。この上肢動作補助装置は、使用者の上肢に装着される装具が設けられた自由端部を有し、装具に加えられた使用者の力情報に基づいて自由端部の軌道制御を行って、上肢の動作を補助するものである。ここで、当該装置においては、使用者の手の震えなどによって発生する本人の意思と関係ない力ベクトルを検出しないように、力情報が数Hz程度の低周波数の周期で変化している場合、前記自由端部の軌道制御を行わないようになっている。   Patent Document 1 discloses an upper limb movement assisting device that assists the manual movement of the body. This upper limb movement assist device has a free end provided with a brace to be worn on the user's upper limb, performs trajectory control of the free end based on the user's force information applied to the brace, It assists the movement of the upper limbs. Here, in the device, when the force information is changing at a low frequency cycle of about several Hz so as not to detect a force vector that is not related to the intention of the person generated by the shaking of the user's hand, The trajectory control of the free end is not performed.

特開平11−253504号公報JP-A-11-253504

しかしながら、前記特許文献1の装置にあっては、本態性振戦患者の上肢の動作を補助することができない。すなわち、本態性振戦患者は、前述したように、自分が意図する動作すなわち随意運動を行おうとした際に、自分の意思とは関係のない体の震えすなわち不随意運動が生じる。このため、特許文献1の装置では、不随意運動による力の周期的な変化を検出した時点で、前記自由端部の動作制御が停止してしまい、随意運動の補助ができず、本態性振戦患者に対して適切な運動支援を行うことができない。   However, the device of Patent Document 1 cannot assist the movement of the upper limb of the essential tremor patient. That is, as described above, when an essential tremor patient tries to perform a motion intended by himself / herself, that is, voluntary movement, a tremor of the body unrelated to his / her own intention, that is, involuntary movement occurs. For this reason, in the apparatus of Patent Document 1, when the periodic change in force due to involuntary movement is detected, the motion control of the free end is stopped, and the voluntary movement cannot be assisted. Unable to provide appropriate exercise support for war patients.

ところで、本発明者らは、本態性振戦患者への運動支援のためのロボット装具の研究開発を行っており、このロボット装具の動作制御は、患者の筋肉の収縮時に周辺皮膚表面に現れる電位差である表面筋電位に基づいて行われる。ところが、筋電位センサ等で得られた筋電位信号には、使用者が意図する随意運動に対応する信号成分と振戦の影響による不随意運動に対応する信号成分とが混在している。従って、随意運動のみを支援可能にするには、筋電位に関する筋電データを患者から取得した後、不随意運動の影響による信号成分(ノイズ)を除去するフィルタリング手法の開発が要請される。そこで、本発明者らは、鋭意、実験研究を行った結果、振戦患者の筋電データに周期性があることに着目し、取得した筋電データから、振戦の影響によるノイズを除去するフィルタリングアルゴリズムを創出した。   By the way, the present inventors are conducting research and development of a robotic brace for exercise support for essential tremor patients, and the motion control of this robotic bracelet is a potential difference that appears on the surface of the surrounding skin when the patient's muscle contracts. This is performed based on the surface myoelectric potential. However, in the myoelectric signal obtained by the myoelectric sensor or the like, a signal component corresponding to the voluntary movement intended by the user and a signal component corresponding to the involuntary movement due to the influence of tremor are mixed. Therefore, in order to be able to support only voluntary movement, it is required to develop a filtering method for removing signal components (noise) due to the influence of involuntary movement after acquiring myoelectric data related to myoelectric potential from a patient. Therefore, as a result of earnest and experimental research, the present inventors paid attention to the fact that there is periodicity in myoelectric data of tremor patients, and removes noise caused by tremor from the acquired myoelectric data. Created a filtering algorithm.

本発明は、以上の課題に基づいて案出されたものであり、その目的は、不随意運動を行う振戦患者等の対象者から取得した筋電データを、随意運動に対応する信号成分と不随意運動に対応する信号成分とに分けることができる筋電データ処理装置、そのプログラム、及び動作支援装置を提供することにある。   The present invention has been devised on the basis of the above problems, and its purpose is to use myoelectric data acquired from a subject such as a tremor patient performing involuntary exercise as a signal component corresponding to voluntary exercise. An object of the present invention is to provide a myoelectric data processing device that can be divided into signal components corresponding to involuntary movements, a program thereof, and an operation support device.

前記目的を達成するため、本発明は、対象者の筋電位に関する筋電データの中から、前記対象者が意図しない不随意運動に対応する信号成分を推定して、前記対象者が意図する随意運動に対応する信号成分を特定する筋電データ処理装置であって、
前記不随意運動時の筋電位の経時的変化を表す不随意波形が複数パターン記憶された記憶手段と、前記対象者から取得した前記筋電データの経時的変化を表す取得波形に対し、前記各不随意波形の中で最も近似する最近似波形を選択し、当該最近似波形と前記取得波形との類似度を演算により求める類似度算出手段と、前記最近似波形と前記類似度に基づき、前記筋電データの中で前記不随意運動の信号成分が含まれる割合を表す減衰率を求める減衰率算出手段と、前記減衰率に基づき、取得した前記筋電データを前記各信号成分に分けるフィルタリング手段とを備えた、という構成を主として採っている。
In order to achieve the above object, the present invention estimates a signal component corresponding to an involuntary movement not intended by the subject from the myoelectric data relating to the myoelectric potential of the subject, and the voluntary intention intended by the subject. A myoelectric data processing device for identifying a signal component corresponding to exercise,
A storage means in which a plurality of involuntary waveforms representing changes over time of the myoelectric potential during the involuntary movement are stored, and an acquired waveform representing a change over time of the myoelectric data acquired from the subject. Based on the similarity calculation means for selecting the closest approximation waveform among the involuntary waveforms, calculating similarity between the closest approximation waveform and the acquired waveform, and the similarity Attenuation rate calculating means for obtaining an attenuation rate representing a ratio of the involuntary movement signal component in myoelectric data, and a filtering means for dividing the acquired myoelectric data into the respective signal components based on the attenuation rate The main feature is that it is equipped with.

本発明によれば、不随意運動を行う振戦患者等の対象者から取得された筋電データを、随意運動に対応する信号成分と不随意運動に対応する信号成分とに分けることができる。従って、不随意運動と随意運動が混在する対象者から得られた筋電データについて、前記何れか一方の信号成分を除去し、何れか他方の信号成分のみを抽出することができる。これにより、本発明の筋電データ処理装置は、不随意運動の影響を排除して随意運動のみの運動支援をする装置や、不随意運動を抑制するための運動支援をする装置等に適用することができ、当該各装置の動作制御に有用となる。   According to the present invention, myoelectric data acquired from a subject such as a tremor patient who performs involuntary movement can be divided into a signal component corresponding to voluntary movement and a signal component corresponding to involuntary movement. Therefore, any one of the signal components can be removed and only the other signal component can be extracted from the myoelectric data obtained from a subject who has both involuntary exercise and voluntary exercise. Accordingly, the myoelectric data processing device of the present invention is applied to a device that supports exercise only for voluntary exercise by eliminating the influence of involuntary exercise, a device that supports exercise for suppressing involuntary exercise, and the like. It is useful for controlling the operation of each device.

本実施形態に係る動作支援装置の概略構成図。The schematic block diagram of the operation | movement assistance apparatus which concerns on this embodiment. 周期関数から不随意波形を作成する手順を説明するためのグラフ。The graph for demonstrating the procedure which produces an involuntary waveform from a periodic function. 不随意波形の種類を説明するためのグラフ。The graph for demonstrating the kind of involuntary waveform.

以下、本発明の実施形態について図面を参照しながら説明する。   Hereinafter, embodiments of the present invention will be described with reference to the drawings.

図1には、本実施形態に係る動作支援装置の概略構成図が示されている。この図において、前記動作支援装置10は、振戦患者である使用者H(対象者)の生活動作を支援する装置であって、使用者Hが意図しない不随意運動の影響を排除し、使用者Hが意図する随意運動のみについてパワーアシストするようになっている。   FIG. 1 shows a schematic configuration diagram of an operation support apparatus according to the present embodiment. In this figure, the motion support device 10 is a device that supports the life motion of a user H (subject) who is a tremor patient, and eliminates the influence of involuntary movement that the user H does not intend to use. Only the voluntary movement intended by the person H is power-assisted.

この動作支援装置10は、使用者Hの関節付近に装着されて当該関節による体部位の運動を支援可能に動作する装具11と、装具11による動作を制御する制御装置12とを備えている。   The movement support apparatus 10 includes a brace 11 that is mounted near the joint of the user H and operates to support the movement of the body part by the joint, and a control apparatus 12 that controls the movement of the brace 11.

前記装具11は、使用者Hの腕部に装着されるようになっており、肘関節の屈曲動作を支援するようになっている。この装具11は、使用者Hの肘関節の屈曲動作方向のみに動作可能なアーム14と、アーム14を動作させる駆動手段としてのモータ15と、前記屈曲動作を行うための上腕筋の皮膚表面に装着され、上腕筋の表面筋電位に関する筋電データを取得するための筋電位センサ17とを備えている。   The brace 11 is adapted to be worn on the arm portion of the user H, and supports the bending motion of the elbow joint. This brace 11 is provided on the skin surface of the upper arm muscle for performing the bending operation, an arm 14 operable only in the bending operation direction of the elbow joint of the user H, a motor 15 as a driving means for operating the arm 14. And a myoelectric sensor 17 for acquiring myoelectric data related to the surface myoelectric potential of the upper arm muscle.

前記アーム14は、使用者Hの上腕部の外側に沿って配置される上腕側アーム19と、使用者Hの前腕部の外側に沿って配置される前腕側アーム20と、これら上腕側アーム19と前腕側アーム20を相対回転可能に連結する連結部22と、上腕側アーム19の上端側に取り付けられ、使用者Hの上腕部に固定可能な上腕側装着部24と、前腕側アーム20の先端側に取り付けられ、使用者Hの手首に固定可能な前腕側装着部25とを備えている。   The arm 14 includes an upper arm side arm 19 disposed along the outer side of the upper arm portion of the user H, a forearm side arm 20 disposed along the outer side of the forearm portion of the user H, and the upper arm side arm 19. The upper arm side of the upper arm 19 and the upper arm side mounting portion 24 that can be fixed to the upper arm of the user H, and the forearm side arm 20. A forearm side mounting portion 25 that is attached to the distal end side and can be fixed to the wrist of the user H is provided.

前記連結部22は、使用者Hがアーム14を装着したときに、使用者Hの肘関節の付近の外側に配置されるようになっている。また、連結部22には、上腕側アーム19に対する前腕側アーム20の回転動作範囲を規制するストッパ(図示省略)が設けられており、当該ストッパにより、使用者Hの前記屈曲動作の範囲内のみで前腕側アーム20が回転動作可能となる。   The connecting portion 22 is arranged outside the vicinity of the elbow joint of the user H when the user H wears the arm 14. Further, the connecting portion 22 is provided with a stopper (not shown) that restricts the rotational operation range of the forearm arm 20 with respect to the upper arm side arm 19, and only by the stopper within the range of the bending operation of the user H. Thus, the forearm arm 20 can rotate.

前記上腕側装着部24は、上腕部の周囲を内側に挟み込み可能な平面視ほぼコ字状(図示省略)に形成されており、上腕部が挟み込まれる内側部分の幅は、装着する使用者Hの上腕部の太さに合わせて調整可能となっている。この上腕側装着部24は、図示しない面ファスナー等で上腕部の所定位置に脱落不能に固定される。   The upper arm side mounting portion 24 is formed in a substantially U shape (not shown) in plan view so that the periphery of the upper arm portion can be sandwiched inside, and the width of the inner portion where the upper arm portion is sandwiched is determined by the user H who wears it. It can be adjusted according to the thickness of the upper arm. The upper arm side mounting portion 24 is fixed to a predetermined position of the upper arm portion with a hook-and-loop fastener (not shown) so as not to fall off.

前記前腕側装着部25は、上腕側装着部24と実質的に同様の構成となっており、図示しない面ファスナー等で手首の所定位置に固定される。   The forearm side mounting portion 25 has substantially the same configuration as the upper arm side mounting portion 24 and is fixed to a predetermined position of the wrist with a hook-and-loop fastener (not shown).

前記モータ15は、連結部22に設けられており、モータ15の駆動時には、上腕側アーム19に対する前腕側アーム20の回転動作が行われる。その一方、モータ15の停止時には、上腕側アーム19に対する前腕側アーム20の回転動作がロックされ、アーム15が装着された状態の使用者Hは、前腕側アーム20のロックによって、前腕部を自由に動作できなくなる。なお、本実施形態では、モータ15により、上腕側アーム19に対する前腕側アーム20の回転動作を行うようになっているが、同様の作用を奏する限りにおいて、当該モータ15の代わりに他のアクチュエータを用いることもできる。   The motor 15 is provided in the connecting portion 22, and when the motor 15 is driven, the forearm arm 20 rotates with respect to the upper arm 19. On the other hand, when the motor 15 is stopped, the rotation operation of the forearm arm 20 with respect to the upper arm 19 is locked, and the user H with the arm 15 attached can freely move the forearm by locking the forearm arm 20. Can not work. In the present embodiment, the motor 15 rotates the forearm arm 20 with respect to the upper arm 19, but other actuators are used instead of the motor 15 as long as the same action is achieved. It can also be used.

前記筋電位センサ17は、使用者Hが肘関節を屈曲動作する際に用いる上腕筋のある皮膚表面の前後2箇所、すなわち、前記屈曲動作時の主働筋、拮抗筋の関係となる上腕二頭筋、上腕三頭筋がそれぞれある皮膚表面に1個ずつ取り付けられる。これら筋電位センサ17では、所定時間毎(例えば、1msec毎)のサンプリング周期で筋電位信号が取得され、当該筋電位信号が逐次、制御装置12に伝送され、制御装置12では、所定の信号処理を経て、筋電位の大きさを表す筋電データが経時的に記憶される。   The myoelectric potential sensor 17 has two upper and lower arm relations between the front and back of the skin surface where the brachial muscle is used, which is used when the user H flexes the elbow joint, that is, the main muscle and the antagonistic muscle during the flexing motion. One muscle and one triceps are attached to the skin surface. In these myoelectric potential sensors 17, myoelectric potential signals are acquired at a sampling period every predetermined time (for example, every 1 msec), the myoelectric potential signals are sequentially transmitted to the control device 12, and the control device 12 performs predetermined signal processing. After that, myoelectric data representing the magnitude of myoelectric potential is stored over time.

この制御装置12は、CPU等の演算処理装置及びメモリやハードディスク等の記憶装置等からなるコンピュータによって構成され、当該コンピュータを以下の各部及び各手段として機能させるためのプログラムがインストールされている。   The control device 12 includes a computer including an arithmetic processing unit such as a CPU and a storage device such as a memory and a hard disk, and a program for causing the computer to function as the following units and units is installed.

すなわち、制御装置12は、筋電位センサ17で得られた筋電データから、使用者Hの不随意運動の影響によるノイズを除去する筋電データ処理部27と、筋電データ処理部27で処理された後の補正筋電データに基づき、モータ15の駆動を指令する指令部28とを備えて構成されている。   That is, the control device 12 performs processing by the myoelectric data processing unit 27 that removes noise due to the influence of the involuntary movement of the user H from the myoelectric data obtained by the myoelectric potential sensor 17 and the myoelectric data processing unit 27. Based on the corrected myoelectric data after being performed, a command unit 28 for commanding the drive of the motor 15 is provided.

前記筋電データ処理部27は、取得した筋電データの中から、不随意運動に対応する信号成分を推定し、随意運動に対応する信号成分を特定する筋電データ処理装置として機能する。この筋電データ処理部27は、不随意運動時の筋電位の経時的変化を表す不随意波形が複数パターン記憶された記憶手段29と、実際に取得した筋電データの経時的変化を表す取得波形に対し、記憶された複数パターンの不随意波形の中で最も近似する最近似波形を選択し、当該最近似波形と前記取得波形との類似度を求める類似度算出手段30と、最近似波形と類似度に基づき、筋電データの中で不随意運動の信号成分であるノイズが含まれる割合を表す減衰率を求める減衰率算出手段31と、減衰率に基づいて、取得した筋電データから、随意運動に対する信号成分のみで構成される補正筋電データを求めるフィルタリング手段32とにより構成されている。   The myoelectric data processing unit 27 functions as a myoelectric data processing device that estimates a signal component corresponding to involuntary movement from the acquired myoelectric data and identifies a signal component corresponding to voluntary movement. The myoelectric data processing unit 27 includes a storage unit 29 that stores a plurality of patterns of involuntary waveforms representing changes over time in myoelectric potential during involuntary exercise, and acquisition that represents changes over time in actually acquired myoelectric data. A similarity calculation means 30 for selecting the closest approximation waveform among the plurality of patterns of involuntary waveforms stored in the waveform and obtaining the similarity between the approximate waveform and the acquired waveform, and the closest approximation waveform Based on the similarity, attenuation rate calculation means 31 for obtaining an attenuation rate representing the proportion of noise included as a signal component of involuntary movement in myoelectric data, and from the acquired myoelectric data based on the attenuation rate And filtering means 32 for obtaining corrected myoelectric data including only signal components for voluntary movement.

前記記憶手段29には、複数パターンの前記不随意波形とそれら波形をベクトル化した不随意ベクトルが予め記憶されている他、以下の各手段30,31,32での演算に用いる種々の数式が記憶されており、また、所定時間毎のサンプリング周期で取得された筋電データが経時的に記憶されるようになっている。   In the storage means 29, a plurality of patterns of involuntary waveforms and involuntary vectors obtained by vectorizing these waveforms are stored in advance, and various mathematical formulas used for calculation in each of the following means 30, 31, and 32 are stored. In addition, the myoelectric data acquired at a sampling period every predetermined time is stored over time.

図2に示されるように、前記不随意波形Wは、振戦による不随意運動の筋電位の経時的変化を表す周期関数f(x)を仮想的に設定し、当該周期関数f(x)を1周期分切り出した波形となっている。この周期関数f(x)としては、振戦の影響による筋電位の経時的変化に近似し、且つ、筋電位の最高値が1になるπ周期の関数であれば何でも良い。また、実際の振戦患者が不随意運動のみを行っているときの筋電位の時間変化を表す波形を取得し、当該波形を加工し、πの周期を持つように関数化したものを利用してもよい。本実施形態では、周期関数f(x)として、サイン累乗波(例えば、f(x)=sinx)が用いられている。 As shown in FIG. 2, the involuntary waveform W virtually sets a periodic function f (x) representing a time-dependent change in myoelectric potential of involuntary movement due to tremor, and the periodic function f (x). Is a waveform cut out for one period. As the periodic function f (x), any function can be used as long as it approximates the change of the myoelectric potential with time due to the influence of tremor and has a π period in which the maximum value of the myoelectric potential is 1. Also, a waveform representing the time change of myoelectric potential when an actual tremor patient is performing only involuntary movement is acquired, and the waveform is processed and used as a function having a period of π. May be. In the present embodiment, a sine power wave (for example, f (x) = sin 4 x) is used as the periodic function f (x).

この不随意波形Wは、図2及び図3に示されるように、周期関数から1周期分を切り出す際に、その最終位置(最終位相θ)を変えることで、相互に位相がずれた状態の複数の形状の波形が得られる。具体的には、周期関数の1周期分をN等分し、当該等分されたそれぞれの位相が、波形の最終位相θとなるように、周期関数の1周期分の範囲で切り出され、最終位相θがそれぞれ異なるN個の不随意波形が得られる。なお、ここでの等分数Nは、後述する相関係数の演算に用いる筋電データのサンプル数Nと同一に設定され、振戦の周波数Fと、筋電位センサ17による筋電データの取得間隔であるサンプリング周期Δtとにより、以下の数式で予め決定される。

Figure 0005811482
As shown in FIGS. 2 and 3, the involuntary waveform W is a state in which the phases are shifted from each other by changing the final position (final phase θ E ) when cutting out one period from the periodic function. A waveform having a plurality of shapes is obtained. Specifically, one period of the periodic function is divided into N equal parts, and each of the equally divided phases is cut out within a range of one period of the periodic function so as to be the final phase θ E of the waveform. the final phase theta E is respectively N different involuntary waveform obtained. Here, the fraction N is set to be the same as the number N of myoelectric data samples used for calculating a correlation coefficient, which will be described later, and the tremor frequency F and the myoelectric data acquisition interval by the myoelectric potential sensor 17. Is determined in advance by the following mathematical formula.
Figure 0005811482

前記不随意ベクトルは、各不随意波形に対応して記憶手段29に記憶されている。この不随意ベクトルは、不随意波形WにおけるN等分された各位相での筋電位の大きさについて、最終位相θから最初の位相まで遡って順に並べることで得られた要素数N個のベクトルであり、各不随意波形Wにそれぞれについて設定される。 The involuntary vector is stored in the storage means 29 corresponding to each involuntary waveform. This involuntary vector is the number of elements N obtained by arranging the magnitude of the myoelectric potential in each phase divided in N in the involuntary waveform W in order from the final phase θ E to the first phase. It is a vector and is set for each involuntary waveform W.

前記類似度算出手段30では、予め記憶された数式により、各不随意波形Wそれぞれについて、前記取得波形との相関性を表す相関係数が求められた後、相関係数の最大値から類似度が求められる。ここでは、各不随意波形Wのうち相関係数が最大となるものが前記最近似波形として選択されることになり、当該最近似波形は、後述するように、減衰率算出手段31での減衰率の算出に用いられる。   The similarity calculation means 30 obtains a correlation coefficient representing the correlation with the acquired waveform for each involuntary waveform W by using a mathematical formula stored in advance, and then calculates the similarity from the maximum value of the correlation coefficient. Is required. Here, the waveform having the maximum correlation coefficient among the involuntary waveforms W is selected as the most approximate waveform, and the most approximate waveform is attenuated by the attenuation rate calculating means 31 as will be described later. Used to calculate the rate.

前記相関係数は、記憶手段29に記憶された複数の不随意波形Wそれぞれについて、現在の筋電データの取得時から一定時間まで遡って実際に取得した筋電データを用い、次のようにして求められる。   As the correlation coefficient, for each of a plurality of involuntary waveforms W stored in the storage means 29, the myoelectric data actually acquired retroactively from the current acquisition of myoelectric data to a certain time is used as follows. Is required.

先ず、前記一定時間の筋電データをベクトル化した筋電データベクトルが求められる。ここでは、現在の筋電データの取得時を含め前述のサンプル数Nの筋電データが得られるように、現在の筋電データの取得時から、過去(N−1)回前に得られた筋電データまでを使い、当該筋電データを現在から過去に向かって順に並べることで、N個の要素とした筋電データベクトルが求められる。   First, a myoelectric data vector obtained by vectorizing the myoelectric data of the predetermined time is obtained. Here, it was obtained in the past (N-1) times from the time of the current myoelectric data acquisition so that the myoelectric data of the above-mentioned number of samples N including the time of the current myoelectric data acquisition can be obtained. By using up to myoelectric data and arranging the myoelectric data in order from the present to the past, a myoelectric data vector having N elements is obtained.

次に、筋電データベクトルEと、前述したN個の各不随意ベクトルB(m=0,1,2,3・・・・N−1)それぞれとの相関係数Cが以下の式によって求められる。

Figure 0005811482
Next, the correlation coefficient C m between the myoelectric data vector E and each of the N involuntary vectors B m (m = 0, 1, 2, 3,... N−1) described above is It is calculated by the formula.
Figure 0005811482

得られた相関係数Cは、前記取得波形が前記各不随意波形Wにどの程度近似しているかを表す指標となる。 The obtained correlation coefficient C m serves as an index indicating how close the acquired waveform is to each involuntary waveform W.

次に、各相関係数Cの最大値CMAXから、当該最大値CMAXが得られる不随意波形Wに対する前記取得波形との類似度Dが次式により算出される。

Figure 0005811482
なお、上式において、offsetは、筋電データの波形が不随意波形に類似すると判断し得る相関係数Cの閾値に相当する定数であり、aは、当該閾値付近の類似度Dの変化割合を定めるゲインとなる定数である。これら定数は、予め、実際の振戦患者のデータを考慮しながら経験的に定められる。 Next, from the maximum value C MAX of each correlation coefficient C m , the similarity D between the acquired waveform and the involuntary waveform W from which the maximum value C MAX is obtained is calculated by the following equation.
Figure 0005811482
In the above equation, offset is a constant corresponding to the threshold value of the correlation coefficient C m that can be determined that the waveform of myoelectric data is similar to an involuntary waveform, and a is a change in the similarity D in the vicinity of the threshold value. It is a constant that is a gain that determines the ratio. These constants are empirically determined in advance in consideration of actual tremor patient data.

前記減衰率算出手段31では、次式に表されるように、求めた類似度Dと、最大値CMAXが得られた不随意波形における最終位相θでの周期関数の値f(θ)とを乗じることで、取得した筋電データのうち不随意運動に対応する成分の割合を表す減衰率Aが求められる。

Figure 0005811482
In the attenuation factor calculating means 31, as represented in the following equation, and the similarity D determined, the maximum value C MAX of periodic function in the final phase theta E in the resulting involuntary waveform value f (theta E ) To obtain an attenuation rate A that represents the proportion of the component corresponding to involuntary movement in the acquired myoelectric data.
Figure 0005811482

上式(3)、(4)によれば、相関係数Cの最大値CMAXが前記閾値offsetよりも小さい場合、取得した筋電データにノイズが殆ど含まれていないものと判断され、減衰率Aがほぼ0になる。 According to the above formulas (3) and (4), when the maximum value C MAX of the correlation coefficient C m is smaller than the threshold value offset, it is determined that the acquired myoelectric data contains almost no noise, The attenuation factor A is almost zero.

前記フィルタリング手段32では、減衰率算出手段31で求めた減衰率Aを次式に代入することによって、時刻t=nの際に得られた筋電データeから、随意運動に対応する成分のみを抽出した補正筋電データSが得られる。

Figure 0005811482
In the filtering unit 32, by substituting the attenuation factor A obtained in the attenuation rate calculating unit 31 to the following equation, from the EMG data e n obtained at time t = n, only the component corresponding to the voluntary movement correction electromyogram data S n obtained by extracting to obtain.
Figure 0005811482

この補正筋電データSは、筋電データeが得られる都度、前述の手順で求められる。 The correction EMG data S n is each time myoelectric data e n is obtained, is obtained in the previous step.

前記指令部28では、得られた補正筋電データSに応じてモータ15の駆動量が決定され、当該駆動量が得られるようにモータ15に指令信号が送られる。 In the instruction unit 28, it determines the driving amount of the motor 15 in accordance with the obtained correction electromyographic data S n, the command signal to the motor 15 as the driving amount is obtained is sent.

以上の構成により、使用者Hが肘関節の屈曲動作をする際に、振戦の影響がある場合には、当該振戦による不随意運動の影響が除去され、随意運動のみが考慮された指令信号に基づいてモータ15が駆動する。その結果、使用者Hの随意運動の意思のみに合致した形でアーム14が動作し、使用者Hの肘関節の屈曲動作支援が行われ、随意運動に混在する不随意運動は、アーム14の動作に反映されないことになる。一方、使用者Hが随意運動を行わずに振戦が発生している場合は、前述のアルゴリズムにより、筋電位センサ17で得られた筋電データが殆ど不随意運動のものと推定され、モータ15を動作させるための指令信号が殆どなくなる。従って、この場合は、使用者Hの意思通り、モータ15が駆動せず、不随意運動によるアーム14の不意な動作が阻止されることになる。   With the above configuration, when the user H is flexing the elbow joint, if there is a tremor effect, the involuntary movement effect due to the tremor is removed and only the voluntary movement is considered. The motor 15 is driven based on the signal. As a result, the arm 14 is operated in a form that only matches the intention of the user H's voluntary movement, and the user H's elbow joint bending support is performed. It will not be reflected in the operation. On the other hand, when tremor occurs without the user H performing voluntary movement, the myoelectric data obtained by the myoelectric potential sensor 17 is estimated to be almost involuntary movement by the above-described algorithm, and the motor There is almost no command signal for operating 15. Therefore, in this case, as the user H intends, the motor 15 is not driven, and the unexpected movement of the arm 14 due to involuntary movement is prevented.

なお、本発明に係る動作支援装置10は、本態性振戦患者の運動支援に限らず、他の振戦患者への運動支援も可能である他、不随意運動が混在する脳性麻痺等の使用者に対し、随意運動を支援する装置として利用することも可能である。   Note that the motion support device 10 according to the present invention is not limited to exercise support for essential tremor patients but can also support exercise for other tremor patients, and is used for cerebral palsy or the like in which involuntary exercise is mixed. It can also be used as a device that supports voluntary movements for the person.

また、前記実施形態では、装具11を腕部に取り付け、腕部の運動支援を行うことを目的としているが、本発明はこれに限らず、脚部等の他の体部位に取り付け、当該体部位の運動支援を行う動作支援装置10とすることもできる。要するに、本発明の動作支援装置10は、関節によって動作する種々の体部位の運動支援が可能となる。   In the above-described embodiment, the orthosis 11 is attached to the arm and the exercise of the arm is supported. However, the present invention is not limited to this, and the body 11 is attached to another body part such as a leg. It can also be set as the operation | movement assistance apparatus 10 which performs the exercise | movement assistance of a site | part. In short, the motion support apparatus 10 of the present invention can support exercise of various body parts that are operated by joints.

更に、前記筋電データ処理部27は、動作支援装置10の制御装置12の一部として組み込まれているが、本発明はこれに限らず、筋電データ処理装置として独立させ、筋電データのうち随意運動に対応した信号成分或いは不随意運動に対応した信号成分を抽出し、当該抽出した補正筋電データを他の装置に供給可能にすることもできる。   Furthermore, although the myoelectric data processing unit 27 is incorporated as a part of the control device 12 of the motion support device 10, the present invention is not limited to this, and the myoelectric data processing unit 27 is made independent as a myoelectric data processing device. Among them, a signal component corresponding to voluntary movement or a signal component corresponding to involuntary movement can be extracted, and the extracted corrected myoelectric data can be supplied to another device.

その他、本発明における装置各部の構成は図示構成例に限定されるものではなく、実質的に同様の作用を奏する限りにおいて、種々の変更が可能である。   In addition, the configuration of each part of the apparatus in the present invention is not limited to the illustrated configuration example, and various modifications are possible as long as substantially the same operation is achieved.

10 動作支援装置
11 装具
12 制御装置
14 アーム
15 モータ(駆動手段)
17 筋電センサ
27 筋電データ処理部(筋電データ処理装置)
28 指令部
29 記憶手段
30 類似度算出手段
31 減衰率算出手段
32 フィルタリング手段
H 使用者(対象者)
W 不随意波形
DESCRIPTION OF SYMBOLS 10 Operation | movement assistance apparatus 11 Equipment 12 Control apparatus 14 Arm 15 Motor (drive means)
17 Myoelectric Sensor 27 Myoelectric Data Processing Unit (Myoelectric Data Processing Device)
28 Command unit 29 Storage means 30 Similarity calculation means 31 Attenuation rate calculation means 32 Filtering means H User (subject)
W Involuntary waveform

Claims (6)

対象者の筋電位に関する筋電データの中から、前記対象者が意図しない不随意運動に対応する信号成分を推定して、前記対象者が意図する随意運動に対応する信号成分を特定する筋電データ処理装置であって、
前記不随意運動時の筋電位の経時的変化を表す周期関数を仮想的に設定し、当該周期関数を一定周期分切り出した波形からなる不随意波形について、前記周期関数から一定周期分切り出す際に、その最終位相を変えることで、相互に位相がずれた状態の複数の形状の波形が記憶された記憶手段と、前記対象者から取得した前記筋電データの経時的変化を表す取得波形に対し、前記各不随意波形の中で最も近似する最近似波形を選択し、当該最近似波形と前記取得波形との類似度を演算により求める類似度算出手段と、前記最近似波形と前記類似度に基づき、前記筋電データの中で前記不随意運動の信号成分が含まれる割合を表す減衰率を求める減衰率算出手段と、前記減衰率に基づき、取得した前記筋電データを前記各信号成分に分けるフィルタリング手段とを備えたことを特徴とする筋電データ処理装置。
The myoelectricity which estimates the signal component corresponding to the involuntary movement which the said subject does not intend from the myoelectric data regarding the subject's myoelectric potential, and specifies the signal component corresponding to the involuntary movement which the said subject intends A data processing device,
When a periodic function representing a time-dependent change in myoelectric potential during the involuntary movement is virtually set, and an involuntary waveform including a waveform obtained by cutting out the periodic function for a certain period is cut out from the periodic function by a certain period By changing the final phase, the storage means for storing waveforms having a plurality of shapes that are out of phase with each other, and the acquired waveform representing the change over time of the myoelectric data acquired from the subject A similarity calculation means for selecting a closest approximation waveform among the involuntary waveforms and calculating a similarity between the closest approximation waveform and the acquired waveform, and calculating the similarity between the closest approximation waveform and the similarity. Based on the attenuation rate calculation means for obtaining an attenuation rate representing the proportion of the involuntary movement signal component included in the myoelectric data, and the acquired myoelectric data based on the attenuation rate as each signal component Fi Myoelectric data processing apparatus characterized by comprising a Taringu means.
前記類似度算出手段では、予め記憶された数式により、前記各不随意波形それぞれについて、前記取得波形との相関性を表す相関係数が求められた後、当該相関係数が最大となるものを前記最近似波形として選択し、前記相関係数の最大値を予め記憶された数式に代入することにより、前記類似度が求められることを特徴とする請求項1記載の筋電データ処理装置。   In the similarity calculation means, a correlation coefficient representing the correlation with the acquired waveform is obtained for each involuntary waveform by a mathematical formula stored in advance, and then the correlation coefficient is maximized. 2. The myoelectric data processing device according to claim 1, wherein the similarity is obtained by selecting as the most approximate waveform and substituting the maximum value of the correlation coefficient into a mathematical formula stored in advance. 前記減衰率算出手段では、前記相関係数の最大値が予め設定した閾値よりも小さい場合、取得した前記筋電データに前記不随意運動に対応する信号成分が殆ど含まれていないものと判断し、前記減衰率をほぼ0にすることを特徴とする請求項2記載の筋電データ処理装置。   In the attenuation rate calculation means, when the maximum value of the correlation coefficient is smaller than a preset threshold value, it is determined that the acquired myoelectric data contains almost no signal component corresponding to the involuntary movement. The myoelectric data processing device according to claim 2, wherein the attenuation rate is set to approximately zero. 前記取得波形は、前記筋電位データの現在の取得時から遡って一定時間前までに取得した筋電データの経時的変化を表し、
前記減衰率算出手段では、前記類似度に前記最近似波形の最終位相の値を乗じて前記減衰率を算出することを特徴とする請求項1、2又は3記載の筋電データ処理装置。
The acquired waveform represents a change over time of myoelectric data acquired up to a certain time before the current acquisition of the myoelectric potential data,
4. The myoelectric data processing device according to claim 1, wherein the attenuation rate calculating means calculates the attenuation rate by multiplying the similarity by a value of a final phase of the most approximate waveform.
対象者の筋電位に関する筋電データの中から、前記対象者が意図しない不随意運動に対応する信号成分を推定して、前記対象者が意図する随意運動に対応する信号成分を特定する筋電データ処理装置を構成するコンピュータを機能させるためのプログラムにおいて、
前記不随意運動時の筋電位の経時的変化を表す周期関数を仮想的に設定し、当該周期関数を一定周期分切り出した波形からなる不随意波形について、前記周期関数から一定周期分切り出す際に、その最終位相を変えることで、相互に位相がずれた状態の複数の形状の波形が記憶された記憶手段と、前記対象者から取得した前記筋電データの経時的変化を表す取得波形に対し、前記各不随意波形の中で最も近似する最近似波形を選択し、当該最近似波形と前記取得波形との類似度を演算により求める類似度算出手段と、前記最近似波形と前記類似度に基づき、前記筋電データの中で前記不随意運動の信号成分が含まれる割合を表す減衰率を求める減衰率算出手段と、前記減衰率に基づき、取得した前記筋電データを前記各信号成分に分けるフィルタリング手段として前記コンピュータを機能させることを特徴とする筋電データ処理装置のプログラム。
The myoelectricity which estimates the signal component corresponding to the involuntary movement which the said subject does not intend from the myoelectric data regarding the subject's myoelectric potential, and specifies the signal component corresponding to the involuntary movement which the said subject intends In a program for causing a computer constituting a data processing apparatus to function,
When a periodic function representing a time-dependent change in myoelectric potential during the involuntary movement is virtually set, and an involuntary waveform including a waveform obtained by cutting out the periodic function for a certain period is cut out from the periodic function by a certain period By changing the final phase, the storage means for storing waveforms having a plurality of shapes that are out of phase with each other, and the acquired waveform representing the change over time of the myoelectric data acquired from the subject A similarity calculation means for selecting a closest approximation waveform among the involuntary waveforms and calculating a similarity between the closest approximation waveform and the acquired waveform, and calculating the similarity between the closest approximation waveform and the similarity. Based on the attenuation rate calculation means for obtaining an attenuation rate representing the proportion of the involuntary movement signal component included in the myoelectric data, and the acquired myoelectric data based on the attenuation rate as each signal component Fi Program myoelectric data processing apparatus for causing the computer to function as Taringu means.
使用者の関節付近に装着され、当該関節による体部位の運動を支援可能に動作する装具と、当該装具による動作を制御する制御装置とを備え、前記装具の動作により前記使用者の動作支援を行う装置であって、
前記装具は、前記体部位の運動方向のみに動作可能なアームと、当該アームを動作させる駆動手段と、前記体部位の動作を行う筋肉部分の皮膚表面に装着され、前記筋肉部分の筋電位に関する筋電データを取得する筋電位センサとを備え、
前記制御装置は、前記筋電位センサで得られた前記筋電データから、前記使用者が意図しない不随意運動の影響によるノイズを除去する筋電データ処理部と、当該筋電データ処理部で処理された後の補正筋電データに基づき、前記駆動手段の駆動を指令する指令部とを備え、
前記筋電データ処理部は、前記不随意運動時の筋電位の経時的変化を表す周期関数を仮想的に設定し、当該周期関数を一定周期分切り出した波形からなる不随意波形について、前記周期関数から一定周期分切り出す際に、その最終位相を変えることで、相互に位相がずれた状態の複数の形状の波形が記憶された記憶手段と、前記使用者から取得した前記筋電データの経時的変化を表す取得波形に対し、前記各不随意波形の中で最も近似する最近似波形を選択し、当該最近似波形と前記取得波形との類似度を演算により求める類似度算出手段と、前記最近似波形と前記類似度に基づき、前記筋電データの中で前記ノイズが含まれる割合を表す減衰率を求める減衰率算出手段と、前記減衰率に基づいて、取得した前記筋電データから前記補正筋電データを求めるフィルタリング手段とを備えたことを特徴とする動作支援装置。
A brace that is mounted near the user's joint and operates to support the movement of the body part by the joint; and a control device that controls the movement of the brace, and supports the operation of the user by the movement of the brace. A device for performing
The brace is mounted on the skin surface of a muscle part that operates the arm part, an arm that can be operated only in the movement direction of the body part, a driving unit that operates the arm, and the body part, and relates to the myoelectric potential of the muscle part A myoelectric potential sensor for acquiring myoelectric data,
The control device includes a myoelectric data processing unit that removes noise due to an involuntary movement unintended by the user from the myoelectric data obtained by the myoelectric potential sensor, and a process performed by the myoelectric data processing unit. A command unit for commanding driving of the driving means based on the corrected myoelectric data after being performed,
The myoelectric data processing unit virtually sets a periodic function representing a time-dependent change in myoelectric potential during the involuntary movement , and for the involuntary waveform including a waveform obtained by cutting out the periodic function for a certain period , the period When cutting out a certain period from the function, by changing the final phase, storage means storing waveforms having a plurality of shapes that are out of phase with each other, and the time course of the myoelectric data acquired from the user A similarity calculation means for selecting the most approximate waveform that is most approximated among the involuntary waveforms for the acquired waveform that represents a change, and calculating the similarity between the most approximate waveform and the acquired waveform; and Based on the recently similar waveform and the similarity, attenuation rate calculating means for obtaining an attenuation rate that represents the ratio of the noise in the myoelectric data, and based on the attenuation rate, the acquired myoelectric data Correction myoelectric Operation support apparatus characterized by comprising a filtering means for obtaining the chromatography data.
JP2011184380A 2011-08-26 2011-08-26 EMG data processing device, program thereof, and operation support device Active JP5811482B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2011184380A JP5811482B2 (en) 2011-08-26 2011-08-26 EMG data processing device, program thereof, and operation support device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2011184380A JP5811482B2 (en) 2011-08-26 2011-08-26 EMG data processing device, program thereof, and operation support device

Publications (2)

Publication Number Publication Date
JP2013043028A JP2013043028A (en) 2013-03-04
JP5811482B2 true JP5811482B2 (en) 2015-11-11

Family

ID=48007398

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2011184380A Active JP5811482B2 (en) 2011-08-26 2011-08-26 EMG data processing device, program thereof, and operation support device

Country Status (1)

Country Link
JP (1) JP5811482B2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112691002A (en) * 2021-03-24 2021-04-23 上海傅利叶智能科技有限公司 Control method and device based on gesture interaction rehabilitation robot and rehabilitation robot

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5352801B2 (en) * 2008-11-11 2013-11-27 国立大学法人三重大学 Noise removing device, noise removing method, and motion correcting device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112691002A (en) * 2021-03-24 2021-04-23 上海傅利叶智能科技有限公司 Control method and device based on gesture interaction rehabilitation robot and rehabilitation robot
CN112691002B (en) * 2021-03-24 2021-06-29 上海傅利叶智能科技有限公司 Control device based on gesture interaction rehabilitation robot and rehabilitation robot

Also Published As

Publication number Publication date
JP2013043028A (en) 2013-03-04

Similar Documents

Publication Publication Date Title
Zhou et al. Development of a wearable tremor suppression glove
Mulas et al. An EMG-controlled exoskeleton for hand rehabilitation
Bouteraa et al. Design and control of an exoskeleton robot with EMG-driven electrical stimulation for upper limb rehabilitation
WO2010140975A1 (en) A system and method for motor learning
JP6340528B2 (en) BMI exercise assist device
JP5439921B2 (en) Tremor control device
WO2017062755A1 (en) Wearable and functional hand orthotic
US20160303369A1 (en) Neuroprosthetic System Restoring Upper Limb Function Through Coordinated Electrical Stimulation
Huen et al. An integrated wearable robot for tremor suppression with context aware sensing
Simonetti et al. Multimodal adaptive interfaces for 3D robot-mediated upper limb neuro-rehabilitation: An overview of bio-cooperative systems
JP6110657B2 (en) Motion support system, voluntary movement recognition device, and voluntary movement recognition program
Shen et al. Admittance control scheme comparison of EXO-UL8: A dual-arm exoskeleton robotic system
JP5352801B2 (en) Noise removing device, noise removing method, and motion correcting device
Ertas et al. Finger exoskeleton for treatment of tendon injuries
JP5467268B2 (en) Involuntary movement suppression system, movement recognition apparatus, and movement recognition apparatus program
Popp et al. Effect of handle design on movement dynamics and muscle co-activation in a wrist flexion task
JP5811482B2 (en) EMG data processing device, program thereof, and operation support device
Irimia et al. Controlling a FES-EXOSKELETON rehabilitation system by means of brain-computer interface
CN106389066A (en) A finger-parted rehabilitation training instrument
Becker et al. Comparison of muscular activity and movement performance in robot-assisted and freely performed exercises
Decker et al. A hand exoskeleton device for robot assisted sensory-motor training after stroke
Ohara et al. Tremor suppression control of meal-assist robot with adaptive filter
US20240082533A1 (en) System for functional rehabilitation and/or pain rehabilitation due to sensorimotor impairment
Popescu et al. Intelligent Haptic Robotic Glove for patients diagnosed with cerebrovascular accidents
Simonetti et al. Reprint of “Multimodal adaptive interfaces for 3D robot-mediated upper limb neuro-rehabilitation: An overview of bio-cooperative systems”

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20140808

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20140808

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20150520

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20150528

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20150724

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20150813

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20150904

R150 Certificate of patent or registration of utility model

Ref document number: 5811482

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250