JPH1024643A - Checking of photographic image and checking device - Google Patents
Checking of photographic image and checking deviceInfo
- Publication number
- JPH1024643A JPH1024643A JP8182181A JP18218196A JPH1024643A JP H1024643 A JPH1024643 A JP H1024643A JP 8182181 A JP8182181 A JP 8182181A JP 18218196 A JP18218196 A JP 18218196A JP H1024643 A JPH1024643 A JP H1024643A
- Authority
- JP
- Japan
- Prior art keywords
- image
- defective
- pattern
- determination condition
- normal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Accessory Devices And Overall Control Thereof (AREA)
- Character Discrimination (AREA)
Abstract
Description
【０００１】[0001]
【発明の属する技術分野】本発明は、インクジェットプ
リンター等で捺印された賞味期限等の文字に発生する文
字の汚れ、欠けの有無を自動検査する方法及び装置に関
する。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and an apparatus for automatically inspecting the presence or absence of a stain or a chip on a character such as a "best-before date" stamped by an ink-jet printer or the like.
【０００２】[0002]
【従来の技術】薬品、食品製造ラインでは、賞味期限等
をインクジェットプリンタによって捺印する例がある。
捺印文字の汚れた欠けがあるために捺印検査を行う。こ
の検査では、ビデオカメラ等の撮像装置を使って画像を
取り込み、あらかじめ登録した正常パターンとの照合検
査によって捺印文字の汚れ、欠けを自動検査する。2. Description of the Related Art In a pharmaceutical or food production line, there is an example in which the expiration date and the like are marked by an ink jet printer.
The seal test is performed because the seal characters are dirty and missing. In this inspection, an image is captured using an image pickup device such as a video camera, and a seal character is automatically inspected for dirt or chipping by a collation inspection with a normal pattern registered in advance.
【０００３】[0003]
【発明が解決しようとする課題】上記捺印検査法は正常
パターンをあらかじめ登録しておき入力パターンとの照
合を行い類似度を求めたうえで正常、不良を判定する方
式を採用する。然るに、画像処理装置で判断された結果
が目視検査と異なるという問題が発生した。正常不良文
字の状態が異なり不良文字を判定するための判定パラメ
ータを設定するのが困難なため、及び一旦設定したとし
ても、不良と判定した画像が残っていないため最適なパ
ラメータを設定できないためである。The above-described seal inspection method employs a method of registering a normal pattern in advance, collating the pattern with an input pattern, obtaining a degree of similarity, and determining whether the pattern is normal or defective. However, there is a problem that the result determined by the image processing apparatus is different from the result of the visual inspection. This is because it is difficult to set a determination parameter for determining a defective character because the state of a normal defective character is different, and even if it is set, an optimal parameter cannot be set because no image determined to be defective remains. is there.
【０００４】本発明の目的は目視検査に近い最適な判定
パラメータを設定可能な画像検査方法及び装置を提供す
ることにある。An object of the present invention is to provide an image inspection method and apparatus capable of setting an optimum judgment parameter close to a visual inspection.
【０００５】[0005]
【課題を解決するための手段】上記問題を解決するため
に本発明では、撮像装置から入力した画像を一旦画像記
憶手段に取り込み辞書パターンとの照合検査を実施した
後、あらかじめ指定した判定条件に基づいて不良として
判定した場合、取り込んだ画像を自動退避するようにし
た。According to the present invention, in order to solve the above-mentioned problem, an image input from an image pickup device is temporarily taken into an image storage means and checked against a dictionary pattern. When it is determined that the image is defective, the captured image is automatically retracted.
【０００６】次に自動退避した画像を画像処理用の画像
記憶手段に転送し判定条件を変えて再検査できるように
した。また、自動退避した複数の画像を判定条件を変え
て目視検査と一致するまで連続検査できるようにした。Next, the automatically evacuated image is transferred to an image processing means for image processing so that the image can be inspected again by changing the judgment conditions. Further, it is possible to continuously inspect a plurality of automatically evacuated images until the images match the visual inspection by changing the determination conditions.
【０００７】上記手段により不良と判定した画像情報を
判定条件を変えて再度検査可能なため、あらかじめ厳し
い判定条件を設定しておき、文字自体の変動を考慮した
最適な判定条件が設定できる。また不良発生状況の確認
も可能となる。[0007] Since the image information determined to be defective by the above means can be inspected again by changing the determination conditions, strict determination conditions can be set in advance, and optimal determination conditions can be set in consideration of variations in characters themselves. In addition, it is possible to check the status of occurrence of defects.
【０００８】[0008]
【発明の実施の形態】以下本発明の一実施の形態を図に
より説明する。図１は、本発明のパターン検査装置の全
体構成図を示す図である。ビデオカメラ等の撮像装置１
からの映像信号はパターン検査装置２における画像記憶
手段２１に入力し、パターン判定手段２２によって、判
定条件入力手段３と辞書記憶手段２３に基づいて検査を
実施して良否を判定し、認識結果出力手段２４により外
部出力する。不良と判定した場合、自動的に画像退避手
段２５に不良画像を退避蓄積する。DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing an overall configuration diagram of a pattern inspection apparatus of the present invention. Imaging device 1 such as a video camera
Is input to the image storage means 21 of the pattern inspection apparatus 2, the pattern determination means 22 performs an inspection based on the determination condition input means 3 and the dictionary storage means 23 to determine pass / fail, and outputs a recognition result. It is externally output by means 24. If it is determined to be defective, the defective image is automatically saved and stored in the image saving means 25.
【０００９】図２は、パターン検査装置内における退避
手段２５に係わる画像退避処理の全体処理フローで、撮
像装置１の映像信号は画像入力処理１０１で入力され、
パターン判定手段２２によるパターン判定処理１０２で
辞書とのパターン照合（１０３）を実施する。この照合
によって正常不良を判定し、正常と判定した場合に、正
常信号を出力（１０４）し、不良と判定した場合に画像
退避処理１０５で不良画像を退避し不良信号を出力（１
０６）する。FIG. 2 is an overall processing flow of an image saving process related to the saving means 25 in the pattern inspection apparatus. A video signal of the imaging device 1 is input in an image input process 101.
In the pattern judgment processing 102 by the pattern judgment means 22, pattern matching (103) with the dictionary is performed. A normal failure is determined by this collation, and if it is determined to be normal, a normal signal is output (104), and if it is determined to be defective, the defective image is saved by the image saving processing 105 and a defective signal is output (1).
06).
【００１０】退避画像については、その都度又は一連の
退避画像がそろった段階で判定条件（判定パラメータ）
を更新しながらその都度、この更新した判定パラメータ
で再パターン判定処理を行って目視結果に一致するよう
な判定条件を見つける。かかる退避画像の再パターン判
定処理フローを図３を用いて説明する。With respect to the save image, a judgment condition (judgment parameter) is set each time or when a series of save images are prepared.
Each time is updated, a re-pattern determination process is performed using the updated determination parameters to find a determination condition that matches the visual result. The flow of the re-save image re-pattern determination process will be described with reference to FIG.
【００１１】退避画像手段（２５）の退避画像用の判定
条件変更処理（２０１）を行う。判定条件とは、退避処
理時の判定処理（図２の処理１０２又は処理２０３）で
使った判定条件を指す。退避処理を判定したときの判定
条件を変更することで再退避処理を回避できるか否かを
再試行させるためである。変更後の新しい判定条件で、
読み出した退避画像（処理２０２による）のパターン判
定処理を行う（２０３）。この処理（２０２、２０３）
は全退避画像について行う（２０４）。全画像について
のパターン判定処理終了後に、目視結果と一致するか否
かをチェックする（２０５）。目視結果と一致とは、退
避画像を人間が表示画面上で見て、正常／不良を判断し
た結果と、パターン判定処理結果が一致することを指
す。そして退避画像に対しての人間による正常／不良の
判断とパターン判定処理結果が一致しないとき「不一
致」であると判定し、判定条件変更処理２０１へ移る。
更に判定条件変更を何回か行っても目視結果との間で不
一致があれば処理不能とする。[0011] A decision condition changing process (201) for the saved image by the saved image means (25) is performed. The determination condition refers to the determination condition used in the determination process (the process 102 or 203 in FIG. 2) at the time of the evacuation process. This is for retrying whether or not the re-evacuation process can be avoided by changing the determination condition when the evacuation process is determined. In the new judgment condition after the change,
A pattern determination process for the read saved image (by the process 202) is performed (203). This process (202, 203)
Is performed for all saved images (204). After the pattern determination processing for all the images is completed, it is checked whether or not they match the visual result (205). The match with the visual result indicates that the result of the normal / defective judgment by the human viewing the save image on the display screen matches the result of the pattern judgment processing. When the result of the pattern determination processing does not match the result of the pattern determination processing performed by the human on the saved image, it is determined to be “mismatch”, and the process proceeds to the determination condition change processing 201.
Further, even if the determination condition is changed several times, if there is a mismatch with the visual result, the processing cannot be performed.
【００１２】図４にはパターン判定処理（図２の処理２
０２）の例を示す。数字「１」が入力パターンの例であ
り、これと辞書パターン上での数字「１」とを照合する
（２０６）。照合の結果、両者の差異（不一致）を見つ
ける。即ち、ステップ２０７では、辞書パターンにあっ
て入力パターンにないパターン部分Ｓ1（欠けパター
ン）、ステップ２０７では、辞書パターンになくて入力
パターンにあるパターン部分Ｓ2（しみパターン）を検
出する。次にステップ２０９で辞書パターンと入力パタ
ーンとの類似度γを次式で算出する。FIG. 4 shows a pattern determination process (process 2 in FIG. 2).
02). The numeral "1" is an example of the input pattern, and the numeral is compared with the numeral "1" on the dictionary pattern (206). As a result of the comparison, a difference (mismatch) between the two is found. That is, in step 207, a pattern portion S 1 (missing pattern) that is in the dictionary pattern and not in the input pattern is detected, and in step 207, a pattern portion S 2 (spot pattern) that is not in the dictionary pattern but in the input pattern is detected. Next, in step 209, the similarity γ between the dictionary pattern and the input pattern is calculated by the following equation.
【数１】γ＝｛ａ−（ｂα＋ｃβ）｝／ａ ここで ａ…比較対象の切り出し領域の正規化サイズ
（通常ｍ＝ｎ＝８のマトリクスに正規化する。これは切
り出し領域のサイズにかかわらず、サンブリングして正
規化される） ｂ…欠けパターンＳ1の面積 ｃ…しみパターンＳ2の面積 α…カケの重み係数 β…しみの重み係数Γ = {a− (bα + cβ)} / a where a is the normalized size of the cut-out area to be compared (normally normalized to a matrix of m = n = 8. This is independent of the size of the cut-out area. B: area of the missing pattern S 1 c: area of the stain pattern S 2 α: weight coefficient of the chip β: weight coefficient of the stain
【００１３】ステップ２１０では、類似度γと基準値γ
1とを比較し、γ≧γ1であれば正常と判定し、γ＜γ1
であれば不良と判定して退避処理を行う。In step 210, the similarity γ and the reference value γ
Comparing 1 and determines as normal if γ ≧ γ 1, γ <γ 1
If so, it is determined to be defective and the evacuation process is performed.
【００１４】図５には、退避画像の再パターン判定処理
例を示す。入力パターン“１”の例であって、ｍ個の異
なる入力パターンが退避画像である。かかる各入力パタ
ーン１〜ｍに対して判定条件を変更しながら、その都度
辞書パターンとの間でパターン判定処理（３０２）を行
う。FIG. 5 shows an example of a re-pattern determination process for a saved image. This is an example of the input pattern “1”, and m different input patterns are save images. While changing the determination conditions for each of the input patterns 1 to m, a pattern determination process (302) is performed with the dictionary pattern each time.
【００１５】ここで、判定条件とは、図４の例では、パ
ラメータγ1、α、βの３つである。かかる３つのパラ
メータγ1、α、βをγ11、α1、β1としたのが判定条
件１、γ12、α2、β2としたのが判定条件２である。こ
のように、判定条件１→２→３・・・と変更しながら正
常、不良を判定する。図５では判定条件ｎ（γ1n、
αn、βn）で全てが目視検査と一致したことがわかる。
そして、以降の検査では、入力パターン“１”に対して
は判定条件ｎを使って判定する。Here, in the example of FIG. 4, the determination conditions are three parameters γ 1 , α, and β. The three parameters γ 1 , α, and β are determined as γ 11 , α 1 , and β 1 , and the determination condition 1 is determined as γ 12 , α 2 , and β 2 . In this manner, normal and defective are determined while changing the determination conditions 1 → 2 → 3. In FIG. 5, the determination condition n (γ 1n ,
α n , β n ) indicate that all were consistent with the visual inspection.
Then, in the subsequent inspection, the input pattern “1” is determined using the determination condition n.
【００１６】尚、図５の判定条件１→２→３・・・と更
新中に、辞書パターンを別の辞書パターンに変更するこ
ともある。数“１”の中に、いくつかの辞書パターンを
持つ例に対処するためである。It should be noted that the dictionary pattern may be changed to another dictionary pattern while updating the determination conditions 1 → 2 → 3... In FIG. This is to deal with an example in which some dictionary patterns are included in the number “1”.
【００１７】（数１）は判定式の一例である。従って、
判定パラメータγ1、α、βも一例である。(Equation 1) is an example of a judgment formula. Therefore,
The determination parameters γ 1 , α, and β are also examples.
【００１８】かくて求めた新しい判定条件を、図１のパ
ターン判定手段にセットし、以降の検査用に使用する。
一般に、パターンは数個の文字や数字より成るため、そ
の各構成文字や数字ごとに、退避画像から新しい判定条
件を求める。また、文字や数字ではなく画像パターンの
例もあれば、複数の文字や数字のまとまりについて、一
括してパターン判定する例もある。こうした画像パター
ンや一括まとまりパターンに対しても、前記実施の態様
と同じように新しい判定条件を更新するやり方を取るこ
ともできる。The new determination conditions thus obtained are set in the pattern determination means of FIG. 1 and used for the subsequent inspection.
In general, since a pattern is composed of several characters and numerals, a new determination condition is obtained from the save image for each of the constituent characters and numerals. In addition, there is an example of an image pattern instead of a character or a number, and there is also an example of pattern determination for a group of a plurality of characters or numbers at a time. For such an image pattern or a batch pattern, a new determination condition can be updated in the same manner as in the above embodiment.
【００１９】[0019]
【発明の効果】本発明によれば、不良画像を退避してい
るために不良発生時の要因を分析することが可能とな
る。また、一度不良と判定した画像パターンでも判定条
件を再度変えて検査可能なため最適な判定条件が設定可
能となり目視検査に近い検査が可能となる。According to the present invention, it is possible to analyze a factor at the time of occurrence of a defect because the defective image is retracted. In addition, even for an image pattern that has once been determined to be defective, inspection can be performed by changing the determination conditions again, so that optimum determination conditions can be set, and an inspection close to a visual inspection can be performed.
【図１】本発明の全体構成図である。FIG. 1 is an overall configuration diagram of the present invention.
【図２】画像退避処理の全体処理フローである。FIG. 2 is an overall processing flow of an image save processing.
【図３】退避画像の再パターン判定処理フロー図であ
る。FIG. 3 is a flowchart of a re-pattern determination process for a saved image.
【図４】パターン判定処理の例図である。FIG. 4 is an example diagram of a pattern determination process.
【図５】退避画像の再パターン判定処理例図である。FIG. 5 is a diagram illustrating an example of a re-pattern determination process for a save image.
１ 撮像装置 ２ パターン検査装置 ３ 判定条件入力手段 ２１ 画像記憶手段 ２２ パターン判定手段 ２３ 辞書記憶手段 ２４ 判定処理部 ２５ 画像退避手段 REFERENCE SIGNS LIST 1 imaging device 2 pattern inspection device 3 determination condition input means 21 image storage means 22 pattern determination means 23 dictionary storage means 24 determination processing unit 25 image saving means
Claims (7)
像を撮像し、捺印の良否を基準判定条件で判定し、不良
と判定した画像を格納しておき、この格納した不良画像
について更新した判定条件で良否を判定し、正常であれ
ばこの更新した判定条件を基準判定条件に設定して、そ
の後の撮像した画像の良否を判定する撮像画像の検査方
法。1. An image of a seal character or the like of a conveyed object on a production line is taken, the quality of the seal is determined based on a reference determination condition, the image determined to be defective is stored, and the stored defective image is updated. A quality inspection is performed based on the determined determination condition, and if the quality is normal, the updated determination condition is set as a reference determination condition, and thereafter, the quality of the captured image is determined.
示しておき、この表示画像を作業者の目視による良否の
判断に一致するまで判定条件の更新を行い、目視による
良否の判断に一致した際の判定条件を基準判定条件とす
るものとした請求項１の撮像画像の検査方法。2. In the updating of the judgment condition, a defective image is displayed, and the judgment condition is updated until the displayed image matches the judgment of the quality by the visual inspection of an operator. 2. The method for inspecting a picked-up image according to claim 1, wherein the determination condition at the time of performing is set as a reference determination condition.
ンとの不一致の面積の重み付け及び良否の判定基準値と
より成る類似度とし、更新は重み付け及び判定基準値と
変更するものとした請求項１又は２の撮像画像の検査方
法。3. The method according to claim 2, wherein the determination condition is a similarity comprising weighting of an area of mismatch between the input image and the dictionary pattern and a determination reference value of pass / fail, and updating is changed to the weighting and determination reference value. Inspection method of 1 or 2 captured images.
画像の記憶手段と、この入力画像と辞書パターンとの照
合による正常、不良の判定手段と、不良と判定した画像
の自動退避手段と、を設けたことを特徴とする撮像画像
の検査装置。4. An image pickup device, a storage unit for an image input from the image pickup device, a normal / defective judging unit by comparing the input image with a dictionary pattern, and an automatic evacuation unit for an image judged to be defective. An inspection device for a picked-up image, comprising:
の記憶手段と、基準判定条件をもとにしての、この入力
画像と辞書パターンとの照合による正常、不良の判定手
段と、不良と判定した画像の自動退避手段と、自動退避
後の画像に対して、更新した判定条件により、辞書パタ
ーンとの照合による正常、不良の判定し、正常であれば
かかる更新後の判定条件を、上記基準判定条件に代わる
新基準判定条件として設定する設定手段と、より成る撮
像画像の検査装置。5. An imaging device, a storage unit for an image input from the imaging device, a normal / defective judging unit based on a reference judgment condition by comparing the input image with a dictionary pattern, The automatic evacuation means of the determined image and the image after the automatic evacuation are used to determine whether the image is normal or defective by comparing the image with the dictionary pattern according to the updated determination condition. A setting means for setting as a new reference determination condition in place of the reference determination condition;
像を撮像する撮像装置と、撮像装置から入力した画像の
記憶手段と、この入力画像と辞書パターンとを比較し
て、両者の不一致個所の面積割合をもとにした正常、不
良の判定手段と、不良と判定した画像の自動退避手段
と、自動退避後の画像に対して、更新した不一致個所の
面積の重み付けを変更しての類似度により、辞書パター
ンとの照合による正常、不良の判定し、正常であればか
かる更新後の類似度を、上記基準類似度に代わる新基準
類似度として設定する設定手段と、より成る撮像画像の
検査装置。6. An image pickup apparatus for picking up an image such as a seal character of a conveyed article on a production line, a storage unit for an image input from the image pickup apparatus, and comparing the input image with a dictionary pattern. Normal / defective determining means based on the area ratio of the location, automatic saving means for the image determined to be defective, and changing the weight of the area of the updated mismatched area for the image after the automatic saving. Setting means for judging normality or failure by comparing with the dictionary pattern based on the similarity, and setting the similarity after the update as a new reference similarity instead of the reference similarity if normal Inspection equipment.
る表示手段と、目視による良否の判断と一致した時の判
定条件入力手段と、より成る請求項５の撮像画像の検査
装置。7. The captured image inspection apparatus according to claim 5, wherein the setting unit includes a display unit for displaying the image after the evacuation, and a determination condition input unit when the determination is made by visual inspection.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP18218196A JP3455970B2 (en) | 1996-07-11 | 1996-07-11 | Method and apparatus for inspecting captured image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP18218196A JP3455970B2 (en) | 1996-07-11 | 1996-07-11 | Method and apparatus for inspecting captured image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JPH1024643A true JPH1024643A (en) | 1998-01-27 |
| JP3455970B2 JP3455970B2 (en) | 2003-10-14 |
Family
ID=16113766
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP18218196A Expired - Fee Related JP3455970B2 (en) | 1996-07-11 | 1996-07-11 | Method and apparatus for inspecting captured image |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP3455970B2 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2020032571A (en) * | 2018-08-28 | 2020-03-05 | コニカミノルタ株式会社 | Image inspection device, image formation system and image inspection method |
| JP2020044820A (en) * | 2018-09-21 | 2020-03-26 | セイコーエプソン株式会社 | Printer, print control device, and method for controlling printer |
-
1996
- 1996-07-11 JP JP18218196A patent/JP3455970B2/en not_active Expired - Fee Related
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2020032571A (en) * | 2018-08-28 | 2020-03-05 | コニカミノルタ株式会社 | Image inspection device, image formation system and image inspection method |
| JP2020044820A (en) * | 2018-09-21 | 2020-03-26 | セイコーエプソン株式会社 | Printer, print control device, and method for controlling printer |
Also Published As
| Publication number | Publication date |
|---|---|
| JP3455970B2 (en) | 2003-10-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20020168099A1 (en) | Image searching defect detector | |
| JPH03210679A (en) | Method and device for pattern matching | |
| CN113111903A (en) | Intelligent production line monitoring system and monitoring method | |
| JP3533722B2 (en) | Failure inspection method and device | |
| JP2000180374A (en) | Method for detecting defect | |
| CN113780235A (en) | Icon flaw detection method and system | |
| JP2003262593A (en) | Apparatus and method for detection of defect | |
| JPH1024643A (en) | Checking of photographic image and checking device | |
| JPH08101130A (en) | Surface flaw inspecting device | |
| IL178321A (en) | Optical inspection system | |
| KR20070101669A (en) | Apparatus and mathod for vision inspecting of mounting plate assembly | |
| JPH09264856A (en) | Article appearance inspection device | |
| JP4956077B2 (en) | Defect inspection apparatus and defect inspection method | |
| JP2002008029A (en) | Image inspection device | |
| JPH08138049A (en) | Method and device for checking dot character | |
| JP2002036513A (en) | Printed product inspecting device | |
| JP3107264B2 (en) | Printed board inspection method and apparatus and printed board intensive inspection system | |
| JPH0995028A (en) | Printing inspection device | |
| JP2000329594A (en) | Data collection and processing devicde and record medium string program for data collection and processing | |
| JPH0735699A (en) | Method and apparatus for detecting surface defect | |
| JPH09147056A (en) | Method and device for checking appearance of mark | |
| JP3506856B2 (en) | CD printing surface inspection method | |
| JP2000121495A (en) | Screen inspection method | |
| US20230316497A1 (en) | Method for detecting defects in products from images and system employing method | |
| JP4009085B2 (en) | Pattern inspection apparatus and pattern inspection method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
| S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313111 |
|
| R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
| R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20080801 Year of fee payment: 5 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20090801 Year of fee payment: 6 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20100801 Year of fee payment: 7 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20110801 Year of fee payment: 8 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20110801 Year of fee payment: 8 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120801 Year of fee payment: 9 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120801 Year of fee payment: 9 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20130801 Year of fee payment: 10 |
|
| R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
| LAPS | Cancellation because of no payment of annual fees |