JP2001305066A - Appearance inspecting device and illumination method in appearance inspection - Google Patents

Appearance inspecting device and illumination method in appearance inspection

Info

Publication number
JP2001305066A
JP2001305066A JP2000119002A JP2000119002A JP2001305066A JP 2001305066 A JP2001305066 A JP 2001305066A JP 2000119002 A JP2000119002 A JP 2000119002A JP 2000119002 A JP2000119002 A JP 2000119002A JP 2001305066 A JP2001305066 A JP 2001305066A
Authority
JP
Japan
Prior art keywords
brightness
value
illumination
image
command value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2000119002A
Other languages
Japanese (ja)
Other versions
JP4230091B2 (en
Inventor
Keiji Yano
啓司 矢野
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Holdings Corp
Original Assignee
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co Ltd filed Critical Matsushita Electric Industrial Co Ltd
Priority to JP2000119002A priority Critical patent/JP4230091B2/en
Publication of JP2001305066A publication Critical patent/JP2001305066A/en
Application granted granted Critical
Publication of JP4230091B2 publication Critical patent/JP4230091B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

PROBLEM TO BE SOLVED: To provide an appearance inspecting device and an illumination method in appearance inspection, ensuring inspection accuracy by appropriately calibrating the luminosity of a picked-up image. SOLUTION: In this illumination method in appearance inspection for illuminating an image picked-up object of the appearance inspection, the luminosity of a calibration image obtained by picking up the image of a calibration plate 3 by a camera 10 is detected by a luminosity detecting part 21, and a luminosity detection value is compared with a luminosity target value stored in a target value storage part 23 to obtain a correction value of a command value for commanding the luminosity of an illumination part 13, corresponding to an illumination value outputted from an illumination value output means 22. A corrected command value corrected by the correction value is outputted to an illumination control part 12 from a command part 25, and the illumination part 13 is lighted on the basis of the corrected command value. The luminosity of the image obtained by picking up the image can thereby be calibrated appropriately to ensure inspection accuracy in appearance inspection.

Description

【発明の詳細な説明】DETAILED DESCRIPTION OF THE INVENTION

【0001】[0001]

【発明の属する技術分野】本発明は、実装基板などの検
査対象物の外観検査を行う外観検査装置および外観検査
における照明方法に関するものである。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an appearance inspection apparatus for inspecting the appearance of an object to be inspected such as a mounting board and a lighting method in the appearance inspection.

【0002】[0002]

【従来の技術】実装基板の電子部品の実装状態を検査す
る方法として、外観検査が広く用いられている。この外
観検査は、実装基板をカメラで撮像し撮像結果を画像処
理することにより電子部品の実装状態の異常の有無を検
出するものであり、検査項目としては電子部品の有無や
位置ずれなど各種のものがある。
2. Description of the Related Art An appearance inspection is widely used as a method for inspecting a mounting state of electronic components on a mounting board. This appearance inspection is to detect the presence or absence of abnormality in the mounting state of electronic components by imaging the mounting board with a camera and performing image processing on the imaging result. There is something.

【0003】この外観検査において良好な撮像結果を得
るためには、照明条件を適正に設定する必要がある。こ
のため外観検査装置では、照明装置として明るさを可変
とし撮像対象に応じて照明条件を調整することが行われ
る。この照明条件の調整は、所望の明るさに応じてLE
Dなどの照明器を駆動する指令値を変化させるものであ
る。
In order to obtain good imaging results in this visual inspection, it is necessary to properly set illumination conditions. For this reason, in the visual inspection device, the brightness is made variable as an illumination device, and the illumination condition is adjusted according to the imaging target. Adjustment of this lighting condition is performed by LE in accordance with desired brightness.
A command value for driving a lighting device such as D is changed.

【0004】[0004]

【発明が解決しようとする課題】ところが、LEDなど
の照明器は一般に経時変化のために同一の指令値によっ
て点灯される場合においても、累積使用時間などの条件
によって実際に得られる明るさはばらつく。また、撮像
画像から得られる明るさの画像情報は、照明条件のみな
らずカメラなど光学系によっても異なっており、従来の
照明条件のみを調整する方法ではばらつきのない適正な
画像情報を得ることが困難で、検査精度が確保されない
という問題点があった。
However, even when an illuminator such as an LED is generally lit with the same command value due to aging, the brightness actually obtained varies depending on conditions such as the accumulated use time. . In addition, image information of brightness obtained from a captured image differs not only with lighting conditions but also with an optical system such as a camera, and a conventional method of adjusting only lighting conditions can obtain appropriate image information without variation. There is a problem that it is difficult and the inspection accuracy cannot be secured.

【0005】そこで本発明は、撮像画像の明るさを適正
に較正することができ、検査精度を確保することができ
る外観検査装置および外観検査における照明方法を提供
することを目的とする。
Accordingly, an object of the present invention is to provide a visual inspection apparatus and a lighting method in visual inspection capable of appropriately calibrating the brightness of a captured image and securing inspection accuracy.

【0006】[0006]

【課題を解決するための手段】請求項1記載の外観検査
装置は、検査対象物の外観検査を行う外観検査装置であ
って、撮像対象を撮像して画像を取り込む撮像手段と、
撮像対象を照明する照明手段と、照明の所望の明るさを
指示する明るさ指示手段と、撮像により得られた画像の
明るさを検出する明るさ検出部と、前記画像の明るさの
目標値である明るさ目標値と前記明るさ指示手段の指示
出力との相関を示すデータを記憶する明るさ目標値記憶
部と、較正板を撮像して得られた較正用画像の明るさ検
出値を明るさ目標値と比較して前記明るさ指示手段の指
示出力と対応した指令値を補正する補正値を求める明る
さ調整部と、前記明るさ指示手段の指示出力に応じた指
令値を前記補正値により補正して補正後指令値を求め前
記照明手段に出力する照明補正手段とを備えた。
According to a first aspect of the present invention, there is provided a visual inspection apparatus for performing a visual inspection of an object to be inspected.
Illumination means for illuminating an imaging target; brightness instructing means for instructing desired brightness of illumination; a brightness detection unit for detecting the brightness of an image obtained by imaging; and a target value of brightness of the image A brightness target value storage unit that stores data indicating a correlation between the brightness target value and the instruction output of the brightness instruction unit, and a brightness detection value of a calibration image obtained by imaging the calibration plate. A brightness adjustment unit that obtains a correction value for correcting a command value corresponding to an instruction output of the brightness instruction means by comparing with a brightness target value; and correcting the command value corresponding to the instruction output of the brightness instruction means. And a lighting correction means for obtaining a corrected command value by correcting with a value and outputting the corrected command value to the lighting means.

【0007】請求項2記載の外観検査装置は、検査対象
物の外観検査を行う外観検査装置であって、撮像対象を
撮像して画像を取り込む撮像手段と、撮像対象を照明す
る照明手段と、照明の所望の明るさを指示する明るさ指
示手段と、撮像により得られた画像の明るさを検出する
明るさ検出部と、前記画像の明るさの目標値である明る
さ目標値と前記明るさ指示手段の指示出力との相関を示
すデータを記憶する明るさ目標値記憶部と、較正板を撮
像して得られた較正用画像の明るさ検出値を明るさ目標
値と比較して前記明るさ指示手段の指示出力と対応した
指令値を補正した補正後指令値を求める明るさ調整部
と、前記補正後指令値を前記照明手段に出力する照明補
正手段とを備えた。
According to a second aspect of the present invention, there is provided a visual inspection apparatus for performing a visual inspection of an object to be inspected, comprising: imaging means for capturing an image of an object to be imaged to capture an image; illuminating means for illuminating the imaged object; Brightness instructing means for instructing desired brightness of illumination, a brightness detecting unit for detecting brightness of an image obtained by imaging, a brightness target value which is a target value of brightness of the image, and the brightness A brightness target value storage unit for storing data indicating a correlation with an instruction output of the instruction means, and comparing a brightness detection value of a calibration image obtained by imaging the calibration plate with a brightness target value, A brightness adjustment unit for obtaining a corrected command value obtained by correcting a command value corresponding to an instruction output of the brightness instruction means; and an illumination correction means for outputting the corrected command value to the illumination means.

【0008】請求項3記載の外観検査における照明方法
は、検査対象物の外観検査において撮像対象を照明手段
により照明する外観検査における照明方法であって、較
正板を撮像して較正用の画像を取り込む較正用画像取り
込み工程と、この較正用画像の明るさを検出する明るさ
検出工程と、この明るさ検出値を明るさ目標値記憶部に
記憶された明るさ目標値と比較して、明るさ指示手段か
ら出力される指示出力に対応し前記照明手段の明るさを
指令する指令値の補正値を求める補正値取得工程と、求
められた補正値により補正された補正後指令値を前記照
明手段に出力する工程と、この補正後指令値に基づいて
照明手段を点灯する工程とを含む。
A lighting method in a visual inspection according to a third aspect of the present invention is a lighting method in a visual inspection for illuminating an object to be imaged by an illuminating means in a visual inspection of an inspection object, wherein a calibration plate is imaged to generate a calibration image. A calibration image capturing step of capturing, a brightness detection step of detecting the brightness of the calibration image, and comparing the brightness detection value with a brightness target value stored in a brightness target value storage unit. A correction value obtaining step of obtaining a correction value of a command value for instructing the brightness of the illumination means in response to an instruction output output from the instruction means, and providing the corrected command value corrected by the obtained correction value to the illumination. Output to the means, and turning on the illumination means based on the corrected command value.

【0009】請求項4記載の外観検査における照明方法
は、検査対象物の外観検査において撮像対象を照明手段
により照明する外観検査における照明方法であって、較
正板を撮像して較正用の画像を取り込む較正用画像取り
込み工程と、この較正用画像の明るさを検出する明るさ
検出工程と、この明るさ検出値を明るさ目標値記憶部に
記憶された明るさ目標値と比較して、明るさ指示手段か
ら出力される指示出力に対応し前記照明手段の明るさを
指令する指令値を補正した補正後指令値を求める工程
と、求められた補正後指令値を前記照明手段に出力する
工程と、この補正後指令値に基づいて照明手段を点灯す
る工程とを含む。
A lighting method in a visual inspection according to a fourth aspect of the present invention is an illumination method in a visual inspection for illuminating an object to be imaged by an illuminating means in a visual inspection of an inspection object, wherein a calibration plate is imaged to generate an image for calibration. A calibration image capturing step of capturing, a brightness detection step of detecting the brightness of the calibration image, and comparing the brightness detection value with a brightness target value stored in a brightness target value storage unit. Obtaining a corrected command value by correcting a command value for instructing the brightness of the illumination means in response to an instruction output output from the instruction means; and outputting the corrected command value to the illumination means. And turning on the illuminating means based on the corrected command value.

【0010】本発明は、較正板を撮像することにより得
られた較正用画像の明るさ検出値を明るさ目標値記憶部
に記憶された明るさ目標値と比較することにより、明る
さ指示手段からの指示出力に応じて照明手段の明るさを
指令する指令値を補正した補正後指令値を求め、この補
正後指令値を照明手段に出力する。これにより、撮像に
より得られる画像の明るさを適正に較正することがで
き、外観検査の検査精度を確保することができる。
According to the present invention, brightness instructing means is provided by comparing a brightness detection value of a calibration image obtained by imaging a calibration plate with a brightness target value stored in a brightness target value storage unit. A corrected command value obtained by correcting a command value for instructing the brightness of the lighting means in accordance with the command output from the controller is obtained, and the corrected command value is output to the lighting means. This makes it possible to properly calibrate the brightness of an image obtained by imaging, and to secure the inspection accuracy of the appearance inspection.

【0011】[0011]

【発明の実施の形態】次に本発明の実施の形態を図面を
参照して説明する。図1は本発明の一実施の形態の外観
検査装置の構成を示すブロック図、図2は本発明の一実
施の形態の外観検査装置の処理機能を示す機能ブロック
図、図3、図5は本発明の一実施の形態の外観検査装置
の照明値、指令値と明るさ目標値との関係を示すグラ
フ、図4は本発明の一実施の形態の外観検査装置の照明
条件較正処理のフロー図、図6は本発明の一実施の形態
の外観検査装置の処理機能を示す機能ブロック図、図7
は本発明の一実施の形態の外観検査装置の変換テーブル
を示す図である。
Embodiments of the present invention will now be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of an appearance inspection apparatus according to an embodiment of the present invention, FIG. 2 is a functional block diagram showing processing functions of the appearance inspection apparatus according to an embodiment of the present invention, and FIGS. FIG. 4 is a graph showing a relationship between an illumination value, a command value, and a brightness target value of the visual inspection device according to the embodiment of the present invention. FIG. 4 is a flowchart of a lighting condition calibration process of the visual inspection device according to the embodiment of the present invention. FIGS. 6 and 7 are functional block diagrams showing processing functions of the visual inspection apparatus according to the embodiment of the present invention.
FIG. 3 is a diagram showing a conversion table of the visual inspection device according to the embodiment of the present invention.

【0012】まず図1を参照して外観検査装置の構成を
説明する。図1において、位置決めテーブル1上には外
観検査の検査対象物である実装基板2および較正板3が
載置されている。実装基板2を撮像して画像を取得し、
得られた画像を画像処理することにより、電子部品の有
無や位置ずれなどの所定の検査が行われる。較正板3は
後述するように、撮像時の照明条件の較正処理に使用さ
れる。
First, the configuration of a visual inspection apparatus will be described with reference to FIG. In FIG. 1, a mounting board 2 and a calibration plate 3 which are objects to be inspected for appearance inspection are placed on a positioning table 1. The mounting board 2 is imaged to obtain an image,
By performing image processing on the obtained image, a predetermined inspection such as the presence / absence of an electronic component and a position shift is performed. As will be described later, the calibration plate 3 is used for calibration processing of illumination conditions at the time of imaging.

【0013】位置決めテーブル1の上方には撮像手段と
してのカメラ10が配設されている。位置決めテーブル
制御部15によって位置決めテーブル1を駆動すること
により、実装基板2はカメラ10に対して相対的に位置
決めされ、実装基板2の任意位置をカメラ10により撮
像することができる。また較正処理時には位置決めテー
ブル1を駆動して較正板3をカメラ10の下方に移動さ
せ、較正板3を撮像する。
Above the positioning table 1, a camera 10 as an imaging means is provided. By driving the positioning table 1 by the positioning table control unit 15, the mounting board 2 is positioned relative to the camera 10, and an arbitrary position of the mounting board 2 can be imaged by the camera 10. During the calibration process, the positioning table 1 is driven to move the calibration plate 3 below the camera 10, and the calibration plate 3 is imaged.

【0014】カメラ10はカメラ制御部11と接続され
ており、カメラ制御部11はカメラ10の撮像動作を制
御するとともに、撮像により取得された画像情報を受け
取る。カメラ10による撮像時には、実装基板2は多数
のLED14を備えた照明部13からの照射光によって
照明される。照明部13は照明制御部12と接続されて
おり、照明制御部12には明るさを示すデジタル値であ
る指令値が入力される。これにより、照明制御部12は
この指令値に比例した明るさで照明部13を点灯させ
る。照明部13、照明制御部12は指令値に応じた明る
さで撮像対象を照明する照明手段となっている。
The camera 10 is connected to a camera control unit 11. The camera control unit 11 controls the image pickup operation of the camera 10 and receives image information obtained by image pickup. At the time of imaging by the camera 10, the mounting board 2 is illuminated by irradiation light from the illumination unit 13 having a large number of LEDs 14. The lighting unit 13 is connected to the lighting control unit 12, and a command value that is a digital value indicating brightness is input to the lighting control unit 12. As a result, the illumination control unit 12 turns on the illumination unit 13 with brightness proportional to the command value. The illumination unit 13 and the illumination control unit 12 are illumination units that illuminate the imaging target with brightness according to the command value.

【0015】演算処理部16はCPUであり、プログラ
ム記憶部17に記憶された各種プログラム及びデータ記
憶部18に記憶された各種データに基づいて、画像処理
による外観検査や照明条件の較正処理などの各種の処理
・演算を行う。プログラム記憶部17は外観検査や照明
条件較正処理などのプログラムを記憶する。データ記憶
部18は、照明条件の較正処理に用いられる明るさ目標
値などの各種のデータを記憶する。表示部19はディス
プレイ装置であり、カメラ10によって撮像された画像
の表示や操作入力時の案内画面などを表示する。操作・
入力部20はキーボードやマウスなどの入力手段であ
り、制御コマンドの入力や照明値などのデータ入力を行
う。
The arithmetic processing unit 16 is a CPU, and based on various programs stored in the program storage unit 17 and various data stored in the data storage unit 18, performs visual inspection by image processing and calibration processing of illumination conditions. Performs various processes and calculations. The program storage unit 17 stores programs such as a visual inspection and a lighting condition calibration process. The data storage unit 18 stores various data such as a brightness target value used for the illumination condition calibration process. The display unit 19 is a display device, and displays an image captured by the camera 10, a guidance screen for operation input, and the like. operation·
The input unit 20 is an input unit such as a keyboard and a mouse, and inputs control commands and data such as illumination values.

【0016】次に図2を参照して外観検査装置の照明条
件較正処理機能について説明する。この照明条件較正処
理は、撮像対象を照明する照明条件を、同一対象につい
ては常に同一結果が得られるよう、較正板を撮像するこ
とにより調整するものである。なお、図2に示す明るさ
検出部21、照明値出力手段22、明るさ調整部24、
指令部25は、図1に示すプログラム記憶部17に記憶
されたプログラムにしたがって演算処理部16によって
行われる処理機能を示すものであり、明るさ目標値記憶
部23、補正値記憶部26は、図1に示すデータ記憶部
18に設定された記憶領域である。
Next, the illumination condition calibration processing function of the visual inspection apparatus will be described with reference to FIG. This illumination condition calibration process adjusts illumination conditions for illuminating the imaging target by imaging the calibration plate so that the same result is always obtained for the same target. Note that the brightness detection unit 21, the illumination value output unit 22, the brightness adjustment unit 24 shown in FIG.
The command section 25 indicates a processing function performed by the arithmetic processing section 16 in accordance with the program stored in the program storage section 17 shown in FIG. 1. The brightness target value storage section 23 and the correction value storage section 26 This is a storage area set in the data storage unit 18 shown in FIG.

【0017】図2において、カメラ10によって較正板
3を撮像して得られた画像データは明るさ検出部21に
送られる。明るさ検出部21は、画像内の対象エリアに
おける明るさを検出し、検出結果は明るさ検出値として
明るさ調整部24に出力される。
In FIG. 2, image data obtained by capturing an image of the calibration plate 3 by the camera 10 is sent to a brightness detection unit 21. The brightness detection unit 21 detects the brightness in the target area in the image, and the detection result is output to the brightness adjustment unit 24 as a brightness detection value.

【0018】照明値出力手段22は外観検査時に撮像対
象に応じて設定される照明の明るさを指示する。すなわ
ち、撮像対象に応じて照明の所望の明るさが設定される
と、この明るさに対応した照明値を出力する。ここで照
明値とは、装置制御上で設定される数値であり、いわば
照明操作盤上での明るさの目盛に相当するものである。
したがって、照明値出力手段22は、照明の所望の明る
さを指示する明るさ指示手段となっている。そして照明
値は明るさ指示手段の指示出力であり、明るさ調整部2
4及び指令部25に出力される。
The illumination value output means 22 indicates the brightness of the illumination set according to the object to be imaged at the time of appearance inspection. That is, when the desired brightness of the illumination is set according to the imaging target, an illumination value corresponding to this brightness is output. Here, the lighting value is a numerical value set on the device control, and is equivalent to a scale of brightness on a lighting operation panel.
Therefore, the illumination value output means 22 is a brightness instruction means for instructing a desired brightness of the illumination. The illumination value is an instruction output of the brightness instruction means, and the brightness adjustment unit 2
4 and the command section 25.

【0019】本実施の形態では、後述するように照明値
は1〜10の数値によって設定され、操作・入力部20
から直接入力されるデータをそのまま出力する方法や、
予め撮像対象ごとに設定されデータ記憶部18に記憶さ
れた照明値を読み取って出力する方法などを用いること
ができる。
In the present embodiment, the illumination value is set by a numerical value of 1 to 10 as described later,
How to output data directly input from
A method of reading and outputting an illumination value set in advance for each imaging target and stored in the data storage unit 18 can be used.

【0020】明るさ調整部24は、照明値出力手段22
から出力された照明値、明るさ検出部21からの明るさ
検出値および明るさ目標値記憶部23に記憶された明る
さ目標値と照明値との相関を示すデータに基づいて、照
明値出力手段22によって指示された所望の明るさを実
現するための補正値、すなわち指令部25から出力され
る指令値を補正する補正値を求める。
The brightness adjustment unit 24 includes an illumination value output unit 22
The illumination value output is performed based on the illumination value output from the CPU, the brightness detection value from the brightness detection unit 21, and the data indicating the correlation between the illumination target value and the illumination value stored in the brightness target value storage unit 23. A correction value for realizing the desired brightness specified by the means 22, that is, a correction value for correcting the command value output from the command unit 25 is obtained.

【0021】ここで、明るさ目標値について図3を参照
して説明する。画像処理による外観検査では、良好な画
像を取得するために撮像時の照明条件を適正に設定する
ことが求められる。このため外観検査装置では、照明の
明るさを調整できるようになっており、この調整は装置
操作上では、前述の照明値を変更することにより行われ
る。したがって、明るさ調整を行うには、撮像によって
得られる画像の明るさの目標を示す明るさ目標値と照明
値との相関を予め設定しておくことが必要となる。
Here, the brightness target value will be described with reference to FIG. In appearance inspection by image processing, it is required to appropriately set illumination conditions at the time of imaging in order to obtain a good image. For this reason, in the appearance inspection device, the brightness of the illumination can be adjusted, and this adjustment is performed by changing the illumination value in the operation of the device. Therefore, in order to perform brightness adjustment, it is necessary to set in advance a correlation between a brightness target value indicating a brightness target of an image obtained by imaging and an illumination value.

【0022】この相関は、図3に示すグラフの特性線L
によって表され、明るさ目標値が指定されることによ
り、この目標明るさを実現するための照明値が特性線L
により決定される。この特性線Lは照明に使用される光
源によって異り、実測によって求められる。そしてこの
特性線Lを数値化したデータが明るさ目標値記憶部23
に記憶されている。通常の外観検査装置の稼働時には、
照明値が指示されることにより、この照明値と図3のグ
ラフの横軸に示す対応関係にある指令値(0〜255)
が指令部25より照明制御部12に出力される。
This correlation corresponds to the characteristic line L in the graph shown in FIG.
Is designated by the brightness target value, the illumination value for realizing the target brightness is represented by a characteristic line L.
Is determined by This characteristic line L differs depending on the light source used for illumination, and is obtained by actual measurement. The numerical data of the characteristic line L is stored in the brightness target value storage unit 23.
Is stored in During the operation of a normal visual inspection device,
When the illumination value is specified, a command value (0 to 255) corresponding to the illumination value and the horizontal axis of the graph of FIG.
Is output from the command unit 25 to the illumination control unit 12.

【0023】照明条件較正処理実行時には、照明値出力
手段22から照明値が出力されると、明るさ調整部24
は明るさ目標値記憶部23からこの照明値に対応した明
るさ目標値を読み取る。そして前述の明るさ検出値をこ
の明るさ目標値と比較し、これらが一致しないならば、
明るさ検出値を明るさ目標値と一致させるための補正値
を求める処理を行う。
When the illumination value is output from the illumination value output means 22 during the execution of the illumination condition calibration process, the brightness adjustment unit 24
Reads the brightness target value corresponding to this illumination value from the brightness target value storage unit 23. Then, the aforementioned brightness detection value is compared with this brightness target value, and if they do not match,
A process for obtaining a correction value for matching the brightness detection value with the brightness target value is performed.

【0024】補正値記憶部26は、明るさ調整部24で
求めた補正値を照明値ごとに記憶する。指令部25は、
照明値出力手段22からの照明値に応じた指令値を出力
するが、補正値記憶部26に補正値が設定されていれ
ば、この補正値によって補正した指令値(補正後指令
値)を出力する。
The correction value storage unit 26 stores the correction value obtained by the brightness adjustment unit 24 for each illumination value. The command unit 25
A command value corresponding to the illumination value from the illumination value output means 22 is output. If a correction value is set in the correction value storage unit 26, the command value corrected by this correction value (corrected command value) is output. I do.

【0025】次に補正値について説明する。照明部13
の光源として使用されるLEDは一般に使用時間の経過
とともに劣化が進行し、同一電力で点灯させても常に同
一の明るさが得られるとは限らない。すなわち同一の照
明値が指示され、この照明値に対応した指令値が照明制
御部12に出力された場合にあっても、照明部13によ
って照明される明るさは時間の経過とともにばらつく。
言い換えれば、図3に示す特性線Lは経時的に変化す
る。上述の補正値はこの経時変化に起因する明るさ目標
値と照明値との相関関係の変動を補正するものであり、
以下の方法によって求められる。
Next, the correction value will be described. Lighting unit 13
In general, the LED used as the light source deteriorates with the elapse of use time, and the same brightness is not always obtained even when the LED is turned on with the same power. That is, even when the same illumination value is specified and a command value corresponding to the illumination value is output to the illumination control unit 12, the brightness illuminated by the illumination unit 13 varies over time.
In other words, the characteristic line L shown in FIG. 3 changes with time. The correction value described above corrects a change in the correlation between the brightness target value and the illumination value due to the temporal change,
It is determined by the following method.

【0026】図4、図5を参照して、経時変化による照
明条件較正処理について説明する。この較正処理は、図
5に示すように予め定められた特性線Lを較正して新た
な特性線L’に置き換える処理に相当する。図4におい
て、まず較正対象の照明値を設定する(ST1)。すな
わち、照明値出力手段22から較正対象の照明値を明る
さ調整部24および指令部25へ出力する。そしてこの
照明値に対応した指令値を照明制御部12に出力して照
明部13を点灯した状態で、較正板をカメラ10で撮像
して較正用画像を取得し(ST2)、得られた較正用画
像の明るさを明るさ検出部21によって検出する(ST
3)。次いで検出された明るさが(ST1)で出力した
照明値の明るさ目標値と一致するように指令値を調整す
る(ST4)。
Referring to FIGS. 4 and 5, a description will be given of an illumination condition calibration process based on a change with time. This calibration process corresponds to a process of calibrating a predetermined characteristic line L and replacing it with a new characteristic line L ′ as shown in FIG. In FIG. 4, first, an illumination value to be calibrated is set (ST1). That is, the illumination value output unit 22 outputs the illumination value to be calibrated to the brightness adjustment unit 24 and the command unit 25. Then, a command value corresponding to the illumination value is output to the illumination control unit 12 and the illumination unit 13 is turned on, and the calibration plate is imaged by the camera 10 to obtain a calibration image (ST2). The brightness of the image for use is detected by the brightness detector 21 (ST
3). Next, the command value is adjusted so that the detected brightness matches the brightness target value of the illumination value output in (ST1) (ST4).

【0027】上記処理は、図5において横軸上に較正対
象の照明値a1を設定し、指令値を調整しながら明るさ
を検出し、ここで得られた明るさ検出値が、既存の特性
線L上で照明値a1に対応する明るさ目標値b1と一致
するような指令値を求める操作である。すなわち、経時
変化により特性が変化した照明部13を用いると、当初
指令値d1と対応していた明るさ目標値b1はもはや指
令値d1とは対応しない。このため同一の明るさ目標値
b1を得ようとすれば指令値をΔd1だけ変化させた新
たな指令値d’1を用いなければならない。換言すれ
ば、特性線L上の照明値a1と対応する点D1は、経時
変化により、新たな指令値d’1と明るさ目標値b1と
の交点D’1に移動する。
In the above processing, the illumination value a1 to be calibrated is set on the horizontal axis in FIG. 5, and the brightness is detected while adjusting the command value. This is an operation for obtaining a command value that matches the brightness target value b1 corresponding to the illumination value a1 on the line L. That is, when the illumination unit 13 whose characteristics have been changed over time is used, the brightness target value b1 corresponding to the command value d1 no longer corresponds to the command value d1. Therefore, in order to obtain the same brightness target value b1, a new command value d'1 obtained by changing the command value by Δd1 must be used. In other words, the point D1 corresponding to the illumination value a1 on the characteristic line L moves to the intersection D'1 between the new command value d'1 and the brightness target value b1 due to a change with time.

【0028】次に、上記のようにして明るさ目標値b1
を与える指令値として求められた新たな指令値d’1を
得るための補正値Δd1を、補正値記憶部26に記憶さ
せる(ST5)。そして較正対象の各照明値a1,a2
・・・について順次同様の処理を行い、全ての照明値に
ついて補正値Δd1,Δd2・・・を取得したか否かを
判断し(ST6)、全照明値の補正値を記憶させて照明
条件較正処理における補正値取得を終了する。
Next, as described above, the brightness target value b1
The correction value Δd1 for obtaining the new command value d′ 1 obtained as the command value that gives is stored in the correction value storage unit 26 (ST5). Then, the respective illumination values a1 and a2 to be calibrated
.. Are sequentially performed to determine whether the correction values Δd1, Δd2,... Have been obtained for all the illumination values (ST6), and the correction values for all the illumination values are stored to calibrate the illumination conditions. The correction value acquisition in the processing ends.

【0029】そして、このようにして求められた新たな
点D’1,D’2・・・を結ぶことにより、新たな特性
線L’が得られ、明るさ目標値と指令値との新たな相関
が求められる。各点D’1,D’2・・・の中間の値に
ついては、データ補間により必要な補正値を求める。
By connecting the new points D'1, D'2,... Obtained in this way, a new characteristic line L 'is obtained, and a new characteristic line L' between the target brightness value and the command value is obtained. High correlation is required. With respect to an intermediate value between the points D′ 1, D′ 2,..., A necessary correction value is obtained by data interpolation.

【0030】指令部25は、照明値出力手段22から照
明値を受けるとともに、補正値記憶部26に記憶された
指令値の補正値を読み込む。そして指示された照明値と
対応する指令値を読み込んだ補正値で補正した指令値
(補正後指令値)を照明制御部12に対して出力する。
すなわち、指令部25は補正後指令値を照明手段に出力
する照明補正手段となっている。そしてこの補正後指令
値に基づいて照明部13を点灯させることにより、照明
部13によって照射される照明光の実際の明るさは、明
るさ目標値と一致する。
The command section 25 receives the illumination value from the illumination value output means 22 and reads the correction value of the command value stored in the correction value storage section 26. Then, a command value (corrected command value) obtained by correcting the command value corresponding to the designated lighting value with the read correction value is output to the lighting control unit 12.
That is, the command unit 25 is an illumination correction unit that outputs the corrected command value to the illumination unit. By illuminating the illumination unit 13 based on the corrected command value, the actual brightness of the illumination light emitted by the illumination unit 13 matches the brightness target value.

【0031】外観検査装置を用いて長期間継続して検査
作業を行う過程において上記較正処理を定期的に行うこ
とにより、常に適正な照明条件下で撮像を行って撮像に
より得られる画像の明るさを較正することができ、LE
Dなどの照明装置の経時変化に起因する明るさのばらつ
きを排除して外観検査の検査精度を確保することができ
る。
In the course of performing inspection work continuously for a long time using the visual inspection device, the calibration process is periodically performed, so that the image is always captured under appropriate lighting conditions and the brightness of the image obtained by the image capture is obtained. Can be calibrated and LE
Variations in brightness due to aging of the lighting device such as D can be eliminated, and the inspection accuracy of the appearance inspection can be ensured.

【0032】なお上記実施の形態においては、照明条件
較正処理の結果を指令値を補正するための補正値として
求めて補正値記憶部26に記憶させ、指令値を出力する
際には指令部25にて新たな指令値を補正値で補正した
補正後指令値として照明制御部12に出力する例を示し
ているが、このような構成以外に図6に示すような方法
を用いてもよい。
In the above embodiment, the result of the illumination condition calibration process is obtained as a correction value for correcting the command value and stored in the correction value storage unit 26. When the command value is output, the command unit 25 is used. Shows an example in which a new command value is output to the illumination control unit 12 as a corrected command value corrected by a correction value, but a method shown in FIG. 6 may be used in addition to such a configuration.

【0033】すなわち図6に示す方法では、照明条件較
正結果は変換テーブル27として求められる。変換テー
ブル27は、図7に示すように0〜10で指示される照
明値と0〜255のデジタル値で示される指令値との対
応関係をテーブルの形式で表したものである。そしてこ
の変換テーブルを前述の較正処理が行われる都度更新す
る。
That is, in the method shown in FIG. 6, the illumination condition calibration result is obtained as the conversion table 27. The conversion table 27 shows, in the form of a table, the correspondence between the illumination values designated by 0 to 10 and the command values represented by digital values of 0 to 255 as shown in FIG. Then, this conversion table is updated each time the above-described calibration processing is performed.

【0034】すなわち図5において、当初a1→d1の
対応関係にあった照明値と指令値との対応を、a1→
d’1の対応関係に置き換えることにより、上記較性処
理により補正された補正後指令値を求め、この補正後指
令値によって変換テーブルが更新される。これにより、
同一の照明値が指示された場合には、常に同一の明るさ
目標値に対応するように補正された補正後指令値が照明
制御部12に出力される。すなわちこの場合には、変換
テーブル27が補正後指令値を照明手段に出力する照明
補正手段となっている。
That is, in FIG. 5, the correspondence between the illumination value and the command value, which originally corresponded to a1 → d1, is represented by a1 → d1.
By replacing the correspondence with d′ 1, the corrected command value corrected by the above-described compatibility processing is obtained, and the conversion table is updated with the corrected command value. This allows
When the same illumination value is instructed, a corrected command value corrected to always correspond to the same brightness target value is output to the illumination control unit 12. That is, in this case, the conversion table 27 serves as illumination correction means for outputting the corrected command value to the illumination means.

【0035】[0035]

【発明の効果】本発明は、較正板を撮像することにより
得られた較正用画像の明るさ検出値を明るさ目標値記憶
部に記憶された明るさ目標値と比較することにより、明
るさ指示手段からの指示出力に応じて照明手段の明るさ
を指令する指令値を補正した補正後指令値を求め、この
補正後指令を照明手段に出力する。これにより、撮像に
より得られる画像の明るさを適正に較正することがで
き、外観検査の検査精度を確保することができる。
According to the present invention, the brightness is detected by comparing the brightness detection value of the calibration image obtained by imaging the calibration plate with the brightness target value stored in the brightness target value storage unit. A corrected command value is obtained by correcting a command value for instructing the brightness of the lighting means in accordance with the command output from the command means, and the corrected command is output to the lighting means. This makes it possible to properly calibrate the brightness of an image obtained by imaging, and to secure the inspection accuracy of the appearance inspection.

【図面の簡単な説明】[Brief description of the drawings]

【図1】本発明の一実施の形態の外観検査装置の構成を
示すブロック図
FIG. 1 is a block diagram illustrating a configuration of a visual inspection apparatus according to an embodiment of the present invention.

【図2】本発明の一実施の形態の外観検査装置の処理機
能を示す機能ブロック図
FIG. 2 is a functional block diagram showing processing functions of the visual inspection device according to the embodiment of the present invention;

【図3】本発明の一実施の形態の外観検査装置の照明
値、指令値と明るさ目標値との関係を示すグラフ
FIG. 3 is a graph showing a relationship between an illumination value, a command value, and a brightness target value of the visual inspection device according to the embodiment of the present invention;

【図4】本発明の一実施の形態の外観検査装置の照明条
件較正処理のフロー図
FIG. 4 is a flowchart of a lighting condition calibration process of the visual inspection device according to the embodiment of the present invention;

【図5】本発明の一実施の形態の外観検査装置の照明
値、指令値と明るさ目標値との関係を示すグラフ
FIG. 5 is a graph showing a relationship between an illumination value, a command value, and a brightness target value of the visual inspection device according to the embodiment of the present invention;

【図6】本発明の一実施の形態の外観検査装置の処理機
能を示す機能ブロック図
FIG. 6 is a functional block diagram showing processing functions of the visual inspection device according to the embodiment of the present invention;

【図7】本発明の一実施の形態の外観検査装置の変換テ
ーブルを示す図
FIG. 7 is a view showing a conversion table of the appearance inspection apparatus according to the embodiment of the present invention;

【符号の説明】[Explanation of symbols]

2 実装基板 3 較正板 10 カメラ 11 カメラ制御部 12 照明制御部 13 照明部 21 明るさ検出部 22 照明値出力手段 23 明るさ目標値記憶部 24 明るさ調整部 25 指令部 26 補正値記憶部 27 変換テーブル Reference Signs List 2 mounting board 3 calibration plate 10 camera 11 camera control unit 12 illumination control unit 13 illumination unit 21 brightness detection unit 22 illumination value output unit 23 brightness target value storage unit 24 brightness adjustment unit 25 command unit 26 correction value storage unit 27 Conversion table

Claims (4)

【特許請求の範囲】[Claims] 【請求項1】検査対象物の外観検査を行う外観検査装置
であって、撮像対象を撮像して画像を取り込む撮像手段
と、撮像対象を照明する照明手段と、照明の所望の明る
さを指示する明るさ指示手段と、撮像により得られた画
像の明るさを検出する明るさ検出部と、前記画像の明る
さの目標値である明るさ目標値と前記明るさ指示手段の
指示出力との相関を示すデータを記憶する明るさ目標値
記憶部と、較正板を撮像して得られた較正用画像の明る
さ検出値を明るさ目標値と比較して前記明るさ指示手段
の指示出力と対応した指令値を補正する補正値を求める
明るさ調整部と、前記明るさ指示手段の指示出力に応じ
た指令値を前記補正値により補正して補正後指令値を求
め前記照明手段に出力する照明補正手段とを備えたこと
を特徴とする外観検査装置。
1. An appearance inspection apparatus for performing an appearance inspection of an inspection object, comprising: an imaging unit that captures an image of an imaging target to capture an image; an illumination unit that illuminates the imaging target; Brightness instructing means, a brightness detecting unit for detecting the brightness of an image obtained by imaging, and a brightness target value which is a brightness target value of the image and an instruction output of the brightness instructing means. A brightness target value storage unit for storing data indicating the correlation, and comparing the brightness detection value of the calibration image obtained by imaging the calibration plate with the brightness target value, and outputting an instruction output of the brightness instruction means. A brightness adjustment unit for obtaining a correction value for correcting the corresponding command value, and a corrected command value obtained by correcting a command value corresponding to an instruction output of the brightness instruction means with the correction value and outputting the corrected command value to the lighting means. External appearance characterized by comprising illumination correction means査 apparatus.
【請求項2】検査対象物の外観検査を行う外観検査装置
であって、撮像対象を撮像して画像を取り込む撮像手段
と、撮像対象を照明する照明手段と、照明の所望の明る
さを指示する明るさ指示手段と、撮像により得られた画
像の明るさを検出する明るさ検出部と、前記画像の明る
さの目標値である明るさ目標値と前記明るさ指示手段の
指示出力との相関を示すデータを記憶する明るさ目標値
記憶部と、較正板を撮像して得られた較正用画像の明る
さ検出値を明るさ目標値と比較して前記明るさ指示手段
の指示出力と対応した指令値を補正した補正後指令値を
求める明るさ調整部と、前記補正後指令値を前記照明手
段に出力する照明補正手段とを備えたことを特徴とする
外観検査装置。
2. An appearance inspection apparatus for performing an appearance inspection of an inspection object, comprising: an imaging unit that captures an image of an imaging target to capture an image; an illumination unit that illuminates the imaging target; and a device that indicates a desired brightness of illumination. Brightness instructing means, a brightness detecting unit for detecting the brightness of an image obtained by imaging, and a brightness target value which is a brightness target value of the image and an instruction output of the brightness instructing means. A brightness target value storage unit for storing data indicating the correlation, and comparing the brightness detection value of the calibration image obtained by imaging the calibration plate with the brightness target value, and outputting an instruction output of the brightness instruction means. A visual inspection apparatus comprising: a brightness adjustment unit that obtains a corrected command value by correcting a corresponding command value; and an illumination correction unit that outputs the corrected command value to the illumination unit.
【請求項3】検査対象物の外観検査において撮像対象を
照明手段により照明する外観検査における照明方法であ
って、較正板を撮像して較正用の画像を取り込む較正用
画像取り込み工程と、この較正用画像の明るさを検出す
る明るさ検出工程と、この明るさ検出値を明るさ目標値
記憶部に記憶された明るさ目標値と比較して、明るさ指
示手段から出力される指示出力に対応し前記照明手段の
明るさを指令する指令値の補正値を求める補正値取得工
程と、求められた補正値により補正された補正後指令値
を前記照明手段に出力する工程と、この補正後指令値に
基づいて照明手段を点灯する工程とを含むことを特徴と
する外観検査における照明方法。
3. A calibration image capturing step for capturing an image of a calibration plate by capturing an image of a calibration plate, the method comprising: A brightness detection step of detecting the brightness of the image for use, and comparing the brightness detection value with the brightness target value stored in the brightness target value storage unit to output an instruction output from the brightness instruction means. Correspondingly, a correction value obtaining step of obtaining a correction value of a command value for instructing the brightness of the lighting means, a step of outputting a corrected command value corrected by the obtained correction value to the lighting means, Lighting a lighting means based on a command value.
【請求項4】検査対象物の外観検査において撮像対象を
照明手段により照明する外観検査における照明方法であ
って、較正板を撮像して較正用の画像を取り込む較正用
画像取り込み工程と、この較正用画像の明るさを検出す
る明るさ検出工程と、この明るさ検出値を明るさ目標値
記憶部に記憶された明るさ目標値と比較して、明るさ指
示手段から出力される指示出力に対応し前記照明手段の
明るさを指令する指令値を補正した補正後指令値を求め
る工程と、求められた補正後指令値を前記照明手段に出
力する工程と、この補正後指令値に基づいて照明手段を
点灯する工程とを含むことを特徴とする外観検査におけ
る照明方法。
4. An illumination method in an appearance inspection for illuminating an imaging target by illumination means in an appearance inspection of an inspection object, wherein a calibration image capturing step of capturing a calibration plate by capturing an image of a calibration plate; A brightness detection step of detecting the brightness of the image for use, and comparing the brightness detection value with the brightness target value stored in the brightness target value storage unit to output an instruction output from the brightness instruction means. A step of obtaining a corrected command value corresponding to a command value for instructing the brightness of the lighting means, and a step of outputting the obtained corrected command value to the lighting means, based on the corrected command value. Lighting the lighting means.
JP2000119002A 2000-04-20 2000-04-20 Appearance inspection device Expired - Fee Related JP4230091B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2000119002A JP4230091B2 (en) 2000-04-20 2000-04-20 Appearance inspection device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2000119002A JP4230091B2 (en) 2000-04-20 2000-04-20 Appearance inspection device

Publications (2)

Publication Number Publication Date
JP2001305066A true JP2001305066A (en) 2001-10-31
JP4230091B2 JP4230091B2 (en) 2009-02-25

Family

ID=18630053

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2000119002A Expired - Fee Related JP4230091B2 (en) 2000-04-20 2000-04-20 Appearance inspection device

Country Status (1)

Country Link
JP (1) JP4230091B2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001235366A (en) * 1999-12-30 2001-08-31 Mitsutoyo Corp Method and device for calibrating open-loop light intensity
JP2005091138A (en) * 2003-09-17 2005-04-07 Yaskawa Electric Corp Light emitting element drive circuit and its method for correcting an amount of light emission
JP2006105830A (en) * 2004-10-06 2006-04-20 Dainippon Printing Co Ltd Photogravure printing cell shape measuring device and measuring method

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001235366A (en) * 1999-12-30 2001-08-31 Mitsutoyo Corp Method and device for calibrating open-loop light intensity
JP4608089B2 (en) * 1999-12-30 2011-01-05 株式会社ミツトヨ Open loop light intensity calibration method and apparatus
JP2005091138A (en) * 2003-09-17 2005-04-07 Yaskawa Electric Corp Light emitting element drive circuit and its method for correcting an amount of light emission
JP4524792B2 (en) * 2003-09-17 2010-08-18 株式会社安川電機 Light emitting element driving circuit and light emission amount correcting method thereof
JP2006105830A (en) * 2004-10-06 2006-04-20 Dainippon Printing Co Ltd Photogravure printing cell shape measuring device and measuring method

Also Published As

Publication number Publication date
JP4230091B2 (en) 2009-02-25

Similar Documents

Publication Publication Date Title
CN108775958B (en) Brightness measuring and calibrating method and device based on light sensor and electronic equipment
JP2010079552A (en) Image processor and image processing method
KR101204617B1 (en) Inspection apparatus
JPH1096605A (en) Position measuring method and device with image processing
US20030103159A1 (en) Evaluating the effect of a strobe light in a camera
JP2005338054A (en) Automatic evaluation device of vehicle-mounted display gauge
JP3861551B2 (en) Optical system calibration method for visual inspection
JP2015002241A (en) Substrate imaging device, and substrate imaging method
JP2001305066A (en) Appearance inspecting device and illumination method in appearance inspection
JP2009002669A (en) Visual inspection device
JP4695535B2 (en) Image processing system having illumination device with brightness correction
JP3806240B2 (en) Illumination device and illuminance adjustment method thereof
KR20180042381A (en) Illumination acquisition system, illumination control system and program
WO2013022662A1 (en) Method for automatically adjusting the levels of illumination sources in an optical measurement machine
JP6461692B2 (en) Board inspection equipment
JP4594772B2 (en) Inspection device
JP2007279213A (en) Luminance inspecting device for display panel, and display panel manufacturing method using the same
JP3534817B2 (en) Automatic lighting setting method and device
JP4657003B2 (en) Endoscope processor
JP2004040417A (en) Imaging apparatus, and white balance correction method
JP2006349416A (en) Surface texture measuring machine
CN117664517A (en) Method, device, detection equipment and system for acquiring optical data of display unit
JPH05126550A (en) Surface state inspecting method
KR100424699B1 (en) Automatic calibration system for line scan camera
JPH0850099A (en) Inspection device

Legal Events

Date Code Title Description
A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20040830

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20041102

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20041227

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20050308

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20050421

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20050531

RD01 Notification of change of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7421

Effective date: 20050630

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20060207

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20061212

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20081203

R151 Written notification of patent or utility model registration

Ref document number: 4230091

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20111212

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20111212

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20121212

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20121212

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20131212

Year of fee payment: 5

LAPS Cancellation because of no payment of annual fees