JPH07209590A - Electronic endoscope device - Google Patents

Electronic endoscope device

Info

Publication number
JPH07209590A
JPH07209590A JP6015827A JP1582794A JPH07209590A JP H07209590 A JPH07209590 A JP H07209590A JP 6015827 A JP6015827 A JP 6015827A JP 1582794 A JP1582794 A JP 1582794A JP H07209590 A JPH07209590 A JP H07209590A
Authority
JP
Japan
Prior art keywords
image
monitor
enlarged
screen
ccd
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP6015827A
Other languages
Japanese (ja)
Other versions
JP3059626B2 (en
Inventor
Kunio Ando
邦郎 安藤
Fujio Okada
藤夫 岡田
Shigeo Suzuki
茂夫 鈴木
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujinon Corp
Original Assignee
Fuji Photo Optical Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fuji Photo Optical Co Ltd filed Critical Fuji Photo Optical Co Ltd
Priority to JP6015827A priority Critical patent/JP3059626B2/en
Publication of JPH07209590A publication Critical patent/JPH07209590A/en
Application granted granted Critical
Publication of JP3059626B2 publication Critical patent/JP3059626B2/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Landscapes

  • Closed-Circuit Television Systems (AREA)
  • Instruments For Viewing The Inside Of Hollow Bodies (AREA)
  • Endoscopes (AREA)

Abstract

PURPOSE:To utilize a monitor screen as an effective display area at a maximum and obtain an easy-to-see screen. CONSTITUTION:This device has a CCD 10, a signal processing circuit 11, a memory part 12 which has a zoom function part 13, an output circuit 14, a monitor 15, and a microcomputer 16; and an image obtained by the CCD 10 is enlarged by the zoom function part 13 to specific magnifications, the output circuit 14 performs enlargement control over the display mask of the monitor according to the image enlargement, and the enlarged screen is regarded as a basic screen. Consequently, even when an optical system and a prism are made small to decrease the diameter of an endoscope, the monitor screen is utilized as the effective display area and the easy-to-see screen is obtained.

Description

【発明の詳細な説明】Detailed Description of the Invention

【0001】[0001]

【産業上の利用分野】本発明は電子内視鏡装置、特に細
い径とされた電子内視鏡で抽出される画像情報の表示処
理に関する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic endoscope apparatus, and more particularly to a display processing of image information extracted by an electronic endoscope having a small diameter.

【0002】[0002]

【従来の技術】電子内視鏡装置では、固体撮像素子であ
るCCD(Charge Coupled Device )がスコープとして
の電子内視鏡の先端に配設され、このCCDにより被観
察体内の画像が捉えられる。即ち、CCDから出力され
たビデオ信号は画像信号処理回路で所定の画像処理が実
行され、これによってモニタ上へ被観察体内の画像が表
示される。
2. Description of the Related Art In an electronic endoscope apparatus, a CCD (Charge Coupled Device), which is a solid-state image pickup device, is arranged at the tip of an electronic endoscope as a scope, and an image inside a body to be observed is captured by this CCD. That is, the video signal output from the CCD is subjected to predetermined image processing by the image signal processing circuit, whereby the image inside the observed body is displayed on the monitor.

【0003】図3には、電子内視鏡の先端部の構成の一
例が示されており、対物レンズ等を有する光学レンズ系
1にはプリズム2を介してCCD3が接続される。ま
た、このCCD3の下側には鉗子等の処置具を導入する
ための処置具挿通チャンネル4が配設されている。この
ような構成によれば、光学レンズ系1で捉えられた被観
察体内の画像はプリズム2を介してCCD3のイメージ
エリアへ結像されることになり、このCCD3で得られ
たビデオ信号に基づいて画像が形成される。そして、こ
の画像はモニタへ表示されるので、このモニタ上の画像
を観察しながら、処置具挿通チャンネル4から処置具を
被観察体内へ導入できることになる。
FIG. 3 shows an example of the configuration of the tip of an electronic endoscope. A CCD 3 is connected to an optical lens system 1 having an objective lens and the like via a prism 2. A treatment instrument insertion channel 4 for introducing a treatment instrument such as forceps is provided below the CCD 3. With such a configuration, the image of the inside of the body under observation captured by the optical lens system 1 is focused on the image area of the CCD 3 via the prism 2, and based on the video signal obtained by this CCD 3. An image is formed. Then, since this image is displayed on the monitor, it is possible to introduce the treatment instrument into the observed body from the treatment instrument insertion channel 4 while observing the image on the monitor.

【0004】[0004]

【発明が解決しようとする課題】ところで、従来では上
記図3の構成よりも細径化を図るために、図4のような
構成が採用される場合もある。即ち、図3の場合の電子
内視鏡の径(直径)はD1 となるが、図4の場合は、こ
れよりも径の小さい光学レンズ系5と丈の低いプリズム
6が用いられる。これによれば、図3の長さD1 に対
し、長さD2 まで電子内視鏡の径を小さくできるという
利点がある。
By the way, in the prior art, in order to make the diameter smaller than that of FIG. 3, there is a case where the structure as shown in FIG. 4 is adopted. That is, the diameter (diameter) of the electronic endoscope in the case of FIG. 3 is D1, but in the case of FIG. 4, the optical lens system 5 having a smaller diameter and the prism 6 having a shorter length are used. According to this, there is an advantage that the diameter of the electronic endoscope can be reduced to the length D2 with respect to the length D1 in FIG.

【0005】しかしながら、図3の構成の場合は表示サ
イズSがTVモニタの垂直表示サイズを100%とした
とき、120%程度となるのに対し、光学レンズ系5及
びプリズム6を小さくした図4の場合は、表示サイズS
が90%程度となり、撮像範囲が狭くなる。即ち、図5
にはCCD3での撮像領域が示されており、図5(A)
に示されるように、図3の構成の場合は、図のCCD3
の全体がイメージ領域であるとすると、有効な撮像領域
は100に示される円領域となる。
However, in the case of the configuration of FIG. 3, the display size S is about 120% when the vertical display size of the TV monitor is 100%, whereas the optical lens system 5 and the prism 6 are made smaller. In case of, display size S
Is about 90%, and the imaging range is narrowed. That is, FIG.
The image pickup area of the CCD 3 is shown in FIG.
In the case of the configuration of FIG. 3, as shown in FIG.
Is an image area, the effective imaging area is the circular area indicated by 100.

【0006】一方、図5(B)のように、図4の構成の
場合は有効な撮像領域が101に示されるように小さく
なる。そのため、モニタ上でも図5(A),(B)と同
一比率の領域が表示領域となる。従って、光学レンズ系
5及びプリズム6を小さくして細径化を図る場合は、表
示領域が狭くなり、モニタ画面が有効に利用されないと
いう問題があった。
On the other hand, as shown in FIG. 5B, in the case of the configuration of FIG. 4, the effective image pickup area becomes small as indicated by 101. Therefore, the area having the same ratio as in FIGS. 5A and 5B is the display area on the monitor. Therefore, when the optical lens system 5 and the prism 6 are made smaller to reduce the diameter, there is a problem that the display area becomes narrow and the monitor screen is not effectively used.

【0007】本発明は上記問題点に鑑みてなされたもの
であり、その目的は、モニタ画面を有効な表示領域とし
て最大限に利用し、かつ見やすい画面を得ることができ
る電子内視鏡装置を提供することにある。
The present invention has been made in view of the above problems, and an object of the present invention is to provide an electronic endoscope apparatus capable of maximally utilizing a monitor screen as an effective display area and obtaining an easy-to-see screen. To provide.

【0008】[0008]

【課題を解決するための手段】上記目的を達成するため
に、本発明は、固体撮像素子から出力されたビデオ信号
に基づいてモニタに被観察体内の画像を表示する電子内
視鏡装置において、上記固体撮像素子で得られた画像を
所定倍率だけ拡大処理すると共に、この画像拡大に応じ
てモニタの表示マスクを拡大制御し、上記拡大画像を基
本画面としてモニタ上に表示することを特徴とする。
In order to achieve the above object, the present invention provides an electronic endoscope apparatus for displaying an image of the inside of an observed body on a monitor based on a video signal output from a solid-state image pickup device, The image obtained by the solid-state image pickup device is enlarged by a predetermined magnification, the display mask of the monitor is enlarged according to the image enlargement, and the enlarged image is displayed as a basic screen on the monitor. .

【0009】[0009]

【作用】上記の構成によれば、メモリに格納された画像
情報が拡大処理されることによって、固体撮像素子で得
られた画像は所定倍率だけ拡大される。また、これに応
じて表示マスクもモニタ画面全域に広がるように、従来
よりも所定倍率だけ拡大される。即ち、マスクは固体撮
像素子上での撮像領域の比率よりも大きな比率となる大
きさに拡大され、この表示領域に拡大画像が表示され
る。そして、この拡大画像は、常に基本画面として表示
される。従って、画面を有効に利用して、見やすい画面
が提供できることになる。
According to the above arrangement, the image information stored in the memory is enlarged so that the image obtained by the solid-state image pickup device is enlarged by a predetermined magnification. Further, accordingly, the display mask is also enlarged by a predetermined magnification as compared with the conventional one so that the display mask is also spread over the entire monitor screen. That is, the mask is enlarged to a size that is larger than the ratio of the image pickup area on the solid-state image pickup element, and the enlarged image is displayed in this display area. Then, this enlarged image is always displayed as the basic screen. Therefore, it is possible to provide a screen that is easy to see by effectively using the screen.

【0010】[0010]

【実施例】図1には、実施例に係る電子内視鏡装置の構
成が示されている。図において、CCD10は電子内視
鏡の先端部に配置されており、このCCD10の全体が
イメージ領域であるとすると、光学レンズ系及びプリズ
ム(図4の場合と同様)の大きさにより、図示200の
円領域が撮像領域として設定される。このCCD10に
は、クランプ処理、ガンマ補正、ホワイトバランス処理
等を行う信号処理回路11が設けられる。この信号処理
回路11には、画像処理済みのビデオ信号を記憶するメ
モリ部12が接続されており、このメモリ部12内には
メモリ制御の一部としてズーム機能部13が設けられ
る。即ち、ズーム機能部13は従来からのズーム制御と
同様に、メモリ内に一旦記憶された画像情報の読出し速
度を変換すること等によって、撮像全域について拡大処
理をすることになる。
FIG. 1 shows the configuration of an electronic endoscope apparatus according to an embodiment. In the figure, the CCD 10 is arranged at the tip of the electronic endoscope, and assuming that the entire CCD 10 is an image area, it is shown in FIG. The circular area of is set as the imaging area. The CCD 10 is provided with a signal processing circuit 11 that performs clamp processing, gamma correction, white balance processing, and the like. The signal processing circuit 11 is connected to a memory unit 12 that stores a video signal that has been subjected to image processing. Inside the memory unit 12, a zoom function unit 13 is provided as a part of memory control. That is, like the conventional zoom control, the zoom function unit 13 enlarges the entire image pickup area by converting the read speed of the image information once stored in the memory.

【0011】このメモリ部12には、エンコーダ等を有
し、かつ被観察体内画像のマスクを設定するための出力
回路14が設けられ、この出力回路14にモニタ15が
接続される。また、各回路を統轄的に制御するマイコン
(MPU)16が設けられており、このマイコン16は
上記ズーム機能部13の倍率を制御すると共に、出力回
路14の表示マスクの大きさを制御することになり、実
施例では図の301のマスク領域(表示領域)が基本画
面の構成として設定される。このマスクは、撮像領域以
外の不要な画素情報を削除するために、電気的処理にて
設定されるものであり、このマスクで遮断された部分に
は例えば撮影情報、患者情報等が表示される。
The memory section 12 is provided with an output circuit 14 having an encoder and the like and for setting a mask of an in-vivo image to be observed, and a monitor 15 is connected to the output circuit 14. Further, a microcomputer (MPU) 16 that controls each circuit in a centralized manner is provided. The microcomputer 16 controls the magnification of the zoom function unit 13 and the size of the display mask of the output circuit 14. In the embodiment, the mask area (display area) 301 in the drawing is set as the basic screen configuration. This mask is set by electrical processing in order to delete unnecessary pixel information other than the imaging region, and for example, imaging information, patient information, etc. are displayed in the portion blocked by this mask. .

【0012】実施例は以上の構成からなり、CCD10
で得られたビデオ信号は信号処理回路11にてガンマ処
理等の所定の画像処理が施された後、メモリ部12に記
憶される。そして、このメモリ部12内ではマイコン1
6の制御に基づいてズーム機能部13が動作し、このズ
ーム機能部13によってビデオ信号は例えば2倍程度に
拡大処理されて、出力回路14へ供給される。また、こ
の出力回路14では、マイコン16の制御に基づいて例
えば2倍程度拡大された表示領域301となるように、
ビデオ信号がマスク処理されることになる。
The embodiment is constructed as described above, and the CCD 10
The video signal obtained in 1 is subjected to a predetermined image processing such as gamma processing in the signal processing circuit 11 and then stored in the memory section 12. In the memory unit 12, the microcomputer 1
The zoom function unit 13 operates under the control of No. 6, and the zoom function unit 13 enlarges the video signal by, for example, about 2 times and supplies it to the output circuit 14. Further, in the output circuit 14, under the control of the microcomputer 16, for example, the display area 301 is enlarged by about 2 times,
The video signal will be masked.

【0013】このようにして、実施例ではモニタ15の
画面上の表示領域301に拡大した画像が表示されるこ
とになる。即ち、CCD10の読出し走査に合せてモニ
タ15では表示のための走査を行うため、図2に示され
るように、従来ではCCD10の撮像領域200とモニ
タ15の表示領域300とは、全体に対する比率におい
てそれぞれが同一となる。従って、モニタ15の表示領
域300は小さいものとなる。しかし、本発明によれ
ば、表示マスクが上記表示領域301まで拡大され(即
ちCCDのイメージ領域に対する撮像領域の比率よりも
大きな比率となる大きさに拡大され)、かつビデオ信号
が拡大処理されるので、図2のようにCCD10の撮像
領域200で捉えられた画像Aは表示領域301内に拡
大して表示される。
Thus, in the embodiment, the enlarged image is displayed in the display area 301 on the screen of the monitor 15. That is, since the monitor 15 scans for display in accordance with the reading scan of the CCD 10, as shown in FIG. 2, the image pickup area 200 of the CCD 10 and the display area 300 of the monitor 15 are in the ratio of the whole as shown in FIG. Each is the same. Therefore, the display area 300 of the monitor 15 becomes small. However, according to the present invention, the display mask is enlarged to the display area 301 (that is, enlarged to a size larger than the ratio of the image pickup area to the image area of the CCD), and the video signal is enlarged. Therefore, as shown in FIG. 2, the image A captured in the imaging area 200 of the CCD 10 is enlarged and displayed in the display area 301.

【0014】そして、この表示領域301の表示は基本
画面の表示状態となるので、画面を有効に利用できると
共に、見やすい画像が表示されるという利点がある。な
お、実施例ではメモリ部12のズーム機能部13を用い
て更に拡大した画像を表示できるようにしてもよい。
Since the display of the display area 301 is the display state of the basic screen, there is an advantage that the screen can be effectively used and an easy-to-see image is displayed. In the embodiment, the zoom function unit 13 of the memory unit 12 may be used to display a further enlarged image.

【0015】また、従来のようにマスクサイズが同一で
あると、拡大画像のまま始終観察し又は記録し続けてし
まうことがあるが、本発明によれば、マスクサイズも拡
大されることにより、通常画像と拡大画像との判別も容
易に判断できることになる。
Further, when the mask size is the same as in the conventional case, the enlarged image may be observed or recorded continuously from beginning to end. However, according to the present invention, the mask size is also enlarged, The normal image and the enlarged image can be easily discriminated.

【0016】上記実施例では、画像とマスクを同一の比
率で拡大するようにしたが、この拡大率は異なる任意の
拡大率とすることができる。
In the above embodiment, the image and the mask are enlarged at the same ratio, but the enlargement ratio can be set to different arbitrary enlargement ratios.

【0017】[0017]

【発明の効果】以上説明したように、本発明によれば、
固体撮像素子で得られた画像を所定倍率だけ拡大処理す
ると共に、この画像拡大に応じてモニタの表示マスクを
拡大制御し、上記拡大画像を基本画面としてモニタ上へ
表示するようにしたので、内視鏡の細径化のために光学
レンズ系やプリズムを小さくした場合でも、モニタ画面
を有効な表示領域として最大限に利用し、見やすい画面
を得ることができるという利点がある。
As described above, according to the present invention,
The image obtained by the solid-state image sensor is enlarged by a predetermined magnification, and the display mask of the monitor is enlarged according to this image enlargement so that the enlarged image is displayed on the monitor as a basic screen. Even when the optical lens system and the prism are made small to reduce the diameter of the endoscope, there is an advantage that the monitor screen can be used as an effective display area to the maximum and a screen that is easy to see can be obtained.

【図面の簡単な説明】[Brief description of drawings]

【図1】本発明の実施例に係る電子内視鏡装置の構成を
示すブロック図である。
FIG. 1 is a block diagram showing a configuration of an electronic endoscope apparatus according to an embodiment of the present invention.

【図2】実施例のCCDの撮像領域とモニタの表示領域
との関係を示す説明図である。
FIG. 2 is an explanatory diagram showing a relationship between an image pickup area of a CCD and a display area of a monitor according to an embodiment.

【図3】従来の電子内視鏡装置の構成の一例を示す図で
ある。
FIG. 3 is a diagram showing an example of a configuration of a conventional electronic endoscope apparatus.

【図4】従来において、図3の電子内視鏡装置よりも電
子内視鏡の細径化を図った構成例を示す図である。
FIG. 4 is a diagram showing a configuration example in which the diameter of the electronic endoscope is made smaller than that of the electronic endoscope apparatus of FIG. 3 in the related art.

【図5】CCDにおける撮像領域を示し、図(A)は図
3の構成例の場合の図、図(B)は図4の構成例の場合
の図である。
5A and 5B show an image pickup area in a CCD, FIG. 5A is a diagram in the case of the configuration example of FIG. 3, and FIG. 5B is a diagram in the case of the configuration example of FIG.

【符号の説明】[Explanation of symbols]

1,5 … 光学レンズ系、 2,6 … プリズム、 3,10 … CCD、 12 … メモリ部、 13 … ズーム機能部、 15 … モニタ、 16 … マイコン。 1, 5 ... Optical lens system, 2, 6 ... Prism, 3, 10 ... CCD, 12 ... Memory section, 13 ... Zoom function section, 15 ... Monitor, 16 ... Microcomputer.

Claims (1)

【特許請求の範囲】[Claims] 【請求項1】 固体撮像素子から出力されたビデオ信号
に基づいてモニタに被観察体内の画像を表示する電子内
視鏡装置において、上記固体撮像素子で得られた画像を
所定倍率だけ拡大処理すると共に、この画像拡大に応じ
てモニタの表示マスクを拡大制御し、上記拡大画像を基
本画面としてモニタ上に表示することを特徴とする電子
内視鏡装置。
1. An electronic endoscope apparatus for displaying an image of an inside of an object to be observed on a monitor based on a video signal output from a solid-state image pickup device, wherein an image obtained by the solid-state image pickup device is enlarged by a predetermined magnification. At the same time, an electronic endoscope apparatus is characterized in that the display mask of the monitor is enlarged and controlled according to the image enlargement, and the enlarged image is displayed as a basic screen on the monitor.
JP6015827A 1994-01-14 1994-01-14 Electronic endoscope device Expired - Lifetime JP3059626B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP6015827A JP3059626B2 (en) 1994-01-14 1994-01-14 Electronic endoscope device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP6015827A JP3059626B2 (en) 1994-01-14 1994-01-14 Electronic endoscope device

Publications (2)

Publication Number Publication Date
JPH07209590A true JPH07209590A (en) 1995-08-11
JP3059626B2 JP3059626B2 (en) 2000-07-04

Family

ID=11899690

Family Applications (1)

Application Number Title Priority Date Filing Date
JP6015827A Expired - Lifetime JP3059626B2 (en) 1994-01-14 1994-01-14 Electronic endoscope device

Country Status (1)

Country Link
JP (1) JP3059626B2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10392670B4 (en) * 2002-05-16 2012-10-11 C2Cure Inc. Miniature camera head

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10392670B4 (en) * 2002-05-16 2012-10-11 C2Cure Inc. Miniature camera head

Also Published As

Publication number Publication date
JP3059626B2 (en) 2000-07-04

Similar Documents

Publication Publication Date Title
JP3732865B2 (en) Endoscope device
JP2003339636A (en) Amplification ratio automatic adjusting device for electronic endoscope apparatus
JPS6081979A (en) Image pickup device
JPS6281193A (en) Endoscope
JPH0458334B2 (en)
JP2005204741A (en) Electronic endoscope apparatus
JPH07209590A (en) Electronic endoscope device
US20010030684A1 (en) Electronic endoscope
JP2010051372A (en) Processor of endoscope, and method of masking endoscopic image
JPH10276973A (en) Electronic endoscope device
JPS6379631A (en) Endoscope imaging apparatus
JPH01270842A (en) Electronic endoscope device
JPH0463687B2 (en)
JP2002369794A (en) Electronic endoscope equipment
JP3140813B2 (en) Endoscope TV system
JP4105280B2 (en) Electronic endoscope apparatus and light source apparatus for electronic endoscope
JPS6354379B2 (en)
JP3458073B2 (en) Monitor shooting device for endoscope
JPS63117727A (en) Electronic endoscope apparatus
JP2002291690A (en) Electronic endoscope apparatus and electronic endoscope system
JP4370007B2 (en) Endoscope device
JPH05285102A (en) Endoscope system
JP4124875B2 (en) Electronic endoscope device capable of digital output
JP2007020762A (en) Processor and electronic endoscope system
JPH1147089A (en) Endoscope image pickup device

Legal Events

Date Code Title Description
S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313532

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R360 Written notification for declining of transfer of rights

Free format text: JAPANESE INTERMEDIATE CODE: R360

R371 Transfer withdrawn

Free format text: JAPANESE INTERMEDIATE CODE: R371

S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313532

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090421

Year of fee payment: 9

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090421

Year of fee payment: 9

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100421

Year of fee payment: 10

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100421

Year of fee payment: 10

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100421

Year of fee payment: 10

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110421

Year of fee payment: 11

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120421

Year of fee payment: 12

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130421

Year of fee payment: 13

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130421

Year of fee payment: 13

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140421

Year of fee payment: 14

EXPY Cancellation because of completion of term