JPH11113010A - Color television camera apparatus - Google Patents
Color television camera apparatusInfo
- Publication number
- JPH11113010A JPH11113010A JP9264229A JP26422997A JPH11113010A JP H11113010 A JPH11113010 A JP H11113010A JP 9264229 A JP9264229 A JP 9264229A JP 26422997 A JP26422997 A JP 26422997A JP H11113010 A JPH11113010 A JP H11113010A
- Authority
- JP
- Japan
- Prior art keywords
- signal
- channel
- component
- luminance signal
- television camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Transforming Light Signals Into Electric Signals (AREA)
- Color Television Image Signal Generators (AREA)
- Processing Of Color Television Signals (AREA)
Abstract
Description
【０００１】[0001]
【発明の属する技術分野】本発明は、固体撮像素子を用
いたカラーテレビジョンカメラ装置の映像信号処理回路
に関するものである。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video signal processing circuit for a color television camera using a solid-state image sensor.
【０００２】[0002]
【従来の技術】固体撮像素子を用いたカラーテレビジョ
ンカメラ装置では、固体撮像素子からの映像信号をサン
プリングする際に折り返し歪みが発生し、サンプリング
周波数が十分に高くない場合は、この折り返し歪みが映
像帯域内に入り込み、再生画像にモアレを発生させて画
質を劣化させる。この折り返し歪みを低減させる方法と
して、「空間画素ずらし」と呼ばれる方法が、特公昭５
５−１９５５３号公報に示されている。この方法は、図
３に示すように、例えば、Ｇ(緑)チャネルのＣＣＤの受
光部(撮像部)の各素子を、Ｒ(赤)チャネル、Ｂ(青)チャ
ネルの各ＣＣＤの受光部(撮像部)の各素子に対して、水
平走査方向に、水平走査方向の画素間隔Ｐｘの１／２だ
けずらして配置している。このように各ＣＣＤを配置す
ることで、Ｇチャネルの映像信号に対して、Ｒ，Ｂチャ
ネルの映像信号は、位相が１８０度ずれることになる。2. Description of the Related Art In a color television camera device using a solid-state imaging device, aliasing distortion occurs when sampling a video signal from the solid-state imaging device. If the sampling frequency is not sufficiently high, the aliasing distortion is reduced. It enters the video band and causes moire in the reproduced image to degrade the image quality. As a method of reducing this aliasing distortion, a method called “space pixel shift” is disclosed in
No. 5,195,553. In this method, as shown in FIG. 3, for example, each element of a light receiving unit (imaging unit) of a CCD of G (green) channel is connected to a light receiving unit of each CCD of R (red) channel and B (blue) channel. Each of the elements of the imaging section is shifted in the horizontal scanning direction by の of the pixel interval Px in the horizontal scanning direction. By arranging the CCDs in this manner, the R and B channel video signals are 180 degrees out of phase with the G channel video signal.
【０００３】輝度信号(以下、Ｙ信号と略記する)成分Ｙ
は、Ｒチャネルの信号レベルをＲ，Ｇチャネルの信号レ
ベルをＧ，Ｂチャネルの信号レベルをＢとして表すと、
例えば、ＮＴＳＣ方式では（１）式に示すマトリクス構
成で与えられる。 Ｙ＝０.３０×Ｒ＋０.５９×Ｇ＋０.１１×Ｂ ・・・・・ （１） このマトリクス演算によって得られるＹ信号は、図５に
示すように、Ｇチャネルの折り返し歪み成分と、Ｒ，Ｂ
チャネルの折り返し歪み成分とで部分的に相殺され、折
り返し歪み成分は低減するが、空間画素ずらし手法を用
いた場合でも、Ｙ信号の折り返し成分による歪みは、
（１）式のマトリクス比より、Ｇチャネルの折り返し歪
み成分を正と仮定すると、Ｒ，Ｂチャネルの折り返し歪
み成分は、位相が１８０度ずれているので負となる。よ
って、Ｙ信号の折り返し歪みを考えると、 （Ｇ比率)−(Ｒ比率＋Ｂ比率)＝０.５９−(０.３０＋
０.１１)＝０.１８ 即ち、Ｙ信号の相対利得の１８％程度の折り返し歪みが
残留することになる。これが原因となり、高周波数帯域
では、映像信号より折り返し歪み成分の方が多くなるた
め、高解像度化には限界があった。A luminance signal (hereinafter abbreviated as Y signal) component Y
Is expressed as R signal level of R channel, G signal level of G channel, and B signal level of B channel.
For example, in the NTSC system, it is given by the matrix configuration shown in equation (1). Y = 0.30 × R + 0.59 × G + 0.11 × B (1) As shown in FIG. 5, the Y signal obtained by this matrix operation has a G channel aliasing component and R, B
Although this is partially offset by the aliasing component of the channel and the aliasing component is reduced, even when the spatial pixel shifting method is used, the distortion due to the aliasing component of the Y signal is:
Assuming that the aliasing component of the G channel is positive from the matrix ratio of the equation (1), the aliasing components of the R and B channels are negative because the phase is shifted by 180 degrees. Therefore, considering the aliasing distortion of the Y signal, (G ratio) − (R ratio + B ratio) = 0.59− (0.30+
0.11) = 0.18 That is, aliasing distortion of about 18% of the relative gain of the Y signal remains. For this reason, in the high frequency band, the number of aliasing components is larger than that of the video signal.
【０００４】この折り返し歪み成分を完全に打ち消すに
は、Ｇチャネルの信号と、Ｒチャネルの信号およびＢチ
ャネルの信号を加算したものの比率を１：１にするとよ
い。しかし、この条件では、Ｙ信号の構成マトリクス比
を満足することができない。そこで、折り返し歪みの影
響が大きいのはＹ信号の高域成分であることに着目し、
Ｙ信号成分を低域成分信号ＹL(以下、ＹLと略記する)と
高域成分信号ＹH(以下、ＹHと略記する)に分離した、図
２に示す様な構成を採用しているものもある。図２の従
来例は、Ｙ信号の内、折り返し歪み成分の小さい低域成
分ＹL は、(１)式を満たすマトリクス構成となるマトリ
クス回路１の出力信号に低域通過型フィルタ(図中で
は、ＬＰＦと略記する)処理を施し、折り返し歪み成分
の大きい高域成分ＹH は、Ｇチャネルの信号に対し、Ｒ
チャネルの信号とＢチャネルの信号を加算したものの比
率が１：１となる別のマトリクス構成のマトリクス回路
２の出力信号に高域通過型フィルタ(図中では、ＨＰＦ
と略記する)処理を施し、これらＹLとＹHを加算したも
のを第２のＹ信号(図中では、Ｙ’信号と略記する)とし
て出力する構成となっている。In order to completely cancel the aliasing component, the ratio of the G channel signal to the sum of the R channel signal and the B channel signal is preferably set to 1: 1. However, under this condition, the configuration matrix ratio of the Y signal cannot be satisfied. Focusing on the fact that the influence of aliasing is large in the high frequency component of the Y signal,
The Y signal component a low-frequency component signal Y L (hereinafter, Y L abbreviated) and the high-frequency component signal Y H (hereinafter, abbreviated as Y H) was separated into adopts a configuration as shown in FIG. 2 Some are. In the conventional example of FIG. 2, the low-frequency component Y L having a small aliasing component in the Y signal is supplied to the output signal of the matrix circuit 1 having a matrix configuration that satisfies the expression (1) by a low-pass filter (in FIG. , LPF), and a high-frequency component Y H having a large aliasing distortion component is added to the signal of the G channel by R R
A high-pass filter (in the figure, an HPF) is added to the output signal of the matrix circuit 2 having another matrix configuration in which the ratio of the sum of the channel signal and the B channel signal is 1: 1.
Applying abbreviated) processing, in a material obtained by adding these Y L and Y H second Y signal (in the figure, and has a configuration for outputting as Y 'signal and abbreviated).
【０００５】[0005]
【発明が解決しようとする課題】前述した従来例は、折
り返し歪み成分を低減させることで、折り返し歪み成分
により打ち消されていた分の解像度を引き出しているに
過ぎないため、高解像度化には限界があるという問題点
がある。本発明は、これらの欠点を除去し、Ｙ信号を生
成する信号成分を、Ｇチャネルの信号成分を示す信号
(以下、ＹG 信号と称す)と、Ｒチャネルの信号とＢチャ
ネルの信号を混合した信号成分を示す信号(以下、ＹRB
信号と称す)とに分離し、これらを合成することで、解
像度特性の改善を図ることを目的とした。In the above-mentioned conventional example, since the aliasing component is reduced, only the resolution that has been canceled by the aliasing component is extracted, and there is a limit to increasing the resolution. There is a problem that there is. The present invention eliminates these drawbacks, and converts a signal component for generating a Y signal into a signal indicating a G-channel signal component.
(Hereinafter, referred to as a Y G signal) and a signal indicating a signal component obtained by mixing the R channel signal and the B channel signal (hereinafter, Y RB signal).
(Referred to as a signal) and combining them to improve resolution characteristics.
【０００６】[0006]
【課題を解決するための手段】本発明は、上記目的を達
成するため、空間画素ずらしを適用したカラーテレビジ
ョンカメラ装置において、ディジタル信号処理されたＧ
チャネルの映像信号に第１のマトリクス比率を乗算し第
１の輝度信号成分(ＹG )を生成する演算手段と、Ｒ、Ｂ
チャネルの映像信号にそれぞれ第２、第３のマトリクス
比率を乗算して加算し第２の輝度信号成分(ＹRB)を生成
する演算手段と、当該生成された第１の輝度信号成分
(ＹG )と第２の輝度信号成分(ＹRB)を倍速処理にてサン
プリングする手段と、これにより得られる輝度信号成分
の内上記所定サンプリング周波数以下の信号成分を抽出
するよう帯域制限して第３の輝度信号を得る手段を有す
る構成としたものである。また、上記第１のマトリクス
比率を０．５９とし、上記第２のマトリクス比率を０．
３０とし、第３のマトリクス比率を０．１１としたもの
である。その結果、本発明によれば、得られるＹ信号の
サンプル周波数(ＦS )は、倍速処理することで２倍とな
り、ＦS／２以上、ＦS以下の周波数成分の信号を、再生
することが可能となり、高解像度のＹ信号を提供するこ
とができる。SUMMARY OF THE INVENTION In order to achieve the above object, the present invention provides a color television camera apparatus to which spatial pixel shift is applied, in which a digital signal processed G
Calculating means for multiplying the video signal of the channel by a first matrix ratio to generate a first luminance signal component (Y G );
Calculating means for multiplying and adding the video signals of the channels by the second and third matrix ratios to generate a second luminance signal component (Y RB ); and the generated first luminance signal component
Means for sampling (Y G ) and the second luminance signal component (Y RB ) by double-speed processing, and limiting the band so as to extract a signal component of the predetermined sampling frequency or less from the luminance signal components obtained by this. This is a configuration having means for obtaining a third luminance signal. Further, the first matrix ratio is set to 0.59, and the second matrix ratio is set to 0.
30 and the third matrix ratio is set to 0.11. As a result, according to the present invention, the sampling frequency (F S ) of the obtained Y signal is doubled by performing the double-speed processing, and a signal having a frequency component of F S / 2 or more and F S or less is reproduced. And a high-resolution Y signal can be provided.
【０００７】[0007]
【発明の実施の形態】本発明の一実施例を図１のブロッ
ク図に示し、以下に説明する。入力端１，２，３に入力
したディジタル信号処理後のＧチャネルの信号（以下、
Ｇ信号と略記する）、Ｒチャネルの信号(以下、Ｒ信号
と略記する)、Ｂチャネルの信号(以下、Ｂ信号と略記す
る)は、マトリクス回路４に入力され、後述のＹG信号８
とＹRB信号９を生成する。そして、倍速変換部５で、Ｙ
G 信号８とＹRB信号９を以降の処理が倍速処理になるよ
うに並べ替え、サンプリング周波数(ＦS）の２倍のクロ
ックレートで出力し、不要な周波数成分はフィルタ６で
帯域制限する。これにより、フィルタ処理後、出力端７
には高解像度特性を実現するＹ’信号を出力する構成と
なっている。DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention is shown in the block diagram of FIG. 1 and will be described below. G-channel signal after digital signal processing input to the input terminals 1, 2, 3 (hereinafter, referred to as
A G signal), an R-channel signal (hereinafter abbreviated as an R signal), and a B-channel signal (hereinafter abbreviated as a B signal) are input to a matrix circuit 4, and a Y G signal 8 to be described later.
And a Y RB signal 9 are generated. Then, in the double speed conversion unit 5, Y
The G signal 8 and the Y RB signal 9 are rearranged so that the subsequent processing is double-speed processing, output at a clock rate twice the sampling frequency (F S ), and unnecessary frequency components are band-limited by the filter 6. Thereby, after the filtering process, the output terminal 7
Is configured to output a Y 'signal for realizing high resolution characteristics.
【０００８】以下本発明を、ＮＴＳＣ方式のカラーテレ
ビジョンカメラ装置を例として説明する。ＮＴＳＣ方式
のマトリクス比が、従来技術の前記（１）式に示す構成
であったとすると、マトリクス回路４で生成されるＹG
信号８とＹRB信号９は、 ＹG ＝０.５９×Ｇ ・・・・・ （２） ＹRB＝０.３０×Ｒ＋０.１１×Ｂ ・・・・・ （３） の比率の信号として表せる。倍速変換部５では、Ｒ／Ｂ
信号とＧ信号が空間画素ずらし処理にて、実際には１／
２画素ずれているので、図４に示すように、空間画素ず
らし処理に対応した位置に、ＹG 信号８とＹRB信号９を
交互に並べていき、２倍のサンプル周波数でサンプリン
グし直すことで、容易に倍速変換が可能となる。フィル
タ６では、倍速変換部５の信号をＹ信号に変換し、折り
返し歪みが生じないように２倍のサンプリング周波数の
１／２、すなわち、サンプリング周波数(ＦS)付近の信
号は完全に遮断する低域通過型フィルタを用いればよ
い。ここで、本実施例では、ＹG 信号８とＹRB信号９の
比率が、０.５９：０.４１となっており、例えば、白色
部分のようなＲ，Ｇ，Ｂ信号の比率が１：１：１の時に
は、リップルが生じないようなフィルタ係数を選択しな
ければならない。このようにして、倍速処理した高解像
度のＹ信号を提供することができる。Hereinafter, the present invention will be described by taking an NTSC color television camera device as an example. Assuming that the matrix ratio of the NTSC system is the configuration shown in the above-mentioned formula (1) of the prior art, the Y G
The signal 8 and the Y RB signal 9 are signals having a ratio of Y G = 0.59 × G (2) Y RB = 0.30 × R + 0.11 × B (3) Can be expressed. In the double speed converter 5, R / B
The signal and the G signal are actually shifted by 1 /
Since the two pixels are shifted, as shown in FIG. 4, the Y G signal 8 and the Y RB signal 9 are alternately arranged at positions corresponding to the spatial pixel shifting process, and re-sampled at twice the sampling frequency. Thus, double-speed conversion can be easily performed. In the filter 6 converts the signal of the double speed conversion unit 5 in the Y signal, 1/2 of a sampling frequency twice so as not to cause aliasing, i.e., the sampling frequency (F S) signal near the completely blocks A low-pass filter may be used. Here, in the present embodiment, the ratio of the Y G signal 8 to the Y RB signal 9 is 0.59: 0.41. For example, the ratio of the R, G, B signals such as the white portion is 1 In the case of 1: 1, it is necessary to select a filter coefficient that does not cause ripple. In this way, a double-resolution processed high-resolution Y signal can be provided.
【０００９】[0009]
【発明の効果】以上説明した如く本発明によれば、最終
段のフィルタ処理により折り返し歪み成分は生じず、Ｙ
G 信号とＹRB信号を生成するまでは通常のサンプリング
周波数で動作し、それ以降のＹ信号を生成する部分のみ
倍速処理で動作させることで、高解像度な輝度信号を提
供可能なカラーテレビジョンカメラ装置を実現すること
ができる。As described above, according to the present invention, no aliasing distortion component is generated by the final stage filtering, and Y
A color television camera capable of providing a high-resolution luminance signal by operating at a normal sampling frequency until the G signal and the Y RB signal are generated, and by operating the subsequent portion for generating the Y signal at double speed processing. The device can be realized.
【図１】本発明の輝度信号処理部の一実施例を示すブロ
ック図FIG. 1 is a block diagram showing one embodiment of a luminance signal processing unit of the present invention.
【図２】従来構成の輝度信号処理部の一例を示すブロッ
ク図FIG. 2 is a block diagram illustrating an example of a luminance signal processing unit having a conventional configuration.
【図３】空間画素ずらし手法を説明する図FIG. 3 is a diagram for explaining a spatial pixel shifting method;
【図４】本発明の倍速変換部５の動作を説明する図FIG. 4 is a diagram for explaining the operation of the double speed conversion unit 5 of the present invention.
【図５】Ｙ信号、Ｒ／Ｂ信号等における折り返し歪みを
説明する図FIG. 5 is a diagram illustrating aliasing distortion in a Y signal, an R / B signal, and the like.
１，２，３：入力端、４：マトリクス回路、５：倍速変
換部、６：フィルタ、７：出力端。1, 2, 3: input terminals, 4: matrix circuit, 5: double speed conversion unit, 6: filter, 7: output terminal.
Claims (2)
１の固体撮像素子の各受光素子がＲ(赤)、Ｂ(青)チャネ
ルの映像信号をそれぞれ生成する第２、第３の各固体撮
像素子の対応する各受光素子に対して水平走査方向に当
該画素間隔の１／２だけずらして配置されており、上記
第１の固体撮像素子を所定サンプリング周波数でサンプ
リングするための第１のサンプリング手段と、上記第
２、第３の固体撮像素子を上記所定サンプリング周波数
で、かつ上記第１のサンプリング手段に対して位相が１
８０度ずれるようにサンプリングするための第２のサン
プリング手段と、上記Ｇ、Ｒ、Ｂチャネルの映像信号を
それぞれディジタル化し信号処理するディジタル信号処
理手段を有するカラーテレビジョンカメラ装置におい
て、上記ディジタル信号処理手段のＧチャネルの映像信
号に第１のマトリクス比率を乗算し第１の輝度信号成分
(ＹG )を生成する演算手段と、上記Ｒ、Ｂチャネルの映
像信号にそれぞれ第２、第３のマトリクス比率を乗算し
て加算し第２の輝度信号成分(ＹRB)を生成する演算手段
と、当該生成された第１の輝度信号成分(ＹG )と第２の
輝度信号成分(ＹRB)を倍速処理にてサンプリングする手
段と、これにより得られる輝度信号成分の内上記所定サ
ンプリング周波数以下の信号成分を抽出するよう帯域制
限して第３の輝度信号を得る手段を有することを特徴と
するカラーテレビジョンカメラ装置。1. A light receiving element of a first solid-state image sensor for generating a video signal of a G (green) channel generates second and third video signals of a R (red) and B (blue) channel, respectively. The first solid-state imaging device is arranged so as to be shifted from the corresponding light-receiving device of each solid-state imaging device by a half of the pixel interval in the horizontal scanning direction, and to sample the first solid-state imaging device at a predetermined sampling frequency. And the second and third solid-state imaging devices are set at the predetermined sampling frequency and have a phase of 1 with respect to the first sampling unit.
In a color television camera apparatus having a second sampling means for sampling so as to shift by 80 degrees and a digital signal processing means for digitizing and processing each of the video signals of the G, R and B channels, Means for multiplying the G channel video signal by a first matrix ratio to obtain a first luminance signal component
Calculating means for generating (Y G ) and calculating means for multiplying the video signals of the R and B channels by second and third matrix ratios and adding them to generate a second luminance signal component (Y RB ) Means for sampling the generated first luminance signal component (Y G ) and the second luminance signal component (Y RB ) by double speed processing, and the predetermined sampling frequency among the luminance signal components obtained thereby. A color television camera device comprising means for obtaining a third luminance signal by band-limiting so as to extract the following signal components.
メラ装置において、上記第１のマトリクス比率を０．５
９、上記第２のマトリクス比率を０．３０、第３のマト
リクス比率を０．１１としたことを特徴とするカラーテ
レビジョンカメラ装置。2. The color television camera device according to claim 1, wherein said first matrix ratio is 0.5.
9. A color television camera device, wherein the second matrix ratio is 0.30 and the third matrix ratio is 0.11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP26422997A JP3673068B2 (en) | 1997-09-29 | 1997-09-29 | Color television camera device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP26422997A JP3673068B2 (en) | 1997-09-29 | 1997-09-29 | Color television camera device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JPH11113010A true JPH11113010A (en) | 1999-04-23 |
| JP3673068B2 JP3673068B2 (en) | 2005-07-20 |
Family
ID=17400295
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP26422997A Expired - Fee Related JP3673068B2 (en) | 1997-09-29 | 1997-09-29 | Color television camera device |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP3673068B2 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011114793A (en) * | 2009-11-30 | 2011-06-09 | Mitsubishi Electric Corp | Method for generating luminance signal, 3-ccd image pickup apparatus |
-
1997
- 1997-09-29 JP JP26422997A patent/JP3673068B2/en not_active Expired - Fee Related
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011114793A (en) * | 2009-11-30 | 2011-06-09 | Mitsubishi Electric Corp | Method for generating luminance signal, 3-ccd image pickup apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| JP3673068B2 (en) | 2005-07-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP3242515B2 (en) | Imaging device | |
| JP3735867B2 (en) | Luminance signal generator | |
| KR100247371B1 (en) | Color television camera apparatus and color television signal generating method | |
| JPH08172636A (en) | Image pickup device | |
| JP4641675B2 (en) | Image signal processing device | |
| JP2611269B2 (en) | Signal processing device for solid-state imaging device | |
| EP0421433A2 (en) | Signal processing circuit for solid-state imaging apparatus | |
| US5349381A (en) | Video camera with aperture correction having reduced power consumption | |
| JPH033996B2 (en) | ||
| JP3673068B2 (en) | Color television camera device | |
| JPH0223076B2 (en) | ||
| JP3613071B2 (en) | Imaging device | |
| JP3263850B2 (en) | Signal processing circuit and image display device | |
| JP3038738B2 (en) | Signal processing circuit of solid-state imaging device | |
| JP2000341710A (en) | Image pickup device | |
| JP3084719B2 (en) | Signal processing circuit of solid-state imaging device | |
| JPH10164604A (en) | Video signal processing circuit | |
| JPS59108491A (en) | Image pickup device | |
| JPH06113310A (en) | Video-signal processing apparatus | |
| JPS63164589A (en) | Solid state image pickup device | |
| KR100281787B1 (en) | Video camera | |
| JP2002354492A (en) | Multi-lens and multi-ccd type image pickup device | |
| JP3013479B2 (en) | Color television camera device | |
| JP3232576B2 (en) | Color television camera device | |
| JPH08256345A (en) | Image pickup device and image signal processor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20041112 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20041129 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20050128 |
|
| TRDD | Decision of grant or rejection written | ||
| A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20050418 |
|
| A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20050421 |
|
| R150 | Certificate of patent or registration of utility model |
Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20090428 Year of fee payment: 4 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20100428 Year of fee payment: 5 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20110428 Year of fee payment: 6 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120428 Year of fee payment: 7 |
|
| LAPS | Cancellation because of no payment of annual fees |