JP4285862B2 - Building 3D data update method - Google Patents

Building 3D data update method Download PDF

Info

Publication number
JP4285862B2
JP4285862B2 JP32780399A JP32780399A JP4285862B2 JP 4285862 B2 JP4285862 B2 JP 4285862B2 JP 32780399 A JP32780399 A JP 32780399A JP 32780399 A JP32780399 A JP 32780399A JP 4285862 B2 JP4285862 B2 JP 4285862B2
Authority
JP
Japan
Prior art keywords
building
data
computer
image
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
JP32780399A
Other languages
Japanese (ja)
Other versions
JP2001143104A (en
Inventor
孝平 嶋本
秀人 佐藤
昌博 井久保
隆大 野口
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Asia Air Survey Co Ltd
Original Assignee
Asia Air Survey Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Asia Air Survey Co Ltd filed Critical Asia Air Survey Co Ltd
Priority to JP32780399A priority Critical patent/JP4285862B2/en
Publication of JP2001143104A publication Critical patent/JP2001143104A/en
Application granted granted Critical
Publication of JP4285862B2 publication Critical patent/JP4285862B2/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Landscapes

  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
  • Image Generation (AREA)
  • Image Analysis (AREA)

Description

【0001】
【発明の属する技術分野】
本発明は、写真測量手法により求めた3次元データを利用した3次元画像処理技術に関するものであり、特に、建物の3次元データを更新する方法に関するものである。
【0002】
【従来の技術】
近年、人工衛星または航空機等から垂直写真を撮影し、該垂直写真より得た画像データを基にして、3次元計測を行い、都市部の建物の3次元CADデータを作成することが行われるようになってきている。
【0003】
【発明が解決しようとする課題】
ところが、都市部においては、建物の新築或いは改築等が頻繁に行われるため、極めて短い周期で建物の3次元データを更新する必要がある。また、垂直写真では写真1枚当たりのカバー領域が狭く、さらに壁面等鉛直部分の確認が困難であった。そのため、従来の方法で建物の3次元データを更新しようとすると、その度に非常に多くの枚数の垂直写真を撮影する必要があり、更新作業に掛かるコストが割高となり、また更新作業の効率化及び省力化が図り難いという問題があった。
【0004】
そこで、本発明の目的は、前述した問題点を解決すべく、更新作業のコスト低減化、効率化及び省力化を図ることのできる建物の3次元データ更新方法を提供しようとするものである。
【0005】
【課題を解決するための手段】
本発明による建物の3次元データ更新方法は、斜め写真を基に実写画像を作成すると共に既存の都市3次元データを基に前記実写画像と同じ視点から見通したシミュレーション画像を作成し、前記実写画像と前記シミュレーション画像を同一画面上に表示し対比し、両画像の相違点を目視確認し、該相違点を基に前記既存の建物3次元データを更新することを特徴する。
【0006】
本発明の1つの実施の形態によれば、前記斜め写真が見通しの良好な建物から撮影した地上写真である。
【0007】
本発明の更に別の実施の形態によれば、前記実写画像と前記シミュレーション画像との対比の結果、新規建物が確認された場合、前記斜め写真から前記新規建物を3次元計測し、該新規建物の3次元データを作成し、該新規建物の3次元データを前記既存の都市3次元データに付加する。
【0008】
本発明の別の実施の形態によれば、前記実写画像と前記シミュレーション画像との対比の結果、変更された建物が確認された場合、該建物の変更部分を基に、前記既存の建物3次元データを変更する。
【0009】
本発明の更に別の実施の形態によれば、前記実写画像と前記シミュレーション画像との対比の結果、変更された建物壁面テクスチャーが確認された場合、該変更された建物壁面テクスチャーデータを前記斜め写真から取得し、該建物壁面テクスチャーデータを前記既存の都市3次元データに付加する。
【0010】
本発明の更に別の実施の形態によれば、前記変更された建物壁面テクスチャーの一部分が確認された場合、該変更された建物壁面テクスチャーデータを前記斜め写真から取得し、該変更された建物壁面テクスチャーデータを予め記憶されたその建物の高さに応じて拡張修正し、該拡張修正したテクスチャーデータを前記既存の都市3次元データに付加する。
【0011】
【発明の実施の形態】
図面を参照しつつ、本発明の実施の形態を説明する。
【0012】
図1は本発明による建物の3次元データ更新方法を示すフローチャートである。
【0013】
先ず、都市部の見通しの良好な高層建物を複数箇所選択し、該各高層建物の屋上及び中間階からそれぞれパノラマカメラ(35ミリ、6×6版等)により上下ステレオ地上斜め写真を撮影すると共にその屋上の複数地点からそれぞれメトリックカメラ(35ミリ、6×6版等)により左右ステレオ地上斜め写真を撮影する(ステップ101)。また、前記各高層建物の屋上等から対象領域をカバーするように各方向の地上斜め単写真を撮影する(ステップ101)。そして、撮影した前記各地上斜め写真をコンピュータで直接扱えるように、アナログ−デジタル(A/D)変換し(ステップ102)、実写画像データを作成する(ステップ103)。前記ステレオ地上斜め写真はパノラマカメラまたはメトリックカメラにより撮影しているが、CCDカメラ等のデジタルカメラで撮影してもよく、その場合には、撮影後の処理をディジタルで行い直接ディジタルデータを取得できるため、前記アナログ−デジタル変換を行う必要はない。
【0014】
次に、前記実写画像データを基に実写画像を作成すると共に従来と同様の方法で取得した既存の都市3次元データを基に前記実写画像と同じ視点から見通したシミュレーション画像を作成し、前記実写画像と前記シミュレーション画像をコンピュータの同一画面上に表示し対比する(ステップ104)。両画像を1対1で対応づけ、また必要に応じて両画像を重ね合わせ、両画像の相違点を目視で確認する(ステップ105)。
【0015】
前記実写画像と前記シミュレーション画像との対比の結果、新規建物が確認された場合(ステップ106)には、前記地上斜め写真から前記新規建物を3次元計測し、該新規建物の3次元データを作成する(ステップ107)。この地上斜め写真から3次元計測する方法は、本出願人が発明し、特許出願(特願平10−152243)した「パノラマカメラを用いたステレオ3次元計測方法および装置」に開示されているように、1次元のステレオマッチングにより3次元データを得るものである。その後、前記新規建物の3次元データを前記既存の都市3次元データに付加する(ステップ108)。
【0016】
また、前記実写画像と前記シミュレーション画像との対比の結果、変更された建物が確認された場合(ステップ109)には、該建物の変更部分を基に、前記既存の都市3次元データを変更する(ステップ110)。
【0017】
更に、前記実写画像と前記シミュレーション画像との対比の結果、変更された建物壁面テクスチャーが確認された場合(ステップ111)には、該建物壁面テクスチャーを画面上でクリックして選択し、該建物壁面テクスチャーの変更範囲を指定し、該変更された建物壁面テクスチャーデータを前記地上斜め写真から取得し(ステップ112)、該建物壁面テクスチャーデータを前記既存の都市3次元データに付加する(ステップ113)。このテクスチャーの付加は、傾斜した建物壁面をクロスターム付きアッフィン変換により矩形の建物壁面に変換して行う。
【0018】
また、前記変更された建物壁面テクスチャーの一部分しか画面表示されていない場合には、該変更された建物壁面テクスチャーデータを前記地上斜め写真から取得し、該建物壁面テクスチャーデータの高さと予め記憶されたその建物の高さを比較して前記変更された建物壁面テクスチャーデータを拡張修正し、その後、該拡張修正したテクスチャーデータを前記既存の都市3次元データに付加する。なお、この時、前記変更された建物壁面テクスチャーデータの拡張修正、付加の一連の作業は、コンピュータで自動的に行わせてもよいことは言うまでもない。
【0019】
以上説明したように、必要に応じて、それぞれ、新規建物、変更された建物、及び変更された建物壁面テクスチャーの3次元データを更新することにより建物の3次元データの更新を行う(ステップ114)。
【0020】
このようにして更新された建物の3次元データを使用すると、コンピュータ上でインタラクティブに視点を自由自在に変化させた鳥瞰画像を得ることができ、所望の視点から都市を見通すことができるようになる。したがって、机上において、マイクロ波及びミリ波の無線ルートが確保できるかどうかについて見極め、基地局と受信局の位置を検討することができるようになる。
【0021】
なお、上記実施の形態においては、都市部の見通しの良好な高層建物の屋上等から撮影した地上斜め写真を使用しているが、ヘリコプタまたは航空機等から撮影した航空斜め写真等の他の斜め写真を使用してもよい。
【0022】
【発明の効果】
以上述べた如く、本発明では、垂直写真と比較して写真1枚当たりのカバー領域の広い斜め写真を使用しているので、更新作業に要する写真の枚数を最小限に抑えることができ、また、壁面等鉛直部分の確認を迅速かつ容易に行うことできる。したがって、本発明によれば、更新作業のコスト低減化、効率化及び省力化を図ることが可能となる。
【図面の簡単な説明】
【図1】本発明による建物の3次元データ更新方法を示すフローチャートである。
[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a three-dimensional image processing technique using three-dimensional data obtained by a photogrammetry technique, and more particularly to a method for updating three-dimensional data of a building.
[0002]
[Prior art]
In recent years, a vertical photograph is taken from an artificial satellite or an aircraft, and three-dimensional measurement is performed based on image data obtained from the vertical photograph to create three-dimensional CAD data of a building in an urban area. It is becoming.
[0003]
[Problems to be solved by the invention]
However, in urban areas, buildings are frequently rebuilt or renovated, and therefore it is necessary to update the three-dimensional data of the buildings with a very short period. Further, in a vertical photo, the cover area per photo is narrow, and it is difficult to confirm vertical portions such as wall surfaces. For this reason, if it is attempted to update the 3D data of a building using the conventional method, it is necessary to take a very large number of vertical photographs each time, which increases the cost of the update work and increases the efficiency of the update work. In addition, there is a problem that it is difficult to save labor.
[0004]
SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to provide a three-dimensional data update method for a building that can reduce the cost, efficiency, and labor saving of update work in order to solve the above-described problems.
[0005]
[Means for Solving the Problems]
The method for updating three-dimensional data of a building according to the present invention creates a live-action image based on an oblique photograph, creates a simulation image viewed from the same viewpoint as the live-action image based on existing city three-dimensional data, and And the simulation image are displayed on the same screen and compared, the difference between the two images is visually confirmed, and the existing three-dimensional data of the building is updated based on the difference.
[0006]
According to one embodiment of the present invention, the oblique photograph is a ground photograph taken from a building with good visibility.
[0007]
According to still another embodiment of the present invention, when a new building is confirmed as a result of the comparison between the real image and the simulation image, the new building is three-dimensionally measured from the oblique photograph, and the new building is measured. Are created, and the three-dimensional data of the new building is added to the existing three-dimensional data of the city.
[0008]
According to another embodiment of the present invention, when a changed building is confirmed as a result of the comparison between the photographed image and the simulation image, the existing building 3D is based on the changed portion of the building. Change the data.
[0009]
According to still another embodiment of the present invention, when a changed building wall texture is confirmed as a result of the comparison between the photographed image and the simulation image, the changed building wall texture data is used as the oblique photograph. And the building wall surface texture data is added to the existing city three-dimensional data.
[0010]
According to still another embodiment of the present invention, when a part of the changed building wall texture is confirmed, the changed building wall texture data is acquired from the oblique photograph, and the changed building wall texture is obtained. The texture data is expanded and corrected according to the height of the building stored in advance, and the expanded and corrected texture data is added to the existing three-dimensional city data.
[0011]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described with reference to the drawings.
[0012]
FIG. 1 is a flowchart illustrating a method for updating three-dimensional building data according to the present invention.
[0013]
First, select a number of high-rise buildings with good prospects in urban areas, and take up and down stereo ground diagonal photographs from the roof and middle floor of each high-rise building with panoramic cameras (35mm, 6x6 version, etc.) respectively. Left and right stereo ground oblique photographs are taken from a plurality of points on the roof by metric cameras (35 mm, 6 × 6 version, etc.) (step 101). In addition, a single oblique ground photograph in each direction is taken so as to cover the target area from the rooftop of each of the high-rise buildings (step 101). Then, the photographed ground oblique photographs are subjected to analog-digital (A / D) conversion so that they can be directly handled by a computer (step 102), and photographed image data is created (step 103). The stereo ground oblique photograph is taken by a panoramic camera or a metric camera, but it may be taken by a digital camera such as a CCD camera. In that case, digital processing can be performed directly after the photographing and digital data can be directly acquired. Therefore, it is not necessary to perform the analog-digital conversion.
[0014]
Next, a live-action image is created based on the live-action image data, and a simulation image viewed from the same viewpoint as the live-action image is created based on existing city three-dimensional data acquired by a method similar to the conventional method. The image and the simulation image are displayed on the same screen of the computer and compared (step 104). The two images are associated one-to-one, and the two images are superimposed as necessary, and the difference between the two images is visually confirmed (step 105).
[0015]
If a new building is confirmed as a result of the comparison between the actual image and the simulation image (step 106), the new building is measured three-dimensionally from the oblique photograph on the ground, and three-dimensional data of the new building is created. (Step 107). The method of three-dimensional measurement from the ground oblique photograph is disclosed in the “stereo three-dimensional measurement method and apparatus using a panoramic camera” invented by the present applicant and applied for a patent (Japanese Patent Application No. 10-152243). In addition, three-dimensional data is obtained by one-dimensional stereo matching. Thereafter, the three-dimensional data of the new building is added to the existing three-dimensional data of the city (step 108).
[0016]
Further, when the changed building is confirmed as a result of the comparison between the photographed image and the simulation image (step 109), the existing city three-dimensional data is changed based on the changed portion of the building. (Step 110).
[0017]
Furthermore, when the changed building wall texture is confirmed as a result of the comparison between the actual image and the simulation image (step 111), the building wall texture is selected by clicking on the screen, and the building wall texture is selected. A texture change range is designated, the changed building wall texture data is acquired from the oblique ground photograph (step 112), and the building wall texture data is added to the existing city three-dimensional data (step 113). This texture is added by converting the inclined building wall surface into a rectangular building wall surface by cross-term Affine transformation.
[0018]
Further, when only a part of the changed building wall texture is displayed on the screen, the changed building wall texture data is acquired from the oblique oblique photograph, and the height of the building wall texture data is stored in advance. The changed building wall texture data is expanded and corrected by comparing the heights of the buildings, and then the expanded and corrected texture data is added to the existing city three-dimensional data. At this time, it goes without saying that a series of operations of the extended correction and addition of the changed building wall texture data may be automatically performed by a computer.
[0019]
As described above, the three-dimensional data of the building is updated by updating the three-dimensional data of the new building, the changed building, and the changed building wall texture, respectively, as necessary (step 114). .
[0020]
By using the three-dimensional data of the building updated in this way, it is possible to obtain a bird's-eye view image in which the viewpoint is freely changed interactively on the computer, and to see the city from a desired viewpoint. . Therefore, it is possible to determine whether or not microwave and millimeter wave radio routes can be secured on the desk and to examine the positions of the base station and the receiving station.
[0021]
In the above embodiment, an oblique ground photograph taken from the top of a high-rise building with a good view of the city is used, but another oblique photograph such as an oblique aerial photograph taken from a helicopter or an aircraft. May be used.
[0022]
【The invention's effect】
As described above, in the present invention, the oblique photograph having a wide cover area per photograph as compared with the vertical photograph is used, so that the number of photographs required for the update work can be minimized. In addition, confirmation of vertical parts such as wall surfaces can be performed quickly and easily. Therefore, according to the present invention, it is possible to reduce the cost, efficiency, and labor saving of the update work.
[Brief description of the drawings]
FIG. 1 is a flowchart showing a method for updating three-dimensional building data according to the present invention.

Claims (6)

パノラマカメラにより撮影された上下ステレオ地上斜め写真と、メトリックカメラにより撮影された左右ステレオ地上斜め写真とを、コンピュータによりアナログ−デジタル変換して実写画像を作成し、前記コンピュータにより既存の都市3次元データを基に前記実写画像と同じ視点から見通したシミュレーション画像を作成し、前記実写画像と前記シミュレーション画像を前記コンピュータの同一画面上に表示し、前記実写画像と前記シミュレーション画像両画像の相違点を基に前記コンピュータにより前記既存の都市3次元データを更新することを特徴する建物の3次元データ更新方法。The top and bottom stereo ground photograph taken by the panoramic camera and the left and right stereo ground oblique photograph taken by the metric camera are converted from analog to digital by a computer to create a real image, and the existing city three-dimensional data is created by the computer. A simulation image viewed from the same viewpoint as the photographed image is created based on the image, the photographed image and the simulation image are displayed on the same screen of the computer, and differences between the photographed image and the simulation image are based on the difference. And updating the existing three-dimensional city data by the computer. 前記上下ステレオ地上斜め写真及び前記左右ステレオ地上斜め写真が見通しの良好な建物から撮影した地上写真である請求項1に記載の建物の3次元データ更新方法。The method for updating three-dimensional data of a building according to claim 1, wherein the upper and lower stereo ground oblique photographs and the left and right stereo ground oblique photographs are ground photographs taken from a building with good visibility. 前記実写画像と前記シミュレーション画像との対比の結果、新規建物が確認された場合、1次元のステレオマッチングにより、前記上下ステレオ地上斜め写真及び前記左右ステレオ地上斜め写真から前記新規建物を前記コンピュータにより3次元計測し、前記コンピュータにより該新規建物の3次元データを作成し、該新規建物の3次元データを前記コンピュータ上の前記既存の都市3次元データに付加する請求項1または請求項2に記載の建物の3次元データ更新方法。When a new building is confirmed as a result of the comparison between the real image and the simulation image, the computer can be used to calculate the new building from the upper and lower stereo ground oblique photographs and the left and right stereo ground oblique photographs by the computer by one-dimensional stereo matching. The three-dimensional data of the new building is created by the computer, and the three-dimensional data of the new building is added to the existing three-dimensional data of the city on the computer. 3D data update method for buildings. 前記実写画像と前記シミュレーション画像との対比の結果、変更された建物が確認された場合、該建物の変更部分を基に、前記コンピュータ上の前記既存の都市3次元データを変更する請求項1または請求項2に記載の建物の3次元データ更新方法。When the changed building is confirmed as a result of the comparison between the photographed image and the simulation image, the existing three-dimensional city data on the computer is changed based on the changed portion of the building. The building three-dimensional data update method according to claim 2. 前記実写画像と前記シミュレーション画像との対比の結果、変更された建物壁面テクスチャーが確認された場合、該変更された建物壁面テクスチャーデータを前記上下ステレオ地上斜め写真及び前記左右ステレオ地上斜め写真から取得し、該建物壁面テクスチャーデータを前記コンピュータ上の前記既存の都市3次元データに付加する請求項1または請求項2に記載の建物の3次元データ更新方法。When the changed building wall texture is confirmed as a result of the comparison between the actual image and the simulation image, the changed building wall texture data is acquired from the upper and lower stereo ground oblique photographs and the left and right stereo ground oblique photographs. The building three-dimensional data update method according to claim 1, wherein the building wall texture data is added to the existing city three-dimensional data on the computer. 前記変更された建物壁面テクスチャーの一部分が確認された場合、前記コンピュータにより、該変更された建物壁面テクスチャーデータを前記上下ステレオ地上斜め写真及び前記左右ステレオ地上斜め写真から取得し、前記コンピュータにより、該変更された建物壁面テクスチャーデータを予め記憶されたその建物の高さに応じて拡張修正し、該拡張修正したテクスチャーデータを前記コンピュータ上の前記既存の都市3次元データに付加する請求項5に記載の建物の3次元データ更新方法。When a part of the changed building wall texture is confirmed, the computer acquires the changed building wall texture data from the upper and lower stereo ground diagonal photographs and the left and right stereo ground diagonal photographs, and the computer 6. The modified building wall texture data is extended and corrected according to the height of the building stored in advance, and the extended and corrected texture data is added to the existing three-dimensional city data on the computer. 3D data update method for buildings.
JP32780399A 1999-11-18 1999-11-18 Building 3D data update method Expired - Lifetime JP4285862B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP32780399A JP4285862B2 (en) 1999-11-18 1999-11-18 Building 3D data update method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP32780399A JP4285862B2 (en) 1999-11-18 1999-11-18 Building 3D data update method

Publications (2)

Publication Number Publication Date
JP2001143104A JP2001143104A (en) 2001-05-25
JP4285862B2 true JP4285862B2 (en) 2009-06-24

Family

ID=18203177

Family Applications (1)

Application Number Title Priority Date Filing Date
JP32780399A Expired - Lifetime JP4285862B2 (en) 1999-11-18 1999-11-18 Building 3D data update method

Country Status (1)

Country Link
JP (1) JP4285862B2 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3776787B2 (en) 2001-11-02 2006-05-17 Nec東芝スペースシステム株式会社 3D database generation system
JP2006003263A (en) * 2004-06-18 2006-01-05 Hitachi Ltd Visual information processor and application system
JP2007156777A (en) * 2005-12-05 2007-06-21 Alpine Electronics Inc Map display device in navigation system
WO2008062819A1 (en) * 2006-11-21 2008-05-29 Nec Corporation Three-dimensional map data generating system, three-dimensional map data generating method and three-dimensional data generating program
JP6939195B2 (en) * 2017-07-27 2021-09-22 株式会社大林組 Inspection processing system, inspection processing method and inspection processing program
CN109931913B (en) * 2019-03-06 2021-01-05 安徽省川佰科技有限公司 Sensitive point influence degree analysis method based on oblique photography

Also Published As

Publication number Publication date
JP2001143104A (en) 2001-05-25

Similar Documents

Publication Publication Date Title
TW565810B (en) Three-dimensional electronic map information generation method
CN107492069B (en) Image fusion method based on multi-lens sensor
JP2007525770A (en) Technology to form a single image from multiple overlapping images
CN108564647A (en) A method of establishing virtual three-dimensional map
CN109993696A (en) The apparent panorama sketch of works based on multi-view image corrects joining method
JP2008509481A (en) How to prepare composite images with non-uniform resolution
JP2003141575A (en) Three-dimensional database generating system and method of generating three-dimensional database
Soycan et al. Perspective correction of building facade images for architectural applications
JP4285862B2 (en) Building 3D data update method
WO2024040863A1 (en) General layout-based multi-site multi-view video fusion method and system
JP3618649B2 (en) An extended image matching method between images using an indefinite window
JP4152698B2 (en) 3D building model data generator
JP3251557B2 (en) Wall image / damage / repair information registration management system and method
Gomez-Lahoz et al. Recovering traditions in the digital era: the use of blimps for modelling the archaeological cultural heritage
JPH06348815A (en) Method for setting three-dimensional model of building aspect in cg system
WO2019003796A1 (en) Image compositing method, image compositing device, and recording medium
JP2001143057A (en) Method for creating three-dimensional model of city
JP2003115057A (en) Texture editing device, texture editing system and method
KR101001629B1 (en) System for mapping texture using aerial images and method therefor
US10580208B2 (en) Ceiling map building method, ceiling map building device, and ceiling map building program
JP2009271895A (en) Image set and method for independent rectification
JP3791186B2 (en) Landscape modeling device
CN109767484A (en) With the light and color homogenization method and system of color consistency in a kind of portion three-dimensional picture pasting
JP4139137B2 (en) Building outline extraction method and system
JP3859794B2 (en) Photo shooting management method

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20060608

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20080916

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20081117

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20081222

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20090217

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20090316

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20090324

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120403

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Ref document number: 4285862

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130403

Year of fee payment: 4

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130403

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140403

Year of fee payment: 5

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

EXPY Cancellation because of completion of term