JP2004226190A - Method for displaying locational information on photograph image from helicopter and its apparatus - Google Patents

Method for displaying locational information on photograph image from helicopter and its apparatus Download PDF

Info

Publication number
JP2004226190A
JP2004226190A JP2003013180A JP2003013180A JP2004226190A JP 2004226190 A JP2004226190 A JP 2004226190A JP 2003013180 A JP2003013180 A JP 2003013180A JP 2003013180 A JP2003013180 A JP 2003013180A JP 2004226190 A JP2004226190 A JP 2004226190A
Authority
JP
Japan
Prior art keywords
helicopter
data
information
target
ground
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2003013180A
Other languages
Japanese (ja)
Inventor
Kenzo Ikeuchi
健三 池内
Kozo Kobayashi
宏造 小林
Shunichi Yokoe
俊一 横江
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kawasaki Heavy Industries Ltd
Original Assignee
Kawasaki Heavy Industries Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kawasaki Heavy Industries Ltd filed Critical Kawasaki Heavy Industries Ltd
Priority to JP2003013180A priority Critical patent/JP2004226190A/en
Publication of JP2004226190A publication Critical patent/JP2004226190A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Instructional Devices (AREA)
  • Processing Or Creating Images (AREA)

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method for displaying locational information on a photograph image from a helicopter capable of speedily and accurately using the photograph image as a news report by automatically adding attribute data such as an accurate photographing location (address) and the name of a building as attribute data to the photograph image from the helicopter and to provide its apparatus. <P>SOLUTION: A target is photographed by a television camera 1 supported by a gimbal mechanism installed in the helicopter 2. Its photograph image is transmitted to the ground. On the basis of information on the self-location by a GPS-MAP on installed in the helicopter, information on the direction of the television camera and the attitude of the airframe, and, in some instances, information on the distance to the target, three-dimensional specification processing is performed on the photographing location on the side of the helicopter to transmit data on the photographing location to the ground. Attribute data corresponding to the data on the photographing location received at the ground is extracted from an electronic map 10 and added to the photograph image received at the ground, and the photograph image with the attribute data is displayed on a display device 12. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

【0001】
【発明の属する技術分野】
本発明は、ヘリコプタからの撮影映像に撮影位置(住所)や建物名などの属性データを付加する位置情報表示方法及びその装置に関するものである。
【0002】
【従来の技術】
報道現場においては、他社よりも一刻/一秒でも早く取材から報道までの作業を完了し、ニュースとして流すことに熾烈な競争が行われている。通常ヘリコプタでの撮影者は現場の場所やビル名などは十分な認識の基に撮影を行うが、撮影された報道映像を見た者には情報が不足しており、画面がどこの場所かの認識ができない。視聴者にニュースとして映像を流す過程において、テレビ局では、文字データや音声によってこの情報を補っているのが現状で、そのために時間や手間がかかっている。関連する先行技術文献として、特許第2695393号がある。
【0003】
【発明が解決しようとする課題】
そこで本発明は、ヘリコプタからの撮影映像に正確な撮影位置(住所)や建物名などの属性データを自動的に文字データとして付与することにより、より迅速且つ正確に報道ニュースとして撮影映像を活用でき、また、防災活動においても各県の防災ヘリコプタに搭載されているテレビカメラの映像に同様の文字データを付加することにより、より迅速・正確な防災活動に寄与できるヘリコプタからの撮影映像への位置情報表示方法及びその装置を提供しようとするものである。
【0004】
【課題を解決するための手段】
上記課題を解決するための本発明のヘリコプタからの撮影映像への位置情報表示方法の1つは、ヘリコプタに搭載したジンバル機構支持のテレビカメラにより目標物を撮影し、その撮影映像を地上に送信すると同時に、ヘリコプタに搭載したGPS−MAPによる自機の位置情報と前記テレビカメラの方向及び機体の姿勢情報からヘリコプタ側で撮影位置の3次元的特定処理を行って、その撮影位置データを地上に送信し、地上で受信した撮影位置データに対応する属性データを電子地図から抽出してこれを地上で受信した撮影映像に付加し、表示装置に属性データ付き撮影映像を表示することを特徴とするものである。
【0005】
本発明のヘリコプタからの撮影映像への位置情報表示方法の他の1つは、ヘリコプタに搭載したジンバル機構支持のテレビカメラにより目標物を撮影し、その撮影映像を地上に送信すると同時に、ヘリコプタに搭載したGPS−MAPによる自機の位置情報と前記テレビカメラの方向及び機体の姿勢情報を地上に送信して撮影位置の3次元特定処理を行って撮影位置データを取得し、この撮影位置データに対応する属性データを電子地図から抽出し、これを地上で受信した撮影映像に付加し、表示装置に属性データ付き撮影映像を表示することを特徴とするものである。
【0006】
上記2つのヘリコプタからの撮影映像への位置情報表示方法において、目標物の撮影位置の3次元的に特定処理は、ヘリコプタに搭載したGPS−MAPによる自機の位置情報とテレビカメラの方向及び機体の姿勢情報の外、目標物までの距離情報とにより行うこともある。
【0007】
また、上記2つのヘリコプタからの撮影映像への位置情報表示方法においては、属性データを持つ電子地図上にヘリコプタの位置及び目標物の撮影位置を重畳して別途表示装置に表示することも好ましい。
【0008】
前記のヘリコプタからの撮影映像への位置情報表示方法の1つを実施するための本発明の位置情報表示装置は、目標物を撮影するヘリコプタ搭載のジンバル機構支持のテレビカメラと、ヘリコプタ搭載のGPS−MAPによる自機位置情報と前記テレビカメラの方向及び機体の姿勢情報から撮影位置の3次元的特定処理を行って撮影位置データを取得するヘリコプタ搭載の撮影位置特定装置と、目標物の撮影映像及び撮影位置データを地上に送信するデータ送信装置と、目標物の撮影映像及び撮影位置データを受信する地上のデータ受信装置と、撮影位置データと電子地図とを対比して撮影位置に対応する住所、建物名等の属性データを電子地図から抽出する属性データ抽出装置と、抽出した属性データを目標物の撮影映像に付加するデータ処理装置と、属性データ付撮影映像を表示する表示装置とより成るものである。
【0009】
前記のヘリコプタの撮影映像への位置情報表示方法の他の1つを実施するための本発明の位置情報表示装置は、目標物を撮影するヘリコプタ搭載のジンバル機構支持のテレビカメラと、目標物の撮影映像ならびにヘリコプタ搭載のGPS−MAPによる自機位置情報と前記テレビカメラの方向及び機体の姿勢情報を地上に送信する送信装置と、それを地上で受信する受信装置と、その受信装置で受信した自機位置情報とテレビカメラの方向及び機体の姿勢情報から撮影位置の3次元的特定処理を行って撮影位置データを取得する地上の撮影位置特定装置と、取得した撮影位置データと電子地図とを対比して撮影位置に対応する住所、建物名等の属性データを電子地図から抽出する属性データ抽出装置と、抽出した属性データを目標映像に付加するデータ処理装置と、属性データ付撮影映像を表示する表示装置とより成るものである。
【0010】
上記2つのヘリコプタからの撮影映像への位置情報表示装置において、撮影位置特定装置は、ヘリコプタ搭載のGPS−MAPによる自機位置情報とテレビカメラの方向と機体の姿勢情報の外、目標物までの距離情報とから撮影位置の3次元的特定処理を行って撮影位置データを取得するようにしたものもある。
【0011】
また、上記2つの位置情報表示装置においては、属性データを持つ電子地図上にヘリコプタの位置及び目標物の撮影位置を重畳して表示する表示装置を別途装備することも好ましい。
【0012】
【発明の実施の形態】
本発明のヘリコプタからの撮影映像への位置情報表示方法及びその装置の実施形態を説明する。先ずその位置情報表示方法の1つを実施するための装置を図1によって説明すると、1はヘリコプタ2に搭載のジンバル機構3に支持されてヘリコプタ2の姿勢とは関係無しに自由に目標物を撮影するテレビカメラである。4はGPS衛星5からのGPS位置情報に基づくヘリコプタ2に搭載のGPS−MAPによる自機位置情報と専用のセンサによって検出したテレビカメラ1の方向及びヘリコプタ2の機体姿勢情報から撮影位置の3次元的特定処理を行うヘリコプタ2に搭載の撮影位置特定装置である。この撮影位置特定装置4は、地表面の起伏についての高度情報を含む三次元的な地勢データと、自機位置情報と、テレビカメラ1の方向及びヘリコプタ2の機体姿勢情報および地表面記録データからの出力に応答し、ヘリコプタ2の位置からテレビカメラ1の向いている方向に延ばした直線と地表面との交点を算出し、目標物の位置として特定する演算処理手段と目標物の位置と目標物を撮影する視野とを、地名等のわかる二次元地図上に表示する手段とを含むものである。今少し判り易く言えば、この撮影位置特定装置4は、撮影した目標物の位置を地上の起伏(高度)を考慮した正確な位置計算によって特定し、さらに目標物までの距離情報やテレビカメラ1の操作などにより正確に撮影位置を特定するものである。6は目標物の撮影映像及び撮影位置データを地上の中継システム7に送信するデータ送信装置で、これもヘリコプタ2に搭載されている。8は地上の中継システム7に設けられ目標物の撮影映像及び撮影位置データを受信するデータ受信装置である。9は撮影位置データと電子地図10とを対比して撮影位置に対応する住所、建物名等の属性データを電子地図10から抽出する属性データ抽出装置である。11は抽出した属性データを目標物の撮影映像に付加するデータ処理装置である。12は属性データ付撮影映像を表示する表示装置である。
【0013】
上記のように構成された位置情報表示装置によるヘリコプタからの撮影映像への位置情報表示方法について説明する。ヘリコプタ2に搭載したジンバル機構3に支持されたテレビカメラ1により目標物、例えば火災発生の建物Pを撮影し、その撮影映像Fをヘリコプタ2に搭載したデータ送信装置6により地上の中継システム7に送信する。と同時にGPS衛星5からのGPS位置情報に基づくヘリコプタ2に搭載のGPS−MAPによる自機位置情報と専用センサによって検出したテレビカメラ1の方向及びヘリコプタ2の機体姿勢情報を撮影位置特定装置4に入れ、撮影位置の3次元的特定処理を行って撮影位置データを取得し、これを地上の中継システム7に送信する。上記撮影位置特定装置4での撮影位置の3次元的特定処理は、撮影位置に対する目標物の方向を計測し、予め作成されている地表面の起伏についての高度情報を含む三次元地勢データから目標物の存在する地表面を求め、地表面と、撮影位置から目標物の方向に延びる直線との交点位置として、目標物の位置を特定し、さらにテレビカメラ1の操作や目標物までの距離情報などにより、正確に撮影位置を特定することである。特に目標物が高層ビルなどの場合、テレビカメラ1の操作は、一旦テレビカメラ1の中心を目標物である高層ビルの一階部分に数秒間向けることにより、高層ビルの位置を正確に特定できる。また、高層ビルのある位置までの距離を測定し、その測距した空間上の位置から垂直に地面におろした位置が正確な緯度、経度となるので、高層ビルの位置特定が正確なものとなる。中継システム7ではデータ受信装置8により目標物、本例の場合火災発生の建物Pの撮影映像Fと撮影位置データを受信する。そして撮影データを属性データ抽出装置9に送り、ここで予め入力された詳細な建物・家屋の名称、行政界(市町村区分、地名)等の属性データを持つ電子地図10と対比し、撮影位置に対応する住所、建物名等の属性データを電子地図10から抽出する。この抽出した属性データは、前記中継システム7のデータ受信装置8から既に火災発生の建物Pの撮影映像Fを入力したデータ処理装置11に入力し、ここで住所、建物名等の属性データを文字データGとして火災発生の建物Pの撮影映像Fに付加する。この文字データGを付加した撮影映像Fは、テレビ局の表示装置12に表示する。かくして撮影対象は、迅速且つ正確に特定でき、視聴者にリアルタイムに報道ニュースとして流すことができる。尚、図1の位置情報表示装置において、別途表示装置13を設けて、属性データを持つ電子地図10上にヘリコプタ2の位置及び目標物、即ち火災発生の建物Pの撮影位置を重畳したのものを表示装置13に表示するようにしてもよい。以上一連のプロセスを図2のフロー図に示す。
【0014】
次に本発明のヘリコプタからの撮影映像への位置情報表示方法の他の1つを実施する装置についてであるが、この装置は、撮影位置特定装置4をヘリコプタ2に搭載せず、地上側に設けた場合で、その他は図1と同一であるので、その詳細な説明は省略する。以下この位置情報表示装置によるヘリコプタからの撮影映像への位置情報表示方法について説明する。ヘリコプタ2に搭載したジンバル機構3に支持されたテレビカメラ1により目標物、例えば火災発生の建物Pを撮影し、その撮影映像Fをヘリコプタ2に搭載したデータ送信装置6により地上の中継システム7に送信する。と同時にGPS衛星5からのGPS位置情報に基づくヘリコプタ2に搭載のGPS−MAPによる自機位置情報とテレビカメラ1の方向及びヘリコプタ2の機体姿勢情報を地上側に設けた撮影位置特定装置4に送信し、ここで前記と同様に撮影位置の3次元的特定処理を行って撮影位置データを取得する。中継システム7ではデータ受信装置8により火災発生の建物Pの撮影映像Fを受信し、この撮影映像Fをデータ処理装置11に入力する。撮影位置特定装置4で取得した撮影位置データは属性データ抽出装置9に送り、ここで予め入力された属性データを持つ電子地図10と対比し、撮影位置に対応する住所、建物名等の属性データを電子地図10から抽出する。この抽出した属性データは、データ処理装置11に入力し、ここで既に入力されている火災発生の建物Pの撮影映像Fに、住所、建物名等の属性データを文字データGとして付加する。この文字データGを付加した撮影映像Fはテレビ局の表示装置12に表示する。かくして撮影対象は、迅速且つ正確に特定でき、視聴者にリアルタイムに報道ニュースとして流すことができる。尚、この撮影映像への位置情報表示方法においても、属性データを持つ電子地図10上にヘリコプタ2の位置及び目標物、即ち火災発生の建物Pの撮影位置を重畳したのものを別途に設けた表示装置13に表示するようにしてもよい。以上一連のプロセスを図3のフロー図に示す。
【0015】
【発明の効果】
以上の説明で判るように本発明によるヘリコプタからの撮影映像への位置情報表示方法によれば、ヘリコプタからの撮影映像に正確な撮影位置(住所)や建物名などの属性データを自動的に文字データとして付加することができるので、この文字データ付き撮影映像は、より迅速且つ正確にリアルタイムの報道ニュースとして活用できる。また、山火事、大規模な地震災害などの防災・救助活動においても被害状況を撮影する各県の防災ヘリコプタに搭載されているテレビカメラの映像に同様の文字データを付加したり、2次元地図や3次元地図上で被害状況及び場所(範囲)をリアルタイムにモニターすることにより、より迅速で的確な防災・救助活動に寄与できる。また、カメラを赤外線カメラにすれば山火事の残り火の確認に効果的である。
さらに、逃走車両、船舶、山岳地での遭難者、崖崩れ、消防用水利等、上空からしか発見し難く、また地上から位置の特定が困難なものを撮影した映像に電子地図上の属性データを付加することにより、上記の災害・救助活動のための地上部隊の配置指示/誘導を効率的に実施するのに有用である。
【0016】
また、本発明によるヘリコプタからの撮影映像への位置情報表示装置によれば、上記の優れた位置情報表示方法を時間や手間をかけることなく効率よくしかも確実に実施できる。
【図面の簡単な説明】
【図1】本発明のヘリコプタからの撮影映像への位置情報表示方法を実施する位置情報表示装置を示す図である。
【図2】本発明のヘリコプタからの撮影映像への位置情報表示方法の1つのプロセスを示すフロー図である。
【図3】本発明のヘリコプタからの撮影映像への位置情報表示方法の他の1つのプロセスを示すフロー図である。
【符号の説明】
1 テレビカメラ
2 ヘリコプタ
3 ジンバル機構
4 撮影位置特定装置
5 GPS衛星
6 データ送信装置
7 中継システム
8 データ受信装置
9 属性データ抽出装置
10 電子地図
11 データ処理装置
12 表示装置
P 目標物(火災発生の建物)
F 撮影映像
G 文字データ
[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a position information display method and apparatus for adding attribute data such as a photographing position (address) and a building name to a photographed image from a helicopter.
[0002]
[Prior art]
At the news outlets, fierce competition is taking place to complete the work from coverage to newsletter at an interval of one second per second faster than other companies, and to broadcast it as news. Normally, helicopter photographers take pictures based on sufficient recognition of the site location and building name, but those who have watched the news footage lack information, and where the screen is Can not recognize. In the process of broadcasting a video as news to a viewer, a television station currently supplements this information with character data or voice, which takes time and effort. As a related prior art document, there is Japanese Patent No. 2695393.
[0003]
[Problems to be solved by the invention]
Therefore, the present invention can more quickly and accurately utilize photographed images as news news by automatically assigning attribute data such as an accurate photographing position (address) and a building name to a photographed image from a helicopter as character data. Also, in disaster prevention activities, by adding the same character data to the images of the television cameras mounted on disaster prevention helicopters in each prefecture, the position of the images taken from the helicopters can contribute to quicker and more accurate disaster prevention activities An object is to provide an information display method and an information display device.
[0004]
[Means for Solving the Problems]
One of the methods for displaying position information on a captured image from a helicopter according to the present invention for solving the above-mentioned problems is to shoot a target object with a gimbal mechanism-supported television camera mounted on the helicopter and transmit the captured image to the ground. At the same time, the helicopter performs three-dimensional identification processing of the shooting position from the position information of the own device by GPS-MAP mounted on the helicopter, the direction of the TV camera, and the attitude information of the aircraft, and places the shooting position data on the ground. Transmitting, extracting attribute data corresponding to the photographing position data received on the ground from the electronic map, adding this to the photographed image received on the ground, and displaying the photographed image with attribute data on the display device. Things.
[0005]
Another method of displaying position information on a captured image from a helicopter according to the present invention is to shoot a target using a gimbal mechanism-supported television camera mounted on the helicopter, transmit the shot image to the ground, and simultaneously transmit the shot image to the helicopter. The position information of the own device, the direction of the television camera, and the attitude information of the aircraft by the on-board GPS-MAP are transmitted to the ground to perform three-dimensional identification processing of the photographing position to acquire photographing position data. It is characterized in that corresponding attribute data is extracted from an electronic map, added to a photographed image received on the ground, and a photographed image with attribute data is displayed on a display device.
[0006]
In the method for displaying the position information on the images captured by the two helicopters, the process of three-dimensionally specifying the shooting position of the target is performed by using GPS-MAP mounted on the helicopter, the position information of the own device, the direction of the TV camera, and the airframe. May be performed based on distance information to a target in addition to the posture information of the target.
[0007]
Further, in the method of displaying position information on images captured by the two helicopters, it is preferable that the position of the helicopter and the imaging position of the target are superimposed on an electronic map having attribute data and separately displayed on a display device.
[0008]
A position information display device of the present invention for implementing one of the above-described methods of displaying position information on an image captured by a helicopter is provided by a helicopter-mounted gimbal mechanism-supported television camera for shooting a target, and a helicopter-mounted GPS A helicopter-mounted shooting position specifying device that obtains shooting position data by performing a three-dimensional specifying process of a shooting position from the own device position information by the MAP, the direction of the TV camera, and the attitude information of the body, and a shot image of a target object And a data transmitting device for transmitting photographing position data to the ground, a data receiving device on the ground for receiving a photographed image of the target and the photographing position data, and an address corresponding to the photographing position by comparing the photographing position data and the electronic map. Attribute data extraction device for extracting attribute data such as building names from an electronic map, and data for adding the extracted attribute data to a video image of a target object And management apparatus, in which the more the display device for displaying an attached attribute data captured image.
[0009]
A position information display apparatus according to the present invention for carrying out another one of the above-described methods for displaying a position information on a captured image of a helicopter is provided with a helicopter-mounted gimbal mechanism-supported television camera for photographing a target, and a target camera. A transmitting device for transmitting the photographed image and its own position information by GPS-MAP equipped with a helicopter, the direction of the television camera and the attitude information of the aircraft to the ground, a receiving device for receiving the information on the ground, and a receiving device for receiving the information. A photographing position specifying device on the ground for acquiring the photographing position data by performing a three-dimensional specifying process of the photographing position from the own device position information, the direction of the TV camera and the posture information of the aircraft, and the acquired photographing position data and the electronic map. In contrast, an attribute data extraction device that extracts attribute data such as addresses and building names corresponding to shooting locations from an electronic map, and adds the extracted attribute data to the target video A data processing device that is those comprising more a display device for displaying with attribute data captured image.
[0010]
In the position information display device for the captured images from the two helicopters, the photographing position specifying device includes a GPS-MAP equipped with a helicopter, the self-machine position information, the direction of the TV camera, and the posture information of the body, and the target object. In some cases, three-dimensional identification processing of a shooting position is performed based on distance information to obtain shooting position data.
[0011]
In addition, it is preferable that the two position information display devices are separately provided with a display device that superimposes and displays the position of the helicopter and the photographing position of the target on the electronic map having the attribute data.
[0012]
BEST MODE FOR CARRYING OUT THE INVENTION
An embodiment of a method and an apparatus for displaying position information on a video captured by a helicopter according to the present invention will be described. First, an apparatus for carrying out one of the position information display methods will be described with reference to FIG. 1. Reference numeral 1 denotes a target that is supported by a gimbal mechanism 3 mounted on a helicopter 2 and that can freely target an object regardless of the attitude of the helicopter 2. TV camera to shoot. Reference numeral 4 denotes a three-dimensional photographing position based on the position information of the self-vehicle based on the GPS-MAP mounted on the helicopter 2 based on the GPS position information from the GPS satellite 5, the direction of the television camera 1 detected by the dedicated sensor, and the body attitude information of the helicopter 2. This is a photographing position specifying device mounted on the helicopter 2 that performs a target specifying process. The photographing position specifying device 4 obtains three-dimensional terrain data including altitude information on the undulation of the ground surface, own vehicle position information, the direction of the television camera 1, the body attitude information of the helicopter 2, and the ground surface recorded data. In response to the output of the helicopter 2, an intersection between the ground surface and the straight line extending from the position of the helicopter 2 in the direction of the television camera 1 is calculated, and the position of the target is specified. Means for displaying a field of view for photographing an object on a two-dimensional map in which the names of places and the like are known. In other words, the photographing position specifying device 4 specifies the position of the photographed target by accurate position calculation in consideration of the undulation (altitude) on the ground, and furthermore, information on the distance to the target and the television camera 1. The photographing position is specified accurately by the operation of the user. Reference numeral 6 denotes a data transmission device for transmitting a photographed image and photographing position data of a target to a relay system 7 on the ground, which is also mounted on the helicopter 2. Reference numeral 8 denotes a data receiving device provided in the relay system 7 on the ground to receive a photographed image and photographing position data of a target. Reference numeral 9 denotes an attribute data extracting device that compares the photographing position data with the electronic map 10 and extracts attribute data such as an address and a building name corresponding to the photographing position from the electronic map 10. Reference numeral 11 denotes a data processing device for adding the extracted attribute data to a video image of a target. Reference numeral 12 denotes a display device that displays a captured video with attribute data.
[0013]
A description will be given of a method of displaying position information on a video taken from a helicopter by the position information display device configured as described above. A TV camera 1 supported by a gimbal mechanism 3 mounted on the helicopter 2 captures an image of a target, for example, a building P in which a fire has occurred. The captured video F is transmitted to a relay system 7 on the ground by a data transmission device 6 mounted on the helicopter 2. Send. At the same time, the camera position information based on the GPS-MAP mounted on the helicopter 2 based on the GPS position information from the GPS satellite 5, the direction of the television camera 1 detected by the dedicated sensor, and the body attitude information of the helicopter 2 are transmitted to the photographing position specifying device 4. Then, three-dimensional identification processing of the photographing position is performed to acquire photographing position data, and this is transmitted to the relay system 7 on the ground. The three-dimensional specifying process of the shooting position in the shooting position specifying device 4 measures the direction of the target with respect to the shooting position, and calculates the target from the three-dimensional terrain data including altitude information about the undulation of the ground surface created in advance. The ground surface where the object is located is determined, and the position of the target is specified as the intersection point between the ground surface and a straight line extending in the direction of the target from the shooting position. Further, the operation of the TV camera 1 and the distance information to the target are determined. This means that the photographing position is specified accurately, for example. In particular, when the target is a high-rise building or the like, the operation of the television camera 1 can accurately specify the position of the high-rise building by once turning the center of the television camera 1 to the first floor of the high-rise building which is the target. . In addition, the distance to a certain location of a high-rise building is measured, and the position vertically lowered from the position in the measured space to the ground becomes the exact latitude and longitude, so it is necessary to specify the position of the high-rise building accurately. Become. In the relay system 7, the data receiving device 8 receives the photographed image F and the photographing position data of the target object, in this case, the building P in which a fire has occurred in this example. Then, the photographing data is sent to the attribute data extracting device 9, where the photographing data is compared with an electronic map 10 having attribute data such as detailed building / house names and administrative boundaries (municipal divisions, place names), etc. Attribute data such as corresponding addresses and building names are extracted from the electronic map 10. The extracted attribute data is input from the data receiving device 8 of the relay system 7 to the data processing device 11 to which the photographed image F of the building P in which the fire has already occurred is input. The data G is added to the photographed image F of the building P where the fire has occurred. The photographed video F to which the character data G is added is displayed on the display device 12 of the television station. Thus, the shooting target can be quickly and accurately specified, and can be broadcast to the viewer in real time as news news. In the position information display device shown in FIG. 1, a separate display device 13 is provided to superimpose the position of the helicopter 2 and the photographing position of the target, that is, the building P where the fire has occurred, on the electronic map 10 having the attribute data. May be displayed on the display device 13. The above series of processes is shown in the flowchart of FIG.
[0014]
Next, an apparatus for carrying out another method of displaying position information on a captured image from a helicopter according to the present invention will be described. In this apparatus, the imaging position specifying device 4 is not mounted on the helicopter 2 and is located on the ground side. In this case, since the other parts are the same as those in FIG. 1, the detailed description is omitted. Hereinafter, a method of displaying position information on a video taken from a helicopter by the position information display device will be described. A TV camera 1 supported by a gimbal mechanism 3 mounted on the helicopter 2 captures an image of a target, for example, a building P in which a fire has occurred, and the captured video F is transmitted to a relay system 7 on the ground by a data transmission device 6 mounted on the helicopter 2. Send. At the same time, the self-position information by GPS-MAP mounted on the helicopter 2 based on the GPS position information from the GPS satellite 5, the direction of the television camera 1, and the attitude information of the helicopter 2 are provided to the photographing position specifying device 4 provided on the ground side. The image data is transmitted, and here, three-dimensional identification processing of the photographing position is performed in the same manner as described above to acquire photographing position data. In the relay system 7, the captured image F of the building P in which the fire has occurred is received by the data receiving device 8, and the captured image F is input to the data processing device 11. The photographing position data obtained by the photographing position specifying device 4 is sent to an attribute data extracting device 9, which compares the photographing position data with an electronic map 10 having attribute data input in advance, such as an address and a building name corresponding to the photographing position. Is extracted from the electronic map 10. The extracted attribute data is input to the data processing device 11, and the attribute data such as the address and the name of the building is added as character data G to the photographed image F of the building P where the fire has already occurred. The photographed image F to which the character data G is added is displayed on the display device 12 of the television station. Thus, the shooting target can be quickly and accurately specified, and can be broadcast to the viewer in real time as news news. In this method of displaying the position information on the photographed image, an electronic map 10 having attribute data in which the position of the helicopter 2 and the photographing position of the target, ie, the building P where the fire occurred, is superimposed is separately provided. The information may be displayed on the display device 13. The above series of processes is shown in the flowchart of FIG.
[0015]
【The invention's effect】
As can be understood from the above description, according to the method for displaying the position information on the video taken from the helicopter according to the present invention, the attribute data such as the exact shooting position (address) and the building name is automatically written in the video taken from the helicopter. Since it can be added as data, the photographed video with character data can be used more quickly and accurately as real-time news. In addition, similar character data can be added to the images of TV cameras mounted on disaster prevention helicopters in each prefecture that capture damage situations in disaster prevention and rescue activities such as forest fires and large-scale earthquake disasters. By monitoring the damage status and location (range) on a real-time or 3D map, it can contribute to quicker and more accurate disaster prevention and rescue activities. In addition, if the camera is an infrared camera, it is effective to confirm the embers of a wildfire.
In addition, attributed data on the electronic map include images of fleeing vehicles, ships, victims in mountainous areas, cliffs, firefighting irrigation water, etc., which are difficult to find only from the sky and whose location is difficult to identify from the ground. Is effective in efficiently instructing and guiding the placement of ground units for the above-mentioned disaster and rescue activities.
[0016]
Further, according to the position information display apparatus for displaying images taken from a helicopter by the present invention, the above-described excellent position information display method can be efficiently and reliably performed without taking time or labor.
[Brief description of the drawings]
FIG. 1 is a diagram showing a position information display device that implements a method for displaying position information on a video shot from a helicopter according to the present invention.
FIG. 2 is a flowchart showing one process of a method for displaying position information on a video taken by a helicopter according to the present invention.
FIG. 3 is a flowchart showing another process of a method for displaying position information on a video taken from a helicopter according to the present invention.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Television camera 2 Helicopter 3 Gimbal mechanism 4 Shooting position specifying device 5 GPS satellite 6 Data transmitting device 7 Relay system 8 Data receiving device 9 Attribute data extracting device 10 Electronic map 11 Data processing device 12 Display device P Target object (fire )
F Captured video G Character data

Claims (8)

ヘリコプタに搭載したジンバル機構支持のテレビカメラにより目標物を撮影し、その撮影映像を地上に送信すると同時に、ヘリコプタに搭載したGPS−MAPによる自機の位置情報と前記テレビカメラの方向及び機体の姿勢情報からヘリコプタ側で撮影位置の3次元的特定処理を行って、その撮影位置データを地上に送信し、地上で受信した撮影位置データに対応する属性データを電子地図から抽出してこれを地上で受信した撮影映像に付加し、表示装置に属性データ付き撮影映像を表示することを特徴とするヘリコプタからの撮影映像への位置情報表示方法。A gimbal mechanism-supported TV camera mounted on a helicopter shoots a target and transmits the shot image to the ground. At the same time, the GPS-MAP mounted on the helicopter has its own position information, the direction of the TV camera, and the attitude of the aircraft. Based on the information, the helicopter performs three-dimensional identification processing of the shooting position, transmits the shooting position data to the ground, extracts attribute data corresponding to the shooting position data received on the ground from the electronic map, and extracts this on the ground. A method for displaying positional information on a captured video from a helicopter, wherein the captured video with attribute data is displayed on a display device in addition to the received captured video. ヘリコプタに搭載したジンバル機構支持のテレビカメラにより目標物を撮影し、その撮影映像を地上に送信すると同時に、ヘリコプタに搭載したGPS−MAPによる自機の位置情報と前記テレビカメラの方向及び機体の姿勢情報を地上に送信し、撮影位置の3次元的特定処理を行って、撮影位置データを取得し、この撮影位置データに対応する属性データを電子地図から抽出し、これを地上で受信した撮影映像に付加し、表示装置に属性データ付き撮影映像を表示することを特徴とするヘリコプタからの撮影映像への位置情報表示方法。A gimbal mechanism-supported TV camera mounted on a helicopter shoots a target and transmits the shot image to the ground. At the same time, the GPS-MAP mounted on the helicopter has its own position information, the direction of the TV camera, and the attitude of the aircraft. Information is transmitted to the ground, a three-dimensional identification process of the photographing position is performed, photographing position data is obtained, attribute data corresponding to the photographing position data is extracted from the electronic map, and the photographed image is received on the ground. And displaying a captured video with attribute data on a display device. 4. A method for displaying positional information on a captured video from a helicopter. 請求項1又は2記載のヘリコプタからの撮影映像への位置情報表示方法において、目標物の撮影位置の3次元的特定処理は、ヘリコプタに搭載したGPS−MAPによる自機の位置情報とテレビカメラの方向と機体の姿勢情報の外、目標物までの距離情報とにより行うことを特徴とするヘリコプタからの撮影映像への位置情報表示方法。3. The method of claim 1, wherein the three-dimensional identification processing of the photographing position of the target is performed by using GPS-MAP mounted on the helicopter and the position information of the television camera. A method for displaying position information on a video taken from a helicopter, based on information on the distance to a target object in addition to the direction and attitude information of the aircraft. 請求項1又は2記載のヘリコプタの撮影映像への位置情報表示方法において、属性データを持つ電子地図上にヘリコプタの位置及び目標物の撮影位置を重畳して別途表示装置に表示することを特徴とするヘリコプタからの撮影映像への位置情報表示方法。3. The method according to claim 1, wherein the position of the helicopter and the position of the target object are superimposed on the electronic map having attribute data and displayed separately on a display device. To display location information on video shot from a helicopter. 目標物を撮影するヘリコプタ搭載のジンバル機構支持のテレビカメラと、ヘリコプタ搭載のGPS−MAPによる自機位置情報と前記テレビカメラの方向及び機体の姿勢情報から撮影位置の3次元的特定処理を行って撮影位置データを取得するヘリコプタ搭載の撮影位置特定装置と、目標物の撮影映像及び撮影位置データを地上に送信するデータ送信装置と、目標物の撮影映像及び撮影位置データを受信する地上のデータ受信装置と、撮影位置データと電子地図とを対比して撮影位置に対応する住所、建物名等の属性データを電子地図から抽出する属性データ抽出装置と、抽出した属性データを目標物の撮影映像に付加するデータ処理装置と、属性データ付撮影映像を表示する表示装置とより成るヘリコプタからの撮影映像への位置情報表示装置。Helicopter-mounted gimbal mechanism-supported TV camera for shooting a target, and helicopter-mounted GPS-MAP to perform three-dimensional identification processing of a shooting position from own-vehicle position information, direction of the TV camera, and attitude information of the aircraft. Helicopter-equipped shooting position identification device that obtains shooting position data, data transmission device that transmits the shooting image and shooting position data of the target to the ground, and ground data reception that receives the shooting image and shooting position data of the target A device, an attribute data extraction device that compares the photographing position data with the electronic map and extracts attribute data such as an address and a building name corresponding to the photographing position from the electronic map, and converts the extracted attribute data into a photographed image of a target object. Position information display on a captured video from a helicopter, comprising a data processing device to be added and a display device for displaying a captured video with attribute data Location. 目標物を撮影するヘリコプタ搭載のジンバル機構支持のテレビカメラと、目標物の撮影映像ならびにヘリコプタ搭載のGPS−MAPによる自機位置情報と前記テレビカメラの方向及び機体の姿勢情報を地上に送信する送信装置と、それを地上で受信する受信装置と、その受信装置で受信した自機位置情報とテレビカメラの方向及び機体の姿勢情報から撮影位置の3次元的特定処理を行って撮影位置データを取得する地上の撮影位置特定装置と、取得した撮影位置データと電子地図とを対比して撮影位置に対応する住所、建物名等の属性データを電子地図から抽出する属性データ抽出装置と、抽出した属性データを目標映像に付加するデータ処理装置と、属性データ付撮影映像を表示する表示装置とより成るヘリコプタからの撮影映像への位置情報表示装置。A gimbal mechanism-supported television camera equipped with a helicopter for capturing an image of a target, and a transmission image for transmitting a captured image of the target, self-position information by a helicopter-mounted GPS-MAP, direction of the television camera, and attitude information of the aircraft to the ground Acquisition of shooting position data by performing three-dimensional identification processing of the shooting position from the device, the receiving device that receives it on the ground, and the own device position information, the direction of the TV camera, and the attitude information of the aircraft received by the receiving device An attribute data extracting device for comparing the acquired photographing position data with the electronic map, extracting attribute data such as an address and a building name corresponding to the photographing position from the electronic map, and an extracted attribute A data processing device for adding data to the target video; and a display device for displaying the captured video with attribute data. Information display device. 請求項5又は6記載のヘリコプタからの撮影映像への位置情報表示装置において、撮影位置特定装置は、ヘリコプタ搭載のGPS−MAPによる自機位置情報とテレビカメラの方向と機体の姿勢情報の外、目標物までの距離情報とから撮影位置の3次元的特定処理を行って撮影位置データを取得するものであることを特徴とするヘリコプタからの撮影映像への位置情報表示装置。7. The position information display device for capturing images from a helicopter according to claim 5 or 6, wherein the photographing position specifying device includes the position information of the self-machine, the direction of the TV camera, and the posture information of the machine by the GPS-MAP equipped with the helicopter. A position information display device for a photographed image from a helicopter, which acquires a photographing position data by performing a three-dimensional specifying process of a photographing position from distance information to a target object. 請求項5又は6記載のヘリコプタからの撮影映像への位置情報表示装置において、属性データを持つ電子地図上にヘリコプタの位置及び目標物の撮影位置を重畳して表示する表示装置を別途装備したことを特徴とするヘリコプタからの撮影映像への位置情報表示装置。7. The position information display device according to claim 5, wherein a display device for superimposing and displaying a position of the helicopter and a photographing position of a target on an electronic map having attribute data is provided. A position information display apparatus for displaying images taken by a helicopter.
JP2003013180A 2003-01-22 2003-01-22 Method for displaying locational information on photograph image from helicopter and its apparatus Pending JP2004226190A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2003013180A JP2004226190A (en) 2003-01-22 2003-01-22 Method for displaying locational information on photograph image from helicopter and its apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2003013180A JP2004226190A (en) 2003-01-22 2003-01-22 Method for displaying locational information on photograph image from helicopter and its apparatus

Publications (1)

Publication Number Publication Date
JP2004226190A true JP2004226190A (en) 2004-08-12

Family

ID=32901583

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2003013180A Pending JP2004226190A (en) 2003-01-22 2003-01-22 Method for displaying locational information on photograph image from helicopter and its apparatus

Country Status (1)

Country Link
JP (1) JP2004226190A (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100125407A1 (en) * 2008-11-17 2010-05-20 Cho Chae-Guk Method for providing poi information for mobile terminal and apparatus thereof
JP4560128B1 (en) * 2009-08-13 2010-10-13 株式会社パスコ Map image integrated database generation system and map image integrated database generation program
WO2011008660A1 (en) * 2009-07-13 2011-01-20 Raytheon Company Extraction of real world positional information from video
JP5076190B1 (en) * 2011-10-03 2012-11-21 光昭 花畑 Damage status monitoring system
US8331611B2 (en) 2009-07-13 2012-12-11 Raytheon Company Overlay information over video
WO2013051300A1 (en) * 2011-10-03 2013-04-11 Hanabata Mitsuaki Disaster circumstance ascertainment system
US8428341B2 (en) 2008-12-08 2013-04-23 Electronics And Telecommunications Research Institute Apparatus for calculating 3D spatial coordinates of digital images and method thereof
JP2013205165A (en) * 2012-03-28 2013-10-07 Pasuko:Kk Portable photographing device and photographing program
US8558847B2 (en) 2009-07-13 2013-10-15 Raytheon Company Displaying situational information based on geospatial data
JP2013234946A (en) * 2012-05-10 2013-11-21 Kawasaki Heavy Ind Ltd Target position identification device, target position identification system and target position identification method
JP2014220604A (en) * 2013-05-07 2014-11-20 三菱電機株式会社 Photographing position information display device
WO2018170882A1 (en) * 2017-03-24 2018-09-27 Sz Dji Osmo Technology Co., Ltd. Method and system for adaptive gimbal

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08285590A (en) * 1995-04-10 1996-11-01 Kawasaki Heavy Ind Ltd Method and apparatus for specifying position
JP2001292444A (en) * 2000-04-10 2001-10-19 Mitsubishi Electric Corp Image pickup system
JP2001343213A (en) * 2000-06-01 2001-12-14 Minolta Co Ltd Position-specifying apparatus loaded to mobile body
JP2002369189A (en) * 2001-06-06 2002-12-20 Ffc:Kk Camera image display equipment and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08285590A (en) * 1995-04-10 1996-11-01 Kawasaki Heavy Ind Ltd Method and apparatus for specifying position
JP2001292444A (en) * 2000-04-10 2001-10-19 Mitsubishi Electric Corp Image pickup system
JP2001343213A (en) * 2000-06-01 2001-12-14 Minolta Co Ltd Position-specifying apparatus loaded to mobile body
JP2002369189A (en) * 2001-06-06 2002-12-20 Ffc:Kk Camera image display equipment and method

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100125407A1 (en) * 2008-11-17 2010-05-20 Cho Chae-Guk Method for providing poi information for mobile terminal and apparatus thereof
US8200427B2 (en) * 2008-11-17 2012-06-12 Lg Electronics Inc. Method for providing POI information for mobile terminal and apparatus thereof
US8401785B2 (en) 2008-11-17 2013-03-19 Lg Electronics Inc. Method for providing POI information for mobile terminal and apparatus thereof
US8428341B2 (en) 2008-12-08 2013-04-23 Electronics And Telecommunications Research Institute Apparatus for calculating 3D spatial coordinates of digital images and method thereof
US8331611B2 (en) 2009-07-13 2012-12-11 Raytheon Company Overlay information over video
US8558847B2 (en) 2009-07-13 2013-10-15 Raytheon Company Displaying situational information based on geospatial data
WO2011008660A1 (en) * 2009-07-13 2011-01-20 Raytheon Company Extraction of real world positional information from video
JP2011038944A (en) * 2009-08-13 2011-02-24 Pasuko:Kk System and program for generating map-image-integrated database
CN102575933A (en) * 2009-08-13 2012-07-11 株式会社博思科 System that generates map image integration database and program that generates map image integration database
WO2011019071A1 (en) * 2009-08-13 2011-02-17 株式会社パスコ System that generates map image integration database and program that generates map image integration database
JP4560128B1 (en) * 2009-08-13 2010-10-13 株式会社パスコ Map image integrated database generation system and map image integrated database generation program
CN102575933B (en) * 2009-08-13 2014-07-09 株式会社博思科 System that generates map image integration database and program that generates map image integration database
US9001203B2 (en) 2009-08-13 2015-04-07 Pasco Corporation System and program for generating integrated database of imaged map
JP5076190B1 (en) * 2011-10-03 2012-11-21 光昭 花畑 Damage status monitoring system
WO2013051300A1 (en) * 2011-10-03 2013-04-11 Hanabata Mitsuaki Disaster circumstance ascertainment system
JP2013205165A (en) * 2012-03-28 2013-10-07 Pasuko:Kk Portable photographing device and photographing program
JP2013234946A (en) * 2012-05-10 2013-11-21 Kawasaki Heavy Ind Ltd Target position identification device, target position identification system and target position identification method
JP2014220604A (en) * 2013-05-07 2014-11-20 三菱電機株式会社 Photographing position information display device
WO2018170882A1 (en) * 2017-03-24 2018-09-27 Sz Dji Osmo Technology Co., Ltd. Method and system for adaptive gimbal

Similar Documents

Publication Publication Date Title
JP5767731B1 (en) Aerial video distribution system and aerial video distribution method
JP3225434B2 (en) Video presentation system
EP3629309A2 (en) Drone real-time interactive communications system
WO2010097921A1 (en) Mobile object imaging system, mobile object, ground-based station device, and method for imaging mobile object
JP2004226190A (en) Method for displaying locational information on photograph image from helicopter and its apparatus
US20180262789A1 (en) System for georeferenced, geo-oriented realtime video streams
JP2007507186A (en) System and method for geolocation using image technology
EP2685707A1 (en) System for spherical video shooting
KR102335994B1 (en) Integrated control apparatus of surveillance devices for drone surveillance
Mukherjee et al. Unmanned aerial system for post disaster identification
JP6482857B2 (en) Monitoring system
CN109068098B (en) Unmanned aerial vehicle video monitoring system for enhancing picture display
JP2695393B2 (en) Position specifying method and device
JP2000050156A (en) News supporting system
JP2001309233A (en) Remote controlling system of photographing apparatus
JP2008252457A (en) Inboard monitor recording system
WO2003021967A2 (en) Image fusion systems
WO2017160381A1 (en) System for georeferenced, geo-oriented real time video streams
JP2007241085A (en) Photographed image processing system and photographed image processing device, and photographed image display method
US20230074477A1 (en) System and method for object monitoring, localization, and controlling
KR102347972B1 (en) panoramic vision suppling systems
JP2003316259A (en) Photography image processing method and system thereof
KR102268061B1 (en) Fire response and lifesaving monitoring system using helicopter
JP6448427B2 (en) Facility name superimposing device
JPH10285583A (en) Fire position and video display transmission system

Legal Events

Date Code Title Description
A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20041221

RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20041221

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20041227

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20041221

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20050127

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20050412

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20050607

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20050628