KR20160120955A - Module for multi diensional vedio information visualization - Google Patents

Abstract

The present invention relates to a damage information analysis system. The damage information analyzing system according to the present invention includes a damaged area image management module for collecting images of at least one damaged area, a damage identification item for the image, and extracting damage information according to the damage identification item An optimum access route selection module for selecting an optimum access route to support a recovery resource for the damaged area based on the damage information, and displaying the location of the damaged area on a two-dimensional map, And a damaged area integrated management module for visually displaying damage information and an access route in two or three dimensions.

Description

[0001] MODULE FOR MULTI DIENSIONAL VEDIO INFORMATION VISUALIZATION [0002]

The present invention relates to the development of a large capacity multi-dimensional image information visualization module for damage detection of a waterfront structure.

The importance of real-time data acquisition and analysis is increasing for rapid disaster management. In order to detect risks from large-scale, centralized and globalized disasters and disasters such as natural disasters and environmental pollution, The need for disaster management is increasing.

In the past, efforts have been made to utilize the video information of Arirang No. 3 high-resolution satellite and aerial image, etc. in order to improve the quality of life of the people by utilizing disaster response, weather / marine information provision, and the like.

By using disaster prevention system using IT technology for disaster / disaster damage, it is possible to prevent and respond quickly, and it is possible to enhance safety prevention effect against national disaster through intelligent image recognition technology.

Numerous research and technology developments are being pursued in developed countries in order to monitor natural disaster preparedness. Techniques utilizing video mapping system are being developed due to the development of automatic processing technology for spatial information and the development of near unmanned aircraft technology.

Especially, it is possible to reduce the operation and management cost by constructing a system adopting a small UAV and a low-cost sensor, and it is possible to secure speedy acquisition of spatial information in a disaster area and a disaster area by using a small UAV.

Development of disaster analysis evaluation technology is essential to combine GIS, satellite, CCTV, advanced instruments, large-scale data processing and analysis, computer-based disaster simulation, real-time sharing and transmission of information.

Therefore, it can contribute greatly to the development of disaster related technology through disaster prediction and management technology by combining advanced information technology related to disaster management.

For disaster analysis, rapid damage evaluation and calculation of recovery cost are needed by using monitoring technology for monitoring of the disaster of city and space, such as broadband monitoring equipment system for acquiring and processing disaster space information, and disaster monitoring system using air and ground image .

In addition, it may be required to develop and operate a stable system capable of quickly processing the corresponding spatial information and other data.

Emergency disaster prevention technology is an important technology that can prevent the assurance of disaster by rapidly restoring the SOC facilities in the early stage of disaster. However, in Korea, the theoretical study on this and the system and related data analysis Technological accumulation may be required.

In Korea, GIS technology such as high precision spatial information construction is relatively developed. However, related infrastructure such as real-time image capture of aerial photographs for real-time measurement of spatial information changes in the event of a disaster and GIS data processing, It is insufficient.

Therefore, it is a technique to acquire damage information and to generate spatial information by fusing images acquired from airline, images acquired in close proximity to bridge piers, images acquired from fixed and mobile CCTVs on the ground, and images acquired by ordinary users such as smart phones Development is required.

Disclosure of Invention Technical Problem [8] Accordingly, the present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a method and apparatus for detecting and analyzing damage information through detailed modeling of a water- .

In addition, it aims to analyze quantitative damage information promptly and make accurate decision-making without going to the scene directly in case of an emergency disaster.

The damage information analyzing system for achieving the above object comprises a damaged area image management module for collecting images of at least one damaged area, a damage identification item for the image, An optimal access route selection module for selecting an optimal access route to support the recovery resource for the damaged area based on the damage information, and a location of the damaged area on a two-dimensional map And a damaged area integrated management module for visually displaying the damage information and the access route in two or three dimensions.

According to an embodiment of the present invention, it is possible to detect and analyze damage information through detailed modeling of a waterfront structure using multi-dimensional image information, and to utilize IT technology for early diagnosis and minimization of disaster damage of a water- have

According to an embodiment of the present invention, quantitative damage information can be quickly analyzed and an accurate decision can be made without an on-site disaster in case of an emergency disaster.

1 is a block diagram illustrating a damage information analysis system according to an embodiment of the present invention.
2 is a view for explaining a method of connecting a damaged region image data according to an embodiment of the present invention.
3 and 4 are views for explaining a three-dimensional terrain data connection method according to an embodiment of the present invention.
5 is a view for explaining a three-dimensional waterfront structure data connection method according to an embodiment of the present invention.
FIGS. 6 and 7 are views showing a survey table for surveying a three-dimensional waterfront structure data construction environment according to an embodiment of the present invention.
8 is a diagram illustrating an architecture of a large capacity multi-dimensional data visualization platform according to an embodiment of the present invention.
9 is a diagram for explaining development of a large capacity image visualization module according to an embodiment of the present invention.
10 is a view for explaining a tile map generation module according to an embodiment of the present invention.
11 and 12 are views for explaining a tile image according to an embodiment of the present invention.
13 is a view for explaining a large capacity image visualization module according to an embodiment of the present invention.
FIG. 14 is a flowchart illustrating a large capacity image visualization module according to an embodiment of the present invention.
15 is an example of a prototype (viewer) of a large capacity image visualization module according to an embodiment of the present invention.
16 is a view for explaining a waterfront structure visualization module according to an embodiment of the present invention.
17 and 18 are views showing an example of a large-capacity three-dimensional topography according to an embodiment of the present invention.
19 and 20 are views for explaining a large capacity three-dimensional waterfront structure visualization module according to an embodiment of the present invention.
FIG. 21 is a view showing a water level structure of a 3DS MAX SW according to an exemplary embodiment of the present invention.
FIG. 22 is a diagram illustrating a 3D model of a large capacity three-dimensional waterfront structure visualizer module (viewer) according to an embodiment of the present invention.
FIG. 23 is a diagram for comparing a color city with a large capacity three-dimensional waterfront structure visualization module (viewer) according to an embodiment of the present invention.
24 is a diagram comparing Solid and Wireframe models of a large capacity three-dimensional waterfront structure visualization module (viewer) according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to or limited by the embodiments. Like reference symbols in the drawings denote like elements.

The present invention provides a system for quickly obtaining damage information on dam structures such as dams, boats, bridges, dams, retaining walls, cut slopes, etc. in the event of natural disasters such as typhoons, heavy rain, .

The damage information analysis system may include a module for efficiently visualizing the damage information of the multi-dimensional images and the precise three-dimensional waterfront structure model for expressing the large-scale terrain at the initial stage.

1 is a block diagram illustrating a damage information analysis system according to an embodiment of the present invention.

The damage information analysis system 100 of the present invention may include a damaged region image management module 110, a damage information extraction module 120, an optimal access route selection module 130, and a damaged area integrated management module 140 . In addition, according to the embodiment, the damage information analysis system 100 may be configured by adding a damage information analysis module 150, a data management module 160, and a large capacity multi-dimensional data visualization module 170. [ The damage information analysis system 100 can analyze the transmission / reception function between the database and the data through the network by analyzing the data linkage of each module of the damage information analysis system.

First, the damaged area image management module 110 collects images of at least one damaged area. In addition, the damaged area image management module 110 can confirm a false image through visual confirmation of CCTV and UAV images of the damaged area. Also, the damaged area image management module 110 can perform image search of the damaged area, image thumbnail of the damaged area, and images of the damaged area.

The damage information extracting module 120 may select a damage identification item for the image and extract damage information corresponding to the damage identification item. In addition, the damage information extraction module 120 extracts the damage information based on the image of the damaged area, and extracts the damage information to visualize the damage information. Also, the damage information extraction module 120 can derive damage identification items and extract damage information.

The optimal access route selection module 130 selects an optimal access route to support the recovery resource for the damaged area based on the damage information. In addition, the optimal access route selection module 130 can select the location of the damaged waterfront structure according to the restoration priority order, and select the location of the optimal restoration resource according to the damage type. That is, the optimal access route selection module 130 can calculate the optimal access route.

The damaged area integrated management module 140 displays the location of the damaged area on a two-dimensional map, and visually displays the damage information and the access route in two or three dimensions. That is, the damaged area integrated management module 140 is a main module of the damaged information analysis system 100, and can display the previous damaged area and the new damaged area on a two-dimensional map. In addition, the damaged area integrated management module 140 can visualize the damage information calculated in each module and the optimal access route in a two-dimensional or three-dimensional manner. That is, the damaged area integrated management module 140 performs a two-dimensional city of a previous or new damaged area, a three-dimensional city of a new damaged area, damage information, and a two-dimensional / three- .

The damage information analysis module 150 can select the damage type and the damage information for the damaged area in at least one of automatic, semi-automatic, and manual. That is, the damage information analysis module 150 can automatically calculate the damage type and information, or calculate the damage type and semi-automatic / manual information. Also, the damage information analysis module 150 can generate a damage information analysis result report.

The data management module 160 can manage input and output of the image and damage information from the database. That is, the data management module 160 can manage the damaged area image and damage information.

The large capacity multidimensional data visualization module 170 can input and output a reference DB and network information related to the damaged area from a database and visualize the data in two or three dimensions. That is, the large capacity multidimensional data visualization module 170 can manage the input and output of the reference database and the network information of the damaged area through the database server, and can visualize the data in two or three dimensions. Also, the large capacity multi-dimensional data visualization module 170 can display a two-dimensional map (image and vector) map and a three-dimensional map (topography and a waterfront structure).

2 is a view for explaining a method of connecting a damaged region image data according to an embodiment of the present invention.

The damage information analysis system 100 can manage the meta information in addition to the image data of the damaged area and the acquired image information. At this time, the management method through the database can be used for the meta information, and the management method through the network folder sharing can be efficiently used for the image information.

3 and 4 are views for explaining a three-dimensional terrain data connection method according to an embodiment of the present invention.

The damage information analysis system 100 can construct a tile map of the terrain data for efficient visualization of the large-scale terrain data, and the constructed tile map can be divided into two methods such as a connection method through web service and a connection method through folder sharing Can be applied.

The scheme shown in FIG. 3 may be a connection method through a Tile Map Service (TMS) of 3D terrain data.

The room shown in FIG. 4 may be a connection method through file sharing of 3D terrain data.

5 is a view for explaining a three-dimensional waterfront structure data connection method according to an embodiment of the present invention.

Damage information analysis system 100 can collect Mesh information and texture information of LOD (Level of Detail) step for efficient visualization of large capacity three-dimensional waterfront structure. Here, the damage information analyzing system 100 can store and manage the mesh information of each LOD level in the database, and manage the texture information of the LOD step, which is relatively burdensome to store the database, Can be used.

FIGS. 6 and 7 are views showing a survey table for surveying a three-dimensional waterfront structure data construction environment according to an embodiment of the present invention.

The damage information analysis system 100 can investigate the construction environment of the three-dimensional watershed structure data of the test bed area for the purpose of efficient data processing and visualization. The damage information analysis system 100 can perform an investigation on the construction environment for each item as shown in the survey table as shown in FIG.

FIG. 6A shows a LOD (Level of Detail) requirement survey table of a three-dimensional waterfront structure, and FIG. 6B shows a survey table of objects and a layer (object group) definition of a three- have.

7 (a) can be an attribute definition lookup table of a three-dimensional waterfront structure, and FIG. 7 (b) can be a three-dimensional waterfront structure data construction environment lookup table. 7 (c) can be a three-dimensional waterfront structure data construction file format (format) survey table.

The damage information analysis system 100 considers the integrated safety management platform operating process, the integrated safety management platform operating environment (hardware / software (O / S) perspective), the integration scheme of the Web and the DB server And a method of transmitting / receiving data with other systems.

8 is a diagram illustrating an architecture of a large capacity multi-dimensional data visualization platform according to an embodiment of the present invention.

The architecture of the large capacity multi-dimensional data visualization platform (engine) based on the module-by-module function and data linkage analysis results of the data viewpoint required by the damage information analysis system 100 and the data linking method and the construction environment analysis result of the 3D terrain and the waterfront structure Design can be done.

The architecture consists of four parts. The Storage section is a multidimensional data management for damage analysis. The Data Source (I / O) section is an I / O function that reads and writes the information needed for data visualization and damage analysis from Storage quickly. I can take charge.

The map section is used to manage large-scale image / terrain / vector data on a layer basis and render management function to visualize each layer efficiently. Map UI section visualizes large-scale multidimensional data through interaction between input and screen device, Dimensional viewer and a three-dimensional viewer function for performing the 3D viewer function.

9 is a diagram for explaining development of a large capacity image visualization module according to an embodiment of the present invention.

The damage information analysis system 100 may include a large capacity image data tile map generation module. In order to quickly and effectively visualize a large-capacity image, the damage information analysis system 100 may need to apply a tile map technology that divides the entire area of the image into a predetermined tile area and structures the same. The tile map may refer to an image structured by a pixel array of a certain size region of the original image data (for each layered scale) in order to efficiently apply enlargement and reduction of the image.

The damage information analysis system 100 can basically be made to have a size of 2nx2n in the tile map, and the level of the tile can be determined as shown in Equation (1).

10 is a view for explaining a tile map generation module according to an embodiment of the present invention.

The damage information analysis system 100 can perform the performance verification on the developed tile map generation module using the image map data (12 GB) of nine map segments produced at 1: 5,000 scale as shown in FIG. 10 (a) shows the performance verification experiment data specification of the tile map generation module, and FIG. 10 (b) shows the performance verification experiment data (1: 5K 9 map) of the tile map generation module have.

11 and 12 are views for explaining a tile image according to an embodiment of the present invention.

11 (a) is a diagram showing a tile image specification for each of eight levels generated through experiments. The damage information analysis system 100 can apply a minimum size of tiles of 256x256 and a maximum level of 8 for performance verification, and accordingly, an 8-level tile having a size of 65,536 x 65,536 for an original image of 58,002 x 72,102 size Images can be generated.

11 (b) is a diagram showing the result of the level 8 tile image generation through the experiment.

FIG. 12 is a view showing a folder storing result of the scale image of the generated tile image. The damage information analysis system 100 can automatically generate and store a structured folder of the generated tile images, and the tile image storing method can increase the data connection efficiency of the damage analysis system.

13 is a view for explaining a large capacity image visualization module according to an embodiment of the present invention.

The damage information analysis system 100 reads out an IRaster interface for reading pixel information from a disk (file) device based on an IMapRasterLayer interface for handling a large-capacity image tile map or one image file as a layer, It can be configured as an IMapRasterRenderer that outputs (shows) on-pixel information to the screen device. The class diagram of the large capacity image visualization module may be as shown in FIG.

The IRaster interface basically provides a function to read pixel information of a desired area. If the target image is composed of a tile map or has a reduced magnification image, a function of obtaining pixel information of a tile image or a reduced magnification image at a desired position Can be performed.

The IMapRasterRenderer interface provides the ability to output (show) the image to the target screen device and to speed up the screen city speed if there is a tile map or reduced magnification image.

FIG. 14 is a flowchart illustrating a large capacity image visualization module according to an embodiment of the present invention.

The damage information analysis system 100 may include a large-capacity image visualization module. The large capacity image visualization module is designed / implemented with a structure that can quickly and precisely display large amount of image data by accessing tile map. In the developed module, the internal interface according to the event message The interconnection flow may be as shown in Fig.

15 is an example of a prototype (viewer) of a large capacity image visualization module according to an embodiment of the present invention.

The large-scale image visualization module prototype (viewer) has been developed for the purpose of verifying the performance of the tile map generation module and the image visualization module. FIG. 15 is a view showing a large-capacity tile image generated through the tile map module, .

The prototype can be implemented so as to be linked with the Naver TMS (Tile Map Service) map, and can be used for verifying the positional accuracy of the tile map generated by superimposing the tile map and the Naver map as shown in FIG.

16 is a view for explaining a waterfront structure visualization module according to an embodiment of the present invention.

The large-capacity 3D terrain visualization module is based on the CWorld class which manages the camera information of the image, the 3D terrain, and the three-dimensional waterfront structure, the CTerrain class representing the terrain, the CModelGroupLayer class representing the three- ≪ / RTI >

The CWorld class defines a World Coordinate System that encompasses all objects (3D terrain / watershed structures) to be managed, so that all objects (terrain / 3D structures) included in one actual object area It is possible to take charge of the function of managing such that it can be expressed easily.

The CTerrain class provides the ability to quickly structure large-scale digital elevation data and orthoimages into three-dimensional terrain, which is the most important role in the 3D terrain visualization module. It also provides classes such as CHeightMap, CImageMap, CImageMapTextureManagerMT, and CHeightMapQLod Lt; / RTI >

The CHeightMap class provides the ability to get the height value of the desired area from the numerical elevation data, and the CImageMap class can provide the function to get the pixel information from the desired reduced magnification image in the orthoimage.

The CImageMapTextureManagerMT class is responsible for managing textures, such as creating or removing unused textures so that imported pixels can be mapped to 3D meshes using CImageMap. It also provides a cache for faster speeds and a multithreaded function to reduce latency when reading data directly from a file.

The CHeightMapQLod class can provide the ability to quickly show terrain on the screen using the Quad-tree space division method.

17 and 18 are views showing an example of a large-capacity three-dimensional topography according to an embodiment of the present invention.

FIG. 17 shows a result of showing a terrain image by a large-capacity three-dimensional terrain visualization module (viewer).

FIG. 18 shows the result of applying an oversight to a large-capacity three-dimensional topographical visualization module (viewer).

19 and 20 are views for explaining a large capacity three-dimensional waterfront structure visualization module according to an embodiment of the present invention.

19 is a diagram showing a class diagram of a three-dimensional waterfront structure visualization module.

The three-dimensional waterfront structure visualization module can be composed of CMEditMesh class having mesh information, CMMeshGroup class defining a structure object, and CMGroupManager class managing a structure object.

The CMEdiitMesh class consists of CMVertices and CMEditTriFaces with vertex and face information, which are basic information of the mesh configuration, CMTexCoords and CMNormals classes with texture coordinate information and normal vector information needed for smooth shading. .

The CMMeshGroup class is the basic unit that represents an object in a waterfront structure and can have multiple CMEditMesh.

CMMeshGroupManager class can have CMTextureManager and CMMaterialManager class for managing integrated object management, texture image of structure, material information, and so on.

20 is a diagram showing a class diagram of an OBJ file input module.

The Waterside Structural Visualization module is a 3DS file format for importing Autodesk's 3DS file format, which is commonly used for 3D modeling software such as Autodesk 3DS Max Studio, and OBJ file format, text-based (ASCII) wavefront format. It can be developed to support input module and OBJ input module.

In addition, these modules can provide the ability to import 3DS and OBJ file vertex, face, normal, texture coordinates, face group, and material information via C3DS and COBJ classes.

FIG. 21 is a view showing a water level structure of a 3DS MAX SW according to an exemplary embodiment of the present invention.

FIG. 22 is a diagram illustrating a 3D model of a large capacity three-dimensional waterfront structure visualizer module (viewer) according to an embodiment of the present invention.

FIG. 23 is a diagram for comparing a color city with a large capacity three-dimensional waterfront structure visualization module (viewer) according to an embodiment of the present invention.

24 is a diagram comparing Solid and Wireframe models of a large capacity three-dimensional waterfront structure visualization module (viewer) according to an embodiment of the present invention.

The damage information analyzing system of the present invention utilizes multidimensional image information to detect and analyze damage information through detailed modeling of a waterfront structure and to utilize IT technology to quickly diagnose and minimize disaster damage in a waterside structure during a disaster Can

In addition, the damage information analysis system of the present invention can quickly analyze quantitative damage information and make accurate decisions without having to go directly to the site in case of an emergency disaster.

The method according to an embodiment of the present invention may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

100: damage information analysis system
110: Damaged area image management module
120: damage information extraction module
130: Optimal access route selection module
140: Damaged area integrated management module
150: Damage Information Analysis Module
160: Data management module
170: Large capacity multi-dimensional data visualization module

Claims (4)

A damaged area image management module for collecting images of at least one damaged area;
A damage information extracting module for selecting a damage identification item for the image and extracting damage information corresponding to the damage identification item;
An optimal access route selection module for selecting an optimal access route to support a recovery resource for the damaged area based on the damage information; And
A damaged area integrated management module for displaying the location of the damaged area on a two-dimensional map and visually displaying the damage information and the access route in a two-dimensional or three-
The damage information analysis system including the damage information analysis system. The method according to claim 1,
A damage information analyzing module that selects a damage type for the damaged area and the damage information in at least one of automatic, semi-automatic, and manual manner;
The damage information analysis system further comprising: The method according to claim 1,
A data management module for managing input and output of the image and damage information from a database,
The damage information analysis system further comprising: The method according to claim 1,
A large-capacity multidimensional data visualization module for inputting and outputting a reference database and network information related to the damaged area from a database and visualizing the reference database and the network information in two or three dimensions
The damage information analysis system further comprising:

Images