KR20140057225A - Methods of cctv video take advantage and surveillance system improved using multi-sensor and thermal imaging - Google Patents

Abstract

The present invention relates to a method for operating a surveillance system, to which an image processing and transmitting method is applied. The present invention enables efficient analysis of an accident and the site when fire or disaster occurs by improving a CCTV video acquired using a thermal imaging sensor and a multi-environmental sensor at the same time to secure a clear image from an unclear sight caused by fog, cloud, and dust.

Description

[TECHNICAL FIELD] The present invention relates to a CCTV image enhancement method and a surveillance system using the same,

The present invention relates to an image sensing system and method using synthetic images, and more particularly, to an image sensing system and method using synthesized images, and more particularly, To detect the analysis contents of the area which can not be overcome by CCTV such as dust, dust, fog and the like, and to provide the situation of the scene with improved image quality

In general, a fire detector detects a fire and directs the fire signal directly or indirectly to the manager or firefighter center. At this time, according to the fire signal, the sprinkler, which is a fire extinguishing system inside and outside, is automatically controlled to suppress the fire.

In general, fire detectors can not communicate with each other in a fire detection period, even though a large number of receivers are installed inside and outside a building where a fire-fighting facility is installed. Therefore, it is impossible to transmit fire information to a building user quickly. Is not transmitted.

General CCTV surveillance devices are also difficult to detect accurately when there is an element that interferes with environmental detection such as fog, dust, dust, and fire.

Most of the surveillance and detection devices, including fire detectors, are confined to notifying the fire detection and the situation, and there is a problem that they are combined with other systems and are difficult to interact with each other.

In the case of fire monitoring system, the local firefighters can operate the 119 command center and the control center. In case of fire report or fire recognition, it is possible to recognize the location of fire and surrounding information using GPS, GIS, etc. However, There is no system to detect.

Accordingly, a system capable of detecting and monitoring fire in real time through a patent registration No. 1175202 (registered on Aug. 13, 2012) has been proposed. However, the above-mentioned prior art detects a fire by sensing the occurrence of flame and smoke, and thus it is impossible to detect whether or not the fire can occur due to a latent heat state in which the temperature is high, even if flame and smoke are not generated. That is, the conventional fire detection technology warns the fire only when the temperature rises and the smoke and the flame are sensed, so that there is no detection device or method for the latent heat which has a high possibility of fire, and the fire can not be prevented in advance. Also, there is a problem in that it is necessary to use a device that delivers accurate internal conditions when restoration and rescue work is under way to suppress the situation in case of fire. .

Also, in the past, technologies for detecting and alarming fire through sensors and images have been mainly made up. However, in such a conventional fire detection and alarm device, a fire detection device through a video image recognizes red clothes or wallpaper as a fire, or recognizes smoke generated in the cooking process as smoke caused by a fire, Fall

SUMMARY OF THE INVENTION The present invention has been made to solve the problems of the conventional system described above, and it is an object of the present invention to provide a method and system for mixing a real image photographed with a CCD or CMOS and a thermal image photographed through a thermal image camera, The two-dimensional data are received from sensors, ultrasonic sensors, and various sensors that can be two-dimensionalized, ultimately synthesized by incorporating them into a real image, and analyzed by sensors and thermal image data, Is provided to provide an analysis method for the purpose of providing a real scene image of fire and disaster situation or emergency situation in real time and preventing it

The present invention includes the following embodiments in order to achieve the above object.

The embodiment of the fire and situation detection system using the composite image according to the present invention includes a real image camera which is installed in each of a plurality of predetermined zones to photograph a corresponding area and transmits a real image signal, A radiographic image camera for transmitting a thermal image displayed by the radiographic image; A sensor unit including a flame sensor for detecting flame, a smoke sensor for detecting smoke, and an infrared sensor ultrasonic sensor; And an image sensing unit for sensing whether a fire or a disaster occurs through a synthesized image obtained by synthesizing a real image, a thermal image, and sensor data of the photographing unit, and a sensing signal of the sensor unit, wherein the image sensing unit comprises: An image mixing means for mixing an image and a real image; Object recognizing means for separating and recognizing a fire and smoke and an environmental factor among a plurality of objects included in the composite image of the image mixing means; And control means for confirming flame and smoke of the synthesized image separated by the object recognizing means and confirming flame and smoke in association with the sensor unit to issue an alarm. In addition, a reproduction means for reproducing a clear real-time image by removing elements of an environmental factor and a thermal image from a composite image is included, and a communication unit for transmitting and storing this to a portable terminal and an operation server is included.

In another embodiment of the present invention, the image mixing means includes synthesizing an image captured by capturing a same frame in a real image and a column image, and synthesizing an object photographed in a thermal image in a real image, and conversely, And recovering the image of the distorted real image.

In another embodiment of the present invention, the fire and disaster detection system comprises:

And image converting means for converting the mixed image and the separated image in the image mixing means into digital images and applying the converted digital images to the control means.

In another embodiment of the present invention, the sensing system includes an image storage unit for storing a mixed image and an improved image transmitted from the image sensing unit; A video server for posting and transmitting the improved video and the mixed video stored in the video storage unit on-line; And a portable terminal that is registered with the image server and receives the image.

In another embodiment of the present invention, the portable terminal receives and outputs an alarm signal transmitted from the control server from the video server.

In another embodiment of the present invention, the detection system may include an alarm detector for receiving an alarm signal including a position signal for distinguishing a situation occurrence area from the image sensor and issuing an alarm, Terminal.

A preferred embodiment of a sensing method using a composite image according to the present invention includes an image processing step of synthesizing and converting an image captured by a real image camera and a thermal image camera and transmitting the combined image to a video server; An object recognition step of classifying each object included in the composite image in the image processing step and helping the environment sensor data to recognize flame, smoke, and environmental factors; A sensor interlocking step of detecting a fire, an accident, and a possibility of a fire or an accident by interlocking with a sensing signal of a sensor when a fire, a smoke, and an emergency are detected in the object recognition step; And a communication step of issuing and transmitting an alarm in the sensor interlocking step.

In another embodiment of the present invention, the image processing step includes an image capturing step of capturing an image of the same frame in a real image captured by the real image camera and a thermal image captured by the thermal image camera, and converting the captured image into an image; An image synthesizing step of synthesizing the images captured in the image capturing step and mixing the two images into one image;

Converting the image into a digital image in the image synthesizing step, and separating the image by removing distorted image factors through other environmental sensors and thermal image data; And a transmission step of transmitting the separated image and the mixed image through a cable and a network, respectively.

In another embodiment of the present invention, the object recognition step may include a preprocessing step of comparing a previous image and a current image using an image filter in a synthesized image synthesized in the image processing step to determine an object added or changed in the current image ; An object separation step of separating and recognizing objects of flame and smoke and environmental factors (dust, dust, and ashes) in an image distorted by a fire and an accident situation in the current image after the pre-processing step; A determination step of determining whether the object separated in the object separation step is a dangerous element; And a determination step of determining whether the object separated in the object separation step is a smoke or an environmental factor (dust, material, etc.)

As described above, according to the present invention,

Real image and environmental factors (dust, dust, fog, ashes) are removed from the thermal image captured through video camera and environment data input through various sensors. , It is possible to detect the possibility of fire and other accidents and to minimize human and material damage as an appropriate device for the measures before and after the accident

1 is a schematic view for explaining a configuration concept of a fire and accident detection system using a composite image according to the present invention;
FIG. 2 is a schematic view for explaining a concept of forming a composite image according to the present invention and a concept of separate transfer storage. FIG.
FIG. 3 is a diagram illustrating an operating configuration of a fire and accident monitoring system using a composite image according to the present invention.
4 is a flowchart of a program operation process for processing signals and images according to the present invention

Next, a detailed description will be made with reference to the accompanying drawings in order to explain the CCTV image enhancement and the utilization method of the surveillance system using the thermal image and the multiple sensors according to the present invention.

FIG. 1 is a schematic view for explaining a configuration concept of a fire and accident detection system using a composite image according to the present invention, which is a schematic view of a fire or accident detection system using a CCD or CMOS room image acquisition unit 12 included in the sensor unit 11, (Fire situation) and mist, fog, dust, smoke, and the like are detected through the generated thermal image acquisition unit 13, the thermal sensor 14 made of the CdS material series, and various sensor acquisition units 14 The information on the abnormal situation is transmitted to the local terminal device 15, and the terminal device stores various signals without filtering and synthesizes the images of the thermal image sensor part 13 and the real image sensor part 12, .

The signals generated by the terminal include real image, composite image, thermal image, and sensor data, respectively, and the data is compressed according to the synchronization, and transmitted to the central system server 16.

The system server 16 distinguishes objects from images (thermal images and real images) based on data received from the terminal device, and provides image processing data to real images based on information transmitted from the real environment sensors 14 give. In the real image, the distribution and density of the environmental factors (dust, water vapor, mist, dust, smoke) are captured based on the data of the environmental sensors including the thermal image, and the real image is reprocessed with the environmental factors removed .

A real image, a composite image and an event (fire and abnormal situation occurrence information) re-created in the system server are transmitted to the outside through the transmission unit 17. [ The analysis unit (18) analyzes the behavior of the objects distinguished from the composite image and the real image, and analyzes the real time variation of the environmental factors. The storage unit 18 stores the data obtained in the calculation of the analysis unit. The data stored in the storage unit 18 stores the real image, the composite image, the change value of the environmental factor, and the real image data including the environmental factor.

FIG. 2 is a schematic diagram for explaining a concept of forming a composite image and a concept of separate transmission and storage according to the present invention, and is a schematic diagram illustrating an overall functional configuration of a local apparatus. In FIG. 2, the sensor and data acquisition unit 21 plays the role of the sensor unit shown in FIG. 1, and data is transmitted to a system constituted by a DSP and a logic system corresponding to the analysis unit 22 in the system. The analyzing unit 22 analyzes the signal transmitted from the sensor unit 11 and passes the signal sync analysis 24 for separating and reassigning various signals according to the transmission time zone. Sync of the signal and data whose contents are analyzed is assigned to each transmission channel so that the signal channel is distributed 25 and at the same time the signal of the column image and the real image is synthesized 26. The data The transmission unit 27 generates an image (28), compresses each type of image into a state capable of transmission, and waits for transmission (29). In addition, the sensor control transceiver 30 for executing commands received from the central server determines the start and end of transmission / reception.

3 is a block diagram of an operating system of a fire and accident monitoring system using a composite image according to the present invention. The sensor unit 41 and the preprocessor 42 corresponding to the local apparatus 40 have been described in detail with reference to FIGS. 1 and 2. The data transmitted from the local apparatus is transmitted to the management terminal 43 The data is immediately transmitted to the central processing unit 44. [ The central processing unit is received by the video server 45 and separated into a data storage server 46 and a data analysis unit 47. The data analysis unit processes the composite image, the real image, and the thermal image, as well as the image processing for removing the environmental factors from the real image using the sensor data. A new real image to be newly reproduced is recorded and stored in the image data portion. The image and the event data processed by the central processing unit are transmitted to the portable terminal 50 through wired / wireless communication through the data transmission unit 48 so as to cope with emergency situations.

FIG. 4 is a flowchart of a program operation process for processing signals and images according to the present invention as a key element of the present invention. When various data synchronized from the local device reaches the system (f02) by summarizing the time and contents through the protocol, the synthesized data starts to be separated (f03). The signal separation primarily separates the video signal f04 and the environmental sensor signal f05, and the column video signal f06 and the real video signal are separated. At this time, the thermal image signal analyzes object classification and pattern according to temperature (f07).

When the thermal image pattern and the object are determined, the image difference in the portion different from the real image is obtained through the image processing in the composite image (f09). When the thermal image object characteristic and pattern variation amount act on the image difference value in the real image and the composite image, the direction of color change such as color density and luminance is suggested.

The weight value shown above is weighted by the actual image value, and the visibility is blurred due to fire, disaster and other events, and the sharpness of the acquired real image value is increased. The obtained image is analyzed by data processing through a separate image processing (f10), and contents and information capable of real-time monitoring of the event situation are displayed. At this time, the event situation is considered as an event occurrence condition through the situation analysis 1 (f11) through the event condition formula.

In addition, the thermal image sensor can identify the abnormal temperature of the area of interest or the cooling area due to fire or gas leakage as a risk factor that can not be classified into the real image. And whether or not an event has occurred. The event information obtained through the real image and the thermal image in real time has an alarm generation (f13) step in which an event corresponding to the alarm is transmitted through the network to the outside in the manner described in the present invention. At this time, the real time real image and the improved real image are simultaneously transmitted including the contents of the alarm (f14).

Claims (4)

In the present invention, a technical method for improving the image of the real image through the environmental weight value, which includes the range of the technology for defining the environmental weight value through the technique contents for synthesizing the thermal image and the real image and the information of the environmental sensor, A technical method of recognizing an object in an improved real image and tracking how the characteristics of the recognized object are estimated from the real image by combining the event generating conditions resulting from the technical method of paragraph 1 In order to achieve the technical method of paragraphs 1 and 2, a technical method for simultaneously compressing and transmitting the real image, the thermal image, and the composite image in the image acquiring unit A protocol designation method for classifying the synthesized signal for signal separation between the local device and the central device through paragraphs 1 and 2

Images