WO2014196721A1 - System and method for detecting fire using synthetic images - Google Patents

System and method for detecting fire using synthetic images Download PDF

Info

Publication number
WO2014196721A1
WO2014196721A1 PCT/KR2014/001508 KR2014001508W WO2014196721A1 WO 2014196721 A1 WO2014196721 A1 WO 2014196721A1 KR 2014001508 W KR2014001508 W KR 2014001508W WO 2014196721 A1 WO2014196721 A1 WO 2014196721A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
fire
smoke
flame
alarm
Prior art date
Application number
PCT/KR2014/001508
Other languages
French (fr)
Korean (ko)
Inventor
정성진
Original Assignee
(주)앤트원정보기술
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)앤트원정보기술 filed Critical (주)앤트원정보기술
Publication of WO2014196721A1 publication Critical patent/WO2014196721A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00—Fire alarms; Alarms responsive to explosion
    • G08B17/06—Electric actuation of the alarm, e.g. using a thermally-operated switch
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00—Fire alarms; Alarms responsive to explosion
    • G08B17/12—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
    • G08B17/125—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00—Fire alarms; Alarms responsive to explosion
    • G08B17/10—Actuation by presence of smoke or gases, e.g. automatic alarm devices for analysing flowing fluid materials by the use of optical means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof

Definitions

  • the present invention relates to a fire detection system and method using a composite image, and more particularly, to synthesize a thermal image according to a temperature change and a real image photographed with a video camera to change the temperature of an object through a thermal image even in a flameless situation. It relates to a fire detection system and method using a composite image that can detect the latent heat by detecting the.
  • the fire detector used for normal fire control detects a fire and sends a fire signal directly or indirectly to a manager or fire control center. At this time, according to the fire signal to control the sprinkler which is the fire extinguishing equipment indoors and outdoors, extinguish the fire.
  • Such a general fire detector even if a plurality of receivers are installed inside and outside the building in which the fire facilities are installed, cannot communicate with each other during the fire detection period, and thus can not quickly transmit the fire information to the building user. There is a problem that the place is not delivered.
  • the general fire detector is limited to the fire detection and the notification of the fire, there is also a problem that it is difficult to interact with other systems organically combined.
  • fire departments in each region operate the 119 command room and control center to recognize the location of fire and surrounding information using GPS and GIS when reporting a fire or recognizing a fire, but can detect the current fire situation in real time. There is no system.
  • the conventional fire detection technology has a problem that can not prevent the fire in advance because there is no detection device or method of latent heat that is likely to fire as a fire alarm only when the temperature rise and the smoke and the flame is detected.
  • an object of the present invention is to mix a real image taken with a real image camera, and a thermal image taken through a thermal camera does not generate flame or smoke
  • the present invention provides a fire detection system and method using a composite image that can detect a change in temperature even if a fire occurs.
  • the thermal images are installed in different colors and displayed in different colors according to the actual image and temperature of the corresponding zone. It is characterized by separating a plurality of objects included in the composite image mixed with and analyzing the flame and smoke contained in the object to issue an alarm.
  • the latent heat of the object can be checked by mixing the real image photographed by the real image camera and the thermal image photographed by the thermal image camera as described above, the occurrence of a fire and the possibility of occurrence of a fire can be detected and alarmed. It works.
  • FIG. 1 is a schematic view for explaining the concept of a fire detection system and method using a composite image according to the present invention
  • FIG. 2 is a block diagram showing a fire detection system using a composite image according to the present invention
  • FIG. 3 is a flowchart illustrating a fire detection method using a composite image according to the present invention
  • FIG. 4 is a flowchart illustrating an image processing step in a fire detection method using a composite image according to the present invention
  • FIG. 5 is a flowchart illustrating an object recognition step to a communication step in a fire detection method using a composite image according to the present invention
  • FIG. 6 is a diagram illustrating an example of a composite image in a fire detection method using the composite image according to the present invention.
  • Preferred embodiments of the fire detection system using a composite image according to the present invention is a real image camera installed in each of a plurality of zones are set to shoot a corresponding zone and transmit a real image signal and is displayed in different colors according to the temperature
  • a photographing unit having a thermal image camera for transmitting a thermal image
  • a sensor unit including a flame sensor for detecting a flame and a smoke sensor for detecting smoke
  • an image detector configured to determine whether a fire has occurred through the synthesized image obtained by synthesizing the real image and the thermal image of the photographing unit and the detection signal of the sensor unit, wherein the image detection unit detects the thermal image and the real image applied from the photographing unit.
  • Image mixing means for synthesizing; Object recognition means for recognizing flames and smoke by analyzing a plurality of objects included in the composite image of the image mixing means; And control means for checking the flame and smoke of the composite image separated from the object recognition means and confirming the flame and smoke in conjunction with the sensor unit to issue an alarm.
  • the image mixing means may synthesize an image captured by the same frame in the real image and the thermal image to synthesize an object photographed as the thermal image in the real image.
  • the fire detection system further comprises an image conversion means for converting the image synthesized in the image mixing means into a composite image of the digital method applied to the control means.
  • the fire detection system includes an image storage unit for storing a composite image transmitted from the image detection unit; An image server for posting and transmitting a composite image stored in the image storage unit online; And a portable terminal registered with the video server to receive the composite video.
  • the portable terminal is characterized in that for receiving and outputting the fire alarm signal transmitted from the control means from the video server.
  • control means checks the color for each temperature in the composite image and compares with the set temperature, if the fire is above the set temperature to the fire It is characterized by issuing a latent heat alarm that can be developed.
  • the fire detection system receives a fire alarm signal including a location signal for distinguishing a fire occurrence area from the image detection unit to issue an alarm, and display the fire alarm with the position on the display It further includes an administrator terminal to display.
  • Preferred embodiment of the fire detection method using a composite image comprises an image processing step of synthesizing and converting the image taken by the real image camera and the thermal image camera to the image server; An object recognition step of classifying each object included in the synthesized image in the image processing step to recognize flame and smoke; A sensor interlocking step of determining a fire occurrence and possibility of fire in association with a detection signal of a sensor when a flame and smoke are detected in the object recognition step; And a communication step of issuing and transmitting a fire occurrence or latent heat alarm if it is determined as one of fire occurrence and latent heat generation in the sensor interlocking step.
  • the image processing step may include an image capturing step of capturing an image of the same frame from the real image photographed by the real image camera and the thermal image photographed by the thermal image camera; An image mixing step of synthesizing two images into one image by synthesizing the image captured in the image capturing step; An image conversion step of converting the image synthesized in the image mixing step into a digital image signal; And transmitting the synthesized image converted into the digital image signal in the image conversion step through a cable and a network.
  • the object recognition step is a pre-processing step of determining the object added or changed in the current image by comparing the previous image and the current image using the image filter in the composite image synthesized in the image processing step ;
  • An object separation step of separating and recognizing objects of the flame and the smoke by applying the characteristics of the flame and the smoke in the current image after the preprocessing step;
  • a flame determination step of determining whether the object separated in the object separation step is a flame;
  • a posture determination step of determining whether the object separated in the object separation step is smoke.
  • the object included in the composite image is A set temperature determination step of determining whether the set temperature is higher than the set temperature; And a latent heat alarm step of issuing a latent heat alarm when the temperature of the object represented by different colors in the composite image is higher than or equal to the set temperature in the set temperature determining step.
  • FIG. 1 is a schematic diagram illustrating the concept of a fire detection system and method using a composite image according to the present invention.
  • the fire detection system and method using a composite image detects the presence of fire and the possibility of fire through the flame and smoke detection of the sensor unit 13 and the image detection of the photographing unit 11 And an image processing member 10 including an image sensing unit 12.
  • the image processing member 10 detects the presence or absence of a fire and transmits it to the administrator terminal 50 and / or the image server 30 so as to be identified on the web or the portable terminal 40.
  • the present invention synthesizes a thermal image photographing the actual image photographed by the photographing unit 10 and the color change according to the temperature to detect a temperature change and the presence of a flame and smoke, and the detection of the sensor unit 13. In conjunction with the signal, it is possible to accurately detect the presence of fire.
  • the present invention synthesizes the real image and the thermal image, and can check the temperature change of the object included in the composite image can recognize the presence or absence of latent heat. Therefore, the present invention determines the possibility of fire by setting a temperature (hereinafter, referred to as a set temperature) in which the fire may be generated in the latent heat in order to determine the possibility of fire occurrence by the latent heat.
  • a set temperature a temperature in which the fire may be generated in the latent heat in order to determine the possibility of fire occurrence by the latent heat.
  • latent heat means that the object does not generate sparks or smoke but has a temperature higher than the ambient temperature so that it can be developed into a fire.
  • the object corresponds to all objects (objects that can cause fire) included in the captured image.
  • the present invention compares the image detected by the photographing unit 11 for photographing the analog image and thermal image and the sensor unit 13 for detecting the flame and smoke and the image detection to determine the presence or absence of fire
  • An image processing member 10 having a portion 12, an administrator terminal 50 for receiving and alarming an image transmitted from the image processing member 10 and a fire detection and latent alarm, and the administrator terminal 50.
  • / or image storage units 20 and 20 ' for storing images transmitted from the image processing member 10 through cables and networks, and images stored in the image storage units 20 and 20' online. It provides a video server 30, and a portable terminal 40 for receiving a fire or latent heat generation signal from the video server (30).
  • the image processing member 10 including the sensor unit 13, the image capturing unit 11, and the image sensing unit 12 is installed in one or more sections within a building and is connected to the manager terminal 50 through wired or wireless communication. And / or transmits the detection signal and the captured image to the image storage unit 20. 20 '.
  • the image sensing unit 12 is embedded with control means 121 (see FIG. 2) to communication means 125 (see FIG. 2) and synthesizes a real image and a thermal image transmitted from the photographing unit 11 to synthesize a composite image. Generates and recognizes objects such as smoke or flame by separating each object included in the composite image. And the image detection unit 12 receives the detection signal of the sensor unit 13 for detecting smoke and sparks to determine the presence of a fire and to alarm.
  • the image sensing unit 12 transmits the synthesized image to the image storage unit 20, 20 'and the image server 30 through the manager terminal 50 and / or a cable and a network, and the web or portable terminal 40 Through the wired / wireless communication terminal such as) to transmit the composite image for viewing.
  • the manager terminal 50 gives a unique code to the photographing unit, the sensor unit, and the image sensing unit 12 installed in each zone to generate a fire from any one of the image sensing units 12 installed in a plurality of zones.
  • a signal or latent heat alarm is received, check the unique code of the video detection unit 12 to check the installed area to alarm the fire and latent heat with the location information.
  • the image server 30 provides the composite image stored in the image storage unit 20, 20 ′ and the network image storage unit 20, 20 ′ to the web or portable terminal 40 through a wired or wireless communication network.
  • the video server 30 preferably transmits the composite video and the fire and possible fire signal to the registered mobile terminal 40 (smartphone, telephone, desktop, notebook, PDA, PDP, netbook). .
  • FIG. 2 is a block diagram illustrating an image processing member in a fire detection system using a composite image according to the present invention.
  • the image processing member 10 includes a sensor unit including a flame sensor 131 for detecting a flame and a smoke sensor 132 for detecting smoke ( 13), a photographing unit 11 having a real image camera 111 for shooting an actual image and a thermal image camera 112 for shooting a thermal image, and the real image camera 111 and a thermal image camera 112 And an image detecting unit 12 for synthesizing the captured image and analyzing the objects included in the synthesized image to alarm fire occurrence and latent heat.
  • a sensor unit including a flame sensor 131 for detecting a flame and a smoke sensor 132 for detecting smoke ( 13), a photographing unit 11 having a real image camera 111 for shooting an actual image and a thermal image camera 112 for shooting a thermal image, and the real image camera 111 and a thermal image camera 112
  • an image detecting unit 12 for synthesizing the captured image and analyzing the objects included in the synthesized image to alarm fire occurrence and latent heat.
  • the image sensing unit 12 separates the image mixing means 122 for synthesizing the real image and the thermal image, the image converting means 123 for converting the synthesized image as a digital signal, and an object included in the synthesized image.
  • the object recognition means 124 for analyzing whether the flame and / or smoke is included, the communication means 125 for transmitting the synthesized image and the alarm signal through the manager terminal 50 and / or the cable and the network, and the flame described above.
  • Control means 121 for receiving a detection signal of the sensor 131 and the smoke sensor 132, and receives the recognition signal of the flame and / or smoke object of the object recognition means 124 to determine the occurrence of fire and the possibility of fire ).
  • the flame sensor 131 is located at a long distance from the control means 121 and detects the surrounding flame.
  • the flame sensor 131 detects a high temperature at a specific position at an ambient temperature and applies a detection signal to the control means 121.
  • the smoke sensor 132 is located at a long distance from the control means 121 to detect the surrounding smoke.
  • the smoke sensor 132 includes a light emitting element and a light receiving element as an optical sensor, and when the amount of light received by the smoke decreases, the smoke sensor 132 applies a smoke generating signal to the control means 121.
  • the real image camera 111 for example, take a real-time image of the surroundings, such as CCTV and apply to the control means 121.
  • the thermal imaging camera 112 detects and photographs a temperature change in an area to be photographed, and transmits the thermal image to the control means 121.
  • the real image camera 111 and the thermal image camera 112 are preferably photographed in the same direction in the same direction.
  • the thermal image is set to have a different color for each temperature by setting a reference temperature value to collect temperature information in a corresponding zone and is expressed in different concentrations and colors according to temperatures for each object included in the image.
  • the image mixing means 122 synthesizes a real image and a thermal image respectively captured by the real image camera 111 and the thermal image camera 112, and synthesizes one image.
  • the image mixing unit 122 synthesizes an image capturing any one frame of the real image and the thermal image.
  • the image converting means 123 converts the image synthesized by the image mixing means 122 as a digital image. For example, the image converting means 123 combines a plurality of composite images into one image frame and converts them into image files of digital formats such as MPEG and AVI.
  • the object recognizing means 124 separates a plurality of objects included in the composite image and analyzes whether the flame and / or smoke is included, and if the flame and / or smoke is included in the object of the composite image, The sensing signal is applied to the control means 121.
  • the communication means 125 transmits the composite image to the image storage unit 20, 20 ′ and / or the manager terminal 50.
  • the control unit 121 controls to synthesize the image by applying the real image and the thermal image captured by the thermal imager 112 and the real image camera 111 to the image mixing means 122, and the image mixing In the means 122, the composite image is sequentially applied to the image converting means 123 and the object recognition means 124 for control.
  • the control unit 121 controls the communication unit 125 to display the composite image of the digital format converted by the image conversion unit 123 to the image storage unit 20, 20 ′ and / or the manager terminal 50. ) Is applied.
  • the video server 30 posts the synthesized video stored in the video storage units 20 and 20 'on the web through a wired / wireless communication network or transmits it to the portable terminal 40.
  • control unit 121 checks the detection signals of the flame sensor 131 and the smoke sensor 132, and if the flame and smoke are detected. The fire alarm is issued to the manager terminal (50).
  • control unit 121 was not recognized the object of the flame and smoke in the composite image, the flame sensor 131 and the smoke sensor 132, but there was no detection signal of the flame and smoke, the surrounding object in the composite image And the presence or absence of an object that generates heat as a temperature higher than the ambient temperature.
  • control means 121 determines whether an object that is heated to a higher temperature than other objects among the objects included in the synthesized image may be fired by comparing with the set temperature, and issues a fire occurrence alarm. .
  • the manager terminal 50 receives a fire alarm signal and a latent heat alarm signal of the image sensing unit 12 to control an alarm and generates an alarm under the control of the terminal controller 51.
  • the alarm unit 52 which is issued, the display 53 which displays the fire alarm and the fire occurrence position under the control of the terminal controller 51, the image server 30 and / or the image storage unit 20, 20 '.
  • Communication unit 54 in communication with the communication unit 54).
  • the terminal controller 51 When the terminal controller 51 receives a fire alarm and a latent heat alarm including a unique code from the image detector 12, the terminal controller 51 checks a unique code assigned to each image detector 12 to detect the corresponding image detector 12. Check the installed area to control to display the area where the fire and latent heat alarm occurred on the display 53.
  • the terminal control unit 51 controls the alarm means to issue a visual and / or audio alarm.
  • the alarm unit 52 includes light emitting display means for outputting a buzzer or a light emitting signal for generating an alarm sound.
  • the manager terminal 50 may receive a fire alarm and a latent heat alarm of the image sensing unit 12, control the communication unit 54, and transmit the same to the image server 30. More preferably, the manager terminal 50 may receive a composite image of the image sensing unit 12 and control the communication unit 54 to relay the image to the image storage units 20 and 20 '.
  • the present invention may be variously modified according to the intention of the designer. That is, although the present invention has been described in the above description that the composite image of the image sensing unit 12 is directly transmitted to the image storage unit, in another embodiment, the manager terminal 50 receives the batch image and collectively stores the image. It is also possible to relay to the parts 20 and 20 '.
  • the terminal controller 51 controls the display 53 to display a location of a zone where a fire or latent heat is generated, and transmits a fire occurrence signal to the image server 30 by controlling the communication unit 54.
  • the video server 30 transmits a fire occurrence signal of the video detection unit 12 and / or the administrator terminal 50 to the registered portable terminal 40.
  • the present invention includes the configuration as described above, in the following will be described in detail with reference to Figures 3 to 6 the effect achieved through the configuration as described above.
  • FIG. 3 is a flowchart illustrating a fire detection method using a composite image according to the present invention.
  • the fire detection method using the composite image according to the present invention synthesizes and converts an image captured by the real image camera 111 and the thermal image camera 112, and transmits the image to the image server 30.
  • the object recognition step (S20) for recognizing the flame and smoke by separating each object included in the composite image of the image processing step (S10), and the flame and smoke in the object recognition step (S20) Is detected, the sensor interlocking step (S30) and the sensor interlocking step (S30) in conjunction with the detection signal of the sensor to determine the possibility of fire, and if the fire occurrence or fire occurrence is determined as one of the possibility of fire in the sensor interlocking step (S30) Alert and communication step (S40) for transmitting a possible alarm.
  • the image processing step (S10) generates a composite image by synthesizing the real image and the thermal image respectively captured by the real image camera 111 and the thermal image camera 112, and converts the synthesized image through a cable and a network.
  • the composite image stored in the image storage units 20 and 20 ' is transmitted to the portable terminal 40 registered in the image server 30 in real time or for a predetermined time.
  • the object recognition step (S20) is a step of recognizing the flame and smoke by analyzing all the objects included in the composite image of the image processing step (S10).
  • the image processing member 10 compares the synthesized image captured in real time with the previously captured composite image and displays an object that is not included in the previous image or an object whose color is different from the previous image due to the temperature change captured in the thermal image. Recognize it to see if it is a flame and / or smoke.
  • the thermal imaging camera 112 detects the temperatures of all objects located in the photographed area and outputs the photographed images having different colors for each temperature. Therefore, if an object that is heated or cooled compared to the previous image is present in the composite image, it is photographed in a different color than before. Accordingly, the image processing member 10 compares the previous image (or the reference image photographed in the normal state) with the current image and analyzes whether the flame or smoke is included.
  • the sensor interlocking step (S30) if the flame or smoke is recognized in the object recognition step (S20), it is determined whether the fire occurs in conjunction with the detection signal of the flame sensor 131 and the smoke sensor 132 installed in the area. It's a step.
  • the alarm and communication step (S40) is a step of transmitting a fire occurrence signal to the portable terminal 40 registered through the image server 30 when it is determined that a fire has occurred in the sensor interlocking step (S30).
  • FIG. 4 is a flowchart illustrating an image processing step in a fire detection method using a composite image according to the present invention.
  • the image processing step includes capturing the same frame in the real image and the thermal image to convert the image into an image, and the two images captured in the image capturing step (S11) as one image.
  • a transmission step (S14) for transmitting the synthesized image converted into a signal.
  • the image capturing step (S11) is performed by applying the real image of the real image camera 111 and the thermal image of the thermal image camera 112 to the image mixing means 122 in the control means 121. This is a step of controlling to capture an image frame photographed at the same time. This will be described through the photo attached to FIG. 6.
  • FIG. 6 is a photograph showing an example of a composite image in a fire detection method using the composite image according to the present invention.
  • FIG. 6A is a captured image of an actual image
  • FIG. 6B is a captured image of a thermal image.
  • the image mixing means 122 captures the real image and the thermal image captured at the same time and position in the real image and the thermal image applied to the control means 121, respectively, and then, FIGS. 6A and 6B.
  • FIGS. 6A and 6B To an image like
  • FIG. 6A illustrates an image captured by the real image camera 111
  • FIG. 6B outputs a thermal image captured by the thermal image camera. 6 (b)
  • each object included in the image is displayed in a different color for each temperature.
  • the control unit 121 controls the image mixing unit 122 to combine two captured images into one.
  • the image mixing means 122 synthesizes the real image capture image and the thermal image capture image under the control of the control means 121, synthesizes the image as a single image, and applies it to the control means 121.
  • Fig. 6C the composite image is composed of the real image image and the thermal image image to synthesize a thermal image image of an object having a different temperature from a surrounding object on the background of the real image image.
  • the image conversion step S13 is a step of controlling the image conversion means 123 in the control means 121 to convert the image synthesized in the image mixing step S12 into a digital image file.
  • the image converting means 123 converts the composite image applied from the control means 121 into a digital image signal. That is, the image converting means 123 converts the captured image of the analog image real image and the thermal image into a digital image image file.
  • the image transmission step (S14) is the manager terminal 50 and / or the image through the communication means 125 the composite image converted in the digital manner by the image conversion means 123 in the control means 121 It is the step of transmitting to the storage unit (20, 20 ').
  • the control unit 121 transmits the composite image converted by the image conversion unit 123 in a digital manner to the manager terminal 50 through the communication unit 125.
  • the manager terminal 50 transmits the composite image received from the image sensing unit 12 to the image storage units 20 and 20 '.
  • the image server 30 transmits the composite image stored in the image storage unit 20, 20 ′ to the registered portable terminal 40. Therefore, the user can check in real time whether a fire occurs at a specific location through the composite image provided from the image server 30.
  • the object recognition step (S20), the sensor interlocking step (S30), and the communication step (S40) are sequentially performed after the image processing step as described above.
  • the entire process from the object recognition step to the communication step (S40) will be described with reference to FIG.
  • FIG. 5 is a flowchart showing in detail the object recognition step (S20) to the communication step (S40) in the fire detection method using a composite image according to the present invention.
  • the object recognizing step S20 may include a preprocessing step S21 of determining an object added or changed from a previous image and a current image using an image filter, and from the current image after the preprocessing step S21.
  • the object separation step (S22) for separating and recognizing the object of the flame and smoke by applying the characteristics of the flame and smoke by separating the added or changed objects, and the flame for determining whether the object separated in the object separation step (S22) is a flame Determination step (S23), and the deferred determination step (S24) for determining whether the object separated in the object separation step (S22) is smoke.
  • the sensor interlocking step (S30) is to check the detection data of the flame sensor 131 and smoke sensor 132 when any one of the flame and smoke is determined in the flame determination step (S23) and smoke determination step (S24). Step.
  • the alarm and communication step (S40) is a fire occurrence determination step (S41) for determining whether a fire occurs by checking the detection signal of the sensor in the sensor interlocking step (S30), and the fire occurs in the fire occurrence determination step (S41) If it is determined that the generated fire alarm signal (S42) for transmitting a fire alarm signal to the manager terminal (50).
  • the communication step (S40) is not determined to be a flame and smoke after the sensor interlocking step (S30) or after the object recognition step (S20), it is determined whether the temperature of the object included in the composite image is above the set temperature.
  • the set temperature determination step (S43) and the latent heat alarm step (S44) to alert the latent heat when determined to be above the set temperature in the set temperature determination step (S43).
  • the preprocessing step S21 may be included in the reference image photographed and synthesized in the previous time by synthesizing the synthesized image synthesized by the object mixing means 122 to the image mixing means 122 under the control of the control means 121. This step compares objects that do not exist.
  • the object recognition means 124 is not included in the previous image (the reference image photographed in the normal environment) through the image filter, the composite image synthesized by the image mixing means 122 by the control of the control means 121 Check for objects or colors that are not.
  • the object separation step (S22) is a step of separating the flame and smoke objects included in the composite image in the object recognition means 124 by the control of the control means 121.
  • the control means 121 controls the object recognition means 124 to separate the object not included in the previous image if the composite image includes an object different from the previous image in the preprocessing step S21. Determine whether the object matches the characteristics of the smoke and smoke.
  • the flame judging step S23 determines whether an object set as a flame is included among the objects separated from the composite image in the control unit 121.
  • the acting determination step S24 determines whether the object set to smoke is included among the objects separated from the composite image by the control unit 121.
  • the characteristics of the object for the smoke and the flame is stored in its own memory, and the control means 121 compares the stored smoke and flame characteristics with the properties of the object separated from the composite image to determine whether the smoke or the flame. .
  • the characteristics of the smoke and the flame are classified as object-specific characteristics in the thermal image, and characteristic data that can be distinguished from other objects are stored in its own memory of the control unit 121. Accordingly, the control unit 121 may recognize the flame and / or smoke by comparing the stored characteristic data of the flame and the smoke in the thermal image with the object separated by the object recognition unit 124.
  • the set temperature step (S43) for comparing the temperature and the set temperature in the separated object is performed.
  • the sensor interlocking step (S30) is a step in which the control means 121 receives the detection signals of the flame sensor 131 and the smoke sensor 132 to confirm the generation of flame or smoke.
  • the flame sensor 131 detects whether a flame is generated in the room and applies it to the control means 121
  • the smoke sensor 132 senses whether smoke is generated in the room and applies it to the control means 121. . Therefore, the control unit 121 receives the detection signals of the flame sensor 131 and the smoke sensor 132 to determine whether the flame and smoke is generated to proceed with the alarm and communication step (S40).
  • the fire determination step (S41) was determined that the flame and / or smoke was generated in the flame and smoke recognition determination step (S23, S24) in the control means 121, also in the sensor interlocking step (S30) If the same judgment results come out, it is determined that a fire has occurred.
  • the fire alarm step (S42) is a step of transmitting an alarm signal containing a unique code to the manager terminal 50, if it is determined that a fire occurred in the fire determination step (S41).
  • the manager terminal 50 controls the alarm unit 52 to issue a buzzer, and checks the corresponding position through the unique code of the image detection unit 12 included in the fire alarm signal to the display 53. Control to display the area where the fire occurred.
  • the manager terminal 50 transmits a fire occurrence signal to the video server. Then, the video server 30 transmits a fire alarm signal to the registered portable terminal.
  • the registered mobile terminal may correspond to a manager, a tenant, or a householder of a fire zone.
  • control means 121 is determined after the object recognition step (S20) or in the fire determination step (S41) is determined that the object of the smoke or flame from the composite image, and if it is determined that no fire has occurred the determination of the set temperature Proceed to step.
  • the set temperature determination step (S43) is a step of checking the object displayed in a different color from the previous image in the composite image in the control means 121 to compare the temperature of the object and the set temperature.
  • the control unit 121 determines whether the color indicating the object is similar to the color of the set temperature or the color set to a temperature higher than the set temperature.
  • the latent heat alarming step (S44) is a latent heat alarm by determining that there is a possibility that the control means 121 may be developed into a fire if the temperature of the object is higher than or equal to the set temperature in the setting temperature determining step (S43). It is a step to issue.
  • the control means 121 transmits a latent heat alarm signal to the manager terminal 50 together with the unique code. Therefore, the manager terminal 50 issues a latent heat alarm, and outputs the location information of the area where the latent heat alarm is issued through the display 53 through a unique code.
  • the manager terminal 50 transmits a fire alarm and a latent heat alarm signal to the video server 30 in the fire alarm step S42 and the latent heat alarm step S44. Therefore, the image server 30 transmits a fire alarm and a latent heat alarm signal to the registered portable terminal 40 so that a fire or latent alarm can be confirmed through the portable terminal 40 even if the administrator or the tenant is at a distance. do.
  • the present invention improves the accuracy of the fire alarm by interlocking the composite image and the sensor, and confirms the latent heat through the color change by temperature according to the thermal image. It is very effective for fire prevention.

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Signal Processing (AREA)
  • Alarm Systems (AREA)
  • Fire-Detection Mechanisms (AREA)

Abstract

The present invention relates to a system and a method for detecting fire using synthetic images, and more specifically, to a system and a method for detecting fire using synthetic images, capable of detecting a change in temperature of an object, even in the absence of sparks, through a thermal image by synthesizing an actual image captured by an image camera and the thermal image according to a change in temperature, to confirm latent heat, and thereby detecting a fire or the possibility of a fire.

Description

합성 영상을 이용한 화재감지시스템 및 방법Fire detection system and method using composite image
본 발명은 합성 영상을 이용한 화재감지시스템 및 방법에 관한 것으로서, 더욱 상세하게는 영상 카메라로 촬영된 실제영상과 온도변화에 따른 열영상을 합성하여 불꽃이 없는 상황에서도 열 영상을 통한 객체의 온도변화를 감지하여 잠열을 확인할 수 있는 합성 영상을 이용한 화재감지시스템 및 방법에 관한 것이다. The present invention relates to a fire detection system and method using a composite image, and more particularly, to synthesize a thermal image according to a temperature change and a real image photographed with a video camera to change the temperature of an object through a thermal image even in a flameless situation. It relates to a fire detection system and method using a composite image that can detect the latent heat by detecting the.
통상의 소방관리에 사용되는 화재감지기는 화재를 감지하여 화재신호를 직간접적으로 관리자 또는 소방관제센터로 화재경보를 한다. 이때, 화재신호에 따라 자동으로 옥내외의 소화설비인 스프링클러를 제어하여 화재를 진압한다.The fire detector used for normal fire control detects a fire and sends a fire signal directly or indirectly to a manager or fire control center. At this time, according to the fire signal to control the sprinkler which is the fire extinguishing equipment indoors and outdoors, extinguish the fire.
이러한 일반적인 화재감지기는 소방시설이 설치된 건물의 내외에 다수의 수신기가 설치되어 있더라도, 이들 화재감지기간에 상호통신이 불가능하여 건물이용자에게 신속한 화재정보를 전달할 수 없고, 특히 화재의 최초 발생시간 및 발생장소가 전달되지 않는 문제점이 있다.Such a general fire detector, even if a plurality of receivers are installed inside and outside the building in which the fire facilities are installed, cannot communicate with each other during the fire detection period, and thus can not quickly transmit the fire information to the building user. There is a problem that the place is not delivered.
또한, 일반적인 화재감지기는 화재감지 및 화재를 알리는 것에 국한되어 있고, 다른 시스템과 유기적으로 결합하여 상호적으로 작용하기 어려운 문제점도 있다.In addition, the general fire detector is limited to the fire detection and the notification of the fire, there is also a problem that it is difficult to interact with other systems organically combined.
또한, 각 지역의 소방관서에서는 119 지령실 및 관제센터를 운영하면서 화재신고 또는 화재 인식시 GPS, GIS 등을 이용하여 화재발생 위치 및 주변 정보는 인지할 수 있으나, 현재 화재 상황에 대해서는 실시간 감지할 수 있는 시스템이 없다.In addition, fire departments in each region operate the 119 command room and control center to recognize the location of fire and surrounding information using GPS and GIS when reporting a fire or recognizing a fire, but can detect the current fire situation in real time. There is no system.
따라서 종래에는 특허등록 제1175202호(2012.08.13 등록)를 통하여 실시간으로 화재를 감지 및 모니터링 할 수 있는 시스템이 제안되었다. 하지만 상기 종래기술은 불꽃과 연기가 발생됨을 감지하여 화재를 감지하는 것으로서 불꽃과 연기가 발생되지 않더라도 온도가 높은 상태인 잠열 상태에 따른 화재가능성 여부를 감지할 수 없었다. Therefore, in the related art, a system capable of detecting and monitoring a fire in real time through a patent registration No. 11175202 (registered on August 13, 2012) has been proposed. However, the prior art is to detect the fire by detecting the occurrence of the flame and smoke, even if the flame and smoke does not occur, it was not possible to detect the possibility of fire according to the latent heat state of high temperature.
즉, 종래의 화재감지기술은 온도의 상승과 연기 및 불꽃을 감지해야만 화재를 경보하는 것으로서 화재 가능성이 높은 잠열의 감지장치나 방법이 전무하여 화재를 미연에 방지할 수 없는 문제점이 있었다. That is, the conventional fire detection technology has a problem that can not prevent the fire in advance because there is no detection device or method of latent heat that is likely to fire as a fire alarm only when the temperature rise and the smoke and the flame is detected.
또한 종래에는 센서나 영상을 통하여 화재를 감지 및 경보하는 기술이 주를 이루었었다. 하지만 이와 같은 종래의 화재감지 및 경보장지에서 영상을 통한 화재감지장치는 빨간색의 의상이나 벽지를 화재로 인식하거나, 또는 음식의 조리과정에서 발생되는 연기를 화재발생에 따른 연기로 인식하기 때문에 정확도가 매우 낮은 문제점이 있었다. In addition, conventional techniques for detecting and alarming the fire through the sensor or the image was the main. However, in the conventional fire detection and warning device, the fire detection device using the image recognizes the red clothes or the wallpaper as a fire, or the smoke generated during the cooking of food as the smoke caused by the fire. There was a very low problem.
따라서 본 발명은 상기와 같은 종래의 문제점을 해결하기 위하여 안출된 것으로서, 본 발명의 목적은 실영상 카메라로 촬영한 실영상과, 열상카메라를 통하여 촬영된 열영상을 혼합하여 불꽃이나 연기가 발생하지 않더라도 온도의 변화를 감지하여 화재 발생 가능성을 감지할 수 있는 합성 영상을 이용한 화재감지시스템 및 방법을 제공함에 있다. Therefore, the present invention has been made to solve the above-mentioned conventional problems, an object of the present invention is to mix a real image taken with a real image camera, and a thermal image taken through a thermal camera does not generate flame or smoke The present invention provides a fire detection system and method using a composite image that can detect a change in temperature even if a fire occurs.
본 발명은 불꽃이나 연기가 발생하지 않더라도 온도의 변화를 감지하여 화재 발생가능성을 정확히 감지하기 위하여 다 수개가 설정된 구역내에 각각 설치되어 해당 구역의 실제 영상과 온도에 따라서 서로 다른 색상으로 표시되는 열영상을 혼합한 합성 영상에 포함된 다 수개의 객체를 분리하여 상기 객체중에 불꽃 및 연기가 포함되었는지를 분석하여 경보를 발령하는 것을 특징으로 한다. In the present invention, even if no flame or smoke is generated, in order to detect a change in temperature and accurately detect the possibility of a fire, the thermal images are installed in different colors and displayed in different colors according to the actual image and temperature of the corresponding zone. It is characterized by separating a plurality of objects included in the composite image mixed with and analyzing the flame and smoke contained in the object to issue an alarm.
본 발명은 상술한 바와 같이 실영상 카메라에서 촬영된 실영상과 열영상 카메라를 통하여 촬영된 열영상을 혼합하여 객체의 잠열을 확인할 수 있기에 화재의 발생 및 화재의 발생 가능성을 감지 및 경보할 수 있는 효과가 있다. According to the present invention, since the latent heat of the object can be checked by mixing the real image photographed by the real image camera and the thermal image photographed by the thermal image camera as described above, the occurrence of a fire and the possibility of occurrence of a fire can be detected and alarmed. It works.
도 1은 본 발명에 따른 합성 영상을 이용한 화재감지시스템 및 방법의 개념을 설명하기 위한 개략도,1 is a schematic view for explaining the concept of a fire detection system and method using a composite image according to the present invention,
도 2는 본 발명에 따른 합성 영상을 이용한 화재감지시스템을 도시한 블럭도, 2 is a block diagram showing a fire detection system using a composite image according to the present invention;
도 3은 본 발명에 따른 합성 영상을 이용한 화재감지방법을 도시한 순서도,3 is a flowchart illustrating a fire detection method using a composite image according to the present invention;
도 4는 본 발명에 따른 합성 영상을 이용한 화재감지방법에서 영상처리 단계를 도시한 순서도,4 is a flowchart illustrating an image processing step in a fire detection method using a composite image according to the present invention;
도 5는 본 발명에 따른 합성 영상을 이용한 화재감지방법에서 객체인식 단계 내지 통신단계를 도시한 순서도, 5 is a flowchart illustrating an object recognition step to a communication step in a fire detection method using a composite image according to the present invention;
도 6은 본 발명에 따른 합성 영상을 이용한 화재감지방법에서 합성 영상의 일예를 도시한 도면이다. 6 is a diagram illustrating an example of a composite image in a fire detection method using the composite image according to the present invention.
본 발명에 따른 합성 영상을 이용한 화재감지시스템의 바람직한 실시예는 다 수개가 설정된 구역내에 각각 설치되어 해당 구역을 촬영하여 실영상 신호를 송신하는 실영상 카메라와, 온도에 따라서 서로 다른 색상으로 표시되는 열영상을 송신하는 열영상카메라를 구비하는 촬영부; 불꽃을 감지하는 불꽃센서와, 연기를 감지하는 연기센서를 구비하는 센서부; 및 상기 촬영부의 실영상과 열영상을 합성한 합성영상과 상기 센서부의 감지신호를 통하여 화재발생여부를 판단하는 영상감지부를 포함하고, 상기 영상감지부는 상기 촬영부에서 인가되는 열영상과 실영상을 합성하는 영상믹싱수단; 상기 영상믹싱수단의 합성 영상에 포함된 다 수개의 객체를 분석하여 불꽃 및 연기를 인식하는 객체인식수단; 및 상기 객체인식수단에서 분리된 상기 합성 영상의 불꽃 및 연기를 확인하여 상기 센서부에 연동하여 불꽃 및 연기를 확인하여 경보를 발령하는 제어수단을 포함한다. Preferred embodiments of the fire detection system using a composite image according to the present invention is a real image camera installed in each of a plurality of zones are set to shoot a corresponding zone and transmit a real image signal and is displayed in different colors according to the temperature A photographing unit having a thermal image camera for transmitting a thermal image; A sensor unit including a flame sensor for detecting a flame and a smoke sensor for detecting smoke; And an image detector configured to determine whether a fire has occurred through the synthesized image obtained by synthesizing the real image and the thermal image of the photographing unit and the detection signal of the sensor unit, wherein the image detection unit detects the thermal image and the real image applied from the photographing unit. Image mixing means for synthesizing; Object recognition means for recognizing flames and smoke by analyzing a plurality of objects included in the composite image of the image mixing means; And control means for checking the flame and smoke of the composite image separated from the object recognition means and confirming the flame and smoke in conjunction with the sensor unit to issue an alarm.
본 발명의 다른 실시예에 있어서, 상기 영상믹싱수단은 실영상과 열영상에서 동일 프레임을 캡춰한 이미지를 합성하여 실영상에 열영상으로 촬영된 객체를 합성하는 것을 특징으로 한다. In another embodiment of the present invention, the image mixing means may synthesize an image captured by the same frame in the real image and the thermal image to synthesize an object photographed as the thermal image in the real image.
본 발명의 또 다른 실시예에 있어서, 상기 화재감지시스템은 상기 영상믹싱수단에서 합성된 이미지를 디지탈 방식의 합성 영상으로 변환하여 상기 제어수단에 인가하는 영상변환수단을 더 포함한다. In another embodiment of the present invention, the fire detection system further comprises an image conversion means for converting the image synthesized in the image mixing means into a composite image of the digital method applied to the control means.
본 발명의 또 다른 실시예에 있어서, 상기 화재감지시스템은 상기 영상감지부에서 송신되는 합성 영상을 저장하는 영상저장부; 상기 영상저장부에 저장된 합성 영상을 온라인에 게시 및 송신하는 영상서버; 및 상기 영상서버에 등록되어 상기 합성 영상을 수신받는 휴대용 단말기를 더 포함한다. In another embodiment of the present invention, the fire detection system includes an image storage unit for storing a composite image transmitted from the image detection unit; An image server for posting and transmitting a composite image stored in the image storage unit online; And a portable terminal registered with the video server to receive the composite video.
본 발명의 또 다른 실시예에 있어서, 상기 휴대용 단말기는 상기 영상서버로부터 상기 제어수단에서 송신된 화재경보신호를 수신하여 출력하는 것을 특징으로 한다. In another embodiment of the present invention, the portable terminal is characterized in that for receiving and outputting the fire alarm signal transmitted from the control means from the video server.
본 발명의 또 다른 실시예에 있어서, 상기 제어수단은 상기 합성 영상에서 불꽃과 연기의 객체가 인식되지 않으면, 상기 합성 영상에서 온도별 색상을 확인하여 설정온도와 비교하고, 설정온도 이상이면 화재로 발전 될 수 있는 잠열경보를 발령하는 것을 특징으로 한다. In another embodiment of the present invention, if the object of the flame and smoke is not recognized in the composite image, the control means checks the color for each temperature in the composite image and compares with the set temperature, if the fire is above the set temperature to the fire It is characterized by issuing a latent heat alarm that can be developed.
본 발명의 또 다른 실시예에 있어서, 상기 화재감지시스템은 상기 영상감지부로부터 화재발생지역을 구분하는 위치신호가 포함된 화재경보신호를 수신하여 경보를 발령하고, 디스플레이에 위치와 함께 화재경보를 표시하는 관리자 단말기를 더 포함한다. In another embodiment of the present invention, the fire detection system receives a fire alarm signal including a location signal for distinguishing a fire occurrence area from the image detection unit to issue an alarm, and display the fire alarm with the position on the display It further includes an administrator terminal to display.
본 발명에 따른 합성영상을 이용한 화재감지방법의 바람직한 실시예는 실영상 카메라와 열영상카메라에서 촬영된 영상을 합성 및 변환하여 영상서버에 전송하는 영상처리단계; 상기 영상처리단계에서 합성 영상에 포함된 각각의 객체를 분류하여 불꽃 및 연기를 인식하는 객체인식단계; 상기 객체인식단계에서 불꽃 및 연기가 감지되면 센서의 감지신호와 연동하여 화재발생 및 화재발생가능성을 판단하는 센서연동단계; 및 상기 센서연동단계에서 화재발생 및 잠열 발생중 어느 하나로 판단되면 화재발생 또는 잠열 경보를 발령 및 송신하는 통신단계를 포함하는 것이 바람직하다. Preferred embodiment of the fire detection method using a composite image according to the present invention comprises an image processing step of synthesizing and converting the image taken by the real image camera and the thermal image camera to the image server; An object recognition step of classifying each object included in the synthesized image in the image processing step to recognize flame and smoke; A sensor interlocking step of determining a fire occurrence and possibility of fire in association with a detection signal of a sensor when a flame and smoke are detected in the object recognition step; And a communication step of issuing and transmitting a fire occurrence or latent heat alarm if it is determined as one of fire occurrence and latent heat generation in the sensor interlocking step.
본 발명의 다른 실시예에 있어서, 상기 영상처리단계는 상기 실영상 카메라에서 촬영된 실영상과 열영상카메라에서 촬영된 열영상에서 동일 프레임의 영상을 캡춰하여 이미지로 변환시키는 영상캡춰단계; 상기 영상캡춰단계에서 캡춰된 이미지를 합성하여 두 개의 이미지를 하나의 이미지로 합성하는 영상믹싱단계; 상기 영상믹싱단계에서 합성된 이미지를 디지탈 영상신호로 변환시키는 영상변환단계; 상기 영상변환단계에서 디지탈 영상신호로 변환된 합성 영상을 케이블 및 네트워크를 통하여 전송하는 전송단계를 포함한다. In another embodiment of the present invention, the image processing step may include an image capturing step of capturing an image of the same frame from the real image photographed by the real image camera and the thermal image photographed by the thermal image camera; An image mixing step of synthesizing two images into one image by synthesizing the image captured in the image capturing step; An image conversion step of converting the image synthesized in the image mixing step into a digital image signal; And transmitting the synthesized image converted into the digital image signal in the image conversion step through a cable and a network.
본 발명의 또 다른 실시예에 있어서, 상기 객체 인식단계는 상기 영상처리단계에서 합성된 합성 영상에서 이미지 필터를 이용하여 이전 이미지와 현재 이미지를 비교하여 현재 이미지에서 추가 또는 변경된 객체를 판단하는 전처리 단계; 상기 전처리 단계 이후에서 현재이미지에서 불꽃과 연기의 특성을 적용하여 불꽃와 연기의 객체를 분리 및 인식하는 객체분리단계; 상기 객체 분리단계에서 분리된 객체가 불꽃인지를 판단하는 불꽃판단단계; 및 상기 객체분리단계에서 분리된 객체가 연기인지를 판단하는 연기판단단계를 포함한다. In another embodiment of the present invention, the object recognition step is a pre-processing step of determining the object added or changed in the current image by comparing the previous image and the current image using the image filter in the composite image synthesized in the image processing step ; An object separation step of separating and recognizing objects of the flame and the smoke by applying the characteristics of the flame and the smoke in the current image after the preprocessing step; A flame determination step of determining whether the object separated in the object separation step is a flame; And a posture determination step of determining whether the object separated in the object separation step is smoke.
본 발명의 또 다른 실시예에 있어서, 상기 객체인식단계 이후 또는 센서연동단계에 이후에 합성 영상에서 연기나 불꽃의 객체가 인식되지 않았고, 화재가 발생되지 않은 것으로 판단되면 합성 영상에 포함된 객체가 설정온도 이상인지를 판단하는 설정온도 판단단계; 및 상기 설정온도 판단단계에서 상기 합성 영상에서 온도에 따라 서로 다른 색상으로 표현되는 객체의 온도가 설정온도보다 높거나 동일하다면 잠열경보를 발령하는 잠열경보단계를 더 포함한다. In another embodiment of the present invention, if the object of the smoke or flame is not recognized in the composite image after the object recognition step or after the sensor interlocking step, and it is determined that no fire has occurred, the object included in the composite image is A set temperature determination step of determining whether the set temperature is higher than the set temperature; And a latent heat alarm step of issuing a latent heat alarm when the temperature of the object represented by different colors in the composite image is higher than or equal to the set temperature in the set temperature determining step.
이하에서는 본 발명에 따른 합성 영상을 이용한 화재감지시스템 및 방법의 바람직한 실시예를 첨부된 도면을 참조하여 상세히 설명한다. Hereinafter, with reference to the accompanying drawings a preferred embodiment of a fire detection system and method using a composite image according to the present invention will be described in detail.
도 1은 본 발명에 따른 합성 영상을 이용한 화재감지시스템 및 방법의 개념을 설명하기 위한 개략도이다. 1 is a schematic diagram illustrating the concept of a fire detection system and method using a composite image according to the present invention.
도 1을 참조하면, 본 발명에 따른 합성 영상을 이용한 화재감지시스템 및 방법은 센서부(13)의 불꽃 및 연기감지와 촬영부(11)의 영상감지를 통하여 화재 발생 유무 및 화재 발생 가능성을 감지하는 영상감지부(12)를 포함하는 영상처리부재(10)를 구비한다. 상기 영상처리부재(10)는 화재발생유무 및 화재발생 가능성을 감지하여 관리자단말기(50) 및/또는 영상서버(30)로서 전송하여 웹 또는 휴대용 단말기(40)등에서 확인가능한 것을 특징으로 한다. Referring to Figure 1, the fire detection system and method using a composite image according to the present invention detects the presence of fire and the possibility of fire through the flame and smoke detection of the sensor unit 13 and the image detection of the photographing unit 11 And an image processing member 10 including an image sensing unit 12. The image processing member 10 detects the presence or absence of a fire and transmits it to the administrator terminal 50 and / or the image server 30 so as to be identified on the web or the portable terminal 40.
특히 본 발명은 상기 촬영부(10)에서 촬영된 실제 영상과 온도에 따른 색상의 변화를 촬영하는 열영상을 합성하여 온도변화와 불꽃 및 연기발생유무를 감지하고, 상기 센서부(13)의 감지신호와 연동하여 화재발생 유무를 정확하게 감지할 수 있다. Particularly, the present invention synthesizes a thermal image photographing the actual image photographed by the photographing unit 10 and the color change according to the temperature to detect a temperature change and the presence of a flame and smoke, and the detection of the sensor unit 13. In conjunction with the signal, it is possible to accurately detect the presence of fire.
아울러 본 발명은 실제영상과 열영상을 합성하고, 합성영상에 포함된 객체의 온도변화를 확인할 수 있어 잠열의 유무를 인지할 수 있다. 따라서 본 발명은 상기 잠열에 의한 화재 발생 가능성을 판단하기 위하여 상기 잠열에 화재가 발생 될 수 있는 온도(이하 설정온도라 칭함)를 설정하여 화재 발생의 가능성을 판단한다. In addition, the present invention synthesizes the real image and the thermal image, and can check the temperature change of the object included in the composite image can recognize the presence or absence of latent heat. Therefore, the present invention determines the possibility of fire by setting a temperature (hereinafter, referred to as a set temperature) in which the fire may be generated in the latent heat in order to determine the possibility of fire occurrence by the latent heat.
여기서 잠열은 객체에서 불꽃이나 연기가 발생 되지 않았지만 주변온도보다 고온으로서 화재로 발전될 수 있는 온도를 가진 것을 의미한다. 상기 객체는 촬영된 영상에 포함된 모든 물건(화재가 발생 될 수 있는 물건)에 해당된다. Here, latent heat means that the object does not generate sparks or smoke but has a temperature higher than the ambient temperature so that it can be developed into a fire. The object corresponds to all objects (objects that can cause fire) included in the captured image.
이를 위하여 본 발명은 아날로그 영상과 열영상을 촬영하는 촬영부(11)와 불꽃과 연기를 감지하는 센서부(13)에서 감지된 영상과 감지신호를 비교하여 화재 유무 및 화재가능성을 판단하는 영상감지부(12)를 구비하는 영상처리부재(10)와, 상기 영상처리부재(10)로부터 전송되는 영상 및 화재감지와 잠열경보를 수신하여 경보하는 관리자단말기(50)와, 상기 관리자단말기(50) 및/또는 상기 영상처리부재(10)로부터 케이블 및 네트워크를 통하여 전송되는 영상을 저장하는 영상저장부(20, 20')와, 상기 영상저장부(20, 20')에 저장된 영상을 온라인상에 제공하는 영상서버(30)와,상기 영상서버(30)로부터 화재발생 또는 잠열발생신호를 수신하는 휴대용 단말기(40)를 포함한다. To this end, the present invention compares the image detected by the photographing unit 11 for photographing the analog image and thermal image and the sensor unit 13 for detecting the flame and smoke and the image detection to determine the presence or absence of fire An image processing member 10 having a portion 12, an administrator terminal 50 for receiving and alarming an image transmitted from the image processing member 10 and a fire detection and latent alarm, and the administrator terminal 50. And / or image storage units 20 and 20 'for storing images transmitted from the image processing member 10 through cables and networks, and images stored in the image storage units 20 and 20' online. It provides a video server 30, and a portable terminal 40 for receiving a fire or latent heat generation signal from the video server (30).
여기서 상기 센서부(13)와 촬영부(11) 및 영상감지부(12)를 포함하는 영상처리부재(10)는 건물내에서 하나 이상으로 구획된 구역별로 설치되어 유무선 통신으로 상기 관리자단말기(50) 및/또는 영상저장부(20. 20')에 감지신호 및 촬영영상을 송신한다. Here, the image processing member 10 including the sensor unit 13, the image capturing unit 11, and the image sensing unit 12 is installed in one or more sections within a building and is connected to the manager terminal 50 through wired or wireless communication. And / or transmits the detection signal and the captured image to the image storage unit 20. 20 '.
상기 영상감지부(12)는 제어수단(121, 도 2참조) 내지 통신수단(125, 도 2참조)과 임베디드화되어 상기 촬영부(11)에서 송신되는 실제영상과 열영상을 합성하여 합성영상을 생성하고, 상기 합성영상에 포함된 각각의 객체를 분리하여 연기나 불꽃과 같은 객체를 인지한다. 그리고 상기 영상감지부(12)는 연기와 불꽃을 감지하는 센서부(13)의 감지신호를 수신하여 화재발생유무를 판단하여 경보한다. The image sensing unit 12 is embedded with control means 121 (see FIG. 2) to communication means 125 (see FIG. 2) and synthesizes a real image and a thermal image transmitted from the photographing unit 11 to synthesize a composite image. Generates and recognizes objects such as smoke or flame by separating each object included in the composite image. And the image detection unit 12 receives the detection signal of the sensor unit 13 for detecting smoke and sparks to determine the presence of a fire and to alarm.
여기서 상기 영상감지부(12)는 합성 영상을 관리자단말기(50) 및/또는 케이블과 네트워크망을 통하여 영상저장부(20, 20')와 영상서버(30)로 전송하여 웹 또는 휴대용 단말기(40)와 같은 유무선 통신 단말기를 통하여 상기 합성 영상을 시청할 수 있도록 전송한다. Here, the image sensing unit 12 transmits the synthesized image to the image storage unit 20, 20 'and the image server 30 through the manager terminal 50 and / or a cable and a network, and the web or portable terminal 40 Through the wired / wireless communication terminal such as) to transmit the composite image for viewing.
상기 관리자단말기(50)는 각 구역별로 설치되는 상기 촬영부와 센서부 및 영상감지부(12)에 고유코드를 부여하여 다 수개의 구역별로 설치되는 영상감지부(12)중 어느 하나로부터 화재발생신호 또는 잠열경보가 수신되면, 해당 영상감지부(12)의 고유코드를 확인하여 설치된 구역을 확인하여 위치정보와 함께 화재발생 및 잠열을 경보한다. The manager terminal 50 gives a unique code to the photographing unit, the sensor unit, and the image sensing unit 12 installed in each zone to generate a fire from any one of the image sensing units 12 installed in a plurality of zones. When a signal or latent heat alarm is received, check the unique code of the video detection unit 12 to check the installed area to alarm the fire and latent heat with the location information.
상기 영상서버(30)는 상기 영상저장부(20, 20')와 네트워크 영상저장부(20, 20')에 저장된 합성 영상을 유무선 통신망을 통하여 웹 또는 휴대용 단말기(40)에 제공한다. 특히 상기 영상서버(30)는 등록된 휴대용 단말기(40)(스마트폰, 전화기, 데스크탑, 노트북, PDA, PDP, 넷북)에 상기 합성 영상과, 화재발생 및 화재 발생 가능신호를 송신하는 것이 바람직하다. The image server 30 provides the composite image stored in the image storage unit 20, 20 ′ and the network image storage unit 20, 20 ′ to the web or portable terminal 40 through a wired or wireless communication network. In particular, the video server 30 preferably transmits the composite video and the fire and possible fire signal to the registered mobile terminal 40 (smartphone, telephone, desktop, notebook, PDA, PDP, netbook). .
이하에서는 보다 구체적인 구성을 첨부된 도면을 참조하여 보다 상세히 설명한다. Hereinafter, with reference to the accompanying drawings a more specific configuration will be described in more detail.
도 2는 본 발명에 따른 합성 영상을 이용한 화재감지시스템에서 영상처리부재를 도시한 블럭도이다. 2 is a block diagram illustrating an image processing member in a fire detection system using a composite image according to the present invention.
도 2를 참조하면, 본 발명에 따른 합성 영상을 이용한 화재감지시스템에서 영상처리부재(10)는 불꽃을 감지하는 불꽃센서(131)와 연기를 감지하는 연기센서(132)를 구비하는 센서부(13)와, 실제 영상을 촬영하는 실영상 카메라(111)와 열영상을 촬영하는 열영상카메라(112)를 구비한 촬영부(11)와, 상기 실영상 카메라(111)와 열영상카메라(112)에서 촬영된 영상을 합성하여 합성영상에 포함된 객체를 분석하여 화재발생 및 잠열을 경보하는 영상감지부(12)를 포함한다. 2, in the fire detection system using the composite image according to the present invention, the image processing member 10 includes a sensor unit including a flame sensor 131 for detecting a flame and a smoke sensor 132 for detecting smoke ( 13), a photographing unit 11 having a real image camera 111 for shooting an actual image and a thermal image camera 112 for shooting a thermal image, and the real image camera 111 and a thermal image camera 112 And an image detecting unit 12 for synthesizing the captured image and analyzing the objects included in the synthesized image to alarm fire occurrence and latent heat.
상기 영상감지부(12)는 실영상과 열영상을 합성하는 영상믹싱수단(122)과, 합성 영상을 디지탈신호로서 변환시키는 영상변환수단(123)과, 상기 합성 영상에 포함된 객체를 분리하여 불꽃 및/또는 연기가 포함되었는지를 분석하는 객체인식수단(124)과, 합성 영상 및 경보신호를 관리자단말기(50) 및/또는 케이블과 네트워크를 통하여 송신하는 통신수단(125)과, 상술한 불꽃센서(131)와 연기센서(132)의 감지신호를 수신하고, 상기 객체인식수단(124)의 불꽃 및/또는 연기 객체의 인식신호를 수신하여 화재발생 및 화재발생가능성을 판단하는 제어수단(121)을 포함한다. The image sensing unit 12 separates the image mixing means 122 for synthesizing the real image and the thermal image, the image converting means 123 for converting the synthesized image as a digital signal, and an object included in the synthesized image. The object recognition means 124 for analyzing whether the flame and / or smoke is included, the communication means 125 for transmitting the synthesized image and the alarm signal through the manager terminal 50 and / or the cable and the network, and the flame described above. Control means 121 for receiving a detection signal of the sensor 131 and the smoke sensor 132, and receives the recognition signal of the flame and / or smoke object of the object recognition means 124 to determine the occurrence of fire and the possibility of fire ).
상기 불꽃센서(131)는 상기 제어수단(121)과 원거리에 위치되어 주변의 불꽃을 감지한다. 상기 불꽃센서(131)는 주변온도에서 특정위치에서 고온을 감지하여 상기 제어수단(121)에 감지신호를 인가한다. The flame sensor 131 is located at a long distance from the control means 121 and detects the surrounding flame. The flame sensor 131 detects a high temperature at a specific position at an ambient temperature and applies a detection signal to the control means 121.
상기 연기센서(132)는 상기 제어수단(121)과 원거리에 위치되어 주변의 연기를 감지한다. 상기 연기센서(132)는, 예를 들면, 광센서로서 발광소자와 수광소자를 구비하여 연기에 의하여 수광되는 광량이 줄어들면 연기발생신호를 상기 제어수단(121)에 인가한다. The smoke sensor 132 is located at a long distance from the control means 121 to detect the surrounding smoke. For example, the smoke sensor 132 includes a light emitting element and a light receiving element as an optical sensor, and when the amount of light received by the smoke decreases, the smoke sensor 132 applies a smoke generating signal to the control means 121.
상기 실영상 카메라(111)는, 예를 들면, CCTV와 같이 주변의 영상을 실시간 촬영하여 상기 제어수단(121)에 인가한다. The real image camera 111, for example, take a real-time image of the surroundings, such as CCTV and apply to the control means 121.
상기 열영상카메라(112)는 촬영되는 영역 내에서 온도변화를 감지하여 촬영하여 상기 제어수단(121)에 열영상을 송신한다. 여기서 상기 실영상 카메라(111)와 열영상카메라(112)는 동일 구역내에서 동일 방향을 지향하여 촬영함이 바람직하다. The thermal imaging camera 112 detects and photographs a temperature change in an area to be photographed, and transmits the thermal image to the control means 121. Here, the real image camera 111 and the thermal image camera 112 are preferably photographed in the same direction in the same direction.
상기 열영상은 기준 온도값을 설정하여 해당 구역내의 온도정보를 수집하여 각 온도별로 서로 다른 색상을 갖도록 설정함에 따라서 영상 내에 포함되는 각 객체별로 온도에 따라서 서로 다른 농도 및 색상으로 표현된다. The thermal image is set to have a different color for each temperature by setting a reference temperature value to collect temperature information in a corresponding zone and is expressed in different concentrations and colors according to temperatures for each object included in the image.
상기 영상믹싱수단(122)은 상기 실영상 카메라(111)와 열영상카메라(112)에서 각각 촬영된 실제영상과 열영상을 합성하여 하나의 영상으로 합성한다. 이때 상기 영상믹싱수단(122)은 상기 실제영상과 열영상중 어느 하나의 프레임을 캡춰한 이미지를 합성한다. The image mixing means 122 synthesizes a real image and a thermal image respectively captured by the real image camera 111 and the thermal image camera 112, and synthesizes one image. In this case, the image mixing unit 122 synthesizes an image capturing any one frame of the real image and the thermal image.
상기 영상변환수단(123)은 상기 영상믹싱수단(122)에서 합성된 이미지를 디지탈 방식의 영상으로서 변환시킨다. 예를 들면, 상기 영상변환수단(123)은 다 수개의 합성 이미지를 연속시켜서 하나의 영상프레임으로 통합함과 동시에 MPEG, AVI와 같은 디지탈 형식의 영상파일로 변환한다. The image converting means 123 converts the image synthesized by the image mixing means 122 as a digital image. For example, the image converting means 123 combines a plurality of composite images into one image frame and converts them into image files of digital formats such as MPEG and AVI.
상기 객체인식수단(124)은 상기 합성 영상중에 포함된 다 수개의 객체를 각각 분리하여 불꽃 및/또는 연기가 포함되어 있는지를 분석하고, 불꽃 및/또는 연기가 상기 합성영상의 객체중에 포함되었다면 상기 제어수단(121)에 감지신호를 인가한다. The object recognizing means 124 separates a plurality of objects included in the composite image and analyzes whether the flame and / or smoke is included, and if the flame and / or smoke is included in the object of the composite image, The sensing signal is applied to the control means 121.
상기 통신수단(125)은 상기 영상저장부(20, 20') 및/또는 관리자단말기(50)에 상기 합성 영상을 송신한다. The communication means 125 transmits the composite image to the image storage unit 20, 20 ′ and / or the manager terminal 50.
상기 제어수단(121)은 상기 열영상카메라(112)와 실영상 카메라(111)에서 촬영된 실제 영상과 열영상을 상기 영상믹싱수단(122)에 인가하여 영상을 합성하도록 제어하고, 상기 영상믹싱수단(122)에서 합성 영상을 상기 영상변환수단(123)과 객체인식수단(124)에 순차적으로 인가하여 제어한다. 아울러 상기 제어수단(121)은 상기 통신수단(125)을 제어하여 상기 영상변환수단(123)에서 변환된 디지탈 형식의 합성 영상을 상기 영상저장부(20, 20') 및/또는 관리자단말기(50)에 인가한다. 여기서 상기 영상서버(30)는 상기 영상저장부(20, 20')에 저장된 합성 영상을 유무선 통신망을 통하여 웹상에 게시하거나 또는 휴대용 단말기(40)에 송신한다. The control unit 121 controls to synthesize the image by applying the real image and the thermal image captured by the thermal imager 112 and the real image camera 111 to the image mixing means 122, and the image mixing In the means 122, the composite image is sequentially applied to the image converting means 123 and the object recognition means 124 for control. In addition, the control unit 121 controls the communication unit 125 to display the composite image of the digital format converted by the image conversion unit 123 to the image storage unit 20, 20 ′ and / or the manager terminal 50. ) Is applied. Here, the video server 30 posts the synthesized video stored in the video storage units 20 and 20 'on the web through a wired / wireless communication network or transmits it to the portable terminal 40.
아울러 상기 제어수단(121)은 합성 영상에 포함된 객체중에서 불꽃이나 연기로 분류되는 객체가 감지되었다면, 상기 불꽃센서(131)와 연기센서(132)의 감지신호를 확인하여 불꽃과 연기가 감지되었다면 상기 관리자단말기(50)에 화재발생경보를 발령한다. In addition, if an object classified as a flame or smoke is detected from the objects included in the composite image, the control unit 121 checks the detection signals of the flame sensor 131 and the smoke sensor 132, and if the flame and smoke are detected. The fire alarm is issued to the manager terminal (50).
또한 상기 제어수단(121)은 상기 합성 영상에서 불꽃과 연기의 객체가 인식되지 않았고, 상기 불꽃센서(131)와 연기센서(132)에서 불꽃과 연기의 감지신호가 없었지만, 상기 합성 영상에서 주변 객체 및 주변 온도보다 높은 온도로서 발열되는 객체 유무를 확인한다. 그리고 상기 제어수단(121)은 상기 합성 영상에 포함된 객체중에서 타 객체에 비하여 비하여 높은 온도로 발열되는 객체가 감지되면 설정온도와 비교하여 화재로 번질 수 있는 지를 판단하여 화재 발생 가능 경보를 발령한다. In addition, the control unit 121 was not recognized the object of the flame and smoke in the composite image, the flame sensor 131 and the smoke sensor 132, but there was no detection signal of the flame and smoke, the surrounding object in the composite image And the presence or absence of an object that generates heat as a temperature higher than the ambient temperature. In addition, the control means 121 determines whether an object that is heated to a higher temperature than other objects among the objects included in the synthesized image may be fired by comparing with the set temperature, and issues a fire occurrence alarm. .
상기 관리자단말기(50)는 상기 영상감지부(12)의 화재경보신호 및 잠열경보신호를 수신하여 경보를 발령하도록 제어하는 단말기제어부(51)와, 상기 단말기제어부(51)의 제어에 의하여 경보를 발령하는 경보부(52)와, 상기 단말기제어부(51)의 제어에 의하여 화재경보 및 화재발생위치를 표시하는 디스플레이(53)와, 상기 영상서버(30) 및/또는 영상저장부(20, 20')와 통신하는 통신부(54)를 포함한다. The manager terminal 50 receives a fire alarm signal and a latent heat alarm signal of the image sensing unit 12 to control an alarm and generates an alarm under the control of the terminal controller 51. The alarm unit 52 which is issued, the display 53 which displays the fire alarm and the fire occurrence position under the control of the terminal controller 51, the image server 30 and / or the image storage unit 20, 20 '. Communication unit 54 in communication with the communication unit 54).
상기 단말기제어부(51)는 상기 영상감지부(12)로부터 고유코드가 포함된 화재경보 및 잠열경보가 수신되면, 각 영상감지부(12)에 부여된 고유코드를 확인하여 해당 영상감지부(12)가 설치된 구역을 확인하여 상기 디스플레이(53)에 화재발생 및 잠열경보가 발생된 지역을 표시하도록 제어한다. When the terminal controller 51 receives a fire alarm and a latent heat alarm including a unique code from the image detector 12, the terminal controller 51 checks a unique code assigned to each image detector 12 to detect the corresponding image detector 12. Check the installed area to control to display the area where the fire and latent heat alarm occurred on the display 53.
아울러 상기 단말기제어부(51)는 상기 경보수단을 제어하여 시각적 및/또는 청각적 경보를 발령한다. In addition, the terminal control unit 51 controls the alarm means to issue a visual and / or audio alarm.
상기 경보부(52)는 경보음을 발생시키는 부저 또는 발광신호를 출력하는 발광표시수단을 포함한다. The alarm unit 52 includes light emitting display means for outputting a buzzer or a light emitting signal for generating an alarm sound.
여기서 상기 관리자단말기(50)는 상기 영상감지부(12)의 화재경보 및 잠열경보를 수신하여 상기 통신부(54)를 제어하여 상기 영상서버(30)로 송신함도 가능하다. 더욱 바람직하게로는 상기 관리자단말기(50)는 상기 영상감지부(12)의 합성 영상을 수신하여 상기 통신부(54)를 제어하여 영상저장부(20, 20')로 중계함도 가능하다. Here, the manager terminal 50 may receive a fire alarm and a latent heat alarm of the image sensing unit 12, control the communication unit 54, and transmit the same to the image server 30. More preferably, the manager terminal 50 may receive a composite image of the image sensing unit 12 and control the communication unit 54 to relay the image to the image storage units 20 and 20 '.
본 발명은 상기와 같이 설계자의 의도에 따라서 다양하게 변형될 수 있다. 즉, 본 발명은 상술한 설명에서 상기 영상감지부(12)의 합성영상이 직접 영상저장부로 송신되는 것으로 설명되었으나, 다른 실시예로서 상기 관리자단말기(50)에서 이를 일괄적으로 수신하여 상기 영상저장부(20, 20')로 중계함도 가능하다. As described above, the present invention may be variously modified according to the intention of the designer. That is, although the present invention has been described in the above description that the composite image of the image sensing unit 12 is directly transmitted to the image storage unit, in another embodiment, the manager terminal 50 receives the batch image and collectively stores the image. It is also possible to relay to the parts 20 and 20 '.
상기 단말기제어부(51)는 디스플레이(53)를 제어하여 화재 또는 잠열이 발생된 구역의 위치를 표시하고, 상기 통신부(54)를 제어하여 화재발생신호를 영상서버(30)에 송신한다. The terminal controller 51 controls the display 53 to display a location of a zone where a fire or latent heat is generated, and transmits a fire occurrence signal to the image server 30 by controlling the communication unit 54.
상기 영상서버(30)는 상기 영상감지부(12) 및/또는 관리자단말기(50)의 화재발생신호를 등록된 휴대용 단말기(40)에 송신한다. The video server 30 transmits a fire occurrence signal of the video detection unit 12 and / or the administrator terminal 50 to the registered portable terminal 40.
본 발명은 상기와 같은 구성을 포함하며, 이하에서는 상기와 같은 구성을 통하여 달성되는 작용을 첨부된 도 3 내지 도 6을 참조하여 상세히 설명한다. The present invention includes the configuration as described above, in the following will be described in detail with reference to Figures 3 to 6 the effect achieved through the configuration as described above.
도 3은 본 발명에 따른 합성 영상을 이용한 화재감지방법을 도시한 순서도이다. 3 is a flowchart illustrating a fire detection method using a composite image according to the present invention.
도 3을 참조하면, 본 발명에 따른 합성 영상을 이용한 화재감지방법은 실영상 카메라(111)와 열영상카메라(112)에서 촬영된 영상을 합성 및 변환하여 영상서버(30)에 전송하는 영상처리단계(S10)와, 상기 영상처리단계(S10)의 합성 영상에 포함된 각각의 객체를 분리하여 불꽃 및 연기를 인식하는 객체인식단계(S20)와, 상기 객체인식단계(S20)에서 불꽃 및 연기가 감지되면 센서의 감지신호와 연동하여 화재발생 및 화재발생가능성을 판단하는 센서연동단계(S30)와, 상기 센서연동단계(S30)에서 화재발생 및 화재발생가능성중 어느 하나로 판단되면 화재발생 또는 화재발생가능 경보를 송신하는 경보 및 통신단계(S40)를 포함한다. Referring to FIG. 3, the fire detection method using the composite image according to the present invention synthesizes and converts an image captured by the real image camera 111 and the thermal image camera 112, and transmits the image to the image server 30. In step S10, the object recognition step (S20) for recognizing the flame and smoke by separating each object included in the composite image of the image processing step (S10), and the flame and smoke in the object recognition step (S20) Is detected, the sensor interlocking step (S30) and the sensor interlocking step (S30) in conjunction with the detection signal of the sensor to determine the possibility of fire, and if the fire occurrence or fire occurrence is determined as one of the possibility of fire in the sensor interlocking step (S30) Alert and communication step (S40) for transmitting a possible alarm.
상기 영상처리단계(S10)는 실영상 카메라(111)와 열영상카메라(112)에서 각각 촬영된 실영상과 열영상을 합성하여 합성영상을 생성하고, 합성 영상을 변환시켜 케이블 및 네트워크망을 통하여 연결되는 영상저장부(20, 20')에 저장하도록 전송하는 단계이다. 여기서 상기 영상저장부(20, 20')에 저장된 합성 영상은 상기 영상서버(30)에 등록된 휴대용 단말기(40)에 실시간 또는 일정시간별로 송신된다. The image processing step (S10) generates a composite image by synthesizing the real image and the thermal image respectively captured by the real image camera 111 and the thermal image camera 112, and converts the synthesized image through a cable and a network. The step of transmitting the data storage unit 20, 20 'to be connected. Here, the composite image stored in the image storage units 20 and 20 'is transmitted to the portable terminal 40 registered in the image server 30 in real time or for a predetermined time.
상기 객체인식단계(S20)는 상기 영상처리단계(S10)의 합성 영상에 포함된 모든 객체를 분석하여 불꽃과 연기를 인식하는 단계이다. 여기서 상기 영상처리부재(10)는 실시간으로 촬영된 합성 영상과 이전에 촬영된 합성 영상을 비교하여 이전 영상에 포함되지 않은 객체 또는 열영상에 촬영된 온도변화에 따른 색상이 이전영상과 다른 객체를 인식하여 불꽃 및/또는 연기인지를 확인한다. The object recognition step (S20) is a step of recognizing the flame and smoke by analyzing all the objects included in the composite image of the image processing step (S10). Here, the image processing member 10 compares the synthesized image captured in real time with the previously captured composite image and displays an object that is not included in the previous image or an object whose color is different from the previous image due to the temperature change captured in the thermal image. Recognize it to see if it is a flame and / or smoke.
여기서 상기 열영상카메라(112)는 촬영되는 영역 내에 위치되는 모든 객체의 온도를 감지하여 온도별로 서로 다른 색상을 갖도록 촬영된 영상을 출력한다. 따라서 이전영상에 비하여 발열 또는 냉각된 객체가 상기 합성 영상에 존재하면 이전과 다른 색상으로 촬영된다. 따라서 상기 영상처리부재(10)는 이전영상(또는 정상상태를 촬영한 기준영상)과 현재영상을 비교하여 불꽃이나 연기가 포함되어 있는지를 분석한다. Here, the thermal imaging camera 112 detects the temperatures of all objects located in the photographed area and outputs the photographed images having different colors for each temperature. Therefore, if an object that is heated or cooled compared to the previous image is present in the composite image, it is photographed in a different color than before. Accordingly, the image processing member 10 compares the previous image (or the reference image photographed in the normal state) with the current image and analyzes whether the flame or smoke is included.
상기 센서연동단계(S30)는 상기 객체인식단계(S20)에서 불꽃이나 연기가 인식되었다면, 해당 영역내에 설치되는 불꽃센서(131)와 연기센서(132)의 감지신호와 연동하여 화재발생유무를 판단하는 단계이다.  In the sensor interlocking step (S30), if the flame or smoke is recognized in the object recognition step (S20), it is determined whether the fire occurs in conjunction with the detection signal of the flame sensor 131 and the smoke sensor 132 installed in the area. It's a step.
상기 경보 및 통신단계(S40)는 상기 센서연동단계(S30)에서 화재가 발생된 것으로 확인되면 화재발생신호를 상기 영상서버(30)를 통하여 등록된 휴대용 단말기(40)에 송신하는 단계이다. The alarm and communication step (S40) is a step of transmitting a fire occurrence signal to the portable terminal 40 registered through the image server 30 when it is determined that a fire has occurred in the sensor interlocking step (S30).
상기와 같은 본 발명에 따른 합성 영상을 이용한 화재감지방법에서 상기 영상처리단계는 도 4, 상기 객체인식 내지 통신단계(S40)는 도 5를 참조하여 설명한다. In the fire detection method using the composite image according to the present invention as described above, the image processing step will be described with reference to FIG. 4 and the object recognition to communication step (S40).
도 4는 본 발명에 따른 합성 영상을 이용한 화재감지방법에서 영상처리단계를 도시한 순서도이다. 4 is a flowchart illustrating an image processing step in a fire detection method using a composite image according to the present invention.
도 4를 참조하면, 상기 영상처리단계는 실영상과 열영상에서 동일 프레임을 캡춰하여 이미지로 변환시키는 영상캡춰단계(S11)와, 상기 영상캡춰단계(S11)에서 캡춰된 두 개의 이미지를 하나의 이미지로 합성하는 영상믹싱단계(S12)와, 상기 영상믹싱단계(S12)에서 합성 다 수개의 이미지를 디지탈 영상신호로 변환시키는 영상변환단계(S13)와, 상기 영상변환단계(S13)에서 디지탈 영상신호로 변환된 합성 영상을 전송하는 전송단계(S14)를 포함한다. Referring to FIG. 4, the image processing step includes capturing the same frame in the real image and the thermal image to convert the image into an image, and the two images captured in the image capturing step (S11) as one image. An image mixing step (S12) for synthesizing an image, an image conversion step (S13) for converting a plurality of images synthesized in the image mixing step (S12) to a digital image signal, and a digital image in the image conversion step (S13). A transmission step (S14) for transmitting the synthesized image converted into a signal.
상기 영상캡춰단계(S11)는 상기 제어수단(121)에서 상기 실영상 카메라(111)의 실영상과 열영상카메라(112)의 열영상을 상기 영상믹싱수단(122)에 인가하여 두 개의 영상에서 동일 시간대에 촬영된 영상프레임을 캡춰하도록 제어하는 단계이다. 이는 도 6에 첨부된 사진을 통하여 설명한다. The image capturing step (S11) is performed by applying the real image of the real image camera 111 and the thermal image of the thermal image camera 112 to the image mixing means 122 in the control means 121. This is a step of controlling to capture an image frame photographed at the same time. This will be described through the photo attached to FIG. 6.
도 6은 본 발명에 따른 합성 영상을 이용한 화재감지방법에서 합성 영상의 일예를 도시한 사진이다.6 is a photograph showing an example of a composite image in a fire detection method using the composite image according to the present invention.
도 6을 참조하면, 도 6의 (a)는 실제 영상을 캡춰한 이미지이고, 도 6의 (b)는 열영상의 캡춰 이미지이다. 여기서 상기 영상믹싱수단(122)은 상기 제어수단(121)에 인가된 실영상과 열영상에서 상호 동일한 시간 및 위치에서 촬영된 실영상 및 열영상을 각각 캡춰하여 도 6의 (a)와 (b)와 같은 이미지로 변환시킨다. Referring to FIG. 6, FIG. 6A is a captured image of an actual image, and FIG. 6B is a captured image of a thermal image. Here, the image mixing means 122 captures the real image and the thermal image captured at the same time and position in the real image and the thermal image applied to the control means 121, respectively, and then, FIGS. 6A and 6B. To an image like
도 6의 (a)는 실영상 카메라(111)에서 촬영한 이미지를 출력한 것이며, 도 6의 (b)는 열영상 카메라에서 촬영한 열영상 이미지를 출력한 것이다. 여기서 도 6의 (b)를 확인하여 보면, 영상에 포함된 각 객체는 온도별로 서로 다른 색상으로 표시된다. FIG. 6A illustrates an image captured by the real image camera 111, and FIG. 6B outputs a thermal image captured by the thermal image camera. 6 (b), each object included in the image is displayed in a different color for each temperature.
상기 영상믹싱단계(S12)는 상기 제어수단(121)에서 상기 영상믹싱수단(122)을 제어하여 캡춰된 두 개의 이미지를 하나로 합성하도록 제어하는 단계이다. 여기서 상기 영상믹싱수단(122)은 상기 제어수단(121)의 제어에 의하여 상기 실영상 캡춰 이미지와 열영상 캡춰 이미지를 합성하여 하나의 이미지로서 합성하여 상기 제어수단(121)에 인가한다. 이는 도 6의 (c)에 도시된 바와 같다. 도 6의 (c)를 참조하면, 상기 합성 이미지는 상기 실영상 이미지와 열영상 이미지가 합성되어 실영상 이미지의 배경에 주변 객체와 다른 온도를 갖는 객체의 열영상 이미지가 합성되었다. In the image mixing step S12, the control unit 121 controls the image mixing unit 122 to combine two captured images into one. Here, the image mixing means 122 synthesizes the real image capture image and the thermal image capture image under the control of the control means 121, synthesizes the image as a single image, and applies it to the control means 121. This is as shown in Fig. 6C. Referring to (c) of FIG. 6, the composite image is composed of the real image image and the thermal image image to synthesize a thermal image image of an object having a different temperature from a surrounding object on the background of the real image image.
상기 영상변환단계(S13)는 상기 제어수단(121)에서 상기 영상변환수단(123)을 제어하여 상기 영상믹싱단계(S12)에서 합성된 이미지를 디지탈 방식의 영상파일로 변환시키는 단계이다. 상기 영상변환수단(123)은 상기 제어수단(121)으로부터 인가되는 합성 이미지를 디지탈 방식의 영상신호로 변환시킨다. 즉, 상기 영상변환수단(123)은 아날로그 방식의 실영상과 열영상의 캡춰 이미지를 디지탈 방식의 영상파일로 변환시킨다. The image conversion step S13 is a step of controlling the image conversion means 123 in the control means 121 to convert the image synthesized in the image mixing step S12 into a digital image file. The image converting means 123 converts the composite image applied from the control means 121 into a digital image signal. That is, the image converting means 123 converts the captured image of the analog image real image and the thermal image into a digital image image file.
상기 영상전송단계(S14)는 상기 제어수단(121)에서 상기 영상변환수단(123)에 의해 디지탈 방식으로 변환된 합성 영상을 상기 통신수단(125)을 통하여 상기 관리자단말기(50) 및/또는 영상저장부(20, 20')로 전송하는 단계이다. The image transmission step (S14) is the manager terminal 50 and / or the image through the communication means 125 the composite image converted in the digital manner by the image conversion means 123 in the control means 121 It is the step of transmitting to the storage unit (20, 20 ').
상기 제어수단(121)은 상기 영상변환수단(123)에서 디지탈 방식으로 변환된 합성 영상을 상기 통신수단(125)를 통하여 상기 관리자단말기(50)에 송신한다. 상기 관리자단말기(50)는 상기 영상감지부(12)로부터 수신된 합성영상을 상기 영상저장부(20, 20')에 송신한다. The control unit 121 transmits the composite image converted by the image conversion unit 123 in a digital manner to the manager terminal 50 through the communication unit 125. The manager terminal 50 transmits the composite image received from the image sensing unit 12 to the image storage units 20 and 20 '.
여기서 상기 영상서버(30)는 상기 영상저장부(20, 20')에 저장된 합성 영상을 등록된 휴대용 단말기(40)에 송신한다. 따라서 사용자는 상기 영상서버(30)에서 제공되는 합성 영상을 통하여 특정위치의 화재 발생여부를 실시간으로 확인할 수 있다. Here, the image server 30 transmits the composite image stored in the image storage unit 20, 20 ′ to the registered portable terminal 40. Therefore, the user can check in real time whether a fire occurs at a specific location through the composite image provided from the image server 30.
본 발명은 상기와 같은 영상처리 단계 이후에 상기 객체인식단계(S20)와 센서연동단계(S30) 및 통신단계(S40)를 순차적으로 진행한다. 이하에서는 상기 객체 인식단계 내지 통신단계(S40)까지의 전체 과정을 도 5를 참조하여 설명한다. According to the present invention, the object recognition step (S20), the sensor interlocking step (S30), and the communication step (S40) are sequentially performed after the image processing step as described above. Hereinafter, the entire process from the object recognition step to the communication step (S40) will be described with reference to FIG.
도 5는 본 발명에 따른 본 발명에 따른 합성 영상을 이용한 화재감지방법에서 객체인식단계(S20) 내지 통신단계(S40)를 상세히 도시한 순서도이다. 5 is a flowchart showing in detail the object recognition step (S20) to the communication step (S40) in the fire detection method using a composite image according to the present invention.
도 5를 참조하면, 상기 객체 인식단계(S20)는 이미지 필터를 이용하여 이전 이미지와 현재 이미지에서 추가 또는 변경된 객체를 판단하는 전처리 단계(S21)와, 상기 전처리 단계(S21) 이후에서 현재 이미지에서 추가 또는 변경된 객체를 분리하여 불꽃과 연기의 특성을 적용하여 불꽃와 연기의 객체를 분리 및 인식하는 객체분리단계(S22)와, 상기 객체 분리단계(S22)에서 분리된 객체가 불꽃인지를 판단하는 불꽃판단단계(S23)와, 상기 객체분리단계(S22)에서 분리된 객체가 연기인지를 판단하는 연기판단단계(S24)를 포함한다. Referring to FIG. 5, the object recognizing step S20 may include a preprocessing step S21 of determining an object added or changed from a previous image and a current image using an image filter, and from the current image after the preprocessing step S21. The object separation step (S22) for separating and recognizing the object of the flame and smoke by applying the characteristics of the flame and smoke by separating the added or changed objects, and the flame for determining whether the object separated in the object separation step (S22) is a flame Determination step (S23), and the deferred determination step (S24) for determining whether the object separated in the object separation step (S22) is smoke.
또한 상기 센서 연동단계(S30)는 상기 불꽃판단단계(S23)와 연기 판단단계(S24)에서 불꽃과 연기중 어느 하나가 판단되면 불꽃센서(131)와 연기센서(132)의 감지 데이타를 확인하는 단계이다. In addition, the sensor interlocking step (S30) is to check the detection data of the flame sensor 131 and smoke sensor 132 when any one of the flame and smoke is determined in the flame determination step (S23) and smoke determination step (S24). Step.
상기 경보 및 통신단계(S40)는 상기 센서연동단계(S30)에서 센서의 감지신호를 확인하여 화재발생 여부를 판단하는 화재발생 판단단계(S41)와, 상기 화재발생 판단단계(S41)에서 화재가 발생된 것으로 판단되면 관리자단말기(50)에 화재경보신호를 송신하는 화재경보단계(S42)를 포함한다. The alarm and communication step (S40) is a fire occurrence determination step (S41) for determining whether a fire occurs by checking the detection signal of the sensor in the sensor interlocking step (S30), and the fire occurs in the fire occurrence determination step (S41) If it is determined that the generated fire alarm signal (S42) for transmitting a fire alarm signal to the manager terminal (50).
또한 상기 통신단계(S40)는 상기 센서연동단계(S30) 이후 또는 상기 객체인식단계(S20) 이후에 불꽃과 연기로 판단되지 않았다면, 상기 합성 영상에 포함된 객체의 온도가 설정온도 이상인지를 판단하는 설정온도 판단단계(S43)와, 상기 설정온도 판단단계(S43)에서 설정온도 이상으로 판단되면 잠열을 경보하는 잠열경보단계(S44)를 포함한다. In addition, if the communication step (S40) is not determined to be a flame and smoke after the sensor interlocking step (S30) or after the object recognition step (S20), it is determined whether the temperature of the object included in the composite image is above the set temperature. The set temperature determination step (S43) and the latent heat alarm step (S44) to alert the latent heat when determined to be above the set temperature in the set temperature determination step (S43).
상기 전처리 단계(S21)는 상기 제어수단(121)의 제어에 의하여 상기 객체인식수단(124)에서 상기 영상믹싱수단(122)에 합성된 합성 이미지를 이전시간에 촬영 및 합성된 기준 이미지에 포함되어 있지 않은 객체를 비교하는 단계이다. 여기서 상기 객체인식수단(124)은 제어수단(121)의 제어에 의하여 상기 영상믹싱수단(122)에서 합성된 합성이미지를 이미지 필터를 통하여 이전 이미지(정상환경에서 촬영된 기준이미지)에 포함되어 있지 않은 객체 또는 색상을 확인한다. The preprocessing step S21 may be included in the reference image photographed and synthesized in the previous time by synthesizing the synthesized image synthesized by the object mixing means 122 to the image mixing means 122 under the control of the control means 121. This step compares objects that do not exist. Here, the object recognition means 124 is not included in the previous image (the reference image photographed in the normal environment) through the image filter, the composite image synthesized by the image mixing means 122 by the control of the control means 121 Check for objects or colors that are not.
상기 객체분리단계(S22)는 상기 제어수단(121)의 제어에 의하여 상기 객체인식수단(124)에서 합성이미지에 포함된 불꽃과 연기 객체를 분리하는 단계이다. 상기 제어수단(121)은 상기 전처리 단계(S21)에서 상기 합성이미지에 이전 이미지와 다른 객체가 포함되어 있다면, 상기 객체인식수단(124)을 제어하여 이전 이미지에 포함되어 있지 않은 객체를 분리하여 불꽃과 연기의 특성에 일치되는 객체인지를 판단한다. The object separation step (S22) is a step of separating the flame and smoke objects included in the composite image in the object recognition means 124 by the control of the control means 121. The control means 121 controls the object recognition means 124 to separate the object not included in the previous image if the composite image includes an object different from the previous image in the preprocessing step S21. Determine whether the object matches the characteristics of the smoke and smoke.
상기 불꽃판단단계(S23)는 상기 제어수단(121)에서 상기 합성이미지로부터 분리된 객체 중에서 불꽃으로 설정된 객체가 포함되어 있는지를 판단한다.The flame judging step S23 determines whether an object set as a flame is included among the objects separated from the composite image in the control unit 121.
상기 연기판단단계(S24)는 상기 제어수단(121)에서 상기 합성이미지에서 분리된 객체 중에서 연기로 설정되는 객체가 포함되어 있는지를 판단한다. The acting determination step S24 determines whether the object set to smoke is included among the objects separated from the composite image by the control unit 121.
여기서 상기 연기와 불꽃에 대한 객체의 특성은 자체 메모리에 저장되며, 상기 제어수단(121)은 저장된 연기특성과 불꽃특성을 상기 합성이미지에서 분리된 객체의 특성을 비교하여 연기 또는 불꽃인지를 판단한다. Here, the characteristics of the object for the smoke and the flame is stored in its own memory, and the control means 121 compares the stored smoke and flame characteristics with the properties of the object separated from the composite image to determine whether the smoke or the flame. .
상기 연기 및 불꽃의 특성은 열영상에서 객체별 특성으로 분류되어 다른 객체와 구분될 수 있는 특성데이타가 상기 제어수단(121)의 자체 메모리에 저장된다. 따라서 상기 제어수단(121)은 열영상에서의 불꽃과 연기에 대한 저장된 특성 데이타와 상기 객체인식수단(124)에서 분리된 객체와 비교하여 불꽃 및/또는 연기를 인식할 수 있다. The characteristics of the smoke and the flame are classified as object-specific characteristics in the thermal image, and characteristic data that can be distinguished from other objects are stored in its own memory of the control unit 121. Accordingly, the control unit 121 may recognize the flame and / or smoke by comparing the stored characteristic data of the flame and the smoke in the thermal image with the object separated by the object recognition unit 124.
그리고 상기 제어수단(121)은 상기 불꽃판단단계(S23)와 연기판단단계(S24)에서 불꽃 및/또는 연기가 감지되면, 상기 센서연동단계(S30)에서 불꽃센서(131)와 연기센서(132)의 감지신호를 통하여 상기 합성이미지를 통하여 인식된 불꽃과 연기를 확인하는 과정을 진행한다. 또는 상기 불꽃 판단단계(S23)와 연기판단단계(S24)에서 불꽃과 연기가 감지되지 않으면, 분리된 객체에서 온도와 설정온도를 비교하는 설정온도단계(S43)를 진행한다. And if the flame and / or smoke is detected in the flame determination step (S23) and smoke determination step (S24), the control means 121, the flame sensor 131 and the smoke sensor 132 in the sensor interlocking step (S30). The process of checking the flame and smoke recognized through the composite image through the detection signal of). Alternatively, when the flame and the smoke are not detected in the flame determination step (S23) and the smoke determination step (S24), the set temperature step (S43) for comparing the temperature and the set temperature in the separated object is performed.
상기 센서연동단계(S30)는 상기 제어수단(121)가 상기 불꽃센서(131)와 연기센서(132)의 감지신호를 수신하여 불꽃이나 연기의 발생여부를 확인하는 단계이다. 상기 불꽃센서(131)는 실내의 불꽃 발생 여부를 감지하여 상기 제어수단(121)에 인가하고, 상기 연기센서(132)는 실내에서 연기의 발생여부를 감지하여 상기 제어수단(121)에 인가한다. 따라서 상기 제어수단(121)은 상기 불꽃센서(131)와 연기센서(132)의 감지신호를 수신하여 불꽃과 연기의 발생여부를 판단하여 상기 경보 및 통신단계(S40)를 진행한다. The sensor interlocking step (S30) is a step in which the control means 121 receives the detection signals of the flame sensor 131 and the smoke sensor 132 to confirm the generation of flame or smoke. The flame sensor 131 detects whether a flame is generated in the room and applies it to the control means 121, and the smoke sensor 132 senses whether smoke is generated in the room and applies it to the control means 121. . Therefore, the control unit 121 receives the detection signals of the flame sensor 131 and the smoke sensor 132 to determine whether the flame and smoke is generated to proceed with the alarm and communication step (S40).
상기 화재발생판단단계(S41)는 상기 제어수단(121)에서 상기 불꽃과 연기 인식판단단계(S23, S24)에서 불꽃 및/또는 연기가 발생된 것으로 판단되었고, 상기 센서연동단계(S30)에서 역시 동일한 판단결과 나온다면 화재가 발생된 것으로 판단하는 단계이다. The fire determination step (S41) was determined that the flame and / or smoke was generated in the flame and smoke recognition determination step (S23, S24) in the control means 121, also in the sensor interlocking step (S30) If the same judgment results come out, it is determined that a fire has occurred.
상기 화재경보단계(S42)는 상기 화재발생판단단계(S41)에서 화재가 발생된 것으로 판단되면, 상기 관리자단말기(50)에 고유코드가 포함된 경보신호를 송신하는 단계이다. 여기서 상기 관리자단말기(50)는 상기 경보부(52)를 제어하여 부저를 발령하고, 상기 화재경보신호에 포함된 영상감지부(12)의 고유코드를 통하여 해당 위치를 확인하여 상기 디스플레이(53)에 화재가 발생된 지역을 표시하도록 제어한다. 아울러 상기 관리자단말기(50)는 상기 영상서버에 화재발생신호를 송신한다. 그러면, 상기 영상서버(30)는 등록된 휴대용 단말기에 화재경보신호를 송신한다. 여기서 등록된 휴대용 단말기는 화재가 발생된 구역의 관리자 또는 입주자나 세대주가 해당될 수 있다. The fire alarm step (S42) is a step of transmitting an alarm signal containing a unique code to the manager terminal 50, if it is determined that a fire occurred in the fire determination step (S41). Here, the manager terminal 50 controls the alarm unit 52 to issue a buzzer, and checks the corresponding position through the unique code of the image detection unit 12 included in the fire alarm signal to the display 53. Control to display the area where the fire occurred. In addition, the manager terminal 50 transmits a fire occurrence signal to the video server. Then, the video server 30 transmits a fire alarm signal to the registered portable terminal. The registered mobile terminal may correspond to a manager, a tenant, or a householder of a fire zone.
여기서 상기 제어수단(121)은 상기 객체인식단계(S20) 이후 또는 화재발생판단단계(S41)에서 합성 이미지로부터 연기나 불꽃의 객체가 인식되지 않았고, 화재가 발생되지 않은 것으로 판단되면 상기 설정온도 판단단계를 진행한다. Here, the control means 121 is determined after the object recognition step (S20) or in the fire determination step (S41) is determined that the object of the smoke or flame from the composite image, and if it is determined that no fire has occurred the determination of the set temperature Proceed to step.
상기 설정온도 판단단계(S43)는 상기 제어수단(121)에서 상기 합성이미지에서 이전 이미지와 다른 색상으로 표시되는 객체를 확인하여 해당 객체의 온도와 설정온도를 비교하는 단계이다. 상기 제어수단(121)은 상기 객체를 표시하는 색상에서 설정온도의 색상과 유사 또는 그 이상의 온도로 설정되는 색상과 유사한지를 판단한다. The set temperature determination step (S43) is a step of checking the object displayed in a different color from the previous image in the composite image in the control means 121 to compare the temperature of the object and the set temperature. The control unit 121 determines whether the color indicating the object is similar to the color of the set temperature or the color set to a temperature higher than the set temperature.
상기 잠열 경보단계(S44)는 상기 설정온도 판단단계(S43)에서 상기 제어수단(121)이 상기 객체의 온도가 설정온도보다 높거나 동일하다면 화재로 발전될 수 있는 가능성이 있는 것으로 판단하여 잠열 경보를 발령하는 단계이다. 여기서 상기 제어수단(121)은 상기 관리자단말기(50)에 잠열경보신호를 고유코드와 함께 송신한다. 따라서 상기 관리자단말기(50)는 잠열경보를 발령하고, 고유코드를 통하여 상기 잠열경보가 발령된 구역의 위치정보를 상기 디스플레이(53)를 통하여 출력한다. The latent heat alarming step (S44) is a latent heat alarm by determining that there is a possibility that the control means 121 may be developed into a fire if the temperature of the object is higher than or equal to the set temperature in the setting temperature determining step (S43). It is a step to issue. Here, the control means 121 transmits a latent heat alarm signal to the manager terminal 50 together with the unique code. Therefore, the manager terminal 50 issues a latent heat alarm, and outputs the location information of the area where the latent heat alarm is issued through the display 53 through a unique code.
마찬가지로 상기 관리자단말기(50)는 상기 화재경보단계(S42)와 잠열 경보단계(S44)에서 화재경보 및 잠열 경보신호를 상기 영상서버(30)에 송신한다. 따라서 상기 영상서버(30)는 화재경보 및 잠열경보신호를 등록된 휴대용 단말기(40)에 송신하여 관리자 또는 입주자가 원거리에 있다 하더라도 상기 휴대용 단말기(40)를 통하여 화재발생 또는 잠열경보를 확인할 수 있도록 한다. Similarly, the manager terminal 50 transmits a fire alarm and a latent heat alarm signal to the video server 30 in the fire alarm step S42 and the latent heat alarm step S44. Therefore, the image server 30 transmits a fire alarm and a latent heat alarm signal to the registered portable terminal 40 so that a fire or latent alarm can be confirmed through the portable terminal 40 even if the administrator or the tenant is at a distance. do.
이와 같이 본 발명은 합성 영상과 센서를 연동하여 화재를 판단 및 경보하기 때문에 화재경보의 정확도가 향상되고, 열영상에 의한 온도별 색상변화를 통하여 잠열을 확인할 수 있어 잠열에 의한 화재가능성을 판단할 수 있어 화재 예방에 매우 효과적이다. As described above, the present invention improves the accuracy of the fire alarm by interlocking the composite image and the sensor, and confirms the latent heat through the color change by temperature according to the thermal image. It is very effective for fire prevention.
상기에서는 본 발명의 실시예를 참조하여 설명하였지만, 해당 기술 분야에서 통상의 지식을 가진 자라면 하기의 특허 청구의 범위에 기재된 본 발명의 사상 및 영역으로부터 벗어나지 않는 범위 내에서 본 발명을 다양하게 수정 및 변경시킬 수 있음을 이해할 수 있을 것이다.Although the above has been described with reference to embodiments of the present invention, those skilled in the art may variously modify the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. And can be changed.

Claims (11)

  1. 다 수개가 설정된 구역내에 각각 설치되어 해당 구역을 촬영하여 실영상 신호를 송신하는 실영상 카메라와, 온도에 따라서 서로 다른 색상으로 표시되는 열영상을 송신하는 열영상카메라를 구비하는 촬영부;A photographing unit including a real image camera installed in a plurality of zones, each of which captures a corresponding zone and transmits a real image signal, and a thermal image camera which transmits thermal images displayed in different colors according to temperature;
    불꽃을 감지하는 불꽃센서와, 연기를 감지하는 연기센서를 구비하는 센서부; 및A sensor unit including a flame sensor for detecting a flame and a smoke sensor for detecting smoke; And
    상기 촬영부의 실영상과 열영상을 합성한 합성영상과 상기 센서부의 감지신호를 통하여 화재발생여부를 판단하는 영상감지부를 포함하고, And a video detecting unit for determining whether a fire has occurred through a synthesized video obtained by synthesizing the real image and the thermal image of the photographing unit and the detection signal of the sensor unit.
    상기 영상감지부는 The image sensing unit
    상기 촬영부에서 인가되는 열영상과 실영상을 합성하는 영상믹싱수단;Image mixing means for synthesizing a thermal image and a real image applied from the photographing unit;
    상기 영상믹싱수단의 합성 영상에 포함된 다 수개의 객체중에서 불꽃 및 연기가 포함되었는지를 인식하는 객체인식수단; 및 Object recognition means for recognizing whether flame or smoke is included among a plurality of objects included in the composite image of the image mixing means; And
    상기 객체인식수단에서 상기 합성 영상의 객체중에 불꽃이나 연기가 포함되었다면, 상기 센서부에서 불꽃 및 연기가 감지되었는지를 확인하여 경보를 발령하는 제어수단을 포함하는 합성 영상을 이용한 화재감지시스템.If the object recognition means includes a flame or smoke in the object of the composite image, the fire detection system using a composite image including a control means for checking whether the flame and smoke is detected in the sensor unit to issue an alarm.
  2. 제1항에 있어서, 상기 영상믹싱수단은The method of claim 1, wherein the image mixing means
    실영상과 열영상에서 동일 프레임을 캡춰한 이미지를 합성하여 실영상에 열영상으로 촬영된 객체를 합성하는 것을 특징으로 하는 합성 영상을 이용한 화재감지시스템.Fire detection system using a composite image, characterized in that by synthesizing the image captured the same frame in the real image and the thermal image to synthesize the object photographed in the thermal image.
  3. 제1항 또는 제2항에 있어서, 상기 화재감지시스템은The fire detection system according to claim 1 or 2, wherein the fire detection system
    상기 영상믹싱수단에서 합성된 이미지를 디지탈 방식의 합성 영상으로 변환하여 상기 제어수단에 인가하는 영상변환수단을 더 포함하는 합성 영상을 이용한 화재감지시스템.And a video converting means for converting the image synthesized by the video mixing means into a synthetic video of the digital method and applying it to the control means.
  4. 제1항에 있어서, 상기 화재감지시스템은According to claim 1, wherein the fire detection system
    상기 영상감지부에서 송신되는 합성 영상을 저장하는 영상저장부; An image storage unit for storing a composite image transmitted from the image detection unit;
    상기 영상저장부에 저장된 합성 영상을 온라인에 게시 및 송신하는 영상서버; 및An image server for posting and transmitting a composite image stored in the image storage unit online; And
    상기 영상서버에 등록되어 상기 합성 영상을 수신받는 휴대용 단말기를 더 포함하는 합성 영상을 이용한 화재감지시스템.A fire detection system using a composite image further comprises a portable terminal registered with the image server to receive the composite image.
  5. 제4항에 있어서, 상기 휴대용 단말기는The method of claim 4, wherein the portable terminal
    상기 영상서버로부터 상기 제어수단에서 송신된 화재경보신호를 수신하여 출력하는 것을 특징으로 하는 합성 영상을 이용한 화재감지시스템. Fire detection system using a composite image, characterized in that for receiving and outputting the fire alarm signal transmitted from the control means from the video server.
  6. 제1항에 있어서, 상기 제어수단은The method of claim 1, wherein the control means
    상기 합성 영상에서 불꽃과 연기의 객체가 인식되지 않으면, 상기 합성 영상에서 온도별 색상을 확인하여 설정온도와 비교하고, 설정온도 이상이면 화재로 발전될 수 있는 잠열경보를 발령하는 것을 특징으로 하는 합성 영상을 이용한 화재감지시스템. If the object of the flame and smoke is not recognized in the synthesized image, by checking the color for each temperature in the synthesized image and compared with the set temperature, if the temperature is above the set temperature is synthesized characterized in that it is issued a latent alarm that can be generated by fire Fire detection system using video.
  7. 제1항에 있어서, 상기 화재감지시스템에서The method of claim 1, wherein in the fire detection system
    상기 영상감지부로부터 화재발생지역을 구분하는 위치신호가 포함된 화재경보신호를 수신하여 경보를 발령하고, 디스플레이에 위치와 함께 화재경보를 표시하는 관리자 단말기를 더 포함하는 합성영상을 이용한 화재감지시스템.Fire detection system using a composite image further comprising a manager terminal for receiving a fire alarm signal containing a location signal to distinguish the fire occurrence area from the video detection unit, and an alarm, and displaying a fire alarm with the location on the display .
  8. 실영상 카메라와 열영상카메라에서 촬영된 영상을 합성 및 변환하여 영상서버에 전송하는 영상처리단계;An image processing step of synthesizing and converting the images captured by the real image camera and the thermal image camera and transmitting them to the image server;
    상기 영상처리단계에서 합성 영상에 포함된 각각의 객체를 분류하여 불꽃 및 연기를 인식하는 객체인식단계;An object recognition step of classifying each object included in the synthesized image in the image processing step to recognize flame and smoke;
    상기 객체인식단계에서 불꽃 및 연기가 감지되면 센서의 감지신호와 연동하여 화재발생 및 화재발생가능성을 판단하는 센서연동단계; 및A sensor interlocking step of determining a fire occurrence and possibility of fire in association with a detection signal of a sensor when a flame and smoke are detected in the object recognition step; And
    상기 센서연동단계에서 화재발생 및 잠열 발생중 어느 하나로 판단되면 화재발생 또는 잠열 경보를 발령 및 송신하는 통신단계를 포함하는 합성 영상을 이용한 화재감지방법.And a communication step of issuing and transmitting a fire occurrence or latent heat alarm when it is determined that any one of fire occurrence and latent heat occurs in the sensor interlocking step.
  9. 제8항에 있어서, 상기 영상처리단계는The method of claim 8, wherein the image processing step
    상기 실영상 카메라에서 촬영된 실영상과 열영상카메라에서 촬영된 열영상에서 동일 프레임의 영상을 캡춰하여 이미지로 변환시키는 영상캡춰단계; An image capturing step of capturing an image of the same frame and converting it into an image from the real image captured by the real image camera and the thermal image captured by the thermal image camera;
    상기 영상캡춰단계에서 캡춰된 이미지를 합성하여 두 개의 이미지를 하나의 이미지로 합성하는 영상믹싱단계;An image mixing step of synthesizing two images into one image by synthesizing the image captured in the image capturing step;
    상기 영상믹싱단계에서 합성된 이미지를 디지탈 영상신호로 변환시키는 영상변환단계;An image conversion step of converting the image synthesized in the image mixing step into a digital image signal;
    상기 영상변환단계에서 디지탈 영상신호로 변환된 합성 영상을 케이블 및 네트워크를 통하여 전송하는 전송단계를 포함하는 합성 영상을 이용한 화재감지방법.And a transmitting step of transmitting the synthesized image converted into the digital image signal through the cable and the network in the image converting step.
  10. 제8항에 있어서, 상기 객체 인식단계는 The method of claim 8, wherein the object recognition step
    상기 영상처리단계에서 합성된 합성 영상에서 이미지 필터를 이용하여 이전 이미지와 현재 이미지를 비교하여 현재 이미지에서 추가 또는 변경된 객체를 판단하는 전처리 단계;A preprocessing step of determining an object added or changed in the current image by comparing the previous image with the current image in the synthesized image synthesized in the image processing step;
    상기 전처리 단계 이후에서 현재이미지에서 불꽃과 연기의 특성을 적용하여 불꽃와 연기의 객체를 분리 및 인식하는 객체분리단계;An object separation step of separating and recognizing objects of the flame and the smoke by applying the characteristics of the flame and the smoke in the current image after the preprocessing step;
    상기 객체 분리단계에서 분리된 객체가 불꽃인지를 판단하는 불꽃판단단계; 및A flame determination step of determining whether the object separated in the object separation step is a flame; And
    상기 객체분리단계에서 분리된 객체가 연기인지를 판단하는 연기판단단계를 포함하는 합성 영상을 이용한 화재감지방법.Fire detection method using a composite image comprising a smoke determination step of determining whether the object separated in the object separation step is smoke.
  11. 제8항에 있어서, The method of claim 8,
    상기 객체인식단계 이후 또는 센서연동단계에 이후에 합성 영상에서 연기나 불꽃의 객체가 인식되지 않았고, 화재가 발생되지 않은 것으로 판단되면 합성 영상에 포함된 객체가 설정온도 이상인지를 판단하는 설정온도 판단단계; 및After the object recognition step or after the sensor interlocking step, if the object of the smoke or flame is not recognized in the composite image, and if it is determined that no fire has occurred, the set temperature determination to determine whether the object included in the composite image is above the set temperature step; And
    상기 설정온도 판단단계에서 상기 합성 영상에서 온도에 따라 서로 다른 색상으로 표현되는 객체의 온도가 설정온도보다 높거나 동일하다면 잠열경보를 발령하는 잠열경보단계를 더 포함하는 합성 영상을 이용한 화재감지방법.And a latent heat alarm step of issuing a latent heat alarm if a temperature of an object expressed in different colors according to a temperature in the synthesized image is higher than or equal to a set temperature in the set temperature determination step.
PCT/KR2014/001508 2013-06-07 2014-02-25 System and method for detecting fire using synthetic images WO2014196721A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2013-0065171 2013-06-07
KR1020130065171A KR101544019B1 (en) 2013-06-07 2013-06-07 Fire detection system using composited video and method thereof

Publications (1)

Publication Number Publication Date
WO2014196721A1 true WO2014196721A1 (en) 2014-12-11

Family

ID=52008326

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2014/001508 WO2014196721A1 (en) 2013-06-07 2014-02-25 System and method for detecting fire using synthetic images

Country Status (2)

Country Link
KR (1) KR101544019B1 (en)
WO (1) WO2014196721A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106157520A (en) * 2015-04-21 2016-11-23 信泰光学(深圳)有限公司 Initiative Defence System
CN106730556A (en) * 2016-12-16 2017-05-31 三汽车制造有限公司 Fire-fighting equipment and its control system and method
CN107154130A (en) * 2017-06-21 2017-09-12 西安科技大学 A kind of fire alarm system for intelligent building
CN107180507A (en) * 2017-05-22 2017-09-19 肇庆市智高电机有限公司 Smokescope monitoring system for Internet bar
CN109716410A (en) * 2018-11-29 2019-05-03 深圳市泰和安科技有限公司 A kind of fire alarm confirmation method, device and the terminal device of smoke detector
CN110060444A (en) * 2019-03-11 2019-07-26 视联动力信息技术股份有限公司 A kind of fire early-warning system and method based on view networking
CN110136385A (en) * 2019-05-29 2019-08-16 广西科飞科技发展有限公司 A kind of safe protection engineering monitor system
CN111167053A (en) * 2020-03-04 2020-05-19 浦江光特通讯技术有限公司 Fire alarm signal device for extinguishing fire and removing smoke
CN111192430A (en) * 2018-06-30 2020-05-22 黄河科技学院 Detection device for building fire
CN112735079A (en) * 2021-01-06 2021-04-30 国网辽宁省电力有限公司电力科学研究院 Cable channel fire disaster intelligent sensing and early warning device and using method thereof

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101635000B1 (en) * 2015-06-26 2016-07-08 (주) 비엑스 솔루션 Fire detector and system using plural cameras
CN108961649A (en) * 2018-08-21 2018-12-07 延安大学 A kind of fire detection bullet
KR102162735B1 (en) * 2018-12-17 2020-10-07 (주)스핀어웹 Fire mornitoring method and system using cctv image recognition based on deep learning
KR102003475B1 (en) * 2019-01-09 2019-07-24 주식회사 이오씨 Method and Apparatus for Composing Image by using Image and Thermal Image
KR102236939B1 (en) * 2019-08-20 2021-04-07 주식회사인텍 Fire pre-detection device
KR102591607B1 (en) * 2021-05-28 2023-10-19 인하대학교 산학협력단 Image processing method and system using metadata extracted through reverse engineering of thermal image
KR20230102532A (en) 2021-12-30 2023-07-07 주식회사 현대케피코 Fire detection system and method using time series data prediction thchnique and image classification
KR102531238B1 (en) * 2023-01-11 2023-05-11 (주)인포스텍 Ai-based multi-purpose safety surveillance integrated camera system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100116829A (en) * 2009-04-23 2010-11-02 (주)플렛디스 An apparatus of dection for moving from cctv camera and that of using method
KR101148799B1 (en) * 2011-09-21 2012-05-24 주식회사 창성에이스산업 Infrared thermal image fire detector and fire detection method using the same
KR20120081496A (en) * 2011-01-11 2012-07-19 주식회사 창성에이스산업 The method for fire warning using analysis of thermal image temperature
KR101178927B1 (en) * 2012-01-13 2012-08-31 주식회사 가윤시스템 Remote fire protection system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100116829A (en) * 2009-04-23 2010-11-02 (주)플렛디스 An apparatus of dection for moving from cctv camera and that of using method
KR20120081496A (en) * 2011-01-11 2012-07-19 주식회사 창성에이스산업 The method for fire warning using analysis of thermal image temperature
KR101148799B1 (en) * 2011-09-21 2012-05-24 주식회사 창성에이스산업 Infrared thermal image fire detector and fire detection method using the same
KR101178927B1 (en) * 2012-01-13 2012-08-31 주식회사 가윤시스템 Remote fire protection system

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106157520A (en) * 2015-04-21 2016-11-23 信泰光学(深圳)有限公司 Initiative Defence System
CN106730556A (en) * 2016-12-16 2017-05-31 三汽车制造有限公司 Fire-fighting equipment and its control system and method
CN107180507A (en) * 2017-05-22 2017-09-19 肇庆市智高电机有限公司 Smokescope monitoring system for Internet bar
CN107154130A (en) * 2017-06-21 2017-09-12 西安科技大学 A kind of fire alarm system for intelligent building
CN111192430A (en) * 2018-06-30 2020-05-22 黄河科技学院 Detection device for building fire
CN111192430B (en) * 2018-06-30 2022-04-26 威海美达智能电子科技有限公司 Detection device for building fire
CN109716410A (en) * 2018-11-29 2019-05-03 深圳市泰和安科技有限公司 A kind of fire alarm confirmation method, device and the terminal device of smoke detector
CN110060444A (en) * 2019-03-11 2019-07-26 视联动力信息技术股份有限公司 A kind of fire early-warning system and method based on view networking
CN110136385A (en) * 2019-05-29 2019-08-16 广西科飞科技发展有限公司 A kind of safe protection engineering monitor system
CN111167053A (en) * 2020-03-04 2020-05-19 浦江光特通讯技术有限公司 Fire alarm signal device for extinguishing fire and removing smoke
CN112735079A (en) * 2021-01-06 2021-04-30 国网辽宁省电力有限公司电力科学研究院 Cable channel fire disaster intelligent sensing and early warning device and using method thereof

Also Published As

Publication number Publication date
KR20140143857A (en) 2014-12-18
KR101544019B1 (en) 2015-08-13

Similar Documents

Publication Publication Date Title
WO2014196721A1 (en) System and method for detecting fire using synthetic images
US9311794B2 (en) System and method for infrared intruder detection
WO2018190478A1 (en) Intelligent flame detection device and method using infrared thermography
WO2012064115A9 (en) Real-time fire-monitoring system using a closed-circuit television camera, and method therefor
KR100995569B1 (en) Intelligence cctv system for preventing crime and crime prevent system and method using the same
KR101832446B1 (en) A emergency bell-cctv integrated system with bidirectional call function in emergency bell with single network
WO2013176526A1 (en) Safe remote control and security system using portable terminal having communication function, and safe remote control and security method using same
JP2002015390A (en) Remote monitoring method and monitoring control server
WO2016099084A1 (en) Security service providing system and method using beacon signal
WO2024090880A1 (en) System and method for preventing fire by using thermal imaging camera
JP2016178363A (en) Processing unit, control unit, lobby interphone unit and interphone system
WO2021118101A1 (en) Portable fire detecting apparatus
WO2012137994A1 (en) Image recognition device and image-monitoring method therefor
KR101726315B1 (en) Network based monitoring system and network based monitoring camera having event notifying function
KR101425598B1 (en) System for monitoring main facilities using smart phone
WO2018097384A1 (en) Crowdedness notification apparatus and method
WO2018074691A1 (en) Stand-alone multiple video surveillance system
CN210466658U (en) Intelligent building safety monitoring information system
KR102113527B1 (en) Thermal ip cctv system and method for detecting fire by using the same
WO2016167428A1 (en) Extension-type monitoring equipment using voice analysis modules installed in plurality of places
CN109727423A (en) Two lines bus formula fire detecting arrangement
WO2019194351A1 (en) Intelligent surveillance camera supporting 360-degree video and intelligent surveillance system using same
WO2019124583A1 (en) System and method for monitoring multi-projection theater
WO2015088158A1 (en) Control method for preventing cctv theft
WO2013191496A1 (en) Disaster early warning system for traditional wooden structures

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14808230

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC

122 Ep: pct application non-entry in european phase

Ref document number: 14808230

Country of ref document: EP

Kind code of ref document: A1