EP4258234A1 - Fire detection method, apparatus, system, and electronic device - Google Patents

Fire detection method, apparatus, system, and electronic device Download PDF

Info

Publication number
EP4258234A1
EP4258234A1 EP21900067.6A EP21900067A EP4258234A1 EP 4258234 A1 EP4258234 A1 EP 4258234A1 EP 21900067 A EP21900067 A EP 21900067A EP 4258234 A1 EP4258234 A1 EP 4258234A1
Authority
EP
European Patent Office
Prior art keywords
temperature
infrared light
temperature target
target
fire behavior
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP21900067.6A
Other languages
German (de)
French (fr)
Other versions
EP4258234A4 (en
Inventor
Jiajie LI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikmicro Sensing Technology Co Ltd
Original Assignee
Hangzhou Hikmicro Sensing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikmicro Sensing Technology Co Ltd filed Critical Hangzhou Hikmicro Sensing Technology Co Ltd
Publication of EP4258234A1 publication Critical patent/EP4258234A1/en
Publication of EP4258234A4 publication Critical patent/EP4258234A4/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00Fire alarms; Alarms responsive to explosion
    • G08B17/12Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
    • G08B17/125Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00Fire alarms; Alarms responsive to explosion
    • G08B17/10Actuation by presence of smoke or gases, e.g. automatic alarm devices for analysing flowing fluid materials by the use of optical means

Definitions

  • the present application relates to the technical field of optoelectronic detection, and in particular to a fire behavior detection method, apparatus, system and electronic device.
  • the thermal imaging camera can be used to acquire a thermal imaging image in a monitored scene according to the characteristic of high temperature of the target at which a fire behavior occurs, and the thermal imaging image can be analyzed to determine whether there is a target with an excessively high temperature in the monitored scene. If there is a target with an excessively high temperature in the monitored scene, it is determined that a fire behavior occurs at the target.
  • the present application provides a fire behavior detection method, apparatus, system and electronic device, which can reduce a false alarm rate of a fire behavior in complex monitored scenes.
  • a fire behavior detection method including:
  • the high-temperature target meets the fire behavior phenomenon condition if there is a smoke within a preset range of the high-temperature target.
  • the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light
  • the high-temperature target meets the infrared light source condition.
  • the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light.
  • the high-temperature target when the high-temperature target is a preset type of machine, the high-temperature target meets the infrared light source condition.
  • determining that no fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet the fire behavior phenomenon condition and/or not meet the infrared light source condition includes:
  • a fire behavior detection apparatus including:
  • the high-temperature target meets the fire behavior phenomenon condition if there is a smoke within a preset range of the high-temperature target.
  • the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light
  • the high-temperature target meets the infrared light source condition.
  • the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light.
  • the high-temperature target when the high-temperature target is a preset type of machine, the high-temperature target meets the infrared light source condition.
  • the intelligent analysis module determining that no fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet the fire behavior phenomenon condition and/or not meet the infrared light source condition includes:
  • a fire behavior detection system including:
  • the linkage unit is further configured for adjusting the thermal imaging camera so that the high-temperature target is located in the center area of a field of view of the thermal imaging camera, after determining, according to the monitoring data acquired by the data acquiring unit, a target having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target;
  • the linkage unit determining, according to the monitoring data acquired by the data acquiring unit, a target having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target includes:
  • the fire behavior detection system further comprises an alarm unit; wherein, the alarm unit is configured for sending an alarm when the intelligence unit determines that a fire behavior has occurred at the high-temperature target.
  • an electronic device including:
  • a computer readable storage medium stores a computer program thereon, which, when executed by a processor, causes the processor to carry out any of the method steps described in the first aspect.
  • the beneficial effects of the embodiments of the present application are as follows:
  • the fire behavior detection method, apparatus, system, and electronic device provided by the embodiments of the present application can, on the basis of a determination of temperature, further determine according to the information presented by the visible light image, whether the cause of the high temperature is a fire behavior, thus effectively reducing the false alarm rate of a fire behavior in complex application scenes.
  • the presence of a fire behavior caused by burning straws can be detected by the following methods: using a cruising device, such as an aircraft, arranged with a thermal imaging camera to cruise through a monitored scene and acquire a thermal imaging image of the monitored scene; analyzing the grayscale of a target in the thermal imaging image. Since the higher the temperature the higher the grayscale of the target in the thermal imaging image, it can be assumed that a fire behavior occurs at the target if there is the target with excessively high grayscale in the thermal imaging image.
  • a fire behavior detection method is provided, which can be applied to any electronic device with a fire behavior detection function. As shown in Fig. 1 , the method can include:
  • the high-temperature target is a target in a monitored scene having a temperature higher than a preset temperature threshold, as determined according to an infrared light signal acquired from the monitored scene.
  • the target in the present application can refer to a target object, such as haystack, tree, etc., or can refer to a target location.
  • the target with a temperature higher than the preset temperature threshold in the monitored scene can be determined.
  • the temperature of the target may be obtained by analyzing an thermal imaging image or may be measured by other non-contact temperature measurement methods, which are not limited by this embodiment.
  • the preset temperature threshold may be set according to the application scene, for example, in the aforementioned application scene of detecting the burning of straws, the preset temperature threshold may be the burning point of the straws.
  • the method of determining whether the temperature of the target is higher than the preset temperature threshold may be achieved by directly comparing the temperature of the target with the preset temperature threshold or by other parameters associated with the temperature, for example, by comparing the grayscale of the target in the thermal imaging image with a preset grayscale threshold to determine whether the temperature of the target is higher than the preset temperature threshold.
  • the fire behavior phenomenon condition is the occurrence of a preset fire behavior phenomenon at the high-temperature target
  • the infrared light source condition is that the high-temperature target is a preset infrared light source.
  • the preset fire behavior phenomenon may be a phenomenon caused by the occurrence of a fire behavior, such as smoke generation, flame generation, refractive index change of the air around the high-temperature target, etc.
  • the preset infrared light source can be an infrared light source pre-set according to the application scene.
  • the preset infrared light source may include an agricultural machinery vehicle, a roof of a house, etc.
  • the preset infrared light source may also include other infrared light sources other than an agricultural machinery vehicle and a roof of a house.
  • the infrared light source in the present application refers to an object with the ability to emit an infrared light outward.
  • the emitted infrared light can be an infrared light radiated by the object or an infrared light reflected by the object.
  • the infrared light source that emits an infrared light by reflecting an infrared light in the present application does not specifically mean that the infrared light source can only emit an infrared light by reflecting an infrared light, and the infrared light source can also radiate an infrared light.
  • the preset infrared light source should not include an infrared light source generated by a fire behavior, such as an infrared light source generated by burning straws.
  • the preset fire behavior phenomenon is a phenomenon caused by the occurrence of a fire behavior, so compared to a high-temperature target that does not meet a fire behavior phenomenon condition, a high-temperature target that meets a fire behavior phenomenon condition has a higher probability of occurrence of a fire behavior.
  • the preset infrared light source can emit an infrared light when no fire behavior occurs
  • the high-temperature target is the preset infrared light source
  • the reason for the temperature of the high-temperature target being higher than a preset temperature threshold, as determined according to an infrared light signal acquired from the monitored scene may not be a fire behavior at the high-temperature target. Therefore, compared to a high-temperature target that does not meet an infrared light source condition, a high-temperature target that meets a fire behavior phenomenon condition has a lower probability of occurrence of a fire behavior.
  • situations where the high-temperature target is determined to meet a fire behavior phenomenon condition and/or to not meet an infrared light source condition can refer to the following four different situations:
  • the situation where the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition refers to Situation 1.
  • the high-temperature target meet a fire behavior phenomenon it is determined that a fire behavior has occurred at the high-temperature target; if the high-temperature target does not meet a fire behavior phenomenon, it is determined that no fire behavior has occurred at the high-temperature target.
  • Table 1 the conditions of the high-temperature target for determining whether a fire behavior has occurred at the high-temperature target or whether no fire behavior has occurred at the high-temperature target can be shown in Table 1: Table 1 meeting a fire behavior phenomenon condition not meeting a fire behavior phenomenon condition meeting an infrared light source condition determining that a fire behavior has occurred at the high-temperature target determining that no fire behavior has occurred at the high-temperature target not meeting an infrared light source condition determining that a fire behavior has occurred at the high-temperature target determining that no fire behavior has occurred at the high-temperature target
  • the "determining that a fire behavior has occurred at the high-temperature target" in the second row and second column of Table 1 indicates that: if the high-temperature target meets a fire behavior phenomenon condition and also meets an infrared light source condition, it is determined that a fire behavior has occurred at the high-temperature target.
  • the "determining that no fire behavior has occurred at the high-temperature target” in the second row and third column of Table 1 indicates that: if the high-temperature target does not meet a fire behavior phenomenon condition and meets an infrared light source condition, it is determined that no fire behavior has occurred at the high-temperature target.
  • the "determining that a fire behavior has occurred at the high-temperature target” in the third row and second column of Table 1 indicates that: if the high-temperature target meets a fire behavior phenomenon condition and does not meet an infrared light source condition, it is determined that a fire behavior has occurred at the high-temperature target.
  • the "determining that no fire behavior has occurred at the high-temperature target” in the third row and third column of Table 1 indicates that: if the high-temperature target does not meet a fire behavior phenomenon condition and also does not meet an infrared light source condition, it is determined that no fire behavior has occurred at the high-temperature target.
  • the situation where the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition refers to Situation 2.
  • the conditions of the high-temperature target for determining whether a fire behavior has occurred at the high-temperature target or whether no fire behavior has occurred at the high-temperature target can be shown in Table 2: Table 2 meeting a fire behavior phenomenon condition not meeting a fire behavior phenomenon condition meeting an infrared light source condition determining that no fire behavior has occurred at the high-temperature target determining that no fire behavior has occurred at the high-temperature target not meeting an infrared light source condition determining that a fire behavior has occurred at the high-temperature target determining that a fire behavior has occurred at the high-temperature target
  • Table 3 meeting a fire behavior phenomenon condition not meeting a fire behavior phenomenon condition meeting an infrared light source condition determining that no fire behavior has occurred at the high-temperature target determining that no fire behavior has occurred at the high-temperature target not meeting an infrared light source condition determining that a fire behavior has occurred at the high-temperature target determining that no fire behavior has occurred at the high-temperature target
  • Table 4 meeting a fire behavior phenomenon condition not meeting a fire behavior phenomenon condition meeting an infrared light source condition determining that a fire behavior has occurred at the high-temperature target determining that no fire behavior has occurred at the high-temperature target not meeting an infrared light source condition determining that a fire behavior has occurred at the high-temperature target determining that a fire behavior has occurred at the high-temperature target
  • Situation 5 For a situation (hereinafter referred to Situation 5) of the situation where the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition referring to Situation 1, it can be only determined whether the high-temperature target meets a fire behavior phenomenon condition, without determining whether the high-temperature target meets an infrared light source condition.
  • Situation 6 For a situation (hereinafter referred to Situation 6) of the situation where the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition referring to Situation 2, it can be only determined whether the high-temperature target meets an infrared condition, without determining whether the high-temperature target meets an infrared light source condition.
  • Situation 7 For a situation (hereinafter referred to Situation 7) of the situation where the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition referring to Situation 3 or Situation 4, it can be determined whether the high-temperature target meets an infrared condition, and also be needed to determine whether the high-temperature target meets an infrared light source condition.
  • the Situation 5, Situation 6, and Situation 7 will be explained in the following based on the application scene for detecting the burning of straws mentioned above: Situation 5: For the convenience of description, it is assumed that the fire behavior phenomenon condition include the presence of a smoke within the preset range of the high-temperature target.
  • the visible light image can be input into a pre-trained smoke detection model to obtain the output result of the smoke detection model.
  • This result is used to indicate whether there is a smoke within the preset range of the high-temperature target. If this result indicates that there is a smoke within the preset range of the high-temperature target, the high-temperature target is considered to meet a fire behavior phenomenon condition.
  • the model can be obtained based on deep learning or based on traditional machine learning, which is not limited by this embodiment.
  • the infrared light source condition can include that a high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, and/or a high-temperature target is a preset type of machine.
  • the preset type of machine can include an aforementioned agricultural machinery vehicle.
  • the infrared light source condition includes that a high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, since smoke will be generated when burning straws, which has a certain blocking effect on light, the light emitted by the high-temperature target is blocked by the smoke if the high-temperature target is caused by burning straws, and only a small amount of light can be acquired by the image acquiring device that captures a visible light image. Therefore, the exposure level of the high-temperature target in the visible light image is theoretically low.
  • the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, such as a roof of a house
  • the infrared light source should theoretically have a certain reflection effect on visible light at the same time, and since there is no block caused by a smoke, a large amount of the light emitted by the high-temperature target can be acquired by the image acquiring device that captures a visible light image, Therefore, the exposure level of the high-temperature target in the visible light image is theoretically high.
  • the visible light image can be input into a pre-trained reflection detection model to obtain an output result of the reflection detection model.
  • This result is used to indicate whether the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light.
  • This reflection detection model is used to determine whether the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light according to the exposure level of the high-temperature target in the visible light image.
  • the model can be obtained based on deep learning or based on traditional machine learning, which is not limited by this embodiment.
  • the infrared light source is an object that emits an infrared light, so even if there is no fire behavior at the infrared light source, the energy of the infrared light emitted by the infrared light source is relatively high, leading to the infrared light source being determined as a high-temperature target.
  • a roof of a house may become a high-temperature target due to sunlight exposure. Therefore, in this embodiment, it can be considered that if it is determined that the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light according to the visible light image, it is determined that no fire behavior has occurred at the high-temperature target.
  • the infrared light source condition includes that the high-temperature target is a preset type of machine
  • it can be determined by image recognition of the visible light image to determine whether the high-temperature target is a preset type of machine.
  • the visible light image can be input into a pre-trained agricultural machinery vehicle detection model to obtain the output result of the agricultural machinery vehicle detection model. This result is used to indicate whether the high-temperature target is an agricultural machinery vehicle.
  • the agricultural machinery vehicle detection model is a model used to identify an agricultural machinery vehicle. The model can be obtained based on deep learning or based on traditional machine learning, which is not limited by this embodiment.
  • the infrared light source is an object that emits an infrared light, so even if there is no fire behavior at the infrared light source, the energy of the infrared light emitted by the infrared light source is relatively high, leading to the infrared light source being identified as a high-temperature target.
  • an agricultural machinery vehicle may become a high-temperature target due to the combustion of a fuel in an internal combustion engine. Therefore, in this embodiment, it can be considered that if it is determined that the high-temperature target is a preset type of machine according to the visible light image, it can be determined that no fire behavior has occurred at the high-temperature target.
  • An infrared light source condition including other conditions, such as the high-temperature target being a factory chimney, can be inferred by analogy and will not be repeated here.
  • the preset condition includes a fire behavior phenomenon condition and an infrared light source condition:
  • the high-temperature target meets the fire behavior phenomenon condition, then whether the high-temperature target meets the infrared light source condition, or it can be determined firstly whether the high-temperature target meets the infrared light source condition, then whether the high-temperature target meets the fire behavior phenomenon condition, or it can be determined whether the high-temperature target meets the infrared light source condition and whether the high-temperature target meets the fire behavior phenomenon condition in a parallel or alternate manner, which is not limited by this embodiment.
  • FIG. 2 is a schematic flowchart of a determination method provided by an embodiment of the present application, which can include: S201, determining whether there is a smoke within the preset range of the high-temperature target; if there is no smoke within the preset range of the high-temperature target, performing S202; if there is a smoke within the preset range of the high-temperature target, performing S204.
  • the determination method can refer to the relevant explanations mentioned above, and will not be repeated here.
  • S202 determining whether the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light; if the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, performing S204; if the high-temperature target is not an infrared light source that emits an infrared light by reflecting an infrared light, performing S203.
  • the determination method can refer to the relevant explanations mentioned above, and will not be repeated here.
  • a determination result can be generated to indicate the presence of a smoke within the preset range of the high-temperature target without performing the determinations on S202 and S203. Based on this determination result, it can be determined that a fire behavior has occurred at the high-temperature target.
  • the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light
  • a determination result can be generated to indicate that there is no smoke within the preset range of the high-temperature target, and that the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light without performing the determinations on S202 and S203. Based on this determination result, it can be determined that no fire behavior has occurred at the high-temperature target.
  • a determination result can be generated to indicate that there is no smoke within the preset range of the high-temperature target, and that the high-temperature target is not an infrared light source that emits an infrared light by reflecting an infrared light, and the high-temperature target is not a preset type of machine. Based on this determination result, it can be determined that a fire behavior has occurred at the high-temperature target.
  • Fig. 3a is a schematic diagram of a structure of a fire behavior detection system provided by an embodiment of the present application, the fire behavior detection system may including: a data acquiring unit 310, a linkage unit 320 and an intelligence unit 330.
  • the data acquiring unit 310 is configured for acquiring a monitoring data in a monitored scene.
  • the linkage unit 320 is configured for determining, according to the acquired monitoring data, a target in the monitored scene having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target, the monitoring data at least comprises an infrared light signal.
  • the data acquiring unit 310 is further configured for acquiring a visible light image of the high-temperature target; the intelligence unit 330 is configured for determining that a fire behavior has occurred at the high-temperature target, if, according to the visible-light image of the data acquiring unit 310, the high-temperature target is determined to meet a fire behavior phenomenon condition and/or not meet an infrared light source condition; wherein, the fire behavior phenomenon condition is that a preset fire behavior phenomenon occurs at the high-temperature target, and the infrared light source condition is that the high-temperature target is a preset infrared light source, the preset infrared light source being an infrared light source capable of emitting infrared light when no fire behavior is occurring.
  • any two units of the data acquiring unit 310, the linkage unit 320, and the intelligence unit 330 can be two independent devices of each other, or be two integrated parts on the same device.
  • the data acquiring unit 310 can be an aircraft
  • the linkage unit 320 can be a control server for the aircraft
  • the intelligence unit 330 can be a back-end processing server for the aircraft.
  • the data acquiring unit 310, the linkage unit 320, and the intelligence unit 330 can be integrated on the same aircraft.
  • the data acquiring unit 310 and the linkage unit 320 can be integrated on the same aircraft
  • the intelligence unit 330 is a back-end processing server of the aircraft.
  • Any unit in the embodiment of the present application can refer to one or more devices, or can refer to one or more components.
  • the steps performed by the intelligence unit 330 can refer to any of the aforementioned fire behavior detection methods, and will not be repeated here. The following will explain the data acquiring unit 310 and the linkage unit 320 respectively.
  • the data acquiring unit 310 can include a thermal imaging camera and a visible light camera which are pre-aligned, wherein the thermal imaging camera refers to a camera with the ability to capture a thermal imaging image, the visible light camera refers to a camera with the ability to capture a visible light image, and the thermal imaging camera and the visible light camera can be different cameras or the same camera.
  • the thermal imaging camera and the visible light camera can be the same binocular camera, that is, the same binocular camera serves as the thermal imaging camera and the visible light camera.
  • the thermal imaging camera is configured for capturing a thermal imaging image in the monitored scene;
  • the linkage unit 320 is configured for determining, according to the thermal imaging image captured by the thermal imaging camera, a target having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target; and
  • the visible light camera is configured for capturing the visible light image of the high-temperature target.
  • it can be used to determine the grayscale values of each pixel in the thermal imaging image. If at least one pixel has a grayscale value greater than the preset grayscale threshold, a target to which the pixel with a grayscale value greater than the preset grayscale threshold belongs will be served as the high-temperature target.
  • the data acquiring unit 310 further includes a temperature and humidity sensor and a ranging component.
  • the temperature and humidity sensor is configured for acquiring the temperature and humidity information of the monitored scene
  • the ranging component is configured for acquiring a distance information; wherein, the distance information is used to indicate the distance between the data acquiring unit and the target in the monitored scene. It can be understood that due to the possible position relationship between the data acquiring unit and other assemblies, although the distance information is used to indicate the distance between the data acquiring unit and the target in the monitored scene, the distance information can also be geometric parameters other than the distance between the data acquiring unit and the target in the monitored scene.
  • the ranging component can vary depending on the application scene.
  • the ranging component can be a pitch angle sensor configured for measuring the pitch angle relative to the aircraft when the thermal imaging camera captures the thermal imaging image. Based on this pitch angle and the height of the aircraft, the distance between the data acquiring unit and the target in the monitored scene can be calculated.
  • the linkage unit 320 can determine, according to the thermal imaging image captured by the thermal imaging camera, the temperature and humidity information and the distance information, a target having a temperature higher than a preset temperature threshold from the monitored scene.
  • the distance information can be based on the temperature and humidity information, the distance information (or if the data acquiring unit is arranged on an aircraft, it can also be based on the temperature and humidity information, the distance information, and cruise sensitivity information of the aircraft) to calculate the grayscale threshold and determine the grayscale value of each pixel in the thermal imaging image. If at least one pixel has a grayscale value greater than the grayscale threshold, the target to which the pixel with the grayscale value greater than the preset grayscale threshold belongs will be considered as the high-temperature target.
  • the linkage unit 320 can control the data acquiring unit 310. For example, the linkage unit 320 can adjust the data after determining the high-temperature target from the monitored scene.
  • the linkage unit 320 can control the movement of the aircraft. For example, it is assumed that the linkage unit 320 determines a high-temperature target according to the data acquiring unit 310, the linkage unit 320 can control the aircraft to fly directly above the high-temperature target, and after the aircraft stabilizes above the high-temperature target, control the data acquiring unit 310 to capture a visible light image of the high-temperature target.
  • the linkage unit 320 can determine, according to the monitoring data, a target with a temperature higher than the preset temperature threshold from other areas other than a shielding area in the monitored scene, as a high-temperature target.
  • the shielding area includes one or more areas within the preset factory area and the preset chimney area. The preset shielding area can be pre-set by the user or predetermined based on map information. This embodiment can further effectively reduce the false alarm rate.
  • Fig. 3b is another schematic diagram of a structure of a fire behavior detection system provided by an embodiment of the present application, the fire behavior detection system may including: a data acquiring unit 310, a linkage unit 320, an intelligence unit 340 and an alarm unit 340.
  • the alarm unit 340 is configured for sending an alarm when the intelligence unit 330 determines that a fire behavior has occurred at the high-temperature target.
  • the method of alarm can vary depending on the application situation. For example, it can be by emitting an alarm sound or sending an alarm information.
  • the sent alarm information can be sent to the preset alarm center or to the preset user terminal, which is not limited by this embodiment.
  • the alarm information can include one or more of the following three types of information:
  • the inclusion of information 1 in the alarm information can facilitate relevant personnel to confirm the fire behavior situation and retain it as evidence.
  • the inclusion of information 2 in the alarm information can facilitate relevant personnel to locate the unknown occurrence of the fire behavior.
  • the inclusion of information in the alarm information can facilitate relevant personnel to grasp the fire behavior state and take appropriate response measures.
  • Fig. 4 is a schematic diagram of a structure of a fire behavior detection apparatus provided by an embodiment of the present application, the fire behavior detection apparatus may include:
  • the high-temperature target meets the fire behavior phenomenon condition if there is a smoke within a preset range of the high-temperature target.
  • the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light
  • the high-temperature target meets the infrared light source condition.
  • the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light.
  • the high-temperature target when the high-temperature target is a preset type of machine, the high-temperature target meets the infrared light source condition.
  • the intelligent analysis module 402 determining that no fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet the fire behavior phenomenon condition and/or not meet the infrared light source condition includes:
  • an electronic device is provided in an embodiment of the present application, the electronic device including:
  • the high-temperature target meets the fire behavior phenomenon condition if there is a smoke within a preset range of the high-temperature target.
  • the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light
  • the high-temperature target meets the infrared light source condition.
  • the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light.
  • the high-temperature target when the high-temperature target is a preset type of machine, the high-temperature target meets the infrared light source condition.
  • determining that no fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet the fire behavior phenomenon condition and/or not meet the infrared light source condition includes:
  • the processor mentioned in the aforementioned electronic device can be a general-purpose processor, such as a central processing unit (CPU), a network processor (NP), or the like; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component.
  • a general-purpose processor such as a central processing unit (CPU), a network processor (NP), or the like
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA field-programmable gate array
  • a computer readable storage medium stores computer program thereon, which, when executed by a processor, causes the processor to carry out any of the steps of the fire behavior detection methods described above.
  • the aforementioned embodiments it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof.
  • software it may be implemented in whole or in part in the form of a computer program product.
  • the computer program product includes one or more computer instructions. The processes or functions described in accordance with the embodiments of the present application is produced in whole or in part, when the computer program instructions are loaded and executed on a computer.
  • the computer may be a general-purpose computer, a dedicated computer, a computer network, or other programmable apparatus.
  • the computer instructions may be stored in a computer-readable storage medium or may be transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a web site, a computer, a server, or a data center to another web site, another computer, another server, or another data center via a cable (such as a coaxial cable, an optical fiber, a digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.).
  • the computer-readable storage medium may be any available medium that may be accessed by a computer or a data storage device such as a server or a data center containing one or more available medium integrations.
  • the available media may be magnetic media (such as floppy disks, hard disks, magnetic tapes), optical media (such as DVD), or semiconductor media (such as solid state disk (SSD)), etc.

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Fire-Detection Mechanisms (AREA)

Abstract

Provided are a fire behavior detection method, apparatus, system, and electronic device. The method comprises: obtaining a visible light image of a high-temperature target (S101), wherein the high-temperature target is a target in a monitored scene having a temperature is higher than a preset temperature threshold, as determined according to an infrared light signal acquired from the monitored scene; when the high-temperature target is determined to meet a fire behavior phenomenon condition and/or not meet an infrared light source condition according to the visible-light image, then determining that a fire has occurred at the high-temperature target (S102), the fire behavior phenomenon condition being that a preset fire phenomenon occurs at the high-temperature target, the infrared light source condition being that the high-temperature target is a preset infrared light source, the preset infrared light source being an infrared light source capable of emitting infrared light when no fire is occurring. On the basis of a determination of temperature, it is possible to further determine, according to the information presented by the visible light image, whether the cause of the high temperature is a fire, thus effectively reducing the false alarm rate.

Description

  • The present application claims the priority to a Chinese Patent Application No. 202011399396.3, filed with State Intellectual Property Office of People's Republic of China on December 03, 2020 and entitled "Fire Behavior Detection Method, Apparatus, System, and Electronic Device", which is incorporated herein by reference in its entirety.
  • Technical Field
  • The present application relates to the technical field of optoelectronic detection, and in particular to a fire behavior detection method, apparatus, system and electronic device.
  • Background
  • In order to take timely response measures to avoid the spread of fire behavior, it is necessary to detect the fire behavior timely. In the related technology, the thermal imaging camera can be used to acquire a thermal imaging image in a monitored scene according to the characteristic of high temperature of the target at which a fire behavior occurs, and the thermal imaging image can be analyzed to determine whether there is a target with an excessively high temperature in the monitored scene. If there is a target with an excessively high temperature in the monitored scene, it is determined that a fire behavior occurs at the target.
  • However, in some complex monitored scenes, other factors than a fire behavior may cause the target to present an excessively high temperature in the thermal imaging image, so that a false alarm rate of a fire behavior in these monitored scenes is high.
  • Summary
  • The present application provides a fire behavior detection method, apparatus, system and electronic device, which can reduce a false alarm rate of a fire behavior in complex monitored scenes.
  • In a first aspect of embodiments of the present application, a fire behavior detection method is provided, including:
    • obtaining a visible light image of a high-temperature target, wherein the high-temperature target is a target in a monitored scene having a temperature higher than a preset temperature threshold, as determined according to an infrared light signal acquired from the monitored scene;
    • determining that a fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet a fire behavior phenomenon condition and/or not meet an infrared light source condition according to the visible light image, wherein, the fire behavior phenomenon condition is that a preset fire behavior phenomenon occurs at the high-temperature target, and the infrared light source condition is that the high-temperature target is a preset infrared light source, the preset infrared light source being an infrared light source capable of emitting infrared light when no fire behavior is occurring.
  • In a possible embodiment, if there is a smoke within a preset range of the high-temperature target, the high-temperature target meets the fire behavior phenomenon condition.
  • In a possible embodiment, if the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, the high-temperature target meets the infrared light source condition.
  • In a possible embodiment, when the exposure level of the high-temperature target in the visible light image meets a high exposure condition, the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light.
  • In a possible embodiment, when the high-temperature target is a preset type of machine, the high-temperature target meets the infrared light source condition.
  • In a possible embodiment, determining that no fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet the fire behavior phenomenon condition and/or not meet the infrared light source condition, includes:
    • when the high-temperature target meets the fire behavior phenomenon condition, determining that a fire behavior has occurred at the high-temperature target; or
    • when the high-temperature target does not meet the infrared light source condition, determining that a fire behavior has occurred at the high-temperature target; or
    • when the high-temperature target meets the fire behavior phenomenon condition and the high-temperature target does not meet the infrared light source condition, determining that a fire behavior has occurred at the high-temperature target; or
    • when the high-temperature target meets the fire behavior phenomenon condition or the high-temperature target does not meet the infrared light source condition, determining that a fire behavior has occurred at the high-temperature target.
  • In a second aspect of embodiments of the present application, a fire behavior detection apparatus is provided, including:
    • an image obtaining module, configured for obtaining a visible light image of a high-temperature target, the high-temperature target being a target in a monitored scene having a temperature higher than a preset temperature threshold, as determined according to an infrared light signal acquired from the monitored scene;
    • an intelligent analysis module, configured for determining that a fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet a fire behavior phenomenon condition and/or not meet an infrared light source condition according to the visible light image, wherein, the fire behavior phenomenon condition is that a preset fire behavior phenomenon occurs at the high-temperature target, and the infrared light source condition is that the high-temperature target is a preset infrared light source, the preset infrared light source being an infrared light source capable of emitting infrared light when no fire behavior is occurring.
  • In a possible embodiment, if there is a smoke within a preset range of the high-temperature target, the high-temperature target meets the fire behavior phenomenon condition.
  • In a possible embodiment, if the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, the high-temperature target meets the infrared light source condition.
  • In a possible embodiment, when the exposure level of the high-temperature target in the visible light image meets a high exposure condition, the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light.
  • In a possible embodiment, when the high-temperature target is a preset type of machine, the high-temperature target meets the infrared light source condition.
  • In a possible embodiment, the intelligent analysis module determining that no fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet the fire behavior phenomenon condition and/or not meet the infrared light source condition, includes:
    • when the high-temperature target meets the fire behavior phenomenon condition, determining that a fire behavior has occurred at the high-temperature target; or
    • when the high-temperature target does not meet the infrared light source condition, determining that a fire behavior has occurred at the high-temperature target; or
    • when the high-temperature target meets the fire behavior phenomenon condition and the high-temperature target does not meet the infrared light source condition, determining that a fire behavior has occurred at the high-temperature target; or
    • when the high-temperature target meets the fire behavior phenomenon condition or the high-temperature target does not meet the infrared light source condition, determining that a fire behavior has occurred at the high-temperature target.
  • In a third aspect of embodiments of the present application, a fire behavior detection system is provided, including:
    • a data acquiring unit, a linkage unit, an intelligence unit;
    • wherein, the data acquiring unit is configured for acquiring a monitoring data from a monitored scene, the monitoring data at least comprises an infrared light signal;
    • the linkage unit is configured for determining, according to the monitoring data acquired by the data acquiring unit, a target in the monitored scene having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target;
    • the data acquiring unit is further configured for acquiring a visible light image of the high-temperature target;
    • the intelligence unit is configured for determining that a fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet a fire behavior phenomenon condition and/or not meet an infrared light source condition according to the visible light image, wherein, the fire behavior phenomenon condition is that a preset fire behavior phenomenon occurs at the high-temperature target, and the infrared light source condition is that the high-temperature target is a preset infrared light source, the preset infrared light source being an infrared light source capable of emitting infrared light when no fire behavior is occurring.
    • In a possible embodiment, the data acquiring unit includes a thermal imaging camera and a visible light camera which are pre-aligned;
    • wherein, the thermal imaging camera is configured for capturing a thermal imaging image of the monitored scene;
    • the linkage unit determining, according to the monitoring data acquired by the data acquiring unit, a target having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target, includes:
      • determining, according to the thermal imaging image captured by the thermal imaging camera, a target having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target;
      • the visible light camera is configured for capturing the visible light image of the high-temperature target.
  • In a possible embodiment, the linkage unit is further configured for adjusting the thermal imaging camera so that the high-temperature target is located in the center area of a field of view of the thermal imaging camera, after determining, according to the monitoring data acquired by the data acquiring unit, a target having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target;
    • and the visible light camera capturing the visible light image of the high-temperature target, includes:
      • capturing the visible light image of the high-temperature target after the linkage unit adjusting the thermal imaging camera so that the high-temperature target is located in the center area of a field of view of the thermal imaging camera.
      • In a possible embodiment, the data acquiring unit further includes a temperature and humidity sensor and a ranging component;
      • wherein the temperature and humidity sensor is configured for acquiring a temperature and humidity information of the monitored scene;
      • the ranging component is configured for acquiring distance information, which indicates a distance between the data acquiring unit and the target in the monitored scene;
      • the linkage unit determining, according to the thermal imaging image captured by the thermal imaging camera, a target in the monitored scene having a temperature higher than a preset temperature threshold as a high-temperature target, includes:
        the linkage unit determining, according to the thermal imaging image captured by the thermal imaging camera, the temperature and humidity information and the distance information, a target having a temperature higher than a preset temperature threshold from the monitored scene as a high-temperature target.
  • In a possible embodiment, the linkage unit determining, according to the monitoring data acquired by the data acquiring unit, a target having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target, includes:
    • determining, according to the monitoring data acquired by the data acquiring unit, a target having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target;
    • determining, according to the monitoring data acquired by the data acquiring unit, a target having a temperature higher than a preset temperature threshold from an area other than a shielding area in the monitored scene, as a high-temperature target, wherein the shielding area includes one or more of a preset factory area and a preset chimney area.
  • In a possible embodiment, the fire behavior detection system further comprises an alarm unit;
    wherein, the alarm unit is configured for sending an alarm when the intelligence unit determines that a fire behavior has occurred at the high-temperature target.
  • In a fourth aspect of embodiments of the present application, an electronic device is provided, including:
    • a memory, configured for storing a computer program;
    • a processor, configured for carrying out the method steps described in the first aspect when executing the program stored on the memory.
  • In a fifth aspect of embodiments of the present application, a computer readable storage medium is provided. The computer readable storage medium stores a computer program thereon, which, when executed by a processor, causes the processor to carry out any of the method steps described in the first aspect.
  • The beneficial effects of the embodiments of the present application are as follows:
    The fire behavior detection method, apparatus, system, and electronic device provided by the embodiments of the present application can, on the basis of a determination of temperature, further determine according to the information presented by the visible light image, whether the cause of the high temperature is a fire behavior, thus effectively reducing the false alarm rate of a fire behavior in complex application scenes.
  • It should be understood that any product or method for implementing the embodiments of the present application does not necessarily require all of the advantages described above.
  • Brief Description of the Drawings
  • In order to describe the technical solutions of embodiments of the present application or of the prior art more clearly, a simple introduction of the drawings required in the description of the embodiments and of the prior art will be given. Obviously, the drawings described below are just for some embodiments of the present application and other drawings may be obtained by those of ordinary skills in the art based on these drawings without any creative effort.
    • Fig. 1 is a schematic flowchart of a fire behavior detection method provided by an embodiment of the present application;
    • Fig. 2 is a schematic flowchart of a determination method provided by an embodiment of the present application;
    • Fig. 3a is a schematic diagram of a structure of a fire behavior detection system provided by an embodiment of the present application;
    • Fig. 3b is another schematic diagram of a structure of a fire behavior detection system provided by an embodiment of the present application;
    • Fig. 4 is a schematic diagram of a structure of a fire behavior detection apparatus provided by an embodiment of the present application;
    • FIG. 5 is a schematic diagram of a structure of an electronic device provided by an embodiment of the application.
    Detailed Description
  • In order to make objectives, technical solutions and advantages of the present application more apparent, the present application now will be described in detail with reference to the accompanying drawings and by way of examples. Obviously, the embodiments described are only some of the embodiments of the present application instead of all of them. All other embodiments obtained by those ordinary skilled in the art based on the embodiments of the present application fall within the scope of the present application.
  • The technical solution in the embodiments of the application will be described clearly in detail with reference to the drawings in the embodiments of the present application. Obviously, the embodiments described herein are only some instead of all of the embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those ordinary skilled in the art based on of the present application without any creative effort fall within the scope of the present application.
  • In some areas, straws may be destroyed by burning it. The burning of straws will generate a lot of toxic substances that pollute the air and soil and may cause bigger fires, therefore the burning of straws needs to be managed. To facilitate the management of the burning of straws, in the related technology, the presence of a fire behavior caused by burning straws can be detected by the following methods:
    using a cruising device, such as an aircraft, arranged with a thermal imaging camera to cruise through a monitored scene and acquire a thermal imaging image of the monitored scene; analyzing the grayscale of a target in the thermal imaging image. Since the higher the temperature the higher the grayscale of the target in the thermal imaging image, it can be assumed that a fire behavior occurs at the target if there is the target with excessively high grayscale in the thermal imaging image.
  • However, the burning of straws often occurs in rural areas, and there may be targets such as a house, an agricultural machinery vehicle (seeder, tractor, etc.), a factory, etc. Therefore, due to the reflection of the roof of the house, the heat emitted by the engine of the agricultural machinery vehicle, and the heat emitted by the heat engine in the factory and so on, there may be targets with excessively high grayscale values in the thermal imaging image of the monitored scene when there is no fire behavior. Therefore, it is possible to mistakenly determine that a fire behavior occurs at these targets. It follows that this method may have a high false alarm rate in such monitored scene of the rural areas.
  • In view of this, in an embodiment of the present application a fire behavior detection method is provided, which can be applied to any electronic device with a fire behavior detection function. As shown in Fig. 1, the method can include:
    • S101, obtaining a visible light image of a high-temperature target;
    • S102, when the high-temperature target is determined to meet a fire behavior phenomenon condition and/or not meet an infrared light source condition according to the visible light image, determining that a fire behavior has occurred at the high-temperature target.
  • By choosing this embodiment, on the basis of a determination of temperature, it is possible to further determine, according to the information presented by the visible light image, whether the cause of the high temperature is a fire behavior, thus effectively reducing the false alarm rate in complex application scenes.
  • In S101, the high-temperature target is a target in a monitored scene having a temperature higher than a preset temperature threshold, as determined according to an infrared light signal acquired from the monitored scene. The target in the present application can refer to a target object, such as haystack, tree, etc., or can refer to a target location.
  • It is understood that any object with a temperature exceeding absolute zero will theoretically radiate infrared light, and the higher the temperature of the object, the higher the energy of the radiated infrared light. Therefore, theoretically, according to the infrared light signal acquired from the monitored scene, the target with a temperature higher than the preset temperature threshold in the monitored scene can be determined. The temperature of the target may be obtained by analyzing an thermal imaging image or may be measured by other non-contact temperature measurement methods, which are not limited by this embodiment. The preset temperature threshold may be set according to the application scene, for example, in the aforementioned application scene of detecting the burning of straws, the preset temperature threshold may be the burning point of the straws.
  • It is understood that since some parameters are associated with temperature, such as the temperature of the target is associated with the grayscale of the target in the thermal imaging image, the method of determining whether the temperature of the target is higher than the preset temperature threshold may be achieved by directly comparing the temperature of the target with the preset temperature threshold or by other parameters associated with the temperature, for example, by comparing the grayscale of the target in the thermal imaging image with a preset grayscale threshold to determine whether the temperature of the target is higher than the preset temperature threshold.
  • In S102, the fire behavior phenomenon condition is the occurrence of a preset fire behavior phenomenon at the high-temperature target, and the infrared light source condition is that the high-temperature target is a preset infrared light source. The preset fire behavior phenomenon may be a phenomenon caused by the occurrence of a fire behavior, such as smoke generation, flame generation, refractive index change of the air around the high-temperature target, etc.
  • The preset infrared light source can be an infrared light source pre-set according to the application scene. In the application scene of detecting the burning of straw, for example, the preset infrared light source may include an agricultural machinery vehicle, a roof of a house, etc. In other possible application scenes, the preset infrared light source may also include other infrared light sources other than an agricultural machinery vehicle and a roof of a house. The infrared light source in the present application refers to an object with the ability to emit an infrared light outward. The emitted infrared light can be an infrared light radiated by the object or an infrared light reflected by the object. It is understood that all objects with a temperature above absolute zero can radiate an infrared light. Therefore, the infrared light source that emits an infrared light by reflecting an infrared light in the present application does not specifically mean that the infrared light source can only emit an infrared light by reflecting an infrared light, and the infrared light source can also radiate an infrared light. In an embodiment of the present application, the preset infrared light source should not include an infrared light source generated by a fire behavior, such as an infrared light source generated by burning straws.
  • It is understood that the preset fire behavior phenomenon is a phenomenon caused by the occurrence of a fire behavior, so compared to a high-temperature target that does not meet a fire behavior phenomenon condition, a high-temperature target that meets a fire behavior phenomenon condition has a higher probability of occurrence of a fire behavior.
  • Furthermore, since the preset infrared light source can emit an infrared light when no fire behavior occurs, if the high-temperature target is the preset infrared light source, the reason for the temperature of the high-temperature target being higher than a preset temperature threshold, as determined according to an infrared light signal acquired from the monitored scene may not be a fire behavior at the high-temperature target. Therefore, compared to a high-temperature target that does not meet an infrared light source condition, a high-temperature target that meets a fire behavior phenomenon condition has a lower probability of occurrence of a fire behavior.
  • Therefore, when the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition, it is determined that a fire behavior has occurred at the high-temperature target. According to different application scenes, situations where the high-temperature target is determined to meet a fire behavior phenomenon condition and/or to not meet an infrared light source condition can refer to the following four different situations:
    • Situation 1: the high-temperature target meets a fire behavior phenomenon condition;
    • Situation 2: the high-temperature target does not meet an infrared light source condition;
    • Situation 3: the high-temperature target meets a fire behavior phenomenon condition and does not meet an infrared light source condition;
    • Situation 4: the high-temperature target meets a fire behavior phenomenon condition or does not meet an infrared light source condition;
  • Exemplary, it is assumed that in some application scenes, the situation where the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition refers to Situation 1. In these application scenes, if the high-temperature target meet a fire behavior phenomenon, it is determined that a fire behavior has occurred at the high-temperature target; if the high-temperature target does not meet a fire behavior phenomenon, it is determined that no fire behavior has occurred at the high-temperature target.
  • In these application scenes, the conditions of the high-temperature target for determining whether a fire behavior has occurred at the high-temperature target or whether no fire behavior has occurred at the high-temperature target can be shown in Table 1: Table 1
    meeting a fire behavior phenomenon condition not meeting a fire behavior phenomenon condition
    meeting an infrared light source condition determining that a fire behavior has occurred at the high-temperature target determining that no fire behavior has occurred at the high-temperature target
    not meeting an infrared light source condition determining that a fire behavior has occurred at the high-temperature target determining that no fire behavior has occurred at the high-temperature target
  • The "determining that a fire behavior has occurred at the high-temperature target" in the second row and second column of Table 1 indicates that: if the high-temperature target meets a fire behavior phenomenon condition and also meets an infrared light source condition, it is determined that a fire behavior has occurred at the high-temperature target. The "determining that no fire behavior has occurred at the high-temperature target" in the second row and third column of Table 1 indicates that: if the high-temperature target does not meet a fire behavior phenomenon condition and meets an infrared light source condition, it is determined that no fire behavior has occurred at the high-temperature target. The "determining that a fire behavior has occurred at the high-temperature target" in the third row and second column of Table 1 indicates that: if the high-temperature target meets a fire behavior phenomenon condition and does not meet an infrared light source condition, it is determined that a fire behavior has occurred at the high-temperature target. The "determining that no fire behavior has occurred at the high-temperature target" in the third row and third column of Table 1 indicates that: if the high-temperature target does not meet a fire behavior phenomenon condition and also does not meet an infrared light source condition, it is determined that no fire behavior has occurred at the high-temperature target.
  • It is assumed that in some application scenes, the situation where the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition refers to Situation 2. In these application scenes, the conditions of the high-temperature target for determining whether a fire behavior has occurred at the high-temperature target or whether no fire behavior has occurred at the high-temperature target can be shown in Table 2: Table 2
    meeting a fire behavior phenomenon condition not meeting a fire behavior phenomenon condition
    meeting an infrared light source condition determining that no fire behavior has occurred at the high-temperature target determining that no fire behavior has occurred at the high-temperature target
    not meeting an infrared light source condition determining that a fire behavior has occurred at the high-temperature target determining that a fire behavior has occurred at the high-temperature target
  • The explanation of each item in Table 2 can refer to the previous explanation of Table 1, which will not be repeated here. It is assumed that in some application scenes, the situation where the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition refers to Situation 3. In these application scenes, the conditions of the high-temperature target for determining whether a fire behavior has occurred at the high-temperature target or whether no fire behavior has occurred at the high-temperature target can be shown in Table 3: Table 3
    meeting a fire behavior phenomenon condition not meeting a fire behavior phenomenon condition
    meeting an infrared light source condition determining that no fire behavior has occurred at the high-temperature target determining that no fire behavior has occurred at the high-temperature target
    not meeting an infrared light source condition determining that a fire behavior has occurred at the high-temperature target determining that no fire behavior has occurred at the high-temperature target
  • The explanation of each item in Table 3 can refer to the previous explanation of Table 1, which will not be repeated here. It is assumed that in some application scenes, the situation where the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition refers to Situation 4. In these application scenes, the conditions of the high-temperature target for determining whether a fire behavior has occurred at the high-temperature target or whether no fire behavior has occurred at the high-temperature target can be shown in Table 4: Table 4
    meeting a fire behavior phenomenon condition not meeting a fire behavior phenomenon condition
    meeting an infrared light source condition determining that a fire behavior has occurred at the high-temperature target determining that no fire behavior has occurred at the high-temperature target
    not meeting an infrared light source condition determining that a fire behavior has occurred at the high-temperature target determining that a fire behavior has occurred at the high-temperature target
  • The explanation of each item in Table 4 can refer to the previous explanation of Table 1, which will not be repeated here.
  • For a situation (hereinafter referred to Situation 5) of the situation where the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition referring to Situation 1, it can be only determined whether the high-temperature target meets a fire behavior phenomenon condition, without determining whether the high-temperature target meets an infrared light source condition. For a situation (hereinafter referred to Situation 6) of the situation where the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition referring to Situation 2, it can be only determined whether the high-temperature target meets an infrared condition, without determining whether the high-temperature target meets an infrared light source condition. For a situation (hereinafter referred to Situation 7) of the situation where the high-temperature target meets a fire behavior phenomenon condition and/or does not meet an infrared light source condition referring to Situation 3 or Situation 4, it can be determined whether the high-temperature target meets an infrared condition, and also be needed to determine whether the high-temperature target meets an infrared light source condition. The Situation 5, Situation 6, and Situation 7 will be explained in the following based on the application scene for detecting the burning of straws mentioned above:
    Situation 5:
    For the convenience of description, it is assumed that the fire behavior phenomenon condition include the presence of a smoke within the preset range of the high-temperature target.
  • Then, the visible light image can be input into a pre-trained smoke detection model to obtain the output result of the smoke detection model. This result is used to indicate whether there is a smoke within the preset range of the high-temperature target. If this result indicates that there is a smoke within the preset range of the high-temperature target, the high-temperature target is considered to meet a fire behavior phenomenon condition. The model can be obtained based on deep learning or based on traditional machine learning, which is not limited by this embodiment.
  • It is understood that due to the high moisture content in straws, obvious smoke will be generated during burning, while the high-temperature target caused by other reasons other than fire behavior often do not generate smoke. For example, an internal combustion engine in an agricultural machinery vehicle has a high temperature during operation but do not generate obvious smoke. Therefore, it can be considered that if there is a smoke within the preset range of the high-temperature target, the high-temperature target is caused by burning straws. If there is no smoke within the preset range of the high-temperature target, the high-temperature target is not caused by burning straws. Therefore, in this embodiment, if it is determined that there is a smoke within the preset range of the high-temperature target according to the visible light image, it can be determined that a fire behavior has occurred at the high-temperature target. If it is determined that there is no smoke within the preset range of the high-temperature target according to the visible light image, it can be determined that no fire behavior has occurred at the high-temperature target.
  • The principle of a fire behavior phenomenon condition including other conditions, such as the preset occurrence of flames in high-temperature targets, is the same and can be inferred by analogy, which will not be repeated here.
  • Situation 6:
  • The infrared light source condition can include that a high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, and/or a high-temperature target is a preset type of machine. The preset type of machine can include an aforementioned agricultural machinery vehicle.
  • If the infrared light source condition includes that a high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, since smoke will be generated when burning straws, which has a certain blocking effect on light, the light emitted by the high-temperature target is blocked by the smoke if the high-temperature target is caused by burning straws, and only a small amount of light can be acquired by the image acquiring device that captures a visible light image. Therefore, the exposure level of the high-temperature target in the visible light image is theoretically low. If the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, such as a roof of a house, the infrared light source should theoretically have a certain reflection effect on visible light at the same time, and since there is no block caused by a smoke, a large amount of the light emitted by the high-temperature target can be acquired by the image acquiring device that captures a visible light image, Therefore, the exposure level of the high-temperature target in the visible light image is theoretically high. In one possible embodiment, it can be determined whether the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light according to the exposure level of the high-temperature target in the visible light image.
  • Exemplary, the visible light image can be input into a pre-trained reflection detection model to obtain an output result of the reflection detection model. This result is used to indicate whether the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light. This reflection detection model is used to determine whether the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light according to the exposure level of the high-temperature target in the visible light image. The model can be obtained based on deep learning or based on traditional machine learning, which is not limited by this embodiment.
  • It is understood that the infrared light source is an object that emits an infrared light, so even if there is no fire behavior at the infrared light source, the energy of the infrared light emitted by the infrared light source is relatively high, leading to the infrared light source being determined as a high-temperature target. For example, a roof of a house may become a high-temperature target due to sunlight exposure. Therefore, in this embodiment, it can be considered that if it is determined that the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light according to the visible light image, it is determined that no fire behavior has occurred at the high-temperature target.
  • If the infrared light source condition includes that the high-temperature target is a preset type of machine, it can be determined by image recognition of the visible light image to determine whether the high-temperature target is a preset type of machine. For example, the visible light image can be input into a pre-trained agricultural machinery vehicle detection model to obtain the output result of the agricultural machinery vehicle detection model. This result is used to indicate whether the high-temperature target is an agricultural machinery vehicle. The agricultural machinery vehicle detection model is a model used to identify an agricultural machinery vehicle. The model can be obtained based on deep learning or based on traditional machine learning, which is not limited by this embodiment.
  • It is understood that the infrared light source is an object that emits an infrared light, so even if there is no fire behavior at the infrared light source, the energy of the infrared light emitted by the infrared light source is relatively high, leading to the infrared light source being identified as a high-temperature target. For example, an agricultural machinery vehicle may become a high-temperature target due to the combustion of a fuel in an internal combustion engine. Therefore, in this embodiment, it can be considered that if it is determined that the high-temperature target is a preset type of machine according to the visible light image, it can be determined that no fire behavior has occurred at the high-temperature target.
  • An infrared light source condition including other conditions, such as the high-temperature target being a factory chimney, can be inferred by analogy and will not be repeated here.
  • Situation 7: the preset condition includes a fire behavior phenomenon condition and an infrared light source condition:
  • In this situation, it can be determined firstly whether the high-temperature target meets the fire behavior phenomenon condition, then whether the high-temperature target meets the infrared light source condition, or it can be determined firstly whether the high-temperature target meets the infrared light source condition, then whether the high-temperature target meets the fire behavior phenomenon condition, or it can be determined whether the high-temperature target meets the infrared light source condition and whether the high-temperature target meets the fire behavior phenomenon condition in a parallel or alternate manner, which is not limited by this embodiment.
  • Moreover, it is possible to determine all of the preset conditions or some of the preset conditions, for example, if it is possible to determine whether a fire behavior has occurred at the high-temperature target according to the determination result obtained after determining some of the preset conditions, it is possible not to continue determining the remaining preset conditions.
  • Exemplary, it is assumed that in a possible embodiment, if the high-temperature target meets the fire behavior phenomenon condition or does not meet the infrared light source condition, it is determined that a fire behavior has occurred at the high-temperature target. If the high-temperature target does not meet the fire behavior phenomenon condition and meets the infrared light source condition, it is determined that no fire behavior has occurred at the high-temperature target. In this embodiment, a possible determination process can be seen in Fig. 2. Fig. 2 is a schematic flowchart of a determination method provided by an embodiment of the present application, which can include:
    S201, determining whether there is a smoke within the preset range of the high-temperature target; if there is no smoke within the preset range of the high-temperature target, performing S202; if there is a smoke within the preset range of the high-temperature target, performing S204.
  • The determination method can refer to the relevant explanations mentioned above, and will not be repeated here.
  • S202, determining whether the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light; if the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, performing S204; if the high-temperature target is not an infrared light source that emits an infrared light by reflecting an infrared light, performing S203.
  • The determination method can refer to the relevant explanations mentioned above, and will not be repeated here.
  • S203, determining whether the high-temperature target is a preset type of machine.
  • S204, generating a determination result.
  • In S201, if there is a smoke within the preset range of the high-temperature target, it can already be determined that a fire behavior has occurred at the high-temperature target. Therefore, a determination result can be generated to indicate the presence of a smoke within the preset range of the high-temperature target without performing the determinations on S202 and S203. Based on this determination result, it can be determined that a fire behavior has occurred at the high-temperature target.
  • Similarly, in S201, if there is no smoke within the preset range of the high-temperature target, and in S202, the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, it can already be determined that no fire behavior has occurred at the high-temperature target. Therefore, a determination result can be generated to indicate that there is no smoke within the preset range of the high-temperature target, and that the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light without performing the determinations on S202 and S203. Based on this determination result, it can be determined that no fire behavior has occurred at the high-temperature target.
  • In S201, if there is no smoke within the preset range of the high-temperature target, and in S202, the high-temperature target is not an infrared light source that emits an infrared light by reflecting an infrared light, and in S203, the high-temperature target is a preset type of machine, a determination result can be generated to indicate that there is no smoke within the preset range of the high-temperature target, and that the high-temperature target is not an infrared light source that emits an infrared light by reflecting an infrared light, and the high-temperature target is a preset type of machine. Based on this determination result, it can be determined that no fire behavior has occurred at the high-temperature target.
  • In S201, if there is no smoke within the preset range of the high-temperature target, and in S202, the high-temperature target is not an infrared light source that emits an infrared light by reflecting an infrared light, and in S203, the high-temperature target is not a preset type of machine, a determination result can be generated to indicate that there is no smoke within the preset range of the high-temperature target, and that the high-temperature target is not an infrared light source that emits an infrared light by reflecting an infrared light, and the high-temperature target is not a preset type of machine. Based on this determination result, it can be determined that a fire behavior has occurred at the high-temperature target.
  • As shown in Fig. 3a, Fig. 3a is a schematic diagram of a structure of a fire behavior detection system provided by an embodiment of the present application, the fire behavior detection system may including:
    a data acquiring unit 310, a linkage unit 320 and an intelligence unit 330.
  • The data acquiring unit 310 is configured for acquiring a monitoring data in a monitored scene. The linkage unit 320 is configured for determining, according to the acquired monitoring data, a target in the monitored scene having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target, the monitoring data at least comprises an infrared light signal.
  • The data acquiring unit 310 is further configured for acquiring a visible light image of the high-temperature target; the intelligence unit 330 is configured for determining that a fire behavior has occurred at the high-temperature target, if, according to the visible-light image of the data acquiring unit 310, the high-temperature target is determined to meet a fire behavior phenomenon condition and/or not meet an infrared light source condition; wherein, the fire behavior phenomenon condition is that a preset fire behavior phenomenon occurs at the high-temperature target, and the infrared light source condition is that the high-temperature target is a preset infrared light source, the preset infrared light source being an infrared light source capable of emitting infrared light when no fire behavior is occurring.
  • Any two units of the data acquiring unit 310, the linkage unit 320, and the intelligence unit 330 can be two independent devices of each other, or be two integrated parts on the same device. For example, in an possible embodiment, the data acquiring unit 310 can be an aircraft, the linkage unit 320 can be a control server for the aircraft, and the intelligence unit 330 can be a back-end processing server for the aircraft. In another possible embodiment, the data acquiring unit 310, the linkage unit 320, and the intelligence unit 330 can be integrated on the same aircraft. In a further possible embodiment, the data acquiring unit 310 and the linkage unit 320 can be integrated on the same aircraft, and the intelligence unit 330 is a back-end processing server of the aircraft. Any unit in the embodiment of the present application can refer to one or more devices, or can refer to one or more components.
  • The steps performed by the intelligence unit 330 can refer to any of the aforementioned fire behavior detection methods, and will not be repeated here. The following will explain the data acquiring unit 310 and the linkage unit 320 respectively.
  • The data acquiring unit 310 can include a thermal imaging camera and a visible light camera which are pre-aligned, wherein the thermal imaging camera refers to a camera with the ability to capture a thermal imaging image, the visible light camera refers to a camera with the ability to capture a visible light image, and the thermal imaging camera and the visible light camera can be different cameras or the same camera. For example, the thermal imaging camera and the visible light camera can be the same binocular camera, that is, the same binocular camera serves as the thermal imaging camera and the visible light camera.
  • The thermal imaging camera is configured for capturing a thermal imaging image in the monitored scene; the linkage unit 320 is configured for determining, according to the thermal imaging image captured by the thermal imaging camera, a target having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target; and the visible light camera is configured for capturing the visible light image of the high-temperature target.
  • As an example, it can be used to determine the grayscale values of each pixel in the thermal imaging image. If at least one pixel has a grayscale value greater than the preset grayscale threshold, a target to which the pixel with a grayscale value greater than the preset grayscale threshold belongs will be served as the high-temperature target.
  • In another possible embodiment, the data acquiring unit 310 further includes a temperature and humidity sensor and a ranging component.
  • The temperature and humidity sensor is configured for acquiring the temperature and humidity information of the monitored scene, and the ranging component is configured for acquiring a distance information; wherein, the distance information is used to indicate the distance between the data acquiring unit and the target in the monitored scene. It can be understood that due to the possible position relationship between the data acquiring unit and other assemblies, although the distance information is used to indicate the distance between the data acquiring unit and the target in the monitored scene, the distance information can also be geometric parameters other than the distance between the data acquiring unit and the target in the monitored scene.
  • The ranging component can vary depending on the application scene. For example, in the data acquiring unit arranged on the aircraft as an example, the ranging component can be a pitch angle sensor configured for measuring the pitch angle relative to the aircraft when the thermal imaging camera captures the thermal imaging image. Based on this pitch angle and the height of the aircraft, the distance between the data acquiring unit and the target in the monitored scene can be calculated.
  • The linkage unit 320 can determine, according to the thermal imaging image captured by the thermal imaging camera, the temperature and humidity information and the distance information, a target having a temperature higher than a preset temperature threshold from the monitored scene.
  • For example, it can be based on the temperature and humidity information, the distance information (or if the data acquiring unit is arranged on an aircraft, it can also be based on the temperature and humidity information, the distance information, and cruise sensitivity information of the aircraft) to calculate the grayscale threshold and determine the grayscale value of each pixel in the thermal imaging image. If at least one pixel has a grayscale value greater than the grayscale threshold, the target to which the pixel with the grayscale value greater than the preset grayscale threshold belongs will be considered as the high-temperature target.
  • The linkage unit 320 can control the data acquiring unit 310. For example, the linkage unit 320 can adjust the data after determining the high-temperature target from the monitored scene.
  • In the data acquiring unit 310 arranged on the aircraft as an example, the linkage unit 320 can control the movement of the aircraft. For example, it is assumed that the linkage unit 320 determines a high-temperature target according to the data acquiring unit 310, the linkage unit 320 can control the aircraft to fly directly above the high-temperature target, and after the aircraft stabilizes above the high-temperature target, control the data acquiring unit 310 to capture a visible light image of the high-temperature target.
  • It is understood that there may be some areas in the monitored scene that may experience burning phenomenon even in the absence of a fire behavior. If the coal may be burnt in the factory and the firewood may be burnt in the chimney, such burning phenomenons with no fire behavior may be mistakenly detected as fire behaviors, leading to an increased false alarm rate. Therefore, in a possible embodiment, the linkage unit 320 can determine, according to the monitoring data, a target with a temperature higher than the preset temperature threshold from other areas other than a shielding area in the monitored scene, as a high-temperature target. The shielding area includes one or more areas within the preset factory area and the preset chimney area. The preset shielding area can be pre-set by the user or predetermined based on map information. This embodiment can further effectively reduce the false alarm rate.
  • As shown in Fig. 3b, Fig. 3b is another schematic diagram of a structure of a fire behavior detection system provided by an embodiment of the present application, the fire behavior detection system may including:
    a data acquiring unit 310, a linkage unit 320, an intelligence unit 340 and an alarm unit 340.
  • Regarding the data acquiring unit 310, the linkage unit 320, and intelligence unit 330, please refer to the relevant explanations mentioned above and the explanations thereof will not be repeated here. The alarm unit 340 is configured for sending an alarm when the intelligence unit 330 determines that a fire behavior has occurred at the high-temperature target.
  • The method of alarm can vary depending on the application situation. For example, it can be by emitting an alarm sound or sending an alarm information. The sent alarm information can be sent to the preset alarm center or to the preset user terminal, which is not limited by this embodiment.
  • The alarm information can include one or more of the following three types of information:
    • Information 1: screenshots of the thermal imaging image and of the visible light image including the high-temperature target.
    • Information 2: location information of the high-temperature target.
    • Information 3: temperature information of the high-temperature target.
  • The inclusion of information 1 in the alarm information can facilitate relevant personnel to confirm the fire behavior situation and retain it as evidence. The inclusion of information 2 in the alarm information can facilitate relevant personnel to locate the unknown occurrence of the fire behavior. The inclusion of information in the alarm information can facilitate relevant personnel to grasp the fire behavior state and take appropriate response measures.
  • As shown in Fig. 4, Fig. 4 is a schematic diagram of a structure of a fire behavior detection apparatus provided by an embodiment of the present application, the fire behavior detection apparatus may include:
    • an image obtaining module 401, configured for obtaining a visible light image of a high-temperature target, the high-temperature target being a target in a monitored scene having a temperature higher than a preset temperature threshold, as determined according to an infrared light signal acquired from the monitored scene;
    • an intelligent analysis module 402, configured for determining that a fire behavior has occurred at the high-temperature target, when, according to the visible-light image, the high-temperature target is determined to meet a fire behavior phenomenon condition and/or not meet an infrared light source condition, wherein, the fire behavior phenomenon condition is that a preset fire behavior phenomenon occurs at the high-temperature target, and the infrared light source condition is that the high-temperature target is a preset infrared light source, the preset infrared light source being an infrared light source capable of emitting infrared light when no fire behavior is occurring.
  • In a possible embodiment, if there is a smoke within a preset range of the high-temperature target, the high-temperature target meets the fire behavior phenomenon condition.
  • In a possible embodiment, if the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, the high-temperature target meets the infrared light source condition.
  • In a possible embodiment, when the exposure level of the high-temperature target in the visible light image meets a high exposure condition, the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light.
  • In a possible embodiment, when the high-temperature target is a preset type of machine, the high-temperature target meets the infrared light source condition.
  • In a possible embodiment, the intelligent analysis module 402 determining that no fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet the fire behavior phenomenon condition and/or not meet the infrared light source condition, includes:
    • when the high-temperature target meets the fire behavior phenomenon condition, determining that a fire behavior has occurred at the high-temperature target; or
    • when the high-temperature target does not meet the infrared light source condition, determining that a fire behavior has occurred at the high-temperature target; or
    • when the high-temperature target meets the fire behavior phenomenon condition and does not meet the infrared light source condition, determining that a fire behavior has occurred at the high-temperature target; or
    • when the high-temperature target meets the fire behavior phenomenon condition or the high-temperature target does not meet the infrared light source condition, determining that a fire behavior has occurred at the high-temperature target.
  • As shown in Fig. 5, an electronic device is provided in an embodiment of the present application, the electronic device including:
    • a memory 501, configured for storing a computer program;
    • a processor 502, configured for carrying out the following steps when executing the program stored on the memory 501:
      • obtaining a visible light image of a high-temperature target, the high-temperature target being a target in a monitored scene having a temperature higher than a preset temperature threshold, as determined according to an infrared light signal acquired from the monitored scene;
      • determining that a fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet a fire behavior phenomenon condition and/or not meet an infrared light source condition according to the visible light image, wherein, the fire behavior phenomenon condition is that a preset fire behavior phenomenon occurs at the high-temperature target, and the infrared light source condition is that the high-temperature target is a preset infrared light source, the preset infrared light source being an infrared light source capable of emitting infrared light when no fire behavior is occurring.
  • In a possible embodiment, if there is a smoke within a preset range of the high-temperature target, the high-temperature target meets the fire behavior phenomenon condition.
  • In a possible embodiment, if the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light, the high-temperature target meets the infrared light source condition.
  • In a possible embodiment, when the exposure level of the high-temperature target in the visible light image meets a high exposure condition, the high-temperature target is an infrared light source that emits an infrared light by reflecting an infrared light.
  • In a possible embodiment, when the high-temperature target is a preset type of machine, the high-temperature target meets the infrared light source condition.
  • In a possible embodiment, determining that no fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet the fire behavior phenomenon condition and/or not meet the infrared light source condition, includes:
    • when the high-temperature target meets the fire behavior phenomenon condition, determining that a fire behavior has occurred at the high-temperature target; or
    • when the high-temperature target does not meet the infrared light source condition, determining that a fire behavior has occurred at the high-temperature target; or
    • when the high-temperature target meets the fire behavior phenomenon condition and does not meet the infrared light source condition, determining that a fire behavior has occurred at the high-temperature target; or
    • when the high-temperature target meets the fire behavior phenomenon condition or the high-temperature target does not meet the infrared light source condition, determining that a fire behavior has occurred at the high-temperature target.
  • The processor mentioned in the aforementioned electronic device can be a general-purpose processor, such as a central processing unit (CPU), a network processor (NP), or the like; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component.
  • In a further embodiment of the present application, a computer readable storage medium is provided. The computer readable storage medium stores computer program thereon, which, when executed by a processor, causes the processor to carry out any of the steps of the fire behavior detection methods described above.
  • In a further embodiment according to the present invention, there is also provided a computer program product with instructions which, when running on a computer, cause the computer to perform the fire behavior detection method described in any one of the embodiments described above.
  • In the aforementioned embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented by software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The processes or functions described in accordance with the embodiments of the present application is produced in whole or in part, when the computer program instructions are loaded and executed on a computer. The computer may be a general-purpose computer, a dedicated computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or may be transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a web site, a computer, a server, or a data center to another web site, another computer, another server, or another data center via a cable (such as a coaxial cable, an optical fiber, a digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that may be accessed by a computer or a data storage device such as a server or a data center containing one or more available medium integrations. The available media may be magnetic media (such as floppy disks, hard disks, magnetic tapes), optical media (such as DVD), or semiconductor media (such as solid state disk (SSD)), etc.
  • It should be noted that, the relationship terms herein such as "first", "second" and the like are only used to distinguish one entity or operation from another entity or operation, but do not necessarily require or imply that there is actual relationship or order between these entities or operations. Moreover, the terms "comprise(s)", "include(s)" or any other variants thereof are intended to cover non-exclusive inclusions, so that processes, methods, articles or devices including a series of elements include not only those elements listed but also those not specifically listed or the elements intrinsic to these processes, methods, articles, or devices. Without further limitations, elements defined by the sentences "comprise(s) a." or "include(s) a." do not exclude that there are other identical elements in the processes, methods, articles, or devices which include these elements.
  • All the embodiments are described in corresponding ways, same or similar parts in each of the embodiments can be referred to one another, and the parts emphasized are differences to other embodiments. In particular, for embodiments of the apparatus, system, electronic device, computer readable storage medium, and computer program product, since they are substantially similar to the embodiments of the method, their description is relatively simple, and for the related aspects, one only needs to refer to portions of the description of the embodiments of the method.
  • The embodiments described above are merely preferred embodiments of the present application, and not intended to limit the scope of the present application. Any modifications, equivalents, improvements or the like within the spirit and principle of the application should be included in the scope of the application.

Claims (15)

  1. A fire behavior detection method, wherein the method comprises:
    obtaining a visible light image of a high-temperature target, wherein the high-temperature target is a target in a monitored scene having a temperature higher than a preset temperature threshold, as determined according to an infrared light signal acquired from the monitored scene;
    determining that a fire behavior has occurred at the high-temperature target when the high-temperature target is determined to meet a fire behavior phenomenon condition and/or not meet an infrared light source condition according to the visible light image, wherein, the fire behavior phenomenon condition is that a preset fire behavior phenomenon occurs at the high-temperature target, and the infrared light source condition is that the high-temperature target is a preset infrared light source, the preset infrared light source being an infrared light source capable of emitting an infrared light when no fire behavior is occurring.
  2. The method as claimed in claim 1, wherein, if there is a smoke within a preset range of the high-temperature target, the high-temperature target meets the fire behavior phenomenon condition.
  3. The method as claimed in claim 1, wherein, if the high-temperature target is an infrared light source that emits an infrared light by reflecting the infrared light, the high-temperature target meets the infrared light source condition.
  4. The method as claimed in claim 3, wherein, when an exposure level of the high-temperature target in the visible light image meets a high exposure condition, the high-temperature target is the infrared light source that emits the infrared light by reflecting the infrared light.
  5. The method as claimed in claim 1, wherein, when the high-temperature target is a preset type of machine, the high-temperature target meets the infrared light source condition.
  6. The method as claimed in claim 1, wherein, determining that no fire behavior has occurred at the high-temperature target when the high-temperature target is determined to meet the fire behavior phenomenon condition and/or not meet the infrared light source condition, comprises:
    when the high-temperature target meets the fire behavior phenomenon condition, determining that the fire behavior has occurred at the high-temperature target; or
    when the high-temperature target does not meet the infrared light source condition, determining that the fire behavior has occurred at the high-temperature target; or
    when the high-temperature target meets the fire behavior phenomenon condition and the high-temperature target does not meet the infrared light source condition, determining that the fire behavior has occurred at the high-temperature target; or
    when the high-temperature target meets the fire behavior phenomenon condition or the high-temperature target does not meet the infrared light source condition, determining that the fire behavior has occurred at the high-temperature target.
  7. A fire behavior detection apparatus, wherein the apparatus comprises:
    an image obtaining module, configured for obtaining a visible light image of a high-temperature target, the high-temperature target being a target having a temperature higher than a preset temperature threshold in a monitored scene, as determined according to an infrared light signal acquired from the monitored scene;
    an intelligent analysis module, configured for determining that a fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet a fire behavior phenomenon condition and/or not meet an infrared light source condition according to the visible light image, wherein, the fire behavior phenomenon condition is that a preset fire behavior phenomenon occurs at the high-temperature target, and the infrared light source condition is that the high-temperature target is a preset infrared light source, the preset infrared light source being an infrared light source capable of emitting infrared light when no fire behavior is occurring.
  8. A fire behavior detection system, wherein the system comprises:
    a data acquiring unit, a linkage unit, an intelligence unit;
    wherein, the data acquiring unit is configured for acquiring a monitoring data from a monitored scene, the monitoring data at least comprises an infrared light signal;
    the linkage unit is configured for determining, according to a monitoring data acquired by the data acquiring unit, a target in the monitored scene having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target;
    the data acquiring unit is further configured for acquiring a visible light image of the high-temperature target;
    the intelligence unit is configured for determining that a fire behavior has occurred at the high-temperature target, when the high-temperature target is determined to meet a fire behavior phenomenon condition and/or not meet an infrared light source condition according to the visible light image, wherein, the fire behavior phenomenon condition is that a preset fire behavior phenomenon occurs at the high-temperature target, and the infrared light source condition is that the high-temperature target is a preset infrared light source, the preset infrared light source being an infrared light source capable of emitting infrared light when no fire behavior is occurring.
  9. The system as claimed in claim 8, wherein, the data acquiring unit comprises a thermal imaging camera and a visible light camera which are pre-aligned;
    wherein, the thermal imaging camera is configured for capturing a thermal imaging image of the monitored scene;
    the linkage unit determining, according to a monitoring data acquired by the data acquiring unit, a target having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target, comprises:
    determining, according to the thermal imaging image captured by the thermal imaging camera, a target having a temperature higher than the preset temperature threshold from the monitored scene, as a high-temperature target;
    the visible light camera is configured for capturing the visible light image of the high-temperature target.
  10. The system as claimed in claim 9, wherein, the linkage unit is further configured for adjusting the thermal imaging camera so that the high-temperature target is located in a center area of a field of view of the thermal imaging camera, after determining, according to the monitoring data acquired by the data acquiring unit, the target having a temperature higher than the preset temperature threshold from the monitored scene, as the high-temperature target;
    the visible-light camera capturing the visible light image of the high-temperature target, comprises:
    capturing the visible light image of the high-temperature target, after the linkage unit adjusts the thermal imaging camera so that the high-temperature target is located in the center area of the field of view of the thermal imaging camera.
  11. The system as claimed in claim 9, wherein, the data acquiring unit further comprises a temperature and humidity sensor and a ranging component;
    wherein the temperature and humidity sensor is configured for acquiring temperature and humidity information of the monitored scene;
    the ranging component is configured for acquiring distance information, which indicates a distance between the data acquiring unit and the target in the monitored scene;
    the linkage unit determining, according to the thermal imaging image captured by the thermal imaging camera, a target having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target, comprises:
    the linkage unit determining, according to the thermal imaging image captured by the thermal imaging camera, the temperature and humidity information and the distance information, the target having a temperature higher than a preset temperature threshold from the monitored scene, as the high-temperature target.
  12. The system as claimed in claim 8, wherein, the linkage unit determining, according to the monitoring data acquired by the data acquiring unit, a target having a temperature higher than a preset temperature threshold from the monitored scene, as a high-temperature target, comprises:
    determining, according to the monitoring data acquired by the data acquiring unit, a target having a temperature higher than the preset temperature threshold from the monitored scene, as the high-temperature target;
    determining, according to the monitoring data acquired by the data acquiring unit, a target having a temperature higher than the preset temperature threshold from an area other than a shielding area in the monitored scene, as the high-temperature target, wherein the shielding area comprises one or more of a preset factory area and a preset chimney area.
  13. The system as claimed in claim 8, wherein, the fire behavior detection system further comprises an alarm unit;
    wherein the alarm unit is configured for sending an alarm when the intelligence unit determines that the fire behavior has occurred at the high-temperature target.
  14. An electronic device, wherein, the electronic device comprises:
    a memory, configured for storing a computer program;
    a processor, configured for carrying out the method of any one of claims 1-6 when executing the program stored on the memory.
  15. A computer readable storage medium having stored thereon a computer program which, when executed by a processor, causes the processor to carry out the method of any one of claims 1-6.
EP21900067.6A 2020-12-03 2021-12-02 Fire detection method, apparatus, system, and electronic device Pending EP4258234A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011399396.3A CN112614302B (en) 2020-12-03 2020-12-03 Fire detection method, device and system and electronic equipment
PCT/CN2021/135096 WO2022117041A1 (en) 2020-12-03 2021-12-02 Fire detection method, apparatus, system, and electronic device

Publications (2)

Publication Number Publication Date
EP4258234A1 true EP4258234A1 (en) 2023-10-11
EP4258234A4 EP4258234A4 (en) 2024-05-22

Family

ID=75228619

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21900067.6A Pending EP4258234A4 (en) 2020-12-03 2021-12-02 Fire detection method, apparatus, system, and electronic device

Country Status (3)

Country Link
EP (1) EP4258234A4 (en)
CN (1) CN112614302B (en)
WO (1) WO2022117041A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112614302B (en) * 2020-12-03 2022-10-04 杭州海康微影传感科技有限公司 Fire detection method, device and system and electronic equipment
CN113240880A (en) * 2021-05-27 2021-08-10 浙江大华技术股份有限公司 Fire detection method and device, electronic equipment and storage medium
CN113536918B (en) * 2021-06-10 2024-04-16 浙江华感科技有限公司 Firework detection method, system, electronic device and storage medium
CN113671886B (en) * 2021-08-25 2022-06-03 江苏霆善科技有限公司 Fire safety monitoring method and system based on 5G
CN114002751B (en) * 2021-10-26 2023-11-03 国网北京市电力公司 Abnormal position identification method, system and device
CN114419076B (en) * 2022-03-28 2022-08-05 杭州微影软件有限公司 Data processing method and device
CN116153007B (en) * 2022-12-29 2023-09-26 浙江佳伯尔电子科技有限公司 Alarm control system and method based on sensor
CN116994418B (en) * 2023-09-27 2023-12-26 广东力创信息技术有限公司 Pipeline safety early warning method and system

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0546887A (en) * 1991-08-19 1993-02-26 Mitsubishi Electric Corp Device and system for finding fire
US7786877B2 (en) * 2008-06-20 2010-08-31 Billy Hou Multi-wavelength video image fire detecting system
CN201936415U (en) * 2010-12-21 2011-08-17 北京川页家和科技发展有限公司 Automatic forest fire identification and alarm system
US20150370272A1 (en) * 2014-06-23 2015-12-24 Google Inc. Intelligent configuration of a smart environment based on arrival time
CN104036611B (en) * 2014-06-24 2017-06-06 北京中恩时代科技有限责任公司 A kind of method of fire detecting and alarm
CN105336086B (en) * 2015-09-29 2017-11-03 广州紫川电子科技有限公司 Intelligent Dynamic thermal source shielding harness and method based on infrared thermography
CN105488941B (en) * 2016-01-15 2018-10-30 中林信达(北京)科技信息有限责任公司 Double spectrum fire monitoring method and devices based on Infrared-Visible image
CN109101882A (en) * 2018-07-09 2018-12-28 石化盈科信息技术有限责任公司 A kind of image-recognizing method and system of fire source
CN109841028B (en) * 2018-11-29 2021-04-02 广州紫川物联网科技有限公司 Thermal infrared imager-based heat source detection method and system and storage medium
CN110334660A (en) * 2019-07-08 2019-10-15 天津城建大学 A kind of forest fire monitoring method based on machine vision under the conditions of greasy weather
CN110491066A (en) * 2019-08-21 2019-11-22 深圳云感物联网科技有限公司 Forest fire protection monitoring and warning system based on infrared thermal imaging
CN111199629B (en) * 2020-02-18 2021-11-23 普宙科技(深圳)有限公司 Heat source identification device, unmanned aerial vehicle and heat source identification method
CN111667656A (en) * 2020-06-05 2020-09-15 国网电力科学研究院有限公司 System and method for discriminating forest fire points of power transmission line
CN111899460B (en) * 2020-07-27 2021-11-23 山东工商学院 Remote fire detection system and method based on video image
CN112614302B (en) * 2020-12-03 2022-10-04 杭州海康微影传感科技有限公司 Fire detection method, device and system and electronic equipment

Also Published As

Publication number Publication date
CN112614302B (en) 2022-10-04
WO2022117041A1 (en) 2022-06-09
CN112614302A (en) 2021-04-06
EP4258234A4 (en) 2024-05-22

Similar Documents

Publication Publication Date Title
EP4258234A1 (en) Fire detection method, apparatus, system, and electronic device
CN107230329B (en) Fire detector calibration method, device and equipment
CN204946249U (en) Smog and fire-alarm
US6611207B1 (en) Method for detecting fire with light section image to sense smoke
CN112418069A (en) High-altitude parabolic detection method and device, computer equipment and storage medium
US10223793B1 (en) Laser distance measuring method and system
CN104392577A (en) Aerosol grain size sensing method based on dual-wavelength scattered signals and application of method to fire smoke detection
JP2014122891A (en) Photoelectronic sensor and method for detecting object and measuring distance
US9714833B2 (en) Method of determining the location of a point of interest and the system thereof
CN111986436B (en) Comprehensive flame detection method based on ultraviolet and deep neural networks
JP2023071760A (en) Multispectral sensor-based alarm condition detector
CN112562253B (en) Smoke sensor, smoke alarm method and smoke alarm device
CN111383294B (en) Drawing method and device for defense area in safety and lightning protection system
US20100097474A1 (en) Smoke detecting method and system
WO2020192047A1 (en) Smoke-sensing alarm and fire detection method
CN111724558A (en) Monitoring method, monitoring device and intrusion alarm system
KR101679148B1 (en) Detection System of Smoke and Flame using Depth Camera
CN109841028B (en) Thermal infrared imager-based heat source detection method and system and storage medium
US10048060B1 (en) Techniques for motion tracking
CN111366245B (en) Method for improving abnormal heating detection capability of infrared temperature measurement
US11935380B2 (en) Operating a scanning smoke detector
JP2017215642A (en) Monitoring system
CN114858675A (en) Smoke detection method, model training method and device and smoke detection equipment
KR102542126B1 (en) Lider sensor and method for removing noise of the same
CN114445669A (en) Smoke and fire alarm method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20230615

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20240419

RIC1 Information provided on ipc code assigned before grant

Ipc: G08B 17/10 20060101ALI20240415BHEP

Ipc: G08B 17/12 20060101AFI20240415BHEP