CN111050120B - Non-refrigeration type medium-long wave infrared video communication method and system - Google Patents
Non-refrigeration type medium-long wave infrared video communication method and system Download PDFInfo
- Publication number
- CN111050120B CN111050120B CN201911099622.3A CN201911099622A CN111050120B CN 111050120 B CN111050120 B CN 111050120B CN 201911099622 A CN201911099622 A CN 201911099622A CN 111050120 B CN111050120 B CN 111050120B
- Authority
- CN
- China
- Prior art keywords
- video
- video stream
- fire
- stream
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Optical Communication System (AREA)
Abstract
The invention relates to the technical field of infrared video communication, in particular to a non-refrigeration type medium-wavelength infrared video communication method and system. The method comprises the following steps: s1, establishing communication connection between the firefighter and the fire commander; the fire-fighting command vehicle can be connected with a plurality of firemen at the same time; s2, acquiring scene video stream and voice information stream; s3, extracting the target edge information of the scene video stream to obtain a processed video stream; s4, presenting the processed video stream on the AR glasses of the firefighter; the system comprises a communication module, a video acquisition module, an information extraction module and a video output module; the system of the embodiment of the invention executes the method, and the video stream of the scene is processed in parallel through the video card shader to extract the target edge information, thereby improving the extraction speed of the edge information and improving the time delay.
Description
Technical Field
The invention relates to the technical field of infrared video communication, in particular to a non-refrigeration type medium-wavelength infrared video communication method and system.
Background
The key technology of the fire fighting head-wearing display system is to transmit the conditions observed by a fire fighter to a vehicle-mounted server system through a network. WebRTC (Web Real-Time Communications, Web Real-Time communication technology, hereinafter referred to as WebRTC) allows Web applications or sites to establish a Peer-to-Peer (Peer-to-Peer) connection between browsers without using an intermediary, so as to transmit video streams or/and audio streams or any other data. The new technologies improve the life safety of the firefighters and improve the efficiency of the whole fire fighting disaster relief.
With the development of the technology, the non-refrigeration type medium-long wave infrared camera avoids the defects of heavy volume and inconvenient use of the traditional refrigeration type infrared camera, and medium-long wave infrared rays of 7 to 14um can effectively penetrate through dense smoke and capture a video formed by object temperature difference; the extraction speed of the object edge information is crucial for firefighters during fast movements. The traditional edge detection method is characterized in that a non-refrigeration medium-long wave infrared camera acquires a YUV format fire scene video, a processed video stream is obtained through a video acquisition card, and the processed video stream is loaded into a memory; the CPU calculates the edge video stream of the target through edge detection, such as a prewitt operator, and then loads the edge video stream into a memory, and the video stream in the memory enters a video memory of a display card; finally, presented on the firefighter's head-mounted AR glasses, fig. 1 in particular is a schematic view of a prior art process, as shown in fig. 1.
The prior art has the problems that in a disaster relief site, a fire control command vehicle is connected with a firefighter through a special vehicle-mounted base station, the bandwidth is unstable, the traditional method for extracting the edge information of an object contains a lot of redundant information, when the information is processed by a CPU, the speed of extracting the information is different according to the difference of the performance of the CPU, the time is required to be in the range of tens of ms to tens of ms, and the edge of a target lags behind the actual edge of the firefighter in the process of fast moving.
Disclosure of Invention
The invention overcomes the defects of the prior art, provides a non-refrigeration type medium-long wave infrared video communication method and a non-refrigeration type medium-long wave infrared video communication system, reduces redundant information of objects, improves the extraction speed of edge information, and improves time delay.
On one hand, the embodiment of the invention provides a non-refrigeration type medium-long wave infrared video communication method, which comprises the following steps:
s1, establishing communication connection between the firefighter and the fire commander; the fire-fighting command vehicle can be connected with a plurality of firemen at the same time;
s2, acquiring scene video stream and voice information stream; the scene video stream is in a YUV format, and the voice information stream is a voice instruction for communication between a fireman and a fire-fighting command vehicle;
s3, extracting the target edge information of the scene video stream to obtain a processed video stream; processing the scene video stream in parallel through a video card shader, and extracting the target edge information; the number of the graphics card shaders is several;
s4, the processed video stream is presented on the AR glasses of the firefighter.
In another aspect, an embodiment of the present invention provides a non-refrigeration medium-wavelength infrared video communication system, including:
the communication module is used for establishing communication connection between a fireman and the fire-fighting command vehicle; the fire-fighting command vehicle can be connected with a plurality of firemen at the same time;
the video acquisition module is used for acquiring scene video streams and voice information streams; the video stream is in a YUV format, and the voice information stream is a voice instruction for communication between a fireman and a fire-fighting command vehicle;
the information extraction module is used for extracting target edge information of the scene video stream to obtain a processed video stream; processing the scene video stream in parallel through a video card shader, and extracting the target edge information; the number of the graphics card shaders is several;
and the video output module is used for presenting the processed video stream on the AR glasses of the firefighter.
The embodiment of the invention provides a non-refrigeration type medium-long wavelength infrared video communication method and a non-refrigeration type medium-long wavelength infrared video communication system.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the technical description of the present invention will be briefly introduced below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive labor.
FIG. 1 is a schematic flow diagram of the prior art;
FIG. 2 is a schematic flow chart of a non-refrigeration type medium-long wavelength infrared video communication method according to an embodiment of the present invention;
FIG. 3 is a sub-flow diagram of a non-refrigeration type mid-wavelength infrared video communication method according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a non-refrigeration type medium-long wavelength infrared video communication system according to an embodiment of the present invention;
reference numerals:
the communication module-1 video acquisition module-2 information extraction module-3 video output module-4.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
FIG. 2 is a schematic flow chart of a non-refrigeration type medium-long wavelength infrared video communication method according to an embodiment of the present invention; as shown in fig. 2, the method comprises the following steps:
s1, establishing communication connection between the firefighter and the fire commander; the fire-fighting command vehicle can be connected with a plurality of firemen at the same time;
s2, acquiring scene video stream and voice information stream; the scene video stream is in a YUV format, and the voice information stream is a voice instruction for communication between a fireman and a fire-fighting command vehicle;
s3, extracting the target edge information of the scene video stream to obtain a processed video stream; processing the scene video stream in parallel through a video card shader, and extracting the target edge information; the number of the graphics card shaders is several;
s4, the processed video stream is presented on the AR glasses of the firefighter.
In particular, the communication technology based on the webrtc enables all firefighters to be in contact with the fire commander, and keeps the low delay of the whole system under the condition of low broadband; the method comprises the steps that a fireman wears a non-refrigeration type medium-long wave infrared camera to obtain surrounding scene video streams, a plurality of graphics card shaders in a GPU process the scene video streams in parallel, processed low-bit-rate video streams are formed through target edge information extraction processing and displayed on fireman AR glasses in real time, the fireman can judge surrounding conditions accurately and timely, life safety of the fireman is improved, and the whole fire fighting and disaster relief efficiency is improved.
The embodiment of the invention provides a non-refrigeration type medium-long wavelength infrared video communication method, wherein scene video streams are processed in parallel through a video card shader to extract edge information of a target, and a fireman improves the extraction speed of the edge information and the actual time delay of the target in the process of quick movement.
Further, fig. 3 is a schematic sub-flow diagram of a non-refrigeration medium-long wavelength infrared video communication method according to an embodiment of the present invention; as shown in fig. 3, the step S3 specifically includes:
s31, the scene video stream enters a video memory of a video card;
s32, the video card shader processes the scene video stream in the video memory of the video card in parallel; the number of the graphics card shaders is several;
and S33, performing edge detection on the target in the scene video stream through the shader programming language, and extracting the edge information of the target.
Specifically, a plurality of graphics card shaders process scene video streams in a graphics card memory in parallel, redundant information is removed through the calculation processing of a shader programming language, edge information extraction is reserved, the integral code rate of the processed video streams is changed to 20% of the original code rate, and due to the fact that a fire-fighting command vehicle is connected with a fireman through a special vehicle-mounted base station, the bandwidth is unstable; under the low-bandwidth environment, the communication between the firefighter and the fire control command vehicle by the video stream with lower code rate is ensured, meanwhile, the key target information is not lost, the speed of extracting and reducing the edge information is further improved, and the time delay is reduced.
Further, the S4 further includes sending the processed video stream to a fire-fighting command vehicle; and the fire-fighting command vehicle stores all the received processed video streams in real time. With reference to fig. 1, the fire conductor stores the processed video stream sent by all the fire fighters in real time for forwarding or playback.
Further, the fire commander sends the corresponding video stream to the firefighter in real time according to the firefighter video switching request instruction. For example, if firefighter 1 needs the field of vision of firefighter N, and sends a video switching request command through a voice command, a firefighter commander switches the video stream of firefighter N to firefighter 1 in real time, and firefighter 1 can see the scene around firefighter N.
Further, the fire-fighting command vehicle sends the voice command or the processed video stream to each firefighter in an emergency; the fire-fighting command vehicle can uniformly command and dispatch the firefighters.
The embodiment of the invention provides a non-refrigeration type medium-long wavelength infrared video communication method, wherein scene video streams are processed in parallel through a video card shader to extract edge information of a target, so that the edge information extraction speed is increased and the edge information and the actual time delay of the target are improved in the process of rapid movement of a fireman; calculating the target in the scene video stream through a shader programming language, performing edge detection, extracting edge information of the target, and removing redundant information, so that the overall code rate of the processed video stream is changed to 20% of the original code rate, the speed of extracting and reducing the edge information in a low-broadband environment is further improved, and the time delay is reduced; the fire control command vehicle stores the processed video streams sent by all the firefighters, and can switch to videos of surrounding environments of other firefighters in real time according to the requirements of all the firefighters in a low-bandwidth environment; meanwhile, the fire-fighting command vehicle sends the voice command or the processed video stream to each firefighter in an emergency; the fire-fighting command vehicle can uniformly command and dispatch the firefighters.
Based on the above embodiments, fig. 4 is a schematic structural diagram of a non-refrigeration type medium-long wavelength infrared video communication system according to an embodiment of the present invention; as shown in fig. 4, includes:
the communication module 1 is used for establishing communication connection between a fireman and a fire-fighting command vehicle; the fire-fighting command vehicle can be connected with a plurality of firemen at the same time;
the video acquisition module 2 is used for acquiring scene video streams and voice information streams; the video stream is in a YUV format, and the voice information stream is a voice instruction for communication between a fireman and a fire-fighting command vehicle;
the information extraction module 3 is used for extracting target edge information of the scene video stream to obtain a processed video stream; processing the scene video stream in parallel through a video card shader, and extracting the target edge information; the number of the graphics card shaders is several;
and the video output module 4 is used for presenting the processed video stream on the AR glasses of the firefighter.
The embodiment of the invention provides a non-refrigeration type medium-long wavelength infrared video communication system for executing the method, the scene video stream is processed in parallel through a video card shader, the target edge information is extracted, the firemen improve the edge information extraction speed and the edge information and the actual time delay of the target in the rapid moving process; calculating the target in the scene video stream through a shader programming language, performing edge detection, extracting edge information of the target, and removing redundant information, so that the overall code rate of the processed video stream is changed to 20% of the original code rate, the speed of extracting and reducing the edge information in a low-broadband environment is further improved, and the time delay is reduced; the fire control command vehicle stores the processed video streams sent by all the firefighters, and can switch to videos of surrounding environments of other firefighters in real time according to the requirements of all the firefighters in a low-bandwidth environment; meanwhile, the fire-fighting command vehicle sends the voice command or the processed video stream to each firefighter in an emergency; the fire-fighting command vehicle can uniformly command and dispatch the firefighters.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A non-refrigeration type medium-long wave infrared video communication method is characterized by comprising the following steps:
s1, establishing communication connection between the firefighter and the fire-fighting command vehicle based on the webrtc communication technology; the fire-fighting command vehicle can be connected with a plurality of firemen at the same time;
s2, acquiring scene video stream and voice information stream through the head-mounted non-refrigeration type medium-long wave infrared camera; the scene video stream is in a YUV format, and the voice information stream is a voice instruction for communication between a fireman and a fire-fighting command vehicle;
s3, extracting the target edge information of the scene video stream to obtain a processed video stream; processing the scene video stream in parallel through a video card shader, and extracting the target edge information; the number of the graphics card shaders is several;
s4, the processed video stream is presented on the AR glasses of the firefighter.
2. The non-refrigeration type medium-wavelength infrared video communication method according to claim 1, wherein the step S3 specifically includes:
s31, the scene video stream enters a video memory of a video card;
s32, the video card shader processes the scene video stream in the video memory of the video card in parallel;
and S33, performing edge detection on the target in the scene video stream through the shader programming language, and extracting the edge information of the target.
3. The non-refrigeration type mid-wavelength infrared video communication method as recited in claim 1, wherein the S4 further comprises sending the processed video stream to a fire commander; and the fire-fighting command vehicle stores all the received processed video streams in real time.
4. The non-refrigeration type medium-long wavelength infrared video communication method according to claim 3, wherein the fire control command vehicle sends the corresponding video stream to a firefighter in real time according to a firefighter video switching request instruction.
5. The non-refrigeration type mid-wavelength infrared video communication method as claimed in claim 4, wherein the fire commander sends the voice command or the processed video stream to each firefighter in an emergency.
6. A non-refrigeration type medium-long wavelength infrared video communication system, comprising:
the communication module (1) is used for establishing communication connection between a fireman and the fire-fighting command vehicle based on a webrtc communication technology; the fire-fighting command vehicle can be connected with a plurality of firemen at the same time;
the video acquisition module (2) acquires scene video stream and voice information stream through a head-mounted non-refrigeration type medium-long wave infrared camera; the scene video stream is in a YUV format, and the voice information stream is a voice instruction for communication between a fireman and a fire-fighting command vehicle;
the information extraction module (3) is used for extracting the target edge information of the scene video stream to obtain the processed video stream; processing the scene video stream in parallel through a video card shader, and extracting the target edge information; the number of the graphics card shaders is several;
and the video output module (4) is used for presenting the processed video stream on AR glasses of the firefighter.
7. The non-refrigerated medium-wavelength infrared video communication system according to claim 6, wherein the information extraction module (3) comprises: the scene video stream enters a video memory of a video card; the video card shader processes scene video streams in the video memory of the video card in parallel; and carrying out edge detection on the target in the scene video stream through a shader programming language, and extracting the edge information of the target.
8. The non-refrigeration type mid-wavelength infrared video communication system according to claim 6, wherein the video output module (4) sends the processed video stream to a fire-fighting command vehicle; and the fire-fighting command vehicle stores all the received processed video streams in real time.
9. The non-refrigeration type mid-wavelength infrared video communication system according to claim 8, wherein the fire commander sends the corresponding video stream to a firefighter in real time according to a firefighter video switching request instruction.
10. The non-refrigeration type mid-wavelength infrared video communication system as set forth in claim 9, wherein said fire commander transmits said voice command or said processed video stream to each firefighter in an emergency.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911099622.3A CN111050120B (en) | 2019-11-12 | 2019-11-12 | Non-refrigeration type medium-long wave infrared video communication method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911099622.3A CN111050120B (en) | 2019-11-12 | 2019-11-12 | Non-refrigeration type medium-long wave infrared video communication method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111050120A CN111050120A (en) | 2020-04-21 |
| CN111050120B true CN111050120B (en) | 2021-07-09 |
Family
ID=70232336
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911099622.3A Active CN111050120B (en) | 2019-11-12 | 2019-11-12 | Non-refrigeration type medium-long wave infrared video communication method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111050120B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112465689B (en) * | 2020-10-21 | 2023-04-07 | 武汉凌久微电子有限公司 | GPU invisible video memory management method and system based on visible video memory exchange area |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6016160A (en) * | 1993-03-31 | 2000-01-18 | Cairns & Brother Inc. | Combination head-protective helmet and thermal imaging apparatus |
| CN104156188A (en) * | 2014-08-04 | 2014-11-19 | 西安电子科技大学 | High-frame-frequency infrared scene generating and outputting system and method |
| CN109688350A (en) * | 2019-02-25 | 2019-04-26 | 苏州长风航空电子有限公司 | Processing system for video based on non-refrigeration type thermal infrared imager |
| CN109998213A (en) * | 2019-04-26 | 2019-07-12 | 中航华东光电有限公司 | A kind of new A R fire helmet |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104639912A (en) * | 2015-02-11 | 2015-05-20 | 尼森科技（湖北）有限公司 | Individual soldier fire protection and disaster rescue equipment and system based on infrared three-dimensional imaging |
| CN108853832A (en) * | 2018-08-08 | 2018-11-23 | 中国电子科技集团公司第二十八研究所 | A kind of Intelligent fire-fighting helmet |
-
2019
- 2019-11-12 CN CN201911099622.3A patent/CN111050120B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6016160A (en) * | 1993-03-31 | 2000-01-18 | Cairns & Brother Inc. | Combination head-protective helmet and thermal imaging apparatus |
| CN104156188A (en) * | 2014-08-04 | 2014-11-19 | 西安电子科技大学 | High-frame-frequency infrared scene generating and outputting system and method |
| CN109688350A (en) * | 2019-02-25 | 2019-04-26 | 苏州长风航空电子有限公司 | Processing system for video based on non-refrigeration type thermal infrared imager |
| CN109998213A (en) * | 2019-04-26 | 2019-07-12 | 中航华东光电有限公司 | A kind of new A R fire helmet |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111050120A (en) | 2020-04-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110856018B (en) | Rapid transcoding method and system in monitoring system based on cloud computing | |
| CN109147253B (en) | Wisdom fire safety pre-judging management linkage platform | |
| CN111050120B (en) | Non-refrigeration type medium-long wave infrared video communication method and system | |
| CN109920099B (en) | Movable modular intelligent fire-fighting on-duty guarantee equipment and related products | |
| CN108616914A (en) | A kind of method and device of disconnection reconnecting | |
| CN111695541A (en) | Unmanned aerial vehicle forest fire prevention system and method based on machine vision | |
| KR20220075275A (en) | Camera occlusion detection method, device, equipment, storage medium and program products | |
| CN114971409A (en) | Smart city fire monitoring and early warning method and system based on Internet of things | |
| CN112530021A (en) | Method, apparatus, device and storage medium for processing data | |
| CN109685835B (en) | Method and device for extracting fire points of power transmission line with mass satellite image data | |
| CN103974029A (en) | Video monitoring method, video monitoring system and video monitoring device | |
| CN115297305A (en) | Multi-video-stream security risk early warning system and method based on edge calculation | |
| CN115861915A (en) | Fire fighting access monitoring method, fire fighting access monitoring device and storage medium | |
| CN112822070A (en) | Internet of things equipment monitoring method | |
| CN114579358A (en) | Virtual operation and maintenance diagnosis platform based on meta universe | |
| CN109525945B (en) | Fire rescue communication system and communication method | |
| CN111669488A (en) | Video monitoring and fire alarm linkage system and method thereof | |
| CN113628172A (en) | Intelligent detection algorithm for personnel handheld weapons and smart city security system | |
| CN116485165B (en) | Forest fire control strategy formulation method, system and storage medium based on fusion factors | |
| CN108564762A (en) | A kind of forest rocket identification intelligent cloud system based on Distributed Calculation | |
| CN116824480A (en) | Monitoring video analysis method and system based on deep stream | |
| JP7263478B2 (en) | Method, device, electronic device, storage medium, roadside unit, cloud control platform and computer program for determining reliability of target detection | |
| CN115022722A (en) | Video monitoring method and device, electronic equipment and storage medium | |
| CN111541864B (en) | Digital retina software defined camera method and system | |
| CN111080954A (en) | Based on wisdom city fire control remote monitering system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |