CN111212265A - Dual-channel display control system of photoelectric equipment - Google Patents
Dual-channel display control system of photoelectric equipment Download PDFInfo
- Publication number
- CN111212265A CN111212265A CN202010030067.5A CN202010030067A CN111212265A CN 111212265 A CN111212265 A CN 111212265A CN 202010030067 A CN202010030067 A CN 202010030067A CN 111212265 A CN111212265 A CN 111212265A
- Authority
- CN
- China
- Prior art keywords
- module
- control system
- data
- video
- visible light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/22—Adaptations for optical transmission
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optical Communication System (AREA)
Abstract
The invention aims to provide a dual-channel display control system of photoelectric equipment, which performs mixed packaging on a real-time video stream of a dual-channel H.264 code according to a private protocol, uses a UDP (user datagram protocol) or RTSP (real time streaming protocol) network protocol to transmit in an optical fiber, enters an upper computer, performs unpacking, caching and decoding by dual-channel display control software according to an agreed private protocol, and finally simultaneously plays two channels of videos. The two paths of video mixed packets are good in continuity and high in transmission efficiency; unpacking, decoding and framing multithread parallel work is performed, the time delay is small, and the real-time performance is high; and the private control protocol can also meet the diversity requirements of customers.
Description
Technical Field
The invention relates to a display control system of photoelectric equipment, in particular to a dual-channel display control system of photoelectric equipment.
Background
In the field of video display control of photoelectric equipment, a RTSP network streaming mode is generally adopted for receiving a single-path video, and only one path of video cannot comprehensively monitor a monitoring area of the photoelectric equipment; the video receiving mode is single, and the display control system lacks a corresponding framing decoding mode for different video streams; the video stream is uniformly coded, so that the program is bloated, the multi-path display occupies large program space, the conversion efficiency is low, and the cost is higher; in the face of users with specific use purposes, common control protocols cannot meet the diversity requirements of customers.
Disclosure of Invention
The invention aims to provide a dual-channel display control system of photoelectric equipment, which performs mixed packaging on a real-time video stream of a dual-channel H.264 code according to a private protocol, uses a UDP (user datagram protocol) or RTSP (real time streaming protocol) network protocol to transmit in an optical fiber, enters an upper computer, performs unpacking, caching and decoding by dual-channel display control software according to an agreed private protocol, and finally simultaneously plays two channels of videos. The two paths of video mixed packets are good in continuity and high in transmission efficiency; unpacking, decoding and framing multithread parallel work is performed, the time delay is small, and the real-time performance is high; and the private control protocol can also meet the diversity requirements of customers.
The invention is realized by the following technical scheme:
an optoelectronic device dual channel display control system, comprising:
the system comprises a visible camera for collecting visible light videos and communication data and a thermal infrared imager for collecting infrared videos and communication data;
the data exchange equipment is used for transmitting visible light video and communication data and infrared video and communication data;
the multithreading parallel receiving device is used for processing visible light video and communication data and infrared video and communication data;
the decoding device is used for decoding the visible light video data and the infrared video data received by the multithread parallel receiving device in real time;
the display device is used for displaying the visible light video data and the infrared video data decoded by the decoding device in real time;
the visible light video and the communication data collected by the visible camera and the infrared thermal imager transmit the collected infrared video and the collected communication data to the multithread parallel receiving device through the data exchange equipment, the video data received by the multithread parallel receiving device is decoded in real time by the decoding device, and the decoded data is displayed in real time by the display device.
The dual-channel display control system of the photoelectric equipment further comprises:
the laser ranging device is used for measuring the linear distance between the target object and the photoelectric tracking device;
the servo tracking module is used for performing motion compensation according to the relative displacement relation between the target object and the photoelectric tracking equipment and keeping the target object at the video center position;
the main control module controls the laser ranging device and the servo tracking module according to the instruction of the control system module;
the control system module is used for controlling the whole photoelectric tracking equipment according to preset control logic or an operator instruction;
the communication module is used for data transmission between the main control module and the control system module;
and the control system module controls the laser ranging device and the servo tracking module through the communication module and the main control module.
The photoelectric equipment dual-channel display control system comprises photoelectric tracking equipment, wherein the photoelectric tracking equipment comprises a visible camera, a thermal infrared imager, laser ranging equipment, a main control module and a servo tracking module.
The dual-channel display control system of the photoelectric equipment further comprises:
the state indicating module displays various states and parameter information of the photoelectric tracking equipment;
and the control system module controls the photoelectric tracking equipment according to the state information and the instruction of an operator.
The data exchange device includes: the first photoelectric conversion module is used for converting the electric signal into an optical signal; an optical fiber for transmitting an optical signal; the second photoelectric conversion module is used for converting the optical signal into an electric signal;
the visible light video and communication data and the infrared video and communication data convert the electric signals into optical signals in the first photoelectric conversion module and transmit the optical signals to the second photoelectric conversion module through the optical fibers, and the second photoelectric conversion module converts the optical signals into the electric signals.
A processing method of a dual-channel display control system of an optoelectronic device comprises the following steps: mixing and packaging the H.264 coded visible light video and communication data and the infrared video and communication data according to a private protocol, transmitting the mixed and packaged data in data exchange equipment by using a UDP (user Datagram protocol) or RTSP (real time streaming protocol) network protocol, and entering a multithreading parallel receiving device in an upper computer through a network module; the multithreading parallel receiving device transmits the received visible light video data and infrared video data to a decoding device for unpacking, caching and framing and H.264 decoding; and the visible light video data and the infrared video data which are decoded by the H.264 are displayed and played in real time on a display device.
Compared with the prior art, the invention has the following advantages and beneficial effects:
the invention provides a dual-channel display control system of photoelectric equipment, wherein the whole set of system receives and decodes two-channel videos in parallel by using multiple threads, so that the real-time performance is ensured; the photoelectric tracking device uses various motion control access and feedback means, so that an operator can select a more convenient and accurate control mode, and the photoelectric tracking device can correctly respond and carry out the intention of the operator.
Drawings
The accompanying drawings, which are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principles of the invention. In the drawings:
fig. 1 is a block diagram of the whole technical scheme of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to examples and accompanying drawings, and the exemplary embodiments and descriptions thereof are only used for explaining the present invention and are not meant to limit the present invention.
Examples
The invention discloses a dual-channel display control system of an optoelectronic device, which comprises a display panel, a display panel and a display panel, wherein as shown in figure 1,
an optoelectronic device dual channel display control system, comprising:
the system comprises a visible camera for collecting visible light videos and communication data and a thermal infrared imager for collecting infrared videos and communication data;
the data exchange equipment is used for transmitting visible light video and communication data and infrared video and communication data;
the multithreading parallel receiving device is used for processing visible light video and communication data and infrared video and communication data;
the decoding device is used for decoding the visible light video data and the infrared video data received by the multithread parallel receiving device in real time;
the display device is used for displaying the visible light video data and the infrared video data decoded by the decoding device in real time;
the visible light camera can output images of visible light wave bands and near infrared wave bands after H.264 coding, and the thermal infrared imager can output images of medium wave infrared or long wave infrared after H.264 coding.
The visible light video and the communication data collected by the visible camera and the infrared thermal imager transmit the collected infrared video and the collected communication data to the multithread parallel receiving device through the data exchange equipment, the video data received by the multithread parallel receiving device is decoded in real time by the decoding device, and the decoded data is displayed in real time by the display device.
The dual-channel display control system of the photoelectric equipment further comprises:
the laser ranging device is used for measuring the linear distance between the target object and the photoelectric tracking device;
the servo tracking module is used for performing motion compensation according to the relative displacement relation between the target object and the photoelectric tracking equipment and keeping the target object at the video center position;
the main control module controls the laser ranging device and the servo tracking module according to the instruction of the control system module;
the control system module is used for controlling the whole photoelectric tracking equipment according to preset control logic or an operator instruction;
the communication module is used for data transmission between the main control module and the control system module;
and the control system module controls the laser ranging device and the servo tracking module through the communication module and the main control module.
The photoelectric equipment dual-channel display control system comprises photoelectric tracking equipment, wherein the photoelectric tracking equipment comprises a visible camera, a thermal infrared imager, laser ranging equipment, a main control module and a servo tracking module.
The dual-channel display control system of the photoelectric equipment further comprises:
the state indicating module displays various states and parameter information of the photoelectric tracking equipment;
and the control system module controls the photoelectric tracking equipment according to the state information and the instruction of an operator.
The data exchange device includes: the first photoelectric conversion module is used for converting the electric signal into an optical signal; an optical fiber for transmitting an optical signal; the second photoelectric conversion module is used for converting the optical signal into an electric signal;
the visible light video and communication data and the infrared video and communication data convert the electric signals into optical signals in the first photoelectric conversion module and transmit the optical signals to the second photoelectric conversion module through the optical fibers, and the second photoelectric conversion module converts the optical signals into the electric signals.
A processing method of a dual-channel display control system of an optoelectronic device comprises the following steps: mixing and packaging the H.264 coded visible light video and communication data and the infrared video and communication data according to a private protocol, transmitting the mixed and packaged data in data exchange equipment by using a UDP (user Datagram protocol) or RTSP (real time streaming protocol) network protocol, and entering a multithreading parallel receiving device in an upper computer through a network module; the multithreading parallel receiving device transmits the received visible light video data and infrared video data to a decoding device for unpacking, caching and framing and H.264 decoding; and the visible light video data and the infrared video data which are decoded by the H.264 are displayed and played in real time on a display device.
The specific operation process comprises the following steps:
(1) completing cable connection, opening dual-channel display and control software, and configuring parameters;
(2) powering a photoelectric tracking device;
(3) the main control module, the servo tracking module and the communication module start to initialize;
(4) the main control module, the servo tracking module and the communication module perform self-checking, after the self-checking is completed, a self-checking state is sent through the communication module, and after the state indicating module receives the self-checking state, the self-checking state is displayed on the dual-channel video display and control device;
(5) the double-channel video display control device controls the electrification of a visible light camera, a thermal infrared imager and laser ranging equipment;
(6) the method comprises the following steps that initialization and self-checking are started by a visible light camera, a thermal infrared imager and laser ranging equipment, after the self-checking is finished, a self-checking state is sent through a communication module, and the self-checking state is displayed on a dual-channel video display control device after the self-checking is received by a state indicating module;
(7) if the self-checking is normal, the video acquisition equipment enters a video acquisition mode, acquires, processes and compresses the video according to preset parameters and outputs the video to the photoelectric conversion module;
(8) an electro-optical channel in the first photoelectric conversion module converts the two-way video and communication data electrical signals into optical signals, and after the optical signals are transmitted by optical fibers, the two-way video and communication data optical signals are restored into the electrical signals by the electro-optical channel in the second photoelectric conversion module and are sent to the network module;
(9) the dual-channel video display control device transfers the data received in the network module to a video cache region or a communication cache region in real time;
(10) the dual-channel video display control device performs operations such as packaging, H.264 decoding, framing, playing, storing and the like on video data in the video cache region according to needs;
(11) due to the differences between UDP and RTSP network protocols, the steps or sequence in (10) are slightly different;
(12) the control system module analyzes and uses the communication data (video acquisition equipment) in the communication cache region, and simultaneously forwards the state information of the video acquisition equipment to the state indication module;
(13) the control system module analyzes and uses communication data (equipment or modules of the photoelectric tracking platform except the video acquisition equipment) received by the communication module, and simultaneously forwards the state information of the video acquisition equipment to the state indicating module;
(14) the control system module integrates the states of all the devices and the instructions of operators, sends corresponding control commands to the video acquisition device, the laser ranging device and the servo tracking module, and sends the control commands to the corresponding devices through the network module or the communication module so as to achieve the expected purpose.
(15) The types of commands for the operator are as follows:
a, adjusting the working state of video acquisition equipment, including exposure time, aperture, focal length and the like;
b, adjusting the algorithm state of the video acquisition equipment, including enhancement, noise reduction, wide dynamic, defogging and the like;
c, requesting the laser range finder to carry out range finding of multiple modes on the target;
d, requesting a servo and tracking module to search a target according to a preset mode;
and e, requesting the servo and tracking module to track the preset target which is clicked, framed or automatically identified in the video played by the dual-channel display control software, driving the carried video acquisition equipment to follow up, and keeping the target at the video center position.
Those skilled in the art will appreciate that all or part of the process implementing the system of the above embodiments may be implemented by a computer program instructing associated hardware, and the program may be stored in a computer.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (8)
1. A dual-channel display control system for an optoelectronic device, comprising:
the system comprises a visible camera for collecting visible light videos and communication data and a thermal infrared imager for collecting infrared videos and communication data;
the data exchange equipment is used for transmitting visible light video and communication data and infrared video and communication data;
the multithreading parallel receiving device is used for processing visible light video and communication data and infrared video and communication data;
the decoding device is used for decoding the visible light video data and the infrared video data received by the multithread parallel receiving device in real time;
the display device is used for displaying the visible light video data and the infrared video data decoded by the decoding device in real time;
the visible light video and the communication data collected by the visible camera and the infrared thermal imager transmit the collected infrared video and the collected communication data to the multithread parallel receiving device through the data exchange equipment, the video data received by the multithread parallel receiving device is decoded in real time by the decoding device, and the decoded data is displayed in real time by the display device.
2. The optoelectronic device dual channel display control system of claim 2, further comprising:
the laser ranging device is used for measuring the linear distance between the target object and the photoelectric tracking device;
the servo tracking module is used for performing motion compensation according to the relative displacement relation between the target object and the photoelectric tracking equipment and keeping the target object at the video center position;
the main control module controls the laser ranging device and the servo tracking module according to the instruction of the control system module;
the control system module is used for controlling the whole photoelectric tracking equipment according to preset control logic or an operator instruction;
the communication module is used for data transmission between the main control module and the control system module;
and the control system module controls the laser ranging device and the servo tracking module through the communication module and the main control module.
3. The optoelectronic device dual-channel display control system according to claim 2, comprising an optoelectronic tracking device, wherein the optoelectronic tracking device comprises a visible camera, a thermal infrared imager, a laser ranging device, a main control module, and a servo tracking module.
4. The optoelectronic device dual channel display control system of claim 3, further comprising:
the state indicating module displays various states and parameter information of the photoelectric tracking equipment;
and the control system module controls the photoelectric tracking equipment according to the state information and the instruction of an operator.
5. The optoelectronic device dual channel display control system of claim 1, wherein the data exchange device comprises:
the first photoelectric conversion module is used for converting the electric signal into an optical signal;
an optical fiber for transmitting an optical signal;
the second photoelectric conversion module is used for converting the optical signal into an electric signal;
the visible light video and communication data and the infrared video and communication data convert the electric signals into optical signals in the first photoelectric conversion module and transmit the optical signals to the second photoelectric conversion module through the optical fibers, and the second photoelectric conversion module converts the optical signals into the electric signals.
6. A processing method of a dual-channel display control system of an optoelectronic device is characterized by comprising the following steps: and mixing and packaging the H.264 coded visible light video and communication data and the infrared video and communication data according to a private protocol, transmitting the mixed and packaged data in data exchange equipment by using a UDP (user Datagram protocol) or RTSP (real time streaming protocol) network protocol, and entering a multithreading parallel receiving device in an upper computer through a network module.
7. The processing method of the two-channel display control system of the optoelectronic device as claimed in claim 6, wherein: and the multithreading parallel receiving device transmits the received visible light video data and infrared video data to a decoding device for unpacking, caching and framing and H.264 decoding.
8. The processing method of the two-channel display control system of the optoelectronic device as claimed in claim 7, wherein: and the visible light video data and the infrared video data which are decoded by the H.264 are displayed and played in real time on a display device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010030067.5A CN111212265A (en) | 2020-01-13 | 2020-01-13 | Dual-channel display control system of photoelectric equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010030067.5A CN111212265A (en) | 2020-01-13 | 2020-01-13 | Dual-channel display control system of photoelectric equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111212265A true CN111212265A (en) | 2020-05-29 |
Family
ID=70788859
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010030067.5A Pending CN111212265A (en) | 2020-01-13 | 2020-01-13 | Dual-channel display control system of photoelectric equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111212265A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112884634A (en) * | 2021-01-20 | 2021-06-01 | 四川中科友成科技有限公司 | Image and video processing system based on OPENCV |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202928691U (en) * | 2012-10-16 | 2013-05-08 | 云南电网公司临沧供电局 | Transformer station equipment image and temperature on-line monitoring system |
| CN103209328A (en) * | 2013-04-19 | 2013-07-17 | 中国科学院遥感与数字地球研究所 | Multi-source satellite image real-time online processing technical method and device |
| CN103402044A (en) * | 2013-08-07 | 2013-11-20 | 重庆大学 | Target recognition and tracking system based on multi-source video integration |
| CN108363519A (en) * | 2017-12-29 | 2018-08-03 | 中国科学院自动化研究所 | Distributed infrared vision-based detection merges the touch control display system of automatic straightening with projection |
| CN108388267A (en) * | 2018-04-13 | 2018-08-10 | 北京天赢测控技术有限公司 | Unmanned plane managing and control system |
| CN207966149U (en) * | 2018-02-12 | 2018-10-12 | 天津港石油化工码头有限公司 | all-weather intelligent oil spilling monitoring system |
-
2020
- 2020-01-13 CN CN202010030067.5A patent/CN111212265A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202928691U (en) * | 2012-10-16 | 2013-05-08 | 云南电网公司临沧供电局 | Transformer station equipment image and temperature on-line monitoring system |
| CN103209328A (en) * | 2013-04-19 | 2013-07-17 | 中国科学院遥感与数字地球研究所 | Multi-source satellite image real-time online processing technical method and device |
| CN103402044A (en) * | 2013-08-07 | 2013-11-20 | 重庆大学 | Target recognition and tracking system based on multi-source video integration |
| CN108363519A (en) * | 2017-12-29 | 2018-08-03 | 中国科学院自动化研究所 | Distributed infrared vision-based detection merges the touch control display system of automatic straightening with projection |
| CN207966149U (en) * | 2018-02-12 | 2018-10-12 | 天津港石油化工码头有限公司 | all-weather intelligent oil spilling monitoring system |
| CN108388267A (en) * | 2018-04-13 | 2018-08-10 | 北京天赢测控技术有限公司 | Unmanned plane managing and control system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112884634A (en) * | 2021-01-20 | 2021-06-01 | 四川中科友成科技有限公司 | Image and video processing system based on OPENCV |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105120240B (en) | The aerial high definition multidimensional of high power zoom unmanned plane investigates transmitting, monitoring device in real time | |
| CN102082466A (en) | Intelligent inspection robot system for transformer substation equipment | |
| CN100446568C (en) | Video monitoring equipment and device | |
| TW201535989A (en) | Free-space optical communications for mobile devices | |
| CN112351258B (en) | Construction site security monitoring system and method based on 5G communication technology | |
| CN105208335B (en) | The aerial high definition multidimensional of high power zoom unmanned plane investigates Transmission system in real time | |
| CN110519531B (en) | Multipath high-definition video distributed processing equipment | |
| CN105375981B (en) | A kind of optical cable survey system and method | |
| CN111212265A (en) | Dual-channel display control system of photoelectric equipment | |
| WO2020043142A1 (en) | Apparatus and method for coupling spatial light to optical fiber light for achieving stability of optical axis without position sensor | |
| Chakareski et al. | Toward Enabling Next-Generation Societal Virtual Reality Applications for Virtual Human Teleportation: A novel future system concept and computation-communication-signal representation trade-offs | |
| JP2000022632A (en) | Image display device | |
| CN104994271B (en) | A kind of cableway camera chain and control thereof and video-signal transmission method | |
| CN110808779B (en) | Laser access method and device based on space division multiplexing | |
| CN105208336B (en) | The aerial high definition multidimensional of high power zoom unmanned plane investigates transmission method in real time | |
| CN102457698B (en) | Video communication bridge-connection system and method | |
| CN103209287A (en) | Photographing method of regulation and control camera lens, special camera and special glasses frame | |
| CN203422844U (en) | Remote infrared controller for interactive set-top box | |
| AU2013249513B2 (en) | Stereoscopic beam splitter | |
| CN211656276U (en) | High-penetrability imaging device with target tracking function | |
| US20140160230A1 (en) | Multi Channel and Wide-Angle Observation System | |
| CN203675227U (en) | Video monitoring tester | |
| KR101113801B1 (en) | High magnification and high distinctness observation apparatus | |
| CN209949303U (en) | Video monitoring tester capable of testing visible distance from camera to target | |
| CN206602588U (en) | Portal jib crane Active Eyes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200529 |
|
| RJ01 | Rejection of invention patent application after publication |