CN109587410A - Panoptic visualization safety defense monitoring system - Google Patents
Panoptic visualization safety defense monitoring system Download PDFInfo
- Publication number
- CN109587410A CN109587410A CN201811514412.1A CN201811514412A CN109587410A CN 109587410 A CN109587410 A CN 109587410A CN 201811514412 A CN201811514412 A CN 201811514412A CN 109587410 A CN109587410 A CN 109587410A
- Authority
- CN
- China
- Prior art keywords
- video
- image
- monitoring system
- safety defense
- splicing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 32
- 230000007123 defense Effects 0.000 title claims abstract description 16
- 238000012800 visualization Methods 0.000 title claims abstract description 15
- 230000004927 fusion Effects 0.000 claims description 13
- 238000000605 extraction Methods 0.000 claims description 3
- 238000012217 deletion Methods 0.000 claims description 2
- 230000037430 deletion Effects 0.000 claims description 2
- 238000004519 manufacturing process Methods 0.000 claims description 2
- 230000004888 barrier function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000003190 augmentative effect Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000000034 method Methods 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000005577 local transmission Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000026676 system process Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The present invention provides a kind of Panoptic visualization safety defense monitoring systems, comprising: video code flow obtains module, for obtaining multi-channel video code stream in real time；Panoramic video splicing module, for multi-channel video to be spliced into a full-view video image.The present invention splices the video image that the camera arranged on different buildings obtains, according to the characteristic point of acquisition, after image overlapping region is deleted, form a width full-view video image, video image after partial occlusion object on large scene stitching image is merged with large scene splicing video, image after making shelter is presented in entire video image, a width is ultimately formed to monitor without the panoramic video of dead angle, all standing, the video image can intuitively show the entire scene of garden, effectively improve the working efficiency of supervisor.
Description
Technical field
The present invention relates to a kind of safety defense monitoring systems, and in particular to a kind of Panoptic visualization safety defense monitoring system.
Background technique
Currently, monitoring trade development in China's is highly developed, many industrial zones have been mounted with video monitoring system,
But existing video monitoring picture is single, onrelevant between multiple cameras, and supervisor can not image picture with respect to multichannel simultaneously
Face, wrong over sight (OS) are seen, have become the common puzzlement point of supervisor, for the industrial zone of densely populated place, energy not see suddenly
Enough intuitively, it specifically shows entire monitoring scene, the working efficiency of supervisor can not only be improved, additionally it is possible to occur in accident
When rapidly determine spot, improve the safety of garden.
Summary of the invention
The object of the present invention is to provide a kind of Panoptic visualization safety defense monitoring systems, garden scene are based on, by a few road videos
Decoded video image blends, wherein there is the video at the monitoring dead angle under shelter (building, tree), is spliced into a width overall situation video
Image, and will be stored after compression of images, it realizes and is monitored without dead angle panoramic video, so that monitor video has " seeing entirely ", " sees
Clearly ", " remembering ", " finding " function.
The present invention provides a kind of Panoptic visualization safety defense monitoring systems, comprising:
Video code flow obtains module, for obtaining multi-channel video code stream in real time；
Panoramic video splicing module, for multi-channel video to be spliced into a full-view video image.
Further, panoramic video splicing module is specifically used for:
In different video images, according to the intersection region of image, common characteristic point is extracted by algorithm；
According to the characteristic point of extraction, best stitching path is calculated, and produces and spells after two image overlapping regions are deleted
Connect rear image；
Fusion treatment, the building that will be blocked are carried out by the image of large scene image and dead zone after image mosaic
Image is replaced by the image after shelter, forms fused full-view video image.
Further, the system further include:
Video encoding module, for it will splice fused full-view video image coding after, be forwarded in real time client or
It is stored.
Compared with prior art the beneficial effects of the present invention are: the video that the camera arranged on different buildings is obtained
Image is spliced, and according to the characteristic point of acquisition, after image overlapping region is deleted, forms a width full-view video image, will
The video image after partial occlusion object (building, tree etc.) on large scene stitching image is merged with large scene splicing video, is made
Image after shelter (building, tree etc.) is presented in entire video image, ultimately forms aphorama of the width without dead angle, all standing
Frequency monitors, which can intuitively show the entire scene of garden, effectively improve the working efficiency of supervisor.
Detailed description of the invention
Fig. 1 is Panoptic visualization safety defense monitoring system process flow diagram of the present invention.
Specific embodiment
The present invention is described in detail for each embodiment shown in reference to the accompanying drawing, but it should be stated that, these
Embodiment is not limitation of the present invention, those of ordinary skill in the art according to these embodiments made by function, method,
Or equivalent transformation or substitution in structure, all belong to the scope of protection of the present invention within.
Join shown in Fig. 1, present embodiments provide a kind of Panoptic visualization safety defense monitoring system, comprising:
Video code flow obtains module, for obtaining multi-channel video code stream in real time；
Panoramic video splicing module, for multi-channel video to be spliced into a full-view video image.
In the present embodiment, panoramic video splicing module is specifically used for:
In different video images, according to the intersection region of image, common characteristic point is extracted by algorithm；
According to the characteristic point of extraction, best stitching path is calculated, and produces and spells after two image overlapping regions are deleted
Connect rear image；
Fusion treatment, the building that will be blocked are carried out by the image of large scene image and dead zone after image mosaic
Image is replaced by the image after shelter, forms fused full-view video image.
In the present embodiment, the system further include:
Video encoding module, for it will splice fused full-view video image coding after, be forwarded in real time client or
It is stored.
By the Panoptic visualization safety defense monitoring system, a few road video decoded video images are blended, wherein there is screening
The video at the monitoring dead angle under block material (building, tree), is spliced into a width overall situation video image, and will store after compression of images, realizes
No dead angle panoramic video monitoring, so that monitor video has the function of " seeing entirely ", " seeing clearly ", " remembering ", " finding ".
By obtaining video code flow in real time, using state-of-the-art video-splicing and video fusion technology, by splicing, fused panorama
Video compress storage, carries out panorama real-time display, while being able to carry out storage in 7*24 hour, and play back splicing, fused
History video, it is final to realize intelligent, integrated monitoring.
Invention is further described in detail below.
Panoptic visualization safety defense monitoring system uses state-of-the-art video-splicing and video fusion technology, solves superintendent
Member can not take multichannel camera picture into account, and wrong over sight (OS) is seen, is flat the problem of not seeing suddenly, to establish the visual control without dead angle
Platform.The comprehensive advantage for capturing and integrally recording being had based on itself, any merit occurred within the scope of garden can be non-
Often clear backtracking comes out.
Panoptic visualization safety defense monitoring system is developed based on industrial zone, since industrial zone shelter is more, is made
The panoramic video for shooting entire garden with panorama camera is more difficult, and by calculating camera arrangements point, adjust video camera
Angle, after first being completed in garden with software video splicing compared with the video-splicing of large scene, recycle under barrier video with
The augmented reality of large scene video fusion completes monitoring without dead angle for entire garden, solves and directlys adopt hardware shooting
Deficiency.
The system includes:
1. monitoring server software
Server software realizes the function of obtaining video channel information and the real-time code stream of video, while docking algorithms library completion
Decoding, the yuv video splicing, coding of h264 video, final realize h264 video 7*24 hours after splicing fusion coding store,
And it is needed spliced real-time and video recording being transmitted to client according to client.Mainly include following subfunction:
1) hard core control
For the nucleus module of server, it is responsible for the starting of service, controls, listens to connection, module starting, data base administration.
2) circulation hair
It is responsible for forwarding live video stream to application end.
3) video recording storage
It is responsible for for video flowing being stored as the video file of index, can records a video according to video recording planned timing or whole day,
And it can be rolled when disk is filled with and delete oldest video file.
4) panoramic mosaic
By call panoramic mosaic algorithm by the multiple video stream splicings got from monitor supervision platform be a panoramic video.
5) primary flow obtains
It is responsible for obtaining live video stream from monitor supervision platform, is used for panoramic mosaic.
2. image mosaic blending algorithm
Based on the existing campus building in certain garden, 7 road video decoded video images are mutually spliced into fusion, ultimately form one
Width overall situation video image, wherein being the image for monitoring dead angle under shelter (building, tree) comprising partial video.
Its major function has:
1) image characteristic point extracts
In different video images, according to the intersection region of image, common characteristic point is extracted by software algorithm,
It is ready for image mosaic processing later.
2) image mosaic
According to the characteristic point got, best stitching path is calculated, and will be after two image overlapping regions deletions
Image after production splicing.
3) image co-registration
Fusion treatment, the building that will be blocked are carried out by the image of large scene image and dead zone after image mosaic
Image is replaced by the image after shelter, forms fused complete image.
3. encoding and decoding algorithm
The data source that monitoring system provides based on certain garden is realized and simultaneously adds the h264 format video hardware of 7 road 1080P
Speed decoding, and h264 code stream is encoded by spliced 1 road panoramic video yuv data is hardware-accelerated, major function is as follows:
1) it is decoded based on hardware-accelerated video
It will be exported by compressed standard h264 code stream decoding at the yuv data for facilitating subsequent video to show or handle.
2) based on hardware-accelerated Video coding
Yuv data is compressed into the output of standard h264 code stream, subsequent video is facilitated to transmit or store.
4. client
Client is the terminal software for using this system to develop for client, may be mounted at the windows system of mainstream
The end PC, be convenient for client's checking monitoring system real-time video and video.Integrated decoder module etc. is needed simultaneously in order to show.
It mainly includes following functions:
1) displaying live view
After user installation customer service terminal, monitoring server software can be connected in real time, thus after realizing to splicing
The realtime graphic of panoramic video browses.
2) playing back videos
After client can be by network connection to server, by query function of recording a video, the spelling of playback server storage
The history video of panoramic picture after connecing.
The system is mainly turned by video data acquiring front end (video camera), local transmission link, local data processing storage
The composition such as server, management server is sent out, realizes the monitoring management covered to garden without dead angle.
It due to the physical limit of video camera acquisition image f iotaeld-of-view, is extracted based on video image characteristic, and video camera is combined to join
Number, point position, angle and the Different Effects under various natural environments distinguish, carry out large scene image mosaic, including base
In CPU and GPU isomerism parallel framework, large-scale data concurrent processing and ultrahigh resolution real time panoramic fusion treatment are realized,
In include multi-channel video GPU parallel rendering and dynamic piece fusion.
The camera parameters of video, point position, angle need effectively to close with whole panoramic video under shooting barrier
Connection needs to carry out augmented reality processing to barrier, carries out three-dimensional reconstruction.Video and panoramic video under barrier carry out
It when splicing, needs effectively to be merged, multiple video fusions is shown into actual position corresponding in model.
Panoptic visualization safety defense monitoring system provided in this embodiment has the advantages that
1) monitoring content large scene, no dead angle, uninterruptedly.
2 can realize that the fusion of multiple real-time panoramic videos in garden is passed through.
3) high manageability, enhanced scalability, easy upgrading easy to maintain.
4) " digitlization, networking, intelligence " is realized.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er Qie
In the case where without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter
From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power
Benefit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent elements of the claims
Variation is included within the present invention.
Claims (3)
1. a kind of Panoptic visualization safety defense monitoring system characterized by comprising
Video code flow obtains module, for obtaining multi-channel video code stream in real time；
Panoramic video splicing module, for multi-channel video to be spliced into a full-view video image.
2. Panoptic visualization safety defense monitoring system according to claim 1, which is characterized in that the panoramic video splices mould
Block is specifically used for:
In different video images, according to the intersection region of image, common characteristic point is extracted by algorithm；
According to the characteristic point of extraction, best stitching path is calculated, and will be after production splicing after two image overlapping regions deletions
Image；
Fusion treatment, the building object image that will be blocked are carried out by the image of large scene image and dead zone after image mosaic
By the image replacement after shelter, fused full-view video image is formed.
3. Panoptic visualization safety defense monitoring system according to claim 2, which is characterized in that further include:
Video encoding module is forwarded to client or progress for it will splice fused full-view video image coding after in real time
Storage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811514412.1A CN109587410A (en) | 2018-12-12 | 2018-12-12 | Panoptic visualization safety defense monitoring system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811514412.1A CN109587410A (en) | 2018-12-12 | 2018-12-12 | Panoptic visualization safety defense monitoring system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109587410A true CN109587410A (en) | 2019-04-05 |
Family
ID=65929085
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811514412.1A Pending CN109587410A (en) | 2018-12-12 | 2018-12-12 | Panoptic visualization safety defense monitoring system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109587410A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111964650A (en) * | 2020-09-24 | 2020-11-20 | 南昌工程学院 | Underwater target tracking device |
| CN112785835A (en) * | 2019-11-04 | 2021-05-11 | 阿里巴巴集团控股有限公司 | Method and device for acquiring road condition information and vehicle-mounted device |
| CN114639040A (en) * | 2022-03-14 | 2022-06-17 | 哈尔滨博敏科技开发有限公司 | Monitoring video analysis system and method based on Internet of things |
| CN116567166A (en) * | 2023-07-07 | 2023-08-08 | 广东省电信规划设计院有限公司 | Video fusion method and device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103390275A (en) * | 2013-07-19 | 2013-11-13 | 香港应用科技研究院有限公司 | Dynamic image splicing method |
| CN204090039U (en) * | 2014-10-16 | 2015-01-07 | 北京十方慧通科技有限公司 | Integration large scene panoramic video monitoring device |
| CN106056534A (en) * | 2016-05-31 | 2016-10-26 | 中国科学院深圳先进技术研究院 | Obstruction perspective method and device based on smart glasses |
| CN106274686A (en) * | 2016-08-05 | 2017-01-04 | 北京智芯微电子科技有限公司 | A kind of vehicle blind zone rendering method and device |
| CN106454085A (en) * | 2016-09-30 | 2017-02-22 | 维沃移动通信有限公司 | Image processing method and mobile terminal |
| CN108769578A (en) * | 2018-05-17 | 2018-11-06 | 南京理工大学 | A kind of real-time omnidirectional imaging system and method based on multi-path camera |
| CN108989739A (en) * | 2018-07-24 | 2018-12-11 | 上海国茂数字技术有限公司 | A kind of full view system for live broadcast of video conference and method |
-
2018
- 2018-12-12 CN CN201811514412.1A patent/CN109587410A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103390275A (en) * | 2013-07-19 | 2013-11-13 | 香港应用科技研究院有限公司 | Dynamic image splicing method |
| CN204090039U (en) * | 2014-10-16 | 2015-01-07 | 北京十方慧通科技有限公司 | Integration large scene panoramic video monitoring device |
| CN106056534A (en) * | 2016-05-31 | 2016-10-26 | 中国科学院深圳先进技术研究院 | Obstruction perspective method and device based on smart glasses |
| CN106274686A (en) * | 2016-08-05 | 2017-01-04 | 北京智芯微电子科技有限公司 | A kind of vehicle blind zone rendering method and device |
| CN106454085A (en) * | 2016-09-30 | 2017-02-22 | 维沃移动通信有限公司 | Image processing method and mobile terminal |
| CN108769578A (en) * | 2018-05-17 | 2018-11-06 | 南京理工大学 | A kind of real-time omnidirectional imaging system and method based on multi-path camera |
| CN108989739A (en) * | 2018-07-24 | 2018-12-11 | 上海国茂数字技术有限公司 | A kind of full view system for live broadcast of video conference and method |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112785835A (en) * | 2019-11-04 | 2021-05-11 | 阿里巴巴集团控股有限公司 | Method and device for acquiring road condition information and vehicle-mounted device |
| CN111964650A (en) * | 2020-09-24 | 2020-11-20 | 南昌工程学院 | Underwater target tracking device |
| CN114639040A (en) * | 2022-03-14 | 2022-06-17 | 哈尔滨博敏科技开发有限公司 | Monitoring video analysis system and method based on Internet of things |
| CN114639040B (en) * | 2022-03-14 | 2023-01-17 | 广东正艺技术有限公司 | Monitoring video analysis system and method based on Internet of things |
| CN116567166A (en) * | 2023-07-07 | 2023-08-08 | 广东省电信规划设计院有限公司 | Video fusion method and device, electronic equipment and storage medium |
| CN116567166B (en) * | 2023-07-07 | 2023-10-17 | 广东省电信规划设计院有限公司 | Video fusion method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109587410A (en) | Panoptic visualization safety defense monitoring system | |
| CN108648257B (en) | Panoramic picture acquisition method and device, storage medium and electronic device | |
| US11706403B2 (en) | Positional zero latency | |
| CN106331645B (en) | The method and system of VR panoramic video later stage compilation is realized using virtual lens | |
| CN107426491B (en) | Implementation method of 360-degree panoramic video | |
| CN106658011A (en) | Panoramic video coding and decoding methods and devices | |
| CN106550239A (en) | 360 degree of panoramic video live broadcast systems and its implementation | |
| CN106789991A (en) | A kind of multi-person interactive method and system based on virtual scene | |
| CN106101741A (en) | Internet video live broadcasting platform is watched the method and system of panoramic video | |
| US20160037068A1 (en) | System and method of stitching together video streams to generate a wide field video stream | |
| US11625864B2 (en) | Compression of dynamic unstructured point clouds | |
| CN106792150B (en) | A kind of poster generation method and device | |
| CN102547212A (en) | Splicing method of multiple paths of video images | |
| EP3434021B1 (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
| CN110536164A (en) | Display method, video data processing method and related equipment | |
| CN108243318B (en) | Method and device for realizing live broadcast of multiple image acquisition devices through single interface | |
| CN105847672A (en) | Virtual reality helmet snapshotting method and system | |
| US20170221174A1 (en) | Gpu data sniffing and 3d streaming system and method | |
| CN202721763U (en) | Panoramic video acquisition device | |
| CN108243345A (en) | A kind of video stream pushing method | |
| CN114598919A (en) | Video processing method, video processing device, computer equipment and storage medium | |
| JP7054351B2 (en) | System to play replay video of free viewpoint video | |
| CN206117889U (en) | 720 degrees panorama collection system in two meshes | |
| US11706375B2 (en) | Apparatus and system for virtual camera configuration and selection | |
| CN113573079B (en) | Method for realizing free visual angle live broadcast mode |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190405 |
|
| RJ01 | Rejection of invention patent application after publication |