CN111163286A - Panoramic monitoring system based on mixed reality and video intelligent analysis technology - Google Patents
Panoramic monitoring system based on mixed reality and video intelligent analysis technology Download PDFInfo
- Publication number
- CN111163286A CN111163286A CN201811326973.9A CN201811326973A CN111163286A CN 111163286 A CN111163286 A CN 111163286A CN 201811326973 A CN201811326973 A CN 201811326973A CN 111163286 A CN111163286 A CN 111163286A
- Authority
- CN
- China
- Prior art keywords
- video
- dimensional
- videos
- area
- historical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/53—Recognition of crowd images, e.g. recognition of crowd congestion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention relates to a panoramic monitoring system based on mixed reality and video intelligent analysis technology, which realizes overall situation control and detail target staring control through real-time fusion of a three-dimensional model and video monitoring, comprises a 4-platform large platform including three-dimensional video fusion, two-dimensional panoramic stitching, historical video backtracking and three-dimensional plan deployment, and mainly has the functions of panoramic monitoring, height association, gun and ball linkage, crowd density analysis, border crossing alarm, three-dimensional plan deployment and historical video backtracking.
Description
Technical Field
The invention relates to the technical field of video monitoring, in particular to a panoramic monitoring system based on mixed reality and video intelligent analysis technology.
Background
The video monitoring is a detection mode for discovering and fixing crime clues and evidences by the public security organization according to national laws and regulations by applying various video devices and technologies, plays an irreplaceable role in detecting and solving cases, and improves the crime fighting capability and level of the public security organization. However, with the increasing number of video monitoring and the development of new technology, the problems of repeated construction, dispersed and isolated videos, incapability of quickly correlating the videos, low intelligent application degree and the like exist in the video monitoring construction process, and great difficulty is brought to reconnaissance and solution solving.
Disclosure of Invention
The invention aims to solve the problems of incomplete visual monitoring, incomprehensible visual monitoring, difficult early warning and difficult retrieval in the current security work, and provides a panoramic monitoring system based on mixed reality and video intelligent analysis technology, which can realize accurate early warning in advance, timely treatment in the process and backtracking in the whole process after the process.
The technical scheme of the invention is as follows:
the utility model provides a panorama monitored control system based on mixed reality and video intelligent analysis technique which characterized in that: including 4 big platforms of three-dimensional video fusion, two-dimensional panorama concatenation, historical video backtracking and three-dimensional scheme deployment, wherein:
three-dimensional video fusion, namely completing full coverage of the video of a key area through a high-point camera, calculating camera parameters by a video checking system and seamlessly attaching the camera parameters to a three-dimensional model to realize three-dimensional live-action fusion display; when the important area is wide in range, splicing and fusing the multiple cameras and the three-dimensional model to complete the full-space coverage of the area; the low-point videos in the key area and the three-dimensional real scenes are associated, an operator randomly selects an area to be monitored in the panoramic video, and the system automatically calls the surrounding low-point videos to realize omnibearing and multi-angle viewing of video details;
the method comprises the following steps of two-dimensional panoramic stitching, namely combining a two-dimensional electronic map with a three-dimensional model to realize the correlated display of the position of a camera, a coverage area and the position of a current observation point in a three-dimensional scene and a two-dimensional map, so that a commander can quickly master the video distribution condition around a key area;
historical video backtracking, namely, simultaneously storing videos, spatial position information of a three-dimensional model and three-dimensionally processed video information in a related manner while adopting a traditional video monitoring storage mode to store one-way videos, and storing the videos, the spatial position information of the three-dimensional model and the three-dimensionally processed video information as a basis for historical video backtracking in a three-dimensional real scene, wherein the historical videos are stored by a video block storage technology, so that the backtracking and checking of the historical videos in any time period can be realized, a video reverse broadcasting function is supported, and the case analysis and the alert condition research and judgment work can be efficiently supported;
the three-dimensional plan deployment is used for managing the video patrol route, supporting manual setting of patrol point positions and automatic planning of a traversal route, and meanwhile, the system can store the set cruise route and set a video cruise schedule so as to realize multiple-time and multi-period total-space patrol; the system monitors important targets in the interest area, and performs amplification display and real-time automatic tracking staring control through a high-point dome camera; and carrying out intelligent analysis on the video coverage area, completing the statistics of the pedestrian flow and crowd density analysis, and carrying out threshold value alarm when the pedestrian flow density is too high.
The invention realizes the three-dimensional live-action enhanced fusion of scattered monitoring videos and a three-dimensional environment based on mixed reality and video intelligent analysis technology, realizes accurate early warning in advance, timely emergency treatment in the process and backtracking in the whole process after the process, fundamentally breaks through the limitation that the traditional videos are scattered and isolated and the whole situation cannot be mastered, and greatly improves the practical application efficiency of a video image monitoring system.
Drawings
FIG. 1 is a system block diagram of the present invention.
Detailed Description
As shown in fig. 1, the invention is based on Geographic Information (GIS), video intelligent analysis and video fusion technology, achieves real-time fusion of a three-dimensional model and video monitoring, realizes overall situation control and detail target staring control in an important area, comprises a 4-platform large platform including three-dimensional video fusion, two-dimensional panoramic stitching, historical video backtracking and three-dimensional plan deployment, and mainly has the main functions of panoramic monitoring, height association, gun-ball linkage, crowd density analysis, border-crossing alarm, three-dimensional plan deployment, historical video backtracking and the like.
(1) And (3) three-dimensional live-action fusion display: the high-point camera completes full coverage of the video of the key area, the video checking system calculates camera parameters and is in seamless fit with the three-dimensional model, and three-dimensional live-action fusion display is achieved.
(2) And (3) three-dimensional full-space fusion display: when the important area is wide in range, the multi-path camera and the three-dimensional model are spliced and fused to complete the full-space coverage of the area.
(3) High-low video related display: the low-point videos in the key areas and the three-dimensional real scenes are associated, an operator randomly selects areas needing to be monitored in the panoramic videos, and the system automatically calls the surrounding low-point videos to realize omnibearing and multi-angle video detail checking.
(4) Gun and ball collaborative association display: and the interest target is clicked in the panoramic video, the high-speed nodding machine can automatically turn to the interest target and perform angle and zoom adjustment, the overall situation of the panoramic video is controlled, and the high-speed nodding machine performs detail checking.
(5) Three-dimensional live-action area cruising: the three-dimensional live-action cruise is based on the three-dimensional model, automatic roaming cruise, full-coverage cruise and multi-azimuth cruise of point, line and plane are realized, and the viewing efficiency of operators and the utilization rate of the camera are improved.
(6) Full-space interactive correlation display: the full-space interactive associated display combines the two-dimensional electronic map and the three-dimensional model, so that the position, the coverage area and the position of the current observation point of the camera are associated and displayed in the three-dimensional scene and the two-dimensional map, and a commander can quickly master the video distribution condition around the key area.
(7) Visual management of camera information: the system realizes real point location marking of the monitoring camera on the three-dimensional model, displays the view angle direction and the video coverage range of the camera, associates the camera related information such as ID information and performance parameters of the camera with the camera in the three-dimensional model, and supports modes such as mouse hovering viewing and information bar viewing.
(8) Managing the full-space historical video: the system stores the single-path video by adopting a traditional video monitoring storage mode, and simultaneously stores the spatial position information of the video and the three-dimensional model and the three-dimensionally processed video information in an associated manner to serve as the basis for backtracking of the historical video under the three-dimensional real scene.
(9) Managing a total space patrol path: the system manages the video patrol route, supports manual setting of patrol points and automatic planning of a traversal route, and can store the set cruise route and set a video cruise schedule so as to realize multiple-time and multi-period full-space patrol.
(10) Continuously tracking the target: the system monitors important targets in the interest area, and performs amplification display and real-time automatic tracking staring control through a high-point dome camera.
(11) Analyzing the population density: the system intelligently analyzes the video coverage area, completes the statistics of the pedestrian flow and the crowd density analysis, and gives an alarm by the threshold value when the pedestrian flow density is too high.
(12) Monitoring regional invasion: the system supports the definition of the warning area, and when the moving target enters or leaves the warning area beyond the boundary, the system gives an early warning.
(13) The full-space historical video backtracking function comprises the following steps: the historical video is stored through a video block storage technology, so that backtracking and viewing of the historical video in any time period can be realized, a video reverse broadcasting function is supported, and case analysis and alarm situation research and judgment work can be efficiently supported.
Claims (1)
1. The utility model provides a panorama monitored control system based on mixed reality and video intelligent analysis technique which characterized in that: including 4 big platforms of three-dimensional video fusion, two-dimensional panorama concatenation, historical video backtracking and three-dimensional scheme deployment, wherein:
three-dimensional video fusion, namely completing full coverage of the video of a key area through a high-point camera, calculating camera parameters by a video checking system and seamlessly attaching the camera parameters to a three-dimensional model to realize three-dimensional live-action fusion display; when the important area is wide in range, splicing and fusing the multiple cameras and the three-dimensional model to complete the full-space coverage of the area; the low-point videos in the key area and the three-dimensional real scenes are associated, an operator randomly selects an area to be monitored in the panoramic video, and the system automatically calls the surrounding low-point videos to realize omnibearing and multi-angle viewing of video details;
the method comprises the following steps of two-dimensional panoramic stitching, namely combining a two-dimensional electronic map with a three-dimensional model to realize the correlated display of the position of a camera, a coverage area and the position of a current observation point in a three-dimensional scene and a two-dimensional map, so that a commander can quickly master the video distribution condition around a key area;
historical video backtracking, namely, simultaneously storing videos, spatial position information of a three-dimensional model and three-dimensionally processed video information in a related manner while adopting a traditional video monitoring storage mode to store one-way videos, and storing the videos, the spatial position information of the three-dimensional model and the three-dimensionally processed video information as a basis for historical video backtracking in a three-dimensional real scene, wherein the historical videos are stored by a video block storage technology, so that the backtracking and checking of the historical videos in any time period can be realized, a video reverse broadcasting function is supported, and the case analysis and the alert condition research and judgment work can be efficiently supported;
the three-dimensional plan deployment is used for managing the video patrol route, supporting manual setting of patrol point positions and automatic planning of a traversal route, and meanwhile, the system can store the set cruise route and set a video cruise schedule so as to realize multiple-time and multi-period total-space patrol; the system monitors important targets in the interest area, and performs amplification display and real-time automatic tracking staring control through a high-point dome camera; and carrying out intelligent analysis on the video coverage area, completing the statistics of the pedestrian flow and crowd density analysis, and carrying out threshold value alarm when the pedestrian flow density is too high.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811326973.9A CN111163286A (en) | 2018-11-08 | 2018-11-08 | Panoramic monitoring system based on mixed reality and video intelligent analysis technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811326973.9A CN111163286A (en) | 2018-11-08 | 2018-11-08 | Panoramic monitoring system based on mixed reality and video intelligent analysis technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111163286A true CN111163286A (en) | 2020-05-15 |
Family
ID=70555123
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811326973.9A Pending CN111163286A (en) | 2018-11-08 | 2018-11-08 | Panoramic monitoring system based on mixed reality and video intelligent analysis technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111163286A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111665945A (en) * | 2020-06-10 | 2020-09-15 | 浙江商汤科技开发有限公司 | Tour information display method and device |
| CN112216049A (en) * | 2020-09-25 | 2021-01-12 | 交通运输部公路科学研究所 | Construction warning area monitoring and early warning system and method based on image recognition |
| CN112367507A (en) * | 2020-11-02 | 2021-02-12 | 内蒙古瑞特优化科技股份有限公司 | Full-time-space video enhancement management and control system based on 3D live-action model |
| CN112383754A (en) * | 2020-11-12 | 2021-02-19 | 珠海大横琴科技发展有限公司 | Monitoring method and device for early warning object, electronic equipment and storage medium |
| CN112449093A (en) * | 2020-11-05 | 2021-03-05 | 北京德火科技有限责任公司 | Three-dimensional panoramic video fusion monitoring platform |
| CN112954234A (en) * | 2021-01-28 | 2021-06-11 | 天翼物联科技有限公司 | Method, system, device and medium for multi-video fusion |
| CN114356096A (en) * | 2022-01-10 | 2022-04-15 | 深圳职业技术学院 | XR (X-ray diffraction) technology-based new-dimension space construction method, system and platform |
-
2018
- 2018-11-08 CN CN201811326973.9A patent/CN111163286A/en active Pending
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111665945A (en) * | 2020-06-10 | 2020-09-15 | 浙江商汤科技开发有限公司 | Tour information display method and device |
| CN111665945B (en) * | 2020-06-10 | 2023-11-24 | 浙江商汤科技开发有限公司 | Tour information display method and device |
| CN112216049A (en) * | 2020-09-25 | 2021-01-12 | 交通运输部公路科学研究所 | Construction warning area monitoring and early warning system and method based on image recognition |
| CN112367507A (en) * | 2020-11-02 | 2021-02-12 | 内蒙古瑞特优化科技股份有限公司 | Full-time-space video enhancement management and control system based on 3D live-action model |
| CN112449093A (en) * | 2020-11-05 | 2021-03-05 | 北京德火科技有限责任公司 | Three-dimensional panoramic video fusion monitoring platform |
| CN112383754A (en) * | 2020-11-12 | 2021-02-19 | 珠海大横琴科技发展有限公司 | Monitoring method and device for early warning object, electronic equipment and storage medium |
| CN112383754B (en) * | 2020-11-12 | 2022-02-18 | 珠海大横琴科技发展有限公司 | Monitoring method and device for early warning object, electronic equipment and storage medium |
| CN112954234A (en) * | 2021-01-28 | 2021-06-11 | 天翼物联科技有限公司 | Method, system, device and medium for multi-video fusion |
| CN114356096A (en) * | 2022-01-10 | 2022-04-15 | 深圳职业技术学院 | XR (X-ray diffraction) technology-based new-dimension space construction method, system and platform |
| CN114356096B (en) * | 2022-01-10 | 2022-09-02 | 深圳职业技术学院 | XR (X-ray diffraction) technology-based new-dimension space construction method, system and platform |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111163286A (en) | Panoramic monitoring system based on mixed reality and video intelligent analysis technology | |
| CN109064755B (en) | Path identification method based on four-dimensional real-scene traffic simulation road condition perception management system | |
| CN108965825B (en) | Video linkage scheduling method based on holographic position map | |
| CN109714563A (en) | A kind of overall view monitoring system based on critical position | |
| CN106327875B (en) | Traffic video monitoring management control system | |
| CN103295396B (en) | Speedy ex-situ evidence collection of traffic accident method and system | |
| CN103795976B (en) | A kind of full-time empty 3 d visualization method | |
| CN109640032A (en) | Based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence | |
| CN109333504A (en) | A kind of patrol robot and patrol robot management system | |
| US20050024206A1 (en) | Method and apparatus for providing a scalable multi-camera distributed video processing and visualization surveillance system | |
| CN112449093A (en) | Three-dimensional panoramic video fusion monitoring platform | |
| AU2015360251A1 (en) | Systems and methods for displaying wind characteristics and effects within a broadcast | |
| WO2018081670A4 (en) | Video data and gis mapping for traffic monitoring, event detection and change prediction | |
| CN111586351A (en) | Visual monitoring system and method for fusion of three-dimensional videos of venue | |
| CN104410834A (en) | Intelligent switching method for teaching videos | |
| US20170366867A1 (en) | Systems and methods for displaying thermographic characteristics within a broadcast | |
| CN107197209A (en) | The dynamic method for managing and monitoring of video based on panorama camera | |
| CN104363427A (en) | Full-live-action video intelligent monitoring system | |
| KR102107189B1 (en) | System and method for maintenance history and state management of facilities of subway station onto 3D screen | |
| AU2014202889A1 (en) | Controlling movement of a camera to autonomously track a mobile object | |
| CN105245852A (en) | Video monitoring method | |
| CN110874866A (en) | Transformer substation three-dimensional monitoring method and system based on videos | |
| CN104469303A (en) | Intelligent switching method of teaching video | |
| US11758238B2 (en) | Systems and methods for displaying wind characteristics and effects within a broadcast | |
| CN113905211B (en) | Video patrol method, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200515 |