CN107659786A - A kind of panoramic video monitoring device and processing method - Google Patents
A kind of panoramic video monitoring device and processing method Download PDFInfo
- Publication number
- CN107659786A CN107659786A CN201710871677.6A CN201710871677A CN107659786A CN 107659786 A CN107659786 A CN 107659786A CN 201710871677 A CN201710871677 A CN 201710871677A CN 107659786 A CN107659786 A CN 107659786A
- Authority
- CN
- China
- Prior art keywords
- video
- panoramic
- image
- projection face
- video image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012806 monitoring device Methods 0.000 title claims abstract description 11
- 238000003672 processing method Methods 0.000 title claims description 9
- 238000013507 mapping Methods 0.000 claims abstract description 14
- 230000004927 fusion Effects 0.000 claims abstract description 7
- 230000009466 transformation Effects 0.000 claims abstract description 7
- 238000012544 monitoring process Methods 0.000 description 7
- 230000000007 visual effect Effects 0.000 description 7
- 241000251468 Actinopterygii Species 0.000 description 1
- 244000027321 Lychnis chalcedonica Species 0.000 description 1
- 235000017899 Spathodea campanulata Nutrition 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
A kind of panoramic video monitoring device, operate below computing device：Step 1,4 road real-time video sequences are obtained, confirm whether image is complete in each sequence；Step 2, judges whether the video image in any two-path video sequence in the same time meets image mosaic condition, confirms the overlapping region in its existence range；Step 3,4 road real-time video sequences are cut into default shape；Step 4, panoramic projection face is determined, and the video image in 4 road real-time video sequences is mapped into panoramic projection face；Step 5, the pixel and the mapping table of panoramic projection established on video image, the pixel of the same data line of video image is set to be distributed in the multirow coordinate points in panoramic projection face, and according to inverse transformation of the video image to panoramic projection face and mapping table, calculate the pixel value of all coordinate points in real time panoramic perspective plane；Step 6, the pixel of all coordinate points on fusion treatment panoramic projection face, and full-view video image is exported according to pixel value.
Description
Technical field
The invention belongs to technical field of video monitoring, more particularly to a kind of panoramic video monitoring device and processing method.
Background technology
In today of monitoring system high speed development, the appearance of high-definition camera compares traditional video camera with many excellent
Gesture, such as fine and smooth details performance, the wider camera lens visual field etc..But have new demand again now for monitoring, people,
The video monitoring of i.e. broader panorama type, monitoring personnel can be allowed to see more contents in same scene.
At present, the video camera based on CMOS and CCD has different focal lengths, for example 2.8mm, 3.6mm, or with zoom
2.8-12mm, the focal length of even more big multiple.Different focal lengths will obtain the different angles of visual field, but the size of these angles of visual field
The monitoring to horizontal 180 degree scope can not all be met.Therefore, existing way is to use wide-angle fish eye lens, can be connect
The angle of visual field of nearly 180 degree, but there is also corresponding shortcoming：
1. the pattern distortion on periphery is serious；
2. the angle of visual field fails the panorama covering for truly reaching 180 degree.
At this moment, if in a regional deployment multichannel video camera, in the hope of in back-end realization overall view monitoring again, then be faced with
Following shortcoming：
1. the image do not gone the same way has intersection, visual perception's effect is poor；
2. the image do not gone the same way might have gap, fail to cover panorama；
3. the image of intersection can waste memory space.
Also a kind of scheme is, in a regional deployment fire ball, allows its scanning of cruising back and forth.There is certain for this scheme
Live preview can not be realized in a little visuals field, remembers the shortcomings that some visuals field can't see.
The content of the invention
The present invention provides a kind of panoramic video monitoring device, it is therefore intended that solution multiway images redundancy occur when integrated and asked
Topic, it is seamless spliced to realize that multi-channel video is done, and to reach the panorama preview of 180 degree, lifts Consumer's Experience.
A kind of panoramic video monitoring device, the device include 4 tight shots for shooting 4 different angles respectively, and 4
The individual cmos image sensor coordinated with the tight shot, forms 4 road real-time video sequences,
The panoramic video monitoring device includes memory；And
It is coupled to the processor of the memory, the processor is configured as performing the finger being stored in the memory
Make, operated below the computing device：
Step 1,4 road real-time video sequences are obtained, confirm whether image is complete in each sequence；
Step 2, judges whether the video image in any two-path video sequence in the same time meets image mosaic condition, really
The overlapping region recognized in its existence range；
Step 3,4 road real-time video sequences are cut into default shape；
Step 4, panoramic projection face is determined, and the video image in 4 road real-time video sequences is mapped into panoramic projection
Face；
Step 5, the pixel and the mapping table of panoramic projection established on video image, make the same line number of video image
According to pixel be distributed in the multirow coordinate points in panoramic projection face, and according to video image to the inverse transformation in panoramic projection face and
Mapping table, calculate the pixel value of all coordinate points in real time panoramic perspective plane；
Step 6, the pixel of all coordinate points on fusion treatment panoramic projection face, and panoramic video is exported according to pixel value
Image.
A kind of panoramic video processing method, shoot the tight shot of 4 different angles, and 4 and institute respectively using 4
The cmos image sensor of tight shot cooperation is stated, forms 4 road real-time video sequences,
Panoramic video processing method comprises the following steps：
Step 1,4 road real-time video sequences are obtained, confirm whether image is complete in each sequence；
Step 2, judges whether the video image in any two-path video sequence in the same time meets image mosaic condition, really
The overlapping region recognized in its existence range；
Step 3,4 road real-time video sequences are cut into default shape；
Step 4, panoramic projection face is determined, and the video image in 4 road real-time video sequences is mapped into panoramic projection
Face；
Step 5, the pixel and the mapping table of panoramic projection established on video image, make the same line number of video image
According to pixel be distributed in the multirow coordinate points in panoramic projection face, and according to video image to the inverse transformation in panoramic projection face and
Mapping table, calculate the pixel value of all coordinate points in real time panoramic perspective plane；
Step 6, the pixel of all coordinate points on fusion treatment panoramic projection face, and panoramic video is exported according to pixel value
Image.
During multichannel video camera is integrated into all the way by the present invention, and video-splicing treatment technology is utilized, be processed into all the way
Real time panoramic preview image.User installation is got up convenient and swift, and can obtain high-resolution panoramic video preview experience, this is
System processing is quick, efficient, effectively reduces the time delay of video preview, effectively realizes the seamless spliced of multi-channel video.
Embodiment
The panoramic video monitoring device of the present invention, the device include 4 tight shots for shooting 4 different angles respectively,
And 4 cmos image sensors coordinated with the tight shot, form 4 road real-time video sequences.
The panoramic video monitoring device includes memory；And
It is coupled to the processor of the memory, the processor is configured as performing the finger being stored in the memory
Make, operated below the computing device：
Step 1,4 road real-time video sequences are obtained, confirm whether image is complete in each sequence；
Step 2, judges whether the video image in any two-path video sequence in the same time meets image mosaic condition, really
The overlapping region recognized in its existence range；
Step 3,4 road real-time video sequences are cut into default shape；
Step 4, panoramic projection face is determined, and the video image in 4 road real-time video sequences is mapped into panoramic projection
Face；
Step 5, the pixel and the mapping table of panoramic projection established on video image, make the same line number of video image
According to pixel be distributed in the multirow coordinate points in panoramic projection face, and according to video image to the inverse transformation in panoramic projection face and
Mapping table, calculate the pixel value of all coordinate points in real time panoramic perspective plane；
Step 6, the pixel of all coordinate points on fusion treatment panoramic projection face, and panoramic video is exported according to pixel value
Image.
The panoramic video processing method of the present invention, shoot the tight shot of 4 different angles, and 4 respectively using 4
The cmos image sensor coordinated with the tight shot, form 4 road real-time video sequences.
Panoramic video processing method comprises the following steps：
Step 1,4 road real-time video sequences are obtained, confirm whether image is complete in each sequence；
Step 2, judges whether the video image in any two-path video sequence in the same time meets image mosaic condition, really
The overlapping region recognized in its existence range；
Step 3,4 road real-time video sequences are cut into default shape；
Step 4, panoramic projection face is determined, and the video image in 4 road real-time video sequences is mapped into panoramic projection
Face；
Step 5, the pixel and the mapping table of panoramic projection established on video image, make the same line number of video image
According to pixel be distributed in the multirow coordinate points in panoramic projection face, and according to video image to the inverse transformation in panoramic projection face and
Mapping table, calculate the pixel value of all coordinate points in real time panoramic perspective plane；
Step 6, the pixel of all coordinate points on fusion treatment panoramic projection face, and panoramic video is exported according to pixel value
Image.
What deserves to be explained is although foregoing teachings describe the essence of the invention by reference to some embodiments
God and principle, it should be appreciated that, the present invention is not limited to disclosed embodiment, the also unawareness of the division to each side
The feature that taste in these aspects can not combine, and this division is merely to the convenience of statement.It is contemplated that cover appended power
Included various modifications and equivalent arrangements in the spirit and scope that profit requires.
Claims (2)
1. a kind of panoramic video monitoring device, it is characterised in that the device includes 4 and shoots focusing for 4 different angles respectively
Camera lens, and 4 cmos image sensors coordinated with the tight shot, form 4 road real-time video sequences,
The panoramic video monitoring device includes memory；And
It is coupled to the processor of the memory, the processor is configured as performing the instruction being stored in the memory, institute
State and operated below computing device：
Step 1,4 road real-time video sequences are obtained, confirm whether image is complete in each sequence；
Step 2, judges whether the video image in any two-path video sequence in the same time meets image mosaic condition, confirms it
Overlapping region in existence range；
Step 3,4 road real-time video sequences are cut into default shape；
Step 4, panoramic projection face is determined, and the video image in 4 road real-time video sequences is mapped into panoramic projection face；
Step 5, the pixel and the mapping table of panoramic projection established on video image, make the same data line of video image
Pixel is distributed in the multirow coordinate points in panoramic projection face, and according to the inverse transformation and mapping of video image to panoramic projection face
Table, calculate the pixel value of all coordinate points in real time panoramic perspective plane；
Step 6, the pixel of all coordinate points on fusion treatment panoramic projection face, and full-view video image is exported according to pixel value.
A kind of 2. panoramic video processing method, it is characterised in that shoot the tight shot of 4 different angles respectively using 4, with
And 4 cmos image sensors coordinated with the tight shot, 4 road real-time video sequences are formed,
Panoramic video processing method comprises the following steps：
Step 1,4 road real-time video sequences are obtained, confirm whether image is complete in each sequence；
Step 2, judges whether the video image in any two-path video sequence in the same time meets image mosaic condition, confirms it
Overlapping region in existence range；
Step 3,4 road real-time video sequences are cut into default shape；
Step 4, panoramic projection face is determined, and the video image in 4 road real-time video sequences is mapped into panoramic projection face；
Step 5, the pixel and the mapping table of panoramic projection established on video image, make the same data line of video image
Pixel is distributed in the multirow coordinate points in panoramic projection face, and according to the inverse transformation and mapping of video image to panoramic projection face
Table, calculate the pixel value of all coordinate points in real time panoramic perspective plane；
Step 6, the pixel of all coordinate points on fusion treatment panoramic projection face, and full-view video image is exported according to pixel value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710871677.6A CN107659786A (en) | 2017-09-25 | 2017-09-25 | A kind of panoramic video monitoring device and processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710871677.6A CN107659786A (en) | 2017-09-25 | 2017-09-25 | A kind of panoramic video monitoring device and processing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107659786A true CN107659786A (en) | 2018-02-02 |
Family
ID=61131177
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710871677.6A Pending CN107659786A (en) | 2017-09-25 | 2017-09-25 | A kind of panoramic video monitoring device and processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107659786A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108495005A (en) * | 2018-04-11 | 2018-09-04 | 江苏安威士智能安防有限公司 | The system and method that the panoramic video of multi-path high-definition camera shooting splicing is handled in real time |
| CN112381713A (en) * | 2020-10-30 | 2021-02-19 | 地平线征程(杭州)人工智能科技有限公司 | Image splicing method and device, computer readable storage medium and electronic equipment |
| CN112637551A (en) * | 2020-11-18 | 2021-04-09 | 合肥市卓迩无人机科技服务有限责任公司 | Panoramic data management software system for multi-path 4K quasi-real-time spliced videos |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101895693A (en) * | 2010-06-07 | 2010-11-24 | 北京高森明晨信息科技有限公司 | Method and device for generating panoramic image |
| CN103763479A (en) * | 2013-12-31 | 2014-04-30 | 深圳英飞拓科技股份有限公司 | Splicing device for real-time high speed high definition panoramic video and method thereof |
| CN105376530A (en) * | 2015-10-27 | 2016-03-02 | 南京泓众电子科技有限公司 | Panorama video image generation device based on fixed position |
-
2017
- 2017-09-25 CN CN201710871677.6A patent/CN107659786A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101895693A (en) * | 2010-06-07 | 2010-11-24 | 北京高森明晨信息科技有限公司 | Method and device for generating panoramic image |
| CN103763479A (en) * | 2013-12-31 | 2014-04-30 | 深圳英飞拓科技股份有限公司 | Splicing device for real-time high speed high definition panoramic video and method thereof |
| CN105376530A (en) * | 2015-10-27 | 2016-03-02 | 南京泓众电子科技有限公司 | Panorama video image generation device based on fixed position |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108495005A (en) * | 2018-04-11 | 2018-09-04 | 江苏安威士智能安防有限公司 | The system and method that the panoramic video of multi-path high-definition camera shooting splicing is handled in real time |
| CN112381713A (en) * | 2020-10-30 | 2021-02-19 | 地平线征程(杭州)人工智能科技有限公司 | Image splicing method and device, computer readable storage medium and electronic equipment |
| CN112381713B (en) * | 2020-10-30 | 2024-01-26 | 地平线征程(杭州)人工智能科技有限公司 | Image stitching method and device, computer readable storage medium and electronic equipment |
| CN112637551A (en) * | 2020-11-18 | 2021-04-09 | 合肥市卓迩无人机科技服务有限责任公司 | Panoramic data management software system for multi-path 4K quasi-real-time spliced videos |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7015954B1 (en) | Automatic video system using multiple cameras | |
| CN104580882B (en) | The method and its device taken pictures | |
| US8004558B2 (en) | Stereoscopic wide field of view imaging system | |
| KR20150068299A (en) | Method and system of generating images for multi-surface display | |
| WO2011107448A2 (en) | Object detection and rendering for wide field of view (wfov) image acquisition systems | |
| JP2006039564A (en) | Camera system and panoramic camera system | |
| SG176327A1 (en) | A system and method of image processing | |
| CN102722080A (en) | Multifunctional three-dimensional shooting method based on multiple-lens shooting | |
| US10057487B1 (en) | Panoramic imaging systems based on normal-lens cameras | |
| CN106603912A (en) | Video live broadcast control method and device | |
| KR102073206B1 (en) | Imaging system, method, and applications | |
| CN107659786A (en) | A kind of panoramic video monitoring device and processing method | |
| US20140192033A1 (en) | 3d image apparatus and method for displaying images | |
| CN106023073A (en) | Image splicing system | |
| JP2010181826A (en) | Three-dimensional image forming apparatus | |
| CN204168378U (en) | A kind of panoramic shooting system | |
| US9098910B2 (en) | Method for generating video data stream | |
| CN105139336A (en) | Method for converting multichannel panorama images into dome-screen fish-eye movie | |
| CN108632563A (en) | Dynamic visual telephone system and its application method | |
| CN107450265A (en) | Light field panorama camera | |
| CN108234904B (en) | Multi-video fusion method, device and system | |
| TWI504936B (en) | Image processing device | |
| JP2017050819A (en) | Generation device for panoramic image data, generation method and program | |
| CN209046727U (en) | The panoramic video real time processing system of multi-path high-definition camera shooting splicing | |
| WO2017092261A1 (en) | Camera module, mobile terminal, and image shooting method and apparatus therefor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180202 |
|
| RJ01 | Rejection of invention patent application after publication |