CN107124586A - Camera intelligent screening system - Google Patents
Camera intelligent screening system Download PDFInfo
- Publication number
- CN107124586A CN107124586A CN201710310943.8A CN201710310943A CN107124586A CN 107124586 A CN107124586 A CN 107124586A CN 201710310943 A CN201710310943 A CN 201710310943A CN 107124586 A CN107124586 A CN 107124586A
- Authority
- CN
- China
- Prior art keywords
- module
- core processor
- camera
- high speed
- hardware accelerator
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012216 screening Methods 0.000 title claims abstract description 14
- 238000012545 processing Methods 0.000 claims abstract description 11
- 230000005540 biological transmission Effects 0.000 claims description 8
- 238000005728 strengthening Methods 0.000 abstract description 2
- 238000000034 method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 239000006002 Pepper Substances 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000011946 reduction process Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a kind of camera intelligent screening system, it includes：Power module, camera acquisition module, core processor, hardware accelerator, image enhancement module, high speed memory modules, transport module.Core processor is responsible for being screened the video data collected at camera acquisition module by default parameter, hardware accelerator module is responsible for optimizing core processor processing speed, image enhancement module is shown for strengthening image vision, high speed memory modules are used to deposit substantial amounts of video data, finally by transport module, it is transferred on Ethernet or display.The present invention realizes one kind and directly carries out video requency frame data screening, and transmit to Ethernet or be directly used in the camera intelligent screening system of display at a high speed in shooting head end.
Description
Technical field
The present invention relates to embedded system, Video processing, hardware-accelerated technical field, especially a kind of camera is intelligently sieved
Select system.
Background technology
Camera is as contemporary most common video frequency output source, and because of its high resolution, time delay is low, it is easy to the features such as operating,
Widely used.With the development of science and technology, the resolution ratio of camera can be gradually stepped up, more high definition, higher resolution are regarded
Frequency evidence also popularizes our life at last.
High-resolution video data just brings HD video and stores this problem, and HD video is stored in many fields
All it is an inevitable link, such as remote monitoring, experimental record.But with the continuous lifting of video resolution,
The total amount of redundancy is also improved constantly therewith, and the real video content interested of people may only account for total video capacity
10%, but occupy substantial amounts of storage resource.Particularly when needing to search for key message from this substantial amounts of video, no
But need to expend extra manpower and substantial amounts of time, the precision simultaneously scanned for is also far from reaching guarantee.
The content of the invention
A kind of camera intelligent screening system that the purpose of the present invention is in view of the shortcomings of the prior art and provided, the system
It compensate for traditional camera transmission data and not only take substantial amounts of channel resource, while needing a large amount of storage resources in receiving terminal
Deposit these data, and the real few situation of valuable information in these data, realize the efficient biography of camera data
The intelligent screening of defeated and data.
The object of the present invention is achieved like this：
A kind of camera intelligent screening system, including power module, core processor, camera acquisition module, hardware-accelerated mould
Block, image enhancement module, high speed memory modules and transport module are power module and core processor, camera acquisition module, hard
Part accelerating module, image enhancement module, high speed memory modules, transport module
Connection, be core processor, camera acquisition module, hardware accelerator, image enhancement module, high speed memory modules,
Transport module provides working power.Core processor increases with power module, camera acquisition module, hardware accelerator, image
Strong module, high speed memory modules, transport module are connected, and wherein camera acquisition module is connected with core processor, for gathering
Video data simultaneously passes to core processor in real time, and hardware accelerator is connected with core processor, for for core processor
Function of hardware acceleration is provided, image enhancement module is connected with core processor, for reducing core processor from IMAQ mould
The noise of the image obtained at block, and strengthen its picture quality.High speed memory modules are connected with core processor, are regarded for storing
Frequently, transport module is connected with core processor, for by the transmission of video after processing to Ethernet or external-connection displayer.
The camera acquisition module enclosed mass two-way utilizing camera interface, supports DVP agreements and MIPI (2-lane) associations respectively
View, to adapt to the most of camera sensing device in market.
The hardware accelerator be GPU, hardware accelerator and core processor parallel processing video data, with this plus
The operating rate of fast core processor.
The transport module includes two-path video transmission means, respectively HDMI and gigabit ethernet interface, HDMI
Interface is used to the video data after screening being transferred directly to display, and gigabit ethernet interface passes the video data after screening
It is sent on Ethernet.
Compared with prior art, the beneficial effects of the invention are as follows：
(1), the invention provides a kind of video data screening mode based on shooting head end, the unwanted video of user is deleted
Frame, reduces the video total amount that camera needs to transmit, reduces the demand of channel capacity.
(2), the present invention is directed to the situation of channel block, it is allowed to which live video stream is stored in locally by camera, treats channel
Transmitted again after unobstructed.
(3), the present invention allows user oneself to define the parameter that camera needs to filter.
Brief description of the drawings
Fig. 1 is structured flowchart of the present invention；
Fig. 2 is camera acquisition module schematic diagram；
Fig. 3 is transmission memory module schematic diagram；
Fig. 4 is core processor workflow diagram.
Embodiment
The present invention is described in detail below in conjunction with drawings and Examples.
Embodiment
Refering to Fig. 1, the present invention includes power module 1, core processor 2, camera acquisition module 3, hardware accelerator
4th, image enhancement module 5, high speed memory modules 6 and transport module 7, power module 1 are core processor 2, camera collection mould
Block 3, hardware accelerator 4, image enhancement module 5, high speed memory modules 6, transport module 7 provide power supply.Wherein camera is adopted
Collecting module 3 includes two-way camera sensing device interface, DVP interfaces 31 and MIPI interfaces 32, and for meeting, different cameras connects
Mouth is required；Transport module 7 includes the different coffret HDMI 71 of two-way and Ethernet interface 72 and ethernet PHY core
Piece 73.
Refering to Fig. 2, camera acquisition module 3 includes two-way camera sensing device interface, DVP interfaces 31 and MIPI interfaces
32, Mipi interfaces 31 are by taking OV5640 as an example, for MiPi interfaces, and the main signal line used is two pairs of signal difference separated times, a pair
Clock differential lines and enabling signal PWN.In the case of enabling signal set, the clock for meeting OV5640 requirements by input is believed
Number, the clock used is the frequency 24Mhz of dutycycle 50% square-wave signal, and OV5640 signal wire can export camera and collect
Real-time video.DVP interfaces 31 are by taking OV5642 as an example, for DVP interfaces, and the signal wire used is 8 data lines, and row, field are same
Line is walked, clock line equally inputs the clock signal for meeting OV5642 requirements, the clock used is the frequency of dutycycle 50% to clock line
Rate 24Mhz square-wave signal, OV5642 can export corresponding row field sync signal and video data.
Hardware accelerator 4 is GPU, by taking GC2000 as an example.The work of GC2000 in systems be divided into it is following some：1. treat
The video data of processing needs defined BGR24 pixel formats, but the form of the next data of camera collection is not fixed, therefore
Need to carry out the pixel format conversion of high speed with GPU.2. core processor 2 carries out needing GPU's same when template matches
Step is assisted, and shows that GPU will sequentially receive core after corresponding frame of video is divided into some zonules by core processor 2
The region that processor 2 is divided, whether being less than decision threshold by calculating the mean square deviation in each region and template to judge this region is
No is that user is interested.If not having user's data interested in a frame data, GPU abandons data, and at core
Reason device 2 returns to the information for not finding area-of-interest, and submits the request of next frame.If finding, present frame is not reprocessed
Remainder data, and the information for finding area-of-interest is replied to core processing 2, and submit the request of next frame.
Image enhancement module 5 is FPGA, and this is sentenced exemplified by Cyclone4 family chips, and FPGA and core processor 2 are connected
Interface be core processor 2 EIM interfaces, maximum rate is up to 24bit*80M/s=1.875Gbit/s, and 1080p@30
Video stream data for 1920*1080*30*3*8 be about 1.39Gbit/s, therefore EIM interfaces are sufficient for timing requirements.FPGA
Work in systems is main in two steps：The data collected are made medium filtering by the first step, are removed in camera gatherer process
The salt-pepper noise of middle introducing；Second step because camera there may be the distortion of color in gatherer process, therefore do one time Ah
You correct at method, depending on parameter amount of distortion as caused by camera.
High speed memory modules 6 are support SATA interface or mSATA hard disk.
Refering to Fig. 3, transport module 7 includes HDMI 71, gigabit network interface 72 and corresponding Ethernet PHY chip
73, model is respectively by taking 10029449-001RLF, HR911130C and AR8031 as an example.HDMI is used for directly transmission video letter
Number, AR8031 is used to need the network bag of transmission to be converted to the signal that HR911130C can be transmitted core processor 2,
HR911130C is then the gigabit ethernet interface of standard, for patching netting twine.
Refering to Fig. 4, core processor 2 is by taking IMX6Q as an example, after system electrification, and modules are started working, and process is as follows：
IMX6Q loads operating system, and initialized operating system reads default parameters.The request camera of core processor 2 acquisition module 3
Outputting video streams, request protocol is V4L2, if request failure, illustrates that camera acquisition module 3 fails startup, now system
Whether have the relevant parameter of Configuration network camera, if nothing, wait manual intervention if checking in default parameters, if in the presence of, by
The parameter of request is converted to IP Camera from camera acquisition module 3, reenters the request camera stage.If request shooting
The outputting video streams success of head acquisition module 3, illustrates that camera acquisition module 3 is working properly.Core processor 2 can be asked firmly afterwards
Part accelerator 4, if hardware accelerator 4 replys request, illustrates the normal work of hardware accelerator 4, hardware accelerator can be cooperateed with afterwards
Core processor handles video data.If hardware accelerator 4 is without reply, illustrates that hardware accelerator 4 starts failure, add without hardware
In the case that fast device 4 is cooperateed with, the maximum processing speed of core processor 2 can only support 1920x1080@15hz video counts
According to, therefore after camera is closed, camera refresh rate is reconfigured for 15hz；If default parameters have been set to 15hz or
Hardware accelerator 4 has replied request, then the request of core processor 2 image intensifier 5.Image intensifier 5 is such as without reply, then it represents that
Image enhaucament 5 starts failure, will cancel the image enhancement functions of system afterwards, while image intensifier 5 is matched somebody with somebody on hardware
It is set to direct mode operation.System formally enters the request stage of frame of video, the request frame of video of core processor 2, after request is arrived afterwards
Frame of video is sent to image enhancement module 5, if image enhancement module 5 is working properly, image enhancement module 5 can be to receiving
Frame of video carries out noise reduction process, reduces caused salt-pepper noise the problems such as because of signal integrity, while strengthening the contrast of image
Degree, makes image be easier by system resolution.If image enhancement module 5 fails on startup, direct mode operation is configured to, then
Data can directly be transmitted back to core processor 2 again after being passed into image enhancement module 5, and the effect of image enhancement module 5 is suitable
In wire.Treat that the processing of image enhancement module 5 terminates, the region segmentation that core processor 2 can be carried out to data, and to segmenting
The key message that data are stored with system is compared, once key message is present, then it is assumed that the data of this frame are to use
Family is interested, and useful information is there is in other words, then the data of this frame will be saved, if all cut
Data be considered as unessential after being matched, then the data of this frame will be rejected, and then be gone again under request
One frame data repeat identical work.In the case where there is useful information, core processor 2 can go to judge current transmission mould
Whether block working properly, if current abnormal, then will the data storage matched in high speed memory modules 6, if
Normally, then core processor will the data transfer matched to Ethernet or from HDMI mouthfuls output.Being then return to please
The stage of frame of video is asked, identical work is repeated.
Claims (4)
1. a kind of camera intelligent screening system, it is characterised in that the system includes：Power module (1), core processor (2),
Camera acquisition module (3), hardware accelerator (4), image enhancement module (5), high speed memory modules（6）, transport module
（7）, power module (1) and core processor (2), camera acquisition module (3), hardware accelerator (4), image enhancement module
(5), high speed memory modules（6）And transport module (7) connection, it is core processor (2), camera acquisition module (3), hardware
Accelerating module (4), image enhancement module (5), high speed memory modules（6）, transport module (7) provide working power, core processing
Device (2) and power module (1), camera acquisition module (3), hardware accelerator (4), image enhancement module (5), deposit at a high speed
Store up module（6）And transport module (7) is connected, wherein camera acquisition module (3) is connected with core processor (2), for gathering
Video data simultaneously passes to core processor (2) in real time, and hardware accelerator (4) is connected with core processor (2), for for core
Heart processor (2) provides hardware-accelerated, and image enhancement module (5) is connected with core processor (2), for reducing core processor
(2) noise of the image obtained from image capture module (5), and strengthen its picture quality；High speed memory modules (6) and core
Processor (2) is connected, and for storing video, transport module (7) is connected with core processor (2), for by the video after processing
It is transferred on Ethernet or external-connection displayer.
2. system according to claim 1, it is characterised in that：Camera acquisition module (3) enclosed mass two-way utilizing camera interface,
DVP agreements and MIPI (2-lane) agreement are supported respectively.
3. system according to claim 1, it is characterised in that：Hardware accelerator (4) is GPU, hardware accelerator (4)
With core processor (2) parallel processing video data, image is rendered at a high speed, accelerates the operating rate of core processor (2).
4. system according to claim 1, it is characterised in that：Transport module (7) includes two-path video transmission means, respectively
For HDMI and gigabit ethernet interface, HDMI is used to the video data after screening being conveyed directly to display, thousand
Video data after screening is sent on Ethernet by mbit ethernet interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710310943.8A CN107124586A (en) | 2017-05-05 | 2017-05-05 | Camera intelligent screening system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710310943.8A CN107124586A (en) | 2017-05-05 | 2017-05-05 | Camera intelligent screening system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107124586A true CN107124586A (en) | 2017-09-01 |
Family
ID=59726823
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710310943.8A Pending CN107124586A (en) | 2017-05-05 | 2017-05-05 | Camera intelligent screening system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107124586A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107564555A (en) * | 2017-09-13 | 2018-01-09 | 量子云未来（北京）信息科技有限公司 | A kind of Portable movable movie and television contents accelerate transmitting device |
| CN107747915A (en) * | 2017-11-10 | 2018-03-02 | 华东师范大学 | Closed loop 3D vision device based on DMD |
| CN111601019A (en) * | 2020-02-28 | 2020-08-28 | 北京爱芯科技有限公司 | Image data processing module and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102595023A (en) * | 2012-01-19 | 2012-07-18 | 西安联客信息技术有限公司 | Mobile terminal and image processing method thereof |
| CN102801962A (en) * | 2012-08-22 | 2012-11-28 | 华南师范大学 | Online object image information obtaining device and method for Internet of things |
| CN103237192A (en) * | 2012-08-20 | 2013-08-07 | 苏州大学 | Intelligent video monitoring system based on multi-camera data fusion |
| CN103620682A (en) * | 2011-05-18 | 2014-03-05 | 高智83基金会有限责任公司 | Video summary including a feature of interest |
| US20150329045A1 (en) * | 2014-05-15 | 2015-11-19 | Fritz B. Harris | Vehcile detection and warning system |
-
2017
- 2017-05-05 CN CN201710310943.8A patent/CN107124586A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103620682A (en) * | 2011-05-18 | 2014-03-05 | 高智83基金会有限责任公司 | Video summary including a feature of interest |
| CN102595023A (en) * | 2012-01-19 | 2012-07-18 | 西安联客信息技术有限公司 | Mobile terminal and image processing method thereof |
| CN103237192A (en) * | 2012-08-20 | 2013-08-07 | 苏州大学 | Intelligent video monitoring system based on multi-camera data fusion |
| CN102801962A (en) * | 2012-08-22 | 2012-11-28 | 华南师范大学 | Online object image information obtaining device and method for Internet of things |
| US20150329045A1 (en) * | 2014-05-15 | 2015-11-19 | Fritz B. Harris | Vehcile detection and warning system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107564555A (en) * | 2017-09-13 | 2018-01-09 | 量子云未来（北京）信息科技有限公司 | A kind of Portable movable movie and television contents accelerate transmitting device |
| CN107564555B (en) * | 2017-09-13 | 2023-04-28 | 量子云未来（北京）信息科技有限公司 | Portable mobile video content acceleration transmission device |
| CN107747915A (en) * | 2017-11-10 | 2018-03-02 | 华东师范大学 | Closed loop 3D vision device based on DMD |
| CN111601019A (en) * | 2020-02-28 | 2020-08-28 | 北京爱芯科技有限公司 | Image data processing module and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103905741B (en) | Ultra-high-definition panoramic video real-time generation and multi-channel synchronous play system | |
| CN109089029B (en) | FPGA-based Gige Vision interface image transmission system and method | |
| CN202634545U (en) | Panorama video and image recording system | |
| CN107124586A (en) | Camera intelligent screening system | |
| CN103297668A (en) | Panoramic video image recording system and method | |
| CN207218845U (en) | Look around camera device | |
| CN107770280B (en) | Multimedia data processing and acquiring method, acquisition terminal and processing device | |
| DE69636099T2 (en) | Apparatus and method for converting data transfer rates for digital audio and video data | |
| CN105959620A (en) | Panorama video synchronization display method and panorama video synchronization display device | |
| CN103647899A (en) | Traffic intelligent-camera snapshot system and snapshot method based on FPGA | |
| CN106385568A (en) | Video monitoring system | |
| CN105471958A (en) | Data processing system and method of internet of things | |
| DE202016008753U1 (en) | Gigabit Ethernet applicable networked video communication | |
| CN207039771U (en) | Camera intelligent screening system | |
| CN106708876B (en) | Similar video retrieval method and system based on Lucene | |
| CN114710474B (en) | Data stream processing and classifying method based on Internet of things | |
| WO2014201775A1 (en) | Multimedia data transmission method, and apparatus | |
| WO2016015576A1 (en) | System and method for remote screen capturing in double-stream mode | |
| CN116016942A (en) | Image data processing method of multi-path camera and related equipment | |
| CN205693803U (en) | Communication based on wireless network and the supervising device of image acquisition | |
| CN108449650A (en) | A kind of RTMP live streaming flows to HTTP FLV live TV streams real time conversion systems and its working method | |
| CN107181928A (en) | Conference system and data transmission method | |
| CN110661785A (en) | Video processing method, device and system, electronic equipment and readable storage medium | |
| CN107666582A (en) | Video signal conversion method and system | |
| CN113079087B (en) | Interconnected data gateway, and data processing system and method based on interconnected data gateway |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170901 |
|
| WD01 | Invention patent application deemed withdrawn after publication |