CN108184096A - Run skating area full view monitoring device, system and method in a kind of airport - Google Patents
Run skating area full view monitoring device, system and method in a kind of airport Download PDFInfo
- Publication number
- CN108184096A CN108184096A CN201810016035.2A CN201810016035A CN108184096A CN 108184096 A CN108184096 A CN 108184096A CN 201810016035 A CN201810016035 A CN 201810016035A CN 108184096 A CN108184096 A CN 108184096A
- Authority
- CN
- China
- Prior art keywords
- module
- airport
- skating area
- image
- monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012806 monitoring device Methods 0.000 title claims abstract description 73
- 238000000034 method Methods 0.000 title claims abstract description 21
- 238000012544 monitoring process Methods 0.000 claims abstract description 90
- 230000033001 locomotion Effects 0.000 claims abstract description 36
- 238000007781 pre-processing Methods 0.000 claims abstract description 17
- 230000004927 fusion Effects 0.000 claims abstract description 15
- 238000000605 extraction Methods 0.000 claims abstract description 13
- 238000012545 processing Methods 0.000 claims abstract description 13
- 238000001514 detection method Methods 0.000 claims description 15
- 230000005540 biological transmission Effects 0.000 claims description 13
- QVFWZNCVPCJQOP-UHFFFAOYSA-N chloralodol Chemical compound CC(O)(C)CC(C)OC(O)C(Cl)(Cl)Cl QVFWZNCVPCJQOP-UHFFFAOYSA-N 0.000 claims description 8
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 230000015654 memory Effects 0.000 description 8
- 230000004044 response Effects 0.000 description 7
- 238000002592 echocardiography Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 3
- 239000013598 vector Substances 0.000 description 3
- 241001062009 Indigofera Species 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000000630 rising effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 230000004083 survival effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30232—Surveillance
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Closed-Circuit Television Systems (AREA)
- Studio Devices (AREA)
- Alarm Systems (AREA)
- Image Analysis (AREA)
Abstract
The present invention relates to a kind of airports to run skating area full view monitoring device, system and method, this method obtains the spatial scene light for running skating area in airport by several monitoring devices by pick-up lens, is transformed into charge by ccd sensor light and passes through analog-digital converter chip and is converted into digital signal；Image capture module acquires real-time airport and runs skating area vedio data code stream；Image pre-processing module carries out feature extraction and dividing processing to the vedio data code stream of input, then several images of acquisition are carried out, then several images of acquisition are carried out splicing fusion by image co-registration module and form airport race skating area panoramic picture by matching superposition by image registration module；Object identification module runs the object for having motion state on the panoramic picture of skating area to airport and is identified, by recognition and tracking module to the object of movement into line trace.The present invention realizes that skating area overall view monitoring is run on airport, can carry out real time recognition and tracking early warning, improves the safety that skating area is run on airport.
Description
Technical field
The present invention relates to panorama monitoring technical fields, and in particular to a kind of airport run skating area full view monitoring device, system and
Method.
Background technology
Taxiway is the regulation channel for making ground taxi on airfield for aircraft.Taxiway system mainly includes main cunning
Trade, disengaging taxiway, aircraft seat in the plane sliding channel, machine level ground taxiway, support taxiway, taxiway road shoulder and taxiway strip.Machine
It is region including taxiway including and around taxiway to run skating area, airport race skating area be related to the safe take-off of aircraft with
The monitoring of skating area is run to ensureing that passenger survival property safety has vital meaning in land, airport.
The general field range of traditional video monitoring is narrow, can only monitor limited scene.It is needing to monitor large scene
In the case of, often some specific region is monitored using multiple cameras, multiple monitoring are provided by multiple cameras
Picture, this solution have often disperseed the attention of monitoring personnel, it is impossible to accidental event be found and be tracked in time, held
Easily lead to safety accident.
Invention content
The purpose of the present invention is to provide a kind of airports to run skating area full view monitoring device, system and method, using common
Pick-up lens, realize to airport run skating area overall view monitoring, and can to airport run skating area moving object carry out in real time identification with
Track early warning improves the safety that skating area is run on airport.
To achieve the above object, the technical scheme is that：Run skating area full view monitoring device, the monitoring in a kind of airport
Device includes dsp processor and arm processor, and the monitoring device further includes pick-up lens, ccd sensor, video acquisition mould
Block, image pre-processing module, image registration module, image co-registration module, object identification module, recognition and tracking module and the prison that crosses the border
Survey module；The pick-up lens establishes a connection with the ccd sensor, and pick-up lens is used to obtain the sky that skating area is run on airport
Between scene；The ccd sensor establishes a connection with the video acquisition module, and ccd sensor is used to light being transformed into
Charge simultaneously passes through analog-digital converter chip and is converted into digital signal；The video acquisition module is established with the dsp processor to be connected
Relationship is connect, video acquisition module is used to acquire the real time video image data code flow of ccd sensor transmission；Described image pre-processes
Module establishes a connection with the video acquisition module, and image pre-processing module is used to carry out feature to the video image of input
Extraction and dividing processing；Described image registration module establishes a connection with described image preprocessing module, image registration module
For several images obtained to be carried out matching superposition；Described image Fusion Module is established connection with described image registration module and is closed
System, image co-registration module are used to several images obtained carrying out splicing fusion；The object identification module and the ARM processing
Device and image co-registration module establish a connection, and object identification module is used to identify that cunning is run on the airport after the fusion of image co-registration module
There is the object of motion state on area's image；The recognition and tracking module establishes a connection with the object identification module, knows
Other tracking module is used to run airport object of the skating area image with motion state into line trace；Monitoring modular and the institute of crossing the border
It states recognition and tracking module to establish a connection, the monitoring modular that crosses the border is used to run airport on object of the skating area image with motion state
Carry out monitoring of crossing the border.
Skating area full view monitoring device is run on a kind of airport as described above, and the monitoring device further includes emergency stop detection module,
The emergency stop detection module establishes a connection with the arm processor, and emergency stop detection module is used to run skating area image to airport
The upper aircraft with motion state carries out emergency stop detection.Emergency stop detection module by running skating area to airport there is motion state to fly
The characteristic parameter of machine extracts, and when emergency stop state occurs for aircraft, the aircraft signature parameter on adjacent image is identical, and then sentences
Break and emergency stop accident has occurred for aircraft.
Skating area full view monitoring device is run on a kind of airport as described above, and the monitoring device further includes warning module, described
Warning module establishes a connection with the arm processor, and warning module runs skating area image for airport has motion state
Safe early warning is carried out during object traverse safety margin or under aircraft emergency stop state.The safety margin that skating area is run on airport is set in advance
It puts inside the parameter of monitoring device, the image features in safety margin are consistent when not having foreign body to swarm into,
When there is foreign body to swarm into, the image features run in the safety margin of skating area change, and then be judged as there is exotic
Swarm into carry out safe early warning.
Skating area full view monitoring device is run on a kind of airport as described above, and the monitoring device is equipped with Flash chip, DDR cores
Piece and Ethernet interface, the Flash chip establish a connection with the arm processor, and Flash chip is used to preserve airport
Skating area image data is run, the DDR chips establish a connection with the arm processor, and DDR chips are used to implement airport and run cunning
The Double Data Rate synchronous dynamic random storage of area's image data；The Ethernet interface is established connection with the arm processor and is closed
System, Ethernet interface are connected to internet for monitoring device and carry out network data transmission.Flash chip is non-volatile memory
Device can carry out erasable and reprogram to the memory cell block for being known as block.The frequency of DDR chip memories can use working frequency
Represent that working frequency is the working frequency of memory grain reality, since DDR memories can be in pulse with equivalent frequency two ways
Rising and falling edges all transmit data, therefore the equivalent frequency for transmitting data is twice of working frequency.When DDR chips are each
Clock can be with the speed read/write data of 4 times of external bus, and can be run with the speed of 4 times of Internal Control Bus IBC.Meet prison
Survey the data storage requirement of device.
Skating area full view monitoring device is run on a kind of airport as described above, and the monitoring device is equipped with wireless transport module, institute
Wireless transport module is stated to establish a connection with the arm processor, wireless transport module using LoRa modules, bluetooth module or
NB-IoT modules, wireless transport module run skating area image data for the airport of monitoring device monitoring and are wirelessly transferred.LoRa
Semtech companies SX1278 radio frequency chips may be used in module, and transmission range farthest can reach 8km, working frequency range 411-
441MHz；The module supports 4 kinds of operating modes and aerial wake-up, can reduce power consumption to greatest extent, which shares 7 pins,
It is realized by serial ports and external device communication, pin M0, M1 is used for setup module operating mode, AUX is used to refer to module work
State.The SIM7000C of SIMCom may be used in NB-IoT modules, and SIM7000C is the branch researched and developed based on high pass MDM9206 platforms
NB-IoT modules are held, using SMT encapsulation, can meet the needs of skating area full view monitoring device is run on airport.
The present invention also provides a kind of airports to run skating area overall view monitoring system, and the monitoring system includes above-mentioned monitoring device,
The monitoring system further includes display host, far-end server and mobile terminal；The monitoring device quantity is at least 2, prison
Control device is laid in airport and runs around skating area, and monitoring device is equipped with collection terminal and monitoring side, and the collection terminal and monitoring side are established
Connection relation, the collection terminal include dsp processor, pick-up lens, ccd sensor, video acquisition module, image preprocessing mould
Block, image registration module and image co-registration module；The monitoring side includes arm processor, object identification module, recognition and tracking mould
Block and the monitoring modular that crosses the border；The monitoring side is established a connection by Ethernet interface and the display host, shows host
The airport race skating area full-view video image data for obtaining monitoring side transmission are shown；The far-end server and the monitoring side
And mobile terminal establishes a connection, far-end server obtains the monitoring device airport and runs skating area image data and be transferred to institute
State mobile terminal.
Skating area overall view monitoring system is run on a kind of airport as described above, the monitoring side by wireless transport module with it is described
Display host establishes a connection, and the wireless transport module uses LoRa modules, bluetooth module or NB-IoT modules.
Skating area overall view monitoring system is run on a kind of airport as described above, and the mobile terminal passes through indigo plant with the monitoring device
Tooth module establishes a connection, and mobile terminal directly obtains airport from the monitoring device and runs skating area panorama monitoring data.
The present invention also provides a kind of airports to run skating area overall view monitoring method, and the method uses above-mentioned monitoring device, passes through
Above-mentioned monitoring system realizes that the monitoring method includes the following steps：
Step 1：Several monitoring devices obtain the spatial scene light for running skating area in airport by pick-up lens, are passed by CCD
Sensor light, which is transformed into charge and passes through analog-digital converter chip, is converted into digital signal；
Step 2：Ccd sensor transmits digital signal to image capture module, and image capture module acquires real-time airport
Run skating area vedio data code stream；
Step 3：Image pre-processing module carries out feature extraction and dividing processing to inputted video image data code flow, so
Several images of acquisition are carried out by matching superposition by image registration module afterwards, then by image co-registration module by the several of acquisition
Image carries out splicing fusion and forms airport race skating area panoramic picture；
Step 4：Object identification module runs the object for having motion state on the panoramic picture of skating area to airport and is identified,
By recognition and tracking module to the object of movement into line trace；
Step 5：The object that the monitoring modular that crosses the border runs skating area to airport and has motion state carries out monitoring of crossing the border, movement
When skating area safety margin is run on object traverse airport, warning module carries out safe early warning.
Airport is run in the overall view monitoring method step 4 of skating area, and object identification module identifies that the object of movement is aircraft, when
When occurring emergency stop state after airplane motion, warning module carries out safe early warning.
The invention has the advantages that：Using common pick-up lens, by image processing algorithm, to inputted video image
Data code flow carries out feature extraction and dividing processing, and several images of acquisition are carried out matching superposition, and several images are carried out
Splicing fusion forms airport and runs skating area panoramic picture, realizes the overall view monitoring that skating area is run to airport, and can run skating area to airport
Moving object carries out real time recognition and tracking early warning, improves the safety that skating area is run on airport, and monitoring cost is low.
Description of the drawings
Fig. 1 runs skating area full view monitoring device schematic diagram for airport；
Fig. 2 runs skating area overall view monitoring system schematic diagram for airport；
Fig. 3 runs skating area overall view monitoring method flow chart for airport.
Specific embodiment
The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention..
As shown in Figure 1, skating area full view monitoring device is run on a kind of airport, the monitoring device includes dsp processor 1 and ARM
Processor 2, the monitoring device further include pick-up lens 3, ccd sensor 4, video acquisition module 5, image pre-processing module 6,
Image registration module 7, image co-registration module 8, object identification module 9, recognition and tracking module 10 and the monitoring modular 11 that crosses the border；It is described
Pick-up lens 3 establishes a connection with the ccd sensor 4, and pick-up lens 3 is used to obtain the spatial scene that skating area is run on airport；
The ccd sensor 4 establishes a connection with the video acquisition module 5, and ccd sensor 4 is used to light being transformed into charge
And pass through analog-digital converter chip and be converted into digital signal；The video acquisition module 5 is established with the dsp processor 1 and is connected
Relationship, video acquisition module 5 are used to acquire the real time video image data code flow of the transmission of ccd sensor 4；Described image pre-processes
Module 6 establishes a connection with the video acquisition module 5, and image pre-processing module 6 is used to carry out the video image of input
Feature extraction and dividing processing；Described image registration module 7 establishes a connection with described image preprocessing module 6, and image is matched
Quasi-mode block 7 is used to several images obtained carrying out matching superposition；Described image Fusion Module 8 and described image registration module 7
It establishes a connection, image co-registration module 8 is used to several images obtained carrying out splicing fusion；The object identification module 9
It establishes a connection with the arm processor 2 and image co-registration module 8, object identification module 9 is used to identify image co-registration module
Run the object on the image of skating area with motion state in airport after 8 fusions；The recognition and tracking module 10 and the object identification
Module 9 establishes a connection, recognition and tracking module 10 be used for airport run skating area image have motion state object carry out with
Track；The monitoring modular 11 that crosses the border establishes a connection with the recognition and tracking module 10, and the monitoring modular 11 that crosses the border is used for machine
The object that field runs skating area image and has motion state carries out monitoring of crossing the border.
Airport is run in one embodiment of skating area full view monitoring device, and the monitoring device further includes emergency stop detection module
12, the emergency stop detection module 12 establishes a connection with the arm processor 2, and emergency stop detection module 12 is used to run airport
The aircraft with motion state carries out emergency stop detection on the image of skating area.Emergency stop detection module 12 has fortune by running skating area to airport
The characteristic parameter of the aircraft of dynamic state extracts, when emergency stop state occurs for aircraft, the aircraft signature parameter on adjacent image
It is identical, and then it is judged as that emergency stop accident has occurred in aircraft.
Airport is run in one embodiment of skating area full view monitoring device, and the monitoring device further includes warning module 13, institute
It states warning module 13 to establish a connection with the arm processor 2, warning module 13 runs skating area image for airport has movement
Safe early warning is carried out during the object traverse safety margin of state or under aircraft emergency stop state.Run the safety margin of skating area in airport
The inner parameter of monitoring device is set in advance in, when not having foreign body to swarm into, the image features in safety margin are
Consistent, when there is foreign body to swarm into, the image features run in the safety margin of skating area change, and then be judged as having
Exotic swarms into carry out safe early warning.
Airport is run in one embodiment of skating area full view monitoring device, and the monitoring device is equipped with Flash chip 14, DDR
Chip 15 and Ethernet interface 16, the Flash chip 14 establish a connection with the arm processor 2, Flash chip 14
Skating area image data is run for preserving airport, the DDR chips 15 establish a connection with the arm processor 2, DDR chips
15 are used to implement the Double Data Rate synchronous dynamic random storage that skating area image data is run on airport；The Ethernet interface 16 with it is described
Arm processor 2 establishes a connection, and Ethernet interface 16 is connected to internet for monitoring device and carries out network data transmission.
Flash chip 14 is nonvolatile storage, can carry out erasable and reprogram to the memory cell block for being known as block.DDR chips
The frequency of 15 memories can represent that working frequency is the work of memory grain reality with working frequency and equivalent frequency two ways
Frequency, since DDR memories can all transmit data in the rising and falling edges of pulse, the equivalent frequency of transmission data is work
Twice of working frequency.15 each clock of DDR chips can be with the speed read/write data of 4 times of external bus, and can be with inside
The speed operation that 4 times of controlling bus.Meet the data storage requirement of monitoring device.
Airport is run in one embodiment of skating area full view monitoring device, and the monitoring device is equipped with wireless transport module 17,
The wireless transport module 17 establishes a connection with the arm processor 2, and wireless transport module 17 is using LoRa modules, indigo plant
Tooth module or NB-IoT modules, wireless transport module 17 run skating area image data for the airport of monitoring device monitoring and carry out wirelessly
Transmission.Semtech companies SX1278 radio frequency chips may be used in LoRa modules, and transmission range farthest can reach 8km, working frequency range
For 411-441MHz；The module supports 4 kinds of operating modes and aerial wake-up, can reduce power consumption to greatest extent, which shares 7
Pin, is realized by serial ports and external device communication, pin M0, M1 are used for setup module operating mode, and AUX is used to refer to module
Working condition.The SIM7000C of SIMCom may be used in NB-IoT modules, and SIM7000C is researched and developed based on high pass MDM9206 platforms
Support NB-IoT modules, using SMT encapsulation, can meet the needs of skating area full view monitoring device is run on airport.
As shown in Fig. 2, the present invention also provides a kind of airports to run skating area overall view monitoring system, the monitoring system includes above-mentioned
Monitoring device, the monitoring system further include display host 18, far-end server 19 and mobile terminal 20；The monitoring device number
Amount is at least 2, and monitoring device is laid in airport and runs around skating area, and monitoring device is equipped with collection terminal and monitoring side, the acquisition
End and monitoring side establish a connection, and the collection terminal includes dsp processor 1, pick-up lens 3, ccd sensor 4, video acquisition
Module 5, image pre-processing module 6, image registration module 7 and image co-registration module 8；The monitoring side include arm processor 2,
Object identification module 9, recognition and tracking module 10 and the monitoring modular 11 that crosses the border；The monitoring side by Ethernet interface 16 with it is described
Display host 18 establish a connection, display host 18 obtain monitoring side transmission airport run skating area full-view video image data into
Row display；The far-end server 19 establishes a connection with the monitoring side and mobile terminal 20, and far-end server 19 obtains
It runs skating area image data and is transferred to the mobile terminal 20 in the monitoring device airport.
Airport is run in one embodiment of skating area overall view monitoring system, and the monitoring side passes through wireless transport module 17 and institute
It states display host 18 to establish a connection, the wireless transport module 17 is using LoRa modules, bluetooth module or NB-IoT modules.
Airport is run in one embodiment of skating area overall view monitoring system, and the mobile terminal 20 passes through with the monitoring device
Bluetooth module establishes a connection, and mobile terminal 20 directly obtains airport from the monitoring device and runs skating area panorama monitoring data.
Referring to Fig. 3, the present invention also provides a kind of airports to run skating area overall view monitoring method, and the method is filled using above-mentioned monitoring
It puts, is realized by above-mentioned monitoring system, the monitoring method includes the following steps：
S1：Several monitoring devices obtain the spatial scene light for running skating area in airport by pick-up lens 3, are sensed by CCD
4 light of device, which is transformed into charge and passes through analog-digital converter chip, is converted into digital signal；
S2：Ccd sensor 4 transmits digital signal to image capture module, and image capture module acquires real-time airport and runs
Skating area vedio data code stream；
S3：Image pre-processing module 6 carries out feature extraction and dividing processing, Ran Houtong to inputted video image data code flow
It crosses image registration module 7 and several images of acquisition is subjected to matching superposition, then by image co-registration module 8 by several figures of acquisition
Airport race skating area panoramic picture is formed as carrying out splicing fusion；
S4：Object identification module 9 runs the object for having motion state on the panoramic picture of skating area to airport and is identified, and passes through
Recognition and tracking module 10 is to the object of movement into line trace；
S5：The object that the monitoring modular 11 that crosses the border runs skating area to airport and has motion state carries out monitoring of crossing the border, the object of movement
When body is across airport race skating area safety margin, warning module 13 carries out safe early warning.
Airport is run in the overall view monitoring method S4 of skating area, and object identification module 9 identifies that the object of movement is aircraft, works as aircraft
When occurring emergency stop state after movement, warning module 13 carries out safe early warning.
The present invention uses common pick-up lens, and by image processing algorithm, inputted video image data code flow is carried out
Feature extraction and dividing processing, feature extraction and dividing processing may be used based on the joint partitioning algorithm of super-pixel and SVM reality
It is existing.In the present invention several images of acquisition are carried out with matching superposition, images match superposition is using based on the coloured silk for improving SURF operators
Color image registration Algorithm, SURF features are a kind of scale and invariable rotary, and with SIFT algorithms the step of is essentially identical, but operation speed
Degree improves 3-5 times, and SURF algorithm has used integral image and box filter, main to include extraction characteristic point, generation feature
Descriptor and characteristic matching three parts.Feature point extraction carries out characteristic point by the scale space based on Gaussian pyramid construction
Detection extracts characteristic point by Hessian matrixes.It generates in feature descriptor as the rotational invariance for ensureing SURF features, gives
The characteristic point of extraction determines principal direction.It is that radius calculates x and y by the center of circle, 6s (s is the value of scale where characteristic point) of characteristic point
The Haar small echos response in direction, Haar small echo template sizes take 4s × 4s；Gauss weight is given to Haar responses so that closer to
The response of characteristic point is bigger；Centered on characteristic point, to one circle of scanning in the fan-shaped range of π/3, by the angled interior Haar of institute
Small echo response carries out accumulative superposition, forms new vector；Principal direction is exactly the maximum value direction of accumulative superposition.Principal direction determine with
Afterwards, by centered on characteristic point, the square window region of a 20s × 20s is constructed, which is divided into 4 × 4 sub-district
Domain, and assign Gauss weight coefficient, to the sum of the Haar small echos response dx in sampled point difference calculated level direction in each region,
The sum of Haar small echos response dy of vertical direction and the sum of the absolute value of Haar small echos response, one four is formed in each region
Dimensional vector (∑ dx, ∑ dy, ∑ dx, ∑ dy), then the descriptor of characteristic point for (4 × 4) × 4=64 dimensional vectors Vs=(i1,
I2 ..., i64).After the characteristic point for extracting two images, characteristic matching can be carried out according to the similarity measurement between characteristic point.
The Euclidean distance between characteristic point is selected as similarity measurement.The present invention carries out several images splicing fusion and forms machine
Skating area panoramic picture is run in field, realizes the overall view monitoring that skating area is run to airport, and the moving object that skating area can be run to airport carries out in fact
When recognition and tracking early warning, improve the safety that skating area is run on airport, monitoring cost is low.
Although above having used general explanation and specific embodiment, the present invention is described in detail, at this
On the basis of invention, it can be made some modifications or improvements, this will be apparent to those skilled in the art.Therefore,
These modifications or improvements without departing from theon the basis of the spirit of the present invention belong to the scope of protection of present invention.
Claims (10)
1. skating area full view monitoring device is run on a kind of airport, the monitoring device includes dsp processor and arm processor, feature
It is：The monitoring device further includes pick-up lens, ccd sensor, video acquisition module, image pre-processing module, image and matches
Quasi-mode block, image co-registration module, object identification module, recognition and tracking module and the monitoring modular that crosses the border；The pick-up lens and institute
It states ccd sensor to establish a connection, pick-up lens is used to obtain the spatial scene that skating area is run on airport；The ccd sensor with
The video acquisition module establishes a connection, and ccd sensor is used to light being transformed into charge and passes through analog-digital converter core
Piece is converted into digital signal；The video acquisition module establishes a connection with the dsp processor, and video acquisition module is used for
Acquire the real time video image data code flow of ccd sensor transmission；Described image preprocessing module and the video acquisition module
It establishes a connection, image pre-processing module is used to carry out feature extraction and dividing processing to the video image of input；The figure
As registration module and described image preprocessing module establish a connection, image registration module be used for by several images obtained into
Row matching superposition；Described image Fusion Module establishes a connection with described image registration module, and image co-registration module is used for will
Several images obtained carry out splicing fusion；The object identification module is established with the arm processor and image co-registration module
Connection relation, object identification module are used to identify that the airport after the fusion of image co-registration module is run on the image of skating area with motion state
Object；The recognition and tracking module establishes a connection with the object identification module, and recognition and tracking module is used for airport
Object of the skating area image with motion state is run into line trace；The monitoring modular that crosses the border is established with the recognition and tracking module to be connected
Relationship is connect, the monitoring modular that crosses the border is used to carry out monitoring of crossing the border to the object that airport race skating area image has motion state.
2. skating area full view monitoring device is run on a kind of airport according to claim 1, it is characterised in that：The monitoring device is also
Including emergency stop detection module, the emergency stop detection module establishes a connection with the arm processor, and emergency stop detection module is used for
The aircraft that run to airport has motion state on the image of skating area carries out emergency stop detection.
3. skating area full view monitoring device is run on a kind of airport according to claim 1, it is characterised in that：The monitoring device is also
Including warning module, the warning module establishes a connection with the arm processor, and warning module runs skating area figure for airport
As when there is the object traverse safety margin of motion state or carrying out safe early warning under aircraft emergency stop state.
4. skating area full view monitoring device is run on a kind of airport according to claim 1, it is characterised in that：The monitoring device is set
There are Flash chip, DDR chips and Ethernet interface, the Flash chip establishes a connection with the arm processor,
Flash chip runs skating area image data for preserving airport, and the DDR chips establish a connection with the arm processor,
DDR chips are used to implement the Double Data Rate synchronous dynamic random storage that skating area image data is run on airport；The Ethernet interface with
The arm processor establishes a connection, and Ethernet interface is connected to internet for monitoring device and carries out network data transmission.
5. skating area full view monitoring device is run on a kind of airport according to claim 1, it is characterised in that：The monitoring device is set
There is wireless transport module, the wireless transport module establishes a connection with the arm processor, and wireless transport module uses
Skating area picture number is run on LoRa modules, bluetooth module or NB-IoT modules, airport of the wireless transport module for monitoring device monitoring
According to being wirelessly transferred.
6. skating area overall view monitoring system is run on a kind of airport, the monitoring system includes the monitoring as described in any one of claim 1 to 5
Device, it is characterised in that：The monitoring system further includes display host, far-end server and mobile terminal；The monitoring device
Quantity is at least 2, and monitoring device is laid in airport and runs around skating area, and monitoring device is equipped with collection terminal and monitoring side, described to adopt
Collection end and monitoring side establish a connection, and the collection terminal includes dsp processor, pick-up lens, ccd sensor, video acquisition
Module, image pre-processing module, image registration module and image co-registration module；The monitoring side includes arm processor, object is known
Other module, recognition and tracking module and the monitoring modular that crosses the border；The monitoring side is established by Ethernet interface and the display host
Connection relation, the airport race skating area full-view video image data that display host obtains monitoring side transmission are shown；The distal end
Server establishes a connection with the monitoring side and mobile terminal, and far-end server obtains the monitoring device airport and runs skating area
Image data is simultaneously transferred to the mobile terminal.
7. skating area overall view monitoring system is run on a kind of airport according to claim 6, it is characterised in that：The monitoring side passes through
Wireless transport module establishes a connection with the display host, and the wireless transport module is using LoRa modules, bluetooth module
Or NB-IoT modules.
8. skating area overall view monitoring system is run on a kind of airport according to claim 6, it is characterised in that：The mobile terminal with
The monitoring device is established a connection by bluetooth module, and mobile terminal directly obtains airport from the monitoring device and runs skating area
Panorama monitoring data.
9. skating area overall view monitoring method is run on a kind of airport, the method is used monitors dress as described in any one of claim 1 to 5
It puts, is realized by the monitoring system as described in any one of claim 6 to 8, it is characterised in that：The monitoring method includes following step
Suddenly：
Step 1：Several monitoring devices obtain the spatial scene light for running skating area in airport by pick-up lens, pass through ccd sensor
Light is transformed into charge and passes through analog-digital converter chip and is converted into digital signal；
Step 2：Ccd sensor transmits digital signal to image capture module, and image capture module acquires real-time airport and runs cunning
Area's vedio data code stream；
Step 3：Image pre-processing module carries out feature extraction and dividing processing, Ran Houtong to inputted video image data code flow
It crosses image registration module and several images of acquisition is subjected to matching superposition, then by image co-registration module by several images of acquisition
It carries out splicing fusion and forms airport race skating area panoramic picture；
Step 4：Object identification module runs the object for having motion state on the panoramic picture of skating area to airport and is identified, and passes through
Recognition and tracking module is to the object of movement into line trace；
Step 5：The object that the monitoring modular that crosses the border runs skating area to airport and has motion state carries out monitoring of crossing the border, the object of movement
When running skating area safety margin across airport, warning module carries out safe early warning.
10. skating area overall view monitoring method is run on a kind of airport according to claim 9, it is characterised in that：In the step 4,
Object identification module identifies that the object of movement is aircraft, and when occurring emergency stop state after airplane motion, warning module is pacified
Full early warning.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810016035.2A CN108184096B (en) | 2018-01-08 | 2018-01-08 | Panoramic monitoring device, system and method for airport running and sliding area |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810016035.2A CN108184096B (en) | 2018-01-08 | 2018-01-08 | Panoramic monitoring device, system and method for airport running and sliding area |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108184096A true CN108184096A (en) | 2018-06-19 |
| CN108184096B CN108184096B (en) | 2020-09-11 |
Family
ID=62550123
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810016035.2A Expired - Fee Related CN108184096B (en) | 2018-01-08 | 2018-01-08 | Panoramic monitoring device, system and method for airport running and sliding area |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108184096B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111064929A (en) * | 2019-12-16 | 2020-04-24 | 佛山科学技术学院 | Video data acquisition system based on LoRa wireless transmission |
| CN112381797A (en) * | 2020-11-16 | 2021-02-19 | 广东电网有限责任公司肇庆供电局 | Infrared data-based line object information confirmation method |
| CN114912755A (en) * | 2022-04-13 | 2022-08-16 | 西安卓越视讯科技有限公司 | All-weather comprehensive early warning and monitoring method, system and device for airport flight area |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009089281A1 (en) * | 2008-01-11 | 2009-07-16 | Broadband Discovery Systems, Inc. | System and method for conditioning a signal received at a mems based acquisition device |
| CN102253381A (en) * | 2011-04-20 | 2011-11-23 | 上海交通大学 | System and method for automatically detecting foreign object debris (FOD) on airfield runways |
| CN102946528A (en) * | 2012-12-14 | 2013-02-27 | 安徽水天信息科技有限公司 | Airport runway monitoring system based on intelligent video monitoring for whole scenic spot |
| CN103402044A (en) * | 2013-08-07 | 2013-11-20 | 重庆大学 | Target recognition and tracking system based on multi-source video integration |
| CN103400380A (en) * | 2013-07-25 | 2013-11-20 | 河海大学 | Single camera underwater target three-dimensional trace stimulation method merged with image matrix offset |
| CN105427618A (en) * | 2015-12-18 | 2016-03-23 | 清华大学 | Method and system for warning in case of vehicle's occupation of emergency parking strip |
| CN106104203A (en) * | 2015-07-13 | 2016-11-09 | 深圳市大疆创新科技有限公司 | The distance detection method of a kind of mobile object, device and aircraft |
| WO2017197620A1 (en) * | 2016-05-19 | 2017-11-23 | Intel Corporation | Detection of humans in images using depth information |
| CN107533133A (en) * | 2015-04-22 | 2018-01-02 | 罗伯特·博世有限公司 | For the method and apparatus in the region for monitoring vehicle front |
-
2018
- 2018-01-08 CN CN201810016035.2A patent/CN108184096B/en not_active Expired - Fee Related
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009089281A1 (en) * | 2008-01-11 | 2009-07-16 | Broadband Discovery Systems, Inc. | System and method for conditioning a signal received at a mems based acquisition device |
| CN102253381A (en) * | 2011-04-20 | 2011-11-23 | 上海交通大学 | System and method for automatically detecting foreign object debris (FOD) on airfield runways |
| CN102946528A (en) * | 2012-12-14 | 2013-02-27 | 安徽水天信息科技有限公司 | Airport runway monitoring system based on intelligent video monitoring for whole scenic spot |
| CN103400380A (en) * | 2013-07-25 | 2013-11-20 | 河海大学 | Single camera underwater target three-dimensional trace stimulation method merged with image matrix offset |
| CN103402044A (en) * | 2013-08-07 | 2013-11-20 | 重庆大学 | Target recognition and tracking system based on multi-source video integration |
| CN107533133A (en) * | 2015-04-22 | 2018-01-02 | 罗伯特·博世有限公司 | For the method and apparatus in the region for monitoring vehicle front |
| CN106104203A (en) * | 2015-07-13 | 2016-11-09 | 深圳市大疆创新科技有限公司 | The distance detection method of a kind of mobile object, device and aircraft |
| CN105427618A (en) * | 2015-12-18 | 2016-03-23 | 清华大学 | Method and system for warning in case of vehicle's occupation of emergency parking strip |
| WO2017197620A1 (en) * | 2016-05-19 | 2017-11-23 | Intel Corporation | Detection of humans in images using depth information |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111064929A (en) * | 2019-12-16 | 2020-04-24 | 佛山科学技术学院 | Video data acquisition system based on LoRa wireless transmission |
| CN112381797A (en) * | 2020-11-16 | 2021-02-19 | 广东电网有限责任公司肇庆供电局 | Infrared data-based line object information confirmation method |
| CN114912755A (en) * | 2022-04-13 | 2022-08-16 | 西安卓越视讯科技有限公司 | All-weather comprehensive early warning and monitoring method, system and device for airport flight area |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108184096B (en) | 2020-09-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110297498B (en) | Track inspection method and system based on wireless charging unmanned aerial vehicle | |
| US11748898B2 (en) | Methods and system for infrared tracking | |
| Luo et al. | A survey of intelligent transmission line inspection based on unmanned aerial vehicle | |
| JP6496323B2 (en) | System and method for detecting and tracking movable objects | |
| CN106203265B (en) | A kind of Construction Fugitive Dust Pollution source monitors automatically and coverage forecasting system and method | |
| US10438062B1 (en) | Cascade recognition for personal tracking via unmanned aerial vehicle (UAV) | |
| CN105425815B (en) | A kind of pasture intelligent management system and method using unmanned vehicle | |
| CN112269398B (en) | Unmanned aerial vehicle of transformer substation independently patrols and examines system | |
| Zormpas et al. | Power transmission lines inspection using properly equipped unmanned aerial vehicle (UAV) | |
| CN105512628A (en) | Vehicle environment sensing system and method based on unmanned plane | |
| CN108184096A (en) | Run skating area full view monitoring device, system and method in a kind of airport | |
| CN204256523U (en) | A kind ofly inspect line inspection device based on the infrared of unmanned aerial vehicle platform | |
| Luo et al. | Object-aware power line detection using color and near-infrared images | |
| Shen et al. | Person tracking and frontal face capture with UAV | |
| CN109782793A (en) | Unmanned plane rescue mode and system | |
| CN107026959A (en) | A kind of image-pickup method and image capture device | |
| CN108074265A (en) | A kind of tennis alignment system, the method and device of view-based access control model identification | |
| CN112702481A (en) | Table tennis track tracking device and method based on deep learning | |
| CN107256034B (en) | Change distribution room multiple spot environmental data collection system based on unmanned aerial vehicle | |
| CN205787918U (en) | A kind of detection system of the automatic decision unmanned plane direction of motion | |
| Xu et al. | Development of power transmission line detection technology based on unmanned aerial vehicle image vision | |
| CN109145905A (en) | A kind of transmission line of electricity accessory detection method of view-based access control model conspicuousness | |
| CN109708659B (en) | Distributed intelligent photoelectric low-altitude protection system | |
| Li et al. | Online monitoring of overhead power lines against tree intrusion via a low-cost camera and mobile edge computing approach | |
| AU2021105629A4 (en) | System and Method for Monitoring, Detecting and Counting Fruits in a Field |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200911 Termination date: 20220108 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |