CN104616322A - Onboard infrared target image identifying and tracking method and device - Google Patents

Onboard infrared target image identifying and tracking method and device Download PDF

Info

Publication number
CN104616322A
CN104616322A CN201510073274.8A CN201510073274A CN104616322A CN 104616322 A CN104616322 A CN 104616322A CN 201510073274 A CN201510073274 A CN 201510073274A CN 104616322 A CN104616322 A CN 104616322A
Authority
CN
China
Prior art keywords
target
tracking
rotary head
moment
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510073274.8A
Other languages
Chinese (zh)
Inventor
袁健
周忠海
张�浩
李俊晓
牟华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oceanographic Instrumentation Research Institute Shandong Academy of Sciences
Original Assignee
Oceanographic Instrumentation Research Institute Shandong Academy of Sciences
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oceanographic Instrumentation Research Institute Shandong Academy of Sciences filed Critical Oceanographic Instrumentation Research Institute Shandong Academy of Sciences
Priority to CN201510073274.8A priority Critical patent/CN104616322A/en
Publication of CN104616322A publication Critical patent/CN104616322A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10048Infrared image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30244Camera pose

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Analysis (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention discloses an onboard infrared target image identifying and tracking method and an onboard infrared target image identifying and tracking device. The identifying and tracking device comprises an up-working controller, a servo control slave computer, a rotating holder, a video gathering card, a searching lamp, an infrared camera, and a tracking control software. Through the up-working controller and the tracking control software, identifying and tracking commands of a moving object are generated and the rotating angle of the holder is controlled, the control commands of the up-working controller are received by the servo control slave computer so that the holder is driven to rotate with a certain angle to track the object, the searching lamp and the infrared camera are fixed to the holder, and objective infrared images are gathered by the video gathering card via the infrared camera and uploaded to the up-working controller so that the tracked object can be in real time identified by the searching lamp. According to the method and the device, the infrared moving objects can be extracted, tracked and locked, and the moving object can be quickly extracted, the tracked object cannot be lost and the rotation of the holder can be in advance estimated, thus the method and the device can be widely used for identifying and warning the moving objects in the port and offshore, for early warning.

Description

Boat-carrying infrared target image identification tracking and device thereof
Technical field
The present invention relates to a kind of boat-carrying infrared target image identification tracking and device thereof.
Background technology
Sea moving object detection, recognition and tracking technology have important purposes in occasions such as coast defence safety, customs management, marine anti-smuggling and harbour allocation of ships.Based on the target travel detection and tracking of infrared imaging, all have broad application prospects in dual-use field.But having that motion detects, the high-intelligentization supervisory system of Target Segmentation and target following must relate to image operation consuming time in a large number simultaneously, being difficult to well take into account reliability and real-time under active computer processing speed simultaneously.The technical barrier of current existence is mainly: the target recognition and tracking 1) in complicated dynamic background situation; 2) hysteresis quality of cloud platform rotation and Video processing time delay cannot meet real-time; 4) the blocking and again search for of moving target.These problems all constrain the application in practice of sea Algorithms for Moving Target Recogntion above.
Summary of the invention
The technical problem to be solved in the present invention is to provide a kind of boat-carrying infrared target image identification tracking means.
The another one technical matters that the present invention will solve is to provide a kind of boat-carrying infrared target image identification tracking.
For boat-carrying infrared target image identification tracking means, the technical solution used in the present invention is: comprise upper industrial computer, servocontrol slave computer, rotary head, video frequency collection card, search lamp, infrared camera;
Upper industrial computer is connected with servocontrol slave computer, and servocontrol slave computer is connected with rotary head and controls rotary head makes all-direction rotation; Rotary head is fixedly equipped with search lamp, infrared camera, infrared camera is connected with upper industrial computer by video frequency collection card, and search lamp is synchronous with the sensing of infrared camera.
As preferably, video frequency collection card is connected with upper industrial computer by USB serial ports.
As preferably, search lamp is high-power sodium vapor lamp.
For boat-carrying infrared target image identification tracking, the technical solution used in the present invention comprises the following steps:
(1) motion estimate
First infrared camera is utilized to carry out image sequence acquisition, obtain the original image of target, target image signal is sent in industrial computer, operator selectes target to be locked, by industrial computer as CPU (central processing unit), Tracking Control Software adopts corresponding image processing method to process to image respectively, extracts comparatively complete target to be tracked from original image; Frame differential method is used to judge whether there is moving target in video sequence, and determine the position of target, frame differential method adopts the difference based on pixel grey scale to two two field pictures before and after a Minimum-time interval, then extracts the moving region in image with thresholding method, and algorithm is:
M ( x , y , t ) = 1 , f ( x , y , t ) - f ( x , y , t - Δt ) > τ 0 , f ( x , y , t ) - f ( x , y , t - Δt ) ≤ τ
In above formula, Δ t is inter frame temporal interval, f (x, y, t) and f (x, y, t-Δ t)) be respectively the picture frame of t and t-Δ t; If the absolute difference of two two field picture respective pixel gray scales is greater than threshold tau, then shows that this pixel is sport foreground, then its value is put 1, otherwise for static background, its value is set to 0, bianry image M (x, y, t) can be obtained;
(2) tracking of moving target
Adopt CamShift algorithm to carry out motion target tracking, algorithm is as follows:
The first step, calculates the 1D histogram of H passage (color channel) component in image HSI space;
Second step, utilizes this 1D histogram that former figure is reconstructed into 2D probability distribution graph;
3rd step, calculates the center of target area;
4th step, utilizes CamShift algorithm, and continuous translation adjustment window center overlaps to target barycentric;
5th step, by the window size of previous frame and center, as the initial value of next frame CamShift algorithm search window;
6th step, continues CamShift computing in the next frame;
(3) rotary head rotates and controls
Kalman filtering algorithm is adopted to carry out the prediction of moving target state, to realize the rotation in advance of rotary head; Target subsequent time position can be turned in advance according to prediction rotary head, adopt Kalman filtering algorithm to carry out the motion state of predicted motion target, utilize the recurrence estimation ability of filtering to predict subsequent time target location; System noise and observation noise are considered as white Gaussian noise, measure as systematic perspective using the position of moving target, with institute's syllabus target location estimation value for exporting, moving target current motion state being made and estimates and Future movement state is made prediction;
State equation and the observation equation of Target Tracking System system are respectively:
x ( k + 1 ) = φx ( k ) + w ( k ) z ( k ) = Hx ( k ) + v ( k )
In above formula: x (k) ∈ R 6for state vector, represent the position of moving target, speed and acceleration, its expression formula is x (k)=[x y x vy vx ay a] t; Z (k) ∈ R 2for observation vector, represent the position of moving target; W (k) ∈ R 6it is systematic procedure noise vector; V (k) ∈ R 6it is observation noise vector; φ ∈ R 6 × 6be state-transition matrix, its expression formula is:
φ = 1 0 T 0 T 2 / 2 0 0 1 0 T 0 T 2 / 2 0 0 1 0 T 0 0 0 0 1 0 T 0 0 0 0 1 0 0 0 0 0 0 1
H is observing matrix, and need the position observing moving target here, its expression formula is
H = 1 0 0 0 0 0 0 1 0 0 0 0
System noise and observation noise are mutual incoherent white Gaussian noise;
Employing time equal interval sampling is for the target following of infrared camera; When observing a certain moment target location, pre-estimation in time the most probable position that next moment target occurs can be gone out, so that infrared camera adjusts angle in time, quick tracking target; When known system original state, obtain x (1/1) according to the obserred coordinate value Kalman filtering of current kinetic target, and then prediction x (2/1), concrete Kalman filter equation is as follows:
x(k/k)=x(k/k-1)+K(k)(z(k)-Hx(k/k-1))
x(k/k-1)=φx(k-1/k-1))
K(k)=P(k/k-1)H T(HP(k/k-1)H T+R(k)) -1
P(k/k-1)=φP(k-1/k-1)φ T+Q(k-1)
P(k/k)=(I-K(k)H)P(k/k-1)
In various above, k=1,2,3 ... x (k/k-1) and P (k/k-1) is status predication value and minimum prediction Square Error matrix thereof, K (k) is Kalman filtering gain matrix, and z (k) ceases for observation is new, and x (k/k) and P (k/k) is the state estimation and error co-variance matrix thereof revised;
Obtain the position of target during k moment, then can obtain the position angle of target according to positional information, according to kalman filter forecasting moving target after the position in k+1 moment, the position angle in k+1 moment can be calculated to obtain equally, Δ θ=θ k+1k, the rotational angular velocity of known rotary head, therefore the control to rotary head can be reached by the rotation time arranging rotary head; When moving target enters the observation scope of infrared camera, infrared camera, can according to the coordinate (x, y) of each moment moving target of these information acquisitions after photographing image; Before not obtaining new measured value z (k) in k moment, the estimation can only made from the k-1 moment signal, estimates status signal x (k) in k moment; After the present co-ordinate position recording k moment target, just can obtain the time of day optimal estimation value x (k|k) of target; Corrected Calculation is carried out to predicted value and goes out the observed reading x (k+1|k) of target at k-1 moment most probable position, the deflection angle of target can be obtained according to coordinate position, control the rotation time of rotary head according to deflection angle.
The invention has the beneficial effects as follows:
The present invention is showing on the basis of image in real time, and real-time detection and tracking moving target, detection and tracking have higher robustness to the complex background under marine environment and all kinds of disturbance factor.In tracing process, even if target keeps static, program also can not lose the tracking to target.By hysteresis quality and the Video processing time delay of kalman filtering algorithm process cloud platform rotation, host computer sends steering order by serial ports to The Cloud Terrace, The Cloud Terrace accepts the instruction that host computer sends, camera and search lamp is driven to turn to target location, target is made to be in the immediate vicinity of shooting screen all the time, thus the Real time identification realized sea moving target and tracking.
Accompanying drawing explanation
Below in conjunction with the drawings and specific embodiments, the present invention is further detailed explanation.
Fig. 1 is the structural representation of boat-carrying infrared target image identification tracking means embodiment of the present invention.
Fig. 2 is the Motion estimation software block diagram of the employing Kalman filter of boat-carrying infrared target image identification tracking embodiment of the present invention.
Mark in Fig. 1: the upper industrial computer of 1-, 2-servocontrol slave computer, 3-rotary head, 4-infrared camera, 5-searches for lamp, 6-video frequency collection card.
Embodiment
Fig. 1 is a kind of boat-carrying infrared target image identification tracking means, is made up of upper industrial computer 1, servocontrol slave computer 2, rotary head 3, video frequency collection card 6, search lamp 5, infrared camera 4 and corresponding Tracking Control Software.
Upper industrial computer 1 is connected with servocontrol slave computer 2, and servocontrol slave computer 2 is connected with rotary head 3 and controls rotary head makes all-direction rotation.Search lamp 5, infrared camera 4 rotary head 3 be fixedly equipped with, wherein search for lamp 5 and adopt high-power sodium vapor lamp, and the top of thermal camera 4 is supported on support, make infrared camera 4 and search lamp 5 can make omnibearing synchronous axial system along with rotary head, and it is synchronous with the sensing of infrared camera to search for lamp.Infrared camera 4 is connected with upper industrial computer 1 by video frequency collection card 6, and wherein video frequency collection card 6 is connected with upper industrial computer by USB serial ports.
Whole tracing process comprise image collection, image procossing target localization, target prediction, adjust The Cloud Terrace according to side-play amount and complete tracking.Upper industrial computer and Tracking Control Software complete the identification of moving target and trace command generates, control the anglec of rotation of The Cloud Terrace, servocontrol slave computer receive host computer steering order drive The Cloud Terrace rotate to an angle realize target follow the tracks of, search lamp and infrared camera are fixed on The Cloud Terrace, video frequency collection card gathers Infrared Targets image by infrared camera, and uploading to upper industrial computer, search lamp realizes the Real time identification to tracking target.
Concrete steps are as follows:
(1) motion estimate
First utilize infrared camera to carry out image sequence acquisition, obtain the original image of target, target image signal is sent in industrial computer, and operator selectes target to be locked.By industrial computer as CPU (central processing unit), Tracking Control Software adopts corresponding image processing method to process to image respectively, extracts comparatively complete target to be tracked from original image.Tracking Control Software uses frame differential method to judge whether there is moving target in video sequence, and determines the position of target.
Frame differential method, by adjacent two frames in sequence of video images or multiframe are done calculus of differences to cut down the region that there is not change, extracts the moving target in image.Frame differential method adopts the difference based on pixel grey scale to two two field pictures before and after a Minimum-time interval, then extracts the moving region in image with thresholding method, and algorithm is:
M ( x , y , t ) = 1 , f ( x , y , t ) - f ( x , y , t - Δt ) > τ 0 , f ( x , y , t ) - f ( x , y , t - Δt ) ≤ τ
In above formula, Δ t is inter frame temporal interval, f (x, y, t) and f (x, y, t-Δ t)) be respectively the picture frame of t and t-Δ t.If the absolute difference of two two field picture respective pixel gray scales is greater than threshold tau, then shows that this pixel is sport foreground, then its value is put 1, otherwise for static background, its value is set to 0, bianry image M (x, y, t) can be obtained.
After completing the segmentation of target image, the position of target current time can be obtained from image information, and compare with image center location, when the motion state of known target current time, by Forecasting Methodology, reasonable estimation is made to the target location of target subsequent time and speed, according to the target location side-play amount produced, by serial ports, to rotary head, steering order is sent to servo controller, rotary head accepts the instruction that servo controller sends, timely drive infrared camera turns to target predicted position, and target is in the immediate vicinity of shooting screen all the time.
(2) tracking of moving target
The present embodiment adopts CamShift algorithm to carry out motion target tracking, can overcome the large shortcoming with being subject to block interference of the calculated amount existed in conventional correlation algorithm preferably.Make full use of the result of moving object detection, improve matching efficiency during target following, and adopt threshold cutoff technology, reduce the hunting zone of target, realize the quick and precisely tracking to target.
Algorithm is as follows:
The first step, calculates the 1D histogram of H passage (color channel) component in image HSI space;
Second step, utilizes this 1D histogram that former figure is reconstructed into 2D probability distribution graph;
3rd step, calculates the center of target area;
4th step, utilizes CamShift algorithm, and continuous translation adjustment window center overlaps to target barycentric;
5th step, by the window size of previous frame and center, as the initial value of next frame CamShift algorithm search window;
6th step, continues CamShift computing in the next frame.
The algorithm operation quantity of the moving object segmentation that the present embodiment proposes and tracking is little, and tracking effect is good.As long as capture target initial errorless, and object and background has certain deviation on color space, video tracking just can reach suitable accuracy.
(3) rotary head rotates and controls
There is sampling time delay in the image taking mechanism due to infrared camera, the existence of the comparatively slow and process time delay of the velocity of rotation of rotary head, all may make to drive infrared photography cephalomotor rotary head cannot tracking target in time, particularly for movement velocity target faster.To real-time follow-up target, will look-ahead target travel.The present invention proposes to adopt kalman filtering algorithm to carry out the prediction of moving target state, and to realize the rotation in advance of rotary head, control flow chart is as Fig. 2.
The present embodiment can turn to target subsequent time position in advance according to prediction rotary head, adopts Kalman filtering algorithm to carry out the motion state of predicted motion target, utilizes the recurrence estimation ability of filtering to predict subsequent time target location.System noise and observation noise are considered as white Gaussian noise, measure as systematic perspective using the position of moving target, with institute's syllabus target location estimation value for exporting, moving target current motion state being made and estimates and Future movement state is made prediction.
State equation and the observation equation of Target Tracking System system are respectively:
x ( k + 1 ) = φx ( k ) + w ( k ) z ( k ) = Hx ( k ) + v ( k )
In above formula: x (k) ∈ R 6for state vector, represent the position of moving target, speed and acceleration, its expression formula is x (k)=[x y x vy vx ay a] t; Z (k) ∈ R 2for observation vector, represent the position of moving target; W (k) ∈ R 6it is systematic procedure noise vector; V (k) ∈ R 6it is observation noise vector; φ ∈ R 6 × 6be state-transition matrix, its expression formula is:
φ = 1 0 T 0 T 2 / 2 0 0 1 0 T 0 T 2 / 2 0 0 1 0 T 0 0 0 0 1 0 T 0 0 0 0 1 0 0 0 0 0 0 1
H is observing matrix, and need the position observing moving target here, its expression formula is
H = 1 0 0 0 0 0 0 1 0 0 0 0
System noise and observation noise are mutual incoherent white Gaussian noise.
The present embodiment adopts time equal interval sampling for the target following of infrared camera.When observing a certain moment target location, pre-estimation in time the most probable position that next moment target occurs can be gone out, so that infrared camera adjusts angle in time, quick tracking target.When known system original state, obtain x (1/1) according to the obserred coordinate value Kalman filtering of current kinetic target, and then prediction x (2/1), concrete Kalman filter equation is as follows:
x(k/k)=x(k/k-1)+K(k)(z(k)-Hx(k/k-1))
x(k/k-1)=φx(k-1/k-1))
K(k)=P(k/k-1)H T(HP(k/k-1)H T+R(k)) -1
P(k/k-1)=φP(k-1/k-1)φ T+Q(k-1)
P(k/k)=(I-K(k)H)P(k/k-1)
In various above, k=1,2,3 ... x (k/k-1) and P (k/k-1) is status predication value and minimum prediction Square Error matrix thereof, K (k) is Kalman filtering gain matrix, and z (k) ceases for observation is new, and x (k/k) and P (k/k) is the state estimation and error co-variance matrix thereof revised.
Obtain the position of target during k moment, then can obtain the position angle of target according to positional information, according to kalman filter forecasting moving target after the position in k+1 moment, the position angle in k+1 moment can be calculated to obtain equally, Δ θ=θ k+1k, the rotational angular velocity of known rotary head, therefore the control to rotary head can be reached by the rotation time arranging rotary head.When moving target enters the observation scope of infrared camera, infrared camera, can according to the coordinate (x, y) of each moment moving target of these information acquisitions after photographing image.Before not obtaining new measured value z (k) in k moment, the estimation can only made from the k-1 moment signal, estimates status signal x (k) in k moment.After the present co-ordinate position recording k moment target, just can obtain the time of day optimal estimation value x (k|k) of target.Corrected Calculation is carried out to predicted value and goes out the observed reading x (k+1|k) of target at k-1 moment most probable position, the deflection angle of target can be obtained according to coordinate position, control the rotation time of rotary head according to deflection angle.Because the motion of now rotary head has certain lead, thus eliminate tracking lag phenomenon preferably.
Global search problem, by target of prediction object position in the next frame, is converted into Local Search by the present embodiment, improves the real-time of algorithm; Meanwhile, utilize predicted value effectively can prevent the interference of similar features object in background, improve the accuracy of algorithm.
Above-described embodiment of the present invention, does not form limiting the scope of the present invention.Any amendment done within the spirit and principles in the present invention, equivalent replacement and improvement etc., all should be included within claims of the present invention.

Claims (5)

1. boat-carrying infrared target image identification tracking means, is characterized in that: comprise upper industrial computer, servocontrol slave computer, rotary head, video frequency collection card, search lamp, infrared camera;
Described upper industrial computer is connected with servocontrol slave computer, and described servocontrol slave computer is connected with rotary head and controls rotary head and rotates; Described rotary head is fixedly equipped with search lamp, infrared camera, described infrared camera is connected with upper industrial computer by video frequency collection card, and described search lamp is synchronous with the sensing of infrared camera.
2. boat-carrying infrared target image identification tracking means according to claim 1, is characterized in that: described video frequency collection card is connected with upper industrial computer by USB serial ports.
3. boat-carrying infrared target image identification tracking means according to claim 1, is characterized in that: described search lamp is high-power sodium vapor lamp.
4. boat-carrying infrared target image identification tracking means according to claim 1, is characterized in that: described servocontrol slave computer controls rotary head and does upper and lower, left and right full angle rotation.
5. boat-carrying infrared target image identification tracking, is characterized in that comprising the following steps:
(1) motion estimate
First infrared camera is utilized to carry out image sequence acquisition, obtain the original image of target, target image signal is sent in industrial computer, operator selectes target to be locked, by industrial computer as CPU (central processing unit), Tracking Control Software adopts corresponding image processing method to process to image respectively, extracts comparatively complete target to be tracked from original image; Frame differential method is used to judge whether there is moving target in video sequence, and determine the position of target, frame differential method adopts the difference based on pixel grey scale to two two field pictures before and after a Minimum-time interval, then extracts the moving region in image with thresholding method, and algorithm is:
M ( x , y , t ) = 1 , f ( x , y , t ) - f ( x , y , t - Δt ) > τ 0 , f ( x , y , t ) - f ( x , y , t - Δt ) ≤ τ
In above formula, Δ t is inter frame temporal interval, f (x, y, t) and f (x, y, t-Δ t)) be respectively the picture frame of t and t-Δ t; If the absolute difference of two two field picture respective pixel gray scales is greater than threshold tau, then shows that this pixel is sport foreground, then its value is put 1, otherwise for static background, its value is set to 0, bianry image M (x, y, t) can be obtained;
(2) tracking of moving target
Adopt CamShift algorithm to carry out motion target tracking, algorithm is as follows:
The first step, calculates the 1D histogram of H passage (color channel) component in image HSI space;
Second step, utilizes this 1D histogram that former figure is reconstructed into 2D probability distribution graph;
3rd step, calculates the center of target area;
4th step, utilizes CamShift algorithm, and continuous translation adjustment window center overlaps to target barycentric;
5th step, by the window size of previous frame and center, as the initial value of next frame CamShift algorithm search window;
6th step, continues CamShift computing in the next frame;
(3) rotary head rotates and controls
Kalman filtering algorithm is adopted to carry out the prediction of moving target state, to realize the rotation in advance of rotary head; Target subsequent time position can be turned in advance according to prediction rotary head, adopt Kalman filtering algorithm to carry out the motion state of predicted motion target, utilize the recurrence estimation ability of filtering to predict subsequent time target location; System noise and observation noise are considered as white Gaussian noise, measure as systematic perspective using the position of moving target, with institute's syllabus target location estimation value for exporting, moving target current motion state being made and estimates and Future movement state is made prediction;
State equation and the observation equation of Target Tracking System system are respectively:
x ( k + 1 ) = φx ( k ) + w ( k ) z ( k ) = Hx ( k ) + v ( k )
In above formula: x (k) ∈ R 6for state vector, represent the position of moving target, speed and acceleration, its expression formula is x (k)=[x y x vy vx ay a] t; Z (k) ∈ R 2for observation vector, represent the position of moving target; W (k) ∈ R 6it is systematic procedure noise vector; V (k) ∈ R 6it is observation noise vector; φ ∈ R 6 × 6be state-transition matrix, its expression formula is:
φ = 1 0 T 0 T 2 / 2 0 0 1 0 T 0 T 2 / 2 0 0 1 0 T 0 0 0 0 1 0 T 0 0 0 0 1 0 0 0 0 0 0 1
H is observing matrix, and need the position observing moving target here, its expression formula is
H = 1 0 0 0 0 0 0 1 0 0 0 0
System noise and observation noise are mutual incoherent white Gaussian noise;
Employing time equal interval sampling is for the target following of infrared camera; When observing a certain moment target location, pre-estimation in time the most probable position that next moment target occurs can be gone out, so that infrared camera adjusts angle in time, quick tracking target; When known system original state, obtain x (1/1) according to the obserred coordinate value Kalman filtering of current kinetic target, and then prediction x (2/1), concrete Kalman filter equation is as follows:
x(k/k)=x(k/k-1)+K(k)(z(k)-Hx(k/k-1))
x(k/k-1)=φx(k-1/k-1))
K(k)=P(k/k-1)H T(HP(k/k-1)H T+R(k)) -1
P(k/k-1)=φP(k-1/k-1)φ T+Q(k-1)
P(k/k)=(I-K(k)H)P(k/k-1)
In various above, k=1,2,3 ... x (k/k-1) and P (k/k-1) is status predication value and minimum prediction Square Error matrix thereof, K (k) is Kalman filtering gain matrix, and z (k) ceases for observation is new, and x (k/k) and P (k/k) is the state estimation and error co-variance matrix thereof revised;
Obtain the position of target during k moment, then can obtain the position angle of target according to positional information, according to kalman filter forecasting moving target after the position in k+1 moment, the position angle in k+1 moment can be calculated to obtain equally, Δ θ=θ k+1k, the rotational angular velocity of known rotary head, therefore the control to rotary head can be reached by the rotation time arranging rotary head; When moving target enters the observation scope of infrared camera, infrared camera, can according to the coordinate (x, y) of each moment moving target of these information acquisitions after photographing image; Before not obtaining new measured value z (k) in k moment, the estimation can only made from the k-1 moment signal, estimates status signal x (k) in k moment; After the present co-ordinate position recording k moment target, just can obtain the time of day optimal estimation value x (k|k) of target; Corrected Calculation is carried out to predicted value and goes out the observed reading x (k+1|k) of target at k-1 moment most probable position, the deflection angle of target can be obtained according to coordinate position, control the rotation time of rotary head according to deflection angle.
CN201510073274.8A 2015-02-10 2015-02-10 Onboard infrared target image identifying and tracking method and device Pending CN104616322A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510073274.8A CN104616322A (en) 2015-02-10 2015-02-10 Onboard infrared target image identifying and tracking method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510073274.8A CN104616322A (en) 2015-02-10 2015-02-10 Onboard infrared target image identifying and tracking method and device

Publications (1)

Publication Number Publication Date
CN104616322A true CN104616322A (en) 2015-05-13

Family

ID=53150755

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510073274.8A Pending CN104616322A (en) 2015-02-10 2015-02-10 Onboard infrared target image identifying and tracking method and device

Country Status (1)

Country Link
CN (1) CN104616322A (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105551030A (en) * 2015-12-09 2016-05-04 上海精密计量测试研究所 Infrared target source positioning tracking calibration method
CN106254836A (en) * 2016-09-19 2016-12-21 南京航空航天大学 Unmanned plane infrared image Target Tracking System and method
CN107093179A (en) * 2017-03-07 2017-08-25 北京环境特性研究所 Localization method is searched for for the two waveband fire in wide area space
CN108259703A (en) * 2017-12-31 2018-07-06 深圳市秦墨科技有限公司 A kind of holder with clapping control method, device and holder
CN108732643A (en) * 2018-03-27 2018-11-02 中国人民解放军海军大连舰艇学院 Two step calculating methods of novel boat-carrying infrared detection system EFFECTIVE RANGE under the conditions of a kind of sea fog
CN110334674A (en) * 2019-07-10 2019-10-15 哈尔滨理工大学 A kind of tracking of plane free body track identification and prediction technique
WO2020078140A1 (en) * 2018-10-16 2020-04-23 北京理工大学 Optimization system and method for motion model
CN111093050A (en) * 2018-10-19 2020-05-01 浙江宇视科技有限公司 Target monitoring method and device
CN111462189A (en) * 2020-04-16 2020-07-28 吉林大学 Image locking and tracking system and method
CN111857188A (en) * 2020-07-21 2020-10-30 南京航空航天大学 Aerial remote target follow-shooting system and method
CN111877290A (en) * 2020-08-10 2020-11-03 重庆交通大学 Intelligent water surface cleaning robot
CN113395448A (en) * 2021-06-15 2021-09-14 西安视成航空科技有限公司 Airborne pod image searching, tracking and processing system
CN114982217A (en) * 2020-12-30 2022-08-30 深圳市大疆创新科技有限公司 Control method and device of holder, movable platform and storage medium
CN116503814A (en) * 2023-05-24 2023-07-28 北京安录国际技术有限公司 Personnel tracking method and system for analysis

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN200969656Y (en) * 2006-11-09 2007-10-31 乔少明 Vehicle infrared monitor
CN101649952A (en) * 2009-07-21 2010-02-17 浙江大学 Locking tracking servo console with two degrees of freedom
US20100213387A1 (en) * 2009-02-23 2010-08-26 Morteza Safai Portable corrosion detection apparatus
CN103412345A (en) * 2013-08-16 2013-11-27 中国舰船研究设计中心 Automatic aircraft carrier flight deck foreign matter detection and recognition system
CN204066317U (en) * 2014-07-02 2014-12-31 天津金海河科技有限公司 A kind of multifunctional remote controls clouds terrace system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN200969656Y (en) * 2006-11-09 2007-10-31 乔少明 Vehicle infrared monitor
US20100213387A1 (en) * 2009-02-23 2010-08-26 Morteza Safai Portable corrosion detection apparatus
CN101649952A (en) * 2009-07-21 2010-02-17 浙江大学 Locking tracking servo console with two degrees of freedom
CN103412345A (en) * 2013-08-16 2013-11-27 中国舰船研究设计中心 Automatic aircraft carrier flight deck foreign matter detection and recognition system
CN204066317U (en) * 2014-07-02 2014-12-31 天津金海河科技有限公司 A kind of multifunctional remote controls clouds terrace system

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105551030A (en) * 2015-12-09 2016-05-04 上海精密计量测试研究所 Infrared target source positioning tracking calibration method
CN106254836A (en) * 2016-09-19 2016-12-21 南京航空航天大学 Unmanned plane infrared image Target Tracking System and method
CN107093179A (en) * 2017-03-07 2017-08-25 北京环境特性研究所 Localization method is searched for for the two waveband fire in wide area space
CN108259703B (en) * 2017-12-31 2021-06-01 深圳市越疆科技有限公司 Pan-tilt and pan-tilt tracking control method and device and pan-tilt
CN108259703A (en) * 2017-12-31 2018-07-06 深圳市秦墨科技有限公司 A kind of holder with clapping control method, device and holder
CN108732643A (en) * 2018-03-27 2018-11-02 中国人民解放军海军大连舰艇学院 Two step calculating methods of novel boat-carrying infrared detection system EFFECTIVE RANGE under the conditions of a kind of sea fog
WO2020078140A1 (en) * 2018-10-16 2020-04-23 北京理工大学 Optimization system and method for motion model
CN111093050A (en) * 2018-10-19 2020-05-01 浙江宇视科技有限公司 Target monitoring method and device
CN111093050B (en) * 2018-10-19 2021-03-09 浙江宇视科技有限公司 Target monitoring method and device
CN110334674A (en) * 2019-07-10 2019-10-15 哈尔滨理工大学 A kind of tracking of plane free body track identification and prediction technique
CN111462189A (en) * 2020-04-16 2020-07-28 吉林大学 Image locking and tracking system and method
CN111857188A (en) * 2020-07-21 2020-10-30 南京航空航天大学 Aerial remote target follow-shooting system and method
CN111877290A (en) * 2020-08-10 2020-11-03 重庆交通大学 Intelligent water surface cleaning robot
CN114982217A (en) * 2020-12-30 2022-08-30 深圳市大疆创新科技有限公司 Control method and device of holder, movable platform and storage medium
CN113395448A (en) * 2021-06-15 2021-09-14 西安视成航空科技有限公司 Airborne pod image searching, tracking and processing system
CN113395448B (en) * 2021-06-15 2023-02-21 西安视成航空科技有限公司 Airborne pod image searching, tracking and processing system
CN116503814A (en) * 2023-05-24 2023-07-28 北京安录国际技术有限公司 Personnel tracking method and system for analysis
CN116503814B (en) * 2023-05-24 2023-10-24 北京安录国际技术有限公司 Personnel tracking method and system for analysis

Similar Documents

Publication Publication Date Title
CN104616322A (en) Onboard infrared target image identifying and tracking method and device
Huang et al. ClusterVO: Clustering moving instances and estimating visual odometry for self and surroundings
Stokkeland et al. Autonomous visual navigation of unmanned aerial vehicle for wind turbine inspection
Teuliere et al. Chasing a moving target from a flying UAV
CN105652891B (en) A kind of rotor wing unmanned aerial vehicle movement Target self-determination tracks of device and its control method
JP6095018B2 (en) Detection and tracking of moving objects
CN103149939B (en) A kind of unmanned plane dynamic target tracking of view-based access control model and localization method
EP2917874B1 (en) Cloud feature detection
CN111932588A (en) Tracking method of airborne unmanned aerial vehicle multi-target tracking system based on deep learning
US20170160751A1 (en) System and method for controlling drone movement for object tracking using estimated relative distances and drone sensor inputs
US9696404B1 (en) Real-time camera tracking system using optical flow feature points
CN111326023A (en) Unmanned aerial vehicle route early warning method, device, equipment and storage medium
US20220024549A1 (en) System and method for measuring the distance to an object in water
KR101486308B1 (en) Tracking moving objects for mobile robots control devices, methods, and its robot
Fefilatyev et al. Tracking ships from fast moving camera through image registration
JP6349737B2 (en) Moving object tracking device and moving object tracking method
CN112444374B (en) Tracking evaluation method based on optical tracking measurement equipment servo system
Wang et al. Monocular visual SLAM algorithm for autonomous vessel sailing in harbor area
CN110490903B (en) Multi-target rapid capturing and tracking method in binocular vision measurement
Yao et al. LiDAR-based simultaneous multi-object tracking and static mapping in nearshore scenario
US11346670B2 (en) Position estimating device
EP2731050A1 (en) Cloud feature detection
Perron et al. Orbiting a moving target with multi-robot collaborative visual slam
Helgesen et al. Detection and tracking of floating objects using a uav with thermal camera
Yang et al. Moving target tracking and measurement with a binocular vision system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20150513