CN111984036B - Method for tracking fast moving target by fixed-wing unmanned aerial vehicle based on pan-tilt camera - Google Patents
Method for tracking fast moving target by fixed-wing unmanned aerial vehicle based on pan-tilt camera Download PDFInfo
- Publication number
- CN111984036B CN111984036B CN202010892049.8A CN202010892049A CN111984036B CN 111984036 B CN111984036 B CN 111984036B CN 202010892049 A CN202010892049 A CN 202010892049A CN 111984036 B CN111984036 B CN 111984036B
- Authority
- CN
- China
- Prior art keywords
- unmanned aerial
- target
- aerial vehicle
- state
- tracking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 230000008569 process Effects 0.000 claims abstract description 26
- 230000007704 transition Effects 0.000 claims abstract description 15
- 230000000007 visual effect Effects 0.000 claims description 8
- 230000008859 change Effects 0.000 claims description 7
- 230000003287 optical effect Effects 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000009738 saturating Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 7
- 230000006872 improvement Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 5
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000008034 disappearance Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 229920001612 Hydroxyethyl starch Polymers 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 229940064366 hespan Drugs 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/12—Target-seeking control
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
The invention discloses a method for tracking a fast moving target by a fixed wing unmanned aerial vehicle based on a pan-tilt camera, which comprises the following steps: step S1: the whole process is divided into three states of a tracking state, an adjusting state and a transition state, and the unmanned aerial vehicle flies according to a controller designed in an earlier stage when the unmanned aerial vehicle is in the tracking state; step S2: when in the adjusting state, the unmanned aerial vehicle switches the spiral direction, and meanwhile, the holder rotates from one side to the other side to continuously track the target; the transition state is to select to enter a tracking state or an adjustment state according to the current state of the unmanned aerial vehicle, so that the unmanned aerial vehicle is prevented from being far away from a target. The method has the advantages of simple principle, wide application range, capability of improving the tracking performance of the method on the fast moving target and the like.
Description
Technical Field
The invention mainly relates to the technical field of unmanned aerial vehicles, in particular to a method for tracking a fast moving target by a fixed wing unmanned aerial vehicle based on a pan-tilt camera.
Background
The unmanned aerial vehicle executes the target tracking task, which is one of important applications of the unmanned aerial vehicle and is also the basis for defining follow-up tasks. Compared with other types of unmanned aerial vehicles, the fixed-wing unmanned aerial vehicle has the characteristics of long flight time and high speed, and can be used for continuously tracking a ground target. In the whole tracking process, the unmanned aerial vehicle captures a target on the ground through the airborne vision sensor, and obtains the coordinates of the feature points on the image by means of a target detection algorithm. On the basis, the position of the target relative to the unmanned aerial vehicle is solved by the aid of internal and external parameters of the sensor in the traditional method, and then the control law is designed in a three-dimensional space. However, the resolving link has a large error, and the flight speed of the fixed-wing unmanned aerial vehicle is high, so that the tracking effect is greatly influenced. Further, because the ground target is mostly in a moving state, how the fixed-wing drone keeps the target in the field of view through the self-movement and the deflection of the pan-tilt is also one of the key problems to be solved.
Because the fixed-wing unmanned aerial vehicle has the limit of the lowest flying speed and the flying direction has no arbitrariness, the difficulty in tracking the moving target is higher. Reference [1]]A target tracking algorithm is provided, and the fixed-wing unmanned aerial vehicle tracks a moving target by estimating the GPS coordinate, the speed and the orientation of the target and combining a low-cost micro holder. Reference [2]]By estimating the target speed, L is applied 1 The fast adaptive estimator designs a tracking controller, and a single camera with a holder and a high-bandwidth wireless link are provided for the fixed-wing unmanned aerial vehicle for transmitting videos and commands, so that the moving target is tracked by the fast adaptive estimator. Reference [3]The framework is provided, and the tracking of the fixed wing unmanned aerial vehicle on the ground moving target is realized by considering different illumination, calculation limitation, insufficient definition and other factors and adopting the steps of target identification, target positioning, state estimation and unmanned aerial vehicle guidance. It should be noted that, in these control methods, target positioning is performed first, and then the design of the controller is completed by using state estimation and the like, so as to realize the tracking of the fixed-wing drone on the moving target. However, since the moving speed of the fixed-wing drone is fast, if the positioning error is large, the tracking error will be greatly affected. Based on this, reference [4]]An included angle between the orientation of the holder and the flight direction of the unmanned aerial vehicle is enabled to tend to 90 degrees, the controller is designed by directly utilizing the change rate of the target characteristic points through a visual servo method based on images, and the effectiveness of tracking control when the ground target moves slowly is verified. Although the method omits a target positioning link, the method only aims at tracking the target with a slow movement speed. Therefore, how to design a tracking strategy by combining the maneuvering characteristics of the unmanned aerial vehicle is very important for tracking the fast moving target.
The currently used method for tracking and controlling the moving target by the fixed-wing unmanned aerial vehicle mainly has the following two defects:
(1) when the unmanned aerial vehicle performs hovering tracking on a ground target, the position of the unmanned aerial vehicle relative to the ground target needs to be obtained through target positioning, and then state information of the target (such as the movement speed of the target) is obtained through state estimation. For example, the tracking control method for the unmanned aerial vehicle proposed in reference [1-3] is to complete the tracking of the fixed-wing unmanned aerial vehicle on the moving target according to the ideas of target positioning, state estimation and guidance control. However, the target positioning needs to use internal and external parameters of the vision sensor, and the parameters are easy to generate errors in the calibration process, and in addition, the fixed-wing unmanned aerial vehicle is in a high-speed motion state, so that the introduction of errors is easy to cause target loss. In addition, reference [1] needs to obtain the GPS coordinates of the target by means of GPS information, and this method cannot be used when the drone is in a GPS-denied environment. References [1-3] are respectively: [1] dobroodhov V N, Kaminer I, Jones K D, et al, vision-based tracking and motion estimation for moving targets using small UAVs [ C ]//2006American Control reference. IEEE,2006:6pp. [2] Li Z, Hovakiman N, Dobrookhov V, et al, vision-based tracking and motion estimation a using UAV [ C ]//49 IEEE reference on Decision and Decision (CDC) IEEE,2010: 2505. 2510 [3] Wang X, Zhu H, Zhuang D, et al, vision-based detection and motion estimation of a moving targets mounting J [ UAV ]// motion system [ UAV ]// J156, Journal J.156. 9. origin J..
When the controller is designed when the unmanned aerial vehicle orbits around the target, the visual servo control method based on the image is adopted, and the controller is directly designed on the image plane. The method does not need target positioning and state estimation, thereby reducing the influence of positioning errors on the tracking effect of the unmanned aerial vehicle and improving the performance of the unmanned aerial vehicle for tracking the moving target.
(2) When the fixed-wing unmanned aerial vehicle tracks the moving target, the moving target is tracked only by considering the increased degree of freedom of the holder camera, but the target with higher speed is tracked without considering the maneuverability of the unmanned aerial vehicle. After the fixed-wing unmanned aerial vehicle is provided with the cloud platform camera, if the target is in a motion state, the cloud platform can deflect according to the offset position of the target feature point relative to the image center, and therefore the target is kept in a view field. The above references [4-5] are all accomplished under the condition that the moving speed of the target is moderate or slow, that is, the fixed wing drone only needs to fly along a specific hovering direction (clockwise hovering or counterclockwise hovering), and then the target is kept in the field of view by utilizing the moving characteristic of the pan-tilt, so as to realize tracking. However, due to the limitation of mechanical characteristics of the pan-tilt, when the moving speed of the target is too fast, the target will be separated from the view field of the camera after the pan-tilt deflects to the extreme position, and may be continuously far away from the target, so that the unmanned aerial vehicle cannot continue to track. Reference [4] is: [4] orthogonal S A P, Hespan J P, video-Based Target Tracking with a small UAV, Optimization-Based Control protocols [ J ] Control Engineering Practice,2014,32:28-42 [5] Yang L, Liu Z, Wang X, et al.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: aiming at the technical problems in the prior art, the invention provides the method for tracking the fast moving target by the fixed-wing unmanned aerial vehicle based on the pan-tilt camera, which has the advantages of simple principle and wide application range and can improve the tracking performance of the fixed-wing unmanned aerial vehicle on the fast moving target.
In order to solve the technical problems, the invention adopts the following technical scheme:
a method for tracking a fast moving target by a fixed wing unmanned aerial vehicle based on a pan-tilt camera comprises the following steps:
step S1: the whole process is divided into three states of a tracking state, an adjusting state and a transition state, and the unmanned aerial vehicle flies according to a controller designed in an earlier stage when the unmanned aerial vehicle is in the tracking state;
step S2: when in the adjusting state, the unmanned aerial vehicle switches the spiral direction, and meanwhile, the holder rotates from one side to the other side to continuously track the target; the transition state is to select to enter a tracking state or an adjustment state according to the current state of the unmanned aerial vehicle, so that the unmanned aerial vehicle is prevented from being far away from a target.
As a further improvement of the process of the invention: the automaton model is divided into three states, called tracking states respectively
Adjustment state
Transition state
And determines a conversion relationship between them.
As a further improvement of the process of the invention: in a tracking state, the fixed-wing unmanned aerial vehicle performs spiral tracking around a target, an image-based visual servo control method is adopted, and the design of a controller is represented as follows:
wherein u is ψ See the previous work on the invention. At u p And u t In the design formula of (2), λ u And λ v A positive constant, the goal is to force the object on the current image toward the center of the image.
As a further improvement of the process of the invention: in the state of adjustment, when theta is equal to 1 When the condition is met and the unmanned aerial vehicle still flies along the current hovering direction, the posture of the holder quickly reaches saturation, so that the target moves to the image edge until the target disappears; let the drone change hover direction, on the other hand let the pan-tilt rotate to the other side of the drone, defining the process as
Status.
As a further improvement of the process of the invention: make the unmanned plane with the maximum yaw rate
The adjustment is carried out, and meanwhile, the tripod head also has the maximum deflection angle speed
And
adjusting; the desired angle for the pan-tilt to deflect to the other side is
And
these two angles need to be determined to ensure that the target can be detected again; considering that the larger the angle at which the drone is deflected to the other side, the larger the area swept by the camera and thus the faster the target can be detected. Thus, if the current yaw angle of the pan/tilt head is
(<0) Then, then
Is gamma p The elapsed time is:
as a further improvement of the process of the invention:
the determination needs to be dependent on
And the position of the drone relative to the target; o is 1 Denotes Θ 1 Position of the drone just when satisfied, O 2 Representing the position of the drone after a time of Δ 2; the corresponding optical axes of the cameras at the two positions are O 1 B 1 And O 2 B 2 And is less than G 1 O 2 B 2 Representing half the camera field angle.
As a further improvement of the process of the invention: in the transition state, marking the mark whether the target is detected as N t When the object is detected N t 1, otherwise N t 0; order to
As a further improvement of the process of the invention: when theta is higher than theta 2 When the conditions are met, the unmanned aerial vehicle leaves
A state; o is 1 ，O 2 And O 3 Indicating the position of the drone, O 2 H 2 And O 3 H 3 Normal, O, representing the unmanned aerial vehicle trajectory at that point 2 C 1 And O 3 C 2 Represents the camera optical axis; when the unmanned aerial vehicle is positioned at O 1 Then the target is detected for the first time, when it is located at the edge of the image; if the next state is
The cradle head needs to make the target tend to the center of the image by adjusting the posture, so that the posture of the cradle head continues to increase; when the target is at O 2 When it reaches near the center of the image, Θ 1 May be satisfied again, causing the drone to re-enter
Status. O is 3 The same applies to the case.
Compared with the prior art, the invention has the advantages that:
1. the invention discloses a method for tracking a fast moving target by a fixed wing unmanned aerial vehicle based on a pan-tilt camera, which is a tracking strategy based on three state transitions, and comprehensively considers the motion characteristics of the unmanned aerial vehicle and the pan-tilt so as to improve the tracking performance of the fixed wing unmanned aerial vehicle on the fast moving target. Firstly, the whole process is divided into three states of a tracking state, an adjusting state and a transition state, and the unmanned aerial vehicle flies according to a controller designed in an earlier stage when the unmanned aerial vehicle is in the tracking state; when in the adjusting state, the unmanned aerial vehicle switches the spiral direction (if the current spiral is clockwise, the spiral direction is changed into anticlockwise spiral), and meanwhile, the tripod head rotates from one side to the other side to continuously track the target; the transition state is to select to enter a tracking state or an adjustment state according to the current state of the unmanned aerial vehicle, so that the unmanned aerial vehicle is prevented from being far away from a target. In short, the motion performance of the unmanned aerial vehicle and the motion performance of the holder are integrated, and the fixed-wing unmanned aerial vehicle can track the fast moving target.
2. According to the method for tracking the fast moving target by the fixed wing unmanned aerial vehicle based on the pan-tilt camera, when the controller of the unmanned aerial vehicle in the process of circling around the target is designed, the three-dimensional space position of the target does not need to be calculated. The control process adopts a visual servo method based on images, takes the geometric center of a target on the images as a characteristic point, and directly designs a control law on an image plane. The design method realizes the direct mapping from the change rate of the characteristic points to the control of the whole system, and the target position is not required to be calculated through the calibration of the sensor parameters, so that the error in the parameter calibration process is avoided, and the tracking performance is improved.
3. According to the method for tracking the fast moving target by the fixed wing unmanned aerial vehicle based on the pan-tilt camera, the maneuverability of the unmanned aerial vehicle is increased on the basis of improving the tracking performance of the unmanned aerial vehicle by using pan-tilt deflection, so that the performance of the unmanned aerial vehicle is further improved, and the fast moving target is tracked by the unmanned aerial vehicle. Wherein, the system keeps the current motion state unchanged in the tracking state; in the adjusting state, the unmanned aerial vehicle and the holder are maneuvered simultaneously, so that the current hovering direction of the unmanned aerial vehicle is changed, and the situation that the unmanned aerial vehicle cannot find a target is avoided; and during the transition state, the unmanned aerial vehicle selects to enter a tracking state or an adjustment state according to the current state of the system, so that the unmanned aerial vehicle continuously tracks the fast moving target.
Drawings
FIG. 1 is a schematic diagram of a fixed wing drone of the present invention changing hover direction by a deterministic finite automaton.
FIG. 2 shows the unmanned aerial vehicle theta used for tracking the target in the specific application example of the invention p And theta t Schematic diagram of the variation of (1).
Fig. 3 is a schematic diagram of a position relationship between the drone and the target in an adjusted state in a specific application example of the present invention.
Fig. 4 is a schematic diagram of a fixed-wing drone in a specific application example of the present invention.
Fig. 5 is a schematic diagram of three states of the present invention in a specific application example.
Detailed Description
The invention will be described in further detail below with reference to the drawings and specific examples.
As shown in fig. 1, the method for tracking a fast moving target by a fixed-wing drone based on a pan-tilt camera according to the present invention includes the steps of:
step S1: the whole process is divided into three states of a tracking state, an adjusting state and a transition state, and the unmanned aerial vehicle flies according to a controller designed in an earlier stage when the unmanned aerial vehicle is in the tracking state;
step S2: when in the adjusting state, the unmanned aerial vehicle switches the spiral direction (if the current spiral is clockwise, the spiral direction is changed into anticlockwise spiral), and meanwhile, the tripod head rotates from one side to the other side to continuously track the target; the transition state is to select to enter a tracking state or an adjustment state according to the current state of the unmanned aerial vehicle, so that the unmanned aerial vehicle is prevented from being far away from a target. In short, the motion performance of the unmanned aerial vehicle and the motion performance of the holder are integrated, and the fixed-wing unmanned aerial vehicle can track the fast moving target.
As the target speed increases, the target may be lost if the fixed wing drone is hovering around only one direction. As shown in FIG. 1, O 1 ' M denotes a motion trajectory of the object, O 1 O 2 Representing the trajectory of the unmanned aerial vehicle, O 1 ′O 2 ' is O 1 O 2 Projection on the ground. Due to the limitation of mechanical characteristics of the holder, when the target speed is too fast in the left image, in order to enable the target speed to tend to the center of the image, the posture of the holder of the unmanned aerial vehicle can quickly reach saturation in the turning process, and finally the target can be far away from the unmanned aerial vehicle.
To avoid this, the present invention designs a deterministic finite automata model. The model can change the hovering direction of the unmanned aerial vehicle when the unmanned aerial vehicle turns, and the effect is shown in the right diagram of fig. 1. Finally, the unmanned aerial vehicle is prevented from being far away from the target, so that the tracking capability of the unmanned aerial vehicle on the moving target is improved.
The invention divides the automaton model into three states, which are respectively called tracking states
Adjustment state
Transition state
And determines a conversion relationship between them. Some symbols are defined as follows:
TABLE 1 notation and corresponding explanations
(1) Tracking states;
in the state, the fixed-wing unmanned aerial vehicle carries out spiral tracking around a target, a visual servo control method based on images is adopted, and the design of a controller is represented as follows:
wherein u is ψ See the work of the previous paragraph of the present invention (reference [5]]Theorem III in (1). At u p And u t In the design formula of (2), λ u And λ v A positive constant, the goal is to force the object on the current image toward the center of the image.
At the controller Ψ 1 Under the effect of, unmanned aerial vehicle can let it tend to the image center when tracking the target. However, when the drone is directly in front of the passing target, | θ p And theta t The value of | will increase. As shown in FIG. 2, N 2 Indicating that the drone is just in front of the target, OB is tangent to the trajectory of the drone, a 1 Indicates the position of the assumed object, A 2 Indicating the current position, OA, of the moving object 1 And OA 2 Both represent the optical axis. The invention defines theta corresponding to the two positions p Is composed of
And
corresponding to theta t Is composed of
And
the following relationship holds:
if the speed of the target is too fast,
and
the rapid increase causes the pan tilt attitude angle to reach the limit, resulting in the left diagram in fig. 1. Therefore, the present invention defines θ separately p And theta t Has a threshold value of
And
order to
When theta is higher than theta 1 When not satisfied, mean that unmanned aerial vehicle is when the turn in the left picture of fig. 1, the cloud platform can not deflect to the limit. Therefore, in the process, the target can be kept at the visual field center through the deflection of the holder, and the unmanned aerial vehicle can be always positioned at the visual field center
Status.
(2) Adjusting the state;
when theta is higher than theta 1 When satisfied and the drone is still flying in the current hover direction, the pan-tilt attitude will quickly reach saturation, causing the target to move toward the image edge until it disappears. Therefore, the invention enables the unmanned aerial vehicle to change the hovering direction on one hand and enables the holder to rotate to the other side of the unmanned aerial vehicle on the other hand. The process is defined as
Status.
Since there is a brief disappearance of the target during the process, it is desirable to minimize the time for this disappearance. According to this requirement, the invention provides for the drone to have a maximum yaw rate
The adjustment is carried out, and meanwhile, the tripod head also has the maximum deflection angle speed
And
and (6) adjusting. The desired angle for the pan-tilt to deflect to the other side is
And
these two angles need to be determined to ensure that the target can be detected again. Taking into account the angle at which the drone is deflected to the other sideThe greater the degree, the larger the area swept by the camera and the faster the object can be detected. Thus, if the current yaw angle of the pan/tilt head is
Then
Is gamma p The elapsed time is:
then, the process of the present invention is carried out,
the determination needs to be dependent on
And the position of the drone relative to the target. As shown in FIG. 3, O 1 Denotes Θ 1 Position of the drone just when satisfied, O 2 Indicating the position of the drone after a time of at. The corresponding optical axes of the cameras at the two positions are O 1 B 1 And O 2 B 2 And is less than G 1 O 2 B 2 Representing half the camera field angle. Because the pan-tilt is arranged at the controller psi 1 Can keep the target near the center of the image, and the invention approximately considers O 1 B 1 Pointing to the target. Furthermore, the present invention recognizes drone slave O 1 To O 2 Yaw rate in the process is all
By combining the flying height and flying speed of the unmanned aerial vehicle and the attitude of the unmanned aerial vehicle and the holder, O can be estimated through simple geometric relationship 1 And O 2 The position of the unmanned aerial vehicle relative to the target is located at the position.
In fact, when the target performs uniform linear motion, the unmanned aerial vehicle is at O 1 And O 2 Is not influenced by the targetThe effect of the direction of motion. Thus, in solving for
The specific direction of the movement of the target (such as westward movement) can be specified, and then the included angle between the directions of the movement of the target and the direction of the westward movement can be obtained by combining the azimuth angle of the unmanned aerial vehicle. When the unmanned aerial vehicle is positioned at O 2 Then, select G 1 The points are located on the trajectory of the target motion, so that the mapping of the target trajectory on the image intersects the image edges at a midpoint. In this situation, it can be ensured that even a slight offset of the target can be located in the camera field of view. Further, the determination can be made by simple geometric relationships
The size of (2).
In summary,
the controller of the time may be expressed as:
(3) transition state
Marking the mark whether the target is detected as N t When the object is detected N t 1, otherwise N t ＝0。
Order to
When theta is higher than theta 2 When the conditions are met, the unmanned aerial vehicle leaves
Status. However, if the drone directly enters at this point
The status will be problematic. As shown in FIG. 4, O 1 ，O 2 And O 3 Indicating the position of the drone, O in plan view 2 H 2 And O 3 H 3 Normal, O, representing the unmanned aerial vehicle trajectory at that point 2 C 1 And O 3 C 2 Representing the camera optical axis. When the unmanned aerial vehicle is positioned at O 1 The first time an object is detected, it is now located at the edge of the image. If the next state is
The cradle head needs to adjust the attitude to make the target tend to the center of the image, so that the attitude of the cradle head continues to increase. When the target is at O 2 When it reaches near the center of the image, Θ 1 May be satisfied again, causing the drone to re-enter
Status. O is 3 The same applies to the case. Therefore, the drone may be far from the target in this situation.
Based on this, the present invention wants to enter the central area before the target (u) 1 ∈(-u t ,u t ),v 1 ∈(-v t ,v t )，u t And v t 1/10 may be taken as the width and height of the image, respectively. ) The controller is still psi 1 And define the state as
Further, by setting θ p Is determined whether to enter
Order to
It is noted that
Should be less than
Thereby preventing the phenomenon in fig. 4 from occurring again. At this time, when theta 1 When satisfied, due to
Unmanned aerial vehicle can not enter immediately
But continues to fly in the tracking state until the transition condition is satisfied. However, if in the process | θ p | always greater than
Then theta 3 Will not be satisfied, thereby making the unmanned plane always in
Status. In this case, the drone will not change hover direction, so that the situation in fig. 1 occurs where the target disappears. To solve this problem, the present invention still desires to have the controller Ψ at this time 2 Can be used for function. Thus, according to equation (54), the present invention constructs another condition for directly converting the current state to
The conditions are expressed as follows:
thus, if the drone has not entered the tracking state when passing directly in front of the target's motion, Ψ 2 It will function directly.
In summary, the deterministic finite automata model can be represented as fig. 5. Defining the current state as S n Then the controller of the model can be expressed as:
meanwhile, the algorithm pseudo code of the model can be expressed as:
the above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above-mentioned embodiments, and all technical solutions belonging to the idea of the present invention belong to the protection scope of the present invention. It should be noted that modifications and adaptations to those skilled in the art without departing from the principles of the present invention may be apparent to those skilled in the relevant art and are intended to be within the scope of the present invention.
Claims (6)
1. A method for tracking a fast moving target by a fixed wing unmanned aerial vehicle based on a holder camera is characterized by comprising the following steps:
step S1: dividing the whole process into tracking states
Adjustment state
Transition state
Determining the conversion relation among the three states, and flying the unmanned aerial vehicle according to a controller designed in the earlier stage when the unmanned aerial vehicle is in the tracking state;
step S2: when the unmanned aerial vehicle is in the adjusting state, the unmanned aerial vehicle switches the spiral direction, and meanwhile, the holder rotates from one side to the other side to continuously track the target; the transition state is to select to enter the tracking state or the adjustment state according to the current state of the unmanned aerial vehicle so as to prevent the unmanned aerial vehicle from being far away from a target;
in the tracking state, the fixed-wing unmanned aerial vehicle performs hovering tracking around a target, and a visual servo control method based on images is adopted, wherein a controller is represented as follows:
Ψ 1 ：
wherein u is ψ Yaw rate u at the pan/tilt head for the yaw rate of the drone p And pitch angle rate u t In the design formula of (2), λ u And λ v A positive constant is aimed at forcing the object on the current image towards the center of the image.
2. The method for tracking the fast moving target by the fixed-wing drone based on the pan-tilt camera according to claim 1, characterized in that in the state of adjustment, when the condition Θ is 1 Satisfied and the drone is still flying in the current hover direction,
and
respectively representing the thresholds of the yaw angle and the pitch angle of the holder, and quickly saturating the posture of the holder, so that the target moves to the edge of the image until the target disappears; let the drone change the direction of hover, on the other hand let the pan-tilt rotate to the other side of the drone, defining the process as the adjustment state
Θ 1 :
3. Cradle head camera based fixed-wing drone pair fast motion according to claim 2A method for tracking a target, characterized by steering an unmanned aerial vehicle at a maximum yaw rate
Adjustment is made while the pan/tilt head is also at a maximum yaw rate
And pitch rate
Adjusting; desired yaw and pitch angles for the pan-tilt to the other side are
And
these two angles need to be determined to ensure that the target can be detected again; considering that the larger the angle of the unmanned aerial vehicle deflecting to the other side is, the larger the area swept by the camera is, and thus the faster the target can be detected; if the current yaw angle of the holder is
Then
Is the maximum yaw angle gamma of the pan/tilt head p The elapsed time is:
4. the pan-tilt-camera-based method for tracking a fast moving object by a fixed-wing drone according to claim 3, wherein the method is characterized in that
Is determined to depend on
And the position of the drone relative to the target; o is 1 Expression Condition Θ 1 Position of the drone just when satisfied, O 2 Representing the position of the drone after a time of Δ t; the corresponding optical axes of the cameras at the two positions are O 1 B 1 And O 2 B 2 And is less than G 1 O 2 B 2 Representing half the camera field angle.
5. The method for tracking the fast moving target by the fixed-wing unmanned aerial vehicle based on the pan-tilt camera according to any one of claims 1 to 4, wherein in the transition state, the mark whether the target is detected is marked as N t When the object is detected N t 1, otherwise N t 0; order:
Θ 2 :
6. the pan-tilt-camera-based method for tracking fast moving target by fixed-wing drone according to claim 5, wherein when Θ is 2 When the conditions are met, the unmanned aerial vehicle leaves
A state; o is 1 ，O 2 And O 3 Indicating the position of the drone, O 2 H 2 And O 3 H 3 Normal, O, representing the trajectory of the drone at this point 2 C 1 And O 3 C 2 Representing the camera optical axis; when the unmanned aerial vehicle is positioned at O 1 Then the target is detected for the first time, when it is located at the edge of the image; if the next state is
The cradle head needs to make the target tend to the center of the image by adjusting the posture, so that the posture of the cradle head continues to increase; when the target is at O 2 When the position reaches near the center of the image, the condition Θ 1 May be satisfied again, causing the drone to re-enter
A state; o is 3 The same applies to (1).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010892049.8A CN111984036B (en) | 2020-08-28 | 2020-08-28 | Method for tracking fast moving target by fixed-wing unmanned aerial vehicle based on pan-tilt camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010892049.8A CN111984036B (en) | 2020-08-28 | 2020-08-28 | Method for tracking fast moving target by fixed-wing unmanned aerial vehicle based on pan-tilt camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111984036A CN111984036A (en) | 2020-11-24 |
| CN111984036B true CN111984036B (en) | 2022-09-16 |
Family
ID=73439740
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010892049.8A Active CN111984036B (en) | 2020-08-28 | 2020-08-28 | Method for tracking fast moving target by fixed-wing unmanned aerial vehicle based on pan-tilt camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111984036B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108399642A (en) * | 2018-01-26 | 2018-08-14 | 上海深视信息科技有限公司 | A kind of the general target follower method and system of fusion rotor wing unmanned aerial vehicle IMU data |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7970507B2 (en) * | 2008-01-23 | 2011-06-28 | Honeywell International Inc. | Method and system for autonomous tracking of a mobile target by an unmanned aerial vehicle |
| FR2985581B1 (en) * | 2012-01-05 | 2014-11-28 | Parrot | METHOD FOR CONTROLLING A ROTARY SAILING DRONE FOR OPERATING A SHOOTING VIEW BY AN ON-BOARD CAMERA WITH MINIMIZATION OF DISTURBING MOVEMENTS |
| CN103149939B (en) * | 2013-02-26 | 2015-10-21 | 北京航空航天大学 | A kind of unmanned plane dynamic target tracking of view-based access control model and localization method |
| US9070289B2 (en) * | 2013-05-10 | 2015-06-30 | Palo Alto Research Incorporated | System and method for detecting, tracking and estimating the speed of vehicles from a mobile platform |
| CN106249888A (en) * | 2016-07-28 | 2016-12-21 | 纳恩博（北京）科技有限公司 | A kind of cloud platform control method and device |
| CN108107920A (en) * | 2017-12-19 | 2018-06-01 | 天津工业大学 | A kind of microminiature twin shaft vision stablizes holder target detection tracing system |
| CN108614580A (en) * | 2018-06-22 | 2018-10-02 | 中国人民解放军国防科技大学 | Layered obstacle avoidance control method in target tracking of unmanned aerial vehicle |
| CN110764537B (en) * | 2019-12-25 | 2020-03-27 | 中航金城无人***有限公司 | Automatic tripod head locking system and method based on motion estimation and visual tracking |
-
2020
- 2020-08-28 CN CN202010892049.8A patent/CN111984036B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108399642A (en) * | 2018-01-26 | 2018-08-14 | 上海深视信息科技有限公司 | A kind of the general target follower method and system of fusion rotor wing unmanned aerial vehicle IMU data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111984036A (en) | 2020-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105652891B (en) | A kind of rotor wing unmanned aerial vehicle movement Target self-determination tracks of device and its control method | |
| Roelofsen et al. | Reciprocal collision avoidance for quadrotors using on-board visual detection | |
| WO2018107419A1 (en) | Control method, device and apparatus, and movable platform | |
| CN108594848B (en) | Unmanned aerial vehicle staged autonomous landing method based on visual information fusion | |
| KR101740312B1 (en) | Induction control method using camera control information of unmanned air vehicle | |
| CN105468014A (en) | Single autopilot integrated aircraft system and two-dimensional holder control method thereof | |
| CN110825108B (en) | Cooperative anti-collision method for multiple tracking unmanned aerial vehicles in same airspace | |
| CN111596693A (en) | Ground target tracking control method and system of unmanned aerial vehicle based on pan-tilt camera | |
| CN109976386A (en) | A kind of method and system of multiple no-manned plane collaboration tracking target | |
| CN108733066B (en) | Target tracking control method based on pod attitude feedback | |
| Li et al. | UAV autonomous landing technology based on AprilTags vision positioning algorithm | |
| WO2019137559A1 (en) | Blind zone tracking method for directional antenna, device therefor, and mobile tracking system | |
| US10642271B1 (en) | Vehicle guidance camera with zoom lens | |
| NO339419B1 (en) | Path-Based Flight Maneuvering System | |
| CN110658826A (en) | Autonomous berthing method of under-actuated unmanned surface vessel based on visual servo | |
| Mills et al. | Vision based control for fixed wing UAVs inspecting locally linear infrastructure using skid-to-turn maneuvers | |
| Duan et al. | A binocular vision-based UAVs autonomous aerial refueling platform | |
| CN112947569B (en) | Visual servo target tracking control method for quad-rotor unmanned aerial vehicle based on preset performance | |
| Kassab et al. | UAV target tracking by detection via deep neural networks | |
| CN112783203B (en) | Multi-sensor-based control system and method for unmanned aerial vehicle formation maintenance | |
| Yang et al. | An optimized image-based visual servo control for fixed-wing unmanned aerial vehicle target tracking with fixed camera | |
| Karras et al. | Target tracking with multi-rotor aerial vehicles based on a robust visual servo controller with prescribed performance | |
| WO2022193081A1 (en) | Method and apparatus for controlling unmanned aerial vehicle, and unmanned aerial vehicle | |
| CN111984036B (en) | Method for tracking fast moving target by fixed-wing unmanned aerial vehicle based on pan-tilt camera | |
| CN114035616A (en) | Method and system for controlling attack of aircraft on moving target |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |