CN104102218B - The perception of view-based access control model servo and bypassing method and system - Google Patents

The perception of view-based access control model servo and bypassing method and system Download PDF

Info

Publication number
CN104102218B
CN104102218B CN201410305109.6A CN201410305109A CN104102218B CN 104102218 B CN104102218 B CN 104102218B CN 201410305109 A CN201410305109 A CN 201410305109A CN 104102218 B CN104102218 B CN 104102218B
Authority
CN
China
Prior art keywords
target
angle
envelope
unmanned plane
sigma
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410305109.6A
Other languages
Chinese (zh)
Other versions
CN104102218A (en
Inventor
吕洋
潘泉
赵春晖
张夷斋
刘流
席庆彪
刘慧霞
吴薇
朱海峰
程承
康青青
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northwestern Polytechnical University
Original Assignee
Northwestern Polytechnical University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Northwestern Polytechnical University filed Critical Northwestern Polytechnical University
Priority to CN201410305109.6A priority Critical patent/CN104102218B/en
Publication of CN104102218A publication Critical patent/CN104102218A/en
Application granted granted Critical
Publication of CN104102218B publication Critical patent/CN104102218B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

The present invention provides a kind of perception of view-based access control model servo and avoidance system, including unmanned plane, image capturing system, Visual servoing control system and navigation positioning system, the vision servo system includes sensation target detection and tracking module, safe envelope module and Visual servoing control device.The present invention also provides a kind of based on the bypassing method perceived with avoidance system, present invention achieves the quick sensing to ambient airspace environment, and do not installing any distance measuring sensor additional and be not required in the case that ground handling operator intervened and operated, the independent evasion manoeuvre completed to space flight target;Loading demands of the present invention are low, control accuracy is high, with higher intelligent, it is possible to increase the spatial domain flight safety ability of unmanned plane.

Description

The perception of view-based access control model servo and bypassing method and system
Technical field
The present invention relates to Navigation of Pilotless Aircraft and control field, the perception of more particularly to a kind of view-based access control model servo and the side of evading Method and system.
Background technology
Recently, as Military Application and civil area are increasingly strong to the demand of unmanned plane, add the civilian spatial domain neck of China Domain further opens, and following spatial domain will be presented the unmanned plane of polytype function, have that man-machine to carry out spatial domain shared and integrated Situation, spatial domain will be increasingly intensive.In the case, unmanned plane perceives and evades (Sense and Avoid, i.e. SAA) ability and incites somebody to action Become into spatial domain flight, ensure the prerequisite of unmanned plane during flying safety.Unmanned plane is perceived and refers to that unmanned plane is utilized with evading Airborne sensor or surface surveillance system complete the monitoring to spatial domain flight environment of vehicle and the state of airbound target is obtained, and touch to potential The target for hitting threat carries out evading path planning, completes evasion manoeuvre action, so as to ensure the Route reform safety of unmanned plane.
SAA technologies are current unmanned air vehicle technique field key technology difficulties urgently to be resolved hurrily.2013, in U.S. FAA In the integrated route map in UAS spatial domain that (Federal Aviation Administration) is issued, SAA is clearly proposed Ability is the pre-requisite abilities that unmanned plane carries out national spatial domain flight.Its major function is divided into:Object detecting and tracking, collision threat Estimate, evade path planning, evasion manoeuvre.
Unmanned aerial vehicle onboard SAA sensors include T-CAS, ADS-B, radar, laser radar, photoelectricity, infrared sensor etc..Its In, photoelectric sensor as and effectively perceive extremely important to noncooperative target with evade means, particularly it is small-sized nobody Machine system load, task, cost are limited, it is impossible to when carrying large-scale awareness apparatus such as radar, laser radar, based on photoelectricity Advantage of the vision SAA system of sensor in terms of quality, power consumption, cost makes which be more easy in the small-sized system integration and application; The characteristics of vision SAA passive type is perceived is applied to battlefield surroundings, stealthy task dispatching particular task occasion;And with ADS-B, TCAS etc. Compare, vision SAA is not against acknowledgement mechanism, it is not necessary to Ground Control Information and satellite positioning information, i.e., can provide to non-conjunction Make perception and the dodging ability of target independence.Therefore, vision SAA system of the research based on photoelectric sensor is significant.
The content of the invention
It is an object of the invention to provide a kind of perception of view-based access control model servo and bypassing method and system, existing to solve Sensor bulk is big, power consumption is larger, the problem of the integrated application being unfavorable in small-sized UAS, and energy of the present invention The quick sensing to ambient airspace environment is enough realized, Visual Feedback Control model is set up by the safe envelope of angle, nobody is controlled Machine completes the perception to spatial domain target and evades.
The present invention provides a kind of perception of view-based access control model servo and avoidance system, including:
Unmanned plane, arranges automatic pilot on the unmanned plane, the automatic pilot receives flight control instruction and carries out Fly and complete avoiding action of the unmanned plane to barrier;
Image capturing system, is mounted on the unmanned plane, for gathering the flying area image information of unmanned plane, adopts The centralized array configuration of polyphaser various visual angles, and pass through camera interface real-time Transmission image information;
Visual servoing control system, is arranged on the unmanned plane, including sensation target detection and tracking module, rescue bag Network module and Visual servoing control device, the image information that sensation target detection receives image capturing system transmission with tracking module is simultaneously Realize the detection to airbound target in image, positioning and track, safe envelope module is carried out according to the target status information for obtaining The generation of the safe envelope of plane of delineation angle, and generate image based on the safe envelope and evade angle, is input at this angle to regarding Feel servo controller, Visual servoing control device output evasion manoeuvre angle, and the angle is passed through into Serial Port Transmission to automatic Pilot Instrument completes avoiding action;
Navigation positioning system, is arranged on the unmanned plane, for setting up air route retrogression mechanism, navigation positioning system detection To unmanned plane not in air route and when there is no threat, air route recurrence is carried out, make unmanned plane return to original air route.
Used as a kind of optimal way, heretofore described sensation target detection is with tracking module using at multi-path high-definition image Platform DM8168.
The present invention also provides the bypassing method of a kind of perception of view-based access control model servo and avoidance system, including:
Step one, realizes being completely covered to the spatial domain in the flight angle of visual field by unmanned aerial vehicle onboard image capturing system, Obtain the flying area image information of unmanned plane;
Step 2, sensation target detection and image letter in tracking module receiving step one in airborne Visual servoing control system Cease and processed, complete the detection to airbound target in spatial domain picture, positioning and track;
Step 3, according to the airbound target status information obtained in step 2, safe envelope in Visual servoing control system Module carries out the safe envelope of plane of delineation angle and generates, and determines that unmanned plane whether there is collision threat by safe envelope, for Collision threat, is calculated and evades angle under image meaning;
Step 4, the visual server evaded in angle input Visual servoing control system in step 3, vision are watched Evasion manoeuvre pitching and yaw angle that device output needs are taken, and is sent to unmanned plane automatic pilot and complete evasion manoeuvre;
Step 5, sets up air route retrogression mechanism using navigation positioning system, when unmanned plane does not have threat, makes unmanned plane Return to original air route.
Used as a kind of optimal way, the concrete methods of realizing of the step 2 is as follows:
The view data that image capturing system is obtained in step one is sent to airborne visual servo control by camera data line In system processed, sensation target detection and tracking module, wherein arrange tri- cameras of A, B, C, sensation target altogether in image capturing system Detection adopts multi-path high-definition image processing platform DM8168 with tracking module, realizes entering the multi-channel video for obtaining using DM8168 Row is processed, and obtains the positional information p of target k moment a certain camera image plane in image capturing system by detection algorithmk =[pxk,pyk], obtain relative angle of the target relative to the camera:
Wherein, w and h are the width and height of the image in units of pixel respectively, and f is camera lens focal length, and μ is picture dot Size;
According to camera installation site, the relative angle that can obtain the target k moment relative to unmanned plane is Θk=[σkk], Wherein
γk=γ '
In formulaRepresent that the target for detecting comes from image capturing system respectively Camera A, camera B and camera C;
The angular velocity vector Ω of target is determined according to the angle change in front and back's momentk=[ωxkyk]=Θk+1k,k>0。
As another kind of optimal way, in the step 3, the generation step of safe envelope and evade the calculation procedure of angle Including:
1. targeted security envelope circle is set up, the center of circle is impact point, chooses a radius initial value, and carried out with fixed speed Increase;
2. safe envelope is set up according to target size oval, the oval center of circle is impact point, the length and envelope of ellipse short shaft Round radius is equal, and the length of transverse is extrapolation of the length of short axle with target under current angular velocity in setting aside some time Length sum, the direction of motion of the long axis direction parallel to target;
3. the envelope circle and envelope of aforementioned generation are oval forms the safe envelope of Plane Angle, and the safe envelope is by short with ellipse Axle moves reciprocal semicircle composition with along target for the semiellipse along target direction of motion of cut-off rule;
4. Target threat estima tion is carried out based on the safe envelope of aforesaid plane angle, sets up the threat based on safe envelope and indicate Function, judges whether collision threat with this;
5. distance principle is evaded according to minimum, is found apart from the nearest point of initial target in the safe envelope of Plane Angle.
Especially, the concrete generation step of safe envelope and evade the concrete calculation procedure of angle such as in the step 3 Under:
1. targeted security envelope circle is set up, relative angular position Θ of the target k moment relative to unmanned plane is elected in the center of circle ask= [σk, γk], choose a radius initial value r0, and increased with fixed speed, then
rk+1=rk+ ε, k=1,2,3 ...
rk=r0, k=0
Wherein ε is to fix growth rate, rk+1Represent the safe envelope radius of circle at k+1 moment;
2. safe envelope ellipse is set up according to target size, the oval center of circle is impact point Θk=[σkk], long axis direction Parallel to the direction of motion of target, i.e. target angular velocity ΩkDirection, the length of major axis and short axle selected by following equation respectively Take:
A=rk(1+α‖Ωk‖),
B=rk,
In formula, a and b represents the oval major axis of envelope and short axle, r respectivelykFor the radius of k moment envelope circle, α is angular velocity The scale factor of axial length is converted into, the factor is represented to evade and set aside some time, ‖ Ωk‖ is target angular velocity of satellite motion vector field homoemorphism;
3. the envelope circle and envelope of aforementioned generation are oval forms the safe envelope of Plane Angle, and the safe envelope is by short with ellipse Axle moves reciprocal semicircle composition with along target for the semiellipse along target direction of motion of cut-off rule;
4. Target threat estima tion is carried out based on the safe envelope of aforesaid plane angle, sets up the threat sign letter based on time k Number lk, work as lk<When 0, it is believed that there is collision threat, collision threat is judged whether with this, wherein
WhereinRepresent that the major axes orientation of camera B, relative to the angle of unmanned plane major axes orientation, can generally be recognized ForIt is sign function;
5. work as lk<When 0, distance principle is evaded according to minimum, distance is found in the safe envelope of Plane AngleNearest point s* =[σ**] as minimum evasion manoeuvre point:
WhereinRepresent unit vector of the k moment perpendicular to target angular velocity vector.
Used as another optimal way, in the step 4, the concrete calculation procedure of evasion manoeuvre pitching and yaw angle is such as Under:
1. defining Interactive matrix is
Speed control is set up in the Visual servoing control device of Visual servoing control system, feedback quantity is The exponential damping of error is completed, output speed controlled quentity controlled variable V, Visual servoing control device are expressed as
In formula, λ is error extension attenuation quotient,Represent LePseudoinverse;
Due in Interactive matrix LeIn cannot obtain the information apart from d of target and the machine, Interactive matrix is split It is as follows:
In formula, LωRepresent LeIn Angle ambiguity component, LtRepresent speed motor control component;
Obtain apart from unrelated Visual servoing control device:
In formula,Represent LωPseudoinverse;
To eliminate steady-state error, Visual servoing control device is compensated, it is as follows:
In formula, Ω represents the angular velocity of target motion,Represent the direction vector of error, ωx、ωy、ωzRepresent respectively Three components of ω;
2. the angle of pitch and yaw angle for exporting be
In formula,And φcK () represents the angle of pitch and yaw angle of automatic pilot output attitude,And φ K () represents the angle of pitch and yaw angle of unmanned plane current pose, Δ t represents Visual servoing control device output time interval steps, ωy(k) and ωzK () represents the rate of pitch controlled quentity controlled variable and yaw rate of current time Visual servoing control device output respectively Controlled quentity controlled variable, g represent acceleration of gravity, and V (k) represents the speed of current time unmanned plane.
Used as another optimal way, in the step 5, the concrete establishment step of air route retrogression mechanism is as follows:
1. unmanned plane is determined whether in air route by the machine navigation positioning system, when the machine not in air route when, navigated Road returns;
2. confirm the recurrence air route angle of moment k
In formula,Represent minimum evasive maneuvering point position when air route returns;
Wherein PdIt is position of the machine on script air route when there is no evasion manoeuvre, Pd12And Pd13It is the machine respectively In the two-dimensional position of XY and XZ planes;
PsIt is the machine current location obtained by the machine navigation positioning system, Ps12And Ps13It is the machine respectively in XY and XZ The two-dimensional position of plane;
esIt is the machine direction vector obtained by the machine navigation positioning system, es12And es13It is the machine respectively in XY and XZ The two-dimensional directional vector of plane.
Present invention achieves the quick sensing to ambient airspace environment, and do not installing any distance measuring sensor additional and be not required to In the case that ground handling operator is intervened and is operated, the independent evasion manoeuvre completed to space flight target;This Bright loading demands are low, control accuracy is high, with higher intelligent, it is possible to increase the spatial domain flight safety ability of unmanned plane.
Description of the drawings
Fig. 1 is the perception of the view-based access control model servo of the present invention and avoidance system structured flowchart;
Fig. 2 is the bypassing method flow chart of the perception with avoidance system of the view-based access control model servo of the present invention;
Fig. 3 a are the image capturing system camera array layout drawing of the present invention;
Fig. 3 b are the image capturing system camera array field of view angle schematic diagram of the present invention;
Fig. 4 is the safe envelope schematic diagram of plane of delineation angle of the present invention.
Specific embodiment
The present invention will be further described with reference to the accompanying drawings and examples.
As shown in figure 1, the present invention provides a kind of perception of view-based access control model servo and avoidance system, including:
Unmanned plane, arranges automatic pilot on the unmanned plane, the automatic pilot receives flight control instruction and carries out Fly and complete avoiding action of the unmanned plane to barrier;
Image capturing system, is mounted on the unmanned plane, for gathering the flying area image information of unmanned plane, adopts The centralized array configuration of polyphaser various visual angles, and pass through camera interface real-time Transmission image information;
Visual servoing control system, is arranged on the unmanned plane, including sensation target detection and tracking module, rescue bag Network module and Visual servoing control device, the image information that sensation target detection receives image capturing system transmission with tracking module is simultaneously Realize the detection to airbound target in image, positioning and track, safe envelope module is carried out according to the target status information for obtaining The generation of the safe envelope of plane of delineation angle, and generate image based on the safe envelope and evade angle, is input at this angle to regarding Feel servo controller, Visual servoing control device output evasion manoeuvre angle, and the angle is passed through into Serial Port Transmission to automatic Pilot Instrument completes avoiding action;
Navigation positioning system, is arranged on the unmanned plane, for setting up air route retrogression mechanism, navigation positioning system detection To unmanned plane not in air route and when there is no threat, air route recurrence is carried out, make unmanned plane return to original air route.
Wherein, in the present invention, sensation target detection adopts multi-path high-definition image processing platform DM8168 with tracking module.
As shown in Fig. 2 the present invention also provides the bypassing method of a kind of perception of view-based access control model servo and avoidance system, bag Include:
Step one, realizes being completely covered to the spatial domain in the flight angle of visual field by unmanned aerial vehicle onboard image capturing system, Obtain the flying area image information of unmanned plane.
Specified according to International Civil Aviation Organization, the angle of visual field of aircraft space must meet respectively:Horizontal field of view>± 110 °, Vertical field of view>± 15 °, it is therefore necessary to which above-mentioned spatial domain can be completely covered, and should obtain clear accurate as far as possible Information.Image capturing system, from for the angle of camera that is, must is fulfilled for using the centralized array configuration of polyphaser various visual angles Big market and remote high-resolution imaging, and single camera lens are difficult to take into account in terms of the angle of visual field and focal length.Therefore, adopt The centralized array configuration of polyphaser as shown in Figure 3 a, in figure, A, B, C are and are arranged on the camera increased on steady head, increase steady head Ensure that the clear, acquisition of horizontal view angle image.Big field of view angle, tool are obtained using the focal length splicing of multiple telephoto lenses Body field of view angle as shown in Figure 3 b, while improving detectivity to distant object.
Step 2, sensation target detection and image letter in tracking module receiving step one in airborne Visual servoing control system Cease and processed, complete the detection to airbound target in spatial domain picture, positioning and track.
In small-sized unmanned plane, due to the restriction of communication bandwidth, tend not to realize the real time communication to high-definition image, The long-distance transmissions of multi-path high-definition video are difficult to realize in current small-sized UAS.
The view data that image capturing system is obtained is sent in airborne Visual servoing control system by camera data line Multi-path high-definition image processing platform DM8168, realizes processing the multi-channel video for obtaining using DM8168, is calculated by detecting Method obtains the positional information p of target k moment a certain camera image plane in image capturing systemk=[pxk,pyk], obtain target Relative to the relative angle of the camera:
Wherein, w and h are the width and height of the image in units of pixel respectively, and f is camera lens focal length, and μ is picture dot Size;
According to camera installation site, the relative angle that can obtain the target k moment relative to unmanned plane is Θk=[σkk], Wherein
γk=γ '
In formulaRepresent that the target for detecting comes from image capturing system respectively Camera A, camera B and camera C.
The angular velocity vector Ω of target is determined according to the angle change in front and back's momentk=[ωxkyk]=Θk+1k,k>0。
Step 3, according to the airbound target status information obtained in step 2, safe envelope in Visual servoing control system Module carries out the safe envelope of plane of delineation angle and generates, and determines that unmanned plane whether there is collision threat by safe envelope, for Collision threat, is calculated and evades angle s under image meaning*=[σ**]。
Safe envelope is defined to indicate that aircraft and the smooth of target distance of minimum separation, closed curve or curved surface, is regarding In feeling avoidance system, as distance cannot be obtained, therefore safe envelope cannot be set up according to the true three-dimension space of target, such as be schemed Shown in 4, a kind of safe enveloping method based on angle is set up in the present invention, comprised the steps:
1. targeted security envelope circle is set up, the center of circle is impact point, chooses a radius initial value, and carried out with fixed speed Increase;
2. safe envelope is set up according to target size oval, the oval center of circle is impact point, the length and envelope of ellipse short shaft Round radius is equal, and the length of transverse is extrapolation of the length of short axle with target under current angular velocity in setting aside some time Length sum, the direction of motion of the long axis direction parallel to target;
3. the envelope circle and envelope of aforementioned generation are oval forms the safe envelope of Plane Angle, and the safe envelope is by short with ellipse Axle moves reciprocal semicircle composition with along target for the semiellipse along target direction of motion of cut-off rule;
4. Target threat estima tion is carried out based on the safe envelope of aforesaid plane angle, sets up the threat based on safe envelope and indicate Function, judges whether collision threat with this;
5. distance principle is evaded according to minimum, is found apart from the nearest point of initial target in the safe envelope of Plane Angle.
Safe enveloping method of the above-mentioned foundation based on angle can be carried out according to following concrete steps:
1. targeted security envelope circle is set up, relative angular position Θ of the target k moment relative to unmanned plane is elected in the center of circle ask= [σkk], choose a radius initial value r0, and increased with fixed speed, then
rk+1=rk+ ε, k=1,2,3 ...
rk=r0, k=0
Wherein ε is to fix growth rate, for simulated three-dimensional space object the plane of delineation rate of expansion, rk+1Represent k The safe envelope radius of circle at+1 moment, the r in Fig. 4 represent the radius of envelope circle;
2. safe envelope ellipse is set up according to target size, the oval center of circle is impact point Θk=[σkk], long axis direction Parallel to the direction of motion of target, i.e. target angular velocity ΩkDirection, a and b in Fig. 4 represent the oval major axis of envelope respectively And the length of short axle, major axis and short axle is chosen by following equation respectively:
A=rk(1+α‖Ωk‖),
B=rk,
In formula, a and b represents the oval major axis of envelope and short axle, r respectivelykFor the radius of k moment envelope circle, α is angular velocity The scale factor of axial length is converted into, the factor is represented to evade and set aside some time, ‖ Ωk‖ is target angular velocity of satellite motion vector field homoemorphism, i.e., The length of major axis is extrapolation length sum of the length of short axle with target under current angular velocity in setting aside some time;
3. the envelope circle and envelope of aforementioned generation are oval forms the safe envelope of Plane Angle, and the safe envelope is by short with ellipse Axle moves reciprocal semicircle composition with along target for the semiellipse along target direction of motion of cut-off rule, real in concrete such as Fig. 4 Shown in line part;
The safe envelope both considered due to target be close to and translocation error exist cause evade angle surplus, while peace Full envelope have also contemplated that the kinestate of target;
4. Target threat estima tion is carried out based on the safe envelope of aforesaid plane angle, sets up the threat sign letter based on time k Number lk, work as lk<When 0, it is believed that there is collision threat, collision threat is judged whether with this, wherein
WhereinRepresent that the major axes orientation of camera B, relative to the angle of unmanned plane major axes orientation, can generally be recognized ForIt is sign function;
5. work as lk<When 0, distance principle is evaded according to minimum, distance is found in the safe envelope of Plane AngleNearest point s* =[σ**] as minimum evasion manoeuvre point:
WhereinRepresent unit vector of the k moment perpendicular to target angular velocity vector.
Step 4, will evade angle s in step 3*=[σ**] input Visual servoing control system in vision watch Device is taken, evasion manoeuvre pitching and yaw angle that visual server output needsAnd unmanned plane is sent to by serial ports Automatic pilot completes evasion manoeuvre.
1. defining Interactive matrix is
Speed control is set up in the Visual servoing control device of Visual servoing control system, feedback quantity is The exponential damping of error is completed, output speed controlled quentity controlled variable V, Visual servoing control device are expressed as
In formula, λ is error extension attenuation quotient,Represent LePseudoinverse;
Due in Interactive matrix LeIn cannot obtain the information apart from d of target and the machine, Interactive matrix is split It is as follows:
In formula, LωRepresent LeIn Angle ambiguity component, LtRepresent speed motor control component;
Obtain apart from unrelated Visual servoing control device:
In formula,Represent LωPseudoinverse;
To eliminate steady-state error, Visual servoing control device is compensated, it is as follows:
In formula, Ω represents the angular velocity of target motion,Represent the direction vector of error, ωx、ωy、ωzRepresent respectively Three components of ω;
2. the angle of pitch and yaw angle for exporting be
In formula,And φcK () represents the angle of pitch and yaw angle of automatic pilot output attitude,And φ K () represents the angle of pitch and yaw angle of unmanned plane current pose, Δ t represents Visual servoing control device output time interval steps, ωy(k) and ωzK () represents the rate of pitch controlled quentity controlled variable and yaw rate of current time Visual servoing control device output respectively Controlled quentity controlled variable, g represent acceleration of gravity, and V (k) represents the speed of current time unmanned plane.
Step 5, sets up air route retrogression mechanism using navigation positioning system, when unmanned plane does not have threat, makes unmanned plane Return to original air route.
1. unmanned plane is determined whether in air route by the machine navigation positioning system, when the machine not in air route when, navigated Road returns;
2. confirm the recurrence air route angle of moment k
In formula,Represent minimum evasive maneuvering point position when air route returns;
Wherein PdIt is position of the machine on script air route when there is no evasion manoeuvre, Pd12And Pd13It is the machine respectively In the two-dimensional position of XY and XZ planes;
PsIt is the machine current location obtained by the machine navigation positioning system, Ps12And Ps13It is the machine respectively in XY and XZ The two-dimensional position of plane;
esIt is the machine direction vector obtained by the machine navigation positioning system, es12And es13It is the machine respectively in XY and XZ The two-dimensional directional vector of plane.
The method and system that the present invention is provided can be realized in the case where any distance measuring sensor is not installed additional, without behaviour Make the evasion manoeuvre for completing to space flight target in the case that personnel intervene, loading demands are low, control accuracy is high, with higher It is intelligent, it is possible to increase the spatial domain flight safety ability of unmanned plane.

Claims (7)

1. a kind of perception of view-based access control model servo and avoidance system, it is characterised in that include:
Unmanned plane, arranges automatic pilot on the unmanned plane, the automatic pilot receives flight control instruction and flown And complete avoiding action of the unmanned plane to barrier;
Image capturing system, is mounted on the unmanned plane, for gathering the flying area image information of unmanned plane, using multiphase The centralized array configuration of machine various visual angles, and pass through camera interface real-time Transmission image information;
Visual servoing control system, is arranged on the unmanned plane, including sensation target detection and tracking module, safe envelope mould Block and Visual servoing control device, sensation target detection receive the image information of image capturing system transmission with tracking module and realize Detection, positioning and tracking to airbound target in image, safe envelope module carry out image according to the target status information for obtaining The generation of the safe envelope of Plane Angle, and angle is evaded based on safe envelope generation image, it is input into vision at this angle and watches Controller, Visual servoing control device output evasion manoeuvre angle are taken, and it is complete to automatic pilot that the angle is passed through Serial Port Transmission Into avoiding action;
Navigation positioning system, is arranged on the unmanned plane, and for setting up air route retrogression mechanism, navigation positioning system detects nothing It is man-machine to carry out air route recurrence not in air route and when there is no threat, make unmanned plane return to original air route.
2. the perception of view-based access control model servo according to claim 1 and avoidance system, it is characterised in that the sensation target Detection adopts multi-path high-definition image processing platform DM8168 with tracking module.
3. the bypassing method of a kind of perception of view-based access control model servo and avoidance system, it is characterised in that include:
Step one, realizes being completely covered to the spatial domain in the flight angle of visual field by unmanned aerial vehicle onboard image capturing system, obtains The flying area image information of unmanned plane;
Step 2, sensation target detection in airborne Visual servoing control system receive image letter in the step one with tracking module Cease and processed, complete the detection to airbound target in spatial domain picture, positioning and track;
The concrete methods of realizing of the step 2 is as follows:
The view data that image capturing system is obtained in the step one is sent to airborne visual servo control by camera data line In system processed, sensation target detection and tracking module, wherein arrange tri- cameras of A, B, C, sensation target altogether in image capturing system Detection adopts multi-path high-definition image processing platform DM8168 with tracking module, realizes entering the multi-channel video for obtaining using DM8168 Row is processed, and obtains the positional information p of target k moment a certain camera image plane in image capturing system by detection algorithmk =[pxk,pyk], obtain relative angle of the target relative to the camera:
&sigma; &prime; = tan - 1 p x k - w 2 f / &mu;
&gamma; &prime; = tan - 1 p y k - h 2 f / &mu;
Wherein, w and h are the width and height of the image in units of pixel respectively, and f is camera lens focal length, and μ is picture dot chi It is very little;
According to camera installation site, the relative angle that can obtain the target k moment relative to unmanned plane is Θk=[σkk], wherein
&sigma; k = &sigma; &prime; - 4 9 &pi; , p k &Subset; A &sigma; &prime; , p k &Subset; B &sigma; &prime; + 4 9 &pi; , p k &Subset; C
γk=γ '
In formulaRepresent that the target for detecting comes from the phase in image capturing system respectively Machine A, camera B and camera C;
The angular velocity vector Ω of target is determined according to the angle change in front and back's momentk=[ωxkyk]=Θk+1k,k>0;
Step 3, according to the airbound target status information obtained in the step 2, safe envelope in Visual servoing control system Module carries out the safe envelope of plane of delineation angle and generates, and determines that unmanned plane whether there is collision threat by safe envelope, for Collision threat, is calculated and evades angle under image meaning;
Step 4, the visual server evaded in angle input Visual servoing control system in the step 3, vision are watched Evasion manoeuvre pitching and yaw angle that device output needs are taken, and is sent to unmanned plane automatic pilot and complete evasion manoeuvre;
Step 5, sets up air route retrogression mechanism using navigation positioning system, when unmanned plane does not have threat, returns unmanned plane Original air route.
4. bypassing method according to claim 3, it is characterised in that in the step 3 generation step of safe envelope and The calculation procedure for evading angle includes:
1. targeted security envelope circle is set up, the center of circle is impact point, chooses a radius initial value, and increased with fixed speed It is long;
2. safe envelope ellipse is set up according to target size, the oval center of circle is impact point, the length and envelope circle of ellipse short shaft Radius is equal, and the length of transverse is extrapolation length of the length of short axle with target under current angular velocity in setting aside some time Sum, the direction of motion of the long axis direction parallel to target;
3. the envelope circle and envelope of aforementioned generation are oval forms the safe envelope of Plane Angle, and the safe envelope by with ellipse short shaft is The semiellipse along target direction of motion of cut-off rule moves reciprocal semicircle composition with along target;
4. Target threat estima tion is carried out based on the safe envelope of aforesaid plane angle, sets up the threat sign letter based on safe envelope Number, judges whether collision threat with this;
5. distance principle is evaded according to minimum, is found apart from the nearest point of initial target in the safe envelope of Plane Angle.
5. bypassing method according to claim 4, it is characterised in that the concrete generation step of safe envelope in the step 3 Concrete calculation procedure that is rapid and evading angle is as follows:
1. targeted security envelope circle is set up, relative angular position Θ of the target k moment relative to unmanned plane is elected in the center of circle ask=[σk, γk], choose a radius initial value r0, and increased with fixed speed, then
rk+1=rk+ ε, k=1,2,3 ...
rk=r0, k=0
Wherein ε is that the fixed of safe envelope radius of circle increases length, rk+1Represent the safe envelope radius of circle at k+1 moment;
2. safe envelope ellipse is set up according to target size, the oval center of circle is impact point Θk=[σkk], long axis direction is parallel In the direction of motion of target, i.e. target angular velocity ΩkDirection, the length of major axis and short axle chosen by following equation respectively:
A=rk(1+α‖Ωk‖),
B=rk,
In formula, a and b represents the oval major axis of envelope and short axle, r respectivelykFor the radius that k moment envelope is justified, α is that angular velocity is converted For the scale factor of axial length, the factor is represented to evade and is set aside some time, ‖ Ωk‖ is target angular velocity of satellite motion vector field homoemorphism;
3. the envelope circle and envelope of aforementioned generation are oval forms the safe envelope of Plane Angle, and the safe envelope by with ellipse short shaft is The semiellipse along target direction of motion of cut-off rule moves reciprocal semicircle composition with along target;
4. Target threat estima tion is carried out based on the safe envelope of aforesaid plane angle, sets up the threat sign function l based on time kk, Work as lk<When 0, there is collision threat, collision threat is judged whether with this, wherein
l k = sgn ( ( &sigma; ~ - &sigma; k ) 2 + ( &gamma; ~ - &gamma; k ) 2 - r k ) ( &Theta; ~ - &Theta; k ) &CenterDot; &Omega; k < 0 sgn ( ( &sigma; ~ - &sigma; k ) 2 a + ( &gamma; ~ - &gamma; k ) 2 b - 1 ) ( &Theta; ~ - &Theta; k ) &CenterDot; &Omega; k &GreaterEqual; 0 ,
WhereinThe angle of the major axes orientation relative to unmanned plane major axes orientation of camera B is represented, wherein, Sgn () is sign function;
5. work as lk<When 0, distance principle is evaded according to minimum, distance is found in the safe envelope of Plane AngleNearest point s*= [σ**] as minimum evasion manoeuvre point:
s * = &Theta; k + ( &Theta; ~ - &Theta; k ) | | &Theta; ~ - &Theta; k | | r k , ( &Theta; ~ - &Theta; k ) &CenterDot; &Omega; k < 0 &Theta; k &PlusMinus; e &perp; &Omega; k r k , ( &Theta; ~ - &Theta; k ) &CenterDot; &Omega; k &GreaterEqual; 0 ,
WhereinRepresent unit vector of the k moment perpendicular to target angular velocity vector.
6. bypassing method according to claim 3, it is characterised in that evasion manoeuvre pitching and yaw angle in the step 4 The concrete calculation procedure of degree is as follows:
1. defining Interactive matrix is
L e = - cos&sigma; k cos&gamma; k d - cos&sigma; k sin&gamma; k d sin&sigma; k sin&gamma; k - cos&gamma; k 0 sin&gamma; k d sin&sigma; k - cos&gamma; k d sin&sigma; k 0 cos&gamma; k cos&sigma; k sin&sigma; k sin&gamma; k cos&sigma; k sin&sigma; k - 1 ,
Speed control is set up in the Visual servoing control device of Visual servoing control system, feedback quantity is The exponential damping of error is completed, output speed controlled quentity controlled variable V, Visual servoing control device are expressed as
V = &lsqb; v , w &rsqb; = - &lambda;L e + e ,
In formula, λ is error extension attenuation quotient,Represent LePseudoinverse;
Due in Interactive matrix LeIn cannot obtain the information apart from d of target and the machine, Interactive matrix is carried out splitting as follows:
L e = &lsqb; 1 d L t , L &omega; &rsqb; ,
In formula, LωRepresent LeIn Angle ambiguity component, LtRepresent speed motor control component;
Obtain apart from unrelated Visual servoing control device:
&omega; = - &lambda;L &omega; + e ,
In formula,Represent LωPseudoinverse;
To eliminate steady-state error, Visual servoing control device is compensated, it is as follows:
&omega; = - &lambda;L &omega; + e + L &omega; + ( &Omega; + s * | | s * | | &epsiv; ) = &omega; x &omega; y &omega; z ,
In formula, Ω represents the angular velocity of target motion,Represent the direction vector of error, ωx、ωy、ωzRepresent ω's respectively Three components;
2. the angle of pitch and yaw angle for exporting be
&phi; c ( k ) = &phi; ( k ) + tan V ( k ) &omega; z ( k ) g
In formula,And φcK () represents the angle of pitch and yaw angle of automatic pilot output attitude,Represent with φ (k) The angle of pitch and yaw angle of unmanned plane current pose, Δ t represent Visual servoing control device output time interval steps, ωy(k) and ωzK () represents the rate of pitch controlled quentity controlled variable and yaw rate controlled quentity controlled variable of current time Visual servoing control device output respectively, G represents acceleration of gravity, and V (k) represents the speed of current time unmanned plane.
7. bypassing method according to claim 3, it is characterised in that air route retrogression mechanism specifically builds in the step 5 Vertical step is as follows:
1. unmanned plane is determined whether in air route by the machine navigation positioning system, when the machine not in air route when, carry out air route and return Return;
2. confirm the recurrence air route angle of moment k
&gamma; d * = cos - 1 ( P d 12 ( k ) - P s 12 ) &CenterDot; e s 12 | | P d 12 - P s 12 | | + &pi; 2 ,
&sigma; d * = cos - 1 ( P d 13 - P s 13 ) &CenterDot; e s 13 | | P d 13 - P s 13 | | + 3 &pi; 4 ,
In formula,Represent minimum evasive maneuvering point position when air route returns;
Wherein PdIt is position of the machine on script air route when there is no evasion manoeuvre, Pd12And Pd13The machine respectively in XY and The two-dimensional position of XZ planes;
PsIt is the machine current location obtained by the machine navigation positioning system, Ps12And Ps13It is the machine respectively in XY and XZ planes Two-dimensional position;
esIt is the machine direction vector obtained by the machine navigation positioning system, es12And es13It is the machine respectively in XY and XZ planes Two-dimensional directional vector.
CN201410305109.6A 2014-06-30 2014-06-30 The perception of view-based access control model servo and bypassing method and system Active CN104102218B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410305109.6A CN104102218B (en) 2014-06-30 2014-06-30 The perception of view-based access control model servo and bypassing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410305109.6A CN104102218B (en) 2014-06-30 2014-06-30 The perception of view-based access control model servo and bypassing method and system

Publications (2)

Publication Number Publication Date
CN104102218A CN104102218A (en) 2014-10-15
CN104102218B true CN104102218B (en) 2017-04-05

Family

ID=51670439

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410305109.6A Active CN104102218B (en) 2014-06-30 2014-06-30 The perception of view-based access control model servo and bypassing method and system

Country Status (1)

Country Link
CN (1) CN104102218B (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6312178B2 (en) * 2014-12-31 2018-04-18 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd Navigation system, method for evaluating state information of transport aircraft, and apparatus for evaluating state information of transport aircraft
CN104539906B (en) * 2015-01-08 2017-06-09 西安费斯达自动化工程有限公司 Image/laser range finding/ADS B monitor integral system
CN104656663B (en) * 2015-02-15 2017-12-01 西北工业大学 A kind of unmanned plane formation of view-based access control model perceives and bypassing method
CN104914877A (en) * 2015-07-13 2015-09-16 沈阳飞羽航空科技有限公司 Method for perceiving and evading light unmanned aerial vehicle autonomously
EP3835912A1 (en) 2015-12-09 2021-06-16 SZ DJI Technology Co., Ltd. Systems and methods for auto-return
CN106056624A (en) * 2016-05-24 2016-10-26 西北工业大学 Unmanned aerial vehicle high-definition image small target detecting and tracking system and detecting and tracking method thereof
CN106371461A (en) * 2016-09-08 2017-02-01 河海大学常州校区 Visual servo based video tracking flight object control system and method
US10552691B2 (en) * 2017-04-25 2020-02-04 TuSimple System and method for vehicle position and velocity estimation based on camera and lidar data
CN110362098B (en) * 2018-03-26 2022-07-05 北京京东尚科信息技术有限公司 Unmanned aerial vehicle visual servo control method and device and unmanned aerial vehicle
JP6974247B2 (en) * 2018-04-27 2021-12-01 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co., Ltd Information processing equipment, information presentation instruction method, program, and recording medium
CN109947123B (en) * 2019-02-27 2021-06-22 南京航空航天大学 Unmanned aerial vehicle path tracking and autonomous obstacle avoidance method based on sight guidance law
CN112766025B (en) * 2019-11-04 2022-03-01 上海喜通装饰材料有限公司 Airspace target state data identification system
CN110908395A (en) * 2019-11-26 2020-03-24 西北工业大学 Improved unmanned aerial vehicle flight path real-time planning method
CN112092805B (en) * 2020-09-23 2021-10-19 北京理工大学 Integrated control method and system for collision avoidance and collision damage reduction of intelligent vehicle
CN112419417B (en) * 2021-01-25 2021-05-18 成都翼比特自动化设备有限公司 Unmanned aerial vehicle-based photographing point positioning method and related device
CN113271409B (en) * 2021-04-06 2022-07-01 南京极目机器人科技有限公司 Combined camera, image acquisition method and aircraft

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2442133A1 (en) * 2010-10-18 2012-04-18 Raytheon Company Systems and methods for collision avoidance in unmanned aerial vehicles

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8380367B2 (en) * 2009-03-26 2013-02-19 The University Of North Dakota Adaptive surveillance and guidance system for vehicle collision avoidance and interception
CN102707724B (en) * 2012-06-05 2015-01-14 清华大学 Visual localization and obstacle avoidance method and system for unmanned plane
CN102854883B (en) * 2012-07-04 2014-10-22 北京航空航天大学 Modeling method for unmanned aerial vehicle (UAV) dynamic emergency collision avoidance area
CN103149939B (en) * 2013-02-26 2015-10-21 北京航空航天大学 A kind of unmanned plane dynamic target tracking of view-based access control model and localization method
CN103869822B (en) * 2014-04-01 2016-09-07 西北工业大学 The perception of many rotor wing unmanned aerial vehicles and avoidance system and bypassing method thereof

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2442133A1 (en) * 2010-10-18 2012-04-18 Raytheon Company Systems and methods for collision avoidance in unmanned aerial vehicles

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
无人机复杂环境中跟踪运动目标的实时航路规划;梁宵 等;《北京航空航天大学学报》;20120930;第38卷(第9期);第1129-1133页 *
电力巡线无人直升机障碍规避***;郑天茹 等;《山东电力技术》;20121231(第185期);第14-17页 *

Also Published As

Publication number Publication date
CN104102218A (en) 2014-10-15

Similar Documents

Publication Publication Date Title
CN104102218B (en) The perception of view-based access control model servo and bypassing method and system
CN104656663B (en) A kind of unmanned plane formation of view-based access control model perceives and bypassing method
CN103941747B (en) The control method of unmanned aerial vehicle group and system
US8301318B2 (en) Robotic vehicle remote control system having a virtual operator environment
KR101492271B1 (en) Method and system to control operation of a device using an integrated simulation with a time shift option
CN106647790A (en) Four-rotor unmanned aerial vehicle aircraft system oriented to complex environment and flying method
CN106249755B (en) A kind of unmanned plane autonomous navigation system and air navigation aid
US10703508B1 (en) Stereoscopic flight simulator with data acquisition
US20200191556A1 (en) Distance mesurement method by an unmanned aerial vehicle (uav) and uav
Griffiths et al. Obstacle and terrain avoidance for miniature aerial vehicles
US9441985B2 (en) Future scene generating system, device, and method for a remotely-operated vehicle
US11556681B2 (en) Method and system for simulating movable object states
CN108733064A (en) A kind of the vision positioning obstacle avoidance system and its method of unmanned plane
Yu et al. Stereo vision based obstacle avoidance strategy for quadcopter UAV
CN102190081A (en) Vision-based fixed point robust control method for airship
CN110333735A (en) A kind of system and method for realizing the secondary positioning in unmanned plane land and water
EP2523062B1 (en) Time phased imagery for an artificial point of view
RU195749U1 (en) Intelligent vision system for an unmanned aerial vehicle for solving navigation problems, building a three-dimensional map of the surrounding space and obstacles, and autonomous patrolling
WO2023102911A1 (en) Data collection method, data presentation method, data processing method, aircraft landing method, data presentation system and storage medium
Miller et al. UAV navigation based on videosequences captured by the onboard video camera
Minwalla et al. Experimental evaluation of PICAS: An electro-optical array for non-cooperative collision sensing on unmanned aircraft systems
Lee et al. Landing Site Inspection and Autonomous Pose Correction for Unmanned Aerial Vehicles
Gonçalves et al. Vision-based automatic approach and landing of fixed-wing aircraft using a dense visual tracking
RU2392586C1 (en) Aircraft information-control system
Stojesics et al. Unmanned aerial vehicle guidance methods for 3D aerial image reconstruction

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant