CN107932514A - Airborne equipment based on Robot Visual Servoing control mounts method - Google Patents

Airborne equipment based on Robot Visual Servoing control mounts method Download PDF

Info

Publication number
CN107932514A
CN107932514A CN201711348364.9A CN201711348364A CN107932514A CN 107932514 A CN107932514 A CN 107932514A CN 201711348364 A CN201711348364 A CN 201711348364A CN 107932514 A CN107932514 A CN 107932514A
Authority
CN
China
Prior art keywords
msub
mrow
mtd
mfrac
mtr
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711348364.9A
Other languages
Chinese (zh)
Inventor
潘辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin Jinhang Computing Technology Research Institute
Original Assignee
Tianjin Jinhang Computing Technology Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin Jinhang Computing Technology Research Institute filed Critical Tianjin Jinhang Computing Technology Research Institute
Priority to CN201711348364.9A priority Critical patent/CN107932514A/en
Publication of CN107932514A publication Critical patent/CN107932514A/en
Pending legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1694Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697Vision controlled systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00Controls for manipulators
    • B25J13/08Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1602Programme controls characterised by the control system, structure, architecture
    • B25J9/1607Calculation of inertia, jacobian matrixes and inverses

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Manipulator (AREA)

Abstract

The invention discloses a kind of airborne equipment based on Robot Visual Servoing control to mount method, it includes the following steps:Step 1:Bomb hoist device people's end view picture is obtained, extracts characteristics of image;Step 2:Vision controller is designed according to characteristics of image;Step 3:The amount of exercise in each joint of robot is calculated according to robot kinematics;Step 4:Control law is generated, controls bomb truck movement that carry thing is moved at aircraft hanging point according to control law and is mounted.The present invention can effectively improve air weapon and mount efficiency;The present invention is applied widely, is suitable for the automatic of a variety of carry things of heterogenous and mounts.

Description

Airborne equipment based on Robot Visual Servoing control mounts method
Technical field
The invention belongs to pattern-recognition and field of artificial intelligence, it is related to a kind of based on Robot Visual Servoing control Airborne equipment mounts method, is mainly used in as the various guided missile of operational aircraft carry and bomb, can use manpower and material resources sparingly, significantly carry The efficiency of the high various air weapon of opportunity of combat carry.
Background technology
Robot Visual Servoing control is pattern-recognition and the important technology in artificial intelligence field, is passed by introducing vision Sensor, makes the ability of robot sensing external environment, is multi-sensor information fusion with integrated technology in robot skill Important application in art, has the flexibility of higher compared with the Robot Control Technology based on traditional nonvisual sensor, The precision of higher, possesses stronger environment self-adaption ability, can preferably complete various tasks.
Visual Servoing System provides external information from visual sensor to robot, so as to control robot real-time Its pose is adjusted, is realized and is accurately tracked or position, completes corresponding work.
Mainly or by manpower completed when current ground crew mounts various carry thing for opportunity of combat, it is necessary to by visually observing position Put, constantly manually adjust position and the posture of carry thing, time-consuming and laborious, inefficient, this very likely can left and right one in wartime Field outcome of a war, therefore, research and utilization bomb truck on-vehicle machines people have important for the various carry thing of opportunity of combat carry automatically Practical significance and engineering value.
The content of the invention
(1) goal of the invention
The purpose of the present invention is:Provide a kind of fast and effectively air weapon based on robot vision servo control method Automatically method is mounted, carry thing can be rapidly completed using robot mounts work.
(2) technical solution
In order to solve the above technical problem, the present invention provides a kind of airborne equipment extension based on Robot Visual Servoing control Dress method, it includes the following steps:
Step 1:Bomb hoist device people's end view picture is obtained, extracts characteristics of image;
Step 2:Vision controller is designed according to characteristics of image;
Step 3:The amount of exercise in each joint of robot is calculated according to robot kinematics;
Step 4:Generate control law, according to control law control bomb truck movement by carry thing be moved at aircraft hanging point into Row mounts.
Wherein, in the step 1, bomb hoist device people's end view picture is obtained, extracts characteristic point under camera coordinate systemcP= [Xc,Yc,Zc]TImage coordinate [u, v]T, had according to imaging modelWherein fxAnd fyFor video camera equivalent focal length; PointcP is change under visual sensor coordinate system, it is assumed that movement velocity of this under camera coordinate system beThen haveWhereincV=[cvx,cvy,cvz,]T,cΩ=[cωx,cωy,cωz,]TRespectivelycP is in camera coordinates Linear velocity and angular speed under system.
Wherein, in the step 2, to image coordinate derivation in step 1, obtained further according to relation in step 2:
Wherein,Referred to as image jacobian matrix,c Ψ=[cvx cvy cvz cωx cωy cωz]T
Wherein, in the step 3, the amount of exercise in each joint of robot is calculated according to robot kinematics;
Bomb hoist device people's manipulator End features point is converted to robot mechanical arm end under camera coordinate system to sit Mark system, draws each amount of articulation accordingly,
WhereinJrobot For Robot Generalized Jacobian matrix, S (ePc) serve as reasonsePcElement composition antisymmetric matrix,Bomb hoist exactly to be asked The amount of exercise in each joint of device people.
Wherein, in the step 4, the amount of exercise in each joint of bomb hoist device people provided according to step 3Design control System rule, control robot end mount carry thing to designated position.
(3) beneficial effect
The airborne equipment based on Robot Visual Servoing control that above-mentioned technical proposal is provided mounts method, can effectively carry High air weapon mounts efficiency;The present invention is applied widely, is suitable for the automatic of a variety of carry things of heterogenous and mounts.
Brief description of the drawings
Fig. 1 mounts method system frame automatically for a kind of air weapon based on Robot Visual Servoing proposed by the present invention Figure.
Fig. 2 is the automatic bomb truck structure diagram based on method proposed by the invention.
Embodiment
To make the purpose of the present invention, content and advantage clearer, with reference to the accompanying drawings and examples, to the present invention's Embodiment is described in further detail.
Current hanging point image is obtained using a video camera, feature is extracted and compared with reference picture feature, according to vision Control law constantly adjusts the pose of carry thing, suitably mounts position until carry thing reaches, visual sensor obtains at this time Characteristics of image is identical with reference picture feature, so far just completes and mounts work.
It is that a kind of airborne equipment based on Robot Visual Servoing control mounts method as described above, this method is for the first time Using needing to carry out teaching campaign to bomb hoist device people, reference picture, afterwards such carry of carry are obtained at hanging point when reaching It can implement carry as with reference to control robot during thing, specifically comprise the following steps:
Step 1:Bomb hoist device people's end view picture is obtained, extracts characteristics of image;
Bomb hoist device people's end view picture is obtained, extracts characteristic point under camera coordinate systemcP=[Xc,Yc,Zc]TImage sit Mark [u, v]T, had according to imaging modelWherein fxAnd fyFor video camera equivalent focal length;PointcP is sat in visual sensor Change under mark system, it is assumed that movement velocity of this under camera coordinate system beThen haveIts IncV=[cvx,cvy,cvz,]T,cΩ=[cωx,cωy,cωz,]TRespectivelycLinear velocities and angle speed of the P under camera coordinate system Degree;
Step 2:Vision controller is designed according to characteristics of image;
To image coordinate derivation in step 1, obtained further according to relation in step 2:
Wherein,Referred to as image jacobian matrix,cΨ=[cvx cvy cvz cωx cωy cωz]T
Step 3:The amount of exercise in each joint of robot is calculated according to robot kinematics;
Bomb hoist device people's manipulator End features point is converted to robot mechanical arm end under camera coordinate system to sit Mark system, draws each amount of articulation accordingly,WhereinJrobotFor Robot Generalized Jacobian matrix, S (ePc) serve as reasonsePcElement composition opposition Claim matrix,The amount of exercise in each joint of bomb hoist device people exactly to be asked.
Step 4:Generate control law, according to control law control bomb truck movement by carry thing be moved at aircraft hanging point into Row mounts.
The amount of exercise in each joint of bomb hoist device people provided according to step 3Design control law, control robot end End mounts carry thing to designated position.
In conclusion the present invention is using the robot vision servo control method of view-based access control model image, to be embodied as aircraft automatic The method of the various carry things of carry, can greatly improve carry efficiency.
The above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, without departing from the technical principles of the invention, some improvement and deformation can also be made, these are improved and deformation Also it should be regarded as protection scope of the present invention.

Claims (5)

1. a kind of airborne equipment based on Robot Visual Servoing control mounts method, it is characterised in that includes the following steps:
Step 1:Bomb hoist device people's end view picture is obtained, extracts characteristics of image;
Step 2:Vision controller is designed according to characteristics of image;
Step 3:The amount of exercise in each joint of robot is calculated according to robot kinematics;
Step 4:Control law is generated, controls bomb truck movement that carry thing is moved at aircraft hanging point according to control law and is hung Dress.
2. the airborne equipment as claimed in claim 1 based on Robot Visual Servoing control mounts method, it is characterised in that institute State in step 1, obtain bomb hoist device people's end view picture, extract characteristic point under camera coordinate systemcP=[Xc,Yc,Zc]TImage Coordinate [u, v]T, had according to imaging modelWherein fxAnd fyFor video camera equivalent focal length;PointcP is in visual sensor It is change under coordinate system, it is assumed that movement velocity of this under camera coordinate system beThen haveIts IncV=[cvx,cvy,cvz,]T,cΩ=[cωx,cωy,cωz,]TRespectivelycLinear velocities and angle speed of the P under camera coordinate system Degree.
3. the airborne equipment as claimed in claim 2 based on Robot Visual Servoing control mounts method, it is characterised in that institute State in step 2, to image coordinate derivation in step 1, obtained further according to relation in step 2:
<mrow> <mfenced open = "[" close = "]"> <mtable> <mtr> <mtd> <mover> <mi>u</mi> <mo>&amp;CenterDot;</mo> </mover> </mtd> </mtr> <mtr> <mtd> <mover> <mi>v</mi> <mo>&amp;CenterDot;</mo> </mover> </mtd> </mtr> </mtable> </mfenced> <mo>=</mo> <mfenced open = "[" close = "]"> <mtable> <mtr> <mtd> <mfrac> <msub> <mi>f</mi> <mi>x</mi> </msub> <msub> <mi>Z</mi> <mi>c</mi> </msub> </mfrac> </mtd> <mtd> <mn>0</mn> </mtd> <mtd> <mrow> <mo>-</mo> <mfrac> <mi>u</mi> <msub> <mi>Z</mi> <mi>c</mi> </msub> </mfrac> </mrow> </mtd> <mtd> <mrow> <mo>-</mo> <mfrac> <mrow> <mi>u</mi> <mi>v</mi> </mrow> <msub> <mi>f</mi> <mi>y</mi> </msub> </mfrac> </mrow> </mtd> <mtd> <mrow> <msub> <mi>f</mi> <mi>x</mi> </msub> <mo>+</mo> <mfrac> <msup> <mi>u</mi> <mn>2</mn> </msup> <msub> <mi>f</mi> <mi>x</mi> </msub> </mfrac> </mrow> </mtd> <mtd> <mrow> <mo>-</mo> <mfrac> <mrow> <msub> <mi>f</mi> <mi>x</mi> </msub> <mi>v</mi> </mrow> <msub> <mi>f</mi> <mi>y</mi> </msub> </mfrac> </mrow> </mtd> </mtr> <mtr> <mtd> <mn>0</mn> </mtd> <mtd> <mfrac> <msub> <mi>f</mi> <mi>y</mi> </msub> <msub> <mi>Z</mi> <mi>c</mi> </msub> </mfrac> </mtd> <mtd> <mrow> <mo>-</mo> <mfrac> <mi>v</mi> <msub> <mi>Z</mi> <mi>c</mi> </msub> </mfrac> </mrow> </mtd> <mtd> <mrow> <mo>-</mo> <msub> <mi>f</mi> <mi>y</mi> </msub> <mo>-</mo> <mfrac> <msup> <mi>v</mi> <mn>2</mn> </msup> <msub> <mi>f</mi> <mi>y</mi> </msub> </mfrac> </mrow> </mtd> <mtd> <mrow> <mo>-</mo> <mfrac> <mrow> <mi>u</mi> <mi>v</mi> </mrow> <msub> <mi>f</mi> <mi>x</mi> </msub> </mfrac> </mrow> </mtd> <mtd> <mrow> <mo>-</mo> <mfrac> <mrow> <msub> <mi>f</mi> <mi>y</mi> </msub> <mi>u</mi> </mrow> <msub> <mi>f</mi> <mi>x</mi> </msub> </mfrac> </mrow> </mtd> </mtr> </mtable> </mfenced> <mfenced open = "[" close = "]"> <mtable> <mtr> <mtd> <mrow> <msub> <mmultiscripts> <mi>v</mi> <mi>c</mi> </mmultiscripts> <mi>x</mi> </msub> </mrow> </mtd> </mtr> <mtr> <mtd> <mrow> <msub> <mmultiscripts> <mi>v</mi> <mi>c</mi> </mmultiscripts> <mi>y</mi> </msub> </mrow> </mtd> </mtr> <mtr> <mtd> <mrow> <msub> <mmultiscripts> <mi>v</mi> <mi>c</mi> </mmultiscripts> <mi>z</mi> </msub> </mrow> </mtd> </mtr> <mtr> <mtd> <mrow> <msub> <mmultiscripts> <mi>&amp;omega;</mi> <mi>c</mi> </mmultiscripts> <mi>x</mi> </msub> </mrow> </mtd> </mtr> <mtr> <mtd> <mrow> <msub> <mmultiscripts> <mi>&amp;omega;</mi> <mi>c</mi> </mmultiscripts> <mi>y</mi> </msub> </mrow> </mtd> </mtr> <mtr> <mtd> <mrow> <msub> <mmultiscripts> <mi>&amp;omega;</mi> <mi>c</mi> </mmultiscripts> <mi>z</mi> </msub> </mrow> </mtd> </mtr> </mtable> </mfenced> <mo>=</mo> <msub> <mi>J</mi> <mrow> <mi>i</mi> <mi>m</mi> <mi>a</mi> <mi>g</mi> <mi>e</mi> </mrow> </msub> <mmultiscripts> <mi>&amp;Psi;</mi> <mi>c</mi> </mmultiscripts> </mrow>
Wherein,Referred to as image jacobian matrix,cΨ= [cvx cvy cvz cωx cωy cωz]T
4. the airborne equipment as claimed in claim 3 based on Robot Visual Servoing control mounts method, it is characterised in that institute State in step 3, the amount of exercise in each joint of robot is calculated according to robot kinematics;
Bomb hoist device people's manipulator End features point is converted to robot mechanical arm ending coordinates system under camera coordinate system, accordingly Draw each amount of articulation,Wherein JrobotFor Robot Generalized Jacobian matrix, S (ePc) serve as reasonsePcElement composition antisymmetric matrix,Extension exactly to be asked Play the amount of exercise in each joint of robot.
5. the airborne equipment as claimed in claim 4 based on Robot Visual Servoing control mounts method, it is characterised in that institute State in step 4, the amount of exercise in each joint of bomb hoist device people provided according to step 3Design control law, controls robot End mounts carry thing to designated position.
CN201711348364.9A 2017-12-15 2017-12-15 Airborne equipment based on Robot Visual Servoing control mounts method Pending CN107932514A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711348364.9A CN107932514A (en) 2017-12-15 2017-12-15 Airborne equipment based on Robot Visual Servoing control mounts method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711348364.9A CN107932514A (en) 2017-12-15 2017-12-15 Airborne equipment based on Robot Visual Servoing control mounts method

Publications (1)

Publication Number Publication Date
CN107932514A true CN107932514A (en) 2018-04-20

Family

ID=61944275

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711348364.9A Pending CN107932514A (en) 2017-12-15 2017-12-15 Airborne equipment based on Robot Visual Servoing control mounts method

Country Status (1)

Country Link
CN (1) CN107932514A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108927807A (en) * 2018-08-14 2018-12-04 河南工程学院 A kind of robot vision control method based on point feature
CN108985184A (en) * 2018-06-26 2018-12-11 齐霄强 A kind of automatic carry system of multipurpose aircraft store Combinations and hanging method
CN109648555A (en) * 2018-12-18 2019-04-19 湖北航天技术研究院总体设计所 A kind of automatic transferring tool arm control method based on Multi-sensor Fusion
CN113268089A (en) * 2021-04-08 2021-08-17 成都立航科技股份有限公司 Method for adjusting pose of hanging object outside hanging vehicle

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6278906B1 (en) * 1999-01-29 2001-08-21 Georgia Tech Research Corporation Uncalibrated dynamic mechanical system controller
US6681151B1 (en) * 2000-12-15 2004-01-20 Cognex Technology And Investment Corporation System and method for servoing robots based upon workpieces with fiducial marks using machine vision
JP2011093014A (en) * 2009-10-27 2011-05-12 Ihi Corp Control device of hand-eye bin picking robot
CN106017463A (en) * 2016-05-26 2016-10-12 浙江大学 Aircraft positioning method based on positioning and sensing device
CN106960440A (en) * 2017-04-20 2017-07-18 力源液压***(贵阳)有限公司 Based on subject image characteristic point pixel space position combination control method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6278906B1 (en) * 1999-01-29 2001-08-21 Georgia Tech Research Corporation Uncalibrated dynamic mechanical system controller
US6681151B1 (en) * 2000-12-15 2004-01-20 Cognex Technology And Investment Corporation System and method for servoing robots based upon workpieces with fiducial marks using machine vision
JP2011093014A (en) * 2009-10-27 2011-05-12 Ihi Corp Control device of hand-eye bin picking robot
CN106017463A (en) * 2016-05-26 2016-10-12 浙江大学 Aircraft positioning method based on positioning and sensing device
CN106960440A (en) * 2017-04-20 2017-07-18 力源液压***(贵阳)有限公司 Based on subject image characteristic point pixel space position combination control method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
刘卫朋: "焊接机器人焊接路径识别与自主控制方法研究及应用", 《中国博士学位论文全文数据库》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108985184A (en) * 2018-06-26 2018-12-11 齐霄强 A kind of automatic carry system of multipurpose aircraft store Combinations and hanging method
CN108985184B (en) * 2018-06-26 2022-04-29 齐霄强 Automatic mounting system and method for multipurpose aircraft plug-in
CN108927807A (en) * 2018-08-14 2018-12-04 河南工程学院 A kind of robot vision control method based on point feature
CN108927807B (en) * 2018-08-14 2020-08-07 河南工程学院 Robot vision control method based on point characteristics
CN109648555A (en) * 2018-12-18 2019-04-19 湖北航天技术研究院总体设计所 A kind of automatic transferring tool arm control method based on Multi-sensor Fusion
CN113268089A (en) * 2021-04-08 2021-08-17 成都立航科技股份有限公司 Method for adjusting pose of hanging object outside hanging vehicle

Similar Documents

Publication Publication Date Title
CN107932514A (en) Airborne equipment based on Robot Visual Servoing control mounts method
CN107901041B (en) Robot vision servo control method based on image mixing moment
Zheng et al. Image-based visual servoing of a quadrotor using virtual camera approach
CN108499054B (en) A kind of vehicle-mounted mechanical arm based on SLAM picks up ball system and its ball picking method
CN109895099B (en) Flying mechanical arm visual servo grabbing method based on natural features
CN108563235B (en) Multi-rotor unmanned aerial vehicle, method, device and equipment for grabbing target object
CN110427043B (en) Pose controller design method based on gravity center offset of operation flying robot
CN105196292B (en) Visual servo control method based on iterative duration variation
CN109522669B (en) Method for tracking fruit space posture and fruit space motion based on binocular vision
CN106774309A (en) A kind of mobile robot is while visual servo and self adaptation depth discrimination method
CN106371442A (en) Tensor-product-model-transformation-based mobile robot control method
CN112109074A (en) Robot target image capturing method
CN110170996A (en) A kind of quick teaching system of robot based on stereoscopic vision
CN106569502A (en) Complex attitude adaptive control method after multi-rotor aircraft captures target
CN109087343A (en) A kind of generation method and system of workpiece grabbing template
Kim et al. Dynamic Model and Motion Control of a Robotic Manipulator.
CN111546331A (en) Safety protection system and safety protection method for man-machine cooperative robot
Sato et al. High-speed catching by multi-vision robot hand
Yu et al. Design of a humanoid ping-pong player robot with redundant joints
CN108170160A (en) It is a kind of to utilize monocular vision and the autonomous grasping means of airborne sensor rotor wing unmanned aerial vehicle
Xu et al. Visual-impedance-based human–robot cotransportation with a tethered aerial vehicle
Yu et al. Visual servoing with quick eye-vergence to enhance trackability and stability
CN109592057A (en) A kind of tanker aircraft of view-based access control model servo is by oily implementation method
Huang et al. Virtual interaction and manipulation control of a hexacopter through hand gesture recognition from a data glove
Navarro-Alarcon et al. A dynamic and uncalibrated method to visually servo-control elastic deformations by fully-constrained robotic grippers

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180420