CN108333924B - Virtual fixture optimization generation method in operation interaction process - Google Patents

Virtual fixture optimization generation method in operation interaction process Download PDF

Info

Publication number
CN108333924B
CN108333924B CN201810046959.7A CN201810046959A CN108333924B CN 108333924 B CN108333924 B CN 108333924B CN 201810046959 A CN201810046959 A CN 201810046959A CN 108333924 B CN108333924 B CN 108333924B
Authority
CN
China
Prior art keywords
virtual
clamp
state
fixture
virtual clamp
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810046959.7A
Other languages
Chinese (zh)
Other versions
CN108333924A (en
Inventor
黄攀峰
任瑾力
刘正雄
董刚奇
孟中杰
张夷斋
张帆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northwestern Polytechnical University
Original Assignee
Northwestern Polytechnical University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Northwestern Polytechnical University filed Critical Northwestern Polytechnical University
Priority to CN201810046959.7A priority Critical patent/CN108333924B/en
Publication of CN108333924A publication Critical patent/CN108333924A/en
Application granted granted Critical
Publication of CN108333924B publication Critical patent/CN108333924B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B13/00Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
    • G05B13/02Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
    • G05B13/04Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric involving the use of models or simulators
    • G05B13/042Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric involving the use of models or simulators in which a parameter or coefficient is automatically adjusted to optimise the performance

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Feedback Control In General (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention relates to a virtual fixture optimization generation method in an operation interaction process, which is characterized in that an optimization method is utilized to optimize and generate a virtual fixture, path points are selected firstly, state variable construction is carried out, and a state equation which the virtual fixture should meet is obtained; giving out a required functional function and a constraint condition; solving the required path track and the virtual clamp parameters; and generating the virtual clamp according to the generated track and the virtual clamp parameters. According to the scheme of the invention, different virtual clamp configuration parameters can be obtained according to the environment where the virtual clamp is located and the characteristics of the virtual clamp, and the method and the device are suitable for more complex task requirements.

Description

Virtual fixture optimization generation method in operation interaction process
Technical Field
The invention belongs to the field of operation interaction control, and relates to a virtual clamp optimization generation method in an operation interaction process, which can be used for assisting an operator in refined operation in a teleoperation process and completing an operation task with higher precision requirement.
Background
Teleoperation techniques and teleoperation systems have been greatly developed over the past few decades. Teleoperated systems can help operators perform a number of very challenging tasks such as disaster relief, unmanned mining, hazardous material handling, remote assistance, telemedicine, and the like.
In the teleoperation process, the tail end mechanism executes an instruction sent by an operator through the interactive system, corresponding operation is carried out, an operation result and the working state of the tail end are fed back, and the tail end state can be conveniently predicted. In the teleoperation process, the refined instruction is generated in a corresponding interaction mode basically depending on the operator, and is limited by the operator to a great extent. In the existing operation modes, a hand controller is used as a main interaction mode, for the control of the position of the tail end, the corresponding operation of the tail end needs to be carried out by depending on the observation of an operator, and for the consideration of human body functions, in the operation task with higher accuracy requirement, the control of the tail end by depending on the operator is not enough. To address this problem and ensure that the operator can complete the task more accurately at a given time, researchers have developed a concept of a virtual fixture.
The virtual clamp is used as a universal guiding mode, and by limiting the motion position of the tail end of the robot, abstract sensory information, force sense, touch sense and other information are generated from a virtual environment and fed back to a main-end operator, so that the auxiliary operator can complete fine operation.
The robot auxiliary system achieves corresponding auxiliary effects by performing constraint action on expected movement of the tail end of the robot. The existing virtual clamp is mainly realized by the following steps: simple function method, proxy point method, potential field method, non-energy-storage constraint method, constraint joint optimization method, reference direction clamp method, mechanical passive constraint implementation method and the like. The generated virtual clamp needs to feed back some sense information to the operator to assist the operator to complete some experiments. For teleoperation, the virtual fixture itself is the tool generated for the convenience of end control, and therefore, the feedback of the virtual fixture and its own influence on the teleoperation process need to be considered.
Disclosure of Invention
Technical problem to be solved
In order to avoid the defects of the prior art, the invention provides an optimal virtual clamp generation method in the operation interaction process, which is used for generating a more efficient virtual clamp for some tasks in the teleoperation process so as to assist an operator to complete the control of a tail end.
Technical scheme
A virtual clamp optimization generation method in an operation interaction process is characterized by comprising the following steps:
step 1: selecting a plurality of path points (x) according to the tasks to be completed by the virtual clamp in the established virtual environment by adopting an interactive tooli,yi,zi);
Step 2: for a plurality of selected path points (x)i,yi,zi) Constructing the State variables (x)i,yi,zi,ki) Obtaining a state equation which the virtual clamp should meet;
Figure BDA0001551184700000021
wherein A (4X4) represents a system matrix, determined by the relationship between states, B (1X4) is an input matrix determining the influence of the input on the system state, C (4X1) is a system observation matrix representing the state to be output, X is the state variable of the whole system, U is the system input, Y is the system output, k is the system outputiCharacteristic parameters of the virtual clamp;
and step 3: according to the obtained state equation, the characteristic parameter k of the virtual clampiObtaining a required functional function and a required constraint condition;
the functional function is: target functional function:
Figure BDA0001551184700000022
hamiltonian: h [ x (t), u (t), lambda (t), t]=L[x(t),u(t),t]+λT(t)f[x(t),u(t),t]
The constraint conditions are as follows: the adjoint equation:
Figure BDA0001551184700000031
the control equation:
Figure BDA0001551184700000032
the cross-section conditions are as follows:
Figure BDA0001551184700000033
wherein λ is a Lagrange multiplier vector;
and 4, step 4: solving the constraint conditions in the step 3 to obtain a path track and virtual fixture parameters;
and 5: generating and setting the virtual clamp according to the generated track and the virtual clamp parameters to complete the configuration of one path point; (ii) a
Step 6: and (5) repeating the steps 2 to 5, and performing virtual fixture setting on all the path points to generate a new virtual fixture.
Advantageous effects
The invention provides a virtual fixture optimization generation method in an operation interaction process, which is characterized in that an optimization method is used for optimizing and generating a virtual fixture, path points are selected firstly, state variable construction is carried out, and a state equation which the virtual fixture should meet is obtained; giving out a required functional function and a constraint condition; solving the required path track and the virtual clamp parameters; and generating the virtual clamp according to the generated track and the virtual clamp parameters.
The virtual fixture optimization generation scheme provided by the invention can obtain different virtual fixture configuration parameters aiming at the environment where the virtual fixture is located and the characteristics of the virtual fixture, and is suitable for more complex task requirements, and compared with the prior art, the virtual fixture optimization generation scheme has the following beneficial effects:
1) the virtual clamp is optimized in consideration of the influence of an operator on the virtual clamp;
2) optimizing the virtual fixture in consideration of the influence of the tail end environment on the virtual fixture;
3) the track of the virtual clamp is optimized by using an optimization method, so that the operation efficiency is improved.
Detailed Description
The invention will now be further described with reference to the examples:
the invention provides a virtual fixture optimization generation strategy based on an optimization method, which aims at solving the problem that how to generate a more efficient virtual fixture to assist an operator to complete a task in different task environments in a space teleoperation task. The method is realized by the following technical scheme:
step 1: selecting waypoints (x) in an established virtual environment using interactive toolsi,yi,zi) And storing the obtained data;
step 2: selecting a Path Point (x)i,yi,zi) Constructing a state variable (x)i,yi,zi,ki) Obtaining a state equation of the system;
Figure BDA0001551184700000041
wherein A (4X4) represents a system matrix, determined by the relationship between states, B (1X4) is an input matrix determining the influence of the input on the system state, C (4X1) is a system observation matrix representing the state to be output, X is the state variable of the whole system, U is the system input, Y is the system output, k is the system outputiIs a characteristic parameter of the virtual clamp.
And step 3: writing functional functions and constraint conditions of the system according to the system state equation obtained in the step 2 and the model requirement; ensuring the smoothness of the virtual fixture path, ensuring the continuity of the path point track slope, ensuring the direction of the terminal direction vector to be the same as the current initial direction vector, and ensuring kiRelated to the current position and the virtual clamp itself;
the system state equation:
Figure BDA0001551184700000042
target functional function:
Figure BDA0001551184700000043
hamiltonian: h [ x (t), u (t), lambda (t), t]=L[x(t),u(t),t]+λT(t)f[x(t),u(t),t](4)
The adjoint equation:
Figure BDA0001551184700000044
the control equation:
Figure BDA0001551184700000045
the cross-section conditions are as follows:
Figure BDA0001551184700000046
where λ is the lagrange multiplier vector.
And 4, step 4: solving unknown variables in the system state equation according to the equation conditions written in the step 3, and noting that the whole path point is an optimization problem under the end point constraint, therefore, the cross-section condition can be rewritten into
Figure BDA0001551184700000051
Wherein, t0Only for the starting time under the segment of the path, not the starting condition under the overall condition, tfAlso corresponding to the end time of the phase. And solving a stage state function of the stage virtual fixture according to the formula.
And 5: according to the obtained configuration parameters of the virtual clamp, path planning setting is carried out, and meanwhile, virtual force setting can be carried out according to the formula 9;
Figure BDA0001551184700000052
wherein, KGVFIs a virtual force parameter, and kiIn connection with, can be obtained from the state variables of the system, PdAs actual trajectory path points, PrThe theoretical track path points are obtained through calculation.
Step 6: and repeating the steps 2-5, and calculating and configuring the virtual fixture of the complete path track to obtain a complete virtual fixture.

Claims (1)

1. A virtual clamp optimization generation method in an operation interaction process is characterized by comprising the following steps:
step 1: selecting a plurality of path points (x) according to the tasks to be completed by the virtual clamp in the established virtual environment by adopting an interactive tooli,yi,zi);
Step 2: for a plurality of selected path points (x)i,yi,zi) Constructing the State variables (x)i,yi,zi,ki) Obtaining a state equation which the virtual clamp should meet;
Figure FDA0002412630850000011
wherein A (4X4) represents a system matrix, determined by the relationship between states, B (1X4) is an input matrix determining the influence of the input on the system state, C (4X1) is a system observation matrix representing the state to be output, X is the state variable of the whole system, U is the system input, Y is the system output, k is the system outputiCharacteristic parameters of the virtual clamp;
and step 3: according to the obtained state equation, the characteristic parameter k of the virtual clampiObtaining a required functional function and a required constraint condition;
the functional function is: target functional function:
Figure FDA0002412630850000012
hamiltonian: h [ x (t), u (t), lambda (t), t]=L[x(t),u(t),t]+λT(t)f[x(t),u(t),t]
The constraint conditions are as follows: the adjoint equation:
Figure FDA0002412630850000013
the control equation:
Figure FDA0002412630850000014
the cross-section conditions are as follows:
Figure FDA0002412630850000015
wherein λ is a Lagrange multiplier vector;
and 4, step 4: solving the constraint conditions in the step 3 to obtain a path track and virtual fixture parameters;
and 5: according to the obtained virtual clamp configuration parameters, path planning setting is carried out, and meanwhile, virtual force setting can be carried out according to the following formula;
Figure FDA0002412630850000016
wherein, KGVFIs a virtual force parameter, and kiIn connection with, can be obtained from the state variables of the system, PdAs actual trajectory path points, PrCalculating the obtained theoretical track path points;
step 6: and (5) repeating the steps 2 to 5, and performing virtual fixture setting on all the path points to generate a new virtual fixture.
CN201810046959.7A 2018-01-18 2018-01-18 Virtual fixture optimization generation method in operation interaction process Active CN108333924B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810046959.7A CN108333924B (en) 2018-01-18 2018-01-18 Virtual fixture optimization generation method in operation interaction process

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810046959.7A CN108333924B (en) 2018-01-18 2018-01-18 Virtual fixture optimization generation method in operation interaction process

Publications (2)

Publication Number Publication Date
CN108333924A CN108333924A (en) 2018-07-27
CN108333924B true CN108333924B (en) 2020-05-12

Family

ID=62926393

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810046959.7A Active CN108333924B (en) 2018-01-18 2018-01-18 Virtual fixture optimization generation method in operation interaction process

Country Status (1)

Country Link
CN (1) CN108333924B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6278899B1 (en) * 1996-05-06 2001-08-21 Pavilion Technologies, Inc. Method for on-line optimization of a plant
CN102810127A (en) * 2012-07-26 2012-12-05 北京卫星环境工程研究所 Virtual vibration test system for spacecraft
CN104932253A (en) * 2015-04-12 2015-09-23 北京理工大学 Mechanical-electrical composite transmission minimum principle real-time optimization control method
CN105159315A (en) * 2015-09-01 2015-12-16 西北工业大学 Target approaching process robustness planning control method facing tethered space robot
CN105242533A (en) * 2015-09-01 2016-01-13 西北工业大学 Variable-admittance teleoperation control method with fusion of multi-information
CN106444861A (en) * 2016-11-21 2017-02-22 清华大学深圳研究生院 Space robot teleoperation system based on three-dimensional gestures
CN106842121A (en) * 2016-11-07 2017-06-13 宁波大学 Sighting distance and the robust position location method based on reaching time-difference in non line of sight hybird environment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6278899B1 (en) * 1996-05-06 2001-08-21 Pavilion Technologies, Inc. Method for on-line optimization of a plant
CN102810127A (en) * 2012-07-26 2012-12-05 北京卫星环境工程研究所 Virtual vibration test system for spacecraft
CN104932253A (en) * 2015-04-12 2015-09-23 北京理工大学 Mechanical-electrical composite transmission minimum principle real-time optimization control method
CN105159315A (en) * 2015-09-01 2015-12-16 西北工业大学 Target approaching process robustness planning control method facing tethered space robot
CN105242533A (en) * 2015-09-01 2016-01-13 西北工业大学 Variable-admittance teleoperation control method with fusion of multi-information
CN106842121A (en) * 2016-11-07 2017-06-13 宁波大学 Sighting distance and the robust position location method based on reaching time-difference in non line of sight hybird environment
CN106444861A (en) * 2016-11-21 2017-02-22 清华大学深圳研究生院 Space robot teleoperation system based on three-dimensional gestures

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
空间遥操作动态避障型虚拟夹具技术研究;刘正雄 等;《西北工业大学学报》;20160430;第34卷(第2期);第228-232 *

Also Published As

Publication number Publication date
CN108333924A (en) 2018-07-27

Similar Documents

Publication Publication Date Title
US9149931B2 (en) Robot system, robot control device and method for controlling robot
Fu Learning control systems and intelligent control systems: An intersection of artifical intelligence and automatic control
JP5044991B2 (en) Route creation apparatus and route creation method
CN102481691A (en) Robot system control method
JPS63216689A (en) Automatic working device
Andersen et al. Intuitive task programming of stud welding robots for ship construction
CN103429399A (en) System for commanding a robot
CN107553485B (en) Method for generating dynamic virtual clamp in human-computer interaction process
CN108333924B (en) Virtual fixture optimization generation method in operation interaction process
CN108791560B (en) Teleoperation system capable of cooperatively regulating single-leg operation and body translation of multi-legged robot and control method
CN106826814B (en) Motion control method and motion control system of robot
Tanzini et al. A novel human-machine interface for working machines operation
Jin et al. Blended shared control with subgoal adjustment
KR101263487B1 (en) Teaching device for robot
Yu et al. A haptic shared control algorithm for flexible human assistance to semi-autonomous robots
WO2013113320A1 (en) System for modifying a plc program
WO2022102578A1 (en) Numerical control apparatus and numerical control system
Dash et al. Inverse kinematics solution of a 6-DOF industrial robot
CN113021344A (en) Master-slave heterogeneous teleoperation robot working space mapping method
JP2610996B2 (en) Articulated robot controller
Korayem et al. Hardware implementation of a closed loop controller on 6R robot using ARM microcontroller
Sanchez et al. Intuitive planning, generation, and tracking of trajectory for wmr with mobile computing device and embedded system
JP2021084188A (en) Control system
Itoh et al. New predictive display method of motion and force information for network teleoperation without using virtual environment model
KR101408020B1 (en) Cooperation system between operator and control device, and method using the same cooperation system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant