CN111256732B - Target attitude error measurement method for underwater binocular vision - Google Patents

Target attitude error measurement method for underwater binocular vision Download PDF

Info

Publication number
CN111256732B
CN111256732B CN202010133113.4A CN202010133113A CN111256732B CN 111256732 B CN111256732 B CN 111256732B CN 202010133113 A CN202010133113 A CN 202010133113A CN 111256732 B CN111256732 B CN 111256732B
Authority
CN
China
Prior art keywords
coordinate system
target
axis
camera
calibration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010133113.4A
Other languages
Chinese (zh)
Other versions
CN111256732A (en
Inventor
高剑
梁晓敏
边琛益
封磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northwestern Polytechnical University
Original Assignee
Northwestern Polytechnical University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Northwestern Polytechnical University filed Critical Northwestern Polytechnical University
Priority to CN202010133113.4A priority Critical patent/CN111256732B/en
Publication of CN111256732A publication Critical patent/CN111256732A/en
Application granted granted Critical
Publication of CN111256732B publication Critical patent/CN111256732B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C25/00Manufacturing, calibrating, cleaning, or repairing instruments or devices referred to in the other groups of this subclass
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/002Measuring arrangements characterised by the use of optical techniques for measuring two or more coordinates

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Manufacturing & Machinery (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention provides a target attitude error measuring method for underwater binocular vision. And calculating a rotation matrix of the support coordinate system and the target coordinate system, wherein the Euler angle of the posture at the moment is used as a theoretical posture truth value of the target object in the camera coordinate system. In an underwater test environment, coordinates of a target object calibration object in an underwater camera coordinate system are measured by a binocular camera, a target three-dimensional coordinate vector is constructed by utilizing coordinate values, and a rotation matrix of the underwater camera coordinate system and the target coordinate system is calculated. And further calculating the change value of the Euler angles of the postures before and after the experiment to obtain the required test error. The construction and cooperative work of the world coordinate system, the support coordinate system and the target coordinate system greatly simplify the calculation process of attitude errors, the test platform is convenient to build, and the test process is very simple and convenient.

Description

Target attitude error measurement method for underwater binocular vision
Technical Field
The invention relates to the technical field of target attitude error measurement of vision, in particular to a target attitude error measurement method for underwater binocular vision, which is a method for testing a visual target attitude error by combining a three-dimensional positioning system and is suitable for measuring the three-dimensional visual attitude error of an underwater target object.
Background
The visual target posture measurement is to obtain a target information image through a visual sensor and obtain the posture information of a target through visual processing. The target attitude information has important theoretical significance and engineering value on aspects such as target motion state analysis, fault analysis and the like, and plays a significant role in the fields such as aerospace, traffic, industrial automation and the like. The target attitude error is an important problem for functions such as target motion state analysis and the like. The target attitude error range of the binocular camera vision carried by the underwater robot can be determined, and the underwater robot is a necessary condition for successfully acquiring target attitude information and executing tasks such as grabbing. In fact, the complicated underwater environment brings many difficulties to the target attitude error test of robot vision, so that the existing underwater robot cannot monitor the target attitude error of binocular vision. The traditional visual target attitude error correction can be only carried out before the task is executed, and the error measurement process is very complicated. How to obtain the target attitude error information in real time in the task process becomes an important problem to be researched.
Many researchers try to correct errors by improving a target attitude measurement method of binocular vision, but it is rare that the method can monitor target attitude errors of a binocular camera in real time during task execution and is applied to a test method of an underwater environment. The literature provides a method for rapidly realizing online measurement of clamping pose errors of a complex component based on vision, and the method comprises the steps of firstly generating a reference frame to obtain a reference coordinate system; then, carrying out point cloud coordinate system transformation and segmentation to obtain an actually measured pose model; and finally, comparing the actual measurement pose model with the reference pose model to carry out clamping pose error. The document also provides a method for detecting position and attitude errors of a single-point multi-view pendant of a mobile industrial robot, and the method is characterized in that template matching comparison is carried out on pictures shot for multiple times, so that relative errors of characteristic points are determined, and the position and attitude errors of an end effector are finally determined. The steps of the method are very complicated, the target attitude error cannot be monitored in real time, and the method is not suitable for underwater environment.
Disclosure of Invention
In order to solve the problems in the prior art, the invention provides a target attitude error measuring method for underwater binocular vision. And the calibration of a world coordinate system is completed by utilizing a three-dimensional positioning system, and the measurement of a camera coordinate system and a target object coordinate system is simplified through the construction of a support coordinate system. The construction and cooperative work of the world coordinate system, the support coordinate system and the target coordinate system greatly simplify the calculation process of attitude errors, the test platform is convenient to build, and the test process is very simple and convenient.
The construction of the world coordinate system is mainly realized by calibrating a specific calibration object through a three-dimensional positioning system. Before calibration, the working range of the three-dimensional positioning system is determined, and a proper position is selected as the origin of a world coordinate system. The positions of the four calibration objects shown in FIG. 1 are determined by taking the intersection point of two straight lines consisting of the four calibration objects as the origin of the coordinate system, and the minor axis is the world coordinate system Y e Axis, major axis being world coordinateIs X e A shaft. In order to facilitate identification and reduce calibration data errors, the calibration object selects a standard fluorescent small ball, and the diameter of the calibration object is far smaller than the working range of the three-dimensional positioning system. In the experiments carried out by the applicant, the calibration objects used were placed on square bars with a long side of 70cm and a short side of 40cm. The color of the calibration rod is black, and the calibration rod is distinguished from the calibration object, so that the process of identifying the calibration object by the three-dimensional positioning system is not interfered.
The construction of the bracket coordinate system is also realized by calibrating the calibration object by using a three-dimensional positioning system. The positions of the calibration objects are shown in three points A, B and C in figure 2, the invention constructs a bracket coordinate system by using three calibration objects, the BC direction is used as the Y axis, the BA direction is used as the X axis, and the Z axis is determined by the right-hand rule. The origin of the coordinate system of the camera is positioned at the position of the left camera of the binocular camera, namely, the position right below the origin of the coordinate system of the bracket, and the connecting line direction of the two cameras of the binocular camera is X c Axis parallel to the X-axis of the gantry coordinate system, Y c The axis is parallel to the Y axis of the support coordinate system, and the X axis of the support coordinate system is perpendicular to the Y axis.
Before image acquisition of the binocular camera is carried out, the binocular camera needs to be calibrated by using a computer and a chessboard, and the process is as follows: and calculating internal and external parameters of the camera by using MATLAB, inputting the parameter result into a vision distance measurement program of OpenCV, and finally finishing vision calibration.
In addition, a target coordinate system is also constructed, and the three-dimensional positioning system is also used for calibrating the calibration object. The positions of the calibration objects are shown as three points D, E and F in figure 2, the invention constructs a target coordinate system by using three calibration objects and taking the EF direction as Y t Axis, with ED direction as X t Axis, Z t The axis is then determined by the right hand rule.
The basic calculation idea of the invention is that the coordinate values of the world coordinate system of the calibration object for constructing the bracket coordinate system are firstly measured by the three-dimensional positioning system, and then the coordinate values of the world coordinate system of the calibration object for constructing the target coordinate system in the air are measured by the three-dimensional positioning system. And respectively constructing coordinate vectors of a three-dimensional coordinate system by using coordinate values of calibration objects of the support coordinate system and the target coordinate system, and calculating to obtain a rotation matrix of the support coordinate system and the target coordinate system, wherein the attitude Euler angle value at the moment is used as a theoretical attitude true value of the target object in the camera coordinate system. In an underwater test environment, coordinates of a camera coordinate system of a target object calibration object under water are measured by a binocular camera, a target three-dimensional coordinate vector is constructed by using the coordinates of the camera coordinate system, and a rotation matrix of the underwater camera coordinate system and the target coordinate system is calculated. And further calculating the change value of the Euler angles of the postures before and after the experiment to obtain the required test error. In the verification process of the experiment, in order to verify the reliability of the experiment result, a binocular camera can be used for testing different targets to be tested.
Experiments prove that obvious vector translation exists in the conversion process of the bracket coordinate system and the camera coordinate system. The vector data has three main aspects, namely firstly the translation distance generated by the X axis and the Y axis of the support coordinate system, and secondly the vertical distance in the Z axis direction. In the data processing process, the three constant values are converted into three-dimensional coordinate values for coordinate translation, the method only involves physical structure conversion, the coordinate calculation process is simplified, and the accuracy of the camera test error is effectively improved.
Based on the principle, the technical scheme of the invention is as follows:
the target attitude error measuring method for underwater binocular vision comprises the following steps:
step 1: arranging four calibration objects in the air above the water tank, wherein three calibration objects are fixed on one connecting rod, two calibration objects are arranged on the other connecting rod, and the two connecting rods are vertically intersected with one calibration object; the calibration object can be shot by a three-dimensional positioning system and can be clearly identified; the central point of a calibration object with two vertically intersected connecting rods is taken as the origin O of a world coordinate system e One connecting rod is used as a world coordinate system Y e Axis with another link as world coordinate system X e A shaft; according to the definition of the world coordinate system, the three direction vectors in the world coordinate system are respectively
Figure BDA0002396354250000031
Step 2: the stent coordinate system is calculated by the following procedure:
step 2.1: placing a calibrated binocular camera in the water tank, wherein the water tank is not filled with water, the optical axis of the binocular camera points to the bottom of the water tank vertically, arranging a calibration object in a space right above the origin of a camera coordinate system of the binocular camera as the origin of a support coordinate system, intersecting two mutually perpendicular connecting rods at the point, and placing a calibration object on each of the two mutually perpendicular connecting rods; measuring coordinate value A (X) of three calibration objects in world coordinate system by three-dimensional positioning system 1 ,Y 1 ,Z 1 ),B(X 2 ,Y 2 ,Z 2 ),C(X 3 ,Y 3 ,Z 3 ) The point B is the origin of the coordinate system of the bracket; determining the Z direction according to a right-hand rule by taking the BA direction as the X direction of a support coordinate system and the BC direction as the Y direction of the support coordinate system;
step 2.2: according to the formula
Figure BDA0002396354250000041
Figure BDA0002396354250000042
Figure BDA0002396354250000043
Calculating the direction vectors of the X axis, the Y axis and the Z axis of the support coordinate system, wherein
Figure BDA0002396354250000044
The vector in the direction of the X-axis is shown,
Figure BDA0002396354250000045
a vector in the direction of the Y-axis is shown,
Figure BDA0002396354250000046
represents a Z-axis direction vector; wherein
Figure BDA0002396354250000047
Figure BDA0002396354250000048
The method is characterized in that: further comprising the steps of:
and step 3: calculating a target coordinate system by:
step 3.1: placing a target object in the water tank, wherein the water tank is not filled with water, and placing a calibration object E on the target as an original point O of a target coordinate system t ', and two additional calibrators D, F are placed, with DE perpendicular to EF; measuring coordinate value D (X) of a target coordinate system calibration object in a world coordinate system through a three-dimensional positioning system 4 ,Y 4 ,Z 4 ),E(X 5 ,Y 5 ,Z 5 ),F(X 6 ,Y 6 ,Z 6 ) With ED direction as X t Direction EF is Y t Direction, determining Z according to right-hand rule t Direction;
step 3.2: according to the formula
Figure BDA0002396354250000049
Figure BDA00023963542500000410
Figure BDA00023963542500000411
Calculating a target coordinate system X t Axis, Y t Axis, Z t Direction vector of axis wherein
Figure BDA00023963542500000412
Represents X t The vector in the direction of the axis is,
Figure BDA00023963542500000413
represents Y t The vector in the direction of the axis is,
Figure BDA00023963542500000414
represents Z t An axial direction vector; wherein
Figure BDA00023963542500000415
Figure BDA0002396354250000051
And 4, step 4: according to the formula:
Figure BDA0002396354250000052
calculating a rotation matrix of the support coordinate system relative to the target coordinate system under the global coordinate system
Figure BDA0002396354250000053
Under the global coordinate system, the posture of the bracket coordinate system is the same as that of the camera coordinate system,
Figure BDA0002396354250000054
a rotation matrix of the camera coordinate system relative to the target coordinate system under the global coordinate system;
and 5: calculating a target coordinate system in the camera coordinate system by the following process:
step 5.1: placing the calibrated binocular camera into a sealed cabin, filling water into a water tank, and measuring coordinates D ', E and F of the target object through the binocular camera in an underwater environment to obtain coordinate values D ' (X ') of the calibrated objects D, E and F in a camera coordinate system 4 ',Y 4 ',Z 4 '),E'(X 5 ',Y 5 ',Z 5 '),F'(X 6 ',Y 6 ',Z 6 ');
Step 5.2: according to the formula
Figure BDA0002396354250000055
Figure BDA0002396354250000056
Figure BDA0002396354250000057
Calculating direction vectors of three axes of a target coordinate system in a camera coordinate system
Figure BDA0002396354250000058
And 6: according to the formula
Figure BDA0002396354250000059
Calculating a rotation matrix of the camera coordinate system relative to the target coordinate system under the camera coordinate system
Figure BDA00023963542500000510
And 7: according to the formula
Figure BDA00023963542500000511
Calculating a rotation matrix R of the front and back changes of the target object posture under the current experiment, wherein
Figure BDA0002396354250000061
And 8: and (4) solving an attitude error value under the current experiment according to the rotation matrix R obtained in the step (7): pitch angle r 1 Transverse roll angle r 2 Yaw angle r 3
Further, calling a matlab function dcm2angle () to solve the rotation matrix R to obtain an attitude error value under the current experiment.
Advantageous effects
The invention has the beneficial effects that: the calibration of a world coordinate system is completed by utilizing a three-dimensional positioning system, and the measurement of a camera coordinate system and a target object coordinate system is simplified through the construction of a support coordinate system. The construction and cooperative work of the world coordinate system, the bracket coordinate system and the target coordinate system greatly simplify the calculation process of attitude errors, the test platform is convenient to build, and the test process is very simple and convenient.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a schematic diagram of global coordinate system calibration;
fig. 2 is a systematic error measurement model.
Detailed Description
The following detailed description of embodiments of the invention is intended to be illustrative, and not to be construed as limiting the invention.
The invention provides a target attitude error measuring method for underwater binocular vision. And the calibration of a world coordinate system is completed by utilizing a three-dimensional positioning system, and the measurement of a camera coordinate system and a target object coordinate system is simplified through the construction of a support coordinate system. The construction and cooperative work of the world coordinate system, the support coordinate system and the target coordinate system greatly simplify the calculation process of attitude errors, the test platform is convenient to build, and the test process is very simple and convenient.
1. System components
The construction of the world coordinate system mainly calibrates a specific calibration object through a three-dimensional positioning system. Before performing calibration workFirstly, the working range of the three-dimensional positioning system is determined, and a proper position is selected as the origin of a world coordinate system. The four calibration object positions shown in FIG. 1 are defined by the intersection of two straight lines formed by the calibration objects as the origin of the coordinate system, and the minor axis is the world coordinate system Y e Axis, major axis being world coordinate system X e A shaft. In order to facilitate identification and reduce calibration data errors, the calibration object selects a standard fluorescent small ball, and the diameter of the calibration object is far smaller than the working range of the three-dimensional positioning system. In the experiments performed by the inventors, the calibration objects used were placed on square bars with a long side of 70cm and a short side of 40cm. The color of the calibration rod is black, and the calibration rod is distinguished from the calibration object, so that the process of identifying the calibration object by the three-dimensional positioning system is not interfered.
The construction of the coordinate system of the bracket requires the three-dimensional positioning system to calibrate a specific calibration object. The positions of the calibration objects are shown in three points A, B and C in figure 2, the invention constructs a bracket coordinate system by using three calibration objects, the BC direction is used as the Y axis, the BA direction is used as the X axis, and the Z axis is determined by the right-hand rule. The origin of the camera coordinate system is located at the left camera position of the binocular camera, namely right below the origin of the bracket coordinate system, and the connecting line direction of the two cameras of the binocular camera is X c Axis parallel to the X-axis of the gantry coordinate system, Y c The axis is parallel to the Y axis of the support coordinate system, and the X axis of the support coordinate system is perpendicular to the Y axis.
The construction of the target coordinate system requires the three-dimensional positioning system to calibrate a specific calibration object. The positions of the calibration objects are shown as three points D, E and F in figure 2, the invention constructs a target coordinate system by using three calibration objects and taking the EF direction as Y t Axis, with ED direction as X t Axis, Z t The axis is then determined by the right hand rule.
2. Error testing method for underwater binocular vision target posture
The basic calculation idea of the invention is that the coordinate value of the world coordinate system of the calibration object of the coordinate system of the construction bracket is measured by the three-dimensional positioning system, and then the coordinate value of the world coordinate system of the calibration object of the target coordinate system in the air is measured by the three-dimensional positioning system. Respectively constructing coordinate vectors of a three-dimensional coordinate system by using coordinate values of calibration objects of a support coordinate system and a target coordinate system, and calculating to obtain a rotation matrix of the support coordinate system relative to the target coordinate system under a global coordinate system; since the postures of the support coordinate system and the camera coordinate system are the same in the global coordinate system, the posture is also a rotation matrix of the camera coordinate system relative to the target coordinate system, and the posture euler angle value reflected by the rotation matrix at the moment is used as a theoretical posture true value of the target object in the camera coordinate system.
In an underwater test environment, coordinates of a camera coordinate system of a target object calibration object under water are measured by a binocular camera, and a rotation matrix of the camera coordinate system relative to the target coordinate system under the camera coordinate system is calculated by utilizing three-dimensional coordinates of the target object calibration object under the camera coordinate system. And further calculating the change value of the Euler angles of the postures before and after the experiment to obtain the required test error. In the verification process of the experiment, in order to verify the reliability of the experiment result, a binocular camera can be used for testing different targets to be tested.
3. Vector translation analysis and processing method
Experiments prove that obvious vector translation exists in the conversion process of the bracket coordinate system and the camera coordinate system. The vector data has three main aspects, namely firstly the translation distance generated by the X axis and the Y axis of the support coordinate system, and secondly the vertical distance in the Z axis direction. In the data processing process, the three constant values are converted into three-dimensional coordinate values for coordinate translation, the method only involves physical structure conversion, the coordinate calculation process is simplified, and the accuracy of the camera test error is effectively improved.
Based on the technical scheme, the following specific embodiments are provided:
step 1: arranging four calibration objects in the air above the water tank, wherein three calibration objects are fixed on one connecting rod, two calibration objects are arranged on the other connecting rod, and the two connecting rods are vertically intersected with one calibration object; the calibration object can be shot by a three-dimensional positioning system and can be clearly identified; the central point of a calibration object with two vertically intersected connecting rods is taken as the origin O of a world coordinate system e One connecting rod is used as a world coordinate system Y e Axis with another link as world coordinate system X e A shaft; root of herbaceous plantAccording to the definition of the world coordinate system, the three direction vectors in the world coordinate system are respectively
Figure BDA0002396354250000081
Step 2: the stent coordinate system is calculated by the following procedure:
step 2.1: placing a calibrated binocular camera in the water tank, wherein water is not filled in the water tank, the optical axis of the binocular camera vertically points to the bottom of the water tank, arranging a calibration object in a space right above the origin of a camera coordinate system of the binocular camera as the origin of a bracket coordinate system, intersecting two mutually perpendicular connecting rods at the origin, and respectively placing another calibration object on the two mutually perpendicular connecting rods; measuring coordinate value A (X) of three calibration objects in world coordinate system by three-dimensional positioning system 1 ,Y 1 ,Z 1 ),B(X 2 ,Y 2 ,Z 2 ),C(X 3 ,Y 3 ,Z 3 ) The point B is the origin of the coordinate system of the bracket; determining the Z direction according to a right-hand rule by taking the BA direction as the X direction of a support coordinate system and the BC direction as the Y direction of the support coordinate system;
in this example
A(X 1 ,Y 1 ,Z 1 )=(513.62;367.5;1121.92)
B(X 2 ,Y 2 ,Z 2 )=(510.09;321.31;1121.97)
C(X 3 ,Y 3 ,Z 3 )=(407.41;325.47;1131.31)
Step 2.2: according to the formula
Figure BDA0002396354250000091
Figure BDA0002396354250000092
Figure BDA0002396354250000093
Calculating the direction vectors of the X axis, the Y axis and the Z axis of the bracket coordinate system, wherein
Figure BDA0002396354250000094
The X-axis direction vector is represented,
Figure BDA0002396354250000095
a vector in the direction of the Y-axis is shown,
Figure BDA0002396354250000096
represents a Z-axis direction vector; wherein
Figure BDA0002396354250000097
Figure BDA0002396354250000098
In this embodiment
Figure BDA0002396354250000099
Figure BDA00023963542500000910
Figure BDA00023963542500000911
And step 3: calculating a target coordinate system by:
step 3.1: placing a target object in the water tank, wherein the water tank is not filled with water, and placing a calibration object E on the target as an original point O of a target coordinate system t ', and an additional two calibrators D, F are placed, with DE perpendicular to EF; measuring coordinate value D (X) of a target coordinate system calibration object in a world coordinate system through a three-dimensional positioning system 4 ,Y 4 ,Z 4 ),E(X 5 ,Y 5 ,Z 5 ),F(X 6 ,Y 6 ,Z 6 ) With ED direction as X t Direction EF is Y t Direction, determining Z according to right-hand rule t Direction;
in this example
D(X 4 ,Y 4 ,Z 4 )=(508.59;280.61;100.59)
E(X 5 ,Y 5 ,Z 5 )=(427.36;285.55;102.25)
F(X 6 ,Y 6 ,Z 6 )=(433.54;325.43;101.91)
Step 3.2: according to the formula
Figure BDA0002396354250000101
Figure BDA0002396354250000102
Figure BDA0002396354250000103
Calculating a target coordinate system X t Axis, Y t Axis, Z t Direction vector of axis wherein
Figure BDA0002396354250000104
Represents X t The vector in the direction of the axis is,
Figure BDA0002396354250000105
represents Y t The vector in the direction of the axis is,
Figure BDA0002396354250000106
represents Z t An axial direction vector; wherein
Figure BDA0002396354250000107
Figure BDA0002396354250000108
In this example
Figure BDA0002396354250000109
Figure BDA00023963542500001010
Figure BDA00023963542500001011
And 4, step 4: according to the formula:
Figure BDA00023963542500001012
calculating a rotation matrix of the support coordinate system relative to the target coordinate system under the global coordinate system
Figure BDA00023963542500001013
Under the global coordinate system, the posture of the bracket coordinate system is the same as that of the camera coordinate system,
Figure BDA00023963542500001014
a rotation matrix of the camera coordinate system relative to the target coordinate system under the global coordinate system;
in this example
Figure BDA00023963542500001015
And 5: calculating a target coordinate system under the camera coordinate system by:
step 5.1: placing the calibrated binocular cameraPutting the object into a sealed cabin, filling water into a water tank, measuring coordinates of the objects D, E and F of the object by a binocular camera in an underwater environment to obtain coordinate values D ' (X ') of the objects D, E and F in a camera coordinate system ' 4 ,Y' 4 ,Z' 4 ),E'(X' 5 ,Y' 5 ,Z' 5 ),F'(X' 6 ,Y' 6 ,Z' 6 );
In this example
D'(X' 4 ,Y' 4 ,Z' 4 )=(25.6885;93.5684;790.3663)
E'(X' 5 ,Y' 5 ,Z' 5 )=(5.4326;94.8149;790.8728)
F'(X' 6 ,Y' 6 ,Z' 6 )=(26.8997;100.3245;791.2354)
Step 5.2: according to the formula
Figure BDA0002396354250000111
Figure BDA0002396354250000112
Figure BDA0002396354250000113
Calculating direction vectors of three axes of a target coordinate system in a camera coordinate system
Figure BDA0002396354250000114
In this example
Figure BDA0002396354250000115
Figure BDA0002396354250000116
Figure BDA0002396354250000117
Step 6: according to the formula
Figure BDA0002396354250000118
Calculating a rotation matrix of the camera coordinate system relative to the target coordinate system under the camera coordinate system
Figure BDA0002396354250000119
In this example
Figure BDA00023963542500001110
And 7: according to the formula
Figure BDA0002396354250000121
Calculating a rotation matrix R of the front and back changes of the target object posture under the current experiment;
in this example
Figure BDA0002396354250000122
And 8: and (4) solving an attitude error value under the current experiment according to the rotation matrix R obtained in the step (7): pitch angle r 1 Transverse roll angle r 2 Yaw angle r 3 . Pitch angle r in the embodiment 1 = -2.2665, roll angle r 2 = -0.2067 yaw angle r 3 =1.6419。
Although embodiments of the present invention have been shown and described above, it will be understood that the above embodiments are exemplary and not to be construed as limiting the present invention, and that those skilled in the art may make variations, modifications, substitutions and alterations within the scope of the present invention without departing from the spirit and scope of the present invention.

Claims (2)

1. A target attitude error measurement method for underwater binocular vision comprises the following steps:
step 1: arranging four calibration objects in the air above the water tank, wherein three calibration objects are fixed on one connecting rod, two calibration objects are arranged on the other connecting rod, and the two connecting rods are vertically intersected with one calibration object; the calibration object can be shot by a three-dimensional positioning system and can be clearly identified; the central point of a calibration object with two vertically intersected connecting rods is taken as the origin O of a world coordinate system e One connecting rod is used as a world coordinate system Y e Axis with another link as world coordinate system X e A shaft;
step 2: the stent coordinate system is calculated by the following procedure:
step 2.1: placing a calibrated binocular camera in the water tank, wherein water is not filled in the water tank, the optical axis of the binocular camera vertically points to the bottom of the water tank, arranging a calibration object in a space right above the origin of a camera coordinate system of the binocular camera as the origin of a bracket coordinate system, intersecting two mutually perpendicular connecting rods at the origin, and respectively placing another calibration object on the two mutually perpendicular connecting rods; measuring coordinate value A (X) of three calibration objects in world coordinate system by three-dimensional positioning system 1 ,Y 1 ,Z 1 ),B(X 2 ,Y 2 ,Z 2 ),C(X 3 ,Y 3 ,Z 3 ) The point B is the origin of the bracket coordinate system; determining the Z direction according to a right-hand rule by taking the BA direction as the X direction of a support coordinate system and the BC direction as the Y direction of the support coordinate system;
step 2.2: according to the formula
Figure FDA0002396354240000011
Figure FDA0002396354240000012
Figure FDA0002396354240000013
Calculating the direction vectors of the X axis, the Y axis and the Z axis of the bracket coordinate system, wherein
Figure FDA0002396354240000014
The X-axis direction vector is represented,
Figure FDA0002396354240000015
a vector in the direction of the Y-axis is shown,
Figure FDA0002396354240000016
represents a Z-axis direction vector; wherein
Figure FDA0002396354240000017
Figure FDA0002396354240000018
The method is characterized in that: further comprising the steps of:
and step 3: calculating a target coordinate system by:
step 3.1: placing a target object in the water tank, wherein the water tank is not filled with water, and placing a calibration object E on the target as an original point O of a target coordinate system t ', and an additional two calibrators D, F are placed, with DE perpendicular to EF; measuring coordinate value D (X) of a target coordinate system calibration object in a world coordinate system through a three-dimensional positioning system 4 ,Y 4 ,Z 4 ),E(X 5 ,Y 5 ,Z 5 ),F(X 6 ,Y 6 ,Z 6 ) With ED direction as X t Direction EF is Y t Direction according to the rightManual determination of Z t Direction;
step 3.2: according to the formula
Figure FDA0002396354240000021
Figure FDA0002396354240000022
Figure FDA0002396354240000023
Calculating a target coordinate system X t Axis, Y t Axis, Z t Direction vector of axis wherein
Figure FDA0002396354240000024
Represents X t The vector in the direction of the axis is,
Figure FDA0002396354240000025
represents Y t The vector in the direction of the axis is,
Figure FDA0002396354240000026
represents Z t An axial direction vector; wherein
Figure FDA0002396354240000027
Figure FDA0002396354240000028
And 4, step 4: according to the formula:
Figure FDA0002396354240000029
calculating a rotation matrix of the stent coordinate system relative to the target coordinate system in the global coordinate system
Figure FDA00023963542400000210
Under the global coordinate system, the posture of the bracket coordinate system is the same as that of the camera coordinate system,
Figure FDA00023963542400000211
a rotation matrix of the camera coordinate system relative to the target coordinate system under the global coordinate system;
and 5: calculating a target coordinate system under the camera coordinate system by:
step 5.1: placing the calibrated binocular camera into a sealed cabin, filling water into a water tank, and measuring coordinates of the calibration objects D, E and F of the target object through the binocular camera in an underwater environment to obtain coordinate values D ' (X ') of the calibration objects D, E and F in a camera coordinate system ' 4 ,Y′ 4 ,Z′ 4 ),E'(X′ 5 ,Y′ 5 ,Z′ 5 ),F'(X′ 6 ,Y′ 6 ,Z′ 6 );
Step 5.2: according to the formula
Figure FDA0002396354240000031
Figure FDA0002396354240000032
Figure FDA0002396354240000033
Calculating direction vectors of three axes of a target coordinate system in a camera coordinate system
Figure FDA0002396354240000034
Step 6: according to the formula
Figure FDA0002396354240000035
Calculating a rotation matrix of the camera coordinate system relative to the target coordinate system under the camera coordinate system
Figure FDA0002396354240000036
And 7: according to the formula
Figure FDA0002396354240000037
Calculating a rotation matrix R of the front and back changes of the target object posture under the current experiment, wherein
Figure FDA0002396354240000038
And 8: and (4) solving an attitude error value under the current experiment according to the rotation matrix R obtained in the step (7): pitch angle r 1 Transverse roll angle r 2 Yaw angle r 3
2. The method for measuring the target attitude error for underwater binocular vision according to claim 1, wherein: and 8, calling a matlab function dcm2angle () to solve the rotation matrix R to obtain an attitude error value under the current experiment.
CN202010133113.4A 2020-03-01 2020-03-01 Target attitude error measurement method for underwater binocular vision Active CN111256732B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010133113.4A CN111256732B (en) 2020-03-01 2020-03-01 Target attitude error measurement method for underwater binocular vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010133113.4A CN111256732B (en) 2020-03-01 2020-03-01 Target attitude error measurement method for underwater binocular vision

Publications (2)

Publication Number Publication Date
CN111256732A CN111256732A (en) 2020-06-09
CN111256732B true CN111256732B (en) 2023-03-14

Family

ID=70953054

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010133113.4A Active CN111256732B (en) 2020-03-01 2020-03-01 Target attitude error measurement method for underwater binocular vision

Country Status (1)

Country Link
CN (1) CN111256732B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110530266B (en) * 2018-05-25 2021-06-25 镱钛科技股份有限公司 Dynamic reference offset detection method and system thereof
CN112815848B (en) * 2021-02-02 2022-06-03 中国人民解放军陆军装甲兵学院 Binocular camera and mechanical arm coordinate system registration method
CN113654509B (en) * 2021-07-28 2022-09-09 北京交通大学 Detection layout control method and device for measuring wheel-rail contact attitude, and medium
CN113790710B (en) * 2021-09-10 2022-10-25 同济大学 Three-dimensional positioning verification method and device for high-speed video underwater structure
CN115060238B (en) * 2022-05-18 2023-11-10 深圳荔石创新科技有限公司 Method and device for measuring relative pose of underwater component
CN115797460B (en) * 2022-10-10 2023-07-21 哈尔滨工程大学 Underwater double-target setting method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1847789A (en) * 2005-04-06 2006-10-18 佳能株式会社 Method and apparatus for measuring position and orientation
CN102589571A (en) * 2012-01-18 2012-07-18 西安交通大学 Spatial three-dimensional vision-computing verification method
CN107883870A (en) * 2017-10-24 2018-04-06 四川雷得兴业信息科技有限公司 Overall calibration method based on binocular vision system and laser tracker measuring system
CN109754428A (en) * 2018-11-26 2019-05-14 西北工业大学 A kind of measurement method for underwater binocular visual positioning error

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013059989A1 (en) * 2011-10-25 2013-05-02 国防科学技术大学 Motion alignment method of inertial navigation system
CN107697248B (en) * 2017-09-26 2019-05-14 哈尔滨航士科技发展有限公司 A kind of error and parameter correction method of deep ocean work humanoid robot propeller

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1847789A (en) * 2005-04-06 2006-10-18 佳能株式会社 Method and apparatus for measuring position and orientation
CN102589571A (en) * 2012-01-18 2012-07-18 西安交通大学 Spatial three-dimensional vision-computing verification method
CN107883870A (en) * 2017-10-24 2018-04-06 四川雷得兴业信息科技有限公司 Overall calibration method based on binocular vision system and laser tracker measuring system
CN109754428A (en) * 2018-11-26 2019-05-14 西北工业大学 A kind of measurement method for underwater binocular visual positioning error

Also Published As

Publication number Publication date
CN111256732A (en) 2020-06-09

Similar Documents

Publication Publication Date Title
CN111256732B (en) Target attitude error measurement method for underwater binocular vision
CN109754428B (en) Method for measuring underwater binocular vision positioning error
JP4021413B2 (en) Measuring device
JP5365218B2 (en) Robot vision system and automatic calibration method
JP4191080B2 (en) Measuring device
CN113021358B (en) Method and device for calibrating origin of coordinate system of mechanical arm tool and electronic equipment
CN113246135A (en) Robot hand-eye calibration method and device, electronic equipment and storage medium
CN112361958B (en) Line laser and mechanical arm calibration method
CN111179351B (en) Parameter calibration method and device and processing equipment thereof
CN115284292A (en) Mechanical arm hand-eye calibration method and device based on laser camera
CN109443273A (en) Pinpoint method is carried out to workpiece for measurement using three-dimension measuring system
CN109342008B (en) Wind tunnel test model attack angle single-camera video measuring method based on homography matrix
CN113799130B (en) Robot pose calibration method in man-machine cooperation assembly
CN109773589B (en) Method, device and equipment for online measurement and machining guidance of workpiece surface
Li et al. A calibration algorithm of the structured light vision for the arc welding robot
CN106959704B (en) Control method and system of three-dimensional topography measuring instrument
CN108257184B (en) Camera attitude measurement method based on square lattice cooperative target
Yu et al. Determination of optimal measurement configurations for self-calibrating a robotic visual inspection system with multiple point constraints
CN107421476A (en) A kind of spatial hole position Measuring datum error compensation method
CN113405532B (en) Forward intersection measuring method and system based on structural parameters of vision system
CN114516051B (en) Front intersection method and system for three or more degrees of freedom robot vision measurement
Huang et al. Robotic hand-eye calibration based on active vision
CN115619877A (en) Method for calibrating position relation between monocular laser sensor and two-axis machine tool system
CN111699445A (en) Robot kinematics model optimization method and system and storage device
CN113733078B (en) Method for interpreting fine control quantity of mechanical arm and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant