CN1203292C - Method and system for measruing object two-dimensiond surface outline - Google Patents

Method and system for measruing object two-dimensiond surface outline Download PDF

Info

Publication number
CN1203292C
CN1203292C CNB031535046A CN03153504A CN1203292C CN 1203292 C CN1203292 C CN 1203292C CN B031535046 A CNB031535046 A CN B031535046A CN 03153504 A CN03153504 A CN 03153504A CN 1203292 C CN1203292 C CN 1203292C
Authority
CN
China
Prior art keywords
point
phase
image
coordinate
width
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB031535046A
Other languages
Chinese (zh)
Other versions
CN1483999A (en
Inventor
钟约先
李仁举
张吴明
马扬飚
袁朝龙
叶成蔚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Tenyoun 3d Technology Co Ltd
Tsinghua University
Original Assignee
Beijing Tenyoun 3d Technology Co Ltd
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Tenyoun 3d Technology Co Ltd, Tsinghua University filed Critical Beijing Tenyoun 3d Technology Co Ltd
Priority to CNB031535046A priority Critical patent/CN1203292C/en
Publication of CN1483999A publication Critical patent/CN1483999A/en
Application granted granted Critical
Publication of CN1203292C publication Critical patent/CN1203292C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Image Processing (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The present invention relates to a method and a system for measuring the outline of the three-dimensional surface of an object, which belongs to the technical field of the three-dimensional measurement of the object. The present invention is characterized in that the present invention uses the combination of a phase and stereo vision technique for projecting a grating on the object surface, grating images occurring aberrance are shot by using two cameras, and each point of phase on the images shot by a left camera and a right camera is obtained by using encoding light and a phase-shifting method. The phase and an outer polar line are used for realizing point matching on two images so that a calibrated camera system can be used for calculating the coordinate of the point in three-dimensional space to measure the three-dimensional outline of the object surface. The present invention has the advantages of non-contact, high speed, large data quantity, high precision, simple operation, easy realization, etc. Only 2 seconds are needed to measure the single surface of the object, high-density data can be obtained and reaches 400, 000 points, and measured precision is more than 0.05mm.

Description

The method of Measuring Object three-dimensional surface profile
Technical field
The method of Measuring Object surface tri-dimensional profile belongs to three-dimensional measurement of objects method and technology field.
Background technology
The three-dimensional measurement technology of object is very universal in fields such as product design and manufacturing, quality testing and control, robot vision.It used product image, rapid manufacture system, the anti-fields such as design, online detection, clothing making, video display stunt, virtual reality, artistic sculpture of asking of product of also being extended in the last few years.
It is contact and contactless that measuring three-dimensional profile mainly contains two class methods.The main method of contact type measurement is a three-coordinates measuring machine, and its measuring accuracy height can reach 0.5 μ m.But this method is not suitable for soft in kind measurement, and measuring speed is slow, working environment is required very high, must be shockproof, anti-gray, constant temperature etc., so range of application is subjected to bigger restriction.As a whole, the demand that the mechanical type three-coordinates measuring machine is difficult to satisfy now fast, high-level efficiency is measured.
Non-contacting method for three-dimensional measurement has: optical sensor method, laser scanning method, stereo vision method, projection gate phase method etc.
1. optical sensor method
The principle of work of this method is similar to the mechanical type three-coordinates measuring machine, only adopts special optic probe to come the inspected object surface configuration.Its optic probe can directly obtain the distance between measured point and the probe, obtains coordinate on other both direction by its working position.Japan Toshiba company has developed one and has been used for the non-contact optical detection instrument that the large-scale high-precision optical surface is measured, and the surface shape measurement precision reaches 0.1 μ m, and roughness is to 1nmRa, is installed on the worktable of super smart CNC lathe to use.Its gordian technique is the manufacturing of optic probe, belongs to precision instrument and equipment, therefore involves great expense.
2. laser scanning method
This method is utilized the laser scanning body surface, determines the three-dimensional coordinate of object each point by the geometry imaging relations between eye point, subpoint and the imaging point three.Characteristics and character according to the work LASER Light Source can be divided into point type laser scanning, linear laser scanning etc.The speed of laser scanning is than piece, but scanning accuracy but is subjected to the influence of factors such as the material of workpiece and character of surface.In addition, the price of laser scanning system is very expensive, and non-general user can bear.
3. stereo vision method
Stereo vision method is to set up according to the bionics principle of people's binocular vision system, and this method can reach certain measuring accuracy.It utilizes the parallax of corresponding point can calculate steric information within the vision according to principle of triangulation, is used for binocular and used for multi-vision visual.
This method requires looser to the application scenario, once can obtain the three-dimensional information in a zone, particularly has the advantage that not influenced by the body surface reflection characteristic.But being difficult to resolve, the matching problem of corresponding point wherein determines, the algorithm complexity is consuming time longer.When the body surface unique point is more sparse, also be difficult to obtain accurate shape.
4. projection gate phase method
Projection gate adopts at body surface projection grid line, utilizes the phase distortion information of modulating grid line to obtain the three-dimensional information of object, and its adopts the method demodulation phase of mathematics, and utilizes phase value to calculate each height value with respect to reference surface.The very big problem that the projection gate phase method exists is that its system operation is bad, is difficult to realize practicability.
Summary of the invention
The purpose of this method is to provide a kind of method of measuring accurately, being convenient to operate and be easy to the Measuring Object three-dimensional surface profile of practicability, to utilize the combination of phase place and stereovision technique for the proposition that reaches this purpose initiative of the present invention, at body surface projection grating, adopt twin camera to take image, utilize phase place and polar curve to realize coupling, thereby reach the counter of object dimensional coordinate asked and reconstruct, developed that operability is good, measuring accuracy is higher, speed is fast, be suitable for the novel three-dimensional noncontacting measurement system of different big wisps.
Light (being called structured light) with certain specific character projects on the object, and the point of differing heights is modulated grating grating is distorted on the object.Take the raster image that distortion takes place with two video cameras, utilize encoded light and phase shifting method to obtain left and right cameras and take the phase place that image is gone up every bit.Utilize phase place and outer polar curve to realize the coupling of the point on two width of cloth images for how much.To the camera chain of having calibrated, just can calculate it at three-dimensional coordinate.
The method of the Measuring Object three-dimensional surface profile that the present invention proposes, it is characterized in that it is a kind of combination that utilizes phase place and stereovision technique, at body surface projection grating, adopt twin camera to take the raster image that distortion takes place again, utilize encoded light and phase shifting method to obtain the phase place of every bit on the left and right cameras photographic images.Utilize phase place and outer polar curve to realize the coupling of the point on two width of cloth images, thereby reach the anti-method of asking body surface point three-dimensional coordinate; It comprises the steps:
(1) utilizes computing machine to generate virtual grating,, utilize projector that the grating that generates is incident upon on the object comprising encode grating and phase-shifted grating;
The light intensity of phase-shifted grating is as shown in the formula expressing:
I i(u,v)=a(u,v)+b(u,v)cos(φ(u,v)+φ i)
Wherein:
(u v) is the coordinate of certain point;
I i(u v) is (u, a light intensity v) in the i width of cloth image;
(u v) is the bias light majorant to a;
(u v) is a fringe contrast to b;
(u v) represents the phase place of each point to φ, and the cycle is T; φ iBe angle of phase displacement;
Encode grating has the N width of cloth, and building method is that first width of cloth is partly to deceive partly in vain, and each width of cloth of back segments gradually, and divided method is the black part of a last width of cloth, is divided into partly deceiving partly in vain, and the white of a last width of cloth is divided into partly and partly deceives in vain.To each point, according to then being encoded to 1 still for encoding in vain for deceiving for black on each width of cloth image in each width of cloth image, for then being encoded to 0 in vain, thereby obtain the coded sequence of this point; N width of cloth encode grating can have 2 NIndividual coded sequence, whole image is divided into 2 NIndividual rectangular, each rectangular width is the period T of phase-shifted grating; To n rectangular (n=1,2 ... 2 N, claim periodicity again), according to the corresponding unique encoding sequence of such encoded light building method, its decimal-coded digit is nc, sets up the mapping relations between periodicity n and the coded number nc, can realize both mutual conversions;
(2) utilize the raster image of two ccd video camera collection projections, and be kept in the array of distributing in the program;
(3) each width of cloth image that each camera is taken is handled respectively, obtain the phase value of each point, phase value adds that by the phase main value periodicity multiply by 2 π, be 2n π, because the phase value of each point that two video cameras are taken should equate, take each some phase value of obtaining as the foundation of mating with two video cameras;
(4) two video cameras are calibrated, obtained the intrinsic parameter of video camera and with respect to the outer parameter of world coordinate system: f (j), R (j), T (j), j=1,2
f (j): lens focus length, j is a camera number;
R (j): rotation matrix, R = r 1 r 2 r 3 r 4 r 5 r 6 r 7 r 8 r 9 ;
T (j): translation vector, T=[TxTyTz] ';
Calculate R, Tx, Ty earlier;
(4.1) calculate the image coordinate of each point
u=u 0+x/dx
v=v 0+y/dy
To the point in space (Xw, Yw, Zw), after video camera is taken, image coordinate (mm) be (x, y), pixel coordinates be (u, v), (u 0, v 0) be the pixel coordinate of initial point in pixel coordinate system of image coordinate system, (dx is the x between the CCD adjacent image point and the distance of y direction dy), is provided by CCD producer.
(4.2) calculate five unknown quantity Ty -1r 1, Ty -1r 2, Ty -1Tx, Ty -1r 4, Ty -1r 5
For each three dimensional object point (Xw k, Yw k, Zw k) (because the some coplane, so the Z coordinate is got work 0) and corresponding image coordinate (x k, y k), by collinearity equation:
x k = f r 1 X w k + r 2 Y w k + Tx r 7 X w k + r 8 Y w k + Tz
y k = f r 4 X w k + r 5 Y w k + Ty r 7 X w k + r 8 Y w k + Tz
Top two formulas are divided by obtain: utilize least square method to try to achieve above-mentioned 5 unknown quantitys; (4.3) calculate r 1..., r 9, Tx, Ty
(4.31) calculate | Ty|
The definition matrix:
C = r 1 ′ r 2 ′ r 4 ′ r 5 ′ = r 1 / Ty r 2 / Ty r 4 / Ty r 5 / Ty
Then have:
y 2 = S r - [ S r 2 - 4 ( r 1 ′ r 5 ′ - r 4 ′ r 2 ′ ) 2 ] 1 / 2 2 ( r 1 ′ r 5 ′ - r 4 ′ r 2 ′ ) 2
Wherein:
Sr=r 12+r 22+r 52+r 42
If certain row of Matrix C or certain column element are calculated as follows for being 0 entirely:
Ty 2=(r i' 2+ r j' 2) -1, r wherein i', r j', be remaining two elements in addition of Matrix C.
(4.32) symbol of decision Ty
1. suppose that Ty is a positive sign;
2. select in the captured image, from picture centre far away a bit.If its image coordinate is (x k, y k), the coordinate in three-dimensional world is (Xw k, Yw k, Zw k).
3. calculate following various value by top result:
r 1=(Ty -1r 1)*Ty,r 2=(Ty -1r 2)*Ty,r 4=(Ty -1r 4)*Ty
r 5=(Ty -1r 5)*Ty,Tx=(Ty -1Tx)*Ty,
x k′=r 1Xw k+r 2Yw k+Tx
y k′=r 4Xw k+r 5Yw k+Ty
If x kAnd x k', y kAnd y k' jack per line all, sgn (Ty)=+ 1 so, otherwise sgn (Ty)=-1;
(4.33) calculate rotation matrix R
Value according to Ty recomputates r 1, r 2, r 4, r 5, Tx.
R = r 1 r 2 ( 1 - r 1 2 - r 2 2 ) 1 / 2 r 4 r 5 s ( 1 - r 4 2 - r 5 2 ) 1 / 2 r 7 r 8 r 9
S=sgn (r wherein 1r 4+ r 2r 5)
r 7, r 8, r 9Be to obtain by preceding two appositions of going.
If calculating following focal distance f according to such R is negative value, then:
R = r 1 r 2 - ( 1 - r 1 2 - r 2 2 ) 1 / 2 r 4 r 5 - s ( 1 - r 4 2 - r 5 2 ) 1 / 2 - r 7 - r 8 r 9
Then calculate focal length f and T zValue
To each calibration point, foundation comprises f and T zLinear equation as unknown parameter:
[ Y i - y i ] f Tz = w i y i
Wherein:
Y i=r 4x wi+r 5y wi+r 6*0+Ty
w i=r 7x wi+r 8y wi+r 9*0
By solving an equation, can ask f and T z
(5) carry out three-dimensionalreconstruction according to phase place and outer polar curve geometry to every, obtain the three-dimensional coordinate of body surface point:
(5.1) calculate basis matrix F
F=A 2 -TEA 1 -1
Wherein
A 2 = f 2 / d x 2 0 u 02 0 f 2 / d y 2 v 02 0 0 1 , A 1 = f 1 / d x 1 0 u 01 0 f 1 / d y 1 v 01 0 0 1
F wherein 1, (u 01, v 01), dx 1, dy 1Be the intrinsic parameter of first video camera,
f 2, (u 02, v 02), dx 2, dy 2It is the intrinsic parameter of second video camera;
E = [ T ] x R ( 2 ) R ( 1 ) - 1 (being called essential matrix, Essential Matrix)
T = T ( 2 ) - R ( 2 ) R ( 1 ) - 1 T ( 1 )
T is expressed as [Tx, Ty, Tz], then antisymmetric matrix is [T] x
[ T ] x = 0 - Tz Ty Tz 0 - Tx - Ty Tx 0
(5.2) calculate 1 P on the right video camera photographic images, its coordinate is
Figure C0315350400122
Its polar curve equation parameter on left video camera photographic images.And on above-mentioned straight line, seek its match point Q point, method is that the phase value of a P and some Q equates.
Known
Figure C0315350400123
According to following straight-line equation, look for the some Q of some P on left video camera photographic images on the right video camera photographic images, its coordinate is
m ~ 2 T F m ~ 1 = 0 ,
Wherein:
Figure C0315350400126
Be the pixel coordinate (u that P is ordered 2, v 2, 1) T
Figure C0315350400127
Be Q point pixel coordinate (u 1, v 1, 1) T
According to a P and the equal principle of some Q phase place, on straight line, seek the Q point by above-mentioned straight-line equation decision.
(5.3) find the Q point, then store this match point, according to following three dimensions point S (Xw, Yw, Zw) and the pass of the correspondence image coordinate of two video camera photographic images be:
x ( j ) = f ( j ) R ( j ) 11 Xw + R ( j ) 12 Yw + R ( j ) 13 Zw + T ( j ) x R ( j ) 31 Xw + R ( j ) 32 Yw + R ( j ) 33 Zw + T ( j ) z ,
y ( j ) = f ( j ) R ( j ) 21 Xw + R ( j ) 22 Yw + R ( j ) 23 Zw + T ( j ) y R ( j ) 31 Xw + R ( j ) 32 Yw + R ( j ) 33 Zw + T ( j ) z ,
J=1,2, be the numbering of video camera.
The angle of phase displacement φ of described phase-shifted grating i=i*90, i=1 ... 4, promptly the phase-shifted grating image has 4 width of cloth, and its phase main value computing formula is:
φ ( u , v ) = a tan ( I 2 - I 4 I 3 - I 1 ) , I wherein 1, I 2, I 3, I 4, be point (u, the v) phase place in four width of cloth phase-shifted gratings.
Described encode grating has 7 width of cloth, and the binary code sequence of every bit can change into this position in image, i.e. periodicity.
The system of the Measuring Object three-dimensional surface profile that the present invention proposes is characterized in that it contains computing machine, projector, two ccd video cameras.
Experimental results show that the present invention has noncontact, speed is fast, data volume is big, precision is high, simple to operate, be easy to advantages such as realization.
Description of drawings
Fig. 1: the synoptic diagram of system of the present invention.
Fig. 2: the calibrating block that camera calibration is used.
Fig. 3: two-phase method camera calibration program flow diagram.
Fig. 4: three-dimensionalreconstruction algorithm flow chart.
Fig. 5: staff measurement result synoptic diagram.
Embodiment
The embodiment of the method for a kind of three-dimensional measurement that the present invention proposes is in conjunction with being described as follows:
The measuring system of present embodiment as shown in Figure 1.Native system is by ccd video camera 1,3, projector 2, computing machine 4 compositions such as grade.
Computing machine has 1394 image cards for PIII 1G, and video card is supported dual screen output.
The ASKC20+ HD digital projector that system adopts, its brightness is the 1500ANSI lumen, resolution is 800 * 600.
CCD adopts the A302f digital camera of German Basler company, and its resolution has reached 780 * 582, meets the IEEE1394 industrial standard, cooperates Computar M1214-MP tight shot to use.
The step that method is taked is as follows, and wherein the realization of software adopts Visual C++6.0 platform to develop:
1) utilizes computing machine to generate virtual grating,, utilize projector that the grating that generates is incident upon on the object comprising encode grating and phase-shifted grating;
The light intensity of phase-shifted grating is as shown in the formula expressing:
I i(u,v)=a(u,v)+b(u,v)cos(φ(u,v)+φ i) (1)
Wherein:
(u v) is the coordinate of certain point;
I i(u v) is (u, a light intensity v) in the i width of cloth image;
(u v) is the bias light majorant to a;
(u v) is a fringe contrast to b;
(u v) represents the phase place of each point to φ, and the cycle is T;
For the phase shift of every interval 90 degree, φ i=i*90, i=1 ... 4,
During phase-shifted grating, the rastered picture size is 1024 * 768 at structure, and the cycle size of grating is 8 promptly the integers of coordinate x span between (1,1024), the integer of y value between (1,768).(x y) gets 0 to a, and (x y) gets 255 to b.Each some phase value φ (x, y) be set to x divided by 8 remainders that obtain divided by 8, multiply by 2 π again.
Encode grating has 7 width of cloth, and building method is that first width of cloth is partly to deceive partly in vain, and each width of cloth of back segments gradually, and divided method is the black part of a last width of cloth, is divided into partly deceiving partly in vain, and the white of a last width of cloth is divided into partly and partly deceives in vain.To each point, according to then being encoded to 1 still for encoding in vain for deceiving for black on each width of cloth image in each width of cloth image, for then being encoded to 0 in vain, thereby obtain the coded sequence of this point; 7 width of cloth encode gratings can have 2 7Individual coded sequence, whole image is divided into 2 7Individual rectangular, each rectangular width is the cycle 8 of phase-shifted grating; To n rectangular (n=1,2 ... 2 7), according to the corresponding unique encoding sequence of such encoded light building method, its decimal-coded digit is nc, sets up mapping relations between each periodicity n and the coded number nc according to such method, can realize both mutual conversions;
2) utilize the rastered picture of two ccd video camera collection projections, and be kept in the array of distributing in the program.
3) 11 images that each camera is taken are handled respectively, obtain the phase value of each point, and phase value adds that by the phase main value periodicity multiply by 2 π.
Phase main value computing formula is in the phase-shift method:
φ ( u , v ) = a tan ( I 2 - I 4 I 3 - I 1 ) - - - ( 2 )
I wherein 1, I 2, I 3, I 4, be point (u, the v) light intensity in four width of cloth phase-shifted gratings.
To seven width of cloth encode gratings, pass through image processing technique, image is carried out binary conversion treatment, can try to achieve each point to each is stain (being encoded to 1) or white point (being encoded to 0) in every images, comprehensive 7 images, can obtain coded sequence,, coded sequence is converted into periodicity n then according to the mapping relations between coded number and the periodicity.The phase place of each point adds that by the phase main value 2n π can obtain.
Concerning same point, according to the phase place of calculating above the location independent taken with video camera, that is to say should equate at each point that two video cameras are taken.Thereby the phase value of our each point of taking with two video cameras is as the foundation of coupling.
4) two video cameras are calibrated, the calibrating block of using in the calibration as shown in Figure 2.Camera calibration is to try to achieve the intrinsic parameter of video camera and with respect to the process of the outer parameter of world coordinate system.To the point in space (Xw, Yw, Zw), after video camera is taken, image coordinate (mm) be (x, y), pixel coordinates (pixel) be (u, v):
x = f r 1 Xw + r 2 Yw + r 3 Zw + Tx r 7 Xw + r 8 Yw + r 9 Zw + Tz
y = f r 4 Xw + r 5 Yw + r 6 Zw + Ty r 7 Xw + r 8 Yw + r 9 Zw + Tz - - - ( 3 )
u=u 0+x/dx
v=v 0+y/dy (4)
Wherein:
R = r 1 r 2 r 3 r 4 r 5 r 6 r 7 r 8 r 9 , T=[TxTyTz] ' be rotation matrix and translation vector, f is a lens focus, is the parameter that will demarcate.
(u 0, v 0) be the pixel coordinate of initial point in pixel coordinate system of image coordinate system, be 780*582 to our resolution of video camera, (u 0, v 0) value is (390,291).(dx is the x between the CCD adjacent image point and the distance of y direction dy), can be provided by CCD producer.
Calibrating block in the calibration is a Precision Machining, and the three-dimensional coordinate of each point is accurately to know, utilizes the image processing radix can obtain the image coordinate of each point.In native system, take the dual stage process of Tsai to obtain the rotation matrix R of video camera, translation matrix T, focal distance f.Idiographic flow as shown in Figure 3, its process is as follows:
Stage 1: calculate rotation matrix R, Tx, Ty
(4.1) computed image coordinate
According to (4) formula calculate each monumented point image coordinate (x, y).
(4.2) calculate five unknown quantity Ty -1r 1, Ty -1r 2, Ty -1T x, Ty -1r 4, Ty -1r 5For each three dimensional object point (Xw k, Yw k, Zw k) (because the some coplane, so the Z coordinate is got work 0) and corresponding image coordinate (x k, y k), by collinearity equation:
x k = f r 1 X w k + r 2 Y w k + Tx r 7 X w k + r 8 Y w k + Tz
y k = f r 4 X w k + r 5 Y w k + Ty r 7 X w k + r 8 Y w k + Tz - - - ( 5 )
Top two formulas are divided by obtain:
[y kXw k y kYw k y k -x kXw k -x kYw k]L=x k (6)
Wherein:
L=[Ty -1r 1 Ty -1r 2 Ty -1Tx Ty -1r 4 Ty -1r 5] T (7)
In following formula, 5 unknown numbers are arranged, the number of our point is generally a lot, utilizes least square method to try to achieve solution of equations.
(4.3) calculate r 1..., r 9, Tx, Ty
(4.31) calculate | Ty|
The definition matrix:
C = r 1 ′ r 2 ′ r 4 ′ r 5 ′ = r 1 / Ty r 2 / Ty r 4 / Ty r 5 / Ty - - - ( 8 )
Then have:
T y 2 = Sr - [ S r 2 - 4 ( r 1 ′ r 5 ′ - r 4 ′ r 2 ′ ) 2 ] 1 / 2 2 ( r 1 ′ r 5 ′ - r 4 ′ r 2 ′ ) 2 - - - ( 9 )
Wherein:
Sr=r 12+r 22+r 52+r 42, (10)
If certain row of Matrix C or certain column element are calculated as follows for being 0 entirely:
Ty 2=(r i' 2+ r j' 2) -1, r wherein i', r j', be remaining two elements in addition of Matrix C.
(4.32) symbol of decision Ty
1. suppose that Ty is a positive sign;
2. select in the captured image, from picture centre far away a bit.If its image coordinate is (x k, y k), the coordinate in three-dimensional world is (Zw k, Yw k, Zw k).
3. calculate following various value by top result:
r i=(Ty -1r 2)*Ty,r 2=(Ty -1r 2)*Ty,r 4=(Ty -1r 4)*Ty
r 5=(Ty -1r 5)*Ty,Tx=(Ty -1Tx)*Ty, (11)
x k′=r 1Xw k+r 2Yw k+Tx
y k′=r 4Xw k+r 5Yw k+Ty
If x kAnd x k', y kAnd y k' jack per line all, sgn (Ty)=+ 1 so, otherwise sgn (Ty)=-1;
(4.33) calculate rotation matrix R
Value according to Ty recomputates r 1, r 2, r 4, r 5, Tx.
R = r 1 r 2 ( 1 - r 1 2 - r 2 2 ) 1 / 2 r 4 r 5 s ( 1 - r 4 2 - r 5 2 ) 1 / 2 r 7 r 8 r 9 - - - ( 12 )
S=sgn (r wherein 1r 4+ r 2r 5)
r 7, r 8, r 9Be to obtain by preceding two appositions of going.
If calculating following focal distance f according to such R is negative value, then:
R = r 1 r 2 - ( 1 - r 1 2 - r 2 2 ) 1 / 2 r 4 r 5 - s ( 1 - r 4 2 - r 5 2 ) 1 / 2 - r 7 - r 8 r 9 - - - ( 13 )
Then calculate focal length f and T zValue
To each calibration point, foundation comprises f and T zLinear equation as unknown parameter:
[ Y k - y k ] f Tz = w k y k - - - ( 14 )
Wherein:
Y k=r 4x wk+r 5y wk+r 6*0+Ty (15)
w k=r 7x wk+r 8y wk+r 9*0
By solving an equation, can ask f and T z
5) carry out three-dimensionalreconstruction according to phase place and outer polar curve geometry to every, obtain the three-dimensional coordinate of body surface point.To the image that two video cameras are taken, three dimensions point S (Zw) pass with the correspondence image coordinate is for Xw, Yw:
x ( j ) = f ( j ) R ( j ) 11 Xw + R ( J ) 12 Yw + R ( j ) 13 Zw + T ( j ) x R ( j ) 31 Xw + R ( j ) 32 Yw + R ( j ) 33 Zw + T ( j ) z ,
y ( j ) = f ( j ) R ( j ) 21 Xw + R ( j ) 22 Yw + R ( j ) 23 Zw + T ( j ) y R ( j ) 31 Xw + R ( j ) 32 Yw + R ( j ) 33 Zw + T ( j ) z - - - ( 16 )
J=1 wherein, the image that two video cameras of 2 expressions are taken.
Behind the camera calibration, f (j), R (j), T (j)Be known, the image to individual video camera is taken has four equations, to the video camera of demarcating, utilizes least square method can obtain the coordinate of three-dimensional point.
This is the ultimate principle of stereo vision three-dimensional rebuilding, and wherein Zui Da problem is how to find two points that are complementary, and that is to say how to realize some corresponding relation on two images in the three dimensions.Know that by the outer polar curve theory in the computer vision to a point in first width of cloth image, the corresponding point in second width of cloth image are point-blank.Its relation can have following The Representation Equation:
m ~ 2 T F m ~ 1 = 0 - - - ( 17 )
Wherein,
Figure C0315350400175
Be the pixel coordinate (u of certain point in first width of cloth image 1, v 1, 1) T,
Figure C0315350400176
Be the pixel coordinate (u of certain point in second width of cloth image 2, v 2, 1) T, F is basis matrix (Fundamental Matrix), its element is a camera interior and exterior parameter.
F=A 2 -TEA 1 -1 (18)
Wherein
A 2 = f 2 / d x 2 0 u 02 0 f 2 / d y 2 v 02 0 0 1 , A 1 = f 1 / d x 1 0 u 01 0 f 1 / d y 1 v 01 0 0 1
F wherein 1, (u 01, v 01), dx 1, dy 1Be the intrinsic parameter of first video camera, f 2, (u 02, v 02), dx 2, dy 2Be the intrinsic parameter of second video camera, the meaning of parameter is described with the front.
E = [ T ] x R ( 2 ) R ( 1 ) - 1 (being called essential matrix, Essential Matrix)
T = T ( 2 ) - R ( 2 ) R ( 1 ) - 1 T ( 1 ) - - - ( 19 )
T is expressed as [Tx, Ty, Tz], [T] xBe antisymmetric matrix, be defined as:
[ T ] x = 0 - Tz Ty Tz 0 - Tx - Ty Tx 0 - - - ( 20 )
Basis matrix is determined by camera interior and exterior parameter as can be seen, and by camera calibration, we just can obtain the polar curve equation.
From the polar curve equation as can be seen, right video camera is taken last 1 P of image, its coordinate
Figure C0315350400184
If it is taken on the image at left video camera corresponding point Q is arranged, should be by On the straight line of basis matrix F decision.
Key is which point on this straight line
When phase place is obtained in front, once mentioned, same when different cameras is taken phase value should be identical.And to the phase value of each point, we have phase place to obtain to have obtained, and we utilize this point to realize the accurate coupling of putting on two images just.
Algorithm flow chart is seen accompanying drawing 4.
After finding match point, utilize the three-dimensional coordinate that formula (16) can calculation level.
According to said process staff is carried out three-dimensional measurement, the point that measures as shown in Figure 5.
Characteristics such as the three-dimension measuring system that the present invention constituted has noncontact, speed is fast, data volume is big, precision is high, simple to operate.Single face to object is measured as long as can obtain the data (400,000 points) of very high-density 2 seconds, and the precision of measurement is more than 0.05mm.

Claims (3)

1. the method for Measuring Object surface tri-dimensional profile, it is characterized in that: it is a kind of combination that utilizes phase place and stereovision technique, at body surface projection grating, adopt twin camera to take the raster image that distortion takes place again, utilize encoded light and phase shifting method to obtain the phase place of every bit on the left and right cameras photographic images; Utilize phase place and outer polar curve to realize the coupling of the point on two width of cloth images, thereby reach the anti-method of asking body surface point three-dimensional coordinate; It comprises the steps:
(1) utilizes computing machine to generate virtual grating,, utilize projector that the grating that generates is incident upon on the object comprising encode grating and phase-shifted grating;
The light intensity of phase-shifted grating is as shown in the formula expressing:
I i(u,v)=a(u,v)+b(u,v)cos(φ(u,v)+φ i)
Wherein:
(u v) is the coordinate of certain point;
I i(u v) is (u, a light intensity v) in the i width of cloth image;
(u v) is the bias light majorant to a;
(u v) is a fringe contrast to b;
(u v) represents the phase place of each point to φ, and the cycle is T;
φ iBe angle of phase displacement;
Encode grating has the N width of cloth, and building method is that first width of cloth is partly to deceive partly in vain, and each width of cloth of back segments gradually, and divided method is the black part of a last width of cloth, is divided into partly deceiving partly in vain, and the white of a last width of cloth is divided into partly and partly deceives in vain; To each point, according to then being encoded to 1 still for encoding in vain for deceiving for black on each width of cloth image in each width of cloth image, for then being encoded to 0 in vain, thereby obtain the coded sequence of this point; N width of cloth encode grating can have 2 NIndividual coded sequence, whole image is divided into 2 NIndividual rectangular, each rectangular width is the period T of phase-shifted grating; Individual rectangular to n, n=1,2 ... 2 N, claim periodicity again, according to the corresponding unique encoding sequence of such encoded light building method, its decimal-coded digit is nc, sets up the mapping relations between periodicity n and the coded number nc, can realize both mutual conversions;
(2) utilize the raster image of two ccd video camera collection projections, and be kept in the array of distributing in the program;
(3) each width of cloth image that each camera is taken is handled respectively, obtain the phase value of each point, phase value adds that by the phase main value periodicity multiply by 2 π, be 2n π, because the phase value of each point that two video cameras are taken should equate, take each some phase value of obtaining as the foundation of mating with two video cameras;
(4) two video cameras are calibrated, obtained the intrinsic parameter of video camera and with respect to the outer parameter of world coordinate system: f (j), R (j), T (j), j=1,2
f (j): lens focus length, j is a camera number;
R (j): rotation matrix, R = r 1 r 2 r 3 r 4 r 5 r 6 r 7 r 8 r 9 ;
T (j): translation vector, T=[Tx Ty Tz] ';
Calculate R, Tx, Ty earlier;
(4.1) calculate the image coordinate of each point
u=u 0+x/dx
v=v 0+y/dy
To the point in space (Xw, Yw, Zw), after video camera is taken, image coordinate (mm) be (x, y), pixel coordinates be (u, v), (u 0, v 0) be the pixel coordinate of initial point in pixel coordinate system of image coordinate system, (dx is the x between the CCD adjacent image point and the distance of y direction dy), is provided by CCD producer;
(4.2) calculate five unknown quantity Ty -1r 1, Ty -1r 2, Ty -1Tx, Ty -1r 4, Ty -1r 5
For each three dimensional object point (Xw k, Yw k, Zw k), because the some coplane, so the Z coordinate is got work 0, and corresponding image coordinate (x k, y k), by collinearity equation:
x k = f r 1 X w k + r 2 Y w k + Tx r 7 X w k + r 8 Y w k + Tz
y k = f r 4 Xw k + r 5 Y w k + Ty r 7 X w k + r 8 Y w k + Tz
Top two formulas are divided by obtain: utilize least square method to try to achieve above-mentioned 5 unknown quantitys;
(4.3) calculate r 1..., r 9, Tx, T y
(4.31) calculate | Ty|
The definition matrix:
C = r 1 ′ r 2 ′ r 4 ′ r 5 ′ = r 1 / Ty r 2 / Ty r 4 / Ty r 5 / Ty
Then have:
Ty 2 = Sr - [ Sr 2 - 4 ( r 1 ′ r 5 ′ - r 4 ′ r 2 ′ ) 2 ] 1 / 2 2 ( r 1 ′ r 5 ′ - r 4 ′ r 2 ′ ) 2
Wherein:
Sr=r 12+r 22+r 52+r 42
If certain row of Matrix C or certain column element are calculated as follows for being 0 entirely:
Ty 2=(r i' 2+ r j' 2) -1, r wherein i', r j', be remaining two elements in addition of Matrix C;
(4.32) symbol of decision Ty
1. suppose that Ty is a positive sign;
2. select in the captured image, from picture centre far away a bit; If its image coordinate is (x k, y k), the coordinate in three-dimensional world is (Xw k, Yw k, Zw k);
3. calculate following various value by top result:
r 1=(Ty -1r 1)*Ty,r 2=(Ty -1r 2)*Ty,r 4=(Ty -1r 4)*Ty
r 5=(Ty -1r 5)*Ty,Tx=(Ty -1Tx)*Ty,
x k′=r 1Xw k+r 2Yw k+Tx
y k′=r 4Xw k+r 5Yw k+Ty
If x kAnd x k', y kAnd y k' jack per line all, sgn (Ty)=+ 1 so, otherwise sgn (Ty)=-1;
(4.33) calculate rotation matrix R
Value according to Ty recomputates r 1, r 2, r 4, r 5, Tx;
R = r 1 r 2 ( 1 - r 1 2 - r 2 2 ) 1 / 2 r 4 r 5 s ( 1 - r 4 2 - r 5 2 ) 1 / 2 r 7 r 8 r 9
S=sgn (r wherein 1r 4+ r 2r 5)
r 7, r 8, r 9Be to obtain by preceding two appositions of going;
If calculating following focal distance f according to such R is negative value, then:
R = r 1 r 2 - ( 1 - r 1 2 - r 2 2 ) 1 / 2 r 4 r 5 - s ( 1 - r 4 2 - r 5 2 ) 1 / 2 - r 7 - r 8 r 9
Then calculate focal length f and T zValue
To each calibration point, foundation comprises f and T zLinear equation as unknown parameter:
Y k - y k f Tz = w k y k
Wherein:
Y k=r 4x wk+r 5y wk+r 6*0+Ty
w k=r 7x wk+r 8y wk+r 9*0
By solving an equation, can ask f and T z
(5) carry out three-dimensionalreconstruction according to phase place and outer polar curve geometry to every, obtain the three-dimensional coordinate of body surface point:
(5.1) calculate basis matrix F
F=A 2 -TEA 1 -1
Wherein
A 2 = f 2 / dx 2 0 u 02 0 f 2 / dy 2 v 02 0 0 1 , A 1 = f 1 / dx 1 0 u 01 0 f 1 / dy 1 v 01 0 0 1
F wherein 1, (u 01, v 01), dx 1, dy 1Be the intrinsic parameter of first video camera,
f 2, (u 02, v 02), dx 2, dy 2It is the intrinsic parameter of second video camera;
E=[T] xR (2)R (1)-1, be called essential matrix;
T=T (2)-R (2)R (1)-1T (1)
T is expressed as [Tx, Ty, Tz], then antisymmetric matrix is [T] x
[ T ] x = 0 - Tz Ty Tz 0 - Tx - Ty Tx 0
(5.2) calculate 1 P on the right video camera photographic images, its coordinate is Look for its polar curve equation parameter on left video camera photographic images; And on above-mentioned straight line, seek its match point Q point, method is that the phase value of a P and some Q equates;
Known According to following straight-line equation, look for the some Q of some P on left video camera photographic images on the right video camera photographic images, its coordinate is
m ~ 2 T F m ~ 1 = 0 ,
Wherein: Be the pixel coordinate (u that P is ordered 2, v 2, 1) T:
Be Q point pixel coordinate (u 1, v 1, 1) T
According to a P and the equal principle of some Q phase place, on straight line, seek the Q point by above-mentioned straight-line equation decision;
(5.3) find the Q point, then store this match point, according to following three dimensions point S (Xw, Yw, Zw) and the pass of the correspondence image coordinate of two video camera photographic images be:
x ( j ) = f ( j ) R ( j ) 11 Xw + R ( j ) 12 Yw + R ( j ) 13 Zw + T ( j ) x R ( j ) 31 Xw + R ( j ) 32 Yw + R ( j ) 33 Zw + T ( j ) z ,
y ( j ) = f ( j ) R ( j ) 21 Xw + R ( j ) 22 Yw + R ( j ) 23 Zw + T ( j ) y R ( j ) 31 Xw + R ( j ) 32 Yw + R ( j ) 33 Zw + T ( j ) z ,
J=1,2, be the numbering of video camera.
2. the method for surface measurements three-D profile according to claim 1 is characterized in that the angle of phase displacement φ of described phase-shifted grating i=i*90, i=1 ... 4, promptly the phase-shifted grating image has 4 width of cloth, and its phase main value computing formula is: φ ( x , y ) = a tan ( I 2 - I 4 I 3 - I 1 ) ,
I wherein 1, I 2, I 3, I 4, be point (u, the v) light intensity in four width of cloth phase-shifted gratings.
3. the method for Measuring Object three-dimensional surface profile according to claim 1 is characterized in that described encode grating has 7 width of cloth, and the binary code sequence of every bit can change into this position in image, i.e. periodicity.
CNB031535046A 2003-08-15 2003-08-15 Method and system for measruing object two-dimensiond surface outline Expired - Fee Related CN1203292C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB031535046A CN1203292C (en) 2003-08-15 2003-08-15 Method and system for measruing object two-dimensiond surface outline

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB031535046A CN1203292C (en) 2003-08-15 2003-08-15 Method and system for measruing object two-dimensiond surface outline

Publications (2)

Publication Number Publication Date
CN1483999A CN1483999A (en) 2004-03-24
CN1203292C true CN1203292C (en) 2005-05-25

Family

ID=34156701

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB031535046A Expired - Fee Related CN1203292C (en) 2003-08-15 2003-08-15 Method and system for measruing object two-dimensiond surface outline

Country Status (1)

Country Link
CN (1) CN1203292C (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100443854C (en) * 2006-09-15 2008-12-17 东南大学 Gray code based phase development method in three-dimensional scanning system
CN102175206A (en) * 2011-02-21 2011-09-07 合肥工业大学 Method for measuring connectivity of valley based on three-dimensional surface topography instrument

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1312461C (en) * 2004-06-23 2007-04-25 香港理工大学 Reconstruction system and method for sheet three-dimensional surface of flexible body
CN1312633C (en) * 2004-04-13 2007-04-25 清华大学 Automatic registration method for large scale three dimension scene multiple view point laser scanning data
CN1308652C (en) * 2004-12-09 2007-04-04 武汉大学 Method for three-dimensional measurement of sheet metal part using single non-measuring digital camera
CN100368767C (en) * 2006-03-29 2008-02-13 东南大学 Two-dimensional image area positioning method based on grating projection
CN100449571C (en) * 2006-09-15 2009-01-07 东南大学 Threshold value dividing method based on single-pixel in three-dimensional scanning system
CN100458358C (en) * 2007-07-10 2009-02-04 浙江大学 Converse measuring method and device based on axial direction stereovision
CN101482398B (en) * 2009-03-06 2011-03-30 北京大学 Fast three-dimensional appearance measuring method and device
DE102010029319B4 (en) * 2009-05-27 2015-07-02 Koh Young Technology Inc. Apparatus for measuring a three-dimensional shape and method thereto
CN102032878B (en) * 2009-09-24 2014-06-18 黑龙江省科学院自动化研究所 Accurate on-line measurement method based on binocular stereo vision measurement system
WO2011137596A1 (en) * 2010-05-07 2011-11-10 深圳泰山在线科技有限公司 Structured-light measuring method and system
CN101893766B (en) * 2010-06-23 2012-01-11 北京航空航天大学 Method and device for realizing phase shift by changing incident angle of light
CN101963494B (en) * 2010-08-20 2012-05-30 沈阳建筑大学 Stone slab surface profile size measurement device and measurement method thereof
CN102261896A (en) * 2011-04-19 2011-11-30 长春东瑞科技发展有限公司 Method and system for measuring three-dimensional shape of object based on phase measurement
JP5138116B2 (en) * 2011-04-19 2013-02-06 三洋電機株式会社 Information acquisition device and object detection device
CN103047944B (en) * 2013-01-22 2014-04-02 廖怀宝 Three-dimensional object measuring method and device
CN104183010A (en) * 2013-05-22 2014-12-03 上海迪谱工业检测技术有限公司 Multi-view three-dimensional online reconstruction method
EP3046499B1 (en) * 2013-09-18 2022-11-02 Imirge Medical Inc. Optical targeting and visualization of trajectories
CN103753585A (en) * 2014-01-10 2014-04-30 南通大学 Method for intelligently adjusting manipulator and grasping force on basis of visual image analysis
CN103994732B (en) * 2014-05-29 2016-08-17 南京理工大学 A kind of method for three-dimensional measurement based on fringe projection
JP5911934B2 (en) * 2014-09-18 2016-04-27 ファナック株式会社 Contour measurement device and robot system
CN104296681B (en) * 2014-10-16 2016-12-07 浙江大学 Dimensional topography method for sensing based on laser dot-matrix mark
CN104390608A (en) * 2014-11-27 2015-03-04 上海江南长兴造船有限责任公司 Projection grating phase method based structured light three-dimensional shape construction method
CN104482921B (en) * 2014-12-23 2016-09-07 河北工业大学 A kind of measuring method of waterborne target
CN104713576B (en) * 2015-03-25 2017-11-07 中测高科(北京)测绘工程技术有限责任公司 Camera Self-Calibration method and its device based on many sheet photos
CN105222724B (en) * 2015-09-10 2018-09-18 北京天远三维科技股份有限公司 Multi-thread array laser 3 D scanning system and multi-thread array laser 3-D scanning method
CA3018886C (en) 2016-04-08 2020-10-27 Shining 3D Tech Co., Ltd. Three-dimensional measuring system and measuring method with multiple measuring modes
US10317199B2 (en) 2016-04-08 2019-06-11 Shining 3D Tech Co., Ltd. Three-dimensional measuring system and measuring method with multiple measuring modes
CN106840037A (en) * 2017-01-17 2017-06-13 黑龙江科技大学 A kind of three-dimensional appearance digitized measurement system and method for reverse-engineering
CN109544500A (en) * 2017-09-20 2019-03-29 诚锋兴业股份有限公司 The device for identifying and discrimination method of vamp assembly operation
CN109141302B (en) * 2018-07-25 2020-04-28 沈阳工学院 Impeller detection method based on least square method
CN109829948A (en) * 2018-12-13 2019-05-31 昂纳自动化技术(深圳)有限公司 Camera calibration plate, calibration method and camera
CN110966937B (en) * 2019-12-18 2021-03-09 哈尔滨工业大学 Large member three-dimensional configuration splicing method based on laser vision sensing
CN111473756B (en) * 2020-04-03 2021-07-06 上海嘉奥信息科技发展有限公司 Surface curve measuring method, system and medium based on Unity3D model

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100443854C (en) * 2006-09-15 2008-12-17 东南大学 Gray code based phase development method in three-dimensional scanning system
CN102175206A (en) * 2011-02-21 2011-09-07 合肥工业大学 Method for measuring connectivity of valley based on three-dimensional surface topography instrument
CN102175206B (en) * 2011-02-21 2013-01-09 合肥工业大学 Method for measuring connectivity of valley based on three-dimensional surface topography instrument

Also Published As

Publication number Publication date
CN1483999A (en) 2004-03-24

Similar Documents

Publication Publication Date Title
CN1203292C (en) Method and system for measruing object two-dimensiond surface outline
CN1268894C (en) Measuring technology and computer numerical control technology
CN1250013C (en) Image process used for correcting image pick-up defect
CN1272601C (en) Improved two-dimensional scale structure and method for absolute position commutator
CN1270277C (en) Image distortion correction method and apparatus
CN1127256C (en) Apparatus for determining smudginess and damage degree of printed article
CN1181313C (en) Method ans system for measuring the relief of an object
CN1187952C (en) Equipment and method for correcting input image distortion
CN1823523A (en) Projector apparatus, inclination angle obtaining method, and projection image correction method
CN1334913A (en) Apparatus and method to measure three-dimensional data
Abouelatta 3D surface roughness measurement using a light sectioning vision system
CN1926417A (en) Method and apparatus for producing an image containing depth information
CN101080921A (en) Image pickup device
CN1616927A (en) Improved scale structure and method in absolute position sensor
CN1655700A (en) Method and device for viewing, archiving and transmitting a garment model over a computer network
CN1918521A (en) Electronic photo-optical system for surveying, digitalizing and reproducing the external surface of a three-dimensional object, either virtually or in plastic, composite or papery material
CN1334916A (en) Phase determination of radiation wave field
CN1677063A (en) Scale for use with a translation and orientation sensing system
CN1884967A (en) Apparatus and method for testing aspherical surface shape error of optical lens
CN1378179A (en) Pattern evaluation method, pattern evaluation device computer reading record medium
CN1241255A (en) Three-dimensional shape measurement device and three-dimensional engraver using said measurement device
CN1833156A (en) Inclination angle detection device and inclination angle detection method
CN1851399A (en) System for sensing an absolute position in two dimensions using a target pattern
CN1242358C (en) Method for achieving position code and ecoding position code
EP4133451A1 (en) Scanning system and calibration thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20050525

Termination date: 20170815

CF01 Termination of patent right due to non-payment of annual fee