CN106022210A - Vein profile three-dimensional point cloud matching identity identifying method and device - Google Patents
Vein profile three-dimensional point cloud matching identity identifying method and device Download PDFInfo
- Publication number
- CN106022210A CN106022210A CN201610288717.XA CN201610288717A CN106022210A CN 106022210 A CN106022210 A CN 106022210A CN 201610288717 A CN201610288717 A CN 201610288717A CN 106022210 A CN106022210 A CN 106022210A
- Authority
- CN
- China
- Prior art keywords
- image
- finger
- point cloud
- vein
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 210000003462 vein Anatomy 0.000 title claims abstract description 51
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000013441 quality evaluation Methods 0.000 claims abstract description 7
- 239000011159 matrix material Substances 0.000 claims description 37
- 238000013519 translation Methods 0.000 claims description 18
- 238000012545 processing Methods 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 11
- 238000004364 calculation method Methods 0.000 claims description 10
- 238000005516 engineering process Methods 0.000 claims description 8
- 230000003044 adaptive effect Effects 0.000 claims description 7
- 230000008878 coupling Effects 0.000 claims description 7
- 238000010168 coupling process Methods 0.000 claims description 7
- 238000005859 coupling reaction Methods 0.000 claims description 7
- 238000012937 correction Methods 0.000 claims description 6
- 230000005484 gravity Effects 0.000 claims description 4
- 230000003287 optical effect Effects 0.000 claims description 4
- 238000006073 displacement reaction Methods 0.000 claims description 3
- 238000013210 evaluation model Methods 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims description 3
- 230000005611 electricity Effects 0.000 claims description 2
- 230000035945 sensitivity Effects 0.000 abstract description 9
- 238000003672 processing method Methods 0.000 abstract description 2
- 230000000875 corresponding effect Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 230000004899 motility Effects 0.000 description 3
- 229910052724 xenon Inorganic materials 0.000 description 3
- FHNFHKCVQCLJFQ-UHFFFAOYSA-N xenon atom Chemical compound [Xe] FHNFHKCVQCLJFQ-UHFFFAOYSA-N 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 241001248531 Euchloe <genus> Species 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 210000001367 artery Anatomy 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000001990 intravenous administration Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000013011 mating Effects 0.000 description 1
- 230000002207 retinal effect Effects 0.000 description 1
- 230000001568 sexual effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/752—Contour matching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
- G06V20/653—Three-dimensional objects by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/14—Vascular patterns
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Human Computer Interaction (AREA)
- Collating Specific Patterns (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The method provides a vein profile three-dimensional point cloud matching identity identifying method and device. A finger vein image is acquired through a vein contour identifying device. The optimal image of a designated region is acquired according to the image quality evaluation. The interference of the surrounding environment is effectively eliminated. The optimal vein image is selected as original data. An image processing method is used to acquire the finger vein contour line of the designated region, and others are set as the background. According to a binocular principle, the finger vein contour line is transformed into a three-dimensional parallax image. The parallax image is converted into a three-dimensional point cloud. A point cloud matching algorithm based on the nearest point of iteration is used for matching to realize identity authentication and identifying. According to the invention, matching is carried out based on all three-dimensional point cloud of the finger vein contour, which improves the matching accuracy and sensitivity of relevant information based on feature points at the present; two-dimensional image misjudgment caused by finger perturbation and unobvious three-dimensional features in the prior art are avoided; and according to a point cloud matching degree threshold, user-defined identifying sensitivity adjustment is realized.
Description
Technical field
The present invention relates to a kind of biometrics identification technology, particularly to the identity of a kind of vein contoured three-dimensional point cloud matching
Recognition methods and device.
Background technology
Existing intravenous methods and device are mainly based upon two dimension vein image and are identified being main.In actual applications,
Due to problems such as change, the finger position of illumination condition are inconsistent, finger disturbances, cause the mistake between template and image to be identified
Join, thus have impact on the performance of vein identification method dramatically.Solve the root of identification problem based on two dimension vein image
This approach is to use three-dimensional to identify.
Existing three-dimensional vein matching process be based on key point information (such as Application No.: 201010508188.2 special
Profit application uses SIFT feature vector etc.) three-dimensional feature that forms carries out mating, and it there may be feature calculation cost, spy
Levy the problems such as inconspicuous, characteristic information amount is very few, thus affect the Performance And Reliability of three-dimensional vein identification method;Meanwhile, by
There is no in existing three-dimensional vein identification method and matching precision is carried out self-defined adjustment and setting, therefore in use lack
Certain motility.
Therefore, how to solve the precision of three-dimensional hand vein recognition and motility has become as of current vein identification technology
Problem demanding prompt solution.
Summary of the invention
The present invention solves above-mentioned technical problem, it is proposed that the personal identification method of a kind of vein contoured three-dimensional point cloud matching
And device.The method utilizes the principle of binocular vision to build based on the embedded or finger vena three-dimensional identification device of computer,
Get the initial pictures of finger vena;Optimum collection image is obtained in conjunction with vein image quality evaluation;Use figure the most again
As processing the finger vena contour images obtained in area-of-interest;Binocular Vision Principle is used to obtain finger vena profile diagram again
The three-dimensional information of picture, is converted into three-dimensional point cloud;The ICP matching algorithm improved is used to realize the three-dimensional identification of finger vena.
The method can be effectively improved finger vena accuracy of identification and actually used in motility.
The technical solution used in the present invention is: the personal identification method of a kind of vein contoured three-dimensional point cloud matching, including:
S1, by identify device obtain finger vena initial pictures;
S2, the finger vena initial pictures obtained for step S1, first combine vein image quality evaluation and obtain optimum
Collection image;Then image procossing is used to obtain the finger vena contour images in area-of-interest;Use binocular vision again
Principle obtains the three-dimensional information of finger vena contour images, is converted into three-dimensional point cloud to be matched;
S3, the three-dimensional point cloud to be matched obtained according to step S2, realize the three-dimensional knowledge of finger vena by ICP matching algorithm
Not.
Further, described identification device includes: infrared light supply, infrared fileter, finger groove, light electric shock source switch, a left side
Right two video cameras, power supply, power control circuit and external processing apparatus;Described external processing apparatus is: PC or ARM connect
Oralia or DSP process plate;
Infrared light supply is arranged at bottom, and two, left and right video camera is arranged at top, the middle finger groove for placing finger, hands
Refer to that groove one end is provided with a touch-switch;Two, left and right camera lens has all added infrared fileter, non-red in order to filter
Outer light;
Finger groove, infrared light supply and two, left and right video camera are in same level;
Finger is vertical with infrared light supply and distance is 1cm, video camera and the vertical dimension about 8cm of finger;
Distance about 3cm between two photographic head in left and right.
Further, described step S2 include following step by step:
S21, the structural similarity of employing image content-based describe image quality, particularly as follows: select a width standard drawing
As reference, it is right the image gathered and standard picture to be carried out in terms of brightness, contrast and structural similarity three every time
Ratio, constructs evaluation model based on these three key element as follows:
S (x, y)=[l (x, y)]α·[c(x,y)]β·[s(x,y)]γ
Wherein, (x, y) is brightness comparison function to l, and а is luminance weights, and (x, y) is contrast weight to c, and β is contrast power
Weight, (x, y) is structural similarity comparison function to s, and γ is structural similarity weight, and x represents parametric image, the image that y gathers;
According to S, (x, result of calculation y) compare with first threshold, if (x, y) more than or equal to first threshold, then for S
Represent that this collection image can accept and uses, otherwise represent that this picture quality is undesirable, be adjusted PWM ripple, again adopt
Collection image, (x, y) value is more than or equal to till first threshold until S;
Two video cameras are demarcated by S22, employing Zhang Zhengyou standardizition, obtain the spin matrix peace between two video cameras
The amount of shifting to and their Intrinsic Matrix K;Using Fusiello method to carry out polar curve correction, the optical axis making video camera is parallel,
Thus obtain only horizontal displacement difference a pair image and correction after camera projection matrix;
S23, use CLAHE algorithm carry out histogram equalization, use adaptive threshold fuzziness technology, it is thus achieved that vein mesh
Mark, then uses Sobel edge edge detective operators to obtain vein profile, then uses 8 neighborhoods to follow the trail of to obtain the monodrome of finger vena
Profile, and will to obtain vein profile point be key point;
S24, use SAD algorithm do Stereo matching and generate disparity map, select the translation distance making sad value minimum for sliding
The parallax value of window center point, calculates the parallax value of each pixel successively with order the most from top to bottom, final
To disparity map;
S25, use principle of triangulation calculate the three-dimensional coordinate of point, obtain three-dimensional point cloud to be matched.
Further, described step S23 uses CLAHE algorithm also to include after carrying out histogram equalization: use intermediate value
Filter method filters the noise in the image after equalization, and to the linearity gray scale stretching obtained.
Further, the ICP matching algorithm described in step S3 is the ICP matching algorithm improved, and specifically includes following substep
Rapid:
1), calculate masterplate point cloud and the center of gravity of three-dimensional point cloud to be matched, and be moved into the identical bits under same coordinate
Put;
2), calculate the minimum rectangle bounding box of two groups of some clouds, point of rotation cloud make minimum bounding box towards unanimously;
3), obtain two points and converge the Cross-covariance of conjunction;
4), utilize antisymmetric matrix to construct column vector, and generate the symmetrical matrix of a 4*4 dimension by this column vector;
5), calculation procedure 4), the eigenvalue of gained symmetrical matrix and unit character vector;
Wherein, the unit character vector that maximum feature valuation is corresponding is optimal spin matrix;
6), optimal translation vector is calculated;
7), according to step 5) spin matrix that obtains and step 6) the optimal translation vector that obtains, obtain registration state
Vector;
8), match cognization object function is built:
Wherein,Represent masterplate point cloud, xiRepresenting some cloud to be matched, R represents spin matrix,Represent optimal spin moment
Battle array,Represent optimal translation vector,Represent Euclidean distance square;
9), according to step 7) the registration state vector that obtains, calculation procedure 8) lowest mean square of match cognization object function
Error;
10), according to repeatedly coupling measuring Second Threshold, by step 9) least mean-square error that obtains and Second Threshold
Compare, if least mean-square error is more than this threshold value, then the some cloud number obtained with the translation vector calculated and spin matrix
Replace former to be matched some cloud according to battle array, and jump to step S31, otherwise when least mean-square error is less than or equal to Second Threshold, or
Person's iterations, more than when presetting maximum iteration time, stops iteration.
A kind of vein outline identification device, including: infrared light supply, infrared fileter, finger groove, light electric shock source switch, a left side
Right two video cameras, power supply, power control circuit and external processing apparatus;Described external processing apparatus is: PC or ARM connect
Oralia or DSP process plate;
Infrared light supply is arranged at bottom, and two, left and right video camera is arranged at top, the middle finger groove for placing finger, hands
Refer to that groove one end is provided with a touch-switch;Two, left and right camera lens has all added infrared fileter, non-red in order to filter
Outer light;
Finger groove, infrared light supply and two, left and right video camera are in same level;
Finger is vertical with infrared light supply and distance is 1cm, video camera and the vertical dimension about 8cm of finger;
Distance about 3cm between two photographic head in left and right.
Beneficial effects of the present invention: the personal identification method of a kind of vein contoured three-dimensional point cloud matching and device, by quiet
Arteries and veins outline identification device gets finger venous image;Then the optimum image specifying region is obtained according to image quality evaluation,
Can effectively get rid of the interference of surrounding, select the vein image of optimum as initial data;Use image processing method,
Obtaining the finger vena contour line specifying region, other are then set to background;According to binocular principle, it is converted into three-dimensional parallax figure
Picture;Anaglyph is converted to three-dimensional point cloud;Use point cloud matching algorithm based on iterative closest point to mate, coupling is set
Threshold value, it is achieved authentication and identification.The present invention achieves three-dimensional coupling based on vein profile point cloud certification from three-dimensional perspective
Identifying, the present invention whole three-dimensional point clouds based on finger vena profile mate, and can be effectively improved and be currently based on characteristic point
Correlated information match accuracy and sensitivity, and effectively eliminate the two dimensional image erroneous judgement caused because of finger disturbance and existing
The unconspicuous problem of three-dimensional feature, can according to point cloud matching degree threshold value come self-defined adjust identify sensitivity.
Accompanying drawing explanation
The identification structure drawing of device that Fig. 1 provides for the present invention.
The protocol procedures figure that Fig. 2 provides for the present invention.
Fig. 3 detects the mask used by profile for what the present invention provided;
Wherein, (a) is finger coboundary, and (b) is finger lower boundary.
The finger vena three-dimensional identification process figure that Fig. 4 provides for the present invention.
Detailed description of the invention
For ease of skilled artisan understands that the technology contents of the present invention, below in conjunction with the accompanying drawings present invention is entered one
Step explaination.
The present invention, by vein outline identification device as shown in Figure 1, obtains finger vena initial pictures, and this device is main
Including: infrared light supply (1), infrared fileter (2), finger groove (3), light electric shock source switch (4), two, left and right video camera (5), electricity
Source (6), power control circuit (7), PC (or ARM interface board and DSP process plate) (8), wherein two camera horizon are placed
At device top, in order to prevent non-infrared light, camera lens adds infrared fileter.Finger groove is placed in the middle of device, at finger
The top of groove is placed with touch-switch (4), and bottom of device lays infrared light supply (1).
After finger is in place in finger groove, finger tip props up touch-switch (4), then starting device power supply (6), opens infrared light
Source (1) and video camera (5), hardware device is started working.By predetermined imaging parameters, it is thus achieved that initial pictures, special by structure
Levying quantitative description picture quality, if meeting requirement, then using this image;PWM ripple is otherwise used to adjust light source voltage, again
Gather image, until picture quality meets requirement;The optimum image of acquisition is cut to the image of unified size.
Described infrared light supply is to be arranged into the electric filament lamp of array format or xenon lamp or infrarede emitting diode LED.Electric filament lamp
Or other light that xenon lamp sends are video camera (5) gathers when, because having added infrared fileter on camera lens, can be by except infrared
Light other light unexpected filter, and electric filament lamp or xenon lamp are common light sources, can reduce be manufactured into for manufacturing the device of the application
This.
It is illustrated in figure 2 the solution of the present invention flow chart, the technical scheme is that a kind of vein contoured three-dimensional point cloud
The personal identification method of coupling, including:
S1, by identify device obtain finger vena initial pictures;
Described identification device includes: infrared light supply, infrared fileter, finger groove, light electric shock source switch, the shooting of two, left and right
Mechanical, electrical source, power control circuit and external processing apparatus;Described external processing apparatus is:, PC or ARM interface board or DSP
Process plate;
Wherein, infrared light supply is in bottom, and two, left and right video camera is at top, and centre is for placing the finger groove of finger, finger
Groove top has a touch-switch, and finger groove, infrared light supply and two, left and right video camera to be in same level;
Infrared light supply, finger groove and two, left and right video camera in same level, finger vertical with infrared light supply and away from
From the vertical dimension about 8cm for 1cm, video camera and finger;
Distance about 3cm between two photographic head in left and right;
Two, left and right camera lens all adds infrared fileter, in order to filter non-infrared light;
S2, the finger vena initial pictures obtained for step S1, first combine vein image quality evaluation and obtain optimum
Collection image, can effectively get rid of the interference of surrounding;Then image procossing is used to obtain the finger in area-of-interest
Vein contour images;Use Binocular Vision Principle to obtain the three-dimensional information of finger vena contour images again, be converted into three-dimensional
Point cloud;Specifically include following step by step:
S21, the structural similarity of employing image content-based describe image quality, i.e. select a width standard picture conduct
Reference, contrasts the image gathered every time with standard picture in terms of brightness, contrast and structural similarity three, structure
Evaluation model based on these three key element is as follows:
S (x, y)=[l (x, y)]α·[c(x,y)]β·[s(x,y)]γ
Wherein, (x, y) is brightness comparison function to l, and а is luminance weights, and (x, y) is contrast weight to c, and β is contrast power
Weight, (x, y) is structural similarity comparison function to s, and γ is structural similarity weight, and x represents parametric image, the image that y gathers.For
Being easy to the design of later image Processing Algorithm, the weight of three factors of quality evaluation here is 1, i.e. а=β=γ=1.
Here,Represent reference picture and gather the mean flow rate of image,Represent reference picture and gather the standard deviation of image,Represent reference picture and gather the covariance of image, c1、c2And c3It is to avoid denominator respectively
It it is the minimum constant of zero.
According to S (x, result of calculation y) are closer to 1, illustrate and reference picture quality closer to, then it represents that more can connect
It is subject to.Here arrange S (x, threshold value y) is 0.8, then S (x, y) more than or equal to 0.8, represents that this collection image can accept and uses,
If (x, y) less than 0.8, then it represents that this picture quality is undesirable, then adjusts PWM ripple to S, and Resurvey image, until adopting
The S of collection image and reference picture (x, y) value is more than or equal to 0.8, till.
S22, use Zhang Zhengyou standardizition that two video cameras are demarcated, obtain spin matrix R between two video cameras and
Translation vector T and their Intrinsic Matrix K;
Wherein, αu=-fku, αv=-fkvRepresent the focal length in horizontal and vertical pixel, kuAnd kvIt is along u axle axle (level
Axle) and the valid pixel number of upper every millimeter of v axle (vertical axis), (u0,v0) it is the seat of principal point (optical axis with retinal plane intersection point)
Mark, γ is warping factor.
Then camera projection matrix is represented by P=K [R | T].
Using Fusiello method to carry out polar curve correction, the optical axis making video camera is parallel, thus obtains only horizontal displacement
Camera projection matrix after a pair image of difference and correction.
S23, use CLAHE algorithm carry out histogram equalization, use adaptive threshold fuzziness technology, it is thus achieved that vein mesh
Mark, then uses Sobel edge edge detective operators to obtain vein profile, then uses 8 neighborhoods to follow the trail of to obtain the monodrome of finger vena
Profile, and will to obtain vein profile point be key point.Particularly as follows:
First, Contrast Limited Adaptive Histogram Equalization (CLAHE) algorithm is used
Limit the enhancing amplitude of local contrast by limiting the height of local histogram, thus realize limiting noise and local contrast
Crossing of degree strengthens.Detailed process is: original image is divided into less window, calculates the accumulation histogram function in each window.
Cutting rectangular histogram is carried out uniform to reach to limit the purpose of enlargement range the part that these cropped by predefined threshold value
Be distributed to other parts histogrammic.Equalization is done, with the gray scale of equalization rear hatch central point for making based on this rectangular histogram
Centered by point gray value.Then moving window, constantly repeats said process, until each pixel is carried out gray scale change
Change.Thereby enhance picture contrast.In actual applications, contrast limits limits value is the number in scope [0,1]
Value, this experimental selection contrast is limited to 0.01.
Then, the noise in image is filtered with median filtering method.Medium filtering principle is the gray value of any in image
Replace with the Mesophyticum of each point value in a neighborhood of this point, make the actual value that the pixel value of surrounding is close, thus eliminate isolated
Noise spot.Method is with two dimension sleiding form, pixel in template is ranked up according to the size of grey scale pixel value, generates dullness
Rise for 2-D data sequence.Two dimension median filter be output as g (x, y)=med{f (x-k, y-l), (k, l ∈ W) }, wherein,
F (x, y), g (x, image after y) being respectively original image and processing.W be size be the template of 7 × 7.
Furthermore, use gray scale stretching to strengthen image quality.Grey Linear conversion makes less gray space pass through line
Sexual relationship expands to bigger gray space.After grey linear transformation, add the dynamic range of pixel, enhance the right of image
Degree of ratio.Image is made to become more fully apparent, it is easy to identify.Assuming that original image f (x, tonal range y) is [a, b], linear transformation
After, (x, gray space y) expands to [c, d] to image f, and formula is as follows.In the method, original image Normalized Grey Level value
Pixel in the range of [0.15,0.9] is scaled up to [0,1].
Finally, it is respectively adopted adaptive threshold fuzziness technology, it is thus achieved that vein target, uses contours extract and tracking the most again
To obtain the monodrome image outline of finger vena.The detection of secondary Sobel edge edge obtains vein profile and finger boundary profile and incites somebody to action
It is as key point.
First, by mask detection finger contours as shown in Figure 3
By calculating each x mask in y-direction and the convolution of image, the position that maximum convolution value occurs is border
Line.Make the grey scale pixel value outside finger areas equal to 0.Use adaptive thresholding algorithm dividing vein from background.Carry out this step
After the bianry image that obtains still have noise region to be extracted as finger vena or background mistakenly, it is therefore desirable to image is carried out
Corrode and add up the size in each UNICOM region.The black connected region that area is little is filled by white pixel, little white of area
Territory, zone is disallowable.Sobel operator extraction is finally used to go out the profile of finger and vein.Sobel edge edge detector uses one 3
Discrete difference between the row and column in × 3 fields calculates gradient, and wherein, the center pixel of every row or column weights with 2, to provide
Smooth effect:
In formula, z item represents gray scale.Therefore, if (x, y) place's Δ f >=T (T is adaptive threshold), then in this position
Pixel be edge pixel.After extracting profile, the key point used as coupling.
S24, use SAD algorithm do Stereo matching and generate disparity map, select the translation distance making sad value minimum for sliding
The parallax value of window center point, calculates the parallax value of each pixel successively with order the most from top to bottom, final
To disparity map.
SAD algorithm is used to do Stereo matching and generate disparity map.Under computing formula figure:
In formula, IlAnd IrRepresenting the gray value of left images vegetarian refreshments respectively, d represents parallax distance, and w is sliding window size, x
Sliding window center pixel coordinate is represented with y.Select the parallax value that translation distance is sliding window central point making sad value minimum.With
Order the most from top to bottom calculates the parallax value of each pixel successively, finally gives disparity map.
S25, use principle of triangulation calculate the three-dimensional coordinate of point.
Image (hereinafter referred to as " left figure ") midpoint and right video camera that left video camera obtains obtain the image (hereinafter referred to as " right side
Figure ") in corresponding point coordinate under camera coordinates system be respectively x and x.The projection matrix of two cameras is respectively P and P '.By
We have obtained two equatioies these: x=PX and x '=P ' X, combine them into a linear equation AX=0 about X.Pass through
Calculate cross product, three equations of available each point, and the homogeneous scale factor that disappeared.For left figure, formula x × (PX)=0 can
Be written to for:
Wherein, PiTIt it is the row vector of P.
For right figure, x and y of above-mentioned equation group can be replaced and obtain the equation of right figure for x ', y '.
Matrix A is:
X=(x, y, z, 1)TBeing its equation of n th order n, X is the least square solution of AX=0.Thus obtain the three-dimensional of corresponding point X
Coordinate system.
S3, it is illustrated in figure 4 the identification process figure of the present invention.First to be matched some cloud and masterplate point cloud are moved to each
Center of gravity, then calculates the proximity pair in 2 clouds, obtains error and coordinate transform vector, coordinate transform vector is substituted into former treating
Mate the some cloud after cloud data is converted.Whether whether error in judgement be more than more than Second Threshold and existing iterations
Big iterations, calculates closest approach if it is not, then return, carries out next iteration.The most then point cloud data is registrated to masterplate point
Cloud, more whether relative error less than Second Threshold, the most then the match is successful;If it is not, then it fails to match.
The present invention whole three-dimensional point clouds based on finger vena profile mate, and can be effectively improved and be currently based on feature
The correlated information match accuracy and sensitivity put, and effectively eliminate the two dimensional image erroneous judgement caused because of finger disturbance and show
The unconspicuous problem of some three-dimensional features, can carry out the self-defined sensitivity adjusting and identifying according to point cloud matching degree threshold value.
The three-dimensional point cloud obtained according to step S2, realizes the three-dimensional identification of finger vena by the ICP matching algorithm improved.
Assume pi(i=1,2 ... Np) it is masterplate point cloud, xi(i=1,2 ... Nx) it is some cloud to be matched, i represents a numbering at cloud midpoint.
Use unit quaternion method to calculate kinematic parameter, obtain representing spin matrix with Quaternion MethodWherein
q0>=0 and q0 2+q1 2+q2 2+q3 2=1.And translation vectorRotated eventually through calculating matrix A
Matrix R.
Registration state vector isThus matching problem is converted into searching functionMinima
Specifically include following step by step:
1), masterplate point cloud and the center of gravity of to be matched some cloud are calculatedAnd moved
Move the same position under same coordinate;
2), calculate the minimum rectangle bounding box of two groups of some clouds, point of rotation cloud make minimum bounding box towards unanimously;
3), obtain two points and converge the Cross-covariance of conjunction;
4) antisymmetric matrix A, is utilizedij=(∑px∑px T)ijStructure column vector Δ=(A23 A31 A12)T, and with these row to
Amount generates the symmetrical matrix Q (∑ of a 4*4px);
5), calculation procedure 4) gained symmetrical matrix Q (∑px) eigenvalue and unit character vector;
Wherein, the unit character vector that maximum feature valuation is corresponding is optimal spin matrix:
6), optimal translation vector is calculated
7), according to step 5) spin matrix that obtains and step 6) the optimal translation vector that obtains, obtain registration state
Vector
8), match cognization object function is built:
Wherein,Represent masterplate point cloud, xiRepresenting some cloud to be matched, R represents spin matrix,Represent optimal spin moment
Battle array,Represent optimal translation vector, | | | |2Represent Euclidean distance square.
9), according to step 7) the registration state vector that obtains, calculation procedure 8) match cognization object functionMinimum
Mean square error
10), according to repeatedly coupling measuring Second Threshold, i.e. matching threshold τ, Second Threshold can be sensitive according to identify
Degree adjusts.If the sensitivity requirement identified is high, then this threshold value is the least;Whereas if the sensitivity requirement identified is low, then
This threshold value is the biggest, i.e. by the setting of this thresholding, can adjust the sensitivity of the identification of system.By step 9) minimum that obtains
Mean square error dmsCompare with τ, if dmsMore than τ, the then cloud data obtained with the translation vector calculated and spin matrix
Battle array replaces former to be matched some cloudLoop iteration is until dmsLess than or equal to τ, or iterations is big
In default maximum iteration time.If in default maximum iteration time, it fails to match, then recognition failures, i.e. body are described
Part authentication failed;If in default maximum iteration time, the match is successful, and dmsLess than or equal to τ, then explanation identifies successfully,
I.e. authentication success.Wherein, maximum iteration time is the number according to a cloud and the precision of identification, real-time and susceptiveness
Experiment determines.The setting of maximum iteration time is the requirement of real-time according to match cognization and required precision, by repeatedly real
Test and determine.If the requirement of real-time identified is high, then maximum iteration time may be designed as less;If the real-time identified
Require low, then maximum iteration time may be designed as more.If the required precision identified is high, then maximum iteration time may be designed as
More;If the requirement of real-time identified is low, then maximum iteration time may be designed as less.
Those of ordinary skill in the art it will be appreciated that embodiment described here be to aid in reader understanding this
Bright principle, it should be understood that protection scope of the present invention is not limited to such special statement and embodiment.For ability
For the technical staff in territory, the present invention can have various modifications and variations.All within the spirit and principles in the present invention, made
Any modification, equivalent substitution and improvement etc., within should be included in scope of the presently claimed invention.
Claims (6)
1. the personal identification method of a vein contoured three-dimensional point cloud matching, it is characterised in that including:
S1, by identify device obtain finger vena initial pictures;
S2, the finger vena initial pictures obtained for step S1, first combine vein image quality evaluation and obtain optimum adopting
Collection image;Then image procossing is used to obtain the finger vena contour images in area-of-interest;Use Binocular Vision Principle again
Obtain the three-dimensional information of finger vena contour images, be converted into three-dimensional point cloud to be matched;
S3, the three-dimensional point cloud to be matched obtained according to step S2, realize the three-dimensional identification of finger vena by ICP matching algorithm.
The personal identification method of a kind of vein contoured three-dimensional point cloud matching the most according to claim 1, it is characterised in that institute
State identification device to include: infrared light supply, infrared fileter, finger groove, light electric shock source switch, two, left and right video camera, power supply, electricity
Source control circuit and external processing apparatus;Described external processing apparatus is: PC or ARM interface board or DSP process plate;
Infrared light supply is arranged at bottom, and two, left and right video camera is arranged at top, the middle finger groove for placing finger, finger groove
One end is provided with a touch-switch;Two, left and right camera lens all adds infrared fileter, in order to filter non-infrared light;
Finger groove, infrared light supply and two, left and right video camera are in same level;
Finger is vertical with infrared light supply and distance is 1cm, video camera and the vertical dimension about 8cm of finger;
Distance about 3cm between two photographic head in left and right.
The personal identification method of a kind of vein contoured three-dimensional point cloud matching the most according to claim 1, it is characterised in that institute
State step S2 include following step by step:
S21, the structural similarity of employing image content-based describe image quality, particularly as follows: select a width standard picture to make
For reference, the image every time gathered is contrasted in terms of brightness, contrast and structural similarity three with standard picture, structure
Make evaluation model based on these three key element as follows:
S (x, y)=[l (x, y)]α·[c(x,y)]β·[s(x,y)]γ
Wherein, (x, y) is brightness comparison function to l, and а is luminance weights, and (x, y) is contrast weight to c, and β is contrast weight, s
(x, y) is structural similarity comparison function, and γ is structural similarity weight, and x represents parametric image, the image that y gathers;
According to S (x, result of calculation y) compare with first threshold, if S (x, y) more than or equal to first threshold, then it represents that
This collection image can accept and uses, and otherwise represents that this picture quality is undesirable, is adjusted PWM ripple, Resurvey figure
Picture, (x, y) value is more than or equal to till first threshold until S;
Two video cameras are demarcated by S22, employing Zhang Zhengyou standardizition, obtain the spin matrix between two video cameras and are translated towards
Amount and their Intrinsic Matrix K;Using Fusiello method to carry out polar curve correction, the optical axis making video camera is parallel, thus
Obtain only horizontal displacement difference a pair image and correction after camera projection matrix;
S23, use CLAHE algorithm carry out histogram equalization, use adaptive threshold fuzziness technology, it is thus achieved that vein target, so
Rear employing Sobel edge edge detective operators obtains vein profile, and uses the Contour tracing of 8 neighborhoods to obtain the monodrome of finger vena
Image outline, will obtain vein profile point as key point;
S24, use SAD algorithm do Stereo matching and generate disparity map, and selecting the translation distance making sad value minimum is in sliding window
The parallax value of heart point, calculates the parallax value of each pixel successively, finally gives and regard with order the most from top to bottom
Difference figure;
S25, use principle of triangulation calculate the three-dimensional coordinate of point, obtain three-dimensional point cloud to be matched.
The personal identification method of a kind of vein contoured three-dimensional point cloud matching the most according to claim 3, it is characterised in that institute
Stating step S23 uses CLAHE algorithm also to include after carrying out histogram equalization: the figure after using median filtering method to filter equalization
Noise in Xiang, and to the linearity gray scale stretching obtained.
The personal identification method of a kind of vein contoured three-dimensional point cloud matching the most according to claim 1, it is characterised in that step
Rapid ICP matching algorithm described in S3 is the ICP matching algorithm improved, specifically include following step by step:
1), calculate masterplate point cloud and the center of gravity of three-dimensional point cloud to be matched, and be moved into the same position under same coordinate;
2), calculate the minimum rectangle bounding box of two groups of some clouds, point of rotation cloud make minimum bounding box towards unanimously;
3), obtain two points and converge the Cross-covariance of conjunction;
4), utilize antisymmetric matrix to construct column vector, and generate the symmetrical matrix of a 4*4 dimension by this column vector;
5), calculation procedure 4), the eigenvalue of gained symmetrical matrix and unit character vector;
Wherein, the unit character vector that maximum feature valuation is corresponding is optimal spin matrix;
6), optimal translation vector is calculated;
7), according to step 5) spin matrix that obtains and step 6) the optimal translation vector that obtains, obtain registrating state vector;
8), match cognization object function is built:
Wherein,Represent masterplate point cloud, xiRepresenting some cloud to be matched, R represents spin matrix,Represent optimal spin matrix,Represent optimal translation vector, | | | |2Represent Euclidean distance square;
9), according to step 7) the registration state vector that obtains, calculation procedure 8) least mean-square error of match cognization object function;
10), according to repeatedly coupling measuring Second Threshold, by step 9) least mean-square error that obtains carries out with Second Threshold
Relatively, if least mean-square error is more than this threshold value, then the cloud data battle array obtained with the translation vector calculated and spin matrix
Replace former to be matched some cloud, and jump to step S31, otherwise when least mean-square error is less than or equal to Second Threshold, or repeatedly
Generation number, more than when presetting maximum iteration time, stops iteration.
6. a vein outline identification device, it is characterised in that including: infrared light supply, infrared fileter, finger groove, light electric shock
Source switch, two, left and right video camera, power supply, power control circuit and external processing apparatus;Described external processing apparatus is: PC
Machine or ARM interface board or DSP process plate;
Infrared light supply is arranged at bottom, and two, left and right video camera is arranged at top, the middle finger groove for placing finger, finger groove
One end is provided with a touch-switch;Two, left and right camera lens all adds infrared fileter, in order to filter non-infrared light;
Finger groove, infrared light supply and two, left and right video camera are in same level;
Finger is vertical with infrared light supply and distance is 1cm, video camera and the vertical dimension about 8cm of finger;
Distance about 3cm between two photographic head in left and right.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610288717.XA CN106022210A (en) | 2016-05-04 | 2016-05-04 | Vein profile three-dimensional point cloud matching identity identifying method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610288717.XA CN106022210A (en) | 2016-05-04 | 2016-05-04 | Vein profile three-dimensional point cloud matching identity identifying method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106022210A true CN106022210A (en) | 2016-10-12 |
Family
ID=57082035
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610288717.XA Pending CN106022210A (en) | 2016-05-04 | 2016-05-04 | Vein profile three-dimensional point cloud matching identity identifying method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106022210A (en) |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107392088A (en) * | 2017-06-01 | 2017-11-24 | 燕南国创科技(北京)有限公司 | Three-dimensional vein identification device and method, switch, mobile terminal |
CN107992820A (en) * | 2017-11-29 | 2018-05-04 | 北京伟景智能科技有限公司 | Counter automatic selling method based on binocular vision |
CN108122280A (en) * | 2017-12-20 | 2018-06-05 | 北京搜狐新媒体信息技术有限公司 | The method for reconstructing and device of a kind of three-dimensional point cloud |
WO2019024321A1 (en) * | 2017-08-01 | 2019-02-07 | 南京东屋信息科技有限公司 | Finger vein image acquisition device and intelligent lock |
CN109325432A (en) * | 2018-09-13 | 2019-02-12 | 联想(北京)有限公司 | A kind of recognition methods of three dimensional object, equipment and computer-readable storage media |
CN109543591A (en) * | 2018-11-19 | 2019-03-29 | 珠海格力电器股份有限公司 | A kind of method and apparatus of three-dimensional finger venous collection |
CN110298261A (en) * | 2019-06-06 | 2019-10-01 | Oppo广东移动通信有限公司 | Vein identification method and Related product |
CN112084840A (en) * | 2020-07-24 | 2020-12-15 | 浙江工业大学 | Finger vein identification method based on three-dimensional NMI |
CN112767276A (en) * | 2021-01-26 | 2021-05-07 | 深圳瑞为智能科技有限公司 | Stereo matching method and device based on upper and lower binocular device images |
CN112907455A (en) * | 2019-12-04 | 2021-06-04 | 财团法人成大研究发展基金会 | Geometric camera correction system and method |
CN112949557A (en) * | 2021-03-24 | 2021-06-11 | 上海慧姿化妆品有限公司 | Method and system for extracting nail outline |
CN112990160A (en) * | 2021-05-17 | 2021-06-18 | 北京圣点云信息技术有限公司 | Facial vein identification method and identification device based on photoacoustic imaging technology |
CN113065566A (en) * | 2021-03-19 | 2021-07-02 | 南京天巡遥感技术研究院有限公司 | Method, system and application for removing mismatching |
CN113196284A (en) * | 2018-12-13 | 2021-07-30 | Lg 伊诺特有限公司 | Image pickup apparatus |
CN113338754A (en) * | 2021-04-21 | 2021-09-03 | 宁波金地历进出口有限公司 | Safe with biological recognition lock mechanism |
CN114841965A (en) * | 2022-04-30 | 2022-08-02 | 中建三局第一建设工程有限责任公司 | Steel structure deformation detection method and device, computer equipment and storage medium |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101866486A (en) * | 2010-06-11 | 2010-10-20 | 哈尔滨工程大学 | Finger vein image quality judging method |
CN101980243A (en) * | 2010-10-15 | 2011-02-23 | 中国人民解放军国防科学技术大学 | Binocular vision-based finger vein three-dimensional identification method and device |
CN103325143A (en) * | 2013-06-13 | 2013-09-25 | 华南理工大学 | Mark point automatic registration method based on model matching |
CN103729622A (en) * | 2013-12-24 | 2014-04-16 | 小米科技有限责任公司 | Finger vein three-dimensional point cloud obtaining method and device and terminal |
CN104217195A (en) * | 2014-08-07 | 2014-12-17 | 中国矿业大学 | A stereo imaging and recognition system for hand veins |
-
2016
- 2016-05-04 CN CN201610288717.XA patent/CN106022210A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101866486A (en) * | 2010-06-11 | 2010-10-20 | 哈尔滨工程大学 | Finger vein image quality judging method |
CN101980243A (en) * | 2010-10-15 | 2011-02-23 | 中国人民解放军国防科学技术大学 | Binocular vision-based finger vein three-dimensional identification method and device |
CN103325143A (en) * | 2013-06-13 | 2013-09-25 | 华南理工大学 | Mark point automatic registration method based on model matching |
CN103729622A (en) * | 2013-12-24 | 2014-04-16 | 小米科技有限责任公司 | Finger vein three-dimensional point cloud obtaining method and device and terminal |
CN104217195A (en) * | 2014-08-07 | 2014-12-17 | 中国矿业大学 | A stereo imaging and recognition system for hand veins |
Cited By (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018219012A1 (en) * | 2017-06-01 | 2018-12-06 | 燕南国创科技(北京)有限公司 | Three-dimensional vein identification device and method, switch, and mobile terminal |
CN107392088A (en) * | 2017-06-01 | 2017-11-24 | 燕南国创科技(北京)有限公司 | Three-dimensional vein identification device and method, switch, mobile terminal |
CN109791606A (en) * | 2017-08-01 | 2019-05-21 | 南京东屋信息科技有限公司 | Finger vein image acquisition device |
WO2019024321A1 (en) * | 2017-08-01 | 2019-02-07 | 南京东屋信息科技有限公司 | Finger vein image acquisition device and intelligent lock |
EP3663964A4 (en) * | 2017-08-01 | 2021-05-05 | Nanjing Easthouse Information Technology Co., Ltd. | Finger vein image acquisition device |
CN107992820A (en) * | 2017-11-29 | 2018-05-04 | 北京伟景智能科技有限公司 | Counter automatic selling method based on binocular vision |
CN108122280A (en) * | 2017-12-20 | 2018-06-05 | 北京搜狐新媒体信息技术有限公司 | The method for reconstructing and device of a kind of three-dimensional point cloud |
CN109325432A (en) * | 2018-09-13 | 2019-02-12 | 联想(北京)有限公司 | A kind of recognition methods of three dimensional object, equipment and computer-readable storage media |
CN109325432B (en) * | 2018-09-13 | 2021-11-16 | 联想(北京)有限公司 | Three-dimensional object identification method and equipment and computer readable storage medium |
CN109543591A (en) * | 2018-11-19 | 2019-03-29 | 珠海格力电器股份有限公司 | A kind of method and apparatus of three-dimensional finger venous collection |
CN113196284A (en) * | 2018-12-13 | 2021-07-30 | Lg 伊诺特有限公司 | Image pickup apparatus |
CN110298261A (en) * | 2019-06-06 | 2019-10-01 | Oppo广东移动通信有限公司 | Vein identification method and Related product |
CN110298261B (en) * | 2019-06-06 | 2021-06-01 | Oppo广东移动通信有限公司 | Vein identification method and related product |
CN112907455A (en) * | 2019-12-04 | 2021-06-04 | 财团法人成大研究发展基金会 | Geometric camera correction system and method |
CN112084840A (en) * | 2020-07-24 | 2020-12-15 | 浙江工业大学 | Finger vein identification method based on three-dimensional NMI |
CN112767276A (en) * | 2021-01-26 | 2021-05-07 | 深圳瑞为智能科技有限公司 | Stereo matching method and device based on upper and lower binocular device images |
CN113065566A (en) * | 2021-03-19 | 2021-07-02 | 南京天巡遥感技术研究院有限公司 | Method, system and application for removing mismatching |
CN113065566B (en) * | 2021-03-19 | 2024-01-09 | 南京天巡遥感技术研究院有限公司 | Mismatching removal method, system and application |
CN112949557A (en) * | 2021-03-24 | 2021-06-11 | 上海慧姿化妆品有限公司 | Method and system for extracting nail outline |
CN113338754A (en) * | 2021-04-21 | 2021-09-03 | 宁波金地历进出口有限公司 | Safe with biological recognition lock mechanism |
CN112990160A (en) * | 2021-05-17 | 2021-06-18 | 北京圣点云信息技术有限公司 | Facial vein identification method and identification device based on photoacoustic imaging technology |
CN114841965A (en) * | 2022-04-30 | 2022-08-02 | 中建三局第一建设工程有限责任公司 | Steel structure deformation detection method and device, computer equipment and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106022210A (en) | Vein profile three-dimensional point cloud matching identity identifying method and device | |
Cheng et al. | Appearance-based gaze estimation via evaluation-guided asymmetric regression | |
CN107609383B (en) | 3D face identity authentication method and device | |
CN107748869B (en) | 3D face identity authentication method and device | |
Elhayek et al. | Efficient convnet-based marker-less motion capture in general scenes with a low number of cameras | |
Valenti et al. | Accurate eye center location and tracking using isophote curvature | |
US9733703B2 (en) | System and method for on-axis eye gaze tracking | |
US8958608B2 (en) | Frontal view reconstruction for iris recognition | |
WO2019056988A1 (en) | Face recognition method and apparatus, and computer device | |
KR102012254B1 (en) | Method for tracking user's gaze position using mobile terminal and apparatus thereof | |
CN108985210A (en) | A kind of Eye-controlling focus method and system based on human eye geometrical characteristic | |
Liu et al. | Accurate dense optical flow estimation using adaptive structure tensors and a parametric model | |
Alt et al. | Rapid selection of reliable templates for visual tracking | |
US20220383653A1 (en) | Image processing apparatus, image processing method, and non-transitory computer readable medium storing image processing program | |
MX2012010602A (en) | Face recognizing apparatus, and face recognizing method. | |
US10909363B2 (en) | Image acquisition system for off-axis eye images | |
Lu et al. | Estimating 3D gaze directions using unlabeled eye images via synthetic iris appearance fitting | |
CN110505398A (en) | A kind of image processing method, device, electronic equipment and storage medium | |
CN110503068A (en) | Gaze estimation method, terminal and storage medium | |
Perra et al. | Adaptive eye-camera calibration for head-worn devices | |
Bastias et al. | A method for 3D iris reconstruction from multiple 2D near-infrared images | |
Strupczewski | Commodity camera eye gaze tracking | |
Hata et al. | Detection of distant eye-contact using spatio-temporal pedestrian skeletons | |
CN205594652U (en) | Vein profile recognition device | |
Sun et al. | An improved genetic algorithm for three-dimensional reconstruction from a single uniform texture image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161012 |