CN106250851B - Identity authentication method, identity authentication equipment and mobile terminal - Google Patents

Identity authentication method, identity authentication equipment and mobile terminal Download PDF

Info

Publication number
CN106250851B
CN106250851B CN201610620252.3A CN201610620252A CN106250851B CN 106250851 B CN106250851 B CN 106250851B CN 201610620252 A CN201610620252 A CN 201610620252A CN 106250851 B CN106250851 B CN 106250851B
Authority
CN
China
Prior art keywords
image
user
face
iris
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610620252.3A
Other languages
Chinese (zh)
Other versions
CN106250851A (en
Inventor
王晓鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201610620252.3A priority Critical patent/CN106250851B/en
Publication of CN106250851A publication Critical patent/CN106250851A/en
Application granted granted Critical
Publication of CN106250851B publication Critical patent/CN106250851B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Ophthalmology & Optometry (AREA)
  • Collating Specific Patterns (AREA)
  • Image Input (AREA)

Abstract

The invention discloses an identity authentication method, which comprises the following steps: acquiring a facial image of a user to be identified through a composite imaging device; detecting human eyes in the face image, and entering a face recognition mode if human eyes are detected in the second area image; judging whether the second area image meets the face recognition condition; if yes, face recognition is carried out; preliminarily judging whether the user is legal or not according to the face recognition result; if the user is judged to be a legal user preliminarily, an iris identification mode is entered; acquiring a first region image of the user including human eyes in the first region again; positioning and cutting an eye image from the first region image, and judging whether the eye image meets an iris recognition condition; if so, carrying out iris recognition; and determining whether the user is a legal user again according to the iris recognition result. The invention also discloses corresponding identity authentication equipment and a mobile terminal.

Description

Identity authentication method, identity authentication equipment and mobile terminal
Technical Field
The invention relates to the field of pattern recognition, in particular to an identity authentication technology.
Background
In recent years, with the rapid development of computer and network technologies and the improvement of living standards of people, the functions of the mobile terminal are continuously improved, namely, a user can use the mobile terminal to carry out entertainment, shopping and the like, great convenience is brought to the life of the user, but meanwhile, potential safety hazards are also continuously shown: user information is stolen maliciously, and huge potential safety hazard … … exists in mobile payment and mobile financing, so that the technology of identity authentication through biological feature recognition is widely researched and applied to mobile terminals.
Conventional biometric identification includes: fingerprint identification, face identification, iris identification, voiceprint identification and the like, wherein the face identification and the iris identification can greatly reduce the possibility that user data is maliciously stolen due to a non-contact user data acquisition mode, and are increasingly widely applied to mobile terminals. However, in later research, it was found that the biometric identification technology of single modality has certain limitations. For example, iris recognition is sensitive to the recognition distance, and the face recognition performance is susceptible to the change of ambient light. Therefore, two (or more) biological feature recognition technologies are fused on the mobile terminal to improve the accuracy and stability of recognition, and the method has important significance for ensuring the information safety of users by applying the biological feature recognition technology in the mobile internet environment.
In consideration of the recognition accuracy, the method can be realized by using an independent near-infrared camera and a common self-photographing front camera when performing multi-mode recognition on the iris and the face on the mobile terminal. In this way, the iris and face image acquisition devices are independent from each other, which results in significant increase in the design complexity and cost of hardware systems, and is not favorable for popularization of applications. Meanwhile, iris and face image acquisition devices which are independent of each other can also increase the complexity and speed of fusion of iris recognition and face recognition processes, and influence user experience.
Disclosure of Invention
To this end, the present invention provides an identity authentication method, device and mobile terminal in an attempt to solve or at least alleviate at least one of the problems presented above.
According to an aspect of the present invention, there is provided an identity authentication method, the method comprising the steps of: acquiring a facial image of a user to be identified through a composite imaging device, wherein the composite imaging device is suitable for dividing an incident light source into two groups of light with two wave bands by utilizing a filter component with regions and wave bands, and respectively imaging the light on regions corresponding to an image sensor to obtain a first region image imaged by near infrared light and a second region image imaged by visible light; detecting human eyes of the face image, and if no human eyes are detected in the first area image and the second area image, re-collecting the face image of the user; if human eyes are detected in the second area image, entering a face recognition mode; judging whether the second area image meets the face recognition condition; if the face recognition condition is met, carrying out face recognition according to the face features in the second region image; preliminarily judging whether the user is legal or not according to the face recognition result; if the user is judged to be a legal user preliminarily, an iris identification mode is entered; acquiring a first region image of the user including human eyes in a first region through a composite imaging device; positioning and cutting an eye image from the first region image, and judging whether the eye image meets an iris recognition condition; if the iris recognition condition is met, extracting iris features from the eye image to perform iris recognition; and determining the legal identity of the user again according to the iris recognition result.
Optionally, in the identity authentication method according to the present invention, after the step of detecting human eyes in the collected face image, the method further includes the steps of: if human eyes are detected in the first region image, entering an iris recognition mode; positioning and cutting an eye image from the first region image, and judging whether the eye image meets an iris recognition condition; if the iris recognition condition is met, extracting iris features from the eye image to perform iris recognition; preliminarily judging whether the user is legal or not according to the iris recognition result; if the user is judged to be a legal user preliminarily, entering a face recognition mode; acquiring a second area image of the user including human eyes in a second area through the composite imaging device; judging whether the second area image meets the face recognition condition; if the face recognition condition is met, carrying out face recognition according to the face features of the second region image; and determining the legal identity of the user again according to the face recognition result.
Optionally, in the identity authentication method according to the present invention, the step of determining whether the second area image satisfies a face recognition condition includes: extracting key points of the face in the second area image; judging whether the extracted key points of the human face contain specific key points or not; if the face identification key points contain the specific key points, counting the number of the extracted face key points, and judging whether the number meets the face identification condition; and if the face recognition condition is met, judging whether the user posture meets the face acquisition requirement according to the extracted key points, if so, carrying out face recognition, and if not, acquiring the second area image again.
Optionally, in the identity authentication method according to the present invention, the step of determining whether the eye image satisfies an iris recognition condition includes: calculating an image quality parameter of the eye image, and judging whether the image quality meets a preset condition or not; if the iris radius value and the binocular pupillary distance value meet the preset conditions, calculating the iris radius and the binocular pupillary distance in the eye image to judge whether the iris radius value and the binocular pupillary distance value meet the iris recognition conditions or not; if the iris recognition condition is met, iris recognition is carried out, and otherwise, the first region image is collected again.
Optionally, in the identity authentication method according to the present invention, the step of acquiring, by the composite imaging device, a corresponding image of the user including the human eye in the first region or the second region includes: and guiding the user to be recognized to adjust the angle or/and distance between the human face and the composite imaging device through the display adjustment signal until the human eyes are detected in the corresponding area image.
Optionally, in the identity authentication method according to the present invention, the method further includes a step of the user autonomously selecting the current recognition mode: if the current identification mode selected by the user is the iris identification mode, acquiring a first region image containing human eyes in a first region of the user by adjusting the shooting angle or/and the distance; executing a positioning judgment step and an iris identification step on the first area image so as to preliminarily judge whether the user is legal; if the user is judged to be a legal user preliminarily, entering a face recognition mode; acquiring a second area image of the user including human eyes in a second area; and executing a judging step and a face recognition step on the second area image so as to determine the legal identity of the user again.
Optionally, in the identity authentication method according to the present invention, the step of the user autonomously selecting the current recognition mode further includes: if the user selects the current identification mode as the face identification mode, acquiring a second area image containing human eyes in a second area of the user by adjusting the shooting angle or/and the distance; executing a judging step and a face recognition step on the second area image to preliminarily judge whether the user is legal; if the user is judged to be a legal user preliminarily, an iris identification mode is entered; acquiring a first region image of the user including human eyes in a first region; and executing a positioning judgment step and an iris identification step on the first area image so as to judge and determine the legal identity of the user again.
According to another aspect of the present invention, there is provided an authentication apparatus coupled with a composite image forming apparatus, the authentication apparatus including: the system comprises a receiving unit, a first image acquisition unit, a second image acquisition unit and a third image acquisition unit, wherein the receiving unit is suitable for receiving a face image of a user to be identified acquired by a composite imaging device and receiving a first region image of the user containing human eyes in a first region acquired by the composite imaging device in an iris identification mode, the first region image is obtained by dividing an incident light source into two groups of light with two wave bands by using a filter component with regions and wave bands, and the two groups of light are imaged on regions corresponding to an image sensor respectively; the human eye detection unit is suitable for detecting human eyes of the face image; the judging unit is suitable for judging whether human eyes exist in the face image, wherein if no human eyes are detected in the first area image and the second area image, the receiving unit receives the face image of the user acquired again by the composite imaging equipment, and if human eyes are detected in the second area image, the face recognition mode is entered; the positioning unit is suitable for positioning and cutting out an eye image from the first region image in an iris recognition mode; the judging unit is also suitable for judging whether the second region image meets the face recognition condition and judging whether the positioned eye image meets the iris recognition condition; the identification unit is suitable for carrying out face identification according to the face characteristics of the second region image when the face identification condition is met, and extracting iris characteristics from the eye image to carry out iris identification when the iris identification condition is met; and the authentication unit is suitable for preliminarily judging whether the user is legal or not according to the face recognition result, entering an iris recognition mode when the user is judged to be the legal user, and determining the legal identity of the user again according to the iris recognition result.
Optionally, in the identity authentication apparatus according to the present invention, the judging unit is further adapted to enter an iris recognition mode first when a human eye is detected in the first region image by the human eye detecting unit; the authentication unit is also suitable for preliminarily judging whether the user is legal or not according to the iris recognition result, and if the user is judged to be a legal user preliminarily, entering a face recognition mode; the receiving unit is further adapted to receive a second region image of the user including human eyes in a second region, which is re-acquired by the composite imaging device, in the face recognition mode; and the authentication unit is further adapted to re-determine the legal identity of the user based on the face recognition result.
Optionally, in the identity authentication apparatus according to the present invention, the judging unit includes: the feature extraction subunit is suitable for extracting the key points of the human face in the second area image; the judging subunit is suitable for judging whether the extracted face key points contain specific key points or not; the statistic subunit is suitable for counting the number of the extracted key points of the human face after judging that the key points contain the specific key points; the judging subunit is further adapted to judge whether the number meets a face recognition condition, and if so, judge whether the user posture meets a face acquisition requirement according to the extracted key points, and if so, perform face recognition, otherwise, acquire the second region image again.
Optionally, in the identity authentication apparatus according to the present invention, the determining unit further includes: the calculating subunit is suitable for calculating the image quality parameters of the eye image, the iris radius in the eye image and the distance between the two pupils; the judging subunit is further adapted to judge whether the image quality meets a preset condition, and further adapted to judge whether the iris radius value and the binocular pupillary distance value meet the iris recognition condition when the preset condition is met, and if the iris recognition condition is met, perform iris recognition, otherwise, re-acquire the first region image.
Optionally, in the identity authentication apparatus according to the present invention, further comprising: and the control unit is suitable for guiding the user to be recognized to adjust the angle or/and the distance between the human face and the composite imaging device through control signal display until the human eyes are detected in the corresponding area image.
Optionally, in the identity authentication apparatus according to the present invention, the receiving unit is further adapted to receive that the user autonomously selects the current identification mode, wherein if the user selects the current identification mode as the iris identification mode, the iris identification is performed first to perform the preliminary determination, and then the face identification is performed to determine the legal identity of the user again; if the user selects the current recognition mode as the face recognition mode, the face recognition is firstly executed for preliminary judgment, and then the iris recognition is executed for determining the legal identity of the user again.
Optionally, in the identity authentication apparatus according to the present invention, the control unit is further adapted to guide the user to be recognized to adjust the angle of the face and the composite imaging apparatus through the control signal display, so as to acquire an image meeting the requirements of the current recognition mode.
According to still another aspect of the present invention, there is provided a mobile terminal including: an identity authentication device as above; and a composite imaging device coupled with the identity authentication device, comprising: a lens assembly including a fixed focal length optical lens; the filter assembly comprises a visible light band-pass filter allowing light in a visible light band to pass through and a near infrared light band-pass region allowing light in a near infrared light band to pass through; and the image sensor comprises a visible light imaging area, a near infrared light imaging area and a transition area between the visible light imaging area and the near infrared light imaging area, wherein the visible light imaging area images visible light passing through the visible light band-pass filter in a visible light imaging mode, and the near infrared light imaging area images near infrared light passing through the near infrared light band-pass filter in a near infrared light imaging mode.
Because the image acquisition devices of the iris and the human face are independent of each other, it is difficult to simultaneously realize iris recognition and human face recognition on the mobile terminal, but as described above, the biometric feature recognition technology of a single modality has certain limitations. The existing scheme for realizing the combination of face recognition and iris recognition on the mobile terminal can only simply collect near-infrared face images and compare the near-infrared face images with a face image database and an iris image database respectively so as to finish face recognition and iris recognition. It should be understood that the face image database is generally a face image based on visible light imaging, and comparing the collected near-infrared light face image with the visible light face image in the database will inevitably reduce the accuracy of recognition.
When the steps of face recognition and iris recognition are executed, the steps of collecting images → confirming that the images meet the recognition conditions → recognizing and judging are respectively carried out, and the collected images correspond to the recognition modes: in the face recognition mode, the corresponding image is a visible light face image; in the iris recognition mode, a near-infrared eye image is corresponded. If the user is judged to be a legal user preliminarily according to the face image, then iris image acquisition is carried out, and the legal identity of the user is further determined according to the iris image. Similarly, if the legal identity of the user is preliminarily determined according to the iris image, then the face image is collected, and the legal identity of the user is further determined according to the face image. By the secondary authentication mode, the accuracy and the reliability of identification can be further improved; in addition, in terms of hardware cost, an additional camera assembly is not added, and the normal use of the mobile terminal by a user is not affected.
In addition, the scheme can also automatically select the current best biological feature recognition mode according to the imaging position of human eyes by detecting human eyes of the firstly collected facial image, and complete the identity authentication under two modes of face recognition and iris recognition according to the sequence. Specifically, if the human eye is in the visible light imaging region, the human face recognition is performed first, and then the iris recognition is performed, and if the human eye is detected to be in the near-infrared imaging region, the iris recognition is performed first, and then the human face recognition is performed. Of course, the user can also select the recognition mode autonomously according to own habits and requirements. The whole identification process is more intelligent and convenient, and good user experience is achieved while the identification accuracy is guaranteed.
Drawings
To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings, which are indicative of various ways in which the principles disclosed herein may be practiced, and all aspects and equivalents thereof are intended to be within the scope of the claimed subject matter. The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description read in conjunction with the accompanying drawings. Throughout this disclosure, like reference numerals generally refer to like parts or elements.
FIG. 1 shows a flow diagram of a method 100 of identity authentication according to one embodiment of the invention;
FIG. 2 shows a schematic diagram of a compound imaging device 200 according to one embodiment of the invention;
FIG. 3 shows three situation contrast diagrams of facial images acquired by composite imaging device 200;
FIG. 4 shows a flow diagram of a method 400 of identity authentication according to another embodiment of the invention;
FIG. 5 shows a schematic diagram of the output image of the composite imaging device 200 in the iris recognition mode;
fig. 6 shows a schematic diagram of an output image of the composite imaging device 200 in the face recognition mode;
FIG. 7 shows a block diagram of an identity authentication device 700 according to one embodiment of the present invention; and
fig. 8 shows a block diagram of an identity authentication device 700 according to a further embodiment of the invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
FIG. 1 shows a flow diagram of a method 100 for multi-biometric based identity authentication, according to one embodiment of the invention.
According to one implementation, a mobile terminal adapted to perform the method 100 includes the composite imaging device 200 implemented as a camera module, a near-infrared light source, and an identity authentication device 700, in addition to necessary configurations including a memory interface, a data processor, a central processing unit, a peripheral interface, a screen, and so on. The identity authentication device 700 is coupled to the composite imaging device 200, and is used to execute the method 100 to implement an identity authentication scheme for multi-biometric recognition.
Generally, the composite imaging device 200 is disposed at one side of the front surface of the screen of the mobile terminal, such as the top of the screen or the bottom of the screen. The near-infrared light source can comprise one or more infrared LEDs within a waveband range of 780-880nm, and optionally, the near-infrared light source is placed below a touch panel of the mobile terminal, for example, a front key bottom layer (such as a Home key bottom layer) of the mobile terminal, so that special holes do not need to be formed at other positions to influence the visual appearance.
FIG. 2 shows a schematic diagram of a compound imaging device 200 according to one embodiment of the invention. As shown in fig. 2, the composite imaging apparatus 200 includes an image sensor 210, a filter assembly 220, and a lens assembly 230. According to one embodiment of the invention, the filter assembly 220 includes a visible light band-pass filter 221 and a near infrared light band-pass filter 222 (shown filled with reverse-slanted lines); the image sensor 210 includes a first region for near infrared light imaging (shown filled with a reverse oblique line), a second region for visible light imaging, and a transition region between the first and second regions (shown filled with a transverse line).
The full spectrum light is incident through the lens assembly 230 and reaches the filter assembly 220, wherein the visible light band pass filter 221 allows visible light (e.g., 380-760nm wavelength) to pass through, and the near infrared light band pass filter 222 allows near infrared light (e.g., 780-880nm wavelength) to pass through. The visible light band pass filter 221 and the near infrared light band pass filter 222 may be implemented by plating. The visible light passing through the visible light band pass filter 221 is substantially imaged in the second area of the image sensor 210, and the near infrared light passing through the near infrared light band pass filter 222 is substantially imaged in the first area of the image sensor 210. The imaging of the first and second regions of the image sensor can be distinguished by the image processing software, respectively, wherein the imaging of the second region corresponds to normal visible light imaging, for example imaging when a user uses a mobile terminal such as a mobile phone for daily self-timer shooting, and the imaging of the first region corresponds to imaging in the near infrared mode, for example imaging when a user uses a mobile phone for iris recognition.
In step S110, a face image of the user to be recognized is captured by the composite imaging apparatus 200. As mentioned above, the captured facial image of the user includes images of both near-infrared light and visible light (since the transition region has a limited area, it mainly has an effect on visible light imaging, and this effect can be eliminated by image processing software, so the transition region imaging is not discussed here).
As shown in fig. 3, the following three situations may occur when the composite imaging device 200 captures the face image of the user, which correspond to (a), (b), and (c) in fig. 3 (each imaging region is divided into three parts, and the near infrared imaging region, the transition region, and the visible light imaging region are sequentially arranged from top to bottom):
① As in FIG. 3(a), the human eye is located in the second area image of the visible light image;
② As in FIG. 3(b), the human eye is located in the first region image of the near infrared light image;
③ As in FIG. 3(c), the human eye is not in either the first region image or the second region image.
Subsequently, in step S120, human eye detection is performed on the captured face image:
if no human eye is detected in the first area image and the second area image (i.e. the situation of ③), returning to step S110 to re-capture the facial image of the user;
if the human eye is detected in the second area image (i.e., in the case of the ①, the visible light image is obtained, and therefore, the face recognition mode is entered.
Subsequently, in step S130, in the face recognition mode, it is determined whether the second region image satisfies a face recognition condition.
Specifically, the face key points in the second region image are extracted, whether the extracted face key points include specific key points (for example, key points near the contour around the face) is judged, if the extracted face key points include the specific key points, it is indicated that a sufficient area of the face is collected, the number of the extracted face key points is counted, and when a sufficient number of feature points (namely, the face key points) for face recognition appear in the acquired face image, the face recognition condition is considered to be satisfied.
Furthermore, whether the user posture meets the face acquisition requirement can be judged according to the extracted key points, for example, the user needs to face the shot from the front, and the acquired face key points should be bilaterally symmetrical. And if the image meets the requirement of face acquisition, performing face identification, and if the image does not meet the requirement of face acquisition, returning to the step S110 to acquire the second area image again.
Subsequently, in step S140, after the second region image is determined to satisfy the face recognition condition, face recognition is performed according to the face features in the second region image. It should be noted that the present invention is not limited to the face recognition algorithm, and any face recognition algorithm may be combined with the embodiments of the present invention to complete the face recognition step.
Subsequently, in step S150, it is preliminarily determined whether the user is legitimate according to the face recognition result. That is, if the face features of the user can be matched in the registered user library, the user is preliminarily determined to be legal, otherwise, the user is illegal, and the user identity authentication is finished.
As mentioned above, the face recognition performance is susceptible to the change of ambient light and the recognition accuracy is inferior to that of iris recognition, so after the user is primarily determined to be a legal user through face recognition, further confirmation is required through iris recognition.
Subsequently, in step S160, after the user is preliminarily determined to be a valid user, the iris recognition mode is entered: a first region image of the user including human eyes in the first region is acquired by the composite imaging device 200. According to an embodiment of the present invention, the captured image is displayed on the display screen of the mobile terminal in real time, so that the user to be recognized can be guided to adjust the angle or/and distance between the face and the compound imaging device by displaying the adjustment signal on the display screen until the human eye is detected in the first area image, i.e., the imaging on the image sensor 210 is as shown in fig. 3 (b).
Subsequently, in step S170, the cropped eye image is located from the first region image, and it is determined whether the eye image satisfies the iris recognition condition.
Because the focusing and reflecting effects of the eye image are affected when the eye image is unclear, the quality of the eye image is considered in the early stage of iris recognition, namely, the image quality parameter of the eye image is calculated first, and whether the image quality meets the preset condition or not is judged. Optionally, the image quality parameters include sharpness, contrast, signal-to-noise ratio, etc. of the eye image.
Next, if the image quality meets the preset conditions, calculating the iris radius and the binocular pupillary distance in the eye image to determine whether the iris radius value and the binocular pupillary distance value meet the iris recognition conditions, if so, performing iris recognition, otherwise, returning to step S160 to re-acquire the first region image.
Subsequently, in step S180, after the first region image is determined to satisfy the iris recognition condition, iris features are extracted from the eye image of the first region image to perform iris recognition. It should be noted that the present invention is not limited to iris recognition algorithms, and any iris recognition algorithm may be combined with embodiments of the present invention to complete the iris recognition step.
Then, in step S190, the legal identity of the user is determined again according to the iris recognition result, and the result is output to end the user identity authentication. That is, if the iris feature of the user can be matched with the registered user library, it is finally confirmed that the user is legitimate.
The method 100 of user identity authentication in conjunction with face recognition and iris recognition ends. It should be understood by description that, in the method, when the steps of face recognition and iris recognition are executed, the steps of collecting an image → confirming that the image meets the recognition condition → recognizing and judging are respectively carried out, and the collected image corresponds to the recognition mode: in the face recognition mode, the corresponding image is a visible light face image; in the iris recognition mode, a near-infrared eye image is corresponded.
In the existing scheme combining face recognition and iris recognition of the mobile terminal, because the iris and the image acquisition equipment of the face are mutually independent, only near infrared face images can be simply acquired and compared with a face image database and an iris image database respectively so as to complete face recognition and iris recognition. It should be understood that the face image database is generally a face image based on visible light imaging, and comparing the near-infrared face image with the visible light face image will inevitably reduce the accuracy of recognition. Compared with the prior art, the recognition accuracy of the scheme is obviously improved.
In addition, the scheme automatically selects the current best biological feature recognition mode according to the imaging position of human eyes by detecting human eyes of the firstly collected facial image, and completes the identity authentication in two modes of face recognition and iris recognition according to the sequence. Specifically, if the human eye is in the visible light imaging region, face recognition is performed first and then iris recognition is performed (as described in method 100), and similarly, if the human eye is detected to be in the near-infrared imaging region, iris recognition is performed first and then face recognition is performed, as described in method 400 below. By the secondary authentication mode, the defect of single-mode identification can be effectively avoided, and the identification accuracy and reliability are further improved.
As shown in fig. 4, step S410 is the same as step S110, and the face image of the user is captured by the composite imaging device.
Subsequently, in step S420, when it is detected that the human eye is located in the first region image imaged by near infrared light, as shown in fig. 3(b), the iris recognition mode is entered.
Subsequently, in step S430, the cropped eye image is located from the first region image, and it is determined whether the eye image satisfies the iris recognition condition. In the same manner as described in step S170, in the determining process, it is first determined whether the image quality of the eye image meets a preset condition; and then judging whether the iris radius value and the binocular pupillary distance value meet the iris recognition condition, if so, performing iris recognition, and otherwise, returning to the step S410 to re-acquire the first region image.
Subsequently, in step S440, when the iris recognition condition is satisfied, iris features are extracted from the eye image to perform iris recognition. It should be noted that the present invention is not limited to iris recognition algorithms, and any iris recognition algorithm may be combined with embodiments of the present invention to complete the iris recognition step.
Subsequently, in step S450, it is preliminarily determined whether the user is legitimate according to the iris recognition result. If the iris characteristics of the user can be matched in the registered user (iris data) base, the user is judged to be legal preliminarily, otherwise, the user is illegal, and the user identity authentication is finished.
Similarly, after the user is preliminarily judged to be legal, face recognition is carried out on the user again to confirm the legality of the user identity again.
In step S460, if it is preliminarily determined that the user is a valid user, a face recognition mode is entered, and a second region image (an image shown in fig. 3 (a)) of the user including human eyes in the second region is acquired by the composite imaging apparatus 200. According to an embodiment of the present invention, the captured image is displayed on the display screen of the mobile terminal in real time, so that the user to be recognized can be guided to adjust the angle or/and distance between the face and the compound imaging device by displaying the adjustment signal on the display screen until the human eye is detected in the second area image, that is, the image on the image sensor 210 is as shown in fig. 3 (a).
Subsequently, in step S470, it is determined whether the second region image satisfies the face recognition condition. And a synchronization step S130, in the judgment process, extracting the face key points in the second region image, and if it is judged from the extracted face key points that the area of the acquired face is large enough and the number of the extracted key points is large enough, determining that the face recognition condition is satisfied.
Optionally, whether the user posture meets the face acquisition requirement or not can be judged according to the extracted key points. And if the requirement of the face acquisition is met, performing face recognition, and if the requirement of the face acquisition is not met, returning to the step S460 to acquire the second area image again.
Subsequently, in step S480, if the face recognition condition is satisfied, face recognition is performed according to the face feature of the second region image. It should be noted that the present invention is not limited to the face recognition algorithm, and any face recognition algorithm may be combined with the embodiments of the present invention to complete the face recognition step.
Then, in step S490, the legal identity of the user is determined again according to the face recognition result, and the result is output and the user identity authentication is ended. That is, if the face features of the user can be matched in the registered user face database, it is finally confirmed that the user is legitimate.
In this scheme, in addition to the automatic determination of the current recognition mode (and the order of the recognition modes) by detecting the positions of human eyes described in the method 100 and the method 400, the order of the recognition modes may be selected autonomously by the user.
According to one implementation mode, if the user selects the current identification mode as the iris identification mode, the adjustment signal is displayed on the display screen to guide the user to adjust the shooting angle and/or distance so as to acquire the first region image of the user including human eyes in the first region, as shown in fig. 5, the imaging region is divided into three parts, namely a near-infrared imaging region, a transition region and a visible light imaging region from top to bottom.
Next, as in the execution process of the method 400, the steps of positioning, determining, iris identifying, and the like in the iris identification mode are first performed on the first region image to preliminarily determine whether the user is legal; if the user is judged to be a legal user preliminarily, a face recognition mode is entered, a second area image of the user including human eyes in a second area is collected, and steps of judgment, face recognition and the like are carried out on the second area image so as to judge the legal identity of the user again.
According to another implementation manner, if the user selects that the current recognition mode is the face recognition mode, the adjustment signal is displayed on the display screen to guide the user to adjust the shooting angle and/or distance to acquire the second area image of the user including human eyes in the second area, as shown in fig. 6, the imaging area is divided into three parts, and the three parts are a near-infrared imaging area, a transition area and a visible light imaging area in sequence from top to bottom.
Next, as in the execution process of the method 100, the steps of determining, face recognizing, and the like in the face recognition mode are first executed on the second area image to preliminarily determine whether the user is legal; if the user is judged to be a legal user preliminarily, an iris recognition mode is entered, a first region image of the user including human eyes in a first region is collected, and the steps of positioning, judging, iris recognition and the like are carried out on the first region image, so that the legal identity of the user is judged again.
Fig. 7 shows a block diagram of a multi-biometric based identity authentication device 700 according to an embodiment of the invention. The apparatus 700 is coupled to a compound imaging apparatus 200 for performing the method 100 or the method 400.
The identity authentication apparatus 700 includes: a receiving unit 710, a human eye detecting unit 720, a judging unit 730, a positioning unit 740, an identifying unit 750, and an authenticating unit 760.
The receiving unit 710 is adapted to receive a facial image of the user to be identified acquired via the composite imaging device 200.
The human eye detection unit 720 is adapted to perform human eye detection on the face image and to perform judgment by the judgment unit 730.
The determination unit 730 is adapted to determine whether a human eye is present in the face image. As shown in fig. 3, the following three cases may occur in detecting a face image, which correspond to (a) - (c) in fig. 3, respectively:
① As in FIG. 3(a), the human eye is located in the second area image of the visible light image;
② As in FIG. 3(b), the human eye is located in the first region image of the near infrared light image;
③ As in FIG. 3(c), the human eye is not in either the first region image or the second region image.
Receiving, by the receiving unit 710, the face image of the user re-acquired by the composite imaging apparatus 200 if no human eyes are detected in both the first area image and the second area image; if human eyes are detected in the second area image, entering a face recognition mode; and if the human eyes are detected in the first area image, entering an iris recognition mode.
In the face recognition mode:
the judging unit 730 is further adapted to judge whether the second region image satisfies the face recognition condition. According to an embodiment of the present invention, the determining unit 730 includes: the system comprises a feature extraction subunit, a statistics subunit and a judgment subunit, wherein the feature extraction subunit is suitable for extracting key points of the human face in the second area image; the judging subunit is adapted to judge whether the extracted face key points include specific key points; the counting subunit is suitable for counting the number of the extracted key points of the human face after judging that the specific key points are included; the judging subunit is further adapted to judge whether the number meets a face recognition condition, and if so, judge whether the user posture meets a face acquisition requirement according to the extracted key points, and if so, perform face recognition, otherwise, acquire the second region image again.
The recognition unit 750 is adapted to perform face recognition according to the face features of the second region image when the face recognition condition is satisfied.
The authentication unit 760 is adapted to preliminarily determine whether the user is legitimate according to the face recognition result, and enter an iris recognition mode when the user is determined to be a legitimate user.
In the iris recognition mode:
the receiving unit 710 is further adapted to receive a first area image acquired by the composite imaging device 200 of the user comprising human eyes in the first area.
The positioning unit 740 is adapted to position the cropped eye image from the first region image.
Then, the determining unit 730 determines whether the eye image obtained by positioning satisfies the iris recognition condition. According to an embodiment of the present invention, the determining unit 730 further includes a calculating subunit adapted to calculate an image quality parameter of the eye image, an iris radius in the eye image, and a binocular pupillary distance, in addition to the above-mentioned feature extracting subunit, the statistics subunit, and the determining subunit; and then the judging subunit judges whether the image quality meets a preset condition, judges whether the iris radius value and the binocular pupillary distance value meet the iris recognition condition when the image quality meets the preset condition, performs iris recognition if the iris recognition condition is met, and otherwise acquires the first region image again.
The recognition unit 750 is adapted to extract iris features from the eye image and perform iris recognition when the iris recognition conditions are satisfied.
Finally, the authentication unit 760 determines the legal identity of the user again according to the iris recognition result.
As described in the method 400, if the human eye detection unit 720 detects a human eye in the first region image, the determination unit 730 determines that the iris recognition mode is entered first. At this time, the authentication unit 760 is adapted to preliminarily determine whether the user is legal according to the iris recognition result, and enter a face recognition mode if the user is preliminarily determined to be a legal user. The receiving unit 710 is further adapted to receive, in the face recognition mode, a second region image of the user including human eyes in a second region, which is re-acquired by the composite imaging apparatus 200, and finally determine the legitimate identity of the user again from the face recognition result by the authentication unit 760.
According to one implementation, the identity authentication device 700 may comprise a control unit 770 in addition to the above-described units, as shown in fig. 8. When the receiving unit 710 needs to re-receive the first region image or the second region image re-acquired by the composite imaging device 200, the control unit 770 is adapted to guide the user to be recognized to adjust the angle or/and distance of the face and the composite imaging device 200 by controlling the display signal on the display screen of the mobile terminal until the human eye is detected in the corresponding region image.
According to an embodiment of the present invention, in addition to the automatic selection of the current recognition mode according to the human eye imaging position by the apparatus 700, the current recognition mode autonomously selected by the user may be received by the receiving unit 710.
For example, if the user selects the current recognition mode as the iris recognition mode, the control unit 770 guides the user to be recognized to adjust the angle and/or distance between the face and the composite imaging device through the control signal display so as to acquire an image meeting the requirement of the iris recognition mode, as shown in fig. 5. Then, the primary judgment is firstly carried out in the iris recognition mode, and then the user identity is determined again in the face recognition mode.
For another example, if the user selects the current recognition mode as the face recognition mode, the control unit 770 guides the user to be recognized to adjust the angle and/or distance between the face and the composite imaging device through the control signal display, so as to acquire an image meeting the requirements of the face recognition mode, as shown in fig. 6. Then, whether the user is legal or not is preliminarily judged in the face recognition mode, and then the legal identity of the user is determined again in the iris recognition mode.
It should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules or units or components of the devices in the examples disclosed herein may be arranged in a device as described in this embodiment or alternatively may be located in one or more devices different from the devices in this example. The modules in the foregoing examples may be combined into one module or may be further divided into multiple sub-modules.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
A6, the method of any one of A1-5, further comprising the step of the user autonomously selecting a current recognition mode: if the current identification mode selected by the user is the iris identification mode, acquiring a first region image containing human eyes in a first region of the user by adjusting the shooting angle or/and the distance; executing a positioning judgment step and an iris identification step on the first area image so as to preliminarily judge whether the user is legal; if the user is judged to be a legal user preliminarily, entering a face recognition mode; acquiring a second area image of the user including human eyes in a second area; and executing the judging step and the face recognition step on the second area image to determine the legal identity of the user again. A7, the method of a6, wherein the step of the user autonomously selecting the current recognition mode further comprises: if the user selects the current identification mode as the face identification mode, acquiring a second area image containing human eyes in a second area of the user by adjusting the shooting angle or/and the distance; executing a judging step and a face recognition step on the second area image to preliminarily judge whether the user is legal; if the user is judged to be a legal user preliminarily, an iris identification mode is entered; acquiring a first region image of the user including human eyes in a first region; and executing the positioning judgment step and the iris recognition step on the first area image so as to determine the legal identity of the user again.
B12, the apparatus of any one of B8-11, further comprising: and the control unit is suitable for guiding the user to be recognized to adjust the angle or/and the distance between the human face and the composite imaging device through control signal display until the human eyes are detected in the corresponding area image. B13, the device according to any one of B8-12, wherein the receiving unit is further adapted to receive a user's own selection of a current recognition mode, wherein if the user selects the current recognition mode as the iris recognition mode, the iris recognition is performed first for preliminary judgment, and then the face recognition is performed to determine the legal identity of the user again; if the user selects the current recognition mode as the face recognition mode, the face recognition is firstly executed for preliminary judgment, and then the iris recognition is executed for determining the legal identity of the user again. B14, the device as in B13, wherein the control unit is further adapted to guide the user to be recognized to adjust the angle of the face and the compound imaging device by controlling the signal display to acquire an image that meets the requirements of the current recognition mode.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
Furthermore, some of the described embodiments are described herein as a method or combination of method elements that can be performed by a processor of a computer system or by other means of performing the described functions. A processor having the necessary instructions for carrying out the method or method elements thus forms a means for carrying out the method or method elements. Further, the elements of the apparatus embodiments described herein are examples of the following apparatus: the apparatus is used to implement the functions performed by the elements for the purpose of carrying out the invention.
As used herein, unless otherwise specified the use of the ordinal adjectives "first", "second", "third", etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense, and the scope of the present invention is defined by the appended claims.

Claims (15)

1. An identity authentication method based on multi-biometric identification, the method being adapted to be executed in a mobile terminal, the method comprising the steps of:
the method comprises the steps that a composite imaging device residing in the mobile terminal is used for collecting facial images of a user to be identified, wherein the composite imaging device comprises an image sensor, a filter assembly and a lens assembly, the filter assembly comprises a visible light band-pass filter and a near infrared light band-pass filter, the image sensor comprises a first area for near infrared light imaging and a second area for visible light imaging, when full-spectrum light rays are incident to penetrate through the lens assembly and reach the filter assembly, the near infrared light band-pass filter allows near infrared light to pass through, the visible light band-pass filter allows visible light to pass through, the near infrared light passing through the near infrared light band-pass filter is imaged in the first area of the image sensor, the visible light passing through the visible light band-pass filter is imaged in the second area of the image sensor, and image processing software is used for respectively imaging the first area, the second area and the first area and the, The imaging area of the second area is separated, and a first area image imaged by near infrared light and a second area image imaged by visible light are obtained;
detecting human eyes of the facial image, and if no human eyes are detected in the first area image and the second area image, re-acquiring the facial image of the user;
if human eyes are detected in the second area image, entering a face recognition mode;
judging whether the second area image meets the face recognition condition;
if the face recognition condition is met, carrying out face recognition according to the face features in the second region image;
preliminarily judging whether the user is legal or not according to the face recognition result;
if the user is judged to be a legal user preliminarily, an iris identification mode is entered;
acquiring a first region image of the user including human eyes in a first region through the composite imaging device;
positioning and cutting an eye image from the first region image, and judging whether the eye image meets an iris recognition condition;
if the iris recognition condition is met, extracting iris features from the eye image to perform iris recognition; and
and determining the legal identity of the user again according to the iris recognition result.
2. The method as claimed in claim 1, wherein the step of detecting human eyes of the collected face image further comprises the steps of:
if human eyes are detected in the first region image, entering an iris recognition mode;
positioning and cutting an eye image from the first region image, and judging whether the eye image meets an iris recognition condition;
if the iris recognition condition is met, extracting iris features from the eye image to perform iris recognition;
preliminarily judging whether the user is legal or not according to the iris recognition result;
if the user is judged to be a legal user preliminarily, entering a face recognition mode;
acquiring a second area image of the user including human eyes in a second area through the composite imaging device;
judging whether the second area image meets the face recognition condition;
if the face recognition condition is met, carrying out face recognition according to the face features of the second region image; and
and determining the legal identity of the user again according to the face recognition result.
3. The method according to claim 1 or 2, wherein the step of judging whether the second region image satisfies the face recognition condition comprises:
extracting key points of the face in the second area image;
judging whether the extracted key points of the human face contain specific key points or not;
if the face identification key points contain the specific key points, counting the number of the extracted face key points, and judging whether the number meets the face identification condition;
and if the face recognition condition is met, judging whether the user posture meets the face acquisition requirement according to the extracted key points, if so, carrying out face recognition, and if not, acquiring the second area image again.
4. The method of claim 3, wherein the determining whether the eye image satisfies the iris recognition condition comprises:
calculating an image quality parameter of the eye image, and judging whether the image quality meets a preset condition or not;
if the iris radius value and the binocular pupillary distance value meet the preset conditions, calculating the iris radius and the binocular pupillary distance in the eye image to judge whether the iris radius value and the binocular pupillary distance value meet the iris recognition conditions or not;
if the iris recognition condition is met, iris recognition is carried out, and otherwise, the first region image is collected again.
5. The method of claim 4, wherein the step of acquiring, by the composite imaging device, corresponding images of the user's eyes in the first or second regions comprises:
and guiding the user to be recognized to adjust the angle or/and distance between the human face and the composite imaging device through the display adjustment signal until the human eyes are detected in the corresponding area image.
6. The method of claim 5, further comprising the step of the user autonomously selecting the current recognition mode:
if the current identification mode selected by the user is the iris identification mode, acquiring a first region image containing human eyes in a first region of the user by adjusting the shooting angle or/and the distance;
executing the positioning judgment step and the iris identification step on the first area image to preliminarily judge whether the user is legal or not;
if the user is judged to be a legal user preliminarily, entering a face recognition mode;
acquiring a second area image of the user including human eyes in a second area; and
and executing the judging step and the face recognition step on the second area image to determine the legal identity of the user again.
7. The method of claim 6, wherein the step of the user autonomously selecting the current recognition mode further comprises:
if the user selects the current identification mode as the face identification mode, acquiring a second area image containing human eyes in a second area of the user by adjusting the shooting angle or/and the distance;
executing the judging step and the face recognition step on the second area image to preliminarily judge whether the user is legal or not;
if the user is judged to be a legal user preliminarily, an iris identification mode is entered;
acquiring a first region image of the user including human eyes in a first region; and
and executing the positioning judgment step and the iris recognition step on the first area image so as to determine the legal identity of the user again.
8. An identity authentication device based on multi-biometric recognition, the identity authentication device residing in a mobile terminal and coupled with a composite imaging device, the identity authentication device comprising:
a receiving unit adapted to receive a face image of a user to be recognized acquired via the composite imaging device and, in an iris recognition mode, a first region image of the user including human eyes in a first region acquired by the composite imaging device,
wherein the composite imaging device comprises an image sensor, a filter component and a lens component, the filter component comprises a visible light band-pass filter and a near infrared light band-pass filter, the image sensor comprises a first area for near infrared light imaging and a second area for visible light imaging, when full spectrum light is incident, passes through the lens assembly and reaches the optical filter assembly, the near infrared light band-pass filter allows near infrared light to pass through, the visible light band-pass filter allows visible light to pass through, near infrared light passing through the near infrared light band-pass filter is imaged in a first area of the image sensor, imaging the visible light passing through the visible light band-pass filter in a second area of the image sensor, and distinguishing the imaging areas of the first area and the second area of the image sensor by using image processing software to obtain a first area image imaged by near infrared light and a second area image imaged by the visible light;
a human eye detection unit adapted to perform human eye detection on the face image;
a judging unit adapted to judge whether or not a human eye is present in the face image, wherein,
receiving, by the receiving unit, a face image of the user re-captured by a composite imaging device if no human eye is detected in either the first region image or the second region image,
if human eyes are detected in the second area image, entering a face recognition mode;
the positioning unit is suitable for positioning and cutting out an eye image from the first region image in an iris recognition mode;
the judging unit is also suitable for judging whether the second region image meets the face recognition condition and judging whether the positioned eye image meets the iris recognition condition;
the identification unit is suitable for carrying out face identification according to the face features of the second region image when a face identification condition is met, and extracting iris features from the eye image to carry out iris identification when the iris identification condition is met; and
and the authentication unit is suitable for preliminarily judging whether the user is legal or not according to the face recognition result, entering an iris recognition mode when the user is judged to be the legal user, and determining the legal identity of the user again according to the iris recognition result.
9. The apparatus of claim 8, wherein,
the judging unit is also suitable for entering an iris recognition mode when the human eyes are detected in the first area image through the human eye detecting unit;
the authentication unit is also suitable for preliminarily judging whether the user is legal or not according to the iris recognition result, and if the user is judged to be a legal user preliminarily, entering a face recognition mode;
the receiving unit is further adapted to receive a second region image of the user including human eyes in a second region, which is re-acquired by the composite imaging device, in the face recognition mode; and
the authentication unit is further adapted to re-determine the legal identity of the user based on the face recognition result.
10. The apparatus of claim 8 or 9, wherein the judging unit comprises:
the feature extraction subunit is suitable for extracting the key points of the human face in the second area image;
the judging subunit is suitable for judging whether the extracted face key points contain specific key points or not;
the statistic subunit is suitable for counting the number of the extracted key points of the human face after judging that the key points contain the specific key points;
the judging subunit is further adapted to judge whether the number meets a face recognition condition, and if so, judge whether the user posture meets a face acquisition requirement according to the extracted key points, and if so, perform face recognition, otherwise, acquire the second region image again.
11. The apparatus of claim 10, wherein the judging unit further comprises:
the calculating subunit is suitable for calculating the image quality parameters of the eye image, the iris radius in the eye image and the distance between the two pupils;
the judging subunit is further adapted to judge whether the image quality meets a preset condition, and further adapted to judge whether the iris radius value and the binocular pupillary distance value meet the iris recognition condition when the preset condition is met, and if the iris recognition condition is met, perform iris recognition, otherwise, re-acquire the first region image.
12. The apparatus of claim 11, further comprising:
and the control unit is suitable for guiding the user to be recognized to adjust the angle or/and the distance between the human face and the composite imaging device through control signal display until the human eyes are detected in the corresponding area image.
13. The apparatus of claim 12, wherein,
the receiving unit is further adapted to receive a user autonomous selection of a current recognition mode, wherein,
if the user selects the current identification mode as the iris identification mode, firstly executing iris identification for preliminary judgment, then executing face identification for determining the legal identity of the user again;
if the user selects the current recognition mode as the face recognition mode, the face recognition is firstly executed for preliminary judgment, and then the iris recognition is executed for determining the legal identity of the user again.
14. The apparatus of claim 13, wherein,
the control unit is also suitable for guiding the user to be recognized to adjust the angle of the human face and the compound imaging equipment through control signal display so as to acquire an image meeting the requirement of the current recognition mode.
15. A mobile terminal, comprising:
an identity authentication device as claimed in any one of claims 8 to 14; and
a composite imaging device coupled with the identity authentication device, comprising:
a lens assembly including a fixed focal length optical lens;
the filter assembly comprises a visible light band-pass filter allowing light in a visible light band to pass through and a near infrared light band-pass region allowing light in a near infrared light band to pass through; and
an image sensor comprising a visible light imaging region, a near infrared light imaging region, and a transition region between the two regions,
the visible light imaging area images visible light passing through the visible light band-pass filter in the visible light imaging mode, and the near infrared light imaging area images near infrared light passing through the near infrared light band-pass filter in the near infrared light imaging mode.
CN201610620252.3A 2016-08-01 2016-08-01 Identity authentication method, identity authentication equipment and mobile terminal Active CN106250851B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610620252.3A CN106250851B (en) 2016-08-01 2016-08-01 Identity authentication method, identity authentication equipment and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610620252.3A CN106250851B (en) 2016-08-01 2016-08-01 Identity authentication method, identity authentication equipment and mobile terminal

Publications (2)

Publication Number Publication Date
CN106250851A CN106250851A (en) 2016-12-21
CN106250851B true CN106250851B (en) 2020-03-17

Family

ID=57605758

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610620252.3A Active CN106250851B (en) 2016-08-01 2016-08-01 Identity authentication method, identity authentication equipment and mobile terminal

Country Status (1)

Country Link
CN (1) CN106250851B (en)

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110114777B (en) * 2016-12-30 2023-10-20 托比股份公司 Identification, authentication and/or guidance of a user using gaze information
CN106845454B (en) * 2017-02-24 2018-12-07 张家口浩扬科技有限公司 A kind of method of image output feedback
CN106971159A (en) * 2017-03-23 2017-07-21 中国联合网络通信集团有限公司 A kind of image definition recognition methods, identity identifying method and device
CN107016761A (en) * 2017-04-17 2017-08-04 合肥酷庆信息科技有限公司 A kind of cell gate disabling intelligence control system based on recognition of face
CN107222738A (en) * 2017-06-22 2017-09-29 浙江大华技术股份有限公司 A kind of video formats determine method and device
CN108229383A (en) * 2017-12-29 2018-06-29 上海爱优威软件开发有限公司 A kind of iris wiring method and system
CN107402787B (en) * 2017-07-14 2020-07-07 Oppo广东移动通信有限公司 Iris recognition mode starting method and related product
CN109426769A (en) * 2017-08-24 2019-03-05 合肥虹慧达科技有限公司 The iris identification method and iris authentication system of face auxiliary
CN107481380B (en) * 2017-08-30 2023-07-18 宜昌市微特电子设备有限责任公司 Lifting safety monitoring system with face and fingerprint biological feature recognition and control method thereof
CN107506752A (en) * 2017-09-18 2017-12-22 艾普柯微电子(上海)有限公司 Face identification device and method
CN110047211A (en) * 2018-01-15 2019-07-23 沅圣科技股份有限公司 Intelligence takes object cabinet management method
CN108376434B (en) * 2018-02-22 2020-12-25 深圳市华科智能信息有限公司 Intelligent home control system based on Internet of things
CN110197098A (en) * 2018-02-26 2019-09-03 上海聚虹光电科技有限公司 Identity identifying method based on face and iris feature
CN108628448B (en) 2018-04-12 2019-12-06 Oppo广东移动通信有限公司 screen lightening method and device, mobile terminal and storage medium
CN109190509B (en) 2018-08-13 2023-04-25 创新先进技术有限公司 Identity recognition method, device and computer readable storage medium
CN109447006A (en) * 2018-11-01 2019-03-08 北京旷视科技有限公司 Image processing method, device, equipment and storage medium
CN109753926A (en) * 2018-12-29 2019-05-14 深圳三人行在线科技有限公司 A kind of method and apparatus of iris recognition
CN109886240A (en) * 2019-03-01 2019-06-14 厦门狄耐克智能科技股份有限公司 A kind of building talkback gateway machine face identification mechanism
CN109934143A (en) * 2019-03-04 2019-06-25 深圳三人行在线科技有限公司 A kind of method and apparatus of the detection of iris image Sino-U.S. pupil
CN110166746A (en) * 2019-04-30 2019-08-23 深圳慧安康科技有限公司 Wisdom Lou Dong robot and the method for community information publication
CN110458034A (en) * 2019-07-17 2019-11-15 江西拓世智能科技有限公司 A kind of identity control methods based on face and iris recognition
CN110427740B (en) * 2019-07-30 2021-06-15 深圳市智微智能软件开发有限公司 Encryption system
CN110619273B (en) * 2019-08-14 2023-10-31 张杰辉 Efficient iris recognition method and recognition device
CN110717463A (en) * 2019-10-12 2020-01-21 深圳芯启航科技有限公司 Non-contact type biological identification method and device
CN112711964A (en) * 2019-10-24 2021-04-27 上海宗保科技有限公司 Face tracking monitoring system and method
CN111931692A (en) * 2020-08-31 2020-11-13 青岛聚看云科技有限公司 Display device and image recognition method
CN113468961A (en) * 2021-05-28 2021-10-01 郑州轻工业大学 Image information processing method and system for specific object

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8306279B2 (en) * 2008-09-15 2012-11-06 Eyelock, Inc. Operator interface for face and iris recognition devices
CN103870805A (en) * 2014-02-17 2014-06-18 北京释码大华科技有限公司 Mobile terminal biological characteristic imaging method and device
CN104850842A (en) * 2015-05-21 2015-08-19 北京中科虹霸科技有限公司 Mobile terminal iris identification man-machine interaction method
CN105187726A (en) * 2015-06-17 2015-12-23 广州市巽腾信息科技有限公司 Multifunctional mobile image processing device, processing method of utilizing multifunctional mobile image processing device, and use of multifunctional mobile image processing device
CN105554385A (en) * 2015-12-18 2016-05-04 天津中科智能识别产业技术研究院有限公司 Remote multimode biometric recognition method and system thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8306279B2 (en) * 2008-09-15 2012-11-06 Eyelock, Inc. Operator interface for face and iris recognition devices
CN103870805A (en) * 2014-02-17 2014-06-18 北京释码大华科技有限公司 Mobile terminal biological characteristic imaging method and device
CN104850842A (en) * 2015-05-21 2015-08-19 北京中科虹霸科技有限公司 Mobile terminal iris identification man-machine interaction method
CN105187726A (en) * 2015-06-17 2015-12-23 广州市巽腾信息科技有限公司 Multifunctional mobile image processing device, processing method of utilizing multifunctional mobile image processing device, and use of multifunctional mobile image processing device
CN105554385A (en) * 2015-12-18 2016-05-04 天津中科智能识别产业技术研究院有限公司 Remote multimode biometric recognition method and system thereof

Also Published As

Publication number Publication date
CN106250851A (en) 2016-12-21

Similar Documents

Publication Publication Date Title
CN106250851B (en) Identity authentication method, identity authentication equipment and mobile terminal
US7130453B2 (en) Eye position detection method and device
US10127439B2 (en) Object recognition method and apparatus
KR100939856B1 (en) Personal authentication method and device
CN103106401B (en) Mobile terminal iris recognition device with human-computer interaction mechanism
US20050084137A1 (en) System and method for iris identification using stereoscopic face recognition
US9336438B2 (en) Iris cameras
US11006864B2 (en) Face detection device, face detection system, and face detection method
CN104933344A (en) Mobile terminal user identity authentication device and method based on multiple biological feature modals
CN111226212A (en) Augmented reality virtual reality non-contact palmprint recognition
CN101814130A (en) Iris identification device by using camera array and multimodal biometrics identification method
KR101014325B1 (en) Face recognition system and method using the infrared rays
WO2016010720A1 (en) Multispectral eye analysis for identity authentication
EP2548154A2 (en) Object detection and recognition under out of focus conditions
JP3586456B2 (en) Personal authentication method and personal authentication device
CN101131727B (en) Image collecting method and its application
CN204791017U (en) Mobile terminal users authentication device based on many biological characteristics mode
CN105119723A (en) Identity authentication and authorization method based on human eye recognition
JP3808014B2 (en) Eye image pickup device and individual authentication device
KR20220052828A (en) Biometric authentication apparatus and biometric authentication method
KR101596363B1 (en) Access Control Apparatus and Method by Facial Recognition
KR101053253B1 (en) Apparatus and method for face recognition using 3D information
CN109492455A (en) Live subject detection and identity identifying method, medium, system and relevant apparatus
US20170024603A1 (en) Biometric image optimization using light fields
KR101336834B1 (en) Usb iris recognition device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Wang Xiaopeng

Inventor before: Wang Xiaopeng

Inventor before: Deng Xiang

CB03 Change of inventor or designer information
GR01 Patent grant
GR01 Patent grant