AU2007223336B2 - A combined face and iris recognition system - Google Patents
A combined face and iris recognition system Download PDFInfo
- Publication number
- AU2007223336B2 AU2007223336B2 AU2007223336A AU2007223336A AU2007223336B2 AU 2007223336 B2 AU2007223336 B2 AU 2007223336B2 AU 2007223336 A AU2007223336 A AU 2007223336A AU 2007223336 A AU2007223336 A AU 2007223336A AU 2007223336 B2 AU2007223336 B2 AU 2007223336B2
- Authority
- AU
- Australia
- Prior art keywords
- iris
- camera
- view
- field
- subjects
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 210000000554 iris Anatomy 0.000 claims description 95
- 238000012545 processing Methods 0.000 claims description 24
- 238000000034 method Methods 0.000 claims description 17
- 238000005286 illumination Methods 0.000 claims description 9
- 210000000887 face Anatomy 0.000 claims description 8
- 230000007246 mechanism Effects 0.000 claims description 5
- 102100028572 Disabled homolog 2 Human genes 0.000 claims 2
- 101710197163 Disabled homolog 2 Proteins 0.000 claims 2
- 230000008569 process Effects 0.000 description 10
- 238000001514 detection method Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 210000003128 head Anatomy 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 238000012913 prioritisation Methods 0.000 description 3
- 230000000903 blocking effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 210000000744 eyelid Anatomy 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 102100031554 Double C2-like domain-containing protein alpha Human genes 0.000 description 1
- 101000866272 Homo sapiens Double C2-like domain-containing protein alpha Proteins 0.000 description 1
- 206010065042 Immune reconstitution inflammatory syndrome Diseases 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/147—Details of sensors, e.g. sensor lenses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/17—Image acquisition using hand-held instruments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/255—Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Ophthalmology & Optometry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Vascular Medicine (AREA)
- Collating Specific Patterns (AREA)
- Image Input (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Description
WO 2007/103833 PCT/US2007/063242 A COMBINED FACE AND IRIS RECOGNITION SYSTEM This application claims the benefit of U.S. Provisional Application No. 60/778,770, filed March 3, 5 2006. This application claims the benefit of U.S. Provisional Application No. 60/807,046, filed July 11, 2006. This application is a continuation-in-part of U.S. 10 Patent Application No. 11/275,703, filed January 25, 2006, which claims the benefit of U.S. Provisional Application No. 60/647,270, filed January 26, 2005. This application is a continuation-in-part of U.S. Patent Application No. 11/043,366, filed January 26, 15 2005. This application is a continuation-in-part of U.S. Patent Application No. 11/372,854, filed March 10, 2006. This application is a continuation-in-part of U.S. Patent Application No. 10/979,129, filed November 3, 20 2004, which is a continuation-in-part of U.S. Patent Application 10/655,124, filed September 5, 2003. This application is a continuation-in-part of U.S. Patent Application 11/382,373, filed May 9, 2006. This application is a continuation-in-part of U.S. 25 Patent Application No. 11/672,108, filed February 7, 2007. This application is a continuation-in-part of U.S. Patent Application No. 11/675,424, filed February 15, 2007. 30 This application is a continuation-in-part of U.S. Patent Application No. 11/681,614, filed March 2, 2007. This application is a continuation-in-part of U.S. Patent Application No. 11/681,662, filed March 2, 2007. This application is a continuation-in-part of U.S. 35 Patent Application No. 11/681,751, filed March 2, 2007, Attorney Docket.
WO 2007/103833 PCT/US2007/063242 This application is a continuation-in-part of U.S. Patent Application No. 11/681,470, filed March 2, 2007. This application is a continuation-in-part of U.S. Patent Application No. 11/681,505, filed March 2, 2007. 5 This application is a continuation-in-part of U.S. Patent Application No. 11/681,251, filed March 2, 2007, which claims the benefit of U.S. Provisional Application 60/807,046, filed July 11, 2006. The government may have rights in the present 10 invention. Background The present invention pertains to recognition systems and particularly to biometric recognition 15 systems. More particularly, the invention pertains to combination face and iris recognition systems. U.S. Provisional Application No. 60/778,770, filed March 3, 2006, is hereby incorporated by reference. U.S. Provisional Application No. 60/807,046, filed 20 July 11, 2006, is hereby incorporated by reference. U.S. Patent Application No. 11/275,703, filed January 25, 2006, is hereby incorporated by reference. U.S. Provisional Application No. 60/647,270, filed January 26, 2005, is hereby incorporated by reference. 25 U.S. Patent Application No. 10/979,129, filed November 3, 2004, is hereby incorporated by reference. U.S. Patent Application 10/655,124, filed September 5, 2003, is hereby incorporated by reference. U.S. Patent Application 11/382,373, filed May 9, 30 2006, is hereby incorporated by reference. U.S. Patent Application No. 11/043,366, filed January 26, 2005, is hereby incorporated by reference. U.S. Patent Application No. 11/372,854, filed March 10, 2006, is hereby incorporated by reference. 35 U.S. Patent Application No. 11/672,108, filed February 7, 2007, is hereby incorporated by reference. 2 C:\NRPonbl\DCC\MAS\3455(91 DOC-2A/21ilI -3 U.S. Patent Application No. 11/675,424, filed February 15, 2007, is hereby incorporated by reference. U.S. Patent Application No. 11/681,614, filed March 2, 2007, is hereby incorporated by reference. 5 U.S. Patent Application No. 11/681,662, filed March 2, 2007, is hereby incorporated by reference. U.S. Patent Application No. 11/681,751, filed March 2, 2007, Attorney Docket No. 1100.1449101, is hereby incorporated by reference. 10 U.S. Patent Application No. 11/681,470, filed March 3, 2007, Attorney Docket No. 1100.1450101, is hereby incorporated by reference. U.S. Patent Application No. 11/681,505, filed March 3, 2007, is hereby incorporated by reference. 15 U.S. Patent Application No. 11/681,251, filed March 3, 2007, is hereby incorporated by reference. Summary According to the present invention there is provided a 20 subject recognition system comprising: a wide field-of-view camera; a medium field of view camera; a narrow field of view camera; and a processing system configured to receive image 25 information from the wide field-of-view, medium field of view, and narrow field of view cameras, the processing system being configured to perform recognition processing on image information from the wide field-of-view, medium field of view, and narrow field of view cameras. 30 C:\NRPonbl\DCC\MAS45569 1.DOC2A/20I I -3A The present invention also provides a method of detecting and recognizing subject, comprising: detecting one or more subjects in a scene with a wide field-of-view camera; 5 acquiring face images of the one or more subjects with a medium field-of-view camera; acquiring iris images of the one or more subjects with a narrow field-of-view camera; matching face images to stored faces in a database; and 10 matching iris images to iris images in a database. Brief Description of the Drawing Figure 1 is a diagram of a combined face and iris recognition system; 15 Figure 2 is a diagram of an approach for the face and iris recognition system; Figure 3 is a block diagram of the recognition system; Figure 4 is an illustration of some of the hardware that might be used for the recognition system; and 20 Figures 5a, 5b and Sc illustrate the enclosure and display for the recognition system. Description The present system may relate to biometrics, face WO 2007/103833 PCT/US2007/063242 and iris recognition systems, image metrics, authentication, access control, monitoring, identification, and security and surveillance systems. Some potential applications for the present system 5 may include airport access control to secure areas, airport trusted traveler systems, border control--watch list surveillance, industrial access control, outdoor facility access control, military checkpoint surveillance, critical infrastructure 10 Due to world wide increased security concerns there is a need to have the ability to accurately identify individuals at a distance. In some applications, it is essential to collect multimodal biometrics of multiple subjects standing or walking in an area. Among the 15 various biometrics available nowadays for recognizing people, iris-based biometrics is the most accurate method for identifying people. There may be a present multimodal biometrics system relying on face and iris for guarantying high recognition rate in most challenging 20 cases. The use of face and iris may improve the overall accuracy of the system. The human iris may provide a robust biometrics signature; however, collecting iris information from a distance appears challenging for several reasons. People may be in arbitrary places in 25 the environment; people might not be looking straight into the device; people's head poses might be arbitrary; people's eyelids might occlude part of the iris signature and therefore provide a partial biometrics; and finally, people might be freely moving in the environment 30 monitored by the present apparatus. Stand-off iris acquisition may also address challenging problems related to imaging the irises with sufficient resolution required for inferring a robust signature. Furthermore, a robust iris signature may be present at just a near infrared 35 wavelength, requiring the use of a sensor capable of measuring such wavelengths, and the use of a near 4 WO 2007/103833 PCT/US2007/063242 infrared illuminator to guarantee good imaging conditions. Iris recognition may have high accuracy in identifying humans. Iris recognition systems may also 5 have suitability, as an exceptionally accurate biometric can be derived from its extremely data-rich physical structure, stability over time, and non-contact acquisition. Related art iris recognition systems may require users to be within a few inches of the sensor and 10 look directly into the sensor, or towards a specific area. The present system does not necessarily have such a requirement. The present invention and system may use commercial off the shelf (COTS) face recognition technology combined 15 with custom iris processing algorithms to accurately recognize subjects based on the face and iris at distances significantly greater than a few inches. The present combined face and iris recognition system (CFAIRS) may perform automatic illumination, detection, 20 acquisition and recognition of faces and irises at ranges out to five meters (over 16 feet). The system may also automatically recognize multiple subjects standing in a scene, and optionally enroll any subjects not previously seen in a database. 25 Relative to the operation of the system, there may be a stationary wide field of view COTS stereo camera 11 for initial subject detection (Figure 1). It may then use a pan-tilt-zoom (PTZ) COTS medium field of view camera 17 to zoom in and acquire the face of each subject 30 within the field of view of camera 11. The acquired faces may be sent to a COTS face processing software package for recognition, such as with processors 18 and 29. In parallel, a modified PTZ COTS narrow field of view camera 22 may acquire images of the irises for each 35 of the subjects. The system may use modified COTS flash 5 WO 2007/103833 PCT/US2007/063242 flood illuminators 26 with a controller 27 to control the amount of illumination on a subject. The acquired iris images may be processed for inferring a signature allowing recognition of a person. 5 Various processing might be required for inferring such signature from an image such as pupil detection, iris segmentation, feature extraction and signature matching software. These processing steps might be optimized for irises acquired at a distance where off-axis gaze and 10 eyelid occlusions are common. The iris processing software may be specifically designed to deal with untrained or unaware users, dealing with issues such as off-axis gaze and partial occlusions of the iris due to half-way closed eyes. 15 Figure 1 is a diagram of the present combined face and iris recognition system 10. The system may have a wide field of view (WFOV) camera 11 for surveillance of a scene having one or more subjects of interest, such as people. Camera 11 might be a wide angle stereo camera 20 for providing distance to the targets or subjects of interest. Camera 11 may be connected to an overall system processing unit 12. A camera module 13 may be connected to unit 12. It may be used for obtaining images of faces of people. A high resolution narrow 25 field of view camera module 14 may be connected to unit 12. Module 14 may be used for obtaining images of a feature of a face such as an iris. An illumination module 15 may be connected to module 14. Module 15 may be used for illuminating items for use with the high 30 resolution module 14 to obtain good images of both irises. Module 15 may be able to illuminate with infrared light. A system input/output interface electronics (I/O electronics) module 16 may be connected to unit 12, module 14 and module 15. 35 Module 13 may have a medium field-of-view (MFOV) camera (e.g., security camera) 17 that is connected to a 6 WO 2007/103833 PCT/US2007/063242 face "process" 18 in unit 12. The term "processor" may be used in lieu of "process" in that a process would include processing. Such processes or processors may be a part of a larger processor, such as a system processor. 5 A pan-tilt-zoom (PTZ) control unit 19 may be connected to the MFOV camera 17. The PTZ unit 19 may be connected to a surveillance process or processor 21 in the overall system processing unit 12. Module 14 may have a high resolution narrow field-of-view (NFOV) camera 22, and a 10 pan-tilt and zoom (PTZ) control unit 23 connected to camera 22 and the surveillance processor 21. A NFOV camera controller 24 may be connected to the high resolution camera 22, the system I/O electronics module 16 and the surveillance processor 21. The camera might 15 be connected to the WFOV stereo camera 11. The camera 22 may also be connected to an iris process or processor 25. Module 15 may have an illuminator module consisting of a number of near infrared illuminators 26 and an illumination controller 27 connected to the illuminators 20 26. Controller 27 may also be connected to I/O electronics module 16 and the NFOV camera controller 24. The WFOV camera 11 may be connected to a WFOV process or processor 28 of unit 12. WFOV processor 28 may be connected to surveillance processor 21. The face 25 processor 18 may be connected to the surveillance processor 21 and to a face/iris recognition processor 29. Iris processor 25 may be connected to a surveillance processor 21 and the face/iris recognition processor 29. The face/iris recognition processor 29 may be connected 30 to the surveillance processor 21. The face/iris recognition processor 29 may be connected to a face/iris database 31. The system I/O electronics module 16 may be connected to a system processor 32. The surveillance 35 processor 21 may be connected to the system processor 32. A user interface 33 may be connected to the surveillance 7 WO 2007/103833 PCT/US2007/063242 processor 21 and the system processor 32. Figure 2 shows a processing flow in the present system 10 (Figure 1). In a first step 35, subjects may be detected in the wide field of view image. This step 5 35 may use an open source or other suitable algorithms for face detection. A wide FOV stereo camera 11 may also compute the range to each of the subjects in a scene. A next step 36 may include prioritization of the subjects in the scene monitored by the present system. Detected 10 subjects might be prioritized for iris and face acquisition. The prioritization scheme might use quality of the imaged biometrics (i.e., face and iris) or the motion of people in the scene. Quality of the imaged biometrics might be measured by the quantity or quality 15 of the face and iris images captured, or confidence measures obtained after matching the subject with the database. After prioritization, the face processing (branch 37) and iris processing (branch 38) may occur in parallel. 20 The face processing branch 37 may use the subject location and range information detected and computed by the wide FOV stereo camera 11 to point the medium field of view camera 17 at a subject. A face image may be acquired at step 44 and then sent to the COTS face 25 recognition software or processor 18. The face recognition software or processor 18 may compute features on the face image and compare them against features in a stored database 31, at step 45, with a recognition processor 29 for identification of the subject. If the 30 face or features do not appear in the database, then they may be enrolled in the database. The iris branch 38 may use the subject location and range information detected and computed by the wide FOV stereo camera 11 to point the modified near infrared 35 (NIR) illuminators 26 to illuminate the face at step 39. The system 10 may do the iris image acquisition in near 8 WO 2007/103833 PCT/US2007/063242 IR to highlight lower contrast iris features. A next step 41 uses the subject location and range information detected and computed by the wide FOV stereo camera 11 to point the NFOV high resolution camera 22 at the subject, 5 and zoom at the right scale, which may then acquire the iris image. The high resolution camera 22 may be modified to remove an IR blocking filter, or camera 22 may use a NIR sensor. The system may control the focus and zoom of camera 22, using the camera controller 24. 10 As an example, a two part algorithm may be used to focus the iris camera 22 on the subject's iris. This algorithm may first use the subject range to compute the right zoom factor required for imaging irises with sufficient resolution, auto-focus the camera 22 using visible light, 15 and then it may use the subject range to compute a focus offset to get the image in focus in the NIR wavelength. Other kinds of suitable algorithms may be used. After iris acquisition, the iris images may be processed with custom iris processing algorithms to 20 extract unique features, at step 42, with an iris processor 25. The extracted features may be matched to features stored in a database 31, at step 43, with the recognition processor 29, to identify the subject. If the extracted features are not matched to features stored 25 in the database, the subject may be enrolled in the system by adding the features and subject information to the database. Another step 46 in the system 10 process may be a display of the matched results for both the face and 30 iris. Matched results may be a corroboration of the identity of the subject. For specific applications, these results may be passed to a security system (e.g., access control). The entire process may then be repeated with a return to step 35 for other subjects. A custom 35 architecture may maintain the inter-component communications and control for the system. 9 WO 2007/103833 PCT/US2007/063242 Figure 3 shows a general layout of the present system. There may be camera or sensor module 61 for obtaining images of one or more subjects in a scene. Images of objects and features of each subject may be 5 obtained by the camera module. These images may be processed by an object/feature processor 62. The processed images may go to a recognition processor 63 which may interact with an object/feature database 64, to perform matching object images and feature images with 10 like images in the database 64 purposes of seeking recognition and identity of the subject. For an example, a subject may be a person, an object may be a face and a feature may be an iris. The subject, object and feature could represent other entities. 15 The camera module 61 may take WFOV images of a scene with one or more subjects. The module 61 may take MFOV images of an object of the one or more subjects. Also, module 61 may take NFOV images of a feature of the object. The module 61 may take pictures of the various 20 fields-of-view with just one adjustable camera with adjustable resolution, or with more than one camera. A general processor 65 may coordinate various operations of the module 61 and processors 62 and 63. The processor 65 may provide user interfacing and also a connection with 25 the world outside of the present system. It may even provide the recognition processor 63 with an external database located at the outside 66 via internet cable, wireless and other media. The present recognition system 10 may have an 30 enclosure including the following items. The items may include a commercial off the shelf (COTS) wide field of view (WFOV) stereo camera 11, a COTS medium field of view pan-tilt-zoom (PTZ) security or other kind of camera system 13 and a narrow field of view, such as a high 35 resolution, iris camera system 14. The narrow field of view camera system 14 may include a modified COTS high 10 WO 2007/103833 PCT/US2007/063242 resolution camera 22, motorized COTS zoom lens, a narrow field of view iris camera controller 24, and a customized pan tilt zoom PTZ controller unit 23. One of the cameras 17 and/or 22 may be a standard PTZ camera. The present 5 recognition system may also include an illumination system 15, system I/O electronics 16 and a processing system 12. The illumination system 15 may include a number of modified flash illuminators 26 and an illuminator controller 27. The processing system 12 may 10 include several computers, a system processor, a digital signal processor or a customized processing board. The system may provide a user interface 33 having a monitor, a keyboard with a build-in mouse, and a keyboard, video, and mouse (KVM) switch. 15 It may be noted that the COTS WFOV stereo camera 11 may be used for locating the position of people in the scene. The COTS medium field of view PTZ security camera 17 may be used to capture images of the people's faces. The high resolution iris camera system 14 may be used to 20 capture near infrared iris images of the people in the scene. The iris camera 22 may be connected to the customized PTZ controller unit 23 and can allow the camera 22 to be pointed to people in the scene. The iris camera controller 24 may control a motorized COTS zoom 25 lens which allows the system to zoom in on the irises in the scene. It may also be connected to a modified lens extension along with the extension lens communication hardware that enables the system to override the auto focus control. 30 The illumination system 15 may have a number of modified flash illuminators 26 and associated illuminator electronics. The illuminator electronics 27 may allow the system to selectively select the flash units used for each picture taken. The system I/O electronics 16 may be 35 used for initializing components by switching on/off power to the devices. It may also be used to monitor the 11 WO 2007/103833 PCT/US2007/063242 camera to detect when the auto-focus is ready and it may also be used to select illuminators before they are fired. The processing system 12 which includes computers 5 may be used for the processing and storage of the images as well as for the user interface 33. There also may be a monitor and a keyboard with a build-in mouse which is used for the user interface. The KVM switch may be used to switch between computers for debugging purposes. 10 Some of these components may be modified. The COTS high resolution camera 22 may have a blocking infrared mechanism. A PTZ unit may be customized to fit the camera 22 with mechanical stops installed to limit the travel. 15 The COTS zoom lens may be engineered with gears and a motor to allow electronic control over the zoom and focus settings. The lens extension may be disassembled and the electronics be modified. The flash illuminators 26 may be modified so that they can be remotely triggered 20 and have the "on" time of the flash reduced. A visible light filter may be added to allow the illumination to be limited to mostly infrared. Some of the operation of the present recognition system 10 may be noted. As a person enters a scene, a 25 WFOV camera 11 may detect and send images to a WFOV processor 12. The WFOV processor may locate the person's head position and range and send coordinates of the head to a surveillance processor. The surveillance processor 21 may prioritize which person in the scene needs to be 30 captured with either the MFOV camera 17 or the iris camera 22. Camera 17 may be a security camera. The surveillance processor may send PTZ coordinates to the camera PTZ 19. The camera PTZ 19 may move to a correct location and send a command to the camera 17, which may 35 then take a picture of the person and send the image to the face/iris recognition processor 29. The face/iris 12 WO 2007/103833 PCT/US2007/063242 recognition processor may check the database 31 for a face match and may enroll the face if it does not have a match. The surveillance processor 21 may send the PTZ 5 coordinates to the corresponding PTZ 23 of the narrow field of view (NFOV) camera 22. The PZT 23 may move the camera to the position and zoom coordinates and then send a command to the NFOV or iris camera 22. The iris camera 22 may use its built-in auto focus electronics to focus 10 the image in the visible wavelength. The system may wait for the auto-focus to complete, and then apply a focusing offset, based on the range of the subject, to get the image in focus in the near infrared wavelength. The infrared illuminators may then fire and the iris camera 15 22 may then take a picture of the person and send the image to the face/iris recognition processor 29 via processor 25. The face/iris recognition processor 29 may check a database 31 for a match of the irises and may enroll the irises if there is no match. The face/iris 20 recognition processor 29 may also keep track of pairing face and irises from the same subject. A feature of the present recognition system 10 is that it may use either face, iris or both a face and iris in the recognition process. The system may work at large 25 distances ( 5 m., 16+ ft.). Also, the system may handle a large number of subjects. Figure 4 shows an example structure 53 containing system 10. A high resolution camera 22, a range estimation camera 11 and a face capture camera 17 are 30 shown. Custom electronics 51 may encompass items of unit 12 and other items of a control and electronic nature. Also shown are flashes 52 which may be a part of illuminator 26. Figures 5a and 5c show cabinetry for encasing and/or 35 enclosing the system 10. Structure 53 of Figure 4 may be situated on top of cabinet 54 when open for use as shown 13 WO 2007/103833 PCT/US2007/063242 in Figure 5a. Figure 5c shows the cabinet 54 closed up with structure 53 inside. The cabinet 54 may be rolled on wheels 55 and pulled by a handle 56. Associated with structure 53 may be a display/interface 57. It may show 5 a scene 58 of several subjects one or more of which have a face image captured by a camera. An inset 59 may alternatively display a face, or a close-up of an eye or iris of the subject being imaged. Items 57, 58 and 59 are shown in Figure 5b. 10 An alternative instantiation of this invention may combine the face and iris acquisition functions into a single camera. This may combine the narrow field of view camera and the medium field of view camera with a single camera that could image the full face and the irises at a 15 high resolution. An alternative instantiation of this invention may simplify the WFOV camera by discarding the stereo sensor and use anthropometric information computed from the wide field of view imagery of the WFOV camera to provide an 20 estimate of the range of the subject in the scene. Another instantiation of this invention may have the narrow field of view PTZ camera performing the functions of the wide field of view camera, the medium field of view camera, and the narrow field of view camera into a 25 single camera. This camera may use a longer zoom setting to do the wide field of view subject detection, a medium field of view zoom setting to do the face acquisition and a narrow field of view zoom setting to do the iris acquisition. 30 In the present specification, some of the matter may be of a hypothetical or prophetic nature although stated in another manner or tense. Although the invention has been described with respect to at least one illustrative example, many 35 variations and modifications will become apparent to those skilled in the art upon reading the present 14 C .\NRPonbl\CC\MASV324%KII) 1 DOC-10/2912010 - 15 specification. It is therefore the intention that appended claims be interpreted as broadly as possible in view of the prior art to include all such variations and modifications. Throughout this specification and the claims which 5 follow, unless the context requires otherwise, the word "comprise", and variations such as "comprises" and "comprising", will be understood to imply the inclusion of a stated integer or step or group of integers or steps but not the exclusion of any other integer or step or group of 10 integers or steps. The reference in this specification to any prior publication (or information derived from it), or to any matter which is known, is not, and should not be taken as an acknowledgment or admission or any form of suggestion that 15 that prior publication (or information derived from it) or known matter forms part of the common general knowledge in the field of endeavour to which this specification relates.
Claims (19)
1. A subject recognition system comprising: a wide field-of-view camera; 5 a medium field of view camera; a narrow field of view camera; and a processing system configured to receive image information from the wide field-of-view, medium field of view, and narrow field of view cameras, the processing 10 system being configured to perform recognition processing on image information from the wide field-of-view, medium field of view, and narrow field of view cameras.
2. The system of claim 1, further comprising a controller 15 for driving a zoom of the narrow field of view camera.
3. The system of claim 2, wherein: the wide field-of-view camera is for locating positions and ranges of subjects in an area; 20 the medium field of view camera is for capturing images of the subjects; and the narrow field of view camera is for capturing images of iris features of the subjects. 25
4. The system of claim 3, wherein: the subjects are people; and the features are irises.
5. The system of claim 4, wherein the medium field of view 30 camera is for capturing images of faces of the people. C:\NRPorhKDCC\MAS\3455u69 1 .DOC-2//2111 -17
6. The system of claim 3, wherein the wide field of view camera is for estimating a distance between the cameras and the subjects. 5
7. The system of claim 3, wherein the distance to the subject may be inferred by stereo or from a calibrated camera and anthropometric knowledge.
8. The system of claim 3, wherein a correct zoom factor of 10 the narrow field of view is estimated for capturing iris images.
9. The system of claim 5, wherein the processing system comprises a mechanism for storage and retrieval of images. 15
10. The system of claim 9 further comprising: a mechanism for face and iris matching and/or enrolling connected to the processing system; and an interface module connected to the mechanism for face 20 and iris matching and/or enrolling and to the wide field of view camera, the medium field of view camera and the narrow field of view camera.
11. The system of claim 10, wherein the interface module 25 comprises an iris processor connected to the narrow field of view camera and to the mechanism for face and iris matching and/or enrolling.
12. The system of claim 10, further comprising an 30 illumination system connected to the interface module. C NRPonb\DCC\MAS0455W' LDOC-2//2011 - 18
13. The system of claim 12, wherein the illuminator is an infrared iris illuminator.
14. A method of detecting and recognizing subject, 5 comprising: detecting one or more subjects in a scene with a wide field-of-view camera; acquiring face images of the one or more subjects with a medium field-of-view camera; 10 acquiring iris images of the one or more subjects with a narrow field-of-view camera; matching face images to stored faces in a database; and matching iris images to iris images in a database.
15 15. The method of claim 14, wherein a level of recognition of a subject comprises a matching of a face image of the subject and a matching of an iris image of the subject with corresponding images, respectively, in a database. 20
16. The method of claim 14, further comprising illuminating faces of the one or more subjects with infrared light for acquiring iris images.
17. The method of claim 14, further comprising prioritizing 25 the subjects for recognition after detecting one or more subjects in a scene.
18. A subject recognition system substantially as hereinbefore described, with reference to the accompanying 30 drawings.
19. A method of detecting and recognizing subject C:NRPorbNlDCC\MAS\V455W9 j DOC-2//2011 - 19 substantially as hereinbefore described, with reference to the accompanying drawings.
Applications Claiming Priority (13)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US77877006P | 2006-03-03 | 2006-03-03 | |
US60/778,770 | 2006-03-03 | ||
US11/372,854 US8442276B2 (en) | 2006-03-03 | 2006-03-10 | Invariant radial iris segmentation |
US11/372,854 | 2006-03-10 | ||
US11/382,373 | 2006-05-09 | ||
US11/382,373 US8064647B2 (en) | 2006-03-03 | 2006-05-09 | System for iris detection tracking and recognition at a distance |
US80704606P | 2006-07-11 | 2006-07-11 | |
US60/807,046 | 2006-07-11 | ||
US11/672,108 | 2007-02-07 | ||
US11/672,108 US8090157B2 (en) | 2005-01-26 | 2007-02-07 | Approaches and apparatus for eye detection in a digital image |
US11/675,424 | 2007-02-15 | ||
US11/675,424 US8098901B2 (en) | 2005-01-26 | 2007-02-15 | Standoff iris recognition system |
PCT/US2007/063242 WO2007103833A1 (en) | 2006-03-03 | 2007-03-02 | A combined face and iris recognition system |
Publications (2)
Publication Number | Publication Date |
---|---|
AU2007223336A1 AU2007223336A1 (en) | 2007-09-13 |
AU2007223336B2 true AU2007223336B2 (en) | 2011-03-10 |
Family
ID=38169246
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
AU2007223336A Ceased AU2007223336B2 (en) | 2006-03-03 | 2007-03-02 | A combined face and iris recognition system |
Country Status (4)
Country | Link |
---|---|
AU (1) | AU2007223336B2 (en) |
GB (1) | GB2450022B (en) |
IL (1) | IL193751A (en) |
WO (1) | WO2007103833A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110128385A1 (en) * | 2009-12-02 | 2011-06-02 | Honeywell International Inc. | Multi camera registration for high resolution target capture |
AU2011252761B2 (en) | 2010-05-13 | 2016-12-15 | Iomniscient Pty Ltd | Automatic identity enrolment |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6714665B1 (en) * | 1994-09-02 | 2004-03-30 | Sarnoff Corporation | Fully automated iris recognition system utilizing wide and narrow fields of view |
WO2005008567A1 (en) * | 2003-07-18 | 2005-01-27 | Yonsei University | Apparatus and method for iris recognition from all direction of view |
WO2005024698A2 (en) * | 2003-09-04 | 2005-03-17 | Sarnoff Corporation | Method and apparatus for performing iris recognition from an image |
WO2006023046A1 (en) * | 2004-06-21 | 2006-03-02 | Nevengineering, Inc. | Single image based multi-biometric system and method |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0910986A1 (en) * | 1997-10-24 | 1999-04-28 | BRITISH TELECOMMUNICATIONS public limited company | Imaging apparatus |
US6714655B2 (en) * | 2001-05-11 | 2004-03-30 | Matsushita Electric Industrial Co., Ltd. | Speaker |
-
2007
- 2007-03-02 WO PCT/US2007/063242 patent/WO2007103833A1/en active Application Filing
- 2007-03-02 GB GB0815735A patent/GB2450022B/en not_active Expired - Fee Related
- 2007-03-02 AU AU2007223336A patent/AU2007223336B2/en not_active Ceased
-
2008
- 2008-08-28 IL IL193751A patent/IL193751A/en not_active IP Right Cessation
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6714665B1 (en) * | 1994-09-02 | 2004-03-30 | Sarnoff Corporation | Fully automated iris recognition system utilizing wide and narrow fields of view |
WO2005008567A1 (en) * | 2003-07-18 | 2005-01-27 | Yonsei University | Apparatus and method for iris recognition from all direction of view |
WO2005024698A2 (en) * | 2003-09-04 | 2005-03-17 | Sarnoff Corporation | Method and apparatus for performing iris recognition from an image |
WO2006023046A1 (en) * | 2004-06-21 | 2006-03-02 | Nevengineering, Inc. | Single image based multi-biometric system and method |
Also Published As
Publication number | Publication date |
---|---|
AU2007223336A1 (en) | 2007-09-13 |
WO2007103833A1 (en) | 2007-09-13 |
GB2450022A (en) | 2008-12-10 |
GB2450022B (en) | 2011-10-19 |
IL193751A (en) | 2014-05-28 |
GB0815735D0 (en) | 2008-10-08 |
IL193751A0 (en) | 2009-05-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8705808B2 (en) | Combined face and iris recognition system | |
US7574021B2 (en) | Iris recognition for a secure facility | |
KR101280920B1 (en) | Image recognition apparatus and method | |
US20050084179A1 (en) | Method and apparatus for performing iris recognition from an image | |
US8208028B2 (en) | Object verification device and object verification method | |
KR100977499B1 (en) | Iris image acquisition system using panning and tilting of mirror at a long distance | |
WO2012023766A2 (en) | Security camera tracking and monitoring system and method using thermal image coordinates | |
CN104798103B (en) | Face recognition device, face recognition method, program for the same, and information apparatus | |
US20110285845A1 (en) | Distant face recognition system | |
KR101530255B1 (en) | Cctv system having auto tracking function of moving target | |
WO2017043031A1 (en) | Image processing apparatus, solid-state imaging device, and electronic apparatus | |
CN101911670A (en) | Digital camera focusing using stored object recognition | |
KR102144394B1 (en) | Apparatus and method for alignment of images | |
US20140253711A1 (en) | Agile non-contact biometric sensor | |
US10127424B2 (en) | Image processing apparatus, image processing method, and image processing system | |
CN109451233A (en) | A kind of device acquiring fine definition face-image | |
WO2020065852A1 (en) | Authentication system, authentication method, and storage medium | |
US11882354B2 (en) | System for acquisiting iris image for enlarging iris acquisition range | |
EP3599989A1 (en) | High speed pupil detection system and method | |
Lee et al. | Auto-focusing method for remote gaze tracking camera | |
AU2007223336B2 (en) | A combined face and iris recognition system | |
De Villar et al. | Design and implementation of a long range iris recognition system | |
KR101635602B1 (en) | Method and apparatus for iris scanning | |
Bashir et al. | Video surveillance for biometrics: long-range multi-biometric system | |
KR20140083563A (en) | Multi-body Detection Method based on a NCCAH(Normalized Cross-Correlation of Average Histogram) And Electronic Device supporting the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FGA | Letters patent sealed or granted (standard patent) | ||
MK14 | Patent ceased section 143(a) (annual fees not paid) or expired |