WO2017161520A1 - 支持近红外光与可见光成像的复合成像***和移动终端 - Google Patents

支持近红外光与可见光成像的复合成像***和移动终端 Download PDF

Info

Publication number
WO2017161520A1
WO2017161520A1 PCT/CN2016/077101 CN2016077101W WO2017161520A1 WO 2017161520 A1 WO2017161520 A1 WO 2017161520A1 CN 2016077101 W CN2016077101 W CN 2016077101W WO 2017161520 A1 WO2017161520 A1 WO 2017161520A1
Authority
WO
WIPO (PCT)
Prior art keywords
infrared light
imaging
infrared
visible light
image sensor
Prior art date
Application number
PCT/CN2016/077101
Other languages
English (en)
French (fr)
Inventor
徐鹤菲
Original Assignee
徐鹤菲
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 徐鹤菲 filed Critical 徐鹤菲
Priority to CN201680085013.0A priority Critical patent/CN109076147B/zh
Priority to PCT/CN2016/077101 priority patent/WO2017161520A1/zh
Publication of WO2017161520A1 publication Critical patent/WO2017161520A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/20—Filters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/30—Transforming light or analogous information into electric information
    • H04N5/33—Transforming infrared radiation

Definitions

  • the present invention relates to the field of image processing, biometrics, and optical imaging technologies, and more particularly to a composite imaging system that supports a visible light imaging mode and a near infrared light imaging mode.
  • the mobile terminal is used as a means of identity confirmation mainly relying on passwords and cards, and has problems such as difficulty in memory, easy to be stolen, and low security.
  • iris recognition has the highest security and accuracy, and has the advantages of being unique, not requiring memory, being able to be stolen, and having a high level of security.
  • an iris recognition function is added to a mobile terminal (such as a mobile phone), and a near-infrared camera module needs to be added to the front of the mobile phone, and the front visible light camera module for self-photographing is independent. That is, the front panel of the mobile phone needs to open two holes, one for self-timer and one for iris imaging, which is complicated in industrial design and has an unattractive appearance.
  • the iris imaging design implemented by the near-infrared camera module generally uses near-infrared light imaging of the 760 nm-880 nm spectrum band. This requires an additional near-infrared source (between 760 nm and 880 nm) for fill-light illumination, and the near-infrared camera module needs to be able to receive this infrared band of energy.
  • the iris recognition on the mobile phone is mainly used for the user's own identity recognition, and the user experience generally needs to be used in advance.
  • the existing front-mounted self-photographing head of the mobile phone cannot accept the infrared light source or receive a large attenuation due to the coating filtration itself. Therefore, the prior art iris recognition requires a separate near-infrared camera for imaging the iris, and cannot be multiplexed with the existing visible light imaging (spectral frequency of 380-760 nm) camera (such as the existing front color camera of the smartphone). ).
  • the existing visible light imaging spectral frequency of 380-760 nm
  • the use of a single camera in near-infrared and visible-light dual-band imaging mainly has the following implementation methods: adding a mechanical switchable near-infrared optical filter (see CN203838720U) in the imaging system, using dual-band infrared and visible light A transmission spectrum filter (see U.S. Patent No. 8,408,821, Chinese Patent Publication No. CN104394306A), and an image sensor using both visible and near-infrared light detecting pixels (see U.S. Patent No. 7,915, 562, Chinese Patent Publication No. CN104284179A).
  • a mechanical switchable near-infrared optical filter see CN203838720U
  • dual-band infrared and visible light A transmission spectrum filter see U.S. Patent No. 8,408,821, Chinese Patent Publication No. CN104394306A
  • an image sensor using both visible and near-infrared light detecting pixels see U.S. Patent No. 7,915, 562, Chinese Patent Publication No. CN104
  • the mechanically switchable near-infrared light filter is difficult to be widely used in mobile devices due to its relatively large volume.
  • the use of filters with infrared and visible light-band transmission spectra causes the visible portion and the near-infrared portion to interfere with each other, thereby affecting the quality of the photograph and the accuracy of the recognition.
  • US7915652 only involves the image sensor design of dual-spectrum imaging, but does not provide the entire imaging system design; the sub-region multi-spectral filter used in CN104284179A is the color filter matrix attached to the surface of the image sensor (Color) Filter Array) instead of a separate optical filter.
  • the present invention provides a design of a biometric composite imaging system that achieves multiplexing of near-infrared light and visible light imaging functions by using a fixed focal length lens assembly, a filter assembly, and an image sensor, and a mobile terminal design including the composite imaging system. Therefore, the visible light imaging function of the front-end self-timer of the mobile terminal can be satisfied, and the biometric function of the near-infrared light imaging can be satisfied.
  • FIG. 1 is a schematic illustration of a composite imaging system 100 for biometrics in accordance with the present invention
  • FIG. 2 is a schematic diagram showing the depth of field of the visible light and near-infrared light of the lens assembly 130;
  • Figure 3 is a schematic illustration of a composite imaging system with a near infrared source in accordance with the present invention
  • FIG. 4 is a schematic diagram showing the internal structure of an image sensor according to an embodiment of the present invention.
  • FIGS. 5A to 5D illustrate an embodiment of a mobile terminal including a composite imaging system, in which FIGS. 5A and 5B illustrate a structural configuration of the mobile terminal, and FIGS. 5C and 5D illustrate the mobile terminal in use.
  • User experience map FIGS. 5A and 5B illustrate a structural configuration of the mobile terminal, and FIGS. 5C and 5D illustrate the mobile terminal in use.
  • FIGS. 6A to 6D illustrate another embodiment of a mobile terminal including a composite imaging system, in which FIGS. 6A and 6B illustrate a structural configuration of the mobile terminal, and FIGS. 6C and 6D illustrate the mobile terminal in use User experience graph.
  • the composite imaging system 100 includes an image sensor 110, a filter assembly 120, and a lens assembly 130.
  • the filter assembly 120 includes a visible light band pass filter 121 and a near infrared light band pass filter 122 (shown as being filled with a backslash)
  • the image sensor 110 includes an area for near infrared light imaging.
  • A shown in the figure as filled with backslashes
  • region B for visible light imaging
  • transition region C between A and B regions shown as filled with horizontal lines).
  • the lens assembly 130, the filter assembly 120, and the image sensor 110 are sequentially disposed along the incident light path. It should be noted that between the three components shown in Figure 1. The distance is only exemplary.
  • the full spectrum of light is incident through the lens assembly 130 and reaches the filter assembly 120, wherein the visible bandpass filter 121 allows visible light (eg, wavelengths of 380-760 nm) to pass, while the near infrared bandpass filter 122 allows near Infrared light (for example, having a wavelength of 780-880 nm) passes.
  • the visible light band pass filter 121 and the near infrared light band pass filter 122 can be realized by plating.
  • the visible light passing through the visible light band pass filter 121 is substantially imaged in the area B of the image sensor, while the near infrared light passing through the near infrared light band pass filter 122 is substantially imaged in the area A of the image sensor.
  • the imaging of the regions B and A of the image sensor can be separately distinguished by image processing software, wherein the imaging of the region B corresponds to normal visible light imaging, for example, the user performs imaging during daily self-timer using a mobile terminal such as a mobile phone, and the area A
  • the imaging corresponds to imaging in the near-infrared mode, such as imaging when the user uses the mobile phone for iris recognition. In this way, switching between visible light and near-infrared light imaging can be conveniently performed without the need to equip moving parts to switch the filter, which greatly improves stability.
  • the area of the filter assembly 120 is larger than the area of the image sensor 110.
  • the filter assembly 120 can be a separate component from the image sensor 110 or can be packaged over the surface of the wafer of image sensors by a packaging process.
  • the near-infrared light passing through the near-infrared bandpass filter 122 and the visible light passing through the visible bandpass filter 121 may overlap at the transition region C of the image sensor.
  • the filter assembly 120 should be close to the image sensor 110, for example, less than 2 mm, in which the wide-angle diffusion propagation of light is small and can even be ignored. Even if the image sensor 110 has a transition region C, its area is limited and mainly affects visible light imaging.
  • the pixel region corresponding to the transition region C can be removed from the visible light image by the image processing software to obtain acceptable visible light imaging.
  • FIG. 2 is a schematic diagram of the depth of field of the lens assembly 130 for clear imaging of visible light and near-infrared light.
  • the lens assembly 130 has a certain field of view and receives light from the full spectrum.
  • Lens assembly 130 uses a fixed focal length of optical transmission Mirror, the depth of field range d1 of the optical lens for clear imaging of the visible spectrum is overlapped with the depth range d2 of the optical lens for clear imaging of the near-infrared spectrum, so that the system can obtain clear images in both visible and near-infrared bands. ,as shown in picture 2.
  • an achromatic optical lens in which visible light and near-infrared light are confocal may be used.
  • FIG. 3 is a schematic diagram of a composite imaging system with a near-infrared light source in accordance with the present invention, in addition to the schematic positional relationship of image sensor 110, filter assembly 120, and lens assembly 130 of FIG. 1A, further A near infrared source 150 is shown.
  • biometric imaging such as iris
  • iris information is easily interfered by visible light from the outside environment, for example, visible light reflection spots formed by window reflections on the surface of the eye or reflections of various environmental lights by users wearing glasses. Reflective bright spots can block the iris, which in turn affects recognition rate and user experience.
  • the near-infrared source 150 can include one or more infrared LEDs having a central spectral range, such as within 780-880 nm, for near-infrared illumination of the biometric features to enhance biometric imaging.
  • the near-infrared source 150 can be independent of the composite imaging system 100, as shown in Figure 3, or as part of a composite imaging system.
  • the near-infrared source 150 has a specific emission tilt angle when installed, and only needs to be illuminated in the near-infrared band of the biometric features within the specific imaging space range ⁇ shown in FIG. 3, without having to be within the entire imaging space range ⁇ . The object is illuminated.
  • the exiting main optical axis of the near-infrared source 150 is not parallel to the central optical axis of the imaging system to avoid "brightness" effects when imaging biometric features (eg, iris), affecting the performance of the biometric system.
  • the launch tilt of the near-infrared source can be flexibly adjusted based on different object distances and relative placement of the composite imaging system 100. Generally, the range of the launch tilt is set between 0 and 45 degrees, and as the object distance increases, the tilt angle can be correspondingly reduced.
  • FIG. 4 is a schematic diagram showing the internal structure of an image sensor according to an embodiment of the present invention.
  • the image sensor 110 is a complete image sensor pixel combination array that transmits digital image pixel data collected by the image sensor to a backend encryption chip or processor through a data transmission interface (such as a MIPI interface).
  • a data transmission interface such as a MIPI interface.
  • the image sensor 110 in the composite imaging system 100 of the present invention can use an image sensor of a large number of pixels, with the accuracy and minimum resolution requirements of the number of pixels.
  • the outer diameter of the monocular iris in the image needs to be 120 pixels. If the iris can be recognized by a lens with a horizontal FOV of 60 degrees at a normal use distance (30 CM), the image sensor needs to have at least 3773 pixels in the horizontal direction, and 2120 pixels in the vertical direction according to the image aspect ratio of 16:9. The pixel, that is, the total number of pixels is 8M.
  • CMOS image sensor having a pixel number of 8 M or more, for example, a 13 M pixel CMOS image sensor (4680 (W) x 3456 (H)).
  • the color filter 114 does not cover the entire silicon base 116 of the image sensor, but covers the visible light imaging region therein, that is, only the visible light region B of the image sensor has a color filter. 114, then the microlens 112 is attached to the color filter 114; while in the near infrared light imaging area A, the color filter is removed, and the microlens 112 is directly attached to the silicon base of the image sensor.
  • the color filter removal design enhances the corresponding spectral sensitivity of the corresponding image sensor area A for the near-infrared spectral range, and enhances the absorption of light energy in the near-infrared band of 760-880 nm, thereby optimizing the enhancement of the area for iris imaging. Image effect.
  • the infrared LED light source with smaller energy can also maintain the strong near-infrared spectral energy reception, and can image the richer iris details, thereby reducing the power consumption requirement of the system for the active illumination source, and realizing the Low power consumption design for near-infrared biometric imaging of mobile terminal devices.
  • the area of the transition region C of the image sensor 110 is small, and the transition region C is omitted in FIG. 4 for the sake of simplicity of description.
  • the color filter corresponding to the transition region C can be retained or removed as needed.
  • the composite imaging system of the embodiment of the present invention innovatively employs a dual-band filter design, and can further employ an improved image sensor for sub-area imaging, wherein The visible light imaging area has a color filter and the color filter is removed on the near infrared light imaging area.
  • the image sensor can output pixel data corresponding to the visible light and near-infrared light bands in different regions, so that it can be conveniently switched between the visible light imaging mode and the near-infrared light imaging mode, for example, the user can click on the mobile terminal touch screen.
  • the button or physical button displayed on the screen switches the imaging mode.
  • the visible light imaging mode (such as daily self-timer) only the imaging of the visible light imaging region of the image sensor can be output, and the imaging of the transition region of the image sensor can be further removed by the image processing software, and the acquired image is not subject to near-infrared light. The effect is reddish.
  • the image sensor In the near-infrared light imaging mode for biometric recognition, the image sensor can output only the imaging of the near-infrared light imaging region, and the acquired biometric image is not affected by visible light of various complex environments to generate environmental noise.
  • the present invention does not require physical positional switching of the filter, but can realize switching and multiplexing of the visible light and near-infrared light imaging modes only by software, and does not require movement for the filter.
  • the component is capable of enhancing the stability of the system and structure in the falling environment of the mobile terminal.
  • the software control image signal processor ISP selects the corresponding visible light imaging region to work, and invokes the corresponding visible light imaging ISP parameter setting to optimize the effect of visible light imaging. If in the near-infrared light imaging mode, the ISP selects the corresponding near-infrared light imaging area to work, and the corresponding ISP parameter setting of the near-infrared light imaging is called to optimize the effect of the near-infrared light imaging.
  • the software control image signal processor ISP selects the corresponding visible light imaging region to work, and invokes the corresponding visible light imaging ISP parameter setting to optimize the effect of visible light imaging.
  • the ISP selects the corresponding near-infrared light imaging area to work, and the corresponding ISP parameter setting of the near-infrared light imaging is called to optimize the effect of the near-infrared light imaging.
  • the ISP selects the corresponding near-infrared light imaging area to work, and the corresponding ISP parameter setting of the near-infrared light imaging is called to
  • the composite imaging system may further include an image encryption unit to provide a function of encrypting the acquired biometric image.
  • the image encryption unit may be implemented by a processor (not shown) or included in the processor or included in an image sensor or a composite imaging system in a separate modular unit. In the group. After the composite imaging system enters the near-infrared light imaging mode and acquires the infrared image, the image encryption unit activates the image encryption function, encrypts the obtained biometric image, and outputs the encrypted data for further processing. When the composite imaging system enters the visible light imaging mode, the image encryption unit does not activate, and the obtained visible light image is not encrypted, so that the image sensor directly outputs the obtained visible light image.
  • 5A-5D illustrate one embodiment of a mobile terminal 100 that includes a composite imaging system of the present invention.
  • 5A and 5B show the structural configuration of the mobile terminal 100
  • FIGS. 5C and 5D respectively show user experience diagrams when the mobile terminal is used in the iris recognition mode and the self-photographing mode, respectively.
  • the mobile terminal 100 includes a composite imaging system 100, a near-infrared light source 150, and a screen implemented as a camera module.
  • the near-infrared source 150 can include one or more infrared LEDs in the 780-880 nm band.
  • the composite imaging system 100 is disposed on one side of the front side of the screen of the mobile terminal, such as the top of the screen or the bottom of the screen, which is the top in FIG. 5A.
  • the near-infrared light source 150 and the composite imaging system 100 are arranged on the same side of the front side of the screen of the mobile terminal, which are shown in the figure as being arranged on the top of the front side of the screen, that is, in the N direction of the screen, wherein the near infrared
  • the horizontal distance of the location of the light source 150 from the center of the composite imaging system 100 is in the range of 2-8 cm, which facilitates the elimination of reflected spots when worn by the user of the glasses.
  • the near-infrared light source 150 is placed under the touch panel of the mobile terminal.
  • the near-infrared light source 150 can be placed on the bottom layer of the front button of the mobile terminal (below the thickness direction of the mobile terminal), such as the Home button.
  • the bottom layer so that it is not necessary to specifically open holes in other locations to cause a visual appearance.
  • the surface of the touch panel of the near-infrared light source can be coated with an infrared anti-reflection film, which is consistent with the overall color of the front surface of the mobile terminal, and the color of the coating can be silver white, gold or black.
  • the composite imaging system 100 is in the N direction of the screen, i.e., above the length of the mobile end, and the screen is in the S direction of the composite imaging system 100.
  • the filter assembly 120 and the image sensor 110 are configured as shown in FIG. 5B: the visible band pass filter 121 is placed above the near-infrared bandpass filter 122 (ie, In the N direction), the visible light imaging region B of the corresponding image sensor is placed above the near-infrared light imaging region A (N direction).
  • the transition region C is located between the visible light imaging region and the near infrared light imaging region.
  • the area of the visible light imaging area is greater than 50% of the area of the image sensor, and the area of the near infrared light imaging area is less than 50% of the area of the image sensor, and the transition area C is located in the visible light imaging area and the near infrared light imaging area.
  • the area between them is less than 15% of the area of the image sensor.
  • it may be preferably designed such that the visible light imaging region height is 80% of the height of the entire image sensor, and the near-infrared light imaging region height is 20% of the height of the entire image sensor.
  • an eye image preview window 160 can be provided in the screen.
  • the eye image preview window 160 only outputs an image of the corresponding near-infrared light imaging region (ie, biometric imaging) for guiding the user to cooperate to acquire the biometric image.
  • the position of the eye image preview window 160 may be placed on the upper or lower side of the screen on the screen of the mobile terminal.
  • the eye image preview window 160 is located on the upper side of the screen, that is, near the side of the composite imaging system 100, which facilitates the user's eyes when in use.
  • the direction of the composite imaging system 100 is gaze, thereby reducing the occlusion of the iris texture features on the eyelids and eyelashes of the human eye, so as to obtain a better and richer iris image, which is advantageous for recognition.
  • the user can tilt the upper portion of the mobile terminal (ie, the side including the composite imaging system 100) toward the user side as shown in FIG. 5C, so that the user's eyes are gazing at the eye image preview window 160.
  • An image can be output in the eye image preview window 160 so that a biometric image (eg, an iris image) can be acquired for subsequent pre-processing or encryption recognition processes.
  • composite imaging system 100 captures visible and near-infrared light from biometrics.
  • near-infrared light from biometrics enters the interior of the mobile terminal through the composite imaging system 100, and passes through the near-infrared (S) near-infrared bandpass filter 122 to the image sensor.
  • the direction of emission of the infrared source 150 can be appropriately tilted toward the system 100 or the upper portion of the screen of the mobile terminal by a certain angle, as shown in FIG. 5C.
  • the divergence angle of the near-infrared light source 150 can be flexibly adjusted according to different object distances and the placement positions of different systems.
  • the visible light imaging mode such as the user's daily self-timer, as shown in FIG. 5D
  • the upper portion of the mobile terminal does not need to be tilted toward the user side as in FIG. 5C, and the near-infrared light source 150 does not operate. The user looks at the middle of the screen.
  • the light of the self-timer region of interest mainly passes through the visible (N) visible light bandpass filter 121 and reaches the upper (N) visible light imaging region of the image sensor. , get a self-portrait image.
  • FIGS. 6A-6D illustrate another embodiment of a mobile terminal 100 that includes a composite imaging system of the present invention.
  • 6A and 6B show the structural configuration of the mobile terminal 100
  • FIGS. 6C and 6D respectively show user experience diagrams when the mobile terminal is used in the iris recognition mode and the self-photographing mode, respectively.
  • the near-infrared source 150 is located in the lower portion of the screen (i.e., the S-direction)
  • the composite imaging system 100 is located in the upper portion of the screen (i.e., the N-direction).
  • the filter assembly 120 and the image sensor 110 are configured as shown in FIG.
  • the visible band pass filter 121 is placed below the near-infrared bandpass filter 122 (S); and the visible light image of the image sensor
  • the area B is placed below the near-infrared light imaging area A (S)
  • the transition area C is located between the visible light imaging area B and the near-infrared light imaging area A.
  • the mobile terminal when used, when the mobile terminal enters the near-infrared light imaging mode to perform near-infrared light imaging of the biometric feature (eg, into the iris recognition mode), it may be provided in an area above the screen.
  • the eye image preview window 160 is used to guide the user to cooperate to collect the biometric image. This is advantageous for the user's eyes to naturally look at the direction of the composite imaging system 100, thereby reducing the occlusion of the iris texture features on the eyelids and eyelashes of the human eye, so as to obtain a better and richer iris image, which is advantageous for recognition.
  • the user can tilt the upper portion of the mobile terminal (ie, the side including the composite imaging system 100) toward the direction away from the user side as shown in FIG. 6C, so that the user pans through the image while looking at the eye image preview window 160.
  • a unit (not shown) performs translation control to ensure that the preview image in the eye image preview window 160 is a preview of the near-infrared light imaging area of the image sensor,
  • An image of the user's eyes can be outputted in the eye image preview window 160 so that a biometric image (eg, an iris image) can be acquired for subsequent pre-processing or encryption recognition processes.
  • the near-infrared light source 150 is placed under the mobile terminal such that the biometric features (e.g., the iris) can be more fully illuminated when the upper portion of the mobile terminal is tilted away from the user.
  • the emission direction of the near-infrared light source 150 may be inclined at a certain angle toward the upper direction of the system 100 or the screen of the mobile terminal.
  • the tilt angle of the near-infrared light source 150 can be flexibly adjusted according to different object distances and placement positions of different systems.
  • the visible light imaging mode such as the user's daily self-timer, as shown in FIG. 6D
  • the upper portion of the mobile terminal can be tilted toward the user side, and the near-infrared light source 150 does not operate.
  • an auxiliary near-infrared light source (not shown) may be incorporated in the displayed screen in front of the mobile terminal.
  • the auxiliary near-infrared light source can assist the near-infrared light illumination of the biometric feature, thereby saving power of the near-infrared light source disposed on the mobile terminal.
  • the iris of the human eye can be illuminated by the infrared screen portion of the screen that is illuminated by the control of the software, and the screen can be illuminated with the OLED light source in the normal mode.
  • the single camera module works in visible light and near-infrared light imaging mode, which simplifies the hardware design, has no moving parts to switch the filter, greatly improves the stability, and realizes the visible light and near-infrared light imaging mode by software. Switch between.
  • Sub-regional near-infrared light imaging requires only a portion of the image sensor to receive illumination from the near-infrared source, rather than the entire image sensor, thereby reducing the total power consumption of the image sensor for the infrared illumination source, ie, using less energy and Smaller emission angle of infrared
  • the LED light source can also maintain sufficient absorption of near-infrared spectral energy in the infrared region to obtain a biometric image rich in texture details.
  • the composite imaging system of the present invention can encrypt the acquired biometric image to ensure the security of the user's personal sensitive information.
  • the present invention takes iris recognition as an example to illustrate the imaging function multiplexing composite imaging system of the present invention.
  • aspects of the present invention are not limited to the recognition of the iris of the human eye, but can also be applied to other biological features that can be used for identification, such as whitening, fingerprints, retina, nose, face (two-dimensional or three-dimensional), Eye lines, lip lines and veins.
  • A8 The composite imaging system of A1, wherein the area of the filter assembly is greater than the area of the image sensor.
  • A9. The composite imaging system of A1, wherein the image sensor has an image resolution greater than 2400 pixels in the horizontal direction of both eyes of the human eye.
  • A10. The composite imaging system of A1, wherein the image sensor comprises a color filter, wherein the color filter covers only the visible light imaging region of the image sensor.
  • A11. The composite imaging system of A1, wherein the filter assembly is less than 2 mm from the image sensor.
  • B15 The mobile terminal of B14, further comprising an image shifting unit for performing panning control of the eye image in the near infrared imaging mode to ensure that the preview image in the eye image preview window is near infrared light of the image sensor A preview of the imaging area imaging.
  • B16. The mobile terminal of B12, wherein the near-infrared light source is placed under the button on the front side of the mobile terminal.
  • B17. The mobile terminal of B16, wherein the surface of the aperture portion of the near-infrared light source is plated with an infrared anti-reflection film that allows transmission of a light source in the near-infrared band.
  • the mobile terminal of B16 wherein the color of the infrared anti-reflection film is consistent with the color of the front surface of the mobile terminal.
  • B19. The mobile terminal of B12, wherein the screen comprises an auxiliary near-infrared light source, and the auxiliary near-infrared light source of the screen assists the near-infrared light illumination of the biometric feature when in the near-infrared light imaging mode.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Image Input (AREA)
  • Studio Devices (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

一种支持可见光成像模式与近红外光成像模式的复合成像***（100），包括沿着入射光路布置的镜头组件（130）、滤光片组件（120）和图像传感器（110）。镜头组件包括固定焦距的光学透镜。滤光片组件包括允许可见光波段的光通过的可见光带通滤光片（121）和允许近红外光波段通过的近红外光带通滤波器（122）。图像传感器包括可见光成像区域（B）、近红外光成像区域（A）以及这两个区域之间的过渡区域（C）。图像传感器在可见光成像模式和/或近红外光成像模式之一模式下工作，其中可见光成像区域在可见光成像模式下对通过可见光带通滤光片的可见光进行成像，以及近红外光成像区域在近红外光成像模式下对通过近红外光带通滤光片的近红外光进行成像。还公开了一种移动终端。

Description

支持近红外光与可见光成像的复合成像***和移动终端 技术领域
本发明涉及图像处理、生物识别和光学成像技术领域，尤其涉及一种支持可见光成像模式与近红外光成像模式的复合成像***。
背景技术
目前用移动终端作为身份确认的手段主要依赖密码和卡，存在难记忆、易被窃取，安全性低等问题。在众多身份识别技术中，虹膜识别的安全性和精确度最高，具有个体唯一、不需要记忆、不能被窃取，安全级别高等优点。
在当前技术中，在移动终端(比如手机)上加入了虹膜识别的功能，需要在手机的正面增加一颗近红外摄像头模组，和用于自拍的前置可见光摄像头模组是独立存在的。也就是手机的前面板需要开两个孔，一个用于自拍，一个用于虹膜成像，工业设计上复杂而且外观并不美观。
在现有技术中，针对黄、褐色或黑色眼睛的人种，近红外摄像头模组所实现的虹膜成像设计一般采用760nm-880nm频谱波段近红外光成像。这需要额外的近红外光源(760nm-880nm之间)进行补光照明，并且近红外摄像头模组需要能够接收该红外波段的能量。
手机上采用虹膜识别主要用于用户自身的身份识别，用户体验一般需要前置使用。而手机现有的前置自拍摄像头因本身有镀膜过滤无法接受该红外波段的光源或接收到的衰减很大。所以现有技术的虹膜识别需要单独的近红外摄像头进行对虹膜成像，不能够与现有的可见光成像(光谱频率在380-760nm)的摄像头进行复用(比如智能手机现有的前置彩色摄像头)。这些均导致虹膜成像***的体积大大增加， 成本增加，设计复杂，用户体验差，无法微型化集成应用到需求量更广的移动终端。
所以如何能够将使用一颗摄像头进行二合一，既能满足手机正常的前置自拍的可见光成像功能，又能满足近红外光成像的生物识别功能，是当前的一个技术瓶颈。
当前利用单摄像头在近红外光和可见光双波段成像主要有以下几种实现方法：在成像***中增加一个机械式可切换的近红外光滤光片(参见CN203838720U)，使用具有红外和可见光双波段透射光谱的滤光片(参见美国专利US8408821，中国专利公开CN104394306A)，和使用同时集成了可见光和近红外光检测像素的图像传感器(参见美国专利US7915652，中国专利公开CN104284179A)。
其中，机械式可切换的近红外光滤光片由于自身体积相对较大，难以在移动设备上广泛使用。而使用具有红外和可见光双波段透射光谱的滤光片会使得可见光部分和近红外光部分相互干扰，从而影响拍照质量和识别精度。而对于图像传感器的设计，US7915652只涉及到双光谱成像的图像传感器设计，而没有提供整个成像***设计；CN104284179A所用的分区域多光谱滤光片是附着在图像传感器表面的色彩滤镜矩阵(Color Filter Array)，而不是独立的光学滤光片。
发明内容
本发明提供了通过使用固定焦距的镜头组件、滤光片组件和图像传感器来实现近红外光和可见光成像功能复用的生物特征复合成像***的设计，以及包括该复合成像***的移动终端设计。从而既能满足移动终端正常的前置自拍的可见光成像功能，又能满足近红外光成像的生物识别功能。
附图说明
通过阅读参照以下附图所作的对非限制性实施例所作的详细描 述，本发明的其它特征、目的和优点将会变得更明显：
图1是根据本发明的用于生物特征的复合成像***100的示意图；
图2是镜头组件130对可见光与近红外光清晰成像景深示意图；
图3是根据本发明的带有近红外光源的复合成像***的示意图；
图4是根据本发明实施例的图像传感器内部结构示意图；
图5A至图5D示出了包括复合成像***的移动终端的一个实施例，其中图5A和图5B示出了移动终端的结构配置，以及图5C和图5D示出了移动终端在使用时的用户体验图；以及
图6A至图6D示出了包括复合成像***的移动终端的另一个实施例，其中图6A和图6B示出了移动终端的结构配置，以及图6C和图6D示出了移动终端在使用时的用户体验图。
在附图中，相同或相似的附图标记代表相同或相似的部件。
具体实施方式
本领域的技术人员应当明白本发明可以以脱离这些具体细节的其它实现方式来实现。而且为了不模糊本发明，在当前的说明中省略了已知的功能和结构的并非必要的细节。
下面结合附图对本发明作进一步详细描述。应当注意，附图中各部件的尺寸和位置仅为示意目的，并非严格依比例绘制。
图1是根据本发明的用于生物特征的复合成像***的示意图。如图1所示，该复合成像***100包括图像传感器110、滤光片组件120、镜头组件130。其中，滤光片组件120包括可见光带通滤光片121和近红外光带通滤光片122(图中示出为用反斜线填充)，图像传感器110包括用于近红外光成像的区域A(图中示出为用反斜线填充)、用于可见光成像的区域B以及在A、B区域之间的过渡区域C(示出为用横线填充)。
如图1所示，镜头组件130、滤光片组件120、图像传感器110依次沿着入射光路布置。应当注意，在图1中所示的这三个部件之间 的距离仅仅是示例性的。全光谱光线入射穿过镜头组件130并到达滤光片组件120，其中可见光带通滤光片121允许可见光(例如，波长为380-760nm)通过，而近红外光带通滤光片122允许近红外光(例如，波长为780-880nm)通过。可见光带通滤光片121和近红外光带通滤光片122可以通过镀膜来实现。通过可见光带通滤光片121的可见光基本在图像传感器的区域B成像，而通过近红外光带通滤光片122的近红外光基本在图像传感器的区域A成像。利用图像处理软件可以分别将图像传感器的区域B和A的成像区分开来，其中区域B的成像对应于正常的可见光成像，例如用户使用诸如手机等移动终端进行日常自拍时的成像，而区域A的成像对应于近红外模式下的成像，例如用户在使用手机进行虹膜识别时的成像。这样，可以便捷地实现可见光和近红外光成像之间的切换，而不需要配备运动部件来切换滤光片，大幅度提高了稳定性。
为了确保在成像光路上，图像传感器110能够完全被滤光片组件120所覆盖，在本发明的复合成像***中，滤光片组件120的面积大于图像传感器110的面积。滤光片组件120可以是独立于图像传感器110以外单独的一个元件，或者，也可以通过封装工艺封装在图像传感器的硅片的表面上方。通过近红外光带通滤光片122的近红外光和通过可见光带通滤光片121的可见光在图像传感器的过渡区域C会产生重叠交汇。为了尽可能减少甚至几乎消除过渡区域C的面积，滤光片组件120应靠近图像传感器110，例如，小于2mm,在这个间距范围内光的广角扩散传播很小，甚至可以被忽略。即使图像传感器110存在过渡区域C，其面积有限，且主要对可见光成像有影响。可以通过图像处理软件在可见光图像中去除过渡区域C对应的像素区域，得到可以接受的可见光成像。
图2是镜头组件130对可见光与近红外光清晰成像景深示意图。在根据本发明的复合成像***100中，镜头组件130具有一定的视场角并且接收来自全光谱的光线。镜头组件130使用固定焦距的光学透 镜，该光学透镜对可见光光谱波段清晰成像的景深范围d1与该光学透镜对近红外光光谱波段清晰成像的景深范围d2有重叠，使得***在可见光和近近红外光波段都可以得到清晰的图像，如图2所示。或者，也可以使用可见光与近红外光共焦的消色差光学透镜。
图3是根据本发明的带有近红外光源的复合成像***的示意图，其中除了示出了图1A中的图像传感器110、滤光片组件120、镜头组件130的示意性位置关系外，还进一步示出了近红外光源150。在诸如虹膜之类的生物特征成像中，虹膜信息容易被复杂的外界环境可见光干扰，例如，眼睛表面因窗户反射所形成的可见光反射光斑或者戴眼镜的用户因各种环境灯的反射所形成的反射亮斑可能会遮挡虹膜，进而影响识别率和用户体验。为此，近红外光源150可以包括中心光谱范围例如在780～880nm内的一颗或多颗红外LED，用以对生物特征进行近红外光照射，从而增强生物特征成像效果。近红外光源150可以独立于复合成像***100，如图3所示，也可以作为复合成像***的一部分。近红外光源150在安装时，会有一个特定的发射倾角，仅需要对图3所示的特定成像空间范围α内的生物特征进行近红外波段的照明，而无需对整个成像空间范围β内的物体进行照明。近红外光源150的出射主光轴和成像***的中心光轴不平行，以避免生物特征(例如虹膜)成像时发生“亮瞳”效应，影响生物识别***的性能。近红外光源的发射倾角可以根据不同的物距以及和复合成像***100的相对摆放位置灵活调节。一般地，发射倾角的范围设置在0-45°之间，当物距增大时，倾角可以相应减小。
图4是根据本发明实施例的图像传感器内部结构示意图。
图像传感器110为一个完整的图像传感器像素组合阵列，其通过数据传输接口(比如MIPI接口)，将图像传感器采集的数字图像像素数据传输到后端加密芯片或者处理器。为了同时满足可见光模式成像应用(比如自拍)对比较大的成像范围(对应比较大的视场角)的要求和近红外光成像应用(比如虹膜成像)对图像分辨率(单位面积内 的像素数)的精度和最小分辨率要求，本发明的复合成像***100中的图像传感器110可以使用大像素数的图像传感器。以平均直径为11毫米的普通人的虹膜为例，按照ISO标准，图像中单眼虹膜外圆直径需要有120个像素。若在正常使用距离上(30CM)能够用水平FOV为60度的镜头进行虹膜识别，这需要图像传感器水平方向至少具备3773个像素，按照16:9的图像宽高比，垂直方向需要有2120个像素，即总像素数量是8M。考虑实际图像传感器在水平和垂直方向上的像素数，优选使用像素数在8M以上的CMOS图像传感器，例如13M像素的CMOS图像传感器(4680(W)x3456(H))。
如图4所示，在生产过程中，一般会在图像传感器硅基116上添加微型透镜112和色彩滤镜114这两种部件。通常，需要在图像传感器的像素区域上提供对应的色彩滤镜来对色彩进行滤除。根据本发明的一个实施例，与传统方案不同，色彩滤镜114并不覆盖图像传感器的全部硅基116，而是覆盖其中的可见光成像区域，即，只有图像传感器的可见光区域B具有色彩滤镜114，然后微型透镜112附着在色彩滤镜114上；而在近红外光成像区域A则去除了色彩滤镜，微型透镜112直接附着在图像传感器的硅基上。去除色彩滤镜的设计可以提升对应的图像传感器区域A对于近红外光谱范围的相应的频谱敏感度，并且提升了对760-880nm近红外波段的光能量的吸收，从而优化增强该区域对于虹膜成像的图像效果。这样，用较小能量的红外LED光源也可以保持较强近红外光谱能量的接收，能够对更丰富的虹膜细节进行成像，从而降低了本发明***对主动照明光源的功耗需求，并且实现了针对移动终端设备近红外生物特征成像低功耗的设计。
图像传感器110的过渡区域C的面积较小，为了简化描述，在图4中省略了过渡区域C。可以根据需要对过渡区域C对应的色彩滤镜采取保留或者去除设计。
如上所述，本发明实施例的复合成像***创新地采用了双波段滤光片设计，并且可以进一步采用改进型分区域成像的图像传感器，其中， 可见光成像区域具有色彩滤镜，而在近红外光成像区域上去除色彩滤镜。利用这样的结构设计，图像传感器可以在不同区域输出分别对应于可见光和近红外光波段的像素数据，从而可以方便地在可见光成像模式和近红外光成像模式下切换，例如用户可以点击移动终端触摸屏上显示的按键或者实体按键来切换成像模式。在可见光成像模式下(如日常自拍)，可以仅输出图像传感器的可见光成像区域的成像，并且还可以进一步通过图像处理软件去除图像传感器的过渡区域的成像，所采集的图像不会受到近红外光的影响而偏红。在用于生物特征识别的近红外光成像模式下，图像传感器可以仅输出近红外光成像区域的成像，所采集的生物特征图像不会受各种复杂环境可见光的影响而产生环境噪声。
和现有技术不同，本发明不需要对滤光片进行物理上的位置切换，而是仅通过软件即可实现可见光与近红外光成像模式的切换和复用，并且无需针对滤光片的运动部件，能够在移动终端的跌落环境下增强***和结构的稳定性。
在可见光成像模式下，软件控制图像信号处理器ISP选择对应的可见光成像区域工作，调用相应的可见光成像的ISP参数设置使得可见光成像的效果优化。如果在近红外光成像模式下，则ISP选择对应的近红外光成像区域工作，调用相应的近红外光成像的ISP参数设置使得近红外光成像的效果优化。特别地，针对虹膜识别，因为有主动红外照明而且照明光源稳定，需要修改ISP参数相应降低图像传感器CMOS的信号增益，增大图像传感器CMOS的对比度，降低图像传感器CMOS的噪声，增大图像传感器CMOS的信噪比，从而有利于提高虹膜成像质量。
考虑到生物特征信息的敏感性，复合成像***还可以包括图像加密单元，以便提供对获取的生物特征图像进行加密的功能。该图像加密单元可以由处理器(未示出)来实现或者包括在处理器当中，或者以独立模块单元的方式被包括在图像传感器或者复合成像***的模 组中。在复合成像***进入近红外光成像模式，并获取了红外图像之后，图像加密单元启动图像加密功能，对得到的生物特征图像进行加密，并输出加密后的数据，以供进一步处理。在复合成像***进入可见光成像模式时，图像加密单元并不会启动，也不对获得的可见光图像进行加密，这样图像传感器直接输出获得的可见光图像。
图5A至图5D示出了包括本发明的复合成像***的移动终端100的一个实施例。其中图5A和5B示出了移动终端100的结构配置，以及图5C和图5D分别示出了移动终端分别在虹膜识别模式和自拍模式下使用时的用户体验图。
如图5A所示，移动终端100包括实现为摄像头模组的复合成像***100、近红外光源150和屏幕。近红外光源150可以包括780～880nm波段范围内的一颗或多颗红外LED。复合成像***100被布置于移动终端屏幕正面的一侧，比如屏幕顶部或者屏幕底部，在图5A中为顶部。在本实施例中，近红外光源150和复合成像***100被布置于移动终端屏幕正面的同一侧，在图中示出为均布置于屏幕正面顶部，即，位于屏幕的N方向，其中近红外光源150的位置与复合成像***100的中心的水平距离在2-8厘米范围内，这有利于佩戴眼镜用户使用时的反射光斑的消除。
近红外光源150放置于移动终端的触摸板(Touch Panel)之下，例如，近红外光源150可以置于移动终端的正面按键底层(沿移动终端厚度方向的下方)，如Home(返回桌面)键底层，这样不必在其他位置专门开孔导致影响视觉外观。近红外光源开孔部分的触摸板表面可以镀红外增透膜，与移动终端正面整体颜色一致，镀膜颜色可选银白色、金色、黑色。
如图5A所示，复合成像***100在屏幕的N方向，即沿移动端长度方向的上方，屏幕在复合成像***100的S方向上。在这种情况下，滤光片组件120和图像传感器110按如图5B所示的方式进行配置：可见光带通滤光片121置于近红外光带通滤光片122的上方(即， N方向)，对应的图像传感器的可见光成像区域B置于近红外光成像区域A的上方(N方向)。过渡区域C位于可见光成像区域和近红外光成像区域之间。在本实施例中，可见光成像区域的面积大于图像传感器的面积的50％，以及近红外光成像区域的面积小于图像传感器的面积的50％，过渡区域C位于可见光成像区域和近红外光成像区域之间，其面积小于图像传感器的面积的15％。在这两个区域上下排列的情况下，可以优选设计为：可见光光成像区域高度为整个图像传感器高度的80％，近红外光光成像区域高度为整个图像传感器高度的20％。
当处于近红外光成像模式时，可以在屏幕中提供眼部图像预览窗口160。该眼部图像预览窗口160仅输出对应的近红外光成像区域(即生物特征成像)的图像，用于引导用户配合采集生物特征图像。在使用时，眼部图像预览窗口160的位置可以在移动终端的屏幕上被置于靠近屏幕的上侧或下侧。在本实施例中，如图5A和5C所示，该眼部图像预览窗口160位于屏幕靠上的区域，也就是靠近复合成像***100的一侧，这有利于在使用时，使用户的眼睛自然注视复合成像***100的方向，从而降低人眼上眼皮和睫毛对虹膜纹理特征的遮挡，以便得到更优、更丰富的虹膜图像，有利于进行识别。此时，用户可以如图5C所示，使移动终端的上部(即包含复合成像***100的一侧)朝靠近用户侧的方向倾斜，使得用户在注视眼部图像预览窗口160时，其双眼的图像能够输出在该眼部图像预览窗口160中，从而能够采集到生物特征图像(例如，虹膜图像)以用于后续的预处理或加密识别过程。具体地，复合成像***100采集来自生物特征的可见光和近红外光。由于透镜成像倒立的原理，来自生物特征的近红外光经过复合成像***100进入移动终端内部，并且经过位于下方(S)的近红外光带通滤光片122而到达图像传感器的同样位于下方(S)的近红外光成像区域，从而对生物特征进行近红外光成像。将近红外光源150置于移动终端上方，有助于当移动终端上部朝靠近用户的方向倾斜时更充分地对生物特征(例如虹膜)进行照明。为保证近红外光源对生物特征的充分照明，在本实施例中，近 红外光源150的发射方向可以朝***100或者移动终端屏幕上部方向适当倾斜一定角度，如图5C所示。近红外光源150的发射倾角可以根据不同的物距以及不同的***的摆放位置灵活调节。在可见光成像模式下，例如用户日常的自拍，如图5D所示，移动终端上部不需要像图5C中那样朝靠近用户侧的方向倾斜，近红外光源150不工作。用户注视屏幕中部，与近红外光成像模式相比，自拍感兴趣区域的光线主要经过位于上方(N)的可见光带通滤光片121而到达图像传感器的同样位于上方(N)的可见光成像区域，获得自拍图像。
图6A至图6D示出了包括本发明的复合成像***的移动终端100的另一个实施例。其中图6A和6B示出了移动终端100的结构配置，以及图6C和图6D分别示出了移动终端分别在虹膜识别模式和自拍模式下使用时的用户体验图。与图5A至5D的实施例相比，在图6A至图6D的实施例中，近红外光源150位于屏幕的下部(即，S方向)，而复合成像***100位于屏幕上部(即N方向)。滤光片组件120和图像传感器110按如图6B所示的方式进行配置：可见光带通滤光片121置于近红外光带通滤光片122的下方(S)；以及图像传感器的可见光成像区域B置于近红外光成像区域A的下方(S)，过渡区域C位于可见光成像区域B和近红外光成像区域A之间。
与图5A至5D的实施例相类似地，当使用时，在移动终端进入近红外光成像模式对生物特征进行近红外光成像(例如进入虹膜识别模式)时，可以在屏幕靠上的区域提供眼部图像预览窗口160，用于引导用户配合采集生物特征图像。这有利于使用户的眼睛自然注视复合成像***100的方向，从而降低人眼上眼皮和睫毛对虹膜纹理特征的遮挡，以便得到更优、更丰富的虹膜图像，有利于进行识别。此时，用户可以如图6C所示的使移动终端的上部(即包含复合成像***100的一侧)朝远离用户侧的方向倾斜，使得用户在注视眼部图像预览窗口160时，通过图像平移单元(未示出)进行平移控制来确保该眼部图像预览窗口160中的预览图像为图像传感器的近红外光成像区域成像的预览， 使得用户双眼的图像能够输出在该眼部图像预览窗口160中，从而能够采集到生物特征图像(例如，虹膜图像)以用于后续的预处理或加密识别过程。如果预览窗口置于移动终端的屏幕区域的下部，则会导致用户在使用过程中虹膜纹理被上眼皮和睫毛遮挡，所以本发明不倾向于这种配置。在本实施例的配置中，将近红外光源150置于移动终端下方，这样当移动终端上部远离用户倾斜时可以使生物特征(例如虹膜)被更充分地照明。为保证近红外光源对生物特征的充分照明，在本实施例中，近红外光源150的发射方向可以朝***100或者移动终端屏幕上部方向倾斜一定角度。近红外光源150的倾角可以根据不同的物距以及不同的***的摆放位置灵活调节。在可见光成像模式下，例如用户日常的自拍，如图6D所示，移动终端上部可以朝靠近用户侧的方向倾斜，近红外光源150不工作。
此外，可以在移动终端前置的显示的屏幕中加入辅助近红外光源(未示出)。当移动终端处于近红外光成像模式下时，所述辅助近红外光源能够对所述生物特征进行辅助近红外光照明，从而节省移动终端上设置的近红外光源的功率。可以通过软件的控制而点亮屏幕局部的红外屏幕部分对人眼虹膜进行照明，而在正常模式下可用OLED光源对屏幕进行照明。
本发明的复合成像***和移动终端至少具有如下优点：
1)单摄像头模组在可见光和近红外光成像模式下工作，简化了硬件设计，没有运动部件来切换滤光片，大幅度提高了稳定性，并利用软件可实现可见光和近红外光成像模式之间的切换。
2)保证移动设备前置摄像头的正常使用，比如自拍，而且可以在用户正常使用的距离上(比如20-50厘米)采集到满足生物特征(例如，虹膜)识别要求的红外生物特征图像，不影响用户体验。
3)分区域近红外光成像只需要图像传感器的一部分区域接收到近红外光源的照明，而不是整个图像传感器，从而降低了图像传感器对红外照明光源的总功耗需求，即用较小能量和较小发射角的红外 LED光源也可以保持该红外区域足够的近红外光谱能量的吸收，以得到纹理细节丰富的生物特征图像。
4)本发明的复合成像***可以对获取的生物特征图像进行加密，保证用户的个人敏感信息的安全性。
本发明以虹膜识别为例来说明本发明的成像功能复用的复合成像***。然而本发明的各方面并不局限于对人眼虹膜的识别，还可以应用到能够用于身份识别的其他生物特征，例如，眼白、指纹、视网膜、鼻子、人脸(二维或三维)、眼纹、唇纹以及静脉。
在此所使用的术语仅用于描述特定实施例的目的，而并非意欲限制本发明。如在此所使用的那样，单数形式的“一个”、“这个”意欲同样包括复数形式，除非上下文清楚地另有所指。还应当理解，当在此使用时，术语“包括”指定出现所声明的特征、整体、步骤、操作、元件和/或组件，但并不排除出现或添加一个或多个其他特征、整体、步骤、操作、元件、组件和/或其群组。
除非另外定义，否则在此所使用的术语(包括技术术语和科学术语)具有与本发明所属领域的普通技术人员所共同理解的相同意义。在此所使用的术语应解释为具有与其在该说明书的上下文以及有关领域中的意义一致的意义，而不能以理想化的或过于正式的意义来解释，除非在此特意如此定义。
A8.如A1所述的复合成像***，其中滤光片组件的面积大于图像传感器的面积。A9.如A1所述的复合成像***，其中图像传感器在人眼双眼的水平方向的图像分辨率大于2400个像素。A10.如A1所述的复合成像***，其中图像传感器包括色彩滤镜，其中色彩滤镜仅覆盖图像传感器的可见光成像区域。A11.如A1所述的复合成像***，其中滤光片组件与图像传感器距离小于2mm。
B15.如B14所述的移动终端，还包括图像平移单元，用于在近红外成像模式下将眼部图像进行平移控制来确保该眼部图像预览窗口中的预览图像为图像传感器的近红外光成像区域成像的预览。 B16.如B12所述的移动终端，其中近红外光源放置在移动终端正面的按键下层。B17.如B16所述的移动终端，其中近红外光源开孔部分的表面镀有允许近红外波段的光源透过的红外增透膜。B18.如B16所述的移动终端，其中红外增透膜的颜色与移动终端正面颜色一致。B19.如B12所述的移动终端，其中屏幕包括辅助近红外光源，当处于近红外光成像模式下时，屏幕的辅助近红外光源对所述生物特征进行辅助近红外光照明。
尽管上述已详细描述了一些实施例，但其他的修改是可能的。例如，为了实现期望的结果，在图中所描绘的逻辑流程不需要所示出的特定顺序，或连续的顺序。可提供其他的步骤，或者可从所描述的流程消除某些步骤，并且可以对所描述的***增加其他的部件或从所描述的***中去除组件。其他的实施例可以在之后的权利要求的范围内。

Claims (10)

  1. 一种支持可见光成像模式与近红外光成像模式的复合成像***，包括沿着入射光路布置的镜头组件、滤光片组件和图像传感器，其中：
    所述镜头组件包括固定焦距的光学透镜；
    所述滤光片组件包括允许可见光波段的光通过的可见光带通滤光片和允许近红外光波段通过的近红外光带通区域；以及
    所述图像传感器包括可见光成像区域、近红外光成像区域以及这两个区域之间的过渡区域，所述图像传感器在可见光成像模式和/或近红外光成像模式之一模式下工作，其中所述可见光成像区域在所述可见光成像模式下对通过所述可见光带通滤光片的可见光进行成像，以及所述近红外光成像区域在所述近红外光成像模式下对通过所述近红外光带通滤光片的近红外光进行成像。
  2. 如权利要求1所述的复合成像***，其中该固定焦距的光学透镜对可见光光谱波段清晰成像的景深范围与该光学透镜对近红外光光谱波段清晰成像的景深范围有重叠。
  3. 如权利要求1所述的复合成像***，其中所述该固定焦距的光学透镜包括可见光与近红外光共焦的消色差光学透镜。
  4. 如权利要求1所述的复合成像***，进一步包括：
    近红外光源，在近红外成像模式下对感兴趣区域进行近红外波段的照明。
  5. 如权利要求3所述的复合成像***，其中近红外光源的出射主光轴和成像***的中心光轴不平行。
  6. 如权利要求1所述的复合成像***，进一步包括：
    图像加密单元，用于对由所述图像传感器所生成的图像进行加密。
  7. 如权利要求5所述的复合成像***，其中：
    当在所述近红外光成像模式下由所述图像传感器生成近红外光图像之后，所述图像加密单元对得到的生物特征的近红外光图像进行加密并且输出加密后的图像；以及
    在所述可见光成像模式下时，所述图像加密单元不对所述图像传感器生成的可见光图像加密。
  8. 一种支持可见光成像模式与近红外光成像模式的移动终端，包括：
    如权利要求1-7中任一项所述的复合成像***；
    近红外光源，用于在近红外光成像模式下对包含感兴趣的生物特征的区域进行近红外波段的照明，其中近红外光源被布置为具有朝移动终端屏幕上部方向的特定发射倾角；
    屏幕，用于在近红外光成像模式下提供用于引导用户配合采集生物特征图像的眼部图像预览窗口，所述眼部图像预览窗口被设置于靠近该复合成像***的一侧，对所述图像传感器的近红外光成像区域的成像进行预览输出。
  9. 如权利要求8所述的移动终端，其中：
    所述复合成像***和所述近红外光源均布置于屏幕的上部，所述滤光片组件的可见光带通滤光片布置于所述近红外光带通滤光片上方，所述图像传感器的可见光成像区域布置于所述近红外光成像区域的上方。
  10. 如权利要求8所述的移动终端，其中：
    所述复合成像***布置于屏幕的上部，所述近红外光源布置于屏幕的下部，所述滤光片组件的可见光带通滤光片布置所述近红外光带通滤光片下方，所述图像传感器的可见光成像区域布置于所述近红外光成像区域的下方。
PCT/CN2016/077101 2016-03-23 2016-03-23 支持近红外光与可见光成像的复合成像***和移动终端 WO2017161520A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201680085013.0A CN109076147B (zh) 2016-03-23 2016-03-23 支持近红外光与可见光成像的复合成像***和移动终端
PCT/CN2016/077101 WO2017161520A1 (zh) 2016-03-23 2016-03-23 支持近红外光与可见光成像的复合成像***和移动终端

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/077101 WO2017161520A1 (zh) 2016-03-23 2016-03-23 支持近红外光与可见光成像的复合成像***和移动终端

Publications (1)

Publication Number Publication Date
WO2017161520A1 true WO2017161520A1 (zh) 2017-09-28

Family

ID=59899878

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/077101 WO2017161520A1 (zh) 2016-03-23 2016-03-23 支持近红外光与可见光成像的复合成像***和移动终端

Country Status (2)

Country Link
CN (1) CN109076147B (zh)
WO (1) WO2017161520A1 (zh)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108685563A (zh) * 2018-06-20 2018-10-23 河北大学 手机套件、多功能手机及基于手机的近红外成像方法
CN110175493A (zh) * 2018-07-13 2019-08-27 神盾股份有限公司 光学指纹感测装置
CN110798602A (zh) * 2019-11-29 2020-02-14 维沃移动通信有限公司 摄像模组、电子设备、拍摄控制方法及装置
CN112135004A (zh) * 2019-06-25 2020-12-25 株式会社理光 图像处理装置、图像形成装置及图像处理方法
CN112135003A (zh) * 2019-06-25 2020-12-25 株式会社理光 图像处理装置、图像形成装置及图像处理方法
US11076080B2 (en) 2019-12-05 2021-07-27 Synaptics Incorporated Under-display image sensor for eye tracking
CN113225485A (zh) * 2021-03-19 2021-08-06 浙江大华技术股份有限公司 图像采集组件、融合方法、电子设备及存储介质
US11153513B2 (en) 2019-08-19 2021-10-19 Synaptics Incorporated Light source for camera
US11516374B2 (en) 2019-06-05 2022-11-29 Synaptics Incorporated Under-display image sensor

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI729813B (zh) * 2020-05-18 2021-06-01 友達光電股份有限公司 血管成像系統

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010026400A1 (en) * 2000-03-28 2001-10-04 Fuji Photo Optical Co., Ltd. Dual-use visible-light/infrared image pickup device
CN202794585U (zh) * 2012-08-30 2013-03-13 广州中国科学院先进技术研究所 一种多通道集成滤光片
CN104301633A (zh) * 2014-11-03 2015-01-21 倪蔚民 移动终端可见光和生物识别组合光电成像***及方法
CN104394306A (zh) * 2014-11-24 2015-03-04 北京中科虹霸科技有限公司 用于虹膜识别的多通道多区域镀膜的摄像头模组及设备
CN105338227A (zh) * 2014-08-06 2016-02-17 南昌欧菲光电技术有限公司 成像模组及移动终端

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102004001556A1 (de) * 2004-01-10 2005-08-04 Robert Bosch Gmbh Nachtsichtsystem für Kraftfahrzeuge mit partiellem optischem Filter
JP2011237638A (ja) * 2010-05-11 2011-11-24 Fujifilm Corp 撮影装置
CN102510450A (zh) * 2011-10-17 2012-06-20 北京瑞澜联合通信技术有限公司 图像传感器、摄像装置及图像数据生成方法
CN103152517B (zh) * 2013-02-06 2018-06-22 北京中科虹霸科技有限公司 用于移动虹膜识别设备的成像模组及移动设备
EP3010393B1 (en) * 2013-06-18 2019-08-07 Delta ID Inc. Optimized imaging apparatus for iris imaging
CN103870805B (zh) * 2014-02-17 2017-08-15 北京释码大华科技有限公司 一种移动终端生物特征成像方法和装置
CN103870819B (zh) * 2014-04-04 2016-03-09 苏州思源科安信息技术有限公司 移动终端安全身份认证的虹膜识别光学成像模组及使用法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010026400A1 (en) * 2000-03-28 2001-10-04 Fuji Photo Optical Co., Ltd. Dual-use visible-light/infrared image pickup device
CN202794585U (zh) * 2012-08-30 2013-03-13 广州中国科学院先进技术研究所 一种多通道集成滤光片
CN105338227A (zh) * 2014-08-06 2016-02-17 南昌欧菲光电技术有限公司 成像模组及移动终端
CN104301633A (zh) * 2014-11-03 2015-01-21 倪蔚民 移动终端可见光和生物识别组合光电成像***及方法
CN104394306A (zh) * 2014-11-24 2015-03-04 北京中科虹霸科技有限公司 用于虹膜识别的多通道多区域镀膜的摄像头模组及设备

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108685563A (zh) * 2018-06-20 2018-10-23 河北大学 手机套件、多功能手机及基于手机的近红外成像方法
CN110175493A (zh) * 2018-07-13 2019-08-27 神盾股份有限公司 光学指纹感测装置
CN110175493B (zh) * 2018-07-13 2021-04-16 神盾股份有限公司 光学指纹感测模块
US11516374B2 (en) 2019-06-05 2022-11-29 Synaptics Incorporated Under-display image sensor
CN112135004A (zh) * 2019-06-25 2020-12-25 株式会社理光 图像处理装置、图像形成装置及图像处理方法
CN112135003A (zh) * 2019-06-25 2020-12-25 株式会社理光 图像处理装置、图像形成装置及图像处理方法
US11153513B2 (en) 2019-08-19 2021-10-19 Synaptics Incorporated Light source for camera
CN110798602A (zh) * 2019-11-29 2020-02-14 维沃移动通信有限公司 摄像模组、电子设备、拍摄控制方法及装置
US11076080B2 (en) 2019-12-05 2021-07-27 Synaptics Incorporated Under-display image sensor for eye tracking
CN113225485A (zh) * 2021-03-19 2021-08-06 浙江大华技术股份有限公司 图像采集组件、融合方法、电子设备及存储介质

Also Published As

Publication number Publication date
CN109076147B (zh) 2021-03-02
CN109076147A (zh) 2018-12-21

Similar Documents

Publication Publication Date Title
WO2017161520A1 (zh) 支持近红外光与可见光成像的复合成像***和移动终端
US10579871B2 (en) Biometric composite imaging system and method reusable with visible light
CN205666883U (zh) 支持近红外光与可见光成像的复合成像***和移动终端
US10520732B2 (en) Head-mounted display eyeball tracker integrated system
KR100383712B1 (ko) 다중 조명원을 이용해 안경을 통해 눈을 조명하고촬영하는 방법 및 장치
JP6539654B2 (ja) 視線検知装置
US20170140221A1 (en) Dual function camera for infrared and visible light with electrically-controlled filters
US9690970B2 (en) Method and device for mobile terminal biometric feature imaging
US20180131880A1 (en) System and method of efficient illuminator-sensor synchronization to capture images
CN206370880U (zh) 一种双摄像头成像***和移动终端
WO2017049923A1 (zh) 一种多功能移动图像处理装置、处理方法及用途
WO2016058528A1 (zh) 一种移动终端前置和人脸/虹膜识别一体化光电成像***及方法
US20170061210A1 (en) Infrared lamp control for use with iris recognition authentication
WO2016041437A1 (zh) 用于移动终端的虹膜识别成像模组及图像获取方法
US20100278394A1 (en) Apparatus for Iris Capture
US20220197376A1 (en) Event camera system for pupil detection and eye tracking
KR20150037628A (ko) 생체인식 카메라
US20140104392A1 (en) Generating image information
JP2002330318A (ja) 携帯端末装置
KR20080005972A (ko) 다중분광 생체계측 센서
JP4385284B2 (ja) 撮像装置及び撮像方法
CN216625895U (zh) 电子设备
CN108108708A (zh) 支持多光谱生物特征的复合成像***及移动终端
CN108292424A (zh) 指静脉认证装置
CN113439912A (zh) 一种可穿戴设备

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16894875

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16.01.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16894875

Country of ref document: EP

Kind code of ref document: A1