CN109791325A - Optical sensor module under equipment with periphery tasks column viewing area and the LCD screen for shielding upper fingerprint sensing - Google Patents

Optical sensor module under equipment with periphery tasks column viewing area and the LCD screen for shielding upper fingerprint sensing Download PDF

Info

Publication number
CN109791325A
CN109791325A CN201880003627.9A CN201880003627A CN109791325A CN 109791325 A CN109791325 A CN 109791325A CN 201880003627 A CN201880003627 A CN 201880003627A CN 109791325 A CN109791325 A CN 109791325A
Authority
CN
China
Prior art keywords
optical
light
viewing area
lcd
sensing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201880003627.9A
Other languages
Chinese (zh)
Other versions
CN109791325B (en
Inventor
何毅
皮波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Goodix Technology Co Ltd
Original Assignee
Shenzhen Huiding Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/708,088 external-priority patent/US10410033B2/en
Application filed by Shenzhen Huiding Technology Co Ltd filed Critical Shenzhen Huiding Technology Co Ltd
Publication of CN109791325A publication Critical patent/CN109791325A/en
Application granted granted Critical
Publication of CN109791325B publication Critical patent/CN109791325B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1626Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1637Details related to the display arrangement, including those related to the mounting of the display in the housing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • G06V40/1306Sensors therefor non-optical, e.g. ultrasonic or capacitive sensing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • G06V40/1318Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1382Detecting the live character of the finger, i.e. distinguishing from a fake or cadaver finger
    • G06V40/1394Detecting the live character of the finger, i.e. distinguishing from a fake or cadaver finger using acquisition arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1637Details related to the display arrangement, including those related to the mounting of the display in the housing
    • G06F1/1643Details related to the display arrangement, including those related to the mounting of the display in the housing the display being associated to a digitizer, e.g. laptops that can be used as penpads

Abstract

Equipment or system with the display design for including main viewing area and peripheral viewing area, seamless continuous display area is collectively formed in main viewing area and peripheral viewing area, for showing image, interior perhaps information on the area Liang Ge as single display area, and even if also allowing to operate peripheral viewing area independently of main viewing area when main viewing area is extinguished and only showing certain images, information or content on peripheral viewing area.In addition to provide separated with the display function of main display area or display function in combination other than, can be also used for based on the peripheral viewing area of disclosed technology by providing certain sensing functions including one or more sensors under the display area of peripheral viewing area.

Description

Equipment with periphery tasks column viewing area and the LCD screen for shielding upper fingerprint sensing Lower optical sensor module
Priority claim and cross reference to related applications
This patent document require to submit on March 7th, 2017 application No. is 62/468,337, it is entitled " in equipment The U.S. of optical sensor module under the LCD screen for shielding lower fingerprint sensing in display with periphery tasks column viewing area " The equity and priority of temporary patent application.
This patent document also require submit on September 18th, 2017 application No. is 15/708,088, entitled " be used for The equity and priority of the U.S. Patent application of optical sensor module under the LCD screen of fingerprint sensing on screen ", and it is the beauty The part continuation application of state's patent application.
Technical field
This patent document is related to the electronic equipment for the optical sensor module for having under display and device display or is System, optical sensor module are used for based on the optical sensing in the electronic equipments such as mobile device or wearable device or larger system Execute one or more sensing operations, such as fingerprint measurement or other parameters measurement.
Background technique
Electronic equipment or the display of system are the piths for executing the user interface of user function and equipment operation, and And display allows to show information to user in a variety of manners and executes operation by user.This display can be configured to touch Quick display screen, to provide touch-sensing operation, as the additional interaction between user and electronic equipment and by communication link or Network and communication or interaction that other people carry out.
Furthermore it is possible to realize various sensors, in electronic equipment or system to provide certain desired functions.In movement In some designs of phone, tablet computer and other portable devices, certain sensors can be placed in outside display screen but also exist In the identical faces of equipment where the display screen.Before the example of some sensors in some smart phones or tablet computer includes Set camera, proximity sensor, ambient light sensor or other kinds of sensor (such as projector and for face recognition at As sensor).
Sensor for user authentication is for including that calculate equipment (such as laptop, flat for portable or mobile Plate computer, smart phone) equipment, game system, various databases, information system or the system of biggish computer control Another example of sensor, these equipment or system can protect personal data using User identification mechanism and prevent from not awarded The access of power.User authentication on electronic equipment can be executed by one or more forms of biometric identifier, this Kind biometric identifier can be used alone or use on the basis of ordinary cryptographic authentication method.Biometric identifier A kind of common form is exactly the fingerprint pattern of people.Fingerprint sensor can it is built-in in the electronic device, to read the fingerprint of user Pattern, so that the equipment can only be unlocked by the authorized user of equipment by authenticating the fingerprint pattern of the authorized user.For electricity Another example of the sensor of sub- equipment or system is biomedical sensor, such as wearable as wrist wearing devices or wrist-watch Heartbeat sensor in equipment.In short, different sensors can be provided in the electronic device to realize different sensing operations And function.
Fingerprint can be used for authenticating user to access system, electronic databank or the information of electronic equipment, computer control System can be used as independent authentication method or tie with other one or more authentication methods (such as cipher authentication method) It closes and uses.E.g., including the electronics that the portable or mobile of laptop, tablet computer, smart phone etc. calculates equipment is set Standby and game system can protect personal data using User identification mechanism and prevent uncommitted access.In another example In, the equipment or system controlled for tissue or the computer or computer of enterprise, which should be protected to, only allows authorized person to visit It asks, to protect the equipment of the tissue or enterprise or the information or use of system.Be stored in portable device and computer control Information in database, equipment or system substantially can be personal information, such as personal contact person or telephone directory, personal photograph Piece, personal health information or other personal information, or the confidential information of tissue or enterprise-specific, such as Business Financial Information, Employee's data, business secret and other Proprietary Informations.If the safety of access electronic equipment or system is damaged, this A little data may be accessed by other people, cause the forfeiture of individual privacy or the loss of valuable confidential information.In addition to information Except safety, also allow guarantee by computer or calculating the secure access of equipment or system that computer and computer control The use of the equipment or system of the control of machine processor, such as the automobile and the other systems such as ATM of computer control.
Summary of the invention
This patent document is disclosed for including that the electronic equipment of main viewing area and peripheral viewing area or the display of system are set Seamless continuous display area is collectively formed in meter, main viewing area and peripheral viewing area, in two as single display area Image, interior perhaps information are shown in a area, and even if also allow to operate independently of main viewing area outer when main viewing area is extinguished Viewing area is enclosed, certain images, information or content are only shown on peripheral viewing area.In some realization sides as shown in the following example In formula, when realizing main viewing area and peripheral viewing area based on LCD display technology, the area Liang Ge can share identical backlight module, So that the area Liang Ge is all available when backlight module is opened, furthermore it is possible to provide as the fill light source for peripheral viewing area Independent illumination backlight light source, with allow its main viewing area and for the area Liang Ge share backlight module close when operation. In addition to provide separated with the display function of main viewing area or display function in combination other than, the periphery based on disclosed technology Viewing area can be also used for providing certain senses by including one or more sensors under the display area of peripheral viewing area Brake.
On the one hand, the technology disclosed in this patent document can be implemented as constructing one kind and can be detected by optical sensing The electronic equipment of fingerprint, the electronic equipment include: liquid crystal display (liquid crystal display, LCD) screen, provide touch Sensing operation and including LCD display panel structure for displaying images, wherein LCD display includes that (1) is aobvious with LCD Show the main viewing area of pixel and the peripheral viewing area with LCD display pixel, wherein the common shape in main viewing area and peripheral viewing area At the seamless continuous display area LCD, and (2) LCD backlight module, the backlight for illuminating main viewing area and peripheral viewing area is provided; Specified peripheral viewing area lighting module is placed relative to LCD screen, and is configured to generate illumination light, and by illumination light It only guides to peripheral viewing area, so that peripheral viewing area can show image or information independently of main viewing area and can be LCD backlight module can operate when closing to show image or information;Top clear is formed on LCD screen, as touching Touch user's touch interface of sensing operation and as being used for transmission the light from LCD screen so that image or information are shown to user Interface;And optical sensor module, it is located at below LCD display panel structure, and be configured to receive and come from and periphery Viewing area contact or close target and pass through the detection light of LCD screen and detect fingerprint.
On the other hand, the technology disclosed in this patent document can be implemented as constructing one kind and can be examined by optical sensing Survey fingerprint electronic equipment, which includes: liquid crystal display (LCD) display panel structure, for show image or information and For providing touch-sensing operation, LCD display panel structure includes LCD layer, light diffuser layer, ducting layer and reflective optical system layer, The LCD layer is used to show image or information, the main viewing area by handling the illumination backlight in main viewing area and peripheral viewing area Viewing area is collectively formed the seamless continuous display area LCD with the periphery, the light diffuser layer for diffuse the main viewing area and Illumination backlight in the periphery viewing area, the ducting layer is for receiving illumination backlight and guiding the illumination backlight received to this Main viewing area and the periphery viewing area and the reflective optical system layer are used to reboot illumination backlight into the main viewing area and be somebody's turn to do In the LCD layer for display operation of peripheral viewing area, each layer in light diffuser layer and reflective optical system layer is configured to It include hole or channel at selection area in the peripheral viewing area of LCD display panel structure, to allow light to be transmitted.The equipment is also Include: LCD backlight module, be coupled to the ducting layer of the LCD display panel structure, to generate to the LCD layer for showing image Or the backlight of information;Specified peripheral viewing area lighting module is placed for generating illumination light, and illumination light is only guided To the periphery viewing area, the periphery viewing area is enable to show image or information independently of main viewing area and can be in the LCD Backlight module can operate when closing to show image or information;Top clear is formed on the LCD display panel structure, As the user's touch interface operated for touch-sensing;Optical sensor module is located at below the LCD display panel structure, Fingerprint is detected to receive detection light that is from the top clear and passing through the LCD display panel structure;And one or Multiple probe sources are separated with the LCD backlight module, are located under the top clear, are illuminated in peripheral viewing area with generating The detection light in the specified fingerprint sensing region that finger is placed for user in the top clear, to be passed by the optics Sensor module carries out optical finger print sensing.
In another aspect, the technology disclosed in this patent document can be implemented as constructing one kind and can be examined by optical sensing The electronic equipment of fingerprint is surveyed, which includes liquid crystal display (LCD) screen, provides touch-sensing operation and including for display figure The LCD display panel structure of picture.LCD display includes having the main viewing area of LCD display pixel and with LCD display pixel Peripheral viewing area, wherein the seamless continuous display area LCD is collectively formed in main viewing area and peripheral viewing area.LCD display It may include: LCD backlight module, the backlight for illuminating main viewing area and peripheral viewing area be provided;And specified peripheral viewing area Lighting module, only viewing area provides illumination light to the periphery, so that peripheral viewing area shows image independently of main viewing area.The equipment Further include: top clear is formed on device screen, as the user's touch interface operated for touch-sensing and is made To be used for transmission interface of the light from display structure image to be shown to user;And optical sensor module, it is located at aobvious At least part shown below panel construction, and be configured as optical sensor module is located at below peripheral viewing area.Optics Sensor module be configured to receive from contacted with peripheral viewing area or close target and pass through the detection light of LCD screen Detect fingerprint.
When realizing the above-mentioned LCD display with (1) main viewing area and (2) peripheral viewing area, control module can be with coupling Main viewing area, peripheral viewing area, LCD backlight module and specified peripheral viewing area lighting module are closed, keeps specified periphery aobvious Show that area's lighting module can illuminate peripheral viewing area when LCD backlight module is closed to show image.In some implementations, Control module may be configured such that the peripheral viewing area of control shows that placing finger at that for user in peripheral viewing area refers to The fingerprint sensing area of line sensing controls peripheral viewing area and shows that message, display allow user starts application or by touching icon Execute the icon or display other information of function.
When stating equipment in realization, optical sensor module may include different optical design, draw for that will detect light Optical detector array is directed to be sensed.In some designs, detection light can be projected onto the case where no lens On optical detector array.In some designs, one or more imaging lens can be used and point to optical detection for light is detected On device array.In some other designs, optical sensor module may include the optics collimator array of optics collimator With the optical detector array of fluorescence detector, optics collimator array is used for for receiving detection light, optical detector array Receive the detection light from optics collimator array.
The following drawings, description and claims are provided to the above and other of disclosed technology and its implementation Aspect and feature more detailed description.
Detailed description of the invention
Figure 1A, Figure 1B, Fig. 1 C and Fig. 1 D show the periphery display of the display with main viewing area and peripheral viewing area The example of the different purposes in area shows certain images, information or interior to allow peripheral viewing area to operate independently of main viewing area Hold, while main viewing area and peripheral viewing area being made to can be used as single seamless continuous display area.
Fig. 2A and Fig. 2 B shows the example of the equipment with LCD display module, to be the identical face LCD under LCD panel Main viewing area and peripheral viewing area in plate provide the specified periphery display of the specified lighting source of the one or more having Area's lighting module.
Fig. 2 C and Fig. 2 D show another example of the equipment with LCD display module, to be identical in LCD panel Main viewing area and peripheral viewing area in LCD panel provide the specified periphery of the specified lighting source of the one or more having Viewing area lighting module.
Fig. 2 E and Fig. 2 F show two examples of the equipment with LCD display module, for the master in identical LCD panel Viewing area and peripheral viewing area provide specified peripheral viewing area lighting module and for illumination light to be only dispersed to peripheral display The specified area illumination waveguide in area.
Fig. 3 A is the exemplary block diagram with the system of fingerprint sensing module, which can be implemented as including in this document Disclosed optical fingerprint sensor.
Fig. 3 B and Fig. 3 C show an example implementations of electronic equipment 200, which, which has, touches Sense display screen component and the optical sensor module below the touch-sensing display screen component.
Fig. 3 D and Fig. 3 E show the example for realizing the equipment of the optical sensor module in Fig. 3 B and Fig. 3 C.
Fig. 4 A and Fig. 4 B show for realizing the design in Fig. 3 B and Fig. 3 C, under display screen component optics and pass The example of one implementation of sensor module.
Fig. 5 A, Fig. 5 B and Fig. 5 C are shown for the sense on the top sensing surface under two different optical conditions The signal for surveying the light of the return in area generates, in order to understand the operation for shielding lower optical sensor module.
Fig. 6 A to Fig. 6 C, Fig. 7, Fig. 8 A to Fig. 8 B, Fig. 9 and Figure 10 A to Figure 10 B, which are shown, shields lower optical sensor module Example design.
Figure 11 is shown under different construction conditions through fingerprint sensing region of the image-forming module in top clear Imaging, wherein imaging device is by the fingerprint sensing regional imaging to optical detector array, and the imaging device can be with It is optical transmission or optical reflection.
Figure 12 shows the example of the operation of fingerprint sensor, which comes from for reducing or eliminating in fingerprint sensing The undesirable influence of bias light.
Figure 13 shows the process for operating optical sensor module under the screen for acquiring fingerprint pattern.
Figure 14, Figure 15 and Figure 16 show for by being determined with the illumination bright finger of two kinds of different light colors and LCD Display screen contact target whether be still-living people finger a part operating process example.
Figure 17 A to Figure 17 B, Figure 18 and Figure 19 A to Figure 19 C are shown to be set for the optics collimator of optical finger print sensing Meter is adapted for carrying out optical sensor module technology under disclosed screen.
Figure 20, Figure 21 A, Figure 21 B, Figure 22 A and Figure 22 B, which are shown, carries out fingerprint sensing using optical sensor module under shielding Various designs example, optical sensor module will carry fingerprint using optics collimator array or pinhole array and believe under the screen The signal light of breath is guided to optical detector array.
Figure 23 and Figure 24 shows the example of optical sensor module under the screen with optics collimator.
Figure 25 shows the example of optics collimator array, which reduces arrival using optical filtering Shield the bias light of the photodetector array in lower optical sensor module.
Figure 26 A, Figure 26 B, Figure 27 and Figure 28 show the optics collimator design that optical sensing is carried out under LCD display Example.
Figure 29, Figure 30 and Figure 31 show the improved light based on the pinhole camera effect in design optical sensor module Learn imaging resolution.
Figure 32 shows the example of optical sensor module under the LCD for carrying out optical sensing using optics pinhole array.
The optics that Figure 33 A and Figure 33 B are shown under the LCD display panel with deflection optical or diffraction device or layer refers to The example of line sensor.
Figure 34 A, Figure 34 B and Figure 34 C show the example of the LCD diffuser design for optical sensing under improved LCD.
Figure 35 A and Figure 35 B show the example of the LCD reflector design for optical sensing under improved LCD.
Figure 36 shows the example of the LCD light source design for optical sensing under improved LCD.
Figure 37 A to Figure 37 D shows the example for the Enhanced feature of optical sensing under improved LCD.
Figure 38 shows the example of the LCD waveguide design for optical sensing under improved LCD.
Figure 39 A to Figure 39 C is shown for the LCD backlight light source of optical sensing under improved LCD and showing for lighting source Example.
Figure 40 shows two different fingerprint patterns of identical finger under different pressing forces: the fingerprint that slightly presses and again Spend the fingerprint of pressing.
Figure 41 A, Figure 41 B and Figure 42 show the specific reality for the optical sensor module being placed under the LCD display of equipment The example of existing mode, the equipment have LCD display module to provide main viewing area and peripheral viewing area in identical LCD panel.
Figure 43 shows typical mankind's thumb and small thumb under several different optics waves from about 525nm to about 940nm The example of the optical transmission spectra profile of finger.
Figure 44 shows the influence of the bias light in the example for shielding lower optical sensor module.
Figure 45 shows the example of the algorithm for design for designing optical filtering in optical sensor module under screen, to subtract The influence of bias light in few optical sensing.
Figure 46 shows two examples in Figure 46 A and Figure 46 B for shielding lower optical sensor module, optical sensing under the screen Device module has the optics collimator array or optics pinhole array before optical detector array, as with small optics A part of the reception optical device of numerical aperture, to reduce the bias light for entering optical detector array.
At the beginning of Figure 47 measures the sensor of baseline background level at optical detector array when showing acquisition fingerprint every time The example of beginning process.
Figure 48 shows the example of the equipment with the optical sensor module being placed under LCD display, by two Detection light of the permeable finger tissue for optical sensing is generated at different positions using two different probe sources.
Figure 49 shows the device examples that the detection light design in Figure 48 is implemented in Figure 42 with LCD display Particular example, the LCD display are configured to provide main viewing area and peripheral viewing area, and by two different positions Place generates detection light of the permeable finger tissue for optical sensing using two different probe sources.
Specific embodiment
This patent document is disclosed for including main viewing area and peripheral viewing area to show image, information, icon and hold The electronic equipment of row user's operation or the display design of system.Two viewing areas be designed to it is placed adjacent one another so that the two Seamless continuous display area can be collectively formed, show image, interior perhaps information as single display area, and into one Step allows to operate peripheral viewing area independently of main viewing area to show certain images, information or content.With main viewing area and outside This combination for enclosing viewing area is provided as common single display area or two individual display areas for showing behaviour Make and for operating user interface a variety of applications.
In addition to provide separated with the display function of main display area or display function in combination other than, based on disclosed The peripheral viewing area of technology can be also used for by under the display area of peripheral viewing area including one or more sensors come Certain sensing functions are provided.For example, peripheral viewing area may include for acquiring the light to be detected by optical sensor module Optical sensing region, the optical sensor module are placed under the peripheral viewing area of device display or nearby carry out optical sensing, To provide optical sensing function, such as optical finger print senses, the optical sensing of other parameters or the target for determining contact are The no optical sensing from still-living people.
For example, peripheral viewing area may include in the equipment with optical sensing function under shielding disclosed in this document For acquiring the optical sensing area for carrying the light of the return to be detected by optical sensor module of fingerprint pattern and other information Domain, the optical sensor module are placed under the peripheral viewing area of device display or nearby carry out optical sensing, include to provide Optical finger print sensing and target for determining contact whether one or more optics of the optical sensing from still-living people etc. Sensing function.Since the technology of two-region design disclosed herein based on adjacent main viewing area and peripheral viewing area can be based on Liquid crystal display (LCD) panel or other display surfaces based on the illumination light of back light except from each LCD display pixel Plate (such as with the sending in each Organic Light Emitting Diode (organic light-emitting diode, OLED) pixel Oled panel based on light) Lai Shixian.
Figure 1A, Figure 1B, Fig. 1 C and Fig. 1 D show the intelligent hand with adjacent main viewing area 10 and peripheral viewing area 20 The example of the different display modes of machine, different display patterns are used for the different purposes of peripheral viewing area 20.With main viewing area 10 and the display of peripheral viewing area 20 be configured to allow for peripheral viewing area 20 to operate independently of main viewing area 10, it is certain to show Image, information or content, while main viewing area being enable to be used together with peripheral viewing area, as single seamless continuous aobvious Show region.In order to illustrate the various features of disclosed two-region display technology, main viewing area 10 and peripheral viewing area 20 can lead to The LCD panel crossed in this example or other examples is realized.
Display in Figure 1A, Figure 1B, Fig. 1 C and Fig. 1 D, which can be, is integrated with touch-sensing layer LCD screen, to provide touch Sensing operation and show image, information and other objects.This LCD screen can be designed to include (1) such as top large area Shown in main viewing area 10 with LCD display pixel and (2) there is LCD display picture such as the smaller strip area in lower part shown in The peripheral viewing area 20 of element.Two viewing areas 10 and 20 are adjacent to each other and integrate, and make winner viewing area 10 and peripheral viewing area 20 It can be collectively formed and be used as single, the seamless and continuous display area LCD.Peripheral viewing area 20 in many implementations It is less than the display area of main viewing area 10, such as bottom taskbar area shown in the specific example as Figure 1A to Fig. 1 D. In the example shown, certain device sensors are placed in except two viewing areas 10 and 20, but certain sensors can be placed in two In a viewing area 10 and 20, such as without the optical sensor module of the display screen external space.
In some implementations of this LCD display, two illumination optical modules: (1) LCD backlight mould can be provided Block, provides the visible backlight for illuminating main viewing area 10 and the LCD pixel in peripheral viewing area 20, and (2) are additional specified outer Viewing area lighting module is enclosed, only the LCD pixel in viewing area 20 generates visible to the periphery, for independently of main viewing area Show image, information and other objects, this is included in the case where main viewing area is closed.For example, two-region shows that equipment may include Top clear is formed on device screen, as the user's touch interface operated for touch-sensing and as with Image is shown to the interface of user in light of the transmission from display structure, also, in various implementations, top transparent Floor can be used as the single seamless layer on the area Shang Liangge of top.
In addition, control module may be coupled to main viewing area 10, peripheral viewing area 20, LCD backlight module and specified outer Viewing area lighting module is enclosed, to control the operation of two viewing areas 10 and 20.For example, this control module can control LCD back Optical module provides backlighting for light to the area Liang Ge 10 and 20, and the LCD pixel controlled in the area Liang Ge executes in Figure 1A to Fig. 1 D Shown in display function various modes, wherein peripheral viewing area 20 can be added in main viewing area 10 as combination it is single Display, or its own information is shown independently of main viewing area 10.For another example, as shown in the example of Figure 1B, control module Specified peripheral viewing area lighting module can be enable to illuminate peripheral viewing area 20 when LCD backlight module is closed to show figure Picture.
In numerous applications, as detailed below, the display panel in display screen can be set in optical sensor module Position below structure, and at least part that can be configured as optical sensor module is located under peripheral viewing area 20 Side.This optical sensor module can be configured to receive from contacted with peripheral viewing area or close target and pass through The detection light of LCD screen come detect fingerprint, other biological metric associated with finger or based on optical sensing other sense Brake.The top surface of display screen may include the fingerprint sensing area (fingerprint sensing, FPS) or region, in fingerprint sense It surveys one or more to carry out fingerprint sensing or progress to illuminate finger in the presence of the detection light below top surface in area or region Other optical sensing operations.The image that the boundary in the specified area FPS can be indicated by display or the image for showing the area FPS will This area FPS is labeled as visible.
Peripheral viewing area 20 in specific example is less than the display area of main viewing area 10, as can provide various function The bottom taskbar area of energy, including display icon, image or other objects (Figure 1A and Fig. 1 C), display information or text message (Figure 1B) and the extension for being shown in the big image shown in main viewing area, so that the area Liang Ge 10 and 20 forms single, nothing Seam and continuous display area (Fig. 1 D).This different display pattern or configuration of two viewing areas 10 and 20 can be by controlling Module control.
For example, in some implementations, control module can be used for controlling peripheral viewing area 20 and show peripheral viewing area Carry out area fingerprint sensing (FPS) of fingerprint sensing or other optical sensings in 20 in that placement finger for user.It is this aobvious The area Shi FPS is one of the object shown in peripheral viewing area 20 in Figure 1A.Control module can be used for controlling peripheral viewing area 20 display icons, the icon allow user starts application or execute function by touching the icon.Referring to Figure 1A and Fig. 1 C.Control Module can control peripheral viewing area 20 and show icon set at the different location in peripheral viewing area.It also as shown in Figure 1A, can To place different icons in peripheral viewing area 20, to allow user to select by touch or user allowed to pass through sliding It touches some or all of the icon currently shown or object icon or the peripheral viewing area 20 of object removal is additional to show Icon, while additional or other icons or object being placed in peripheral viewing area 20.Thus extending can be outside Enclose the function of executing in viewing area 20.
In some other implementations, as shown in Figure 1B, it is aobvious that control module can be used for controlling peripheral viewing area 20 Show message or information.The message or information of display can be duplicate same text message or information, or the difference rolled Text message or information.In the specific screen capture shown in Figure 1B, main viewing area is shown as extinguishing, but in other display moulds In formula, main viewing area 20 can be shone while showing one or more text message or other information using peripheral viewing area It is bright to be shown.
Fig. 2A shows the example of the equipment with LCD display module, to provide main viewing area 10 in identical LCD panel With peripheral viewing area 20.The example includes the touch-sensing display system being placed under the top clear 431 of such as cover-plate glass System, which realizes various operating user interfaces as the surface of user interface, including for example: the touch-sensing of user Operation shows image etc. to user;And finger is received as optical sensing interface and carries out optical finger print sensing and other light Learn sensing operation, wherein detection light is guided to top blind flange glass 431 inside equipment to illuminate finger.It is this specific aobvious Show that exemplary system includes multiple field LCD module 433, which includes providing white backlight for LCD module 433 LCD display backlight module 434 (such as LED light of side-light backlight configuration or the configuration of backlight type backlight), and to be coupled to LCD aobvious The light waveguide-layer 433c for showing back light 434, for receiving backlight and backlight being oriented to LCD structure layer 433a (such as side-light type Backlight configuration).LCD structure layer 433a may include for example liquid crystal (liquid crystal, LC) elementary layer, LCD electrode layer, thoroughly Bright conducting ito layers, two preceding optical polarizators on opposite sides of LCD cell and rear optical polarizator layer have for generating The color-filter layer of the colour filter of color and the touch-sensing layer operated for touch-sensing.As described below, the LCD in Fig. 2A is tied Structure layer 433a is revised as LCD structure layer 433f to adapt to peripheral viewing area.
Multiple field LCD module 433 also includes for managing in the light waveguide-layer 433c from LCD display backlight light source 434 Backlight multiple layers, multiple layer includes: backlight diffuser device layer 433b, top and LCD structure positioned at light waveguide-layer 433c The lower section of layer 433f, the LCD display pixel in LCD structure layer 433f is illuminated by spatial backlight;Optical reflector mould Layer 433d, positioned at the lower section of light waveguide-layer 433c, for backlight to be recycled to LCD structure layer 433a, to improve light utilization efficiency And display brightness.
Different from the multiple field LCD module in various smart phones or other equipment, multiple field LCD module 433 has two A different viewing area: the main viewing area 10 and peripheral viewing area 20 as shown in Figure 1A to Fig. 1 D.Under peripheral viewing area 20, it is Peripheral viewing area 20 provides additional module: specified peripheral viewing area lighting module 436b, illuminates periphery for generating to be used as The illumination light in the small peripheral LCD panel region of the multiple field LCD module 433 of viewing area 20, to allow 20 work of peripheral viewing area Make, though close LCD display backlight light source 434 make the main viewing area 10 of multiple field LCD module 433 due to lacking backlight and When closing.As shown in this example, specified peripheral viewing area lighting module 436b is placed in the lower section of multiple field LCD module 433.? Under this design, the illumination light from specified peripheral viewing area lighting module 436b needs to penetrate optical reflector film layer 433d LCD structure layer 433f is reached with light waveguide-layer 433c and backlight diffuser device layer 433b, in LCD structure layer 433f, is passed through It filters the illumination light received and shows image to control LCD pixel.Therefore, optical reflector film layer 433d is configured in periphery It include fractional transmission area or window in viewing area 20, to allow the illumination light from specified peripheral viewing area lighting module 436b Through.As an example for realizing the target, Fig. 2A shows the sub-translucent knot formed in optical reflector film layer 433d Structure 951e, can be made into the hole that some optical deliveries are provided or other structures.
The optical sensor being formed under the multiple field LCD module 433 in the vicinity of peripheral viewing area 20 is also shown in Fig. 2A The example of module, to provide optical sensing above top clear 431.Specifically, in this example, this optics passes Sensor module includes the optics inspection of fluorescence detector or optical sensor (such as photodiode or other optical sensing elements) Device array 621a is surveyed, for receiving and detecting the optical detection light returned from top clear 431, to carry out optical finger print sensing Or the optical detections such as other optical sensings.One or more optical detection light source 436a are provided under multiple field LCD module 433, Top clear 431 is reached by multiple field LCD module 433 with guidance detection light, is used in peripheral viewing area 20 to illuminate Optical sensing sensing area, and the detection light returned is guided through multiple field LCD module 433 and reaches optical detector array 621a.Therefore, LCD layer 433f can be configurable to include the region in the peripheral viewing area 20 as window, be allowed with presenting The optical delivery for detecting the aspiration level of optical transport modifies window 951c as shown in LCD layer 433f;Similarly, light diffusion Device layer 433b can be configurable to include the region in the peripheral viewing area 20 as optical window, allow to detect light biography to present The optical delivery of defeated aspiration level modifies window 951d as shown in light diffuser layer 433b.Optical sensing under this LCD One of technological challenge be exactly undesirable bias light or environment light at optical detector array 621a, and can be in light It is designed in road using suitable optical filtering, to pass through being applicable in the optics RX path for leading to optical detector array 621a Optical filtering film or figure layer are realized on surface to reduce or refuse this undesirable bias light or environment light.
Therefore, the layer modified in the multiple field LCD module 433 in Fig. 2A in peripheral viewing area 20 is adapted to, with guidance Under LCD and the illumination light of specified peripheral viewing area lighting module 436b and allows to detect the abundant of light and transmit and be convenient for Optical sensing under LCD.Those regions for being used for transmission sufficient light in light diffuser 433b and other LCD layers 433f can be with Formed in following different mode, including for example including form transparent apertures, using transparent or partially transparent material, with suitable In addition theta alignment light path or excision remove scattering material (such as the light in the region in peripheral viewing area 20 Diffusing globe, prism film).
In the illustrated example, board layer 623 is provided under multiple field LCD module 433, with support for aobvious in periphery Show the specified peripheral viewing area lighting module 436b that optical sensing is carried out in area 20, one or more optical detection light source 436a With optical detector array 621a.
Probe source 436a can be designed as with the suitable wavelength of one or more (such as with can be with suitable incidence Angle part is to start through the longer visible red wavelength (such as 940nm wave band) of reflector film and liquid crystal cells polarizer In near infrared spectral range) emission detection light.Probe source 436a can with the back lighting light from light source module 434 The different optical wavelength of wavelength is arranged, so that the light guide function of waveguide 433c is invalid to the light from lighting source 436a, from And the detection light from probe source 436a can pass through the top clear 431 above LCD panel more effectively to shine Bright finger.Various optical systems can be designed for the optical sensor module under LCD display.For example, if for that will return Detection light guide the reception optical device to optical detector array 621a there is no lens, then can will detection light collimation.Light The some specific examples for learning sensor module designs are disclosed in the aft section of this patent document.
In some implementations, the specified lighting source 436b in peripheral viewing area or taskbar area 20 can be set The low-power consumption for being calculated as being provided when basic display unit backlight 434 is closed for showing icon or image illuminates.Specified lighting source 436b should be in the limit of visible spectrum, such as white light, with provided in peripheral viewing area or taskbar area 20 it is colored or Monochromatic display.
Fig. 2 B shows the lighting operation of the specified lighting source 436b in peripheral viewing area or taskbar area 20, In, the sub-translucent structure 951e being formed in optical reflector film layer 433d receives the task from specified lighting source 436b Column illumination light 957a, the specified lighting source 436b can be controlled independently of basic display unit back light 434.Taskbar light Source 436b can be used for illuminating peripheral viewing area or taskbar area 20 whole region or a part of region.
Fig. 2 C shows another example of the equipment with LCD display module, to provide main display in identical LCD panel Area and peripheral viewing area.It is different from the example in Fig. 2A, the one of illumination light is provided for the LCD pixel in viewing area 20 to the periphery A or multiple specified lighting source 436c are placed in LCD module 433 without below LCD module 433, while still by light It learns detector array 621a and one or more probe source 436a is placed under LCD module 433.Specifically, one or more The light source module of a specified lighting source 436c can be located in the processing region 951d of light diffuser 433b or LCD layer 433f 951c in, so, the illumination visible light of generation can reach the LCD pixel in the LCD module 433 in peripheral viewing area 20.
Fig. 2 D shows the lighting operation of the specified lighting source 436c in peripheral viewing area or taskbar area 20, should Specified lighting source 436c can be controlled independently of main display backlight light source 434.Taskbar light source 436c can be used for Illuminate peripheral viewing area or taskbar area 20 whole region or a part of region.
In some implementations, the individual peripheral viewing area illuminating waveguide as sidebar illuminated light guide can be provided, To receive the light from one or more taskbar light source 436c or 436b, and light is evenly dispersed in taskbar 20.Figure 2E shows region optical waveguide structure 2000 and is formed in inside LCD module 433 as peripheral viewing area illuminating waveguide to cover LCD The example of the peripheral viewing area 20 of layer 433f.Region optical waveguide structure 2000 is separated with LCD waveguide 433c, and LCD waveguide 433c will The illumination for carrying out autonomous backlight module 434 is dispersed to the entire LCD layer 433f of main viewing area 10 and peripheral viewing area 20.It is set this Under meter, region optical waveguide structure 2000 is the waveguide by design, to receive from one or more taskbar light source 436c's Illumination light, and operate the region optical waveguide structure 2000 with spatially more uniform mode will receive from one or The illumination light spatial dispersion of multiple tasks column light source 436c is at the different LCD pixel positions in peripheral viewing area 20.
Region optical waveguide structure for illuminating peripheral viewing area 20 can be placed on and position shown in the example of Fig. 2 E At different other positions.As long as and the illumination light of the output from the specified lighting source of one or more is may be coupled to In the optical waveguide structure of region, then the presence of region optical waveguide structure can be used for placing one or more specified illumination lights Some design flexibilities are provided in terms of source.Fig. 2 F shows region optical waveguide structure 2000 and is formed in inside LCD module 433 to cover Another example of the peripheral viewing area 20 of lid LCD layer 433f.As shown in the specific design of Fig. 2 F, the specified photograph of one or more Mingguang City source 436f is located at the edge of LCD layer 433f, and without in the OCD layer 433f in Fig. 2 E example, and its is optical coupled To the region optical waveguide structure 2000 being located inside LCD layer 433f.This spy of the specified lighting source 436f of one or more Fixed arrangement simplifies the multilayer architecture of the LCD of optical sensor under peripheral display region 20 and LCD with independent operation.
The example in Fig. 2A, Fig. 2 C, Fig. 2 E and Fig. 2 F with main viewing area and peripheral viewing area in identical LCD panel In, following three kinds of different lighting sources: (1) backlight module 434 are provided, for the main viewing area into identical LCD panel Visible or white illumination light are provided with peripheral viewing area, (2) have specifying for one or more light source 436b or 436c Illumination optical module, specified illumination light is provided with the LCD pixel in the LCD module 433 in viewing area 20 to the periphery, thus Allow the display operation of peripheral display region 20, and (3) that there is one for optical sensing under LCD when backlight module 434 is closed The detection optical module of a or multiple probe source 436a.Various optical illumination operations may be implemented.For another example, with backlight module 434 and Specified illumination optical module with one or more light source 436b or 436c is different, has one for optical sensing under LCD The illumination optical detection optical module of a or multiple probe source 436a can be with as other probe sources for optical sensing It is designed as issuing the detection light for being used for optical sensing with one or more optical wavelengths different from LCD display illumination light wavelength, And the illumination optical detection optical module can be for example in the infrared range of spectrum beyond limit of visible spectrum or in visible spectrum In range, and the illumination optical detection optical module can be used to utilize different detection wavelength detections from target or finger Different optical responses.Lighting source for optical sensing can be placed in identical approximate location (for example, in light Learn sensor side or the lower section of neighbouring reflector film 433d), or be placed on and one or more lighting sources are placed on LCD The difference that the edge of LCD module below module and by one or more lighting sources under top clear 431 is placed At position.
Subsequent part describes the design and feature of display panel module and optical sensor module below display screen, It, which is used to execute, touches or close to the finger of the top surface of display screen or the fingerprint sensing of target and other optical sensings.Under this screen Optical sensing design can be in the two-region display with main viewing area and peripheral viewing area and in no peripheral viewing area Single area's display in use.
Electronic equipment or system can be equipped with finger print identifying mechanism, to improve the safety of access equipment.This electronics is set Standby or system may include portable or mobile calculate equipment, such as smart phone, tablet computer, wrist-worn device and other Wearable or portable device further includes bigger electronic equipment or system, such as the personal meter of portable forms or desktop form Calculation machine, ATM, for business or government use various terminals to various electronic systems, database or information system and including Automobile, ship, train, aircraft and other motorized traffic systems.
Fingerprint sensing is using or is needing in the mobile application having secure access to and other application to be useful.For example, fingerprint Sensing may be used to provide the secure access to mobile device and the secure financial transactions including on-line purchase.It is expected that Robust and reliable fingerprint sensing including being suitable for mobile device and other application.In movement, portable or wearable device, Since the space in these equipment is limited, the demand to the maximum display area on locking equipment is especially considering that, it is expected that fingerprint The occupancy of fingerprint sensing is minimized or is eliminated by sensor.
In order to be seen by the user, the light for displaying images generated by display screen must pass through the top surface of the display screen. Finger can touch the top surface, to interact with the light at the top surface, so that the reflection or scattered at the surface region of the touch The light penetrated carries the spatial image information of the finger, and is back to the display panel below the top surface.It is shown in touch-sensing In equipment, top surface is the touch-sensing interface engaged with user, and light for displaying images and user's finger or hand it Between this interaction be constantly occurring, but the light of this carrying information for being back to display panel is largely wasted, and It is not used by most touch-sensing equipment.It is being shown with touch-sensing and various movements of fingerprint sensing function or portable In equipment, fingerprint sensor is intended in the equipment separated with display screen or the similar face for being arranged on display screen At position in addition to display screen area, such as in some models of apple iphone and Samsung smart phone or set Set at the back side of smart phone, for example, Huawei, association, millet or Google some models smart phone, used to avoid occupying In the expensive real estate that big display screen is arranged in front.These fingerprint sensors are the equipment separated with display screen, to need It is very compact with save space for show and other function, while still provide have be higher than a certain acceptable level space diagram As the reliable and quick fingerprint sensing of resolution ratio.However, because based on various suitable fingerprint sensing technologies (such as capacitor Formula touch-sensing or optical imagery) acquisition fingerprint image in high spatial image resolution ratio need that there are a large amount of sensor pixels Large sensor region, so to the need for being compact and small demand and the offer high spatial image resolution ratio when acquiring fingerprint pattern It asks and conflicts directly with one another in many fingerprint sensors.
The example of the implementation of sensor technology described in sensor technology and this patent document provides a kind of light Sensor module is learned, which at least partly uses the light from display screen bright aobvious as illumination detection illumination One or more sensings of the optical sensing of the dry sensing region of fingerprint and execution based on this light on the touch-sensing surface of display screen Operation.A kind of display screen appropriate for realizing disclosed optical sensor technology based on various display technologies or can match It sets, including the display screen with light emitting display pixels without the use of backlight, wherein each individually pixel is generated in liquid crystal It shows and forms display image on the screens such as (LCD) screen, organic light emission electric diode (OLED) display screen or electroluminescent display panel Light.
In the disclosed example for optical sensing to be integrated into LCD based on disclosed optical sensor technology, LCD Lower optical sensor can be used for detecting a part for showing the light of image in LCD display, wherein be used for display screen This part of light can be scattering light, reflected light or some stray lights.For example, in some implementations, based on backlight The image light of LCD screen can be used as return when encountering user's finger or palm or as targets such as the user pointer equipment of stylus Light reflection or be scattered back LCD show display screen in.The light of this return can be collected for using disclosed optics Sensor technology operates to execute one or more optical sensings.Due in optical sensing to the light from LCD display It using, the optical sensor module based on disclosed optical sensor technology is distinguishingly designed as being integrated into LCD display, In, the integrated mode maintain LCD display display operation and function without interfere, while provide optical sensing operation and Function, to enhance the allomeric function of the electronic equipments such as smart phone, tablet computer or movement/wearable device or system, set Standby integrated and user experience.
In addition, can provide what one or more was specified in the various implementations of disclosed optical sensing techniques Probe source detects light to generate the additional illumination for carrying out optical sensing operation for optical sensing module under LCD screen.At this In kind application, use is collectively formed in the light of the backlight from LCD screen and the detection light from the specified probe sources of one or more In the illumination light of optical sensing operation.
About the additional optical sensing function in addition to fingerprint detection, optical sensing can be used for measuring other parameters. For example, disclosed optical sensor technology can measure the hand of the people of available large touching surface product on entire LCD display The palm pattern (on the contrary, some specified fingerprint sensors, as apple iPhone/iPad equipment home button in fingerprint pass Sensor has the outer fingerprint sensing region of fairly small and specified screen may by height limitation in the size of sensing region Be not suitable for the big pattern of sensing).For another example, disclosed optical sensor technology can be used not only for acquiring using optical sensing and The pattern for detecting finger associated with people or palm, can be also used for logical to detect using optical sensing or other sensing mechanism Cross that " live finger " testing mechanism is collected or the pattern of fingerprint or palm that detects whether the hand from still-living people, should Testing mechanism can be based on the different light absorption behaviors of blood under for example different optical wavelengths, in fact, due to still-living people's Naturally mobile or movement (intentional or unintentional) or the pulsation when blood flows through the human body being connected with heartbeat, the finger of this people Usually moves or stretch.In one implementation, due to heartbeat/blood flow variation, optical sensor module can be with The variation of the light of the return from finger or palm is detected, so that detection whether there is in the target for showing as finger or palm The heartbeat to live.User authentication can be determined based on the optical sensing of fingerprint/palm pattern and to the front there are still-living people Combination enhance access control.For another example, optical sensor module may include sensing function, for based on from finger or hand The optical sensing of the light of the return of the palm measures glucose level or oxygen saturation.For another example, when people touches LCD display, touching The variation for touching power can reflect in one or more ways, including the contact between fingerprint pattern deformation, finger and screen surface The variation of area, fingerprint ridge broaden or the dynamic change of blood flow.These and other variations can be by based on disclosed optics The optical sensing of sensor technology measures, and can be used for calculating touch force.This touch force sensing can be used in as light Learn more functions of the sensor module addition in addition to fingerprint sensing.
Relevant useful operation or controlling feature in terms of for the touch-sensing to LCD display, disclosed optics pass Sensor technology can provide Trigger Function or additional function based on one or more sensing results from optical sensor module, To execute certain operations relevant to the touch-sensing control on LCD display.For example, the optical characteristics of finger skin is (as rolled over Penetrate rate) it is usually different from other man-made targets.Optical sensor module can be designed as selectively receiving and detect accordingly by The light of return caused by the finger contacted with the surface of LCD display, and the light of the return as caused by other targets will not be by light Sensor module is learned to detect.This target selectivity optical detection may be used to provide the useful user by touch-sensing Control such as only could wake up smart phone or equipment via the touch of the finger of people or palm, and the touch of other targets is not It can cause the revival of equipment, to carry out power-save operation and extend the use of battery.This operation can be by being passed based on optics The control of the output of sensor module is realized, to control the wake-up circuit operation of LCD display, wherein pass through and close LCD pixel (and closing LCD backlight) is at " sleep " mode, and opens the one or more of optical sensor module under LCD panel Lighting source (such as LED) is at flash mode, senses the finger of people intermittently to flash to screen surface Or any touch of palm.Under this design, optical sensor module operates one or more lighting sources, with generation " sleep " The scintillation light of mode wakeup sensing, so that optical sensor module is able to detect caused by being touched on LCD display as finger The light of this return for waking up sensing light, and detected in response to front, LCD backlight and LCD display is illuminated or " wake-up ". In some implementations, waking up sensing light can be in the sightless spectral region of infrared ray, so user will not be through successive The flashing of what visual light.LCD display operation be can control by the bias light for eliminating the optical sensing for fingerprint To provide improved fingerprint sensing.For example, in one implementation, each display scanning frame generates a frame fingerprint signal.Such as Fruit generates two frames fingerprint signal relevant to display, wherein generating a frame fingerprint signal when LCD display illuminates, and works as LCD Display screen generates another frame fingerprint signal when extinguishing, then the difference of this two frames fingerprint signal can be used for reducing the bias light of surrounding Influence.In some implementations, it is the half of frame rate of display by operation fingerprint sensing frame rate, fingerprint can be reduced Background noise in sensing.
Optical sensor module based on disclosed optical sensor technology may be coupled to the back side of LCD display, Without creating specified region in the surface side of LCD display, the region is in some smart phones, tablet computer or can Valuable equipment surface space can be occupied in the electronic equipments such as wearable device.This aspect of disclosed technology can be used for Equipment design and product integrate or provide certain advantages or benefit in manufacturing.
In some implementations, the optical sensor module based on disclosed optical sensor technology can be configured For non-invasive module, it is easily integrated to display screen, without changing the design of LCD display to provide fingerprint The desired optical sensing functions such as sensing.On this point, the optical sensor mould based on disclosed optical sensor technology The design that block can be designed independently of specific LCD display, this is because the following property of optical sensor module: this light Learn sensor module optical sensing be by detect by optical sensor module one or more lighting sources issue and What the light returned from the top surface of display area carried out, and disclosed optical sensor module is as optical sensor mould under shielding Block is coupled to the back side of LCD display, the light of the return for receiving the top surface from display area, without with display Shield the specific sensing ports or sensing region of region disconnecting.Therefore, optical sensor module can be used for showing with LCD under this screen Display screen combination, to provide optical finger print sensing and other sensors function on LCD display, without the use of having special design For providing the LCD display of the special designing of the hardware of this optical sensing.This side of disclosed optical sensor technology Face can make LCD display smart phone, tablet computer or other have the light from disclosed optical sensor technology The range learned in the powerful electronic equipment of increasing of sensing is more extensive.
For example, the existing telephone component for the fingerprint sensor for not providing separation designs, as certain apples (iPhone) Or Samsung (Galaxy) smart phone, this existing telephone component design can not change touch-sensing display screen component and integrate Shield lower optical sensor module, as disclosed herein to provide fingerprint sensing function on increased screen.Because of disclosed light It learns sensing and is not required to specified sensing region to be separated or port, as certain apples (iPhone)/Samsung (Galaxy) mobile phone tool There are the preceding fingerprint sensor outside display screen area, or some intelligent hands of some models as Huawei, millet, Google or association Machine overleaf has specified rear fingerprint sensor, and the integrated of fingerprint sensing is not needed to touch on screen disclosed herein The design of the existing telephone component of sensed layer and display layer or touch-sensing display module carry out the change of essence.Based in this document Disclosed optical sensing techniques do not need external sensing ports and external hardware button in the outside of equipment, which needs Disclosed optical sensor module is added to carry out fingerprint sensing.The optical sensor module and interlock circuit of addition are in phone Under display screen in shell, and fingerprint sensing can just be carried out in the identical touch-sensing surface of touch screen.
For another example, due to the above-mentioned property of the optical sensor module for fingerprint sensing, this optical sensor mould is integrated The smart phone of block can be updated with improved design, function and integration mechanism, without influence LCD display design or Manufacture or the design or manufacture burden for aggravating LCD display, to provide the phase in production life cycle for device fabrication and improvement/upgrading The flexibility of prestige, while maintaining using optical finger print sense in the smart phone of LCD display, tablet computer or other electronic equipments The availability of the more new version of brake.Specifically, touch-sensing layer can be updated when next product is issued or LCD is shown Layer, without changing to make any significant hardware using the fingerprint sensing feature of optical sensor module realization under disclosed screen Become.Also, optical sensing on the screen realized based on this optical sensor module, to be used for fingerprint sensing or other optical sensings The improvement of function --- it also include increasing additional optical sensing function, it can be under the screen by using new version in new product Optical sensor module is realized, without significantly changing to Telephone Package design.
Above or other features of disclosed optical sensor technology can be implemented as mentioning to the electronic equipment of a new generation For improved fingerprint sensing and other sensing functions, especially for LCD display smart phone, tablet computer and its His electronic equipment, to provide various touch-sensing operations and functions, and enhances the user experience of this equipment.Based on including LCD Various displays are applicable to the feature of the different technologies of OLED display, optical sensor module disclosed in this patent document Panel.The optical sensor module that specific example below is directed to LCD display panel and is placed under LCD display panel.
In the implementation of disclosed technical characteristic, it can provide the additional sensing function such as biomedical sensor Or sensing module, such as the heartbeat sensor in the wearable device as wrist wearing devices or wrist-watch.In short, can be set in electronics Different sensors is provided in standby or system to realize different sensing operation and function.
Disclosed technology can be implemented as providing the optical sensing for executing mankind's fingerprint and for authenticating to mobile device Or equipment, system and the technology of the certification of the access trial of the equipment of the computer control of the lockings such as system of computer control, The equipment of the computer control of the locking is equipped with finger print detecting module.Disclosed technology can be used for protecting to various electronics The portable or mobiles such as the access of equipment and system, including laptop, tablet computer, smart phone and game station calculate Other electronic equipments such as equipment and electronic databank, automobile, bank ATM or system.
Fig. 3 A is the exemplary block diagram of the system 180 with the fingerprint sensing module 180 including fingerprint sensor 181, should System can be implemented as include the optical sensing based on the fingerprint disclosed in this document optical fingerprint sensor.System 180 Including fingerprint sensor control circuit 184 and digital processing unit 186, which may include one or more places Manage device, for handling fingerprint pattern, and determine input fingerprint pattern whether be authorized user fingerprint pattern.Fingerprint sensing system System 180 is obtained fingerprint using fingerprint sensor 181 and is compared obtained fingerprint with the fingerprint of storage, to enable or prohibit With the function in the equipment or system 188 protected by fingerprint sensing system 180.In operation, finger prints processing processor 186 is based on adopting Whether the user fingerprints of collection come from authorized user, control the access to equipment 188.As shown, fingerprint sensor 181 can wrap Multiple finger sensing pixels are included, such as at least part of pixel 182A-182E in unified representation fingerprint.For example, fingerprint sensing System 180 can be realized at the ATM as system 188, to determine the fingerprint of the client of the fund that requests access to or other transaction. Based on to the fingerprint from the client that fingerprint sensor 181 obtains with one or more storage fingerprints compared with, in response to front Identification, fingerprint sensing system 180 can make ATM system 188 permit the access to user account requested, or in response to no Fixed identification, can be with denied access.For another example, equipment or system 188 can be smart phone or portable device, and fingerprint sensing System 180 is integrated into the module of equipment 188.For another example, equipment or system 188, which can be using fingerprint sensor 181, permits Or the door or safety entrance for the facility or family being rejected for entry into.For another example, equipment or system 188 can be automobile or other traffic works Tool, the starting of engine is linked to using fingerprint sensor 181, and is identified whether people is authorized to and operated the automobile or traffic work Tool.
As specific example, Fig. 3 B and Fig. 3 C show an example implementations of electronic equipment 200, the electronics Equipment 200 has touch-sensing display screen component and the optical sensor module below touch-sensing display screen component.? In the specific example, display technology can be by having the LCD display of the backlight for optical illumination LCD pixel or having Another display screen (such as OLED display screen) Lai Shixian of light emitting display pixels without the use of backlight.Electronic equipment 200 can be with For portable devices such as smart phone or tablet computers, and electronic equipment 200 can be equipment 188 as shown in Figure 3A.
Fig. 3 B shows the front side of equipment 200, some spies being similar in some existing smart phones or tablet computer Sign.Device screen occupies the whole of front space, major part or signal portion in the front side of equipment 200, and in device screen Upper offer fingerprint sensing function, such as receiving one or more sensing regions of finger on device screen.As an example, figure 3B shows the fingerprint sensing area touched in device screen for finger, which can be lit for obviously can recognize Area or region, user place finger to carry out fingerprint sensing.It this fingerprint sensing area can be as the rest part of device screen Equally for showing image.As shown, in various implementations, the device housings of equipment 200 can have side, the side Support side control button common in various smart phones on Vehicles Collected from Market in face.Also, such as the upper left corner of device housings in Fig. 3 B An example shown in, one or more optional sensors can be provided on the front side of the equipment 200 outside device screen.
Fig. 3 C shows the structure construction for sensing relevant module in equipment 200 to optical finger print disclosed in this document Example.Device screen component shown in Fig. 3 C include: for example, top have touch-sensing layer touch-sensing panel module, And the display panel module with display layer under touch-sensing panel module.Optical sensor module is coupled to display screen group Part module is simultaneously disposed below, and to receive and acquire the light of the return of the top surface from touch-sensing panel module, and this is returned The light returned is guided and is imaged on the optical detector array of optical sensing pixel or photoelectric detector, the optical detector array Optical imagery in the light of the return is converted into picture element signal with for further processing.It is to set under optical sensor module Standby electronic structure, the equipment electronic structure include certain electricity for optical sensor module and other assemblies in equipment 200 Sub-circuit.The device electronics can be arranged in inside device housings, and may include optical sensing as shown in Figure 3 C A part below device module.
In implementation, the top surface of device screen component can be the surface of transparent optical layer, the transparent optical layer table Face provides multiple functions as user's touch-sensing surface, such as (1) shows output surface, and the light for carrying display image passes through The display output surface reaches the eyes of viewer, and (2) touch-sensing interface receives the touch-sensing for being used for touch-sensing module The user of operation touches, and (3) optical interface, for shielding upper fingerprint sensing (and possible one or more other light Learn sensing function).This transparent optical layer can be rigid layers or the flexible layers such as glass or crystal layer.
Display screen another example is with LCD layer and thin film transistor (TFT) (thin film transistor, TFT) knot The LCD display of structure or substrate.LCD display panel is multiple field liquid crystal display (LCD) module, which includes Issue for LCD pixel LCD illumination light LCD display backlight light source (such as LED light), guide backlight light waveguide-layer and It may include such as liquid crystal (LC) elementary layer, transparent conductive ITO layer, optical polarizator layer, light filter layer and touch-sensing layer LCD structure layer.LCD module further includes backlight diffuser device and the optical waveguide below LCD structure layer and above light waveguide-layer The optical reflector film layer of layer lower section, the backlight diffuser device are used to illuminate the backlight of LCD display pixel, the light for spatial It learns reflector film layer to be used to backlight being recycled to LCD structure layer, to improve light utilization efficiency and display brightness.
Referring to Fig. 3 C, the optical sensor module in this example is located at below LCD display panel, comes from the top with acquisition The light of the return on portion touch-sensing surface, and obtain the fingerprint when the sensing region on the finger of user and the top surface contacts The high-definition picture of pattern.In other implementations, optical sensor module under the disclosed screen for fingerprint sensing It can be realized in the equipment of no touch-sensing feature.In addition, suitable display panel can have different from OLED display Various screens design.
Fig. 3 D and Fig. 3 E show the example for realizing the equipment of Fig. 3 B figure and the optical sensor module in 3C.Fig. 3 D is shown Viewgraph of cross-section comprising shielding a part of the equipment of lower optical sensor module.Fig. 3 D shows to have in left side touches sense The view of the front side of the equipment of display is surveyed, indicates the fingerprint sensing region on display screen lower part, and show packet on right side The perspective view of a part of the equipment containing the optical sensor module being located at below device display screen component.Fig. 3 D also shows tool There is the example of the layout of the flexible-belt of circuit element.
Fig. 3 B, Fig. 3 C, Fig. 3 D and Fig. 3 E design example in, optical fingerprint sensor design be different from it is some other Fingerprint sensor design, these designs use the fingerprint sensor structure independently of display screen, and on the surface of mobile device On, have physical interface (for example, in top glass cover board in the design of some mobile phones between display screen and fingerprint sensor Button-like structure in opening).In design shown in this article, the optics for detecting fingerprint sensing and other optical signallings refers to Line sensor is located at below top blind flange glass or layer (such as Fig. 3 D), so that the top surface of cover-plate glass is used as mobile device Top surface, as across vertical stacking and the continuous and uniform glass of vertically superposed display screen layer and fluorescence detector sensor Surface.For optical finger print to be sensed and is integrated in this design under common and uniform surface to the display screen of touch-sensitive Benefit is provided, including improves equipment integration, equipment packages is enhanced, enhances equipment to outer member, failure, abrasion With the resistance of tearing, and the user experience during the ownership of equipment is enhanced.
Referring back to Fig. 3 B and 3C, shown in optical sensor module can be with various under screen for shielding fingerprint sensing Configuration is to realize.
In one implementation, the equipment based on above-mentioned design can be configurable to include device screen, the equipment screen Curtain provides touch-sensing operation and the LCD display panel structure including forming display image, which further includes top transparent Layer, is formed on device screen, comes from as the user's touch interface operated for touch-sensing and as being used for transmission The light of structure is shown so that image to be shown to the interface of user, which further includes optical sensor module, is located at display panel Fingerprint is detected to receive the light returned from top clear in the lower section of structure.
This equipment and other equipment disclosed in this document can be additionally configured to include various features.
For example, equipment electronic control module may include in the device, in the fingerprint and authorized user detected Access of the authorized user to equipment when fingerprint matching.In addition, optical sensor module is in addition to for being also used to other than detecting fingerprint Be different from the biochemical characterization parameter of fingerprint by optical sensing detection, with show at top clear with the fingerprint phase that detects Whether associated touch comes from still-living people, if the fingerprint matching of fingerprint and authorized user that (1) detects, and (2) are examined The biochemical characterization parameter measured shows the fingerprint detected from still-living people, then equipment electronic control module is used for authorized user Access to the equipment.The biochemical characterization parameter may include, for example, finger whether include people blood flow or heartbeat.
For example, the equipment may include the equipment electronic control module for being coupled to display panel structure, with to luminescence display Pixel provides power supply, and the image for controlling the display panel structure is shown, and in fingerprint sensing operation, mould is controlled electronically in equipment Block operates the light emitting display pixels closed in a frame and opens the light emitting display pixels in next frame, to allow fluorescence detector battle array Column acquisition has light emitting display pixels illumination and two fingerprint images without light emitting display pixels illumination, to reduce fingerprint sense The influence of bias light in survey.
For another example, equipment electronic control module may be coupled to display panel structure, to provide electricity to luminous LCD display panel Source, and the power supply of the backlight of LCD display panel is closed in a sleep mode, and when optical sensor module is in top clear Specified fingerprint sensing region at detect people skin there are when, equipment electronic control module can be used for display surface Hardened structure is from sleep mode wakeup.More specifically, in some implementations, equipment electronic control module can be used for operating light The one or more lighting sources for learning sensor module kind intermittently shine, and simultaneously close off LCD display panel power supply (in sleeping Sleep mode), the illumination light that interval issues is guided to the specified fingerprint sensing region of top clear, to monitor whether to exist The skin of the people contacted with specified fingerprint sensing region, for by equipment from sleep mode wakeup.
For another example, which may include equipment electronic control module, which is coupled to optical sensing Device module, to receive the information of the multiple fingerprints detected obtained by the touch of sensing finger, and the equipment electronics control Molding block is operated to measure the variation of multiple fingerprint detected and determines the touch force for the variation for causing to measure.Example Such as, the variation of multiple fingerprint detected may include the variation of the fingerprint image due to caused by touch force, due to touch force The variation of the spacing of the variation or fingerprint ridge of caused touch area.
For another example, top clear may include being touched for user with finger to carry out the specified fingerprint sense of fingerprint sensing Survey region, and the optical sensor module below display panel structure may include contacted with panel substrate it is transparent Block, to receive light issuing from the display panel structure and from top clear return, which may be used also To include the optical detector array and optical imagery module for receiving the light, which will receive in the transparent block To the light be imaged on the optical detector array.The optical sensor module can be relative to specified fingerprint sensing region It places, and is configured to: when the skin contact with people, being selectively received at the top surface of top clear by complete interior The light of the return of reflection, and in the contact of the skin of nobody, the return from specified fingerprint sensing region is not received Light.
For another example, optical sensor module can be configurable to include the wedge below display panel structure, with modification Total reflection condition on the bottom surface of the display panel structure engaged with the wedge is worn to allow to extract from the display panel structure The light of the bottom surface is crossed, which can also include optical detector array, receive aobvious from this from the wedge Show the light that panel construction extracts, can also include optical imagery module, between the wedge and the optical detector array, The light from the wedge to be imaged on the optical detector array.
The specific example of optical sensor module under the screen for shielding upper fingerprint sensing is provided below.
Fig. 4 A and Fig. 4 B show the example of an implementation of the optical sensor module below display screen component, should Optical sensor module is for realizing the design in Fig. 3 B and Fig. 3 C.Equipment in Fig. 4 A to Fig. 4 B includes having top clear 431 display component 423, the top clear 431 are formed on device screen component 432, are grasped as touch-sensing User's touch interface of work and as being used for transmission the light from display structure so that image to be shown to the interface of user.One In a little implementations, which can be cover-plate glass or crystalline material.Device screen component 423 may include LCD display module 433 below top clear 431.LCD display layer allows the optical transport of part, so that from top surface Light can partly transmit LCD display layer and reach optical sensor module under LCD.For example, LCD display layer includes electrode and light Learn the wire structures for serving as hole array and light Scattering Targets.Circuitry module can be provided below the OLED display panel 435, to control the operation of the equipment, and function is executed to operate the equipment for user.
Optical sensor module 702 in this specific implementation example is located under LCD display module 433.Setting one Or lighting source 436 below multiple lighting sources, such as LCD display module 433 or/and it is located under top blind flange glass 431 Another or multiple lighting sources in face, the illumination light or detection light for carrying out optical sensing for providing optical sensing module 702, And it can control this or more lighting sources shine, to illuminate device screen area at least partially through LCD display module Placing a digit into wherein for user to carry out fingerprint recognition fingerprint sensing area 615 in the top clear 431 in domain.It comes from The illumination light of one or more lighting sources 436 can be directed to the fingerprint sensing region 615 on top surface, as the illumination light is From illuminating fingerprint light area 613.Another or multiple lighting sources below top blind flange glass 431 can be placed on top Near fingerprint sensing region 615 on face, to guide the illumination light generated to reach top blind flange glass 433 without passing through LCD Display module 433.As shown, finger 445 is placed in the fingerprint sensing area 615 illuminated, 615 conduct of fingerprint sensing area Effective sensing area for fingerprint sensing.It is aobvious that a part in fingerprint sensing area 615 in the light of reflection or scattering is directed to LCD Show in the optical sensor module under module 433, and in optical sensor module photoelectric detector sensing array received this Kind light, and acquire the fingerprint pattern information as entrained by the received light.
This design of illumination light for optical finger print sensing is being provided using one or more light sources (such as 436) In, in some implementations, each lighting source 436 can be controlled, with intermittently beating with the relatively slow period It opens, to reduce the power for optical sensing operation.In some implementations, fingerprint sensing operation can be with two step process To realize: firstly, one or more light sources 436 are opened in a flashing mode, without opening LCD display panel, to use flashing Light to sense finger, whether then touch-sensing area 615 once detecting the touch in area 615, then operates optical sensing mould Block executes the fingerprint sensing based on optical sensing, and can open LCD display panel.
In the example of Fig. 4 B, shielding lower optical sensor module includes the transparent block 701 for being coupled to the display panel, this is thoroughly The light of the return of bright piece 701 top surface of the reception from apparatus assembly, under the screen optical sensor module further include execute optics at The optical imagery block 702 of picture and imaging acquisition.Light from lighting source 436 is after reaching coversheet top surface, for example, user hand Refer to the coversheet top surface at the sensing region 615 touched, reflects or be scattered back to come from the coversheet top surface.When sensing region 615 In coversheet top surface be in close contact fingerprint ridge when, due to the presence of the skin or tissue of the finger contacted at this location, refer to Light reflection under wrinkle ridge is different from the light reflection of the another position under fingerprint valley, and the another position under fingerprint valley does not have finger Skin or tissue.Light conditioned reflex at the position of region median ridge and paddy that finger on the coversheet top surface touches it is this It is differently formed image, which indicates the image or spatial distribution by the ridge of touch part and paddy of the finger.The reflected light It is vectored back to towards LCD display module 433, and after the aperture for passing through LCD display module 433, reaches the optical sensor The interface of the low index optical transparent block 701 of module.The refractive index of the low index optical transparent block 701 is configured to be less than LCD The refractive index of display panel allows to from LCD display panel extract the light of return in the optical clear block 701.Once The light of the return is received in the optical clear block 701, and this light received enters one as imaging sensing block 702 The optical image unit divided, and on the photoelectric detector sensing array or optical sensing permutation being imaged onto block 702.Fingerprint Light reflection difference between ridge and paddy is different to cause the comparison of fingerprint image.As shown in Figure 4 B, (such as the microcontroller of control circuit 704 Device or MCU) it is coupled to other circuits such as the equipment primary processor 705 on imaging sensing block 702 and main circuit board.
In the specific example, optical beam path design is: light is total on the top surface between substrate and Air Interface Enter coversheet top surface in angle of reflection, and can by block 702 image forming optics and imaging sensor array most effectively receive Collection.In this type of design, maximum comparison is presented in the image in fingerprint ridge valley region.This imaging system may have can be to finger Line senses the undesirable optical distortion adversely affected.Therefore, at based on optical detector array, along the light of the light returned The optical distortion situation on road, when the output signal of the optical detector array in process block 702, the image of acquisition can also be It is corrected during imaging reconstruction by distortion correction.By the entire sensing region in X-direction line and Y-direction line, scan every time The test image pattern of one-row pixels, distortion correction coefficient can be raw by the pattern acquired in each photo-detector pixel At.This correction course can also use from one individual pixel of each tuning and scan the whole of photodetector array The image that a image-region generates.This correction coefficient only needs to generate after assembling sensor primary.
Bias light (such as sunlight or room light) from environment can pass through LCD by the hole in LCD display component 433 Panel top surface enters imaging sensor.This bias light can generate background baseline in the valuable image from finger, And this background baseline is undesirable.Different methods can be used to reduce this baseline intensity.Another example is with Certain frequency f tuning switches on and off lighting source 436, by carrying out phase to lamp drive pulses and imaging sensor frame Synchronous, imaging sensor is able to identical frequency and obtains the image received.Under this operation, only one in image phase is wrapped Containing the light from light source.By subtracting odd and even number frame, it is likely to be obtained most of light institute by the lighting source transmitting modulated The image of composition.Based on the design, each display scanning frame generates the frame of fingerprint signal.If connected by harmony in a frame Illumination light and the tuning disconnection Zhao Mingguang in another frame, remove two continuous signal frames, then can be by the background shadow of environment It rings and minimizes or largely eliminate.In implementation, fingerprint sensing frame rate can be the half of frame rate of display.
A part in light from lighting source 436 may also pass through cover board top surface, and enter finger tissue.This part Optical power be dispersed in around, and in the light of the scattering it is a part of can finally by optical sensor module imaging pass Sensor array is collected.The luminous intensity of the light of the scattering depends on the haemoconcentration in the colour of skin and finger tissue of finger, and hand This information that the light of the scattering on finger carries is useful to fingerprint sensing, and can be used as the one of fingerprint sensing operation Part is detected.For example, by integrate user's finger image region intensity, may it will be observed that haemoconcentration increase/ Reduce the phase for depending on user's heartbeat.This feature is determined for the HR Heart Rate of user, determines that the finger of user is Live finger still has the deception device of the fingerprint pattern of forgery.
One or more lighting sources 436 in Fig. 4 B can be designed as issuing the light of different colours or wavelength, and light Sensor module can acquire the light of the return of the different colours or wavelength of the finger from people.It is accordingly measured by record Different colours or wavelength return light intensity, can determine information associated with the colour of skin of user.For example, working as user When having registered the finger for finger print identifying operation, optical fingerprint sensor also measures the scattering light of color A and B from finger Intensity, as intensity Ia and Ib.Can recorde the ratio of Ia/Ib, with the survey when the finger of user is placed on sensing region The measurement result that the evening of amount fingerprint is a little is made comparisons.This method can help to refuse to set with the unmatched deception of user colour It is standby.
One or more lighting sources 436 can be by the identical electricity for the image sensor array in control block 702 Sub- device 704 (such as MCU) control.The one or more lighting source 436 can with the pulse in short time of low duty ratio, with It shines to having a rest property and the pulsed light for image sensing is provided.Image sensor array can be operating as accounting for identical pulse Sky is than monitoring light pattern.If there is the human finger of the sensing region 615 on touch screen, then the imaging in block 702 senses The image acquired at array can be used for detecting touch event.It is connected to the control electronics of the image sensor array in block 702 Device or MCU 704 can be operating as determining whether the touch is human finger's touch.If it is determined that being human finger's touch Event, MCU 704 can be operating as waking up intelligent mobile phone system, open the lighting source for executing optical finger print sensing 436, and complete fingerprint image is obtained using normal mode.Image sensor array in block 702 can be to the main place of smart phone It manages device 705 and sends the fingerprint image obtained, which can be operating as the fingerprint image that will be acquired As being matched with the fingerprint database of registration.If there is matched, smart phone can unlock mobile phone, and start normal behaviour Make.If the image obtained is not matched, smart phone can be to the user feedback authentification failure.User can taste again Examination, or input password.
In the example of Fig. 4 A and Fig. 4 B, shields lower optical sensor module using optical clear block 701 and there is photoelectricity to examine Survey device sensing array imaging sensing block 702, by the top surface with display screen contact touch finger fingerprint pattern optically at As on photoelectric detector sensing array.The optics from the photodetector array into block 702 of sensing area 615 is shown in Fig. 4 B Imaging axis or detection axis 625.The front end of imaging sensing block 702 before optical clear block 701 and photoelectric detector sensing array Body image-forming module is formd, to realize the suitable imaging for optical finger print sensing.Since the optics in the imaging process loses Very, as explained on, distortion correction can be used to realize desired imaging operation.
It is disclosed herein by the screen in Fig. 4 and 4B under optical sensor module and other design carry out optical sensing In, it include different light groups from the sensing area 615 in top clear 431 to the optical signalling for shielding lower optical sensor module Point.The signal that Fig. 5 A, 5B and Fig. 5 C show the light for returning under two different optical conditions from sensing area 615 generates, In order to understand the operation for shielding lower optical sensor module.
Fig. 5 A, which shows the illumination light from lighting source 436 and how to pass through OLED display module 433, to be propagated, and is being penetrated The optical signal for shielding the different returns of lower optical sensor module, the optical signal packet of the return are generated to after top clear 431 Include the optical signal for carrying fingerprint pattern information.For the sake of simplicity, two illuminating rays 80 and 82 at different location are directed to top Portion's hyaline layer 431, and total reflection is not being suffered from 431 junction of top clear.Specifically, illuminating ray 80 and 82 and top layer 431 is vertical or near vertical.Finger 60 is contacted with the sensing area 615 in top clear 431.As shown, illuminating bundle 80 After through top clear 431, the finger ridge contacted with top clear 431 is reached, to generate light beam in finger tissue 183 and to LCD display module 433 return another light beam 181.Illuminating bundle 82 reaches position after through top clear 431 Finger paddy above top clear, to generate the light returned from the interface of top clear 431 to LCD display module 433 Beam 185, the second light beam 189 into finger tissue and the third light beam 187 by finger paddy reflection.
In the example of Fig. 5 A, it is assumed that equivalent refractive index of the finger skin at 550nm is about 1.44, and top transparent The cover-plate glass refractive index of layer 431 is about 1.51., the part light of finger ridge-cover-plate glass interface the reflected beams 80, as arriving The light 181 of the reflection of the bottom 524 of 433 lower section of LCD display module.In some LCD panel, reflectivity is low, e.g., about 0.1%.Most of light in light beam 80 becomes the light beam 183 being transmitted in finger tissue 60, and finger tissue 60 causes light 183 Scattering generates the light 191 of the scattering returned to LCD display module 433 and bottom 524.Transmitting beam from LCD pixel 73 189 scattering in finger tissue also contributes the light 191 of the scattering of return.
About 3.5% (light 185) of 82 power of light beam at finger skin paddy position 63 is reflected into bottom by cover-plate glass surface Layer 524, and about 3.3% (light 187) of the incident optical power is reflexed to bottom 524 by finger paddy surface.Total reflectivity is about 6.8%.Most of light 189 is transferred in finger tissue 60.One in optical power in the light 189 of transmission in finger tissue Part is scattered by finger tissue, is contributed to toward and into the scattering light 191 in bottom 524.
Therefore, the light reflection from various interfaces or surface at the finger paddy and finger ridge for touching finger is different , reflectivity difference carries fingerprint cartographic information, and can measure the reflectivity difference contacted with top clear 431 with to extract and The fingerprint pattern for the part being irradiated to by oled light.
Fig. 5 B and 5C are shown under different condition and at relative to the paddy of finger or the different location of ridge, at top surface The optical path of two kinds of additional irradiation lights, including the optical path under total reflection condition with 431 intersection of top clear.The photograph of diagram Mingguang City's line generates the optical signal of different returns comprising carries fingerprint pattern information to the light for shielding lower optical sensor module Signal.Assuming that cover-plate glass 431 and LCD display module 433 are bonded together, between the two without any air gap, so that right There is cover-plate glass 431 the O illumination light of big incidence angle can be totally reflected at cover-plate glass-Air Interface.Fig. 5 A, 5B and 5C The example of following three groups of different divergent beams: (1) central light beam 82 is shown, there is small incidence angle to cover-plate glass 431 And without total reflection (Fig. 5 A), (2) high contrast light beam 201,202,211 and 212, when cover-plate glass surface is not touched When, it is totally reflected at cover-plate glass 431, and when finger touches cover-plate glass 431, may be coupled in finger tissue Light beam is fled from very big incidence angle in (Fig. 5 B and 5C), and (3), even if also covering at the position that finger tissue touches It is totally reflected at glass sheet 431.
For central light beam 82, light of the cover-plate glass surface against the reflection of light beam 185 about 0.1%~3.5%, this part Light is transferred in bottom 524, and the light that finger skin is about 0.1%~3.3% to the reflection of light beam 187, this part light is also passed It is defeated into bottom 524.Difference in reflection depends on whether light beam 82 meets with finger skin ridge 61 or paddy 63.Remaining 189 quilt of light beam It is coupled in finger tissue 60.
For high contrast light beam 201 and 202, if cover-plate glass surface is not touched, cover-plate glass surface difference Almost 100% light is reflected light beam 205 and 206.When finger skin ridge touches correcting glass surface and in light beam 201 and 202 Position at when, the major part in optical power is coupled in finger tissue 60 by light beam 203 and 204.
For high contrast light beam 211 and 212, if cover-plate glass surface is not touched, cover-plate glass surface difference Almost 100% light is reflected light beam 213 and 214.When finger touches cover-plate glass surface and finger skin paddy just at light When the position of beam 211 and 212, without Coupling power into finger tissue 60.
As shown in Figure 5A, the random scatter of finger tissue can be undergone by being coupled to the light beam in finger tissue 60, low to be formed Contrast light 191, and a part in the low contrast light 191 can reach optical sensor module across LCD display module.
Therefore, in the region of high contrast light beam irradiation, finger skin ridge and paddy cause different optical reflections, and Reflection differences pattern carries fingerprint pattern information.High contrast fingerprint signal can be realized by comparing this species diversity.
Based on the design in Fig. 3 B and 3C, optical sensing techniques can optically be adopted with various configurations under disclosed screen Collect fingerprint.
For example, can realize the specific implementation in Fig. 4 B with various configurations, which is based upon using optics sense Survey the optical imagery of the body image-forming module in module.Fig. 6 A to Fig. 6 C, Fig. 7, Fig. 8 A to Fig. 8 B, Fig. 9, Figure 10 A to Figure 10 B, figure 11 and Figure 12 shows various realizations, supplementary features and the behaviour that optical sensor module designs under the screen for optical finger print sensing The example of work.
Fig. 6 A, Fig. 6 B and Fig. 6 C are shown to be shown based on optical sensor module under the screen for carrying out optical imagery by lens Example, for acquiring fingerprint from the finger 445 of pressing display cover-plate glass 423.Fig. 6 C is optical sensor module shown in Fig. 6 B Partial enlarged view.Optical sensor module is located under LCD display module 433 under screen as shown in Figure 6B, optics under the screen Sensor module includes the optical clear gasket 617 contacted with the bottom surface of LCD display module 433, comes from top transparent to receive The light of the return of sensing area 615 on the top surface of layer upper 431, optical sensor module further includes positioned at 617 He of gasket under the screen Imaging len 621 between photodetector array 623, imaging len 621 is by the return from sensing area 615 received Light is imaged on photodetector array 623.Similar to the imaging system in Fig. 4 B example, optical sensor mould is used in Fig. 6 B The imaging system of block may undergo image fault, and suitable optical correction calibration can be used to reduce this distortion, example Such as, to aberration emendation method described in system in Fig. 4 B.
It is similar to the hypothesis in Fig. 5 A, Fig. 5 B and Fig. 5 C, it is assumed that equivalent refractive index of the finger skin at 550nm be about 1.44, and for cover-plate glass 423, the refractive index of naked cover-plate glass is about 1.51.When OLED display module 433 is bonded in When on cover-plate glass 431 and without any air gap, total internal reflection occurs in the wide-angle for being greater than the critical angle of incidence at interface.If Cover-plate glass top surface is not contacted, then being totally reflected incidence angle is about 41.8 °, and if finger skin touches cover-plate glass top Face, then the angle of total reflection is about 73.7 °.Corresponding total reflection angular difference is about 31.9 °.
In this type of design, lenticule 621 and photodiode array 623, which define in acquisition sensing area 615, contacts hand The view angle theta of the image of finger.It, can be by controlling object in order to detect the desired part in 615 cover plate glass surface of sensing area Parameter or configuration are managed to be appropriately aligned the visual angle.For example, the total internal reflection of LCD display component can be detected with alignment angle. Specifically, alignment angle θ senses effective sensing area 615 in cover-plate glass surface.The cover-plate glass surface 615 effectively sensed It can be considered as mirror, so that the figure of fingerprint illumination light year module 613 in LCD display is effectively detected in photodetector array Picture, the image project on photodetector array to the cover-plate glass surface 615 by sensing.Photodiode/Photoelectric Detection Device array 623 can receive the image in the area 613 reflected by the cover-plate glass surface 615 sensed.When finger touch-sensing area 615 When, a part in light may be coupled to the chi chung of fingerprint, this can cause photodetector array to receive the light from ridge position, To be rendered as darker fingerprint image.Since the geometry in optical detection path is known, it is possible to which correction is in light Learn caused fingerprint image distortion in the optical path in sensor module.
As specific example, it is contemplated that the distance H in Fig. 6 B from detection module central axis to cover-plate glass top surface is 2mm, this design can directly cover effective sensing area 615 of 5mm, which has width on cover-plate glass Spend Wc.The adjustable detector location parameter H of thickness of gasket 617 is adjusted, and effectively sensing sector width Wc can be optimized.By In the thickness that H includes cover-plate glass 431 and display module 433, so this application design is contemplated that these layers.It is gasket 617, micro- Lens 621 and photodiode array 623 can integrate the lower section of the coloured coating 619 on the bottom surface of top clear 431.
Fig. 7 show in Fig. 6 to another design of the optical imaging designs of the optical sensor module shown in Fig. 6 C The example of consideration, the gasket 617 in Fig. 6 B to Fig. 6 C replaced by using special gasket 618, to increase sensing region 615 Size.Gasket 618 is designed as with a thickness of Hs, having low-refraction (RI) ns, also, gasket 618 is located at width Ws Under LCD display module 433, for example, the attached bottom surface for arriving LCD display module 433 (as bonded).The end face of gasket 618 be with The angled or inclined face that lenticule 621 engages.This relative position of gasket and lens is different from Fig. 6 B to Fig. 6 C Lens are located at the lower section of gasket 617.It is θ that lenticule 621 and photodiode array 623, which are assembled into detection angles size, Optical detecting module in.Due to the light refraction of the interface between gasket 618 and display module 433 and in cover board glass The light refraction of interface between glass 431 and air, detection axis 625 are bent.Local incidence angle φ 1 and φ 2 is by component material What refractive index RI, ns, nc and na of material were determined.
If nc is greater than ns, φ 1 is greater than φ 2.Refraction is exaggerated sense width Wc as a result,.For example, it is assumed that finger skin Equivalent refractive index RI be about 1.44 at 550nm, and the refractive index RI of cover-plate glass is about 1.51, if cover-plate glass top Face is not touched, then being totally reflected incident angular estimation is about 41.8 °, if finger skin touches cover-plate glass top surface, is all-trans Firing angle is about 73.7 °.Corresponding total reflection angular difference is about 31.9 °.If gasket 618 is by material system identical with cover-plate glass At then the distance from detection module center to cover-plate glass top surface is 2mm, if detection angle is θ=31.9 °, is effectively sensed Peak width Wc is about 5mm.The local incidence angle of corresponding central axis is φ 1=φ 2=57.75 °.If special gasket 618 Material have about 1.4 refractive index ns and Hs be 1.2mm, then detection module tilts at φ 1=70 °.Effective sensing area Field width degree is added to greater than 6.5mm.Under these parameters, the detection angular breadth in cover-plate glass is lowered to 19 °.Therefore, The imaging system of optical sensor module can be designed as the size of the sensing region 615 on expectation enlarged top portion hyaline layer 431.
When the refractive index RI of special gasket 618 is designed as sufficiently low (e.g., formed using MgF2, CaF2 or even air Gasket) when, the width Wc of effective sensing region 615 is no longer limited by the thickness of cover-plate glass 431 and display module 433.It is this Property provides desired design flexibility.In principle, if detection module has enough resolution ratio, it might even be possible to will be effective Sensing region, which increases to, covers all display screens.
Because disclosed optical sensor technology, which may be used to provide big sensing region, carrys out pick-up pattern, institute is public Optical sensor module can be not only used for acquiring and detecting the pattern of finger under the screen opened, and can be also used for acquiring and detect more Large-sized pattern, such as the palm of people associated with people, Lai Jinhang user authentication.
Fig. 8 A to Fig. 8 B shows another design of the optical imaging designs for optical sensor module shown in Fig. 7 The example of consideration, in this design, setting photodetector array detection angle θ ' and lens opposite in display screen surface The distance between 621 and gasket 618 L.Fig. 8 A shows the viewgraph of cross-section along the direction perpendicular to display screen surface, Fig. 8 B Show the view for the equipment seen from display screen bottom or top.Packing material 618c can be used for filling lens 621 and light Interval between photodetector array 623.For example, packing material 618c can be material identical with special gasket 618 or It is another different material.In some designs, packing material 618c can be airspace.
Fig. 9 shows another example of optical sensor module under the screen in the design based on Fig. 7, wherein provides one A or multiple lighting sources 61, to illuminate the top surface sensing area 615 for optical finger print sensing.Lighting source 614 can be expansion It opens up type or collimates the light source of type, so that effectively all points are illuminated in sensing area 615.Lighting source 614 can be Unit piece light source or array of source.
Figure 10 A to 10B shows optical sensor module under the screen using the optical coupler 628 that shape is thin wedge and shows Example, to improve the optical detection at optical detector array 623.Figure 10 A is shown with for light under the screen of fingerprint sensing The cross section of the device structure of sensor module is learned, Figure 10 B shows the top view of device screen.Wedge 628 (has refractive index ns) it is located at the lower section of display panel structure, the total reflection item on bottom surface to modify the display panel structure engaged with wedge 628 Part, to allow to extract the light across bottom surface from display panel structure.Optical detector array 623 is received from wedge 628 The light extracted from display panel structure, optical imagery module 621 between wedge 628 and optical detector array 623, with Light from wedge 628 is imaged on optical detector array 623.In the example shown, wedge 628 includes facing to light Learn the oblique light wedge surface of image-forming module and optical sensing array 623.Also, as shown, in wedge 628 and optical imagery module Exist between 621 and is freely spaced.
If light is totally reflected at the sensing surface of cover-plate glass 431, reflectivity 100%, there is highest effect Rate.However, light can be also totally reflected at the light diffuser layer 433b of the bottom surface LCD if light is parallel with cover-plate glass surface.Wedge Shape coupler 628 allows light to couple output at optical detector array 623 for modifying local surfaces angle Detection.Micropore in LCD display module 433 provides so that light penetrates LCD display module 433 to carry out the phase for shielding lower optical sensing The propagation path of light of prestige.If light transmission angle becomes too big or when TFT layer becomes too thick, actual light transmission efficiencies may be by It is decrescence few.When the angle is close to the angle of total reflection, i.e., about 41.8 °, and when cover-plate glass refractive index is 1.5, fingerprint image Look like.Therefore, the angle of wedge of wedge-shaped coupler 628 can be adjusted to a pair several times, so that raising or optimizing detection Efficiency.If selecting the refractive index of higher cover-plate glass, the angle of total reflection becomes smaller.For example, if cover-plate glass is by refractive index About 1.76 sapphire is made, then the angle of total reflection is about 34.62 °.Also improve the detection light transmission efficiencies in display.Cause This, this design will test angle using thin wedge and be set above the angle of total reflection, and/or the cover-plate glass material using high refractive index Material, Lai Tigao detection efficiency.
Under the screen in Fig. 6 A to Figure 10 B in optical sensor module, the sensing region 615 on top transparent surface is not Detection axis 625 that is vertical or being not orthogonal to optical sensor module, so that the plane of delineation of sensing region is also not vertical Or be not orthogonal to detection axis 625.Therefore, the plane of photodetector array 523 can be inclination relative to detection axis 625 , to realize high quality imaging at light detection array 623.
Figure 11 shows this inclined three example arrangements.Figure 11 (1) shows sensing region 615a inclination and does not hang down Directly in detection axis 625.Under the specific condition shown in (2), sensing region 615b is aligned in detection axis 625, the plane of delineation Also can be located in detection axis 625.In practice, lens 621 can be cut away partly to simplify encapsulation.In various implementations, Lenticule 621 is also possible to transmission-type or reflection lens.For example, showing specific approach in (3).Sensing region 615c by Imaging lens 621a imaging.Photodiode array 623b is aligned to detect signal.
In the above-mentioned design using lens 621, the effective aperture of lens 621 can be designed as being greater than LCD display layer In hole aperture, the latter allows light to carry out optical finger print sensing through LCD display module.This design can reduce LCD The caused undesirable influence of wire structures and other Scattering Targets in display module.
Figure 12 show fingerprint sensor for reducing or eliminating in fingerprint sensing from the undesirable of bias light The example of the operation of influence.Optic sensor array can be used for acquiring various frames, and collected frame can be used for executing Difference and average operation between multiple frames, to reduce the influence of bias light.For example, in frame A, for optical finger print sensing Lighting source is turned on, and to illuminate the region of finger touch, in frame B, changes or close illumination.It can make in image procossing With the signal for subtracting frame B from the signal of frame A, influenced with reducing undesirable bias light.
It can also be by providing suitable optical filtering in the optical path come bias light undesirable when reducing fingerprint sensing.One A or multiple optical filters can be used for refusing that ambient light wave is long, for example, near-infrared IR light and partial feux rouges etc..Some In implementation, this optical filter coating can be produced on the surface of optical module, including display bottom surface, prism table Face or sensor surface etc..For example, the major part in the energy of wavelength of human finger's absorbing wavelength lower than~580nm, if One or more optical filters or optical filtering coating can be designed as refusal wavelength from 580nm to infrared light, then can be with The influence of optical detection when greatly reducing environment light to fingerprint sensing.
Figure 13 shows the example of the operating process for correcting the image fault in optical sensor module.In step At 1301, one or more lighting sources are controlled and are operated in and shone in a particular area, and the light emitting of this pixel It is modulated by frequency F.At step 1302, the frame rate of the imaging sensor under display panel be operating as it is identical with frequency F, with Acquire image.In optical finger print sensing operation, finger is placed on the top of display panel cover board substrate, and finger is deposited In the light reflected intensity for modulating the display panel cover board substrate top surface.What the imaging sensor acquisition fingerprint under the display was modulated Reflected light pattern.It is synchronous with frequency F to the demodulation of the signal from imaging sensor at step 1303, and carried on the back Scape filtering.Resulting image reduces the influence of bias light, and the image generated including the light from pixel emission.In step At 1304, acquired image is handled and calibrates, to correct image systematic distortion.At step 1305, the image that will correct As mankind's fingerprint image for user authentication.
The identical optical sensor used for acquiring the fingerprint of user, which can be also used for acquiring coming from, is illuminated hand The light of the scattering of finger, as shown in the light 191 scattered in bottom in Fig. 5 A.It can integrate and scatter to bottom in Fig. 5 A In light 191 area-of-interest in detector signal, to generate strength signal.Assess the Strength Changes of the strength signal with Determine the heart rate of user.
Above-mentioned fingerprint sensor can be capable of the fingerprint of authorized user and be replicated the fingerprint pattern being tampered The individual hacker attack of malice on the carrier for being similar to human finger.The fingerprint pattern of this unauthorized can be used in fingerprint On sensor, to unlock target device.Therefore, fingerprint pattern, despite unique biochemical characterization identifier, itself may not It is completely reliable or safe mark.Shield lower optical sensor module and be also used as optics anti-spoofing sensor, for sensing Whether the input target with fingerprint pattern is the finger from people living, and for determining whether fingerprint input is that fingerprint is taken advantage of Deceive attack.This optics anti-spoofing sensing function is provided without using individual optical sensor.Optics anti-spoofing can mention Whole Response speed for high-speed response, without damaging fingerprint sensing operation.
Figure 14 shows the exemplary extinction coefficient of the material monitored in blood, and the optical absorption in blood is such as It is different between the infra-red range of the infrared IR light of the limit of visible spectrum of the feux rouges of 660nm and such as 940nm.By using spy Light is surveyed to illuminate finger in second different wave length such as the first visible wavelength (color A) and infrared IR wavelength (color B), can be adopted The difference of the optical absorption of collection input target, to determine whether the target touched is the finger from still-living people.For providing One or more lighting sources of optical sensing illumination can be used for issuing the light of different colours and the light issued is at least two The detection light or illumination light of different optical wavelengths carry out live finger inspection to use the different optical absorption behaviors of blood It surveys.When human heart bounce, pulse pressure pump blood flows in the artery, therefore the delustring of the material monitored in blood Than changing with pulse.The signal received carries pulse signal.These characteristics of blood can be used for detecting monitored Material is living body finger print or false fingerprint.
Figure 15 shows the optical signalling row in the light of the reflection from non-living material (such as prosthetic finger) and live finger Comparison between.Optical fingerprint sensor is also used as heartbeat sensor to monitor biology living.When detecting detection light Two or more wavelength when, extinction ratio difference can be used for quickly determining whether monitored material is biology living, such as Living body finger print.In the example depicted in fig. 15, the detection light of different wave length has been used, as shown in figure 14, one is visible wavelength, Another is infrared RI wavelength.
When top blind flange glass above non-living material touch fingerprint sensor module, the signal received is disclosed Strength level relevant to the picture on surface of the non-living material, and the signal received does not include the hand with still-living people Refer to associated signal component.However, the signal received discloses when the finger of still-living people touches top blind flange glass Signal characteristic associated with still-living people, since the extinction ratio of different wave length is different, so the signal received includes Visibly different strength level.This method does not need to take a long time to determine and touch whether material is one of people living Point.In Figure 15, pulse-like signal has reacted the situation of multiple touch, rather than blood pulse.It is similar with non-living material It repeatedly touches and does not show the difference as caused by live finger.
This optical sensing of different optical absorption behaviors of the blood at different optical wavelengths can in short cycle into Row, be used for live finger detection, and can than use the people of identical optical sensor heartbeat optical detection faster.
In a lcd display, LCD backlight illumination light is white light, so that it is above-mentioned to be included in execution at optical sensor module The light of the limit of visible spectrum of live finger detection and infrared IR spectral region.LCD colour filter in LCD display module can be used The measurement result in Figure 14 and Figure 15 is obtained in permission optical sensor module.Furthermore it is possible to operate for generating optical sensing Illumination light specified light source 436, to issue detection light in different time with selected visible wavelength and infrared IR wavelength, and And the detection light of the return of two kinds of different wave lengths is acquired by optical detector array 621, with based on Figure 14 and it is shown in figure 15 on Operation is stated to determine and touch whether object is live finger.Although should be noted that the visible wavelength selected in different time It can reflect the different optical absorption characteristics of blood with the detection light of the reflection of IR wavelength, but fingerprint image in different time always by selecting The detection light collection of the detection light and infrared IR wavelength of fixed visible wavelength.Therefore, fingerprint sensing can be with visible wavelength and red It is carried out under outer IR wavelength.
Figure 16 shows true to be come with the bright finger of two different colors of illumination by operating one or more lighting sources The fixed target contacted with LCD display whether be people living finger a part operating process example.
For another example, disclosed optical sensor technology can be used for by except above-mentioned blood under different optical wavelengths not With other mechanism except optical absorption, " live finger " testing mechanism is utilized to detect fingerprint or hand collected or detect The pattern of the palm whether the hand from people living.For example, due to the natural mobile of people or moving (either intentionally or unintentionally) or working as blood The pulse relevant to heartbeat when human body is flowed through, the finger of people living is usually to move or stretch.A realization side In formula, caused by the light that optical sensor module can detecte the return from finger or palm changes due to heartbeat/blood flow Variation, so that detection is in the target for showing as finger or palm with the presence or absence of heartbeat living.User authentication can based on fingerprint/ The optical sensing of palm pattern and the combination determined to the front that there is people living enhance access control.For another example, when people touches When LCD display, the variation of touch force can reflect in one or more ways, including fingerprint pattern deformation, finger and screen The variation of contact area between surface, fingerprint ridge broaden or the dynamic change of blood flow.These variations and other variations can lead to It crosses based on the optical sensing of disclosed optical sensor technology and measures, and can be used for calculating touch force.It can be used This touch force sensing is more functions of the optical sensor module addition in addition to fingerprint sensing.
In the examples described above, as shown in Fig. 4 B and Fig. 6 B, fingerprint pattern is collected in fluorescence detector via image-forming module In permutation, optical distortion typically reduces image sensing fidelity.This image fault can correct in various ways.Example Such as, known pattern can be used to generate optical design at optical detector array, and the image coordinate in known pattern Related with the optical imagery with distortion generated at optical detector array, the image coordinate of the known image is for calibrating The imaging sensing signal for fingerprint sensing exported by optical detector array.The figure of fingerprint sensing module reference standard pattern As calibration output coordinate.
According to the content disclosed in this patent document, the various realizations of disclosed optical sensor module can be carried out Mode.
For example, display panel can be configured to: each light emitting pixel therein can be independently controlled;Display panel includes The transparent cover board substrate of at least partly transparent substrate and essence.Optical sensor module is located under display panel, with sensing The image formed on the top of panel surface.Optical sensor module can be used for sensing to be emitted from display panel pixel Light be formed by image.Optical sensor module may include that refractive index is transparent lower than the refractive index of panel substrate Block further includes the imaging sensor block and optical imaging lens with imaging sensor array.In some implementations, low The refractive index of refractive index block is in the range of 1.35 to 1.46 or 1 to 1.35.
For another example, a kind of method for fingerprint sensing can be provided, wherein the light emitted from display panel is by cover board substrate Reflection, the finger in cover board substrate top are interacted with light, to pass through fingerprint modulation light reflection graphic patterns.Under display panel at As sensing module is used to sense the light pattern image reflected, and fingerprint image is rebuild.In one implementation, in the time domain The transmitting light from display panel is modulated, and imaging sensor is synchronous with the transmitting modulation of pixel, the solution based on such setting Modulated process can refuse most of light in bias light (light for being not from object pixel).
The various designs of optical sensor module under the disclosed screen for optical finger print sensing are considered as Shen Please number for 62/289,328 U.S. Provisional Application and application No. is the hairs of a part of 62/330,833 U.S. Provisional Application The attachment 3 of bright entitled " multifunctional fingerprint sensor and encapsulation " (texts of page 41 and the attached drawings of page 26) and on June 20th, 2016 Submit, application No. is PCT/US2016/038445 international patent applications (it is required that in submit, application number on June 18th, 2015 It is the priority of 62/181,718 U.S. Provisional Patent Application, and is disclosed on December 22nd, 2016 with WO2016/205832) Neutralize that on November 2nd, 2016 is submitting, application No. is the international patent applications of PCT/CN2016/104354 (it is required that in 2015 November 2 was submitting, application No. is the priority of 62/249,832 U.S. Provisional Patent Application, and on May 11st, 2017 Disclosed with WO2017/076292) in be further described.The complete disclosure of above-mentioned patent application is incorporated by reference into this specially A part of sharp file disclosure.
It is disclosed herein for the screen of fingerprint sensing under optical sensor module technology various implementations in, can be with Realize that the touch partial optical of finger being illuminated is imaged onto the optical detector array shielded in lower optical sensor module, without Use the image-forming modules such as lens by the way that the light returned from the touch part of finger is imaged under illumination optical.Mould is not imaged One technological challenge of the optical finger print sensing of block is how to control the propagation of the light of return, and this propagation may be disturbed spatially The light that the different location of slave finger at random optical detector array touched on part returns, so that the light when this return arrives When up to optical detector array, the spatial information of different location may be lost.This challenge can be by using optics collimator Or the optical imagery module that pinhole array substitution is shielded in lower optical sensor module detects fingerprint using optical sensing to solve.One The equipment that kind sends for realizing this optical finger print may include: device screen, provide touch-sensing operation and including tool There is the display panel structure of light emitting display pixels, each pixel can be operated to shine, to form a part of display image;Top Hyaline layer is formed on device screen, is come from as the user's touch interface operated for touch-sensing and being used for transmission The light of structure is shown so that image to be shown to the interface of user;And optical sensor module, it is located at below display panel structure, It is examined with receiving light that is being issued by least part in the light emitting display pixels of display structure and returning from top clear Fingerprint is surveyed, which includes optical detector array, which receives the light returned, the optics Sensor module further includes the optics collimator array or needle in the path to optical detector array of the light of the return Hole array.Optics collimator array is used to collect the light of the return from display panel structure, and separates and come from top transparent The light of different location in layer, while the light for the return being collected into being guided to optical detector array.
Different collimators is used dependent in different location using the imaging of collimator, it will be from the not same district of fingerprint The light in domain is spatially separated the different fluorescence detectors in optical detector array.Each collimator is along the collimator Thickness or length can be designed as controlling each collimator optical view narrow field, for example, being only from the finger being illuminated On the light of zonule acquired by each collimator, and be projected onto several adjacent fluorescence detectors in optical detector array On.For example, can be by each collimator along the thickness of the collimator or very big, such as several hundred microns, so that often of Design of length The field of the optical view of a collimator can permit collimator in such as optical detector array on optical detector array A fluorescence detector or several adjacent fluorescence detectors zonule transmission imaging (for example, in some cases, More than ten microns of region on every side of optical detector array).
Following part explains optics collimator array by example or how pinhole array is used to shield lower optical finger print sense It surveys, which uses optics collimator in mixing sensor pixel when optical finger print is sensed, and each mixing sensor pixel has Optical sensor for acquiring the capacitance type sensor of finger print information and for acquiring finger print information.
Figure 17 A and 17B show the mixing that capacitance sensing and optical sensing are incorporated in same sensor pixel and sense picture Two examples of element design.
Figure 17 A shows the example of finger sensor apparatus 2100, and the finger sensor apparatus 2100 is in acquisition fingerprint letter When breath, capacitance type sensor is incorporated on the basis of optical sensor for each sensor pixel of sensor pixel array.It is logical It crosses and combines capacitance type sensor and optical sensor, can be used for preferably decomposing using the fingerprint image that optical sensor obtains The 3D dactylotype obtained using capacitance type sensor.For illustrative purposes, the representation sensor pixel shown in Figure 17 A A sensor pixel in array, and each sensor pixel includes that optics disposed adjacent one another in same pixel passes Sensor 2102 and capacitance type sensor 2114.
Optical sensor 2102 includes photoelectric detector 2108 and the collimator 2106 being placed in above photoelectric detector 2108, So as to narrow or focus towards photoelectric detector 2108 from the light 2124 that finger 2102 reflects.The one or more such as LED light source is (not Show) it can be placed on around collimator 2106 and shine, which is reflected into the light 2124 of reflection by finger, and is directed to Corresponding photoelectric detector 2108 is focused towards corresponding photoelectric detector 2108, in the fingerprint image to acquire finger 2102 A part.Fiber optic bundle or one or more metal layers with hole or opening can be used to realize collimator 2106.This Kind may be used as the finger that acquisition has desired spatial resolution using multiple optics collimators above optical detector array The non-lens optical of line figure designs, to carry out reliable optical finger print sensing.Figure 17 A is shown using with hole or opening The collimator 2106 that 2112 one or more metal layers 2110 are realized.It is examined in Figure 17 A in top structure or layer 2104 and photoelectricity Survey device 2108 between layer in collimator 2106 include by optical fiber or one or more layers (such as silicon or metal) hole or opening The multiple individual optics collimators formed, each of this individual optics collimator are received along each optical alignment The longitudinal direction of device or the light 2124 in small angular region, as shown, light 2124 can be opened at the top of each opening or hole Mouth and tubular structure acquisition, so that the light with large angle incidence from each optics collimator longitudinal direction is by each collimator Refusal reaches the optical photoconductor diode on the other end of the optics collimator.
In the capacitance type sensing part of each sensor pixel, capacitance type sensor 2114 includes capacitance type sensor plate 2116, the capacitance type sensor plate 2116 be electromagnetically coupled to and sensor pixel near to or in contact with finger a part, with carry out Capacitance type sensing.More specifically, when finger 2102 and the movement of optional cover board 2104 or realization finger sensor apparatus 2100 are set When standby upper cover board is contacted or is within close proximity, capacitance type sensor plate 2116 and finger 2102 are as one or more condenser types members Two plates of part 2122 interact.The quantity of capacitance type sensor plate 2116 can be based on the design of capacitance type sensor 2114 And change.One or more metal layers can be used to realize in capacitance type sensor plate 2116.Capacitance type sensor plate 2116 is logical Letter ground is coupled to capacitive sensor circuits 2120, so that capacitive sensor circuits 2120 can handle from capacitive sensing The signal of device plate 2116, to obtain indicating the signal of 3D dactylotype.It can be passed in capacitance type sensor plate 2116 and condenser type Setting routing or shielding material between sensor circuit, with electrical shielding metal plate 2116.Capacitive sensor circuits 2120 can lead to Letter ground is coupled to capacitance type sensor plate 2116 and photoelectric detector 2108, to handle the letter from capacitance type sensor plate 2116 Number and the signal from photoelectric detector 2108.Capacitance type sensor and optics in Figure 17 A, in each mixing sensor pixel Sensor is adjacent to each other and mutually there is displacement, without being spatially overlapped.
In implementation method, the optical sensings feature such as optics collimator design in hybrid sensor design in Figure 17 A, It can be used for shielding in lower optical sensor module.Therefore, the optical sensing in Figure 17 A with optics collimator feature can be in energy It is enough detected by optical sensing and is realized in the mobile device or electronic equipment of fingerprint, the mobile device or electronic equipment include: aobvious Display screen structure;The top clear being formed on display screen structure is come as user's touch interface and as being used for transmission Image is shown to the interface of user from the light of display screen structure;And optical sensor module, positioned at display screen structure Fingerprint is detected to receive the light returned from top clear in lower section.Optical sensor module includes the light for receiving the light returned The optical detector array of photodetector further includes optics collimator array, saturating from top to be collected by display screen structure The light of the return of bright layer, and separate the light of different location in top clear, while by the light for the return being collected into The photoelectric detector into optical detector array is guided across optics collimator.
Figure 17 B shows another example of finger sensor apparatus 2130, which is sensing Optical sensor and capacitive sensor structure are integrated in the configuration overlapped in space by each mix in device pixel array It closes in sensor pixel, to reduce each mixing sensor pixel the space occupied.Finger sensor apparatus 2130 is half including silicon etc. Conductor substrate 2131.Multiple sensing elements or sensor pixel 2139 are set on substrate 2131.Each sensing element or sensing picture Element 2139 includes active electronic circuit region 2132, which includes cmos switch, amplifier, resistance Device and capacitor, to handle sensor signal.Each sensor pixel or sensing element 2139 include being arranged or being embedded in active electronic Photoelectric detector 2133 in circuit region 2132.The capacitance type sensor plate of capacitance type sensor for capacitance type sensing or Top electrodes 2134 be arranged on photoelectric detector 2133, and including on sensor board 2134 hole or opening 2138, also rise To light is directed to the effects of the collimator of the light on photoelectric detector 2133.Through-hole 2135 filled with conductive material is set, Top electrodes 2134 are electrically connected to active circuit element 2132.By adjusting opening or hole and top electrodes 2134 and light The distance of photodetector 2133, the light collection angle 2137 of adjustable photoelectric detector (such as photodiode) 2133.Fingerprint passes Sensor equipment 2130 is covered by cover sheet 2136, which includes hard material, such as sapphire, glass etc.. The light collection angle 2137 of photoelectric detector 2133 can be designed as saving the space point for the image collected by photodiode array Resolution.The light sources such as LED 2140 are located at below cover board, and in the side of finger sensor apparatus 2130 to shine, the light is by finger It reflects and guides to photoelectric detector 2133, to acquire fingerprint image.When finger touch cover sheet or with cover sheet very When close, finger and the combination for sensing top electrodes 2134 form the capacitive coupling between human body and sensing top electrodes 2134 (such as Capacitor 2142).Finger sensor apparatus 2130 including optical sensor and capacitance type sensor can obtain the light of fingerprint Reflected image and capacitive coupling image both images.It senses top electrodes 2134 and is used for dual purpose: 1) being used for condenser type sense The light surveyed and 2) will returned from finger as collimator (by manufacturing one or more holes on sensing top electrodes 2134) Guidance narrows or focuses to photoelectric detector 2133 or towards photoelectric detector 2133.The recycling of sensing top electrodes 2134 disappears In addition to the needs to additional metal layer or fiber optic bundle, to reduce the size of each pixel, and fingerprint sensing is therefore reduced The overall dimensions of device equipment 2130.
In Figure 17 B, optical sensing design is used to be formed between top layer 2136 and the bottom array 2133 of photoelectric detector Hole or opening 2138 be used as optics collimator, only to select the light in certain angles 2137, to keep as shown in the figure The spatial resolution for the image that photoelectric detector 2133 in photodetector array is collected.Similar in Figure 17 A optical fiber or Other tubular optical collimators, the hole formed between top layer 2136 and the bottom array of photoelectric detector 2133 or opening 2138 Optics collimator is constituted, the light of the return from top clear is collected via display screen structure, and separate and come from top The light of different location in hyaline layer, while the light for the return being collected into is passed through into optics collimator and is guided to photoelectric detector 2133。
Figure 18 is that the exemplary mixing being incorporated to optical sensor and capacitance type sensor in each mixing sensor pixel refers to The top view of line sensor device 2200.Finger sensor apparatus 2200 is embodied as CMOS silicon chip 2221, the CMOS silicon chip 2221 include mixing (being incorporated to optical sensor and capacitance type sensor) sensing element array or pixel array 2222.Alternatively Ground, the layout in Figure 18, which can be also used for all optical sensings designs, split shed or hole 2223 disclosed in this document, to be indicated Optics collimator in Figure 17 A and Figure 17 B.For example, the size or size of sensing element can be in 25 μm to 250 μm of ranges It is interior.Hybrid sensor equipment 2220 may include support circuits array, which includes in lateral side regions 2224 Amplifier, analog-digital converter ADC and buffer storage.In addition, hybrid sensor equipment 2200 may include for wire bonding Or the region 2225 of protrusion engagement.The top layer 2226 of hybrid sensor element 2222 may include the metal electricity for capacitance sensing Pole.One or more openings or hole 2223 can be manufactured, in each top metal electrode 23 to be used as collimator in structure Light is guided on the photoelectric detector being radiated at below top electrodes with vertical direction.Therefore, 2226 structure of top layer can be used In the dual purpose of optical sensing and capacitance sensing.A kind of sensor device processor can be provided, with processing from mixing sense The pixel output signal of pixel is surveyed, come the information that takes the fingerprint.
Except shared as collimator for capacitance sensing and identical structure for focusing light in vertical direction in addition to, can be with An example of shared sensor signal deteching circuit between optical sensor and capacitance type sensor comes from photoelectricity with detection The sensor signal of detector and capacitance type sensor plate.
Figure 19 A shows the exemplary mixed-fingerprint sensing with capacitance sensing and optical sensing function for fingerprint Part or pixel 2300.The illustrative sensors pixel 2300 includes Transducer Signal Detecting Circuit 2316, to detect or obtain Based on capacitance sensing come the sensor signal of self-inductance measurement top electrodes (such as metal layer at top) 2308 and based on optical sensing Optionally switched between sensing signal from photoelectric detector (such as photodiode) 2314, with obtain finger from light The reflection optical imagery of photodetector 2314 and the capacitive coupling image from capacitive sensor electrode 2308.In some realizations In mode, two images for sensing mechanism from two kinds in each mixing sensor pixel can be examined serially by sensor signal Slowdown monitoring circuit processing.In the example shown, switch 2310 and 2312, which includes, is electrically coupled to sensing top electrodes 2308 and light The first end of photodetector 2314, and it is coupled to the second end of the shared input of Transducer Signal Detecting Circuit 2316, with The corresponding fluorescence detector signal from photoelectric detector 2314 and corresponding is provided to Transducer Signal Detecting Circuit 2316 Carry out the capacitance sensing signal of self-inductance measurement top electrodes 2308.When switch 2310 disconnects (CAP_EN=0) and the closure of switch 2312 (Optical_en=1) when, Transducer Signal Detecting Circuit 2316 obtains what expression received at specific blend sensor pixel Scan the fluorescence detector signal of the optical imagery of fingerprint.As the CAP_EN=1 of switch 2310 and optics _ en=0, sensor The capacitance sensing signal of the available capacitance image for indicating scanning fingerprint of signal deteching circuit 2316.In optical imagery and capacitor Image is acquired later, and two images can be handled either individually or in combination in circuit downstream, to identify fingerprint characteristic.
It, can be by utilizing two kinds of image in different ways with two kinds of image modes of above-mentioned mixing sensor pixel To enhance the performance of fingerprint recognition.The fingerprint recognition of this enhancing can be set by sensors such as sensor device processors 2321 Standby processor is realized, for handle from the pixel output signal for mixing sensor pixel, with the information that takes the fingerprint.For example, electric The 3D rendering of depth of the ridge and paddy about fingerprint characteristic can be provided by holding image.As the supplement of 3D capacitance image, optical picture As the high resolution 2 D information about fingerprint characteristic can be provided.Because two kinds of image informations are all about the identical ridge of fingerprint, So the optics 2D image with more high spatial resolution can be used for restoring capacitance sensing image resolution ratio.In some realization sides In formula, compared with optical sensing method, capacitive sensing method can more sensitively and accurately identify the paddy of fingerprint, use capacitor Method for sensing obtain image spatial resolution can the thickness based on cover board and deteriorate.This aspect of capacitance sensing can be with It is made up by optical sensing.In operation, sensor response be can be fixed, and the point spread function of capacitance type sensor All sensor positions can be fixed.The optical sensing of higher resolution may be used as resolution ratio restoration methods, And it can apply on capacitance sensing image to enhance 3D rendering.Part high-definition picture from optical sensing can be used In the help restoration methods.Therefore, can by enhancing 3D capacitance image based on the interpolation of high resolution 2 D image or recovery, To provide the more information about valley and a ridge.
The 3D rendering of enhancing can provide improved fingerprint recognition and matching.In another example, light can be stored together Image and capacitance image are learned, is compared with providing two kinds when carrying out fingerprint recognition or matching every time.Use two kinds of image It is compared and enhances the accuracy and safety of fingerprint sensing system.
Transducer Signal Detecting Circuit 2316 can be used a variety of different circuit designs and realize in various ways.At one In example, integral sensing circuit 2318 can be implemented as storing the charge as caused by the touch of ridge or paddy or the lid from mobile device Charge caused by the cover board of the very close finger sensor apparatus of plate.To integrating circuit 2318 comprising enhancing signal-to-noise ratio (signal-to-noise ratio, SNR).Integrating sensing circuit includes operational amplifier 2322, to amplify by exemplary sensing The sensor signal that the sensing top electrodes 2308 or photoelectric detector 2314 of device pixel 2300 detect, such as capacitance correlated signal Or optical correlation signal (for example, voltage signal).The sensing top electrodes of conductive materials such as including one of various metals 2308 are electrically connected to the negative terminal or inverting input terminal 2328 of amplifier 2322 by switch 2310.Sense top electrodes 2108 and hand The local surfaces 2302 of finger play the role of the opposite plate of capacitor Cf 2302.The capacitor of capacitor Cf 2302 is based on finger The distance between local surfaces and sensing top electrodes 2308 ' d ' variation, two plates of the distance ' d ' i.e. capacitor Cf 2302 The distance between.The distance between the capacitor of capacitor Cf 2302 and two plates of capacitor Cf 2302 ' d ' are inversely proportional.Work as sense The capacitor of capacitor Cf 2302 is greater than when sensing top electrodes 2308 and finger when survey top electrodes 2308 are opposite with the ridge of finger Paddy it is opposite when capacitor Cf 2302 capacitor.
In addition, various parasitic capacitances can be formed between different conducting elements in illustrative sensors pixel 2300 Device or other capacitors.For example, capacitor parasitics can be formed between sensing top electrodes 2308 and equipment ground end 2305 CP 2304.Equipment ground is closely coupled to the earth.Another capacitor Cr 2324 can be in the output conductor of amplifier 2322 It is formed between the negative terminal or inverting input terminal 2328 of amplifier 2322, and plays the work of the feedback capacity of amplifier 2322 With.Also, switch 2326 can be coupled in the output end of amplifier 2322 and the negative terminal or inverting input terminal of amplifier 2322 Between 2328, to reset integrating circuit 2318.
The anode of amplifier 2322 is electrically connected to pumping signal Vref.It, can be directly to special in each sensor pixel Pumping signal Verf is provided with the anode of amplifier.By directly providing pumping signal Verf to the anode of amplifier 2322, show Example property sensor pixel 2100 becomes active sensor pixel.In addition, directly providing pumping signal to the anode of amplifier 2322 Verf eliminates the needs of the excitation electrode shared including all the sensors pixel, reduces half from sensor chip in this way Conduction (such as metal) layer of conductor structure.In some implementations, it based on the design of sensor pixel, may be implemented optional Motivate electrode 2306 to enhance SNR.In addition, by directly providing pumping signal Verf, pumping signal Vref to amplifier 2322 It is not directly applied to finger, to avoid the potential stimulation or injury to finger.Moreover, pumping signal directly ought be applied to hand When the excitation electrode of finger is not used by, all components of finger sensor apparatus can be integrated into single package equipment, and And entire finger sensor apparatus can be set under cover sheet glass.Since the setting of entire finger sensor apparatus is being protected Under protecting cover glass sheet, protect finger sensor apparatus from the finger of fingerprint sensor and the shadow of other outer members may be damaged It rings.
In Figure 19 A, output signal (the optics output letter of the Transducer Signal Detecting Circuit 2316 in sensor pixel 2300 Number and capacitor output signal) (such as Vpo of amplifier 2322) be electrically coupled to switch 2320, selectively by output signal Vpo The signal processing circuit including filter is output to from sensor pixel 2300.Transistor can be used in switch 2320 or other are cut It changes planes and makes to realize, and may be electrically coupled to controller, with the switching of control switch 2320.By control switch 2320, 2310 and 2312, is obtaining optical signalling and obtaining capacitor letter to the sensor pixel property of can choose in sensor pixel array Switch between number.In one implementation, in available array the sensor pixel of every a line, row or column optical signalling Or capacitance signal, switch the optical signalling or capacitance signal then to obtain the other types signal of the row, row or column.It can be by Row carries out the switching between optical signalling acquisition and capacitance signal acquisition.In another implementation, institute in available array There is a type of signal (capacitance signal or optical signalling) of sensor pixel or element, then switches the signal of this type To obtain the other kinds of signal of all the sensors pixel or element.Therefore, between the acquisition of different signal types Switching can occur in entire array.Other deformations of switching between the acquisition of two kinds of sensor signal can be real It is existing.
Figure 19 B shows the circuit diagram of another exemplary mixed-fingerprint sensing element or pixel 2340.For with identical The component of appended drawing reference, mixed-fingerprint sensing element or pixel 2340 and mixed-fingerprint sensing element or the substantive phase of pixel 2300 Together.Description for the common elements with same reference numerals, referring to the description of Figure 19 A.
Mixed-fingerprint sensing element or pixel 2340 are using sensing top electrodes 2308, on it to include playing collimator The hole of effect or opening 2342, the light 2344 that will reflect is towards photoelectric detector 2314 (such as photodiode) focusing or narrow Change.Photoelectric detector 2314 can be located at or the lower section for the collimator realized using sensing top electrodes 2308 is arranged in, to adopt Collect the light 2344 of the reflection focused by collimator 2308.
It in some implementations, may include the Transducer Signal Detecting Circuit of optical sensor and capacitance type sensor Independent example, concurrently to detect the sensor signal from photoelectric detector and capacitance type sensor plate.
Figure 19 C shows the circuit diagram of exemplary mixed-fingerprint sensing element or pixel 2350, for examining to from photoelectricity The sensor signal for surveying device and capacitance type sensor plate carries out parallel detection.For the component with same reference numerals, mixing Fingerprint sensing element or pixel 2350 and mixed-fingerprint sensing element or pixel 2340 are substantially identical.For with identical attached drawing mark The description of the common elements of note, referring to the description of Figure 19 A.
In order to carry out parallel detection, mixed-fingerprint sensing element to the sensor signal from capacitor board and photoelectric detector Or pixel 2350 includes that the individual sensor being communicatively coupled respectively with sensing top electrodes 2308 and photoelectric detector 2324 is believed Number detection circuit 2316 and 2317.Transducer Signal Detecting Circuit 2317 can be implemented as being substantially similar to sensor signal inspection Slowdown monitoring circuit 2316.In some implementations, switch 2310 and 2312, which can be set to have, is electrically coupled to sensing top The first end of electrode 2308 and photoelectric detector 2314, and it is respectively coupled to the of Transducer Signal Detecting Circuit 2316 and 2317 Two ends, to provide the fluorescence detector letter from photoelectric detector 2314 respectively to Transducer Signal Detecting Circuit 2316 and 2317 Number and carry out the capacitance sensing signals of self-inductance measurement top electrodes 2308.When switch 2310 and 2312 open and close together, sensing Device signal deteching circuit 2316 and 2317 can concurrently be believed from the sensor of capacitor board 2308 and photoelectric detector 2314 It number is detected.When switch 2310 and 2312 is mutually out of phase ground open and close, 2316 He of Transducer Signal Detecting Circuit 2317 can serially detect the sensor signal from capacitor board 2308 and photoelectric detector 2314.In addition, sensing Device device handler 2321 can directly or indirectly be communicatively coupled to sensor signal detection by switch 2320A and 2320B Circuit 2316 and 2317, concurrently or sequentially to handle the sensing from capacitor board 2308 and photoelectric detector 2314 detected Device signal.
In the another aspect of disclosed technology, due to the heartbeat and pump action of heart, for Figure 17 A, Figure 17 B, figure 18, the optical sensor of Figure 19A and Figure 19B description can be used for by becoming at any time caused by blood flow variation in measurement finger The intensity of reflected light of change, to measure the heartbeat of people.The information is included in by the light of finger reflection, scattering or diffusion received In, and carried by fluorescence detector signal.Therefore, optical sensor can be used for multiple functions, the light including obtaining fingerprint It learns image and measures the heartbeat of people.In the implementation, sensor device processor is for handling one or more fluorescence detector letters Number, to extract heartbeat message.This sensor device processor from optical sensing pixel or can mix sensing picture with processing The pixel output signal of element is identical with the sensor device processor for the information that takes the fingerprint.
Following section describes use the example for shielding the various designs that lower optical sensor module carries out fingerprint sensing, the screen Lower optical sensor module is guided the signal light for carrying finger print information to optics using optics collimator array or pinhole array Detector array.This optics collimator or pin hole are placed on LCD display and shield the optics inspection in lower optical sensor module It surveys between device array, to couple the light of the desired return from display panel, while carrying out light in optical detector array Wiping out background light when learning detection.The realization of this optics collimator or pin hole can simplify optical detector array and carry out optics inspection The optical design of survey, for example, without using in Fig. 6 B, Fig. 7, Figure 10 A and Figure 11 in other designs disclosed in this patent document The complicated optical imaging designs such as imaging design.In addition, the realization of this optics collimator or pin hole can simplify optics inspection Survey device array entire optical layout optical alignment, and improve optical detector array carry out optical detection reliability and Performance.Moreover, this optics collimator or pin hole, which can significantly simplify manufacturing process and reduce, shields lower optical sensor module Overall cost.
Figure 20 shows showing for the smart phone with liquid crystal display (LCD) display and the lower optical sensor module of screen Example, optical sensor module includes optics collimator array under the screen, for correcting light and light is directed to for optical finger print The optical detector array of sensing.Touch-sensing display system 423 based on LCD realizes under LCD display system 423 to be had The optical sensing module of photodetector array 621.
Touch-sensing display system 423 is placed under top blind flange glass 431, and the top blind flange glass 431 is as wrapping It includes the touch-sensing operation of user and shows the user interface surface of various user's bonding operations of image etc., Yi Jizuo to user For the optical sensing interface for carrying out fingerprint sensing and other optical sensings for receiving finger, wherein detect light from device external It is directed to top blind flange glass 431, to illuminate finger.Although micro-structure can eliminate part detection luminous energy, work as sensing window When LCD cell in mouthful is opened, the major part in LCD structure layer 433a becomes partially transparent.Light diffuser 433b, optical waveguide 433c, reflector film 433d and LCD module frame are used to support fingerprint sensor and provide transparent or partially transparent sensing Optical path, so that a part of of the light of the reflection from 431 top surface of cover-plate glass can reach under LCD screen in optical sensor module Photodetector array 621, carry out fingerprint sensing and other optical sensings and operate.As shown, the optical sensing under LCD screen This particular example of device module includes various fingerprint sensing device assemblies, for example, for collimated reflected detection light and by reflection Detection light is guided to the optics collimator array 617 of photodetector array 621, and is received and adjusted from photoelectric detector battle array The optical sensor circuit module 623 of the detector output signal of column 621.Optics collimator array 617 may include optics standard Straight device, and the optics collimator array 617 can be image generator based on waveguide, fiber array, microlens array or Pinhole array.Optics collimator is used for the numerical aperture (NA) of limited samples image and is used to form corresponding image-element. Each optics collimator unit obtains a part of the image of the touch part of target finger on top glass cover board 431.It is all The light beam of collimator transmission forms the complete image of target at photodetector array 621 jointly.Photodiode array 621 It can be the cmos sensor, CDD sensor array or photosensitive applicable fluorescence detector battle array of CMOS sensor pixel Column.
Shown in example include shown for LCD and touch-sensing operation electronic-component module 435, such as monitoring One or more other sensors 425 of the optical sensor of the light level of ambient enviroment etc. and for controlling certain intelligent hands The optional side button 427 and 429 of machine operation.
In the example of fig. 20, the light source in shown example includes display backlight light source 434 and additional specified detection Light source 436.Light beam 442a from the additional specified probe source 436 and light beam 442b from display light source 434 can be with Light is detected as the sensor for illuminating the finger contacted with top glass cover board 431, to generate desired carrying fingerprint image Case and other information to optical sensor module reflection detection light.
Although micro-structure can eliminate part detection luminous energy, when sensing the LCD cell opening in window, LCD structure Major part (including liquid crystal cells, electrode, transparent ITO, polarizer, colour filter, touch-sensing layer etc.) in layer 433a becomes It is partially transparent.Light diffuser 433b, optical waveguide 433c, reflector film 433d and LCD module frame are used to support fingerprint sensor, And provide transparent or partially transparent sensing optical path.
Figure 21 shows the operation of optical sensor module under the LCD screen in the above-mentioned example of Figure 20 further below.? On top blind flange glass 431, fingerprint sensing region or window are the region on 431 top surface of top blind flange glass, the top blind flange The surface for the optical sensor module that glass 431 is located below or close following optical sensor module.Since optics passes Sensor module is below LCD structure, so sensing window is a part of the continuous top surface of top blind flange glass 431, and The sensing window is also a part of the display area shown for LCD.It therefore, can be without visible physics side on top surface Boundary shows the sensing window.This sensing window can show by other means to user to help user by finger It is placed in fingerprint sensing and the sensing window of other optical sensings operation.For example, additional specified probe source 436 It can be used for illuminating sensing window, so that the region of sensing window differs markedly from the peripheral region on top blind flange glass, and And easily visible region of user.This can be completed when LCD panel is closed or LCD panel is opened.
As shown in figure 21, user presses finger on sensing window, and then, detection light beam 82P illuminates finger.Finger and lid Detection light is reflected into the signal beams 82R of reflection by glass sheet 431.Various scattering interface 433S diffusion in LCD module 433 is anti- The signal beams 82R penetrated, to form the light beam 82D of diffusion.Each collimator unit in collimator array 617 selects light component 82S and the corresponding photosensitive detector that selected light component 82S is inducted into photodetector array 621.Photodiode or CMOS senses the photosensitive detectors such as detector and generates the respective sensor signals comprising the information about fingerprint pattern.In light source A part can enter fingerprint sensor mould in the case where the finger sensing area on the top surface for not first passing through LCD panel Block.This part light is ambient noise, and can be eliminated by calibrating.Each collimator unit of collimator array 617 is only Selection is transferred to a part in photodetector array 621 accordingly with relatively low light loss along the direction that it allows Light in photoelectric detector.Therefore, each collimator unit in collimator array 617 and its in photodetector array 621 In corresponding photoelectric detector operate together, to define effective detection optical numerical aperture NA.The NA is directly defined by optics The spatial resolution for the image that sensor module generates.
Based on optical sensor designs under disclosed LCD screen, directly contacted with LCD display or attached in LCD display The finger of close people enables to the light returned to carry the illumination exported by LCD display while returning in LCD display The information for a part of finger being mapped to.This information may include the ridge for the part of finger being irradiated to and the space pattern of paddy With position etc..Therefore, at least part in the integrated light that can acquire this return of optical sensor module, to pass through light Picture and optical detection operation are studied to detect the ridge for the part being irradiated to of finger and the space pattern of paddy and position.The detection To finger the ridge for the part being irradiated to and the space pattern of paddy and position then can be processed, to construct fingerprint pattern And fingerprint recognition is carried out, for example, a part as user authentication and equipment access process, authorized user's fingerprint image with storage Whether case is compared, be matching fingerprint with the fingerprint confirmly detected.Use this of disclosed optical sensor technology Fingerprint detection based on optical sensing uses LCD display as optical sensing platform, and can be used for substituting existing electricity Appearance formula fingerprint sensor or other fingerprint sensors, these sensors are substantially the standalone sensor as " additional " component, Without using the light from display screen or use the display screen of the fingerprint sensing for mobile phone, tablet computer and other electronic equipments.
It should be noted that the optical sensor module based on disclosed optical sensor technology may be coupled to LCD The back side of display screen without the display surface side of the display screen in LCD specified region, some smart phones, plate electricity In the electronic equipments such as brain or wearable device, which can occupy valuable equipment surface space.This optical sensor Module can be placed under the display screen of LCD, vertically superposed with display screen area, also, from the perspective of user, the optics Sensor module is hidden in behind display screen area.Further, since the optical sensing of this optical sensor module is to pass through Display screen of the detection from LCD and light that top surface from display area returns and carry out, disclosed optical sensor mould Block does not need the special sensing ports or sensing region separated with display screen area.Therefore, in the iPhone/iPad including apple In other designs of equipment or Samsung Galaxy smart phone model etc., fingerprint sensor is located in the similar face of display screen At particular fingerprint sensor region or port (such as home button), but the specified non-display area being located at outside display screen area In, different from the fingerprint sensor in other designs, the optical sensor module based on disclosed optical sensor technology Can realize in the following manner: by using unique optical sensing design will the optical routing that is returned from finger to optical sensor In, and high resolution optical imaging sensing is realized by providing suitable optical imagery mechanism, allow on the display screen of LCD Position at carry out fingerprint sensing.On this point, the implementation of disclosed optical sensor technology is schemed by using with display It as identical top touch-sensing surface, is configured to provide fingerprint sensing on unique screen, and touch-sensing operation is provided, and The fingerprint sensing region not separated outside display screen area or interface
Outside the fingerprint detection carried out except through optical sensing, optical sensing can be also used for measurement other parameters.For example, Disclosed optical sensor technology can measure the palm of the people of available large touching surface product on the display screen of entire LCD Pattern (on the contrary, some specified fingerprint sensors, as apple iPhone/iPad equipment home button in fingerprint sensor, It, may be uncomfortable by height limitation in the size of sensing region with fingerprint sensing region outside fairly small and specified screen It closes and senses big pattern).For another example, disclosed optical sensor technology can be used not only for acquiring and detecting using optical sensing The pattern of finger associated with people or palm can be also used for passing through using optical sensing or other sensing mechanism to detect " live finger " testing mechanism is collected or the pattern of fingerprint or palm that detects whether the hand from still-living people, the inspection Survey mechanism can with based on the fact that, due to the natural mobile or movement (intentional or unintentional) of still-living people or when blood flows through and the heart Pulsation when connected human body is jumped, the finger of this people is usually to move or stretch.In one implementation, due to Heartbeat/blood flow variation, optical sensor module can detecte the variation of the light of the return from finger or palm, so that detection exists It shows as in the target of finger or palm with the presence or absence of the heartbeat to live.User authentication can be based on fingerprint/palm pattern light Sensing and the combination determined to the front there are still-living people are learned to enhance access control.For another example, optical sensor module can be with It is full for measuring glucose level or oxygen based on the optical sensing of the light from finger or the return of palm including sensing function And degree.For another example, when people touches the display screen of LCD, the variation of touch force can reflect in one or more ways, including fingerprint The variation of contact area between pattern deformation, finger and screen surface, fingerprint ridge broaden or the dynamic change of blood flow.These become Change and other variations can be by being measured based on the optical sensing of disclosed optical sensor technology, and can be used for counting Calculate touch force.This touch force sensing can be used in adding more function in addition to fingerprint sensing for optical sensor module Energy.
Relevant useful operation or controlling feature, disclosed optics in terms of for the touch-sensing to the display screen of LCD Sensor technology can provide Trigger Function or additional function based on one or more results from optical sensor module, with Carry out certain operations relevant to the touch-sensing control on the display screen of LCD.For example, the optical characteristics of finger skin is (as rolled over Penetrate rate) it is usually different from other man-made targets.Optical sensor module can be designed as selectively receiving and detect accordingly by The light of return caused by the finger contacted with the surface of the display screen of LCD, and the light of the return as caused by other targets will not be by Optical sensor module detects.This target selectivity optical detection may be used to provide the useful use by touch-sensing Family control, such as only could wake up smart phone or equipment via the touch of the finger of people or palm, and the touch of other targets It will not cause the revival of equipment, to carry out power-save operation and extend the use of battery.This operation can be by being based on optics The control of the output of sensor module is realized, to control the wake-up circuit operation of LCD display, wherein for example, may include The additional light source for optical sensing of design, and the additional light source for opening the design is at flash mode, with to screen Scene plot face intermittently flashes to sense any touch of the finger of people or palm, while LCD display can be placed in and sleep Sleep mode is to save energy.In some implementations, waking up sensing light can be in the sightless spectral region of infrared ray, institute The flashing of any visual light will not be undergone with user.
Optical sensor module based on disclosed optical sensor technology may be coupled to the back of the display screen of LCD Face, without creating specified region in the surface side of the display screen of LCD, the region is in some smart phones, plate electricity Valuable equipment surface space can be occupied in the electronic equipments such as brain or wearable device.This aspect of disclosed technology can be with For providing certain advantages or benefit in equipment design and product are integrated or manufactured.
In some implementations, the optical sensor module based on disclosed optical sensor technology can be configured For non-invasive module, be easily integrated to the display screen of LCD, without change LCD display screen design with The desired optical sensing functions such as fingerprint sensing are provided.On this point, the optics based on disclosed optical sensor technology Sensor module can be independently of the design of the design of LED of specific LCD, this is because optical sensor module is following Property: the optical sensing of this optical sensor module is by detecting the display screen from LCD and from display area top What the light that face returns carried out, and disclosed optical sensor module is coupled to the back side of the display screen of LCD, comes for receiving From the light of the return of the top surface of display area, without the specific sensing ports or sensing area separated with display screen area Domain.Therefore, optical sensor module can be used for combining with the display screen of LCD under this screen, to provide on the display screen of LCD Optical finger print sensing and other sensors function, without the use of having the hardware for being specially designed for providing this optical sensing The display screen of the LCD of special designing.This respect of disclosed optical sensor technology can make the display screen of LCD in intelligent hand Machine, tablet computer or other powerful electronic equipments of increasing with the optical sensing from disclosed optical sensor technology In range it is more extensive.
For example, the existing telephone component for the fingerprint sensor that does not provide separation designs, as certain apple iPhone or Samsung Galaxy model, this existing telephone component design can not change touch-sensing display screen component and integrate such as this paper institute Optical sensor module under the screen stated, to provide fingerprint sensing function on increased screen.Because disclosed optical sensing is not required to Specified sensing region to be separated or port, as certain apple iPhone/ Samsung Galaxy mobile phones have outside display screen area Preceding fingerprint sensor, or as some smart phones of some models of Huawei, millet, Google or association overleaf have it is specified Rear fingerprint sensor, the integrated of fingerprint sensing is not needed to touch-sensing layer and display layer on screen disclosed herein The design of existing telephone component or touch-sensing display module carry out the change of essence.Therefore, outside is not needed in the outside of equipment Sensing ports and external hardware, the equipment need to add disclosed optical sensor module to carry out fingerprint sensing.Addition Under the display screen of optical sensor module and interlock circuit in shell, and can be in the identical touch-sensing of touch screen Surface just carries out fingerprint sensing.
For another example, due to the above-mentioned property of the optical sensor module for fingerprint sensing, this optical sensor mould is integrated The smart phone of block can be updated with improved design, function and integration mechanism, the design of the display screen without influencing LCD Or the design or manufacture burden of the display screen of LCD are manufactured or aggravate, to be that device fabrication and improvement/upgrading mention in production life cycle For desired flexibility, while maintaining optics in the smart phone, tablet computer or other electronic equipments of display screen using LCD The availability of the more new version of sensing function.Specifically, the aobvious of touch-sensing layer or LCD can be updated when next product is issued Display screen, without to be that fingerprint sensing feature is made any significant hardware and changed using optical sensor module under disclosed screen Become.Also, optical sensing on the screen realized based on this optical sensor module, to be used for fingerprint sensing or other optical sensings The improvement of function --- it also include increasing additional optical sensing function, it can be under the screen by using new version in new product Optical sensor module is realized, without significantly changing to Telephone Package design.
Above or other features of disclosed optical sensor technology can be implemented as mentioning to the electronic equipment of a new generation For improved fingerprint sensing and other sensing functions, especially for LCD display smart phone, tablet computer and its His electronic equipment, to provide various touch-sensing operations and functions, and enhances the user experience of this equipment.
Optical sensor technology disclosed herein uses for displaying images from equipment display component in display screen The light that top surface returns carries out fingerprint sensing and other sensing operations.The light of the return carries the target (example contacted with the top surface Such as finger) information, and acquire and detect the return light constitute realize be located at display screen below particular optical pass A part that design considers when sensor module.Because the top surface of touch panel unit is used as fingerprint sensing region, this is touched The optical imagery in region should be by the optical imaging sensor array acquisition in optical sensor module, the optical imaging sensor Array has the hi-vision fidelity to original fingerprint with the fingerprint sensing for robust.Optical sensor module can be designed as This desired optical imagery is realized by being properly configured to acquire and detect the optical element of the light returned.
Figure 22 A to Figure 22 B shows the example implementations that optics collimator designs in Figure 20 and Figure 21.In this example Optics collimator array 2001 include optics collimator array 903 and the optical absorption that is filled between optics collimator 903 Material, with the crosstalk for absorbing light to reduce between different optics collimators.Each collimator 903 in collimator array 2001 can To be edge perpendicular to the direction extension of display panel or extended channel, and each collimator 903 allows light with low-loss edge The transmission of its axis.Collimator array 2001 is designed as reducing the optical crosstalk between different optics collimators, and in optics sense Desired spatial resolution is kept when survey.In some implementations, an optics collimator can correspond only to Photoelectric Detection A photoelectric detector in device array 2002.In other implementations, an optics collimator can correspond to photoelectricity inspection Survey two or more photoelectric detectors in device array 2002.As shown in figure 22, in some designs, each collimator The axis of unit can be perpendicular to display screen surface, and can tilt relative to display surface.In operation, only along collimator axis The light of propagation carries image information.For example, incident light 82P appropriate is reflected to form light 82R.Light 82R is then by the small of TFT Diffraction by aperture, and expand to light 82D.Light part 82S is transferred in photodiode array 2002.Light part far from axis 82E is filled material absorption.Reflection in cover-plate glass surface 431 carries finger print information.Relative to collimator unit axis angulation Therefore the light 901 of degree can be blocked.A part of reflected light, such as 901E are transferred in corresponding optics collimator, to reach Photodetector array 2002.
Optics collimator array can be manufactured by different technologies, including pass through planar substrates etch-hole, formation light wave It leads array, formation and the matched microlens array of optical filter, using coreless fiber beam, or prints collimator on slide Deng.The desired character of this collimator array includes: (1) between the light component that axis is propagated and the component to blaze abroad from axis Enough transmission contrasts so that collimator ensure that it is desired in the optical sensing of fingerprint pattern at the photodetector array Spatial resolution;(2) the transmission numerical aperture allowed is sufficiently small, to realize the desired high spatial resolution of optical sensing.
Various optics collimator Array Designs can be used.Each optics collimator in optics collimator array is constructed At by transmitting light in the direction of the axis along or close to optics collimator, while stopping the light in other directions, the space Lai Jinhang Filtering, and there is small optical delivery numerical aperture to realize high spatial resolution by optics collimator array.Small light It learns transmission numerical aperture and also reduces the amount into the bias light of optical detector array.Collimator element aperture and spacing (that is, Two the distance between collimator elements closed on) it can be designed as realizing the desired spatial resolution that optical finger print senses.
Figure 23 shows the example of collimator design, by using the alignment in CMOS structure in two different metal layers The collimator design in hole is a part of CMOS structure.In this particular example, each optics collimator in array is along vertical Directly in the strip channel in the direction of display panel.
Figure 24 shows the example for the optical fingerprint sensor module that LCD is shown under structure, should in acquisition finger print information Optical fingerprint sensor module is each optical sensor pixel combination optical detector array and integrated collimator array.Such as Shown in figure, optical detector array includes photodetector array and the collimator battle array that is arranged on photodetector array Column, the optical clear through-hole to include as optics collimator and the optically opaque metal structure between through-hole.Guiding illumination For light to illuminate the touch part of finger, the light reflected from finger passes through a part that optics collimator array is directed to acquisition finger The photodetector array of fingerprint image.The collimator array can be used with the hole or opening integrated by CMOS technology One or more layers metal layer is realized.
Shielding this optics collimator in lower optical sensor module can be structured as providing direct point-to-point imaging.Example Such as, the size of optics collimator array and the size of single collimator can be designed as tight fit photodetector array respectively Size and single photoelectric detector size, to realize the one-to-one imaging between optics collimator and photoelectric detector.By The whole image that the light that optical sensor module receives carries can be by the photodetector array of single photoelectric detector It acquires and is spelled without connecing simultaneously.
The spatial filtering operation of optics collimator array can be advantageously reduced into the photoelectricity in optical sensor module The amount of the bias light of detector array.Further, since the illumination of the light from OLED pixel emission, it can be in optical sensor module The one or more optical filters of middle setting, with wiping out background light, and reduce the amount of the bias light at photodetector array, To improve the optical sensing of the light of the return from fingerprint sensing region.For example, the one or more optical filter can be by It is configured to such as bandpass filter, with the transmission for the illumination light for being allowed for optical sensing to generate, while being stopped in sunlight Other light components such as infrared IR light.In the outdoor application equipment, this optically filtering be can be effectively reduced by sunlight Caused by bias light.The one or more optical filter can be implemented as such as optically filtering coating, the optically filtering coating It is formed on one or more interfaces along the optical path of the photodetector array into optical sensor module, or can To be embodied as one or more discrete optical filters.
Figure 25 shows the back for reducing using optically filtering and reaching and shielding photodetector array in lower optical sensor module The example of the optics collimator array of scape light.The example is and one or more using optical waveguide array as optics collimator Optical filter film is coupled to optical waveguide array, reaches the photodetector array for being coupled to optical waveguide array to reduce Undesirable bias light, such as the infrared IR light from sunlight, simultaneous transmission are used to irradiate the predetermined light of the detection light of finger Desired light in bands of a spectrum.Optical waveguide may include the waveguide core with or without external waveguide covering.Optical waveguide can also be by Coreless fiber beam with different optical fiber is formed, wherein each unit collimator is the optical fiber sheet without optical fiber cored structure.When When coreless fiber bunchy, the packing material between optical fiber may include light absorbing material, to increase not by coreless fiber guidance The absorption of stray light.Final collimator can be assembled with the sub- collimator array of multilayer.
Following part provides the example of various optics collimator design and its manufacture.
Figure 26 A and Figure 26 B show the example by etching manufacture collimator.In Figure 26 A, it is used to form collimator battle array The suitable layers of material of optics collimator in column is formed on optically transparent supporting substrate or by optically transparent supporting substrate Support.Etching mask is formed on the layer, and has the pattern for etching lower layer, to form optics collimator.It executes Suitable etch process is to form optics collimator.Supporting substrate can in conjunction with collimator array, and can by include oxygen The various optically transparent materials of SiClx etc. are formed.
Figure 26 B is shown by that (can be adhesive, glass or suitable optical clear material via inter-layer connectors material Material) the sub- collimator array of stacked multilayer is come the example of the optics collimator array assembled.In some implementations, sub- collimator The different layers of array can overlie one another in the case where no inter-layer connectors material.This stacking allows along collimator axis Line manufacture has the optics collimator of desired length or depth, to realize desired optical numerical aperture.The hole of collimator is several What limits visual angle on.Transmission numerical aperture is determined by the thickness and aperture of collimator.Hole can use optics in some applications Transparent material filling, and can be sky in some designs.
In implementation, supporting substrate can be coated with one or more optical light filter films, to reduce or eliminate example Such as bias light of the infrared IR light from sunlight, simultaneous transmission are used to illuminate the predetermined spectral band mid-term of the detection light of finger The light of prestige.
Figure 27 shows the array of the optical spatial filter coupled with microlens array, wherein each lenticule is opposite It is placed in the respective through hole of optical spatial filter, so that each unit collimator includes lenticule and micro- spatial filter, example Such as, micropore.The light that each lenticule is constructed and is positioned to receive focuses on corresponding micro- spatial filter without being imaged The light received.Micropore limits effective reception numerical aperture.Spatial filter can be printed on optical transparent substrate, or Person is etched on a piece of silicon wafer.Microlens array can be handled by MEMS or is chemically treated to etch.Lenticule can also be with It is made of the Gradient Refractive Index Materials, such as a piece of graded index glass fibre is cut into the length of a quarter spacing.It is micro- The focal length of lens and the diameter in spatial filter hole can be used for controlling the transmission numerical aperture of each unit.As other designs one Sample, collimator plate can be coated with filter membrane, to reduce or eliminate not used light belt in sensor, such as from sunlight Infrared IR light.
Figure 28 shows the example of the integrated CMOS photodetector array sensor with built-in light collimation.Collimator By 705 gusts of alignment hole that are interleaved to provide interval in combing different metal layer 704 and oxide layer 702,703 between metal layer Column are to construct.This some holes can be aligned with the light-sensitive element 701 in optical detector array.Optical finger print imager is to utilize this The integrated CMOS photodetector array sensing that with built-in light collimates of the kind under LCD display module 701 and cover-plate glass Device is realized.Touch the user's finger in the sensor window region of cover-plate glass fingerprint can by detection from fingerprint valley and The light of spinal reflex is imaged.Because light, by the fingerprint tissue resorption at ridge region, the light from fingerprint ridge region can subtract It is few, and in contrast, the light from fingerprint valley region can be stronger.This light level difference between the ridge and paddy of fingerprint is in light It learns and generates fingerprint pattern at detector array.
It is above-mentioned based on collimator optical sensor module design in, each collimator along the collimator thickness or Length can be designed as greatly to the zonule being transmitted to imaging on optical detector array, or can be designed as small to will be at The big region on optical detector array is transmitted to as light.When each collimator in collimator array is along the thickness of the collimator Degree or length is when being reduced to certain point, such as at tens microns, the optical field of view of each collimator can be relatively large, with covering The fluorescence detector of the last split-phase neighbour of optical detector array, such as the region of 1mm × 1mm.In the design of some equipment, optics Fingerprint sensing can realize that there is each pin hole in the pinhole array sufficiently large optics to regard by using pinhole array , to cover a part of adjacent fluorescence detector in optical detector array, to realize optical detection when sensing fingerprint High image resolution at device array.Compared with the design for using collimator, pinhole array can have thinner size and more The pin hole of small number, to realize desired high imaging resolution in the case where no imaging len.Also, with via optics standard The imaging of straight device is different, and the imaging with pinhole array uses each pin hole as pinhole camera, to acquire image, is based on pin hole The image reconstruction process of camera operation is different from the image reconstruction process by using optics collimator array, it may be assumed that each pin hole Sub-image regions are established, and the sub-image regions of pin hole different in pinhole array are spliced together, to constitute whole image.Tool Have that the image resolution ratio of the optical sensor module of pinhole array is related with the size of the sensor of detector array, so as to To sense resolution ratio by adjusting detector size to adjust or optimize.
It can be based on various semiconductor pattern technologies or technique or other manufacturing methods, relatively simply with lower cost Manufacture pinhole array.Pinhole array can also provide spatial filtering operation, be entered in optical sensor module with being advantageously reduced Photodetector array bias light amount.Have the optical sensor module of optics collimator similar to design, due to depositing In the illumination of the illumination light generated for optical sensing, one can be arranged in the optical sensor module with pinhole array Or multiple optical filters, with wiping out background light, and the amount of the bias light at photodetector array is reduced, is come from improving The optical sensing of the light of the return in fingerprint sensing region.For example, the one or more optical filter is configurable to such as band Bandpass filter to be allowed for the transmission of the illumination light of optical sensing, while stopping other light such as infrared IR light in sunlight Component.In the outdoor application equipment, the bias light as caused by sunlight is can be effectively reduced in this optically filtering.This one A or multiple optical filters can be implemented as such as optically filtering coating, which is formed in passes along to optics On one or more interfaces of the optical path of photodetector array in sensor module, or it can be implemented as one or more Discrete optical filter.
In the optical sensor module based on optics collimator, the optical imagery resolution ratio at optical detector array can Improved by and configuring optics collimator in a manner of providing pinhole camera effect.Figure 29 shows showing for this design Example.
In Figure 29, the collimator unit 618 of this optics collimator array draws the light from corresponding detection zone unit It is directed at photodetector array 621.The aperture of collimator unit forms small field of view (field of view, FOV) 618b.If Detector in photodetector array 621 does not acquire the details in each unit FOV, then imaging resolution is by each collimator The FOV of unit is determined.In order to improve detection resolution, need to reduce the FOV of each collimator unit.However, being examined when in photoelectricity When surveying each photoelectric detector in device array 621 and gap 618a being set between corresponding collimator 618, collimator unit Small-bore is used as pin hole.This pinhole camera effect provides higher imaging resolution in the image of each unit of FOV.When It, can be with the image detail in recognition unit FOV as shown in insertion piece 621a when having multiple detector elements in unit FOV.This Mean that detection resolution is improved.In implementation, such gap can be set in various ways, including for example exist Optical filter film 618a is added between collimator 618 and optical detector array 621.
By pinhole camera effect, the fill factor of collimator plate can be optimized.For example, big in order to detect 10mm × 10mm Small region, if the region of each unit FOV covering 1mm × 1mm, can be used 10 × 10 collimator array.If In each unit FOV, detector can obtain 20 × 20 resolution chart picture, and whole detection resolution ratio is 200 × 200 or 50 micro- Rice or 500psi.This method can be applied to all types of alignment methods.
Figure 30 shows using pinhole camera effect another example for improving optical imagery resolution ratio.In this example, Optical sensor module includes multiple layers: gasket 917, the pinhole array that can be the sufficiently small optics collimator array of thickness 617, protection materials 919, photodetector array 621 and circuit board 623.Objective optics distance is by sensing surface to pin hole plane Total material thickness determine that the thickness of optical thickness, gasket 917 including display module 433, is appointed at any filtering coating thickness What air gap thickness and any adhesive material thickness.Imagery optical distance by pin hole plane to photodetector array total material Thickness determines, including protection materials thickness, any filtering coating thickness, any air gap thickness and any adhesive material thickness. Image magnification ratio is determined compared with objective optics distance by imagery optical distance.Detection pattern can be by being arranged amplification appropriate Rate optimizes.Optionally, magnifying power can be set as less than 1, such as 0.7 or 0.5 etc..Some equipment design in, gasket and Pinhole array layer can be combined into single component.In other designs, pinhole array and protective layer can be combined into single component, To pre-define the centre coordinate of each pin hole.
Figure 31 shows the example of the optical imagery based on pinhole camera effect.It is whole on target side, LCD display panel A detection zone 921 is divided into multiple sub- detection zones 923.Setting pinhole array 920 is for being imaged detection zone 921.Pin hole Each pin hole unit in array 920 is responsible for a small field of view (FOV) 925.Each small FOV 925 covers a sub- detection zone 923.As shown in figure 31, the small FOV of each of pin hole can be overlapped with the small FOV of pin hole adjacent thereto.In image-side, optics inspection The every sub- detection zone 923 surveyed in device array acquires image 933.Also as shown in figure 31, the small FOV 925 of each of pin hole have pair The image district 935 answered.The magnifying power that the system can be optimized distinguishes the image of every sub- detection zone respectively.Change sentence It talks about, the image of small FOV does not overlap each other.In the detection pattern, the centre coordinate of each pin hole be it is predetermined, each The picture point coordinate of LCD display pixel can be calibrated in advance, and this pre-calibration can be used for during sensor operations Correction card is generated for calibration.In this design, the image of pinhole camera is inverted, and signal processing can be based on calibration Table restores whole image.
In the above-mentioned example for optics collimator, for guiding the light of the finger on display screen top to use The direction of optics collimator in the optical detector array of fingerprint sensing can touch table perpendicular to the top of LCD display Face, to collect the detection light for fingerprint sensing that returns from finger, wherein the major part of the detection light returned be perpendicular to On the light direction of top touch-surface.In practice, it when touching finger drying, is hung down substantially by sensing with top touch-surface The detection light of straight return, the picture contrast in image detected in optical detector array from relative to top lower than touching Touch the picture contrast of the identical image obtained in the detection light of the angled return of vertical direction on surface.This is to a certain degree On be this portion because the optical sensing of the light of angled return spatially filters out the light returned strongly from top touch-surface Light splitting is most of perpendicular to top touch-surface.In view of this of the optical sensing of the detection light returned from top touch-surface Aspect, the axis that optics collimator may be oriented each collimator unit can be tilted relative to top touch-surface, such as be schemed Shown in the example of 22B.
However, during manufacturing, manufacture that inclined collimator is more complicated and cost is higher.It is a kind of to use such as Figure 20 and figure Vertical optical collimator shown in 21B also passes through selectively detect the angled return from top touch-surface simultaneously Light be come the mode for realizing more high contrast in optical sensing: before the light of return enters vertical optical collimator, hang down Deflection optical or diffraction device or layer are provided between straight optics collimator and the light of the return from top touch-surface.Some In implementation, this deflection optical or diffraction device or layer can between OLED display panel and vertical optical collimator, To select the detection light for the return for only existing in some tilt angle to enter vertical optical collimator, and then by being collimated in vertical optical Optical detector array on the other end of device carries out optical detection, at the same prevent or reduce it is perpendicular to top touch-surface and The detection light of return from top touch-surface enters the amount of optics collimator.The deflection optical or diffraction device or layer can be with It realizes in a variety of manners, including such as prism array, the optical layer with diffraction pattern or is located at optics collimator and display surface Other equipment between plate are reduced simultaneously with selecting the angled detection light returned from display panel to enter optics collimator The amount of detection light perpendicular to display panel and into the return of optics collimator.
Figure 32 shows the example of the optical sensor module for optical sensing using optics pinhole array.As schemed Show, pinhole array 920a is formed between LCD display module 433 and optical photodetector array 621, and finger 60 is pressed Sensing region be imaged on optical photodetector array 621.
The thickness T of layer of pinholes 920a shows the angle visual field (FOV).Using from sensing surface to pinhole array 920a distance with And sensing region FOVs and imaging region FOVi are defined to the distance of pinhole array 920a from imaging plane.Image is put Big rate is provided by Di/Ds, wherein Di is the transparent optical layer 919a between pinhole array 920a and optical detector array 621 Thickness, and Ds is by the thickness of 431 combination stack of gasket 917, LCD display module 433 and top blind flange glassy layer.Such as The device parameter of layer of pinholes thickness T, Ds and Di etc. can optimize for the combination of desired FOV and image magnification ratio.For example, such as Fruit needs, and optical sensor module can be configured to ideal parameter so that in array 920a corresponding adjacent pin hole phase Adjacent FOV is suitably overlapped.Similarly, adjacent FOVi can also be adjusted to be overlapped or be kept completely separate as discrete FOVi.? It is designed as in the optical sensor module for making adjacent FOVs overlap each other, some points sensed in the point on surface can have Multiple images point.This feature can be used for enhancing detection.
In the example of Figure 32, the optical filter film for reducing bias light can form or be coated in gasket 917, needle On aperture layer 920a, protection 919a or display surface.As shown, when bias light 937 projects in finger tissue 60, short wavelength Component is largely absorbed, and part long wavelength (for example, feux rouges or infrared light) light is transferred to detector 621.Optical filter Film can be used for refusing those long wavelength components, to improve the detection of the optical signal for the return for carrying finger information.
Figure 33 A and Figure 33 B show the optical finger print under the LCD display panel with deflection optical or diffraction device or layer The example of sensor.
As shown in figure 33 a, each collimator 2001 in collimator array can be along vertically or perpendicular to display surface Axis extension channel.Visual angle adapter optical layer 2210 is used to adjust the visual angle of the detection light of the return from display panel, And the visual angle adapter optical layer 2210 is between optics collimator 2001 and LCD display panel, to select from display surface The angled detection light that plate returns enters optics collimator 2001, while reducing perpendicular to display panel and entering optical alignment The amount of the detection light of the return of device 2001.
Figure 33 B shows the more details of visual angle adapter optical layer 3210 and main detection optical path.For example, visual angle adapter Optical layer 3210 can be implemented as the diffraction pattern pattern layer of such as prism structure 3210a.Only having for display from finger Detection the light 82a and 82b of the return of the appropriate incidence angle of panel can be just bent through collimator 2001.In contrast, vertically It is guided most by visual angle adapter optical layer 2210 far from perpendicular to the first of display panel in the detection light of the return of display panel Beginning direction, and the off-axis incident light therefore become to optics collimator 2001.Reduce in this way perpendicular to display panel and can be with Into the amount of the detection light of the return of optics collimator 2001.
Behind appropriate adjustment visual angle, the reception light of different location 63a and 63b from fingerprint valley carry finger print information.Example Such as, under equal illumination, since visual angle is different with the fingerprint profile of finger tip skin, light 82a may be stronger than light 82b.This design Optical sensor module is allowed to obtain a degree of fingerprint shade.This arrangement improves detection of finger when dry.
When designing the optical sensor module under LCD display module, it is contemplated that the various technologies of LCD display module are special Sign or characteristic simultaneously incorporate it into whole optical sensor module design, to improve optical sensing operation.It retouches following part Several design examples are stated.
A common part in various LCD display modules is light diffuser, can be incident light being diffused into difference Direction is to realize the thin slice of the spatially uniform at big visual angle and display.However, the presence of the LCD diffuser layers may reduce The optical detection of optical sensor module under LCD.
Figure 34 A and Figure 34 B show the LCD light diffuser layer between LCD ducting layer 433c and other LCD layers 433a 433b.In some LCD components, cover-plate glass layer 431 can be separated by a distance with following diffuser sheet 433b (for example, In some LCD devices, several millimeters), and by light guiding plate 433c, (it can be secondary optics collimator array 617 Micron is thick) it is separated with diffuser sheet 433b.Under this configuration, strongly diffusing in diffuser sheet 433b can be significantly reduced across LCD display module 433 reaches the signal contrast in the signal light of optical detector array 621.Although LCD diffuser layers 433b The light diffusion at place is needed for display operation, but which reduce fingerprint detection performances.
This undesirable effect of LCD diffuser layers 433b can be mitigated by using different technologies.Figure 34 A and Two examples are shown in Figure 34 B.
Figure 34 A shows an example, wherein can be in the part of the diffuser sheet 433b above optical sensor module In corresponding region or entire diffuser sheet 433b in LCD display module in hole 951a is made, to improve from top blind flange glass Glass 431 arrives the transmission of the light of the return of optical detector array 621.Size, shape and the distribution in hole can be based on specifically setting Meter needs to select.For example, the size in hole can be greater than detection optical wavelength, to avoid strong diffraction.For example, collimator unit The diameter in aperture can be about 40 microns, and the size of diffusing globe film perforation can for 5 microns, 10 microns, 30 microns, 40 microns or 100 microns etc..In this design, hole 951a is included in LCD diffuser layers 433b is to be each collimator unit Establish optical path.The aperture of each collimator unit can have one or more holes in diffuser sheet, to provide from top blind flange Glass 431 arrives the desired optical path of optical detector array 621.If the aperture of collimator unit with biggish pitch (for example, 1mm or so) it is discrete, then the hole in diffuser sheet can be drilled out with identical pitch.Inhomogeneities in detection can be calibrated.
Figure 34 B shows another example, wherein diffuser sheet can be configurable to include low diffusion optics brocken spectrum 951b, wherein light diffusion is weaker in the region above optical sensor module, with improve light to optical sensor module biography It is defeated.Size, shape and the distribution of brocken spectrum can be needed based on specific design to select.For example, the size in hole can be greater than Optical wavelength is detected, to avoid strong diffraction, and the distribution put can make each collimator unit have one or more Transparent optical path, to allow effectively to receive the light of the return from top blind flange glass 431 and by LCD display layer.If quasi- The aperture of straight device unit is discrete with big pitch (for example, 1mm or so), then can be made in diffuser sheet with identical pitch Brocken spectrum.If diffuser sheet by being made for the material with roughened surface of diffraction or diffused light, selected material can be selected It is applied to rough surface to selecting property, reduces the diffusion of the original optical of rough surface to provide certain transparent material.Suitable material Example include epoxy resin, wax or oil, and these materials can effectively change diffusion.
For given LCD diffusing layer, long wavelength's light source can choose to generate detection light or illumination light, so that being directed to this The diffusing scattering of kind light is weaker, so that more light, which can pass through diffusing layer, reaches optical sensor module.
For another example, with reference to Figure 35 A and Figure 35 B, various LCD display modules include the light in the LCD below LCD ducting layer 433c Reflecting layer or film 433d are learned, not used light is reflected back LCD layer to improve display brightness.However, this optical reflectance coating The presence of 433d can stop most of light to reach the optical sensor module below LCD, it is thus possible to sense and produce to optical finger print Raw adverse effect.This optical reflecting layer can with most of positions maintain LCD ducting layer under desired optical reflection, The mode of desired optical delivery is allowed to modify at the position of optical sensor module at LCD simultaneously.In some realizations In mode, the collimator 617 for the optical sensor that can be fixed under LCD is to contact reflector film 433d.
Figure 34 C is shown for providing another example of transparent optical path, which comes from one or more for guiding The light of a lighting source 436, to improve the fingerprint sensing of detection module without obviously being diffused by diffusing layer.For example, hole 969 can be with It is optionally formed in light diffuser film 433b, to be improved to the optical transport of optical fingerprint sensor under LCD.In order to avoid shadow Display performance is rung, optical path hole can be tilted to keep a degree of light diffusion function in the region in hole 969.In addition, in this way Hole 969 can be designed as very little, such as 0.3mm or smaller, to further enhance the diffusion of backlight, while the light still at LCD It learns and improved optical imagery is provided at fingerprint sensor.In some implementations, optical path hole can be sky, fill air, Transparent material can also be filled with.
In some designs, optical path hole 969 can be not limited to some region, but can be distributed in entire light diffuser film On 433b, for example, hole 969 can be evenly distributed in entire film 433b.Such a design eliminates selected aperture 969 in some regions But the undesirable space non-uniform illumination not generated in other regions.In some designs, optical path hole 969 can be with space Gradient mode distribution, so that any change of the LCD illumination as caused by hole 969 is progressive and less obvious.
Figure 35 A shows an example for modifying optical reflector layer, wherein by wrapping in optical reflector film Optical reflector layer is modified in the light transmission hole that includes or formed in the region of optical sensor module position, to allow optical reflection The optical reflection shown for LCD in most of position of device film, while transparent light is provided for optics collimator array 617 Road, for receiving the light reflected from the finger above LCD.Size, shape and the distribution in hole, which can be configured as, meets optics sense It surveys and needs.For example, the size in hole can be greater than detection optical wavelength, to avoid strong diffraction.For example, collimator unit aperture Diameter can be about 40 microns, and the size of diffusing globe film perforation can be micro- for 5 microns, 10 microns, 30 microns, 40 microns or 100 Rice etc..Each collimator unit hole can have one or more holes to be used for optical sensing to provide in optical reflector layer Desired optical path.Inhomogeneities in detection can be calibrated.If the aperture of collimator unit is with biggish pitch (example Such as, 1mm or so) it is discrete, then the hole in diffuser sheet can be drilled out with identical pitch.
Figure 35 B shows another example for modifying the optical reflector layer in LCD, wherein the light of optical reflector film Learning reflectivity can be revised as allowing a degree of optical delivery to carry out optical sensing by following optical sensor.Respectively Kind business LCD reflector film uses flexible plastic material as substrate, and the light transmission of this plastic material may be enough Enough optical transports are used for fingerprint sensing to optical sensor module.
In the above-mentioned design for LCD diffuser layers and LCD reflector layer, hole can be formed in one or more illuminations In region locating for light source, top blind flange glass is reached to allow illumination light that can substantially pass LCD display module layer, for shining Bright finger carries out optical sensing operation.
In above-mentioned design, optical sensor module is located at the lower section of LCD display module, therefore is located under LCD ducting layer Side, LCD ducting layer are designed to guide the backlight from back light to the display area LCD.As shown in figure 36, from display The backlight of device light source 434 (for example, LED) is guided by waveguide 433c and is diffused by LCD diffuser layers to leave waveguide 433c, is provided Backlight needed for LCD.Light can uniformly be leaked out from a side of waveguide 433c, then be diffused by diffuser sheet 433b.? In some LCD, approximately half of diffused light 957 can be propagated towards collimator 617 and become strong in optical sensing detection Bias light.
One or more additional light sources 436 can be provided to connect optical sensor module, for illuminate finger and The light for carrying fingerprint pattern information is supplied to the optical sensor module below LCD.Due to lighting source position (for example, Beside optical sensor or below the reflector film 433d adjacent with optical sensor), the light guide function of waveguide 433c is to next It does not work from the light of lighting source 436, the light from 436 is allowed to reach the top surface of LCD panel more efficiently to illuminate Finger.
In addition, lighting source 436 can be designed as to be different from the LCD display illumination from LCD display backlight light source 434 One or more optical wavelengths of optical wavelength emit illumination.Lighting source 436 can be used for fingerprint sensing and other sensing functions.
The illumination light of the above-mentioned one or more optical wavelengths for being used to select the optical wavelength of backlight shown from LCD different Design can be used to reduce power consumption.Need to open display backlight light source using display backlight light source progress fingerprint detection to carry out Optical finger print sensing.Compared with above-mentioned design, this design consumes more power, wherein being used for the illumination light part of optical sensing Ground is different from the backlight in optical wavelength, and optical sensing is allowed to operate without opening LCD backlight.It is above-mentioned for select with The design of the illumination light of the different one or more optical wavelengths of the optical wavelength for the backlight that LCD is shown can neatly select to shine Mingguang City source is to obtain additional advantage.It is, for example, possible to use infrared lights as lighting source 436 so that LCD diffuser layers for IR illumination light is more transparent, to realize the desired more high-transmission of IR illumination light.For another example, it is multiple to provide to can choose lighting source Wavelength is for other function, such as anti-fraud living body sensing, heartbeat sensing etc..
In optical sensor module under designing LCD, position and the spatial distribution of lighting source 436 can be used to adjust Viewing angle, to optimize sensing quality.
When optical sensor module is placed below LCD module, additional optical design can be used enhance from The backlight of ducting layer to LCD layer is transmitted, while maintaining to be used for the illumination light of optical sensing to the abundant biography of optical sensor module It send.
It includes that two or more layers are carried on the back that Figure 37 A to Figure 37 D, which is shown as a part of LCD layer structure shown in 433a, The example of the enhancing structure of optical reinforced film (for example, 433px and 433py).It is unrestrained that back optical reinforced film 433px and 433py are formed in light Above emitter layer 433b.
In the example of Figure 37 A, each enhancing film 433px and 433py include Polarizing prism structure.Two enhancing films The prism slot direction of 433px and 433py is generally perpendicular to each other a pair of of enhancing film is collectively formed, to be improved to the photograph of LCD panel Mingguang City's transmission.However, this function of enhancing film may be to optical fingerprint sensor module under LCD if configuration is inappropriate The optical imagery of 621U has an adverse effect.
As shown in the example of Figure 37 B and Figure 37 C, additional light source direction of illumination and detector direction of observation can specifically match It is set to not along the prism slot direction of enhancing film 433px and 433py, to reduce the unfavorable imaging shadow that enhancing film senses optical finger print It rings.This design is to obtain the clear image that do not perforate in enhancing film.Visual angle φ 1 and light angle φ 2 should bases The design of enhancing film is adjusted.
Example in Figure 37 D shows the particular design of collimator unit 617U and photodetector array unit 621U. Collimator unit 617U is used to provide the imaging function realized by lenticule, pin hole or both combination.By optimizing single detection Unit designs or by using multiple detection unit, and the larger sensing area at photodetector array unit 621U may be implemented Domain.
Figure 38 shows the example of the light waveguide-layer in LCD module comprising the partially transparent part in light path, Ducting layer is passed through to allow to improve the optical transport of the illumination light for optical sensing.
Figure 39 A to Figure 39 C is shown for designed for the optics sense in the optical sensor module under LCD display module The example of the lighting source of survey.In LCD display module, optical reflector layer is by being recycled to LCD layer for not used backlight To enhance LCD display brightness.In this respect, along the defect of the optical reflectivity of optical reflector film, such as in reflector film Mechanical defect, will lead to the visible change of LCD display brightness, therefore be undesirable.Figure 39 A to Figure 39 C, which is shown, to be used for Reduce the design feature of the adverse effect of defect in reflector layer or film.
As shown in Figure 39 A, micropore 973 can be provided in the reflector layer 433d at the position of lighting source 436, be used for Visible component in illumination light.This visible component is used to provide illumination in the finite region of display to show necessity Text or identification information, without open display backlight.
As shown in Figure 39 B, another solution be selection lighting source wavelength, be allowed to no longer fall into be generally in it is visible The service band of the reflector film of optical band.Lighting source 436 for optical sensing can be in the reflectance spectrum of reflector film Except range, for example, 400nm (such as 380nm) short wavelength range below or beyond red color visible range (such as 780nm, 900nm, 940nm etc.) long wavelength range except, allow illumination light to pass through reflector film or layer without in reflector Hole is formed in film.
Figure 39 C shows yet another design scheme, and reflector film is designed as to include being used for transmission the photograph for being used for optical detection The narrowband transmission window 975 of Mingguang City.For example, this this narrow transparent or transmission window in reflector film can in 525nm and Between 535nm.
The portable device or other equipment or system of mobile phone based on optical sensing disclosed in this document etc. can be with It is configured to supply additional operating characteristics.
For example, can control LCD display panel provides local flash mode, by selected below operation sensing region LCD display pixel illuminates fingerprint sensing region.This can be provided in the optical sensor module under LCD display panel, example Such as, Fig. 4 A and Fig. 4 B based on optical imaging designs, or based on the optical imagery Figure 21 A and figure for passing through optics collimator array 21B.In the case where obtaining fingerprint image, the LCD display pixel and lighting source sensed in window area can be opened temporarily With generate high intensity illumination for fingerprint optical sensing, and at the same time open photoelectric testing sensor array 621 with acquire with Open the fingerprint image of illumination phototiming.The time for opening illumination light can be relatively short, but emissive porwer can be set It is very high.For this purpose, this mode for optical finger print sensing is flash mode, make photoelectric detector sensor array 621 are able to detect a greater amount of light to improve image sensing performance.
Optical sensor for sensing optical finger print disclosed above can be used for acquiring the high quality graphic of fingerprint, make Obtain the minor change that can be distinguished in the acquisition fingerprint of different time acquisition.It is worth noting that, being set when people presses with finger When standby, due to the variation of pressing force, it may change with the contact of the top touch-surface on display screen.When finger touches When sensing area on cover-plate glass, the variation of touch force may cause optical detector array and following several detectable changes occur Change: (1) fingerprint deforms, and the variation of (2) contact area, (3) fingerprint ridge broadens, and hemodynamic dynamic at (4) pressurized zone Variation.These variations can be by optically detecting, and can be used for calculating the corresponding change of touch force.Touch force sensing is fingerprint sense Survey increases more multi-functional.
Referring to fig. 40, contact profile area increases with the increase of pressing force, while ridge coining is with the increasing of pressing force Add and expands.On the contrary, contact profile area reduces with the reduction of pressing force, while ridge coining is with the reduction of pressing force And tightens or shrink.Figure 40 shows two different fingerprint patterns of identical finger under different pressing forces: the finger slightly pressed The fingerprint 3303 of line 2301 and severe pressing.The detection light of the return in the selected integrated area 3305 of the fingerprint on touch-surface It can be acquired by a part of optical sensor on optical detector array, the choosing on the partial optical sensor and touch-surface Surely integrated area 3305 is corresponding.It has been further explained below and the detection signal from those optical sensors has been analyzed, with Extract useful information.
When finger touch sensor surface, finger tissue absorbs optical power, therefore is integrated on photodiode array Reception power reduce.Especially under the total internal reflection mode for not sensing low-index material (water, sweat etc.), sensor can To receive changed power trend for passing through analysis, to detect finger touch sensor or other target accident touch sensings Device.Based on this sensing process, sensor can determine whether touch is true finger touch, so as to be based on touch No is true finger pressing to detect whether mobile device to be waken up.Because detection is to detect to carry out based on integrated power, So the light source for optical finger print sensing is in energy-saving mode.
In detailed fingerprint map, when pressing force increases, fingerprint ridge expands, and more light are at touch interface The fingerprint ridge being extended absorbs.Therefore, in relatively small observation area 3305, the integrated optical power change received is reflected The variation of pressing force.Based on this, pressing force can detecte.
Therefore, changed by the detection of optical power received integrated in analysis cell, fingerprint ridge pattern change can be monitored The time-domain evolution of shape.It is pressed on finger it is then possible to be determined using the information of the time-domain evolution deformed about fingerprint ridge pattern The time-domain evolution of power.In the application, the time-domain evolution of the pressing force of the finger of people can be used for determining by the touch of finger The dynamic of user's interaction, including determine that people is to remove in pressing touch-surface, or by pressing finger from touch-surface.These are used Interaction dynamic in family can be used to trigger the operation of certain applications in the certain operations or mobile device of mobile device.For example, The touch that the time-domain evolution of the pressing force of the finger of people is determined for people is for operating the intended touch of mobile device also It is unexpected touch unintentionally, also, based on such determination, mobile device control system may determine whether sleep mould to be waken up Mobile device under formula.
In addition, the finger of the people of the work contacted with touch-surface can be showed at two kinds not under different pressing forces With the different characteristics of the extinction ratio obtained under detection optical wavelength, as described in Figure 14 and Figure 15.Back to Figure 40, slightly press Fingerprint 3301 may not significantly limit flow into finger pressing part blood, thus generate show living person tissue two The extinction ratio obtained under the different detection optical wavelength of kind.When people exerts oneself to press fingerprint 3303 of the finger to generate severe pressing, stream It may seriously be reduced to the blood of pressing finger part, therefore, what is obtained under two kinds of different detection optical wavelength disappears accordingly The extinction ratio of fingerprint 3301 of the light than will differ from slight pressing obtained under two kinds of different detection optical wavelength.Therefore, two The extinction ratios obtained under the different detection optical wavelength of kind change under different pressing forces and different blood circumstances.It is this variation with The delustring obtained under two kinds of different detection optical wavelength generated with the different power pressings of the false fingerprint pattern of artificial material Than difference.
Therefore, the extinction ratio obtained under two kinds of different detection optical wavelength, which can also be used to determine, touches hand from the user Refer to still other targets.This determination is also used in determining whether to call out the mobile device under sleep mode to be kept alert while in bed.
For another example, disclosed optical sensor technology can be used for monitoring proper motion, and this proper motion is due to work The natural mobile or movement (either intentionally or unintentionally) of people or the pulse relevant to heartbeat when blood flows through human body and go out The behavior of the finger of existing people.Wake operation or user authentication optical sensing based on fingerprint pattern and can live to existing The combination that the front of people determines enhances access control.For another example, optical sensor module may include sensing function, for being based on The optical sensing of the light of return from finger or palm measures glucose level or oxygen saturation.For another example, it is shown when people touches When display screen, the variation of touch force can reflect in one or more ways, including fingerprint pattern deformation, finger and screen surface it Between contact area variation, fingerprint ridge broadens or the dynamic change of blood flow.These or other variation can be by public based on institute The optical sensing for the optical sensor technology opened measures, and can be used for calculating touch force.This touch force sensing can For adding more functions in addition to fingerprint sensing for optical sensor module.
Under above-mentioned screen related to Fig. 3 A to Figure 40 the relevant feature of optical sensing can be implemented with main viewing area and The equipment of the two-region display of peripheral viewing area, and the equipment of single area's display without peripheral viewing area.Figure 41 A, Figure 41 B The example of the specific implementation for the optical sensor module being placed under the LCD display of equipment, the equipment are shown with Figure 42 With LCD display module to provide main viewing area and peripheral viewing area in identical LCD panel.
Figure 41 A shows the example that optical sensor module under LCD is placed under the LCD module in peripheral viewing area.It is right For optical finger print sensing, one or more light source 436a are placed on 433 lower section of LCD module in peripheral viewing area 20, with Issue the detection light beam that the top sensing surface in peripheral display region 20 is reached through LCD module 433 and top clear 431 967a, optical sensing or other characteristics for fingerprint.Detection light beam 967a can be the light beam after collimation.In operation, pushing up Portion sensing surface at or near detection light beam 967a interacted with finger 447, and the reflection as caused by finger 447 and/or The detection light of scattering is vectored back in top clear 431 as detectable signal light beam 965a, carry finger print information and about The other information of finger, for example, fingerprint pattern or map, blood flow and heartbeat etc..In this example, for collecting and routing from top Portion's hyaline layer 431 does not have light into the design of the reception optical device of the detectable signal light beam 965a of optical detector array 621b Learn lens.Because of the reflection of cover-plate glass surface of the detectable signal light beam 965a from top clear 431, fingerprint absorbs Map or pattern are added on detectable signal light beam 965a, and the fingerprint absorbs map or pattern can be by photoelectric detector Array 621b is detected.Photodetector array 621b, which is oriented, makes it detect the lid that surface is parallel to top clear 431 Glass sheet surface and other layers.This arrangement is formed to project without lens imaging and be configured, wherein fingerprint map is with a certain magnifying power two Project on detector array 621b to dimension.Probing light for entering detector array 621b with different incidence angles comes It says, optical distortion is usually lower, and the picture contrast detected is usually higher.
Figure 41 B shows saturating by the nothing for placing optical sensor module under LCD under the LCD module in peripheral viewing area Another example of mirror imaging projection configuration.Different from the design in Figure 41 A, design in Figure 41 B is by photodetector array 621c is angularly oriented relative to 431 layers of top clear of cover-plate glass surface and other layers.Photodetector array 621c's This inclined orientation makes the image carried by the detectable signal light beam 965a returned on the surface along photodetector array It is compressed on direction, the size of photodetector array pixel in the direction can be reduced in this way, and with larger detector picture Element or the photodetector array 621b of size are compared, to correspondingly reduce the overall cost of photodetector array 621c.
Above-mentioned no lens imaging projection configuration in Figure 41 A and Figure 41 B for optical sensor module under LCD can also be used In the optical sensor module being placed under single area's LCD panel.Fig. 4 B is shown under single area's LCD panel using this inclined orientation Photodetector array 702 example.
It is designed referring to optical sensor module of Fig. 6 B into Figure 11, the reception optics device of optical sensor module under LCD Part can also include one or more imaging lens for optical sensing.Figure 42 is shown to include as optical device is received Micro- camera configuration of lens of a part place optical sensor module under the LCD under the LCD module in peripheral viewing area Example.In this example, photodetector array 621d is placed as its detector array surface perpendicular to top clear 431 Cover-plate glass surface and other layers or cover-plate glass surface relative to top clear 431 and other layers it is angled.Mirror 617p is placed on the detectable signal of the return as caused by the detection light beam 967b of the probe source 436b below LCD module In the optical path of light beam 965b, the detectable signal light beam 965b reboot of return is most parallel to and top clear 431 Cover-plate glass surface and other layer of parallel direction or relative to top clear 431 cover-plate glass surface and other layers it is flat Capable direction is angled.Lens 617q is placed in the optical path of the light beam of the reflection from mirror 617p, and lens 617q The light beam of reflection from mirror 617p is projected into photodetector along the cover-plate glass surface of top clear 431 and other layers On array 621d.In this micro- camera design, lens 617q generates the reduced fingerprint pattern of luminous intensity with higher Optical imagery, this gain of image lens 617q allows to reduce the integral level of detection of optical power or this gain improves Signal-to-noise performance when optical sensing.In addition, because lens 617q produces reduction at photodetector array 621d The optical imagery of fingerprint pattern, so microfacies machine can be by using small size photodetector array as photoelectric detector battle array 621d is arranged to realize.The cost of photodetector array 621d is reduced in this way.Moreover, in this type of design, being used due to existing The mirror of cover-plate glass surface and other layers along top clear 431 is changed into the direction for the detection light beam that will be received 617, and because the interval needed for the imaging operation that direction of beam propagation carries out imaging len 617q is along top transparent The cover-plate glass surface of layer 431 is with other layers rather than perpendicular to the cover-plate glass surface of top clear 431 and other layers, institute With adjustable required interval.This optical layout with imaging len 617q can be used for keeping equipment perpendicular to top Thickness or size in the cover-plate glass surface of portion's hyaline layer 431 and the direction of other layers is smaller, without damaging imaging lens The appropriate image-forming condition of 617q.Similarly, the optical design for optical sensor module under LCD shown in Fig. 6 B to Figure 11 Relatively small thickness can be kept on the direction perpendicular to display screen.
Electronic equipment with display is commonly used in bright environment, having by natural light (such as from the sun Natural daylight) or (such as in bright and clear office facility or stadium) headlamp caused by different degrees of environment Light or bias light.This environment light or bias light can have an adverse effect to the detection of optical sensor module under LCD, should give Inhibit.As described above, two examples as shown in figure 12 and figure 13, can shielded by executing certain controls and signal processing Background is provided in lower optical sensor module and reduces technology.Furthermore it is possible to which one or more additional optical design features are added It is added in optical sensor module design disclosed above, is reduced with being filtered based on bias light or adding additional lighting source Bias light.Based on operation control/signal processing, optical filtering and the different backlights reduction technologies for adding additional lighting source It can be combined in a variety of ways in implementation.
In the equipment with LCD display, one or more probe sources are provided, are passed with generating for optics under LCD The detection light of sensor module, and this probe source and backlight module 434 or the specified periphery for illuminating peripheral viewing area 20 The back light separation that image is shown for LCD display of viewing area lighting module 436b or 436c etc..Therefore, it is used for optics The optical detection power of sensing can be controlled independently of LCD illumination, to provide sufficient illumination for optical sensing, to mention High optics detection signal-to-noise ratio simultaneously offsets environment shadow sound.For example, one or more probe sources can during fingerprint sensing with High-output power short time flashing, to obtain optimum detection.For example, one or more probe sources can be modulated, changed with providing Into optical sensing performance without influence display function.In addition, one or more probe sources can be in the hand confirmly detected Finger provides flexibility when whether being live finger, to prevent the malice trial using false fingerprint around fingerprint detection.For example, multiple Probe source can be set to include the light source with sufficient different optical wavelength, under different optical wavelengths, finger The different optical signatures of live finger detection are showed, for example, examining using what referring to Fig.1 4 and Figure 15 were released for live finger The green LED of survey and nearly IR LED, wherein finger tissue consumingly absorbs green light so that finger-image show it is desired big Brightness step, and near-ir light completely extends across finger and illuminates, so that finger-image brightness seems more evenly.
Optical filtering for reducing bias light can be set with various optical sensor modules disclosed in this document Meter is to realize.Although the overall goal for being inserted into optical filter in the optical path of optical sensor module is refusal ambient light wave It is long, for example, near-infrared IR light and part feux rouges and other undesirable wavelength, but the specific implementation of this optical filter Mode can based on each application it is specific needs and change.This optical filter can be by leading to fluorescence detector battle array Optical filter coating is formed on the selected surface of optical element in the optical path of column to be formed, which includes for example Show bottom surface, the surface of other optical components of optical prism, upper sensor surface of optical detector array etc..Example Such as, finger absorbs the energy of most of wavelength under specific wavelength (for example, about~580nm), if optical filter is designed as Refuse the light in the wavelength from wavelength near about~580nm to infrared ray, then undesirable environment shadow sound can drop significantly It is low.
Figure 43 show at several different optical wavelengths from about 525nm to about 940nm typical mankind's thumb and The example of the optical transmission spectra profile of little finger.The wavelength of 610nm is less than for short wavelength, such as wavelength, less than 0.5% Environment light can pass through finger.The light transmissivity with higher of the longer wavelength of feux rouges and near-ir light etc..Due to finger tissue Scattering, the transmission direction range across the environment light of finger becomes larger, so as to shield lower optical sensor module to be detected Signal light mixing.When being operated under sunlight, since the optical power of sunlight is higher, it is possible to which processing comes from the sun with caution Light is not required to desired environment light, to reduce the adverse effect to optical fingerprint sensor performance or be minimized.
Figure 44 shows the influence for shielding the bias light in lower optical sensor module 4400.Optical finger print may be sensed and be produced The undesirable environment light of raw adverse effect can pass through different paths and reach 4400: certain environment light of optical fingerprint sensor (such as light 4410) passes through finger via top clear 431 (such as light 4410a) and LCD module 433 (such as light 4410b) enter optical fingerprint sensor 4400 (Class1), and certain ambient light (such as light 4420) is not passed through finger But enter optical fingerprint sensor 4400 (type 2) from one or more sides around finger, such as in top clear 431 Light 4420a and LCD module 433 in light 4420b.
Under the screen for fingerprint sensing shown in optical sensor module 4400, sensor package or shell 4402 It can be formed in the outside for shielding lower optical sensor module 4400, and may include as the optically opaque of background obstacle Or absorbing material, at least for stopping some incident bias lights with large angle incidence, this incidence bias light is not passed through finger But enter optical fingerprint sensor 4400 from one or more sides around finger.
For passing through the environment light 4410 for the Class1 that finger is propagated, some light in finger incident light 4410, so that A part of the light 4410a of Class1 reaches cover-plate glass 431 through finger, reaches LCD module 433 subsequently through cover glass 431 In LCD layer.A part of the light 4410b of this Class1 passes through LCD layer and enters optical fingerprint sensor package 4400/ 4402, and this part light generally includes into the incoming ambient light of big incidence angle.
Optical fingerprint sensor package 4402 can be designed as by providing optical window at top spatially to hinder The some light kept off into the incoming ambient light of wide-angle enter optical fingerprint sensor 4400, carry out free sensor envelope to receive Most of incident light above optical window that dress cover 4402 is formed, engages (example with the bottom of LCD module 433 so that only opening Such as bonding) the top side of optical sensor module 4400 receive light, and sensor base and side wall be not it is optically transparent, In this way, reducing the environment light that can enter optical fingerprint sensor.Therefore, for be at first not transmitted through finger but enter optics The environment light (such as environment light of type 2) of sensor module, the package of optical sensor module can be designed as utilizing light Side wall or appropriately designed optics receiver hole is stopped to provide absorption or blocking to this light, so that the light reaches reception optics It is absorbed or stops when device material or encapsulating material.
Undesirable environment light may include different wavelength components, therefore when realizing disclosed technology, to this Different environment light components can carry out different disposal, to reduce their influences to optical finger print sensing.For example, undesirable Environment light may include (1) with red wavelength (being greater than 580nm) and more long wavelength (such as infrared light) through finger Light component and (2) do not penetrate the light component of finger with the wavelength (for example, being less than 580nm) shorter than red wavelength.Due to Figure 43 Shown in finger the absorption dependent on wavelength, the environment light across the transmission of finger generally includes some near-ir lights and feux rouges Part light in component.Therefore, it may include optical filtering in optical fingerprint sensor package, can in addition enter light to filter out Learn the undesirable environment light of detector array.
Example design is using one or more layers IR barrier filters coating, such as IR- cut-off filter coating, to subtract IR light or near-ir light in the light of few transmission from finger.However, the various IR- cut-off filters for imaging device are usual Only wavelength-limited is greater than the wavelength of 710nm.When equipment is exposed under direct or indirect sunlight, this strainability may not It is enough to reduce IR bias light when optical finger print sensing.In some applications, suitable IR filtering coatings should end short end Wavelength extends below the shorter wavelength of 710nm, such as 610nm.
Due to stopping or ending the spectral response of coating there are various IR, there is the list for the work belt for extending to shorter wavelength A IR cut-off filter may not be able to provide desired IR barrier properties.In some filtering for optical sensor module under shielding In device design, two or more optical filters can be applied in combination, to realize desired IR resistance in sensor optical path Keep off performance.Using this two kinds or the reason in part for more than two filter is the strong background in the presence of the natural daylight from the sun Light, this is an important technical problem.In the example of disclosed optical sensor below LCD module, optical filtering machine System, which can be built in, shields in optical sensor lamination down, to stop or reduce the entrance optical detection of the natural daylight from the sun The strong bias light of device array 600a.Therefore, one or more optical filter layers are desirably integrated into above optical detector array Screen under in optical sensor lamination, to stop the undesirable background daylight from the sun, while being allowed for optical finger print The illumination light of sensing is passed through to reach optical detector array.
For example, in some implementations, one or more optics for reducing undesirable IR environment/bias light are filtered Wave device can be placed between LCD module and optical detector array, and with the detection light to return, (such as wavelength is arrived in 400nm Between 650nm or other detection wavelength detection light) optical transmission is carried out, while stopping light of the optical wavelength greater than 650nm, Including the strong IR light in daylight.In fact, some commercial optical filters have transmission bands, this transmission bands are in this document It for the specific application of optical sensor may be unwanted under disclosed screen.For example, some business multilayer band pass filters It can stop the light of wavelength 600nm or more, but have transmission peaks, such as 630nm in the spectral region more than wavelength 600nm Optical transmission band between 900nm.The strong bias light in daylight in this optical transmission band can be passed through and be examined up to optics Device array is surveyed, and is had an adverse effect to the optical detection sensed for optical finger print.By that will have different spectral regions Two or more difference optical filters are combined, and can eliminate or reduce in this optical filter not expecting Optical transmission band so that wavelength is eliminated jointly or reduced to combination two or two filters in 630nm between 900nm Undesirable light transmission band, wherein undesirable optical transmission band may be at another optical filter in a filter Optical barrier spectral region in.Specifically, for example, carrying out wavelength-filtered from 610nm to 1100nm by using a filter Light, while transmission peak wavelength carrys out wavelength-filtered from 700nm to 1100nm in 610nm visible light below and another filter Offset spectral region in light, while transmission peak wavelength can play two filter banks in 700nm visible light below Come.This combination of two or more optical filters can be used for generating to the optical wavelength for being greater than high transmission wavelength The desired refusal of bias light.This optical filter, which can be used as, is formed in figure layer in LCD module and optical sensor module Between different location at.
In some implementations, when using two or more optical filters disclosed above, Ke Yi Optical absorbing material is filled between two filters, is suitably absorbed with the light belt to refusal, so that in two optically filterings The light of roundtrip can be absorbed between device.For example, the blue tinted glass with high-absorbility of the wavelength from 610nm to 1100nm Piece may be used as the substrate of filter, and two filters are covered and are coated in the upper and lower surface of blue tinted glass, and this component can be with As the gasket or protection materials above optical sensor module.
In addition to being utilized in optical sensor module under screen for ending the appropriate of the bias light in red and IR range Outside optical filtering, bias light can also include the light in shorter wavelength spectral region (including UV wavelength).In some realization sides In formula, it should the environment light in UV band is reduced or eliminated, this is because the light belt generates noise in optical sensing.This UV Eliminate can be by using one or more layers UV to end optical coating or UV in the detection optical path above optical sensor module Absorbing material is realized.Finger tissue, silicon and black ink etc. are easy to absorb UV light strongly.The material absorption of UV light can be used to reduce The influence that UV light senses optical finger print.
Figure 45 shows for the optical filtering under the design screen in above-mentioned light in optical sensor module and reduces back The example of the algorithm for design of scape light.Therefore, in addition to designing suitable optical filter in the optical path to optical sensor module Outside, the fluorescence detector battle array that the additional design feature for being used to reduce bias light can also be added in optical sensor module In the design for receiving optical device of column.When operating this optical sensor module, can will via operation control and signal It handles these optical filterings for considering and is further reduced bias light and is combined, to realize desired optical sensing performance.
The optical sensing under the screen with optics collimator array or optics pinhole array before optical detector array In device module, optics collimator array or optics pinhole array are a part for receiving optical device, and can have been designed small Optical numerical aperture, with reduce enter optical detector array bias light.
Figure 46 shows two examples in Figure 46 A and 46B.
6A referring to fig. 4, collimator pin hole 4651 can be designed as being optically transparent, collimator wall material in detection light belt Material 4653 can choose to absorb the light 4655 for reaching wall.It can be formed if collimator material is silicon, on each wall black The light-absorbing coating of change.
The pinhole array of 6B referring to fig. 4, the pin hole 4659 as a part for receiving optical device can be configured to have There is effective numerical aperture, to stop that there is the environment light of big incidence angle.The photoresist layer of array with aperture limiting holes 4661 It can be formed in below the array of pin hole 4659, allow the light 4667 outside effective numerical aperture by with hole limiting holes 4461 Photoresist layer opaque section stop.Form 4663 He of material of image camera pin hole 4659 and aperture limiting holes 4661 4665 can be light-proof material or optical absorbing material, such as the optical reflectors such as black ink or metal film.
In some implementations, one or more optical filters may be used as being used to support pinhole camera type optics device The substrate of part is combined or integrated into multiple function parts in one hardware.This different background light reduces mechanism Integrated or combination can reduce equipment cost, and device thickness can also be reduced.
Optical sensor module under screen also can use sensor initialization process to operate, to reduce undesirable back The influence of scape light.Technology as shown in Figure 12 and Figure 13, this sensor initialization process are substantially for operating.Figure 47 The example of this sensor initialization process is shown, sensor initialization process measurement optics inspection when obtaining fingerprint every time The baseline background surveyed at device array is horizontal.Before executing actual fingerprint sensing, in the darkroom that no any environment shadow is rung In environment, open be used for optical sensing illumination light or optical detection light, finger simulator device be placed on cover-plate glass with Recording image data.Finger simulator device is designed to simulation finger skin reflex behavior, but the finger simulator device does not have Any fingerprint pattern.Be saved in the image data obtained from finger simulator device as 1 data of radix in memory, with Bias light reduction processing is carried out in true sensing operation.The process can be the equipment completed before Transporting equipment in factory Calibration process.
In real time fingerprint sensing, there are environment influences.In operation, it is first shut off illumination light or optical detection light, with note Image data is recorded as radix 2, which obtained under conditions of having environment light.The radix 2 indicates that all environment light are residual Stay total influence of object.The summation of radix 1 and radix 2 is real-time radix.Next, opening illumination light or optical detection light to execute Fingerprint sensing, to acquire live signal, which is mixed with actual fingerprint signal and real-time radix from fingerprint.It can be with Difference is carried out between signal mixing and in real time radix, as a part of signal processing, to reduce the signal from environment light It influences, it is hereby achieved that the picture quality of fingerprint image.
Figure 47 the examples discussed show a kind of for operating the electronic equipment that can detect fingerprint by optical sensing Method is generated by operating the optical sensor module below the touch display panel for providing touch-sensing operation for the equipment The detection light of the top clear of the touch display panel is illuminated, to operate the optical detector array in optical sensor module To obtain the first image of the return detection light from the top clear.This method includes in operation optical sensor module Optical detector array simultaneously closes off the detection light, and bright touch of any detection illumination is not had to obtain only environment light and is shown Show the second image under the illumination of the top clear of panel;And the first image and the second image are handled, with eliminating equipment The influence of environment light in image operation.
Based on above-mentioned, not phase of the bias light to the performance for shielding lower optical sensor module can be mitigated with different technologies The influence of prestige, these technologies include implementing optical filtering in the optical path to optical detector array to reduce bias light, design Bias light is reduced for the reception optical device of optical detector array or controls optical sensor module and signal processing Operation is to further decrease influence of the bias light to optical sensing performance.These different technologies can be used alone and can also tie It closes and uses, to meet desired equipment performance.
Above-mentioned example for reducing the technology of bias light or environment light is normally based on blocking or wiping out background light or ring Border light reaches optical sensor module under LCD.However, reaching the top glass surface at fingerprint sensing region through finger The a part of of bias light can carry finger print information, and therefore can be used for fingerprint sensing.Refer back to Figure 44, wherein penetrate hand The one of the background light 4410b of the Class1 of finger and this background light 4410b at the top of optical sensor module 4400 Partial wavelength is in 540nm as shown in figure 43 between 950nm.At the top that can detecte optical sensor module 4400 Background light 4410b is for optical finger print sensing sensing, this is because wavelength can be in 650nm to the bias light between 950nm It is transferred in finger tissue, and passes through the cutin Es-region propagations of finger skin, by as caused by fingerprint ridge region and paddy region Finger print information is imprinted on the bias light by the internal structure change inside finger skin, and this internal structure change is shown as Optical signal with different brightness, this luminance contrast, which is used as, to be absorbed by finger tissue, reflected and reflected, finger skin structure Fingerprint pattern caused by optical reflection difference at shade and/or finger skin, it is possible to which detection is in optical sensor module Background light 4410b at 4400 top.
Using wavelength in 650nm to the light between 950nm by the transmission of finger tissue to obtain this of finger print information Technology with as shown in Fig. 5 A, Fig. 5 B and Fig. 5 C based on by outside finger finger ridge and the surface topography pattern that is formed of paddy cause Reflected light technology it is different.When relying on the surface reflection at finger shown in Fig. 5 A, Fig. 5 B and Fig. 5 C, finger and top Other materials (" the dirty hand of existing water or sweat (" wet finger contact situation ") or such as foul or fragment between glass surface Abutment situation ") it can change optical reflection and cause the undesirable variation of picture contrast, to be produced to fingerprint sensing performance Raw adverse effect.With as shown in Fig. 5 A, Fig. 5 B and Fig. 5 C based on by the finger ridge and the surface topography that is formed of paddy outside finger The optical finger print sensing of the light reflected caused by pattern is compared, and the fingerprint pattern obtained via finger interior structure change is used One of advantage of light of optical delivery is that optical finger print, which is sensed, contacts shape to the surface of the finger contacted with top glass surface Condition is less sensitive.
Using this bias light for optical finger print sensing, there are technological challenges.For example, bias light can be such as too The strong light of sunlight, and the fluorescence detector in optic sensor array 4400 can be made to be saturated.However, it will be recognized that tool There is the equipment of LCD display also to may be constructed such that LCD layer such as with liquid crystal cells, it is special certain optical deliveries are presented Property, facilitate mitigate in LCD optical sensing bias light or environment light adverse effect, while using optical wavelength 650nm extremely The background light 4410b at the top of optical sensor module 4400 between 950nm carries out fingerprint sensing.For example, tool Having the LCD layer of two optical polarization layers in front and back on opposite sides in lc unit layer can be designed as selectively stopping or reducing The optical delivery of certain bias lights in limit of visible spectrum and UV spectral region reaches optical sensor module under LCD, simultaneously Allow optical wavelength in 650nm to the background light 4410b's at the top of optical sensor module 4400 between 950nm A part carries out fingerprint sensing.As specific example, there is the optical polarization before and after two opposite sides of lc unit layer The LCD layer of layer can be designed as when lc unit switchs to close pattern to stop optical delivery, and visible light or wavelength is stopped to be less than The light of 650nm, while still transmitting the light of longer wavelength, such as 800nm or longer wavelength.In lc unit everywhere in Yu Feichuan This operation of the LCD module of defeated close pattern can be used for reducing the total amount that bias light reaches optical sensor module 4400, together When allow optical sensor module 4400 to carry out optical sensing using a part for the bias light 440b for carrying fingerprint.This Under design, the probe source 436a for optical sensing should be designed as issuing the detection light within the scope of longer wavelength, wherein locating It is transparent to prevent the lc unit of optical delivery from still can be in close pattern, to allow the transmission of the light of longer wavelength, example Such as 800nm or longer wavelength.For example, the probe source 436a for optical sensing can be designed as issuing wavelength 850nm's Light is detected, finger is illuminated with the LCD layer across close pattern and passes through the LCD layer in close pattern back to optical sensor Module 4400.Using this design, when optical sensor module 4400 and detection optical module 436a are activated for fingerprint detection Or when other optical sensings, the corresponding LCD pixel in the fingerprint sensing region of peripheral display region 20 or taskbar can be closed, So that liquid crystal material and reflector film stop a part of visible band and the light in near-infrared IR band.Which improves carryings The total amount of the signal light of finger print information, while reducing the amount of the bias light at optical sensor module 4400.
In short, the probe source 436a for optical sensing can be designed as issuing 650nm for optical sensing under LCD It is used for fingerprint sensing, such as 800nm or longer wavelength to the detection light between 950nm within the scope of longer wavelength, to allow to wear The optical delivery of finger tissue is crossed, so that (1) is used to obtain the fingerprint pattern via finger interior structure change as described above Transmission light and (2) as shown in Fig. 5 A, Fig. 5 B and Fig. 5 C by the finger ridge and the surface topography map that is formed of paddy outside finger Reflection detection light caused by case may be used to optical finger print sensing.For example, the probe source 436a for optical sensing can be with It is designed as issuing the detection light that wavelength is 850nm, to obtain finger print information based on two kinds of mechanism, due in optical sensor module There is the detection light of transmission in place, to reduce the influence of undesirable wet finger contact conditions or dirty finger contact conditions.
Figure 48, which is shown, is used for fingerprint sensing in 650nm to the permeable finger tissue between 950nm using based on wavelength Detection light LCD under optical sensor module equipment example.At two different locations on top glass cover board 431 The two different probe source 436a and 4661, both different probe source 436a and 4661 for being used for optical sensing are provided It is designed specifically to generate detection light in 650nm to wavelength identical between 950nm to carry out fingerprint sensing with wavelength.First detection Light source module 436a and the optical sensor module 4820 of 433 lower section of LCD module are placed adjacent, upward with relatively small incidence angle The the first detection light for generating guidance to the fingerprint sensing region on top glass cover board 431, to generate such as Fig. 5 A, Fig. 5 B and figure It is returned shown in 5C and penetrates detection optical signal.The first detection light is also generated to be drawn by a part for the first detection light being conveyed into finger The return risen detects light.This part of first detection light of finger interior is scattered back to come by finger tissue, and again passes through finger, To by being printed with fingerprint pattern across the finger surface contacted with top glass cover board 431.First detection light this two A part is guided to optical detector array by the reception optical device of optical sensor module 4820 for optical sensing.Figure 48 In the first detection light is not shown.
Second probe source module 4661 is located at 431 lower section of top glass cover board, but far from top glass cover board 431 Fingerprint sensing region makes the second probe source module 4661 generate the second detection light 4661a, and detects light 4661a for second It guides at big incidence angle to the fingerprint sensing region on top glass cover board, therefore, optics of the second detection light at surface is anti- Optical sensor module 4820 will not largely be entered by penetrating.However, a part of the second detection light 4461a at surface is thoroughly Enter finger, and this part of the second detection light 4461a of finger interior is scattered back by finger tissue as 4661b, and again It is secondary to pass through finger, thus by being printed with fingerprint pattern across the finger surface contacted with top glass cover board 431.By second The signal detection light 4661b caused by detection light 4661 is guided by the reception optical device of optical sensor module 4820 to optics Detector array is used for optical sensing.
Therefore, optical sensor module 4820 not only receives the detection optical signal from two different probe sources, and And also receive the identical fingerprint pattern information of the light finger interaction from following two type: (1) table of the ridge of finger and paddy The interaction of the external structure of face reflection and (2) finger associated with the ridge of finger and paddy.Thus have be configured to It is provided in identical LCD panel in the equipment of the LCD panel of main viewing area and peripheral viewing area or aobvious with single area is configured to Show and produce improved optical sensing in the equipment of the LCD panel of device,.
Figure 49 shows the device examples that the detection light design in Figure 48 is implemented in Figure 42 with LCD display Particular example, the LCD display are configured to provide main viewing area and peripheral viewing area in identical LCD panel.Make having The equipment in the mirror 617p and lens 617q of a part and Figure 42 of light source 436a and 4661 to receive optical device is shown Two different probe source 436a and 4661 are provided in example for optical sensing.First probe source module 436a and LCD mould The optical sensor module 4820 of 433 lower section of block is placed adjacent, to generate the detection optical signal of following two type: (1) coming from As described in Figure 42 and the reflection of the finger outer surface of label detects optical signal (drawing dotted line) and (2) by penetrating finger and being scattered back Draw afterwards across the detection light that finger enters reception optical device (mirror 617p and lens 617q) and optical detector array 612d The return detection optical signal (drawing solid line) risen.Second probe source module 4661 is placed side by side on their public affairs with LCD module 433 431 lower section of top glass cover board altogether, to generate the second detection light at big incidence angle in sense areas, to penetrate finger and scatter Back, then enter through finger and receive optical device (mirror 617p and lens 617q) and optical detector array 612d.Figure The optical reflection of the second detection light from the second probe source module 4461 is not depicted in 49, and is scattered by finger interior Caused detectable signal is shown in solid.
Although this patent document includes many details, these are not necessarily to be construed as to any invention or claimed The limitation of range, but be interpreted to can be the description of feature specific to the specific embodiment to specific invention.This patent Certain features described in file can also combine realization in a single embodiment in the context of separate embodiments.On the contrary, The various features described in the context of single embodiment can also be implemented separately in various embodiments or with any suitable Sub-portfolio form realize.Although working in certain combinations moreover, feature can be described above as, and even initially It is so claimed, but can be deleted from combination in some cases from claimed combined one or more features It removes, and claimed combination can be related to the deformation of sub-portfolio or sub-portfolio.
Similarly, although describing operation in the accompanying drawings with particular order, this should not be construed as requiring these operations The particular order shown in successively executes in sequence, or require execute it is all shown in operate, to realize desired knot Fruit.Moreover, the various individual system units in the embodiment described in this patent document should not be construed as in all implementations This separation is needed in example.
This patent document only describes several implementations and example, and can be based on describing and showing in this patent document Content out is realized, enhances and is changed to make other.

Claims (52)

1. the electronic equipment that one kind can detect fingerprint by optical sensing, comprising:
Liquid crystal display (LCD) screen, provides touch-sensing operation and including LCD display panel structure for displaying images, In, the LCD display includes the main viewing area of (1) with LCD display pixel and the periphery display with LCD display pixel Area, wherein the seamless continuous display area LCD, and (2) LCD back is collectively formed in the main viewing area and the peripheral viewing area Optical module provides the backlight for illuminating the main viewing area and the peripheral viewing area;
Specified peripheral viewing area lighting module is placed relative to the LCD screen, and is configured to generate illumination light, and The illumination light is only guided to the peripheral viewing area, so that the periphery viewing area can be aobvious independently of the main viewing area Diagram picture or information and can the LCD backlight module close when can operate to show image or information;
Top clear is formed on the LCD screen, as the user's touch interface operated for the touch-sensing and As being used for transmission the light from LCD screen so that image or information to be shown to the interface of user;And
Optical sensor module is located at below the LCD display panel structure, and is configured to receive and come from and the periphery Viewing area contact or close target simultaneously pass through the detection light of the LCD screen to detect fingerprint.
2. equipment as described in claim 1, comprising:
Control module is coupled to the main viewing area, the peripheral viewing area, the LCD backlight module and described specified outer Viewing area lighting module is enclosed, so that the specified peripheral viewing area lighting module can be when the LCD backlight module be closed The peripheral viewing area is illuminated to show image.
3. equipment as described in claim 2, in which:
The control module is configured to control peripheral viewing area display in the peripheral viewing area and places for user Finger is with the fingerprint sensing area of the fingerprint sensing for the optical sensor module.
4. equipment as described in claim 2, in which:
The control module is configured to, and no matter whether the main viewing area is illuminated, and the control peripheral viewing area, which is shown, to disappear Breath.
5. equipment as described in claim 2, in which:
The control module is configured to, and no matter whether the main viewing area is illuminated, and controls the peripheral viewing area display figure Mark, the icon allow user by touching the icon starting application or executing function.
6. equipment as described in claim 2, in which:
The control module is configured to, and no matter whether the main viewing area is illuminated, and controls the peripheral viewing area display letter Breath.
7. equipment as described in claim 2, in which:
The control module is configured to, and no matter whether the main viewing area is illuminated, and controls the peripheral viewing area described Icon set is shown at different location in peripheral viewing area, wherein icon allows user to start application by touching the icon Or execute function.
8. equipment as described in claim 7, in which:
The control module is configured to, and no matter whether the main viewing area is illuminated, control the peripheral viewing area by with Under type shows different icon sets in the peripheral viewing area: allowing one icon set of primary display, allows users to simultaneously The icon set that sliding finger is currently shown in the peripheral viewing area with using another icon set to replace.
9. equipment as described in claim 1, in which:
The specified peripheral viewing area lighting module is located in the LCD display panel structure and is located at the periphery display Above the optical sensor module in area.
10. equipment as described in claim 1, in which:
The specified peripheral viewing area lighting module is located under the LCD display panel structure in the peripheral viewing area Side.
11. equipment as described in claim 10, in which:
The specified peripheral viewing area lighting module is located at below the peripheral viewing area of the LCD display panel structure simultaneously And close to the optical sensor module.
12. equipment as described in claim 10, in which:
The LCD display panel structure includes the light diffuser layer for diffused light and is used for the LCD display panel structure In illumination light reboot the reflective optical system layer for being back to the LCD pixel of display operation,
Each layer in the light diffuser layer and the reflective optical system layer is in the optical sensor module and described specified It include hole or channel at selection area above peripheral viewing area lighting module, to allow light to be transferred to up to the optical sensing Device module and the institute for allowing the bright LCD display panel structure of illumination from the specified peripheral viewing area lighting module State the LCD pixel in peripheral viewing area.
13. equipment as described in claim 10, in which:
The LCD display panel structure includes the light diffuser layer for diffused light and is used for the LCD display panel structure In illumination light reboot the reflective optical system layer for being back to the LCD pixel of display operation,
Each layer in the light diffuser layer and the reflective optical system layer is in the optical sensor module and described specified Other parts for being different from the light diffuser layer or the reflective optical system layer above peripheral viewing area lighting module it is selected It include modifier area at region, to allow light to be transferred to up to the optical sensor module and allow from described specified LCD pixel in the peripheral viewing area of the bright LCD display panel structure of the illumination of peripheral viewing area lighting module.
14. equipment as described in claim 10, further includes:
One or more probe sources of detection light are generated, a part of the detection light passes through the LCD screen and illuminates the LCD Sensing region in the top clear of screen top,
The optical sensor module includes the optical detector array of fluorescence detector, and the optical detector array is placed For receiving the detection light for optical sensing led back to from the top clear, and
Wherein the specified peripheral viewing area lighting module is one or more below the LCD display panel structure A probe source is placed.
15. equipment as described in claim 14, in which:
The specified peripheral viewing area lighting module is located at one or more of probe sources and the optical sensor mould Between the optical detector array of block.
16. equipment as described in claim 1, in which:
The optical sensor module includes the optical detector array of fluorescence detector, and the optical detector array is placed For receiving the detection light for optical sensing led back to from the top clear;And
The optical sensor module includes lens, the lens be used for collects led back to from the top clear be used for light The detection light of sensing is learned, and the detection light being collected into is guided to the optical detector array.
17. equipment as described in claim 16, in which:
The optical sensor module includes optical reflector, and the optical reflector is located at from the top clear to described In the optical path of the detection light of lens, the detection light from the top clear is reflected towards the lens.
18. equipment as described in claim 1, in which:
The optical sensor module includes the optical detector array of fluorescence detector, and the optical detector array is placed For receiving the detection light for optical sensing led back to from the top clear;And
The optical detector array in the optical sensor module is placed not have to lens and collect the detection light.
19. equipment as described in claim 1, in which:
The optical sensor module below the LCD display panel structure is configured as the optical sensor module At least part be located at below the peripheral viewing area, the optical sensor module be configured to receive from it is described outer It enclose viewing area contact or close target and passes through the detection light of the LCD screen and detects fingerprint.
20. equipment as described in claim 1, in which:
The optical sensor module includes the optics collimator array of optics collimator and the fluorescence detector of optical sensor Array, the optics collimator array is for receiving the detection light, and the optical detector array is for receiving from described The detection light for optical sensing of optics collimator array.
21. equipment as described in claim 1, in which:
The top clear includes being touched for user with finger to carry out the specified fingerprint sensing region of fingerprint sensing;
The optical sensor module below the LCD display panel structure include contacted with panel substrate it is transparent Block, the transparent block are used to receive light from the LCD display panel structure and from top clear return, In, the optical sensor module is placed relative to the specified fingerprint sensing region, and is configured to: when the top When the skin contact of the top surface of hyaline layer and people, selectively receive the top surface from the top clear via optics standard The light of the return of straight device array.
22. the equipment as described in claim 21, in which:
The LCD display panel structure includes the light diffuser layer for diffused light, and the light diffuser layer is in the light Learning at the selection area above sensor module includes hole or channel, to allow light to be transferred to up to the optical sensor mould Block.
23. the equipment as described in claim 21, in which:
The LCD display panel structure includes being back to for rebooting the illumination light in the LCD display panel structure The reflective optical system layer of the LCD pixel of display operation, and choosing of the reflective optical system layer above the optical sensor module Determine to include hole or channel at region, to allow light to be transferred to up to the optical sensor module.
24. equipment as described in claim 1, in which:
The LCD display panel structure includes the light diffuser layer for diffused light and is formed in the LCD display panel structure Bottom section on optical reflector layer, the light diffuser layer is at the selection area above the optical sensor module Including hole, to allow light to be transferred to up to the optical sensor module, the optical reflector layer is for reflecting light back into institute State LCD display panel structure, wherein the optical reflector layer includes the selection area above the optical sensor module, To allow light to be transferred to up to the optical sensor module.
25. equipment as described in claim 1, comprising:
Equipment electronic control module is coupled to the display panel structure, to provide power supply to one or more probe sources, and The power supply of one or more of probe sources is closed in a sleep mode,
Wherein, when the optical sensor module detects people's at the specified fingerprint sensing region of the top clear Skin there are when, the equipment electronic control module is used for the LCD display panel structure from the sleep mode wakeup.
26. equipment as recited in claim 25, in which:
The equipment electronic control module is used for, when the LCD display panel structure is in the sleep pattern, described in operation One or more probe sources intermittently issue the detection light, simultaneously close off the power supply of the LCD display panel structure, by between The detection light of sending of having a rest is guided to the specified fingerprint sensing region of the top clear, to monitor whether to exist The skin of the people contacted with the specified fingerprint sensing region, with for by the equipment from the sleep mode wakeup.
27. equipment as described in claim 1, further includes:
Equipment electronic control module, if the fingerprint matching of the fingerprint and authorized user that detect, described in authorized user's access Equipment.
28. the equipment as described in claim 27, in which:
The optical sensor module is in addition to for other than detecting fingerprint, being also used to detect the life for being different from fingerprint by optical sensing Object characterization parameter, to show with the fingerprint detected associated at the top clear whether touch from living People, and
If the biochemical characterization parameter list that the fingerprint matching of the fingerprint and authorized user that (1) detect and (2) detect For the bright fingerprint detected from still-living people, the equipment electronic control module accesses the equipment for authorized user.
29. equipment as claimed in claim 28, in which:
The biochemical characterization parameter includes heartbeat.
30. equipment as claimed in claim 28, in which:
The biochemical characterization parameter includes the different optical absorption characteristics of tissue living under different detection wavelength.
31. equipment as described in claim 1, comprising:
Equipment electronic control module is coupled to the optical sensor module, passes through what the touch for sensing finger obtained to receive The information of multiple fingerprints detected, wherein the equipment electronic control module measures the variation of the multiple fingerprint detected And determine the touch force for the variation for causing to measure.
32. the equipment as described in claim 31, in which:
The variation of the multiple fingerprint detected includes the variation of the fingerprint image due to caused by the touch force, due to described The variation of the spacing of the variation or fingerprint ridge of touch area caused by touch force.
33. equipment as described in claim 1, in which:
The LCD display panel structure includes the peripheral viewing area for covering the region of the peripheral viewing area and being optically coupled Illuminating waveguide, to receive the illumination light from the specified peripheral display region lighting module, and
Periphery viewing area illuminating waveguide is configured to disperse the illumination light only to illuminate the peripheral viewing area.
34. equipment as described in claim 1, comprising:
Relative to one or more probe sources that the peripheral viewing area is placed, to generate the permeable finger in spectral region Tissue enters the detection light of finger, to cause towards the optical sensing being located at below the LCD display panel structure The detection light from finger surface reflection of device module and the detection light of the return caused by finger interior scattering.
35. the equipment as described in claim 34, in which:
The wavelength of the detection light is between 650nm to 950nm.
36. the equipment as described in claim 34, in which:
The wavelength of the detection light is between 800nm to 950nm.
37. equipment as described in claim 1, comprising:
First probe source, the LCD panel knot near the optical sensor module in the peripheral viewing area Below structure, the first detection light that the permeable finger tissue in spectral region enters finger is generated to detect wavelength, as described A part of light is detected, is caused to cause the first reflection detection light reflected from finger surface and by finger interior scattering First return detection light, it is described first reflection detection light and it is described first return detection light towards be located at the LCD display surface The optical sensor module below hardened structure;And
Second probe source is located at outside the LCD panel construction and below the top clear, to generate the light Light is detected into the second of finger in spectral limit, to cause the second return detection light caused by being scattered by the finger interior, Described second returns to the optical sensor module that detection light direction is located at below the LCD display panel structure,
Wherein, optical sensor module detection the first reflection detection light, described first return to detection light and described the Two return to the combination of detection light to carry out fingerprint sensing.
38. the electronic equipment that one kind can detect fingerprint by optical sensing, comprising:
Liquid crystal display (LCD) display panel structure, it is described for showing image or information and for providing touch-sensing operation LCD display panel structure includes LCD layer, optical diffusion layer, ducting layer and reflective optical system layer, and the LCD layer is used for through processing master Illumination backlight in viewing area and peripheral viewing area shows image or information, and the main viewing area and the peripheral viewing area are common The seamless continuous display area LCD is formed, the optical diffusion layer is for diffusing in the main viewing area and the peripheral viewing area The illumination backlight, the ducting layer is for receiving the illumination backlight and guide the illumination backlight received to institute It states main viewing area and the peripheral viewing area and the reflective optical system layer is shown for rebooting illumination backlight into the master In the LCD layer for display operation for showing area and the peripheral viewing area, the light diffuser layer and the reflective optical system Each layer in layer is configured at the selection area in the peripheral viewing area of the LCD display panel structure include hole Or channel, to allow light to be transmitted;And
LCD backlight module is coupled to the ducting layer of the LCD display panel structure, to generate to the LCD layer for showing The backlight of diagram picture or information;
Specified peripheral viewing area lighting module is placed for generating illumination light and only guides the illumination light to described outer Viewing area is enclosed, the peripheral viewing area is enable to show image or information independently of the main viewing area and can be described LCD backlight module can operate when closing to show image or information;
Top clear is formed on the LCD display panel structure, as the user's touching operated for the touch-sensing Touch interface;
Optical sensor module is located at below the LCD display panel structure, to receive from the top clear and wear The detection light of the LCD display panel structure is crossed to detect fingerprint;And
One or more probe sources are separated with the LCD backlight module, are located at below the top clear, to generate photograph The detection light in the specified fingerprint sensing region in top clear described in the bright peripheral viewing area, to be used for user Finger is placed, to sense for the optical finger print of the optical sensor module.
39. the equipment as described in claim 38, in which:
The specified peripheral viewing area lighting module is located in the LCD display panel structure and is located at the periphery display Above the optical sensor module in area.
40. the equipment as described in claim 38, in which:
The specified peripheral viewing area lighting module is located under the LCD display panel structure in the peripheral viewing area Side.
41. the equipment as described in claim 40, in which:
The optical sensor module includes the optical detector array of fluorescence detector, and the optical detector array is placed For receiving the detection light for optical sensing led back to from the top clear, and
One or more of spies of the specified peripheral viewing area lighting module below the LCD display panel structure Light source is surveyed to place.
42. the equipment as described in claim 41, in which:
The specified peripheral viewing area lighting module is located at one or more of probe sources and the optical sensor mould Between the optical detector array of block.
43. the equipment as described in claim 38, in which:
The optical sensor module includes the optical detector array of fluorescence detector, and the optical detector array is placed For receiving the detection light for optical sensing led back to from the top clear, and
The optical sensor module includes lens, the lens be used for collects led back to from the top clear be used for light The detection light of sensing is learned, and the detection light being collected into is guided to the optical detector array.
44. the equipment as described in claim 43, in which:
The optical sensor module includes optical reflector, and the optical reflector is located at from the top clear to described In the optical path of the detection light of lens, the detection light from the top clear is reflected towards the lens.
45. the equipment as described in claim 38, in which:
The optical sensor module below the LCD display panel structure is configured as the optical sensor module At least part be located at below the peripheral viewing area, the optical sensor module be configured to receive from it is described outer It enclose viewing area contact or close target and passes through the detection light of LCD screen and detects fingerprint.
46. the equipment as described in claim 38, in which:
The optical sensor module includes the optics collimator array of optics collimator and the fluorescence detector of optical sensor Array, the optics collimator array is for receiving the detection light, and the optical detector array is for receiving from described The detection light for optical sensing of optics collimator.
47. the equipment as described in claim 38, in which:
One or more of probe sources generate the detection light with different optical wavelengths, so that the optical sensor mould Block acquisition is reflected described different by the target contacted with the specified fingerprint sensing region in the top clear The optical characteristics in detection light under optical wavelength, and
Device control module can be operated to handle the detection under the different optical wavelength of acquisition reflected by the target The optical characteristics in light determines whether the target is the finger of people of living.
48. the equipment as described in claim 38, in which:
The LCD display panel structure includes the peripheral viewing area for covering the region of the peripheral viewing area and being optically coupled Illuminating waveguide, to receive the illumination light from the specified peripheral display region lighting module, and
Periphery viewing area illuminating waveguide is configured to disperse the illumination light only to illuminate the peripheral viewing area.
49. the equipment as described in claim 38, in which:
Each probe source is configured to generate the detection light that the permeable finger tissue in spectral region enters finger, with Cause the spy from finger surface reflection towards the optical sensor module being located at below the LCD display panel structure The detection light surveying light and being returned caused by being scattered by the finger interior.
50. the equipment as described in claim 49, in which:
The wavelength of the detection light is between 650nm to 950nm.
51. the equipment as described in claim 49, in which:
The wavelength of the detection light is between 800nm to 950nm.
52. the equipment as described in claim 38, in which:
First probe source is located at the LCD panel construction near the optical sensor module in the peripheral viewing area Lower section generates the first detection light that the permeable finger tissue in spectral region enters finger to detect wavelength, as the spy A part of light is surveyed, to cause the first reflection detection light reflected from finger surface and as caused by finger interior scattering First returns to detection light, and described first, which reflects detection light and described first, returns to detection light towards positioned at the LCD display panel The optical sensor module below structure;And
Second probe source is located at outside the LCD panel construction and below the top clear, to generate the light Light is detected into the second of finger in spectral limit, to cause the second return detection light caused by being scattered by the finger interior, Described second returns to the optical sensor module that detection light direction is located at below the LCD display panel structure,
Wherein, optical sensor module detection the first reflection detection light, described first return to detection light and described the Two return to the combination of detection light to carry out fingerprint sensing.
CN201880003627.9A 2017-03-07 2018-03-07 Device with peripheral taskbar display and LCD underscreen optical sensor module for on-screen fingerprint sensing Active CN109791325B (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201762468337P 2017-03-07 2017-03-07
US62/468,337 2017-03-07
US15/708,088 US10410033B2 (en) 2015-06-18 2017-09-18 Under-LCD screen optical sensor module for on-screen fingerprint sensing
US15/708,088 2017-09-18
PCT/CN2018/078360 WO2018161923A1 (en) 2017-03-07 2018-03-07 Devices with peripheral task bar display zone and under-lcd screen optical sensor module for on-screen fingerprint sensing

Publications (2)

Publication Number Publication Date
CN109791325A true CN109791325A (en) 2019-05-21
CN109791325B CN109791325B (en) 2022-02-08

Family

ID=63447336

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880003627.9A Active CN109791325B (en) 2017-03-07 2018-03-07 Device with peripheral taskbar display and LCD underscreen optical sensor module for on-screen fingerprint sensing

Country Status (3)

Country Link
EP (1) EP3504588A4 (en)
CN (1) CN109791325B (en)
WO (1) WO2018161923A1 (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110376780A (en) * 2019-07-20 2019-10-25 深圳阜时科技有限公司 Shield lower detection system, liquid crystal display device and backlight module
CN110458151A (en) * 2019-07-29 2019-11-15 深圳阜时科技有限公司 A kind of fingerprint acquisition apparatus and electronic equipment
CN111178164A (en) * 2019-12-12 2020-05-19 武汉华星光电技术有限公司 Optical fingerprint identification device under screen
CN112785929A (en) * 2019-11-07 2021-05-11 三星显示有限公司 Display device and method for driving the same
TWI733427B (en) * 2019-08-16 2021-07-11 神盾股份有限公司 Fingerprint sensing apparatus
TWI747096B (en) * 2018-12-07 2021-11-21 大陸商上海耕岩智能科技有限公司 Fingerprint identification method and device, storage medium and fingerprint identification equipment
CN113808549A (en) * 2020-06-11 2021-12-17 北京小米移动软件有限公司 Brightness adjusting method and device for LCD display screen, electronic equipment and medium
CN114375417A (en) * 2019-09-24 2022-04-19 贝尔-赫拉恒温控制有限公司 Display device with integrated optically operated proximity sensor system
US11422661B2 (en) 2019-04-05 2022-08-23 Apple Inc. Sensing system for detection of light incident to a light emitting layer of an electronic device display
US11487859B2 (en) 2020-07-31 2022-11-01 Apple Inc. Behind display polarized optical transceiver
US11527582B1 (en) 2019-09-24 2022-12-13 Apple Inc. Display stack with integrated photodetectors
US11592873B2 (en) 2020-02-14 2023-02-28 Apple Inc. Display stack topologies for under-display optical transceivers
US11611058B2 (en) 2019-09-24 2023-03-21 Apple Inc. Devices and systems for under display image sensor
US11839133B2 (en) 2021-03-12 2023-12-05 Apple Inc. Organic photodetectors for in-cell optical sensing

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200075548A (en) * 2018-12-18 2020-06-26 엘지디스플레이 주식회사 Display device
US20200327300A1 (en) * 2019-04-10 2020-10-15 Shenzhen GOODIX Technology Co., Ltd. Optical id sensing using illumination light sources positioned at a periphery of a display screen
CN110290243B (en) * 2019-06-24 2022-07-08 Oppo广东移动通信有限公司 Display device, electronic apparatus, and image acquisition method
WO2021023361A1 (en) * 2019-08-02 2021-02-11 Huawei Technologies Co., Ltd. Mobile phone colorized displays to conceal optical devices
CN110427919A (en) * 2019-08-16 2019-11-08 深圳阜时科技有限公司 Optical detection apparatus
CN110458148A (en) * 2019-08-31 2019-11-15 深圳阜时科技有限公司 Optical detection apparatus
CN111339916B (en) * 2020-02-24 2023-08-11 京东方科技集团股份有限公司 Pixel circuit, driving method thereof and display panel
CN111967411B (en) * 2020-08-21 2024-02-02 合肥维信诺科技有限公司 Display device
CN218825596U (en) * 2022-05-11 2023-04-07 指纹卡安娜卡敦知识产权有限公司 Optical fingerprint sensor and electronic device

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001069520A2 (en) * 2000-03-10 2001-09-20 Ethentica, Inc. Biometric sensor
US20090300539A1 (en) * 1993-12-02 2009-12-03 Discovery Communications, Inc. Electronic book with information manipulation features
WO2011110821A1 (en) * 2010-03-12 2011-09-15 Milan Momcilo Popovich Biometric sensor
CN102906627A (en) * 2010-05-21 2013-01-30 皇家飞利浦电子股份有限公司 Multi-view display device
US20130120760A1 (en) * 2011-11-11 2013-05-16 Daniel H. Raguin Ambient light rejection for non-imaging contact sensors
US20140218327A1 (en) * 2012-04-29 2014-08-07 Weidong Shi Method and Apparatuses of Transparent Fingerprint Imager Integrated with Touch Display Device
CN104509174A (en) * 2012-06-15 2015-04-08 诺基亚公司 Method and apparatus for providing mixed-reality connectivity assistance
CN105229707A (en) * 2013-03-22 2016-01-06 诺基亚技术有限公司 For providing the method and apparatus of the local synchronization of the information of augmented reality object
US20160004899A1 (en) * 2014-07-07 2016-01-07 Goodix Technology Inc. Integration of touch screen and fingerprint sensor assembly
CN105718134A (en) * 2014-12-19 2016-06-29 Lg电子株式会社 Mobile terminal

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103458073B (en) * 2013-08-23 2015-12-23 深圳欧菲光科技股份有限公司 Contact panel, touching display screen and mobile phone thereof
CN107040621A (en) * 2014-06-16 2017-08-11 深圳市汇顶科技股份有限公司 A kind of mobile terminal
CN105094443A (en) * 2015-08-21 2015-11-25 深圳市汇顶科技股份有限公司 Touch pressure detecting device and method

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090300539A1 (en) * 1993-12-02 2009-12-03 Discovery Communications, Inc. Electronic book with information manipulation features
WO2001069520A2 (en) * 2000-03-10 2001-09-20 Ethentica, Inc. Biometric sensor
WO2011110821A1 (en) * 2010-03-12 2011-09-15 Milan Momcilo Popovich Biometric sensor
CN102906627A (en) * 2010-05-21 2013-01-30 皇家飞利浦电子股份有限公司 Multi-view display device
US20130120760A1 (en) * 2011-11-11 2013-05-16 Daniel H. Raguin Ambient light rejection for non-imaging contact sensors
US20140218327A1 (en) * 2012-04-29 2014-08-07 Weidong Shi Method and Apparatuses of Transparent Fingerprint Imager Integrated with Touch Display Device
CN104509174A (en) * 2012-06-15 2015-04-08 诺基亚公司 Method and apparatus for providing mixed-reality connectivity assistance
CN105229707A (en) * 2013-03-22 2016-01-06 诺基亚技术有限公司 For providing the method and apparatus of the local synchronization of the information of augmented reality object
US20160004899A1 (en) * 2014-07-07 2016-01-07 Goodix Technology Inc. Integration of touch screen and fingerprint sensor assembly
CN105718134A (en) * 2014-12-19 2016-06-29 Lg电子株式会社 Mobile terminal

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI747096B (en) * 2018-12-07 2021-11-21 大陸商上海耕岩智能科技有限公司 Fingerprint identification method and device, storage medium and fingerprint identification equipment
US11422661B2 (en) 2019-04-05 2022-08-23 Apple Inc. Sensing system for detection of light incident to a light emitting layer of an electronic device display
CN110376780B (en) * 2019-07-20 2024-04-02 深圳阜时科技有限公司 Under-screen detection system, liquid crystal display device and backlight module
CN110376780A (en) * 2019-07-20 2019-10-25 深圳阜时科技有限公司 Shield lower detection system, liquid crystal display device and backlight module
CN110458151A (en) * 2019-07-29 2019-11-15 深圳阜时科技有限公司 A kind of fingerprint acquisition apparatus and electronic equipment
CN110458150A (en) * 2019-07-29 2019-11-15 深圳阜时科技有限公司 Sensing device and electronic equipment under a kind of screen
CN110516657A (en) * 2019-07-29 2019-11-29 深圳阜时科技有限公司 Sensing device and electronic equipment under a kind of screen
TWI733427B (en) * 2019-08-16 2021-07-11 神盾股份有限公司 Fingerprint sensing apparatus
US11611058B2 (en) 2019-09-24 2023-03-21 Apple Inc. Devices and systems for under display image sensor
CN114375417A (en) * 2019-09-24 2022-04-19 贝尔-赫拉恒温控制有限公司 Display device with integrated optically operated proximity sensor system
US11527582B1 (en) 2019-09-24 2022-12-13 Apple Inc. Display stack with integrated photodetectors
CN112785929A (en) * 2019-11-07 2021-05-11 三星显示有限公司 Display device and method for driving the same
CN111178164B (en) * 2019-12-12 2022-04-05 武汉华星光电技术有限公司 Optical fingerprint identification device under screen
CN111178164A (en) * 2019-12-12 2020-05-19 武汉华星光电技术有限公司 Optical fingerprint identification device under screen
US11592873B2 (en) 2020-02-14 2023-02-28 Apple Inc. Display stack topologies for under-display optical transceivers
CN113808549A (en) * 2020-06-11 2021-12-17 北京小米移动软件有限公司 Brightness adjusting method and device for LCD display screen, electronic equipment and medium
US11487859B2 (en) 2020-07-31 2022-11-01 Apple Inc. Behind display polarized optical transceiver
US11839133B2 (en) 2021-03-12 2023-12-05 Apple Inc. Organic photodetectors for in-cell optical sensing

Also Published As

Publication number Publication date
EP3504588A1 (en) 2019-07-03
WO2018161923A1 (en) 2018-09-13
EP3504588A4 (en) 2019-10-23
CN109791325B (en) 2022-02-08

Similar Documents

Publication Publication Date Title
CN109791325A (en) Optical sensor module under equipment with periphery tasks column viewing area and the LCD screen for shielding upper fingerprint sensing
CN209640882U (en) Optical sensor arrangement and electronic equipment
US11030434B2 (en) Lens-pinhole array designs in ultra thin under screen optical sensors for on-screen fingerprint sensing
US11048903B2 (en) Under-LCD screen optical sensor module for on-screen fingerprint sensing
US10318791B2 (en) Anti-spoofing sensing for rejecting fake fingerprint patterns in under-screen optical sensor module for on-screen fingerprint sensing
US10614283B2 (en) Devices with peripheral task bar display zone and under-LCD screen optical sensor module for on-screen fingerprint sensing
US10984213B2 (en) 3-dimensional optical topographical sensing of fingerprints using under-screen optical sensor module
US10331939B2 (en) Multi-layer optical designs of under-screen optical sensor module having spaced optical collimator array and optical sensor array for on-screen fingerprint sensing
CN109196525A (en) Refuse the anti-spoofing sensing of false fingerprint pattern in optical sensor module under the screen for shielding upper fingerprint sensing
US10410037B2 (en) Under-screen optical sensor module for on-screen fingerprint sensing implementing imaging lens, extra illumination or optical collimator array
US10410036B2 (en) Under-screen optical sensor module for on-screen fingerprint sensing
CN109791599A (en) Optical sensor module under the screen that fingerprint incudes on screen
EP3254235B1 (en) Under-screen optical sensor module for on-screen fingerprint sensing
CN109074495A (en) Improve the optical sensing performance of optical sensor module under the screen for shielding upper fingerprint sensing
EP3465399B1 (en) Optical collimators for under-screen optical sensor module for on-screen fingerprint sensing
CN109196524A (en) Optical imagery under screen in equipment with Organic Light Emitting Diode (OLED) screen or other screens for shielding upper fingerprint sensing in optical sensor module via imaging len and image pinhole
CN109154959A (en) Optical fingerprint sensor with non-contact imaging capability
CN109154961A (en) Optics fingerprint sensing in LCD screen based on the optical imagery for utilizing lens-pinhole module and other optical designs

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant